Beschreibung
Job Description:Experienced Cloudera Hadoop Administrator who will be part of a global team responsible for implementation and ongoing administration of CS Big Data infrastructure
Skill requirements:
. Intimate knowledge of non-root installation with fully integrated AD/Kerberos authentication
. Working with data delivery teams to setup new Hadoop clusters. This job includes setting up Kerberos principals and testing
. Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Accumulo, Impala, Hue, Spark (and Spark streaming), Solr, Hive, Kafka, Pig, YARN, ZooKeeper and Postgres
. Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise
. Performance tuning of Hadoop clusters and Spark Streaming routines
. Screen Spark cluster job performances and capacity planning
. Monitor Hadoop cluster connectivity and security
. Manage, Troubleshoot and review Hadoop log files
. Workload management, load balancing, quota management of the Cloudera cluster
. Setting up disaster recovery on Cloudera cluster including HDFS, HBase, Kafka, Flume and Spark streaming workload
. Performance tuning of Spark streaming and HBase queries
. Eyes-on-glass cluster monitoring and responding to internal tickets and email alerts. File system management and monitoring
. Setup Splunk monitoring
. HDFS and other Cloudera Hadoop components support and maintenance
. Diligently teaming with the infrastructure, network, database, application and Business Intelligence teams to guarantee high data quality and availability
. Collaborating with application teams to install Hadoop updates, patches, version upgrades when required
. Aligning with the engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
. Point of Contact for Vendor escalation
. Good communication skills
. Good understanding (preferably experience) of application integration/SOA, DevOps and Continuous Integration
. Understand and experience of working on Palantir Foundry platform is preferable.