Beschreibung
Cloudera Hadoop Admin - Zurich - 6 months - 450 CHF per day
I am working with a global business based in Zurich who are looking to hire multiple Cloudera Hadoop Administrators who will be responsible for the implementation and ongoing administration of the Big Data infrastructure.
The Hadoop Administrator will be required to have the following skills:
- Intimate knowledge of non-root installation with fully integrated AD/Kerberos authentication
- Working with data delivery teams to setup new Hadoop clusters. This job includes setting up Kerberos principals and testing
- Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Accumulo, Impala, Hue, Spark (and Spark streaming), Solr, Hive, Kafka, Pig, YARN, ZooKeeper and Postgres
- Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise
- Performance tuning of Hadoop clusters and Spark Streaming routines
- Screen Spark cluster job performances and capacity planning
- Monitor Hadoop cluster connectivity and security
- Manage, Troubleshoot and review Hadoop log files
- Workload management, load balancing, quota management of the Cloudera cluster
- Setting up disaster recovery on Cloudera cluster including HDFS, HBase, Kafka, Flume and Spark streaming workload
- Performance tuning of Spark streaming and HBase queries
- Eyes-on-glass cluster monitoring and responding to internal tickets and email alerts. File system management and monitoring
- Setup Splunk monitoring
- HDFS and other Cloudera Hadoop components support and maintenance
- Diligently teaming with the infrastructure, network, database, application and Business Intelligence teams to guarantee high data quality and availability
- Collaborating with application teams to install Hadoop updates, patches, version upgrades when required
- Aligning with the engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
- Point of Contact for Vendor escalation
- Good communication skills
- Good understanding (preferably experience) of application integration/SOA, DevOps and Continuous Integration
- Understand and experience of working on Palantir Foundry platform is preferable.
Please get your CV in for instant review.