Vor Ort

Senior Data Engineer

Zürich

Beschreibung

Location / Remote Working: Zurich, Switzerland (3 days minimum onsite)

Pay Rate: (Swiss Francs)

We are currently looking for an experienced data engineer for one of our clients in the banking domain. They need someone who will help build new or improve existing data pipelines. You should be comfortable working with large or fast-moving data, have a solid understanding of distributed processing frameworks, and a software engineering mindset!

Responsibilities:
  • Responsible to ingest data from files, streams and databases. Process the data using Spark, Python
  • Develop programs in PySpark and Python as part of data cleaning and processing
  • Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems
  • Develop efficient software code for multiple use cases leveraging Python and Big Data technologies for various use cases built on the platform
  • Provide high operational excellence guaranteeing high availability and platform stability
  • Implement scalable solutions to meet the ever-increasing data volumes, using big data/Palantir technologies PySpark, any Cloud computing etc.


Essential Skill Set:
  • Over all 7 to 12 years of IT, experience. Extensive experience in Big Data, Analytics, ETL technologies
  • Application Development background along with knowledge of Analytics libraries, statistical and big data computing libraries
  • Minimum 4+ years of experience in Spark/PySpark, Python/Scala/java programming.
  • Hands on experience in coding, designing and development of complex data pipelines using big data technologies
  • Experience in developing applications on Big Data. Design and build highly scalable data pipelines
  • Expertise in Python, SQL Database, Spark, non-relational databases
  • Individual who can work under their own direction towards agreed targets/goals and with creative approach to work
  • Intuitive individual with an ability to manage change and proven time management
  • Proven interpersonal skills while contributing to team effort by accomplishing related results as needed


Desirable Skill Set:
  • Experience in Palantir
  • Experience in building CI/CD Pipelines, Git, Jenkins
  • Have worked with large datasets
  • Proficient reading and understanding enterprise-grade PySpark code
  • Knowledge of Palantir would be added advantage
Start
10/2022
Dauer
6 months
Von
Soda
Eingestellt
23.09.2022
Projekt-ID:
2467488
Um sich auf dieses Projekt zu bewerben müssen Sie sich einloggen.
Registrieren