Beschreibung
PySpark - DataBricks - Streaming - Delta tables
You will bring a strong and experience Python engineer who has demonstrable experience implementing robust, reliable and successful data processing solutions using PySpark.
You will join a large project, which is transforming our Group Finance department to be cloud native. The business area handles large amounts of financial data. Our pipeline needs to support high concurrency, accuracy and low latency when preparing and serving the data to consumers.
We are targeting the Microsoft Azure cloud, where we prefer Platform as a Service (PaaS). A key platform for us is Azure Databricks, which will form the core of our data processing pipeline.
Job Description
- You will work closely with Product Owners and Architects in order to understand requirements, formulate solutions and evaluate the implementation effort
- You will collaborate within a global development team to design and deliver solutions
- You will assist stakeholders with data-related functional and technical issues
- You will design, develop and maintain scalable data transformation pipelines
Requirements
- Bachelor's degree level or equivalent in Computer Science or similar discipline
- MUST: experience in software solutions using Spark.
- At least 5 years of experience working with large scale software systems
- Proficiency with: Python/PySpark (batch and streaming, Scala is a plus),SQL (Synapse/Azure DWH experience is a plus)Scalable big data' data stores (Azure Data lake preferably)
- A practical experience working with (and securing) large data sets on enterprise data platforms and distributed computing (Spark)
- Experience applying automated testing and modern deployment practices on the for mentioned platforms, including Azure DevOps
- Knowledge of Scrum/Agile development methodologies
- A previous experience in the finance sector will be beneficial
Contract Details
- Start Date: 1.2.2020
- Duration: 6 months
- 100%
Contact
IT Di-Visions is a friendly and dynamic IT placement agency which has a real track record with companies within the financial, telecom, insurance and other interesting industries in Switzerland.
We place IT experts in contracting positions as well as in permanent employment contracts.
For further technical information, please contact Mr. Emanuele Gorelli,
Please send your complete electronic application to IT Di-Visions AG