Beschreibung
Source Group are currently supporting a Financial Services customer with the recruitment of a Freelance Data Engineer.This role is tackling a range of complex software and data challenges, including data management, advanced analytics, and business intelligence. This role is pivotal to implement, maintain and support data pipelines using shared data platforms exploiting cutting-edge data technologies and modern software development practices.
We are looking to hire an intermediate level Data Engineer able to support the project with data modelling and data pipeline implementation.
Day to Day Tasks:
- Provide implementation support on a variety of data management and analytics projects using the Bank's approved databases (big data as well as relational databases) and analytical technologies
- Develop optimal data models for data storage as well as end-to-end data pipelines for optimal extraction, transformation and loading of data from/to a wide variety of RDBMS or NoSQL data stores
- Translate functional and technical requirements into detailed designs, as well as derive use cases where appropriate
- Design, develop, construct, install, test, and maintain highly scalable, robust, and fault-tolerant data management & processing systems by integrating a variety of programming languages & tools together
Requirements:
- Minimum 5+ year of work experience as a Data Engineer/BI Developer.
- Extensive experience working with RDBMS, designing physical models, authoring SQL queries and procedural extensions, and carrying out performance tuning. Hands-on experience with SQL MS Server would be an advantage.
- Knowledge on Data warehousing/Data Mart and Data Lake architectures, with experience in building associated data ingestion pipelines. Knowledge of various ETL / ELT techniques and frameworks would be an advantage.
- Strong, in-depth experience in data modelling with data vault and experience with business intelligence systems (dimensional modelling, data vault, data mining, predictive analytics).
- Working knowledge of Apache NiFi and experience developing SQL-based data pipelines, ideally using dbt. Experience in workflow management and automation tools such as Airflow or RunDeck would be an advantage.
- Hands-on development using open-source big data technologies such as Hadoop, Hive and Impala.