Beschreibung
Our client, a fast-growing fin-tech, is seeking a skilled Data Platform Engineer to join their dynamic team. As a Data Platform Engineer, you will play a crucial role in operating, monitoring, and extending the data platform infrastructure. Join this forward-thinking organization and contribute to their vision of making data easily accessible and driving data-driven processes.Responsibilities:
• Operate, monitor, design, and enhance the data platform infrastructure, pipelines, and services.
• Implement and maintain Airflow workflows to orchestrate data pipelines.
• Utilize DBT for data transformation, aggregation, materialized views, and data quality management.
• Leverage Snowflake and Redshift data warehouses for data modeling, ingestion, processing, and ensuring data integrity.
• Develop and maintain PostgreSQL and MySQL databases, including data modeling, schema design, and performance optimization.
• Collaborate with the analytics team to design and develop the semantic layer from an engineering perspective.
Requirements:
• Excellent knowledge of SQL and proficient skills in Python.
• Experience working with AWS data and analytics stack, including Redshift, Athena, Glue, S3, EMR, and DMS.
• Familiarity with ELT/ETL flows.
• Knowledge of OpenSearch.
• Track record of end-to-end project ownership, from requirements gathering to production performance monitoring.
• Can-do mentality, eagerness to learn, and a continuous improvement mindset.