Data Engineer with expertise in Azure, PySpark and ETL pipelines

Data Pipeline Development
Development and optimization of scalable enterprise data engineering ETL pipelines in Azure Databricks and PySpark, transforming raw production data into high-quality, analysis-ready datasets.

Data Architecture & Integration
Integration of heterogeneous data sources into unified Data Lakehouse architecture using Medallion, supporting real-time operational dashboards and planning tools.

AI & Process Mining Solutions
Development of Gen AI solutions including RAG chatbots and agents for tabular data, along with end-to-end process mining solutions to identify bottlenecks and improve business processes.

Programming & Frameworks
Proficiency in Python ecosystem including Pandas, PySpark, NumPy, Matplotlib, SciPy, as well as Spark SQL, Hugging Face transformers, AutoGen, and LangChain.

Database Management
Experience with SQL, MongoDB (NoSQL), Snowflake for data warehousing, and cloud services including Azure Databricks, ADLS Gen2, Cosmos DB, and Azure SQL DB.

Data Visualization & Workflow
Skills in Power BI, Microsoft Fabric for visualization, Apache Airflow for workflow orchestration, and Git/GitHub for version control.

Process Mining Tools
Expertise in SAP Signavio, Microsoft Power Automate, PAFnow (Power BI Plugin), and Celonis for process mining and analysis.