29.10.2026 aktualisiert


100 % verfügbar
Big Data Management
Sulzbach, Deutschland
Weltweit
Ph.D.Über mich
Passionate about software architecture and development, with an extensive background in designing, building, deploying, and operating massive distributed low-latency batch data processing and real-time event streaming pipelines in the cloud.
Skills
JavaAmazon Web ServicesData AnalysisApache HTTP ServerArchitekturBig DataComputerprogrammierungDatenbankenData ArchitectureInformation EngineeringData IntegrationETLData WarehousingDevOpsPython
Big Data & Analytics Architecture
Expertise in designing and implementing massive distributed low-latency batch data processing and real-time event streaming pipelines in cloud environments with petabyte-scale data lakes
Cloud Platform Engineering
Advanced knowledge in AWS cloud services, Kubernetes, Docker, and DevOps practices for scalable platform solutions and cost optimization strategies
Software Development & Programming
Proficiency in multiple programming languages including Scala, Java, Python, and modern frameworks for enterprise-level software development
Apache Ecosystem Technologies
Deep experience with Apache Flink, Kafka, Spark EMR, Iceberg, and other big data processing frameworks
Database Technologies
Comprehensive knowledge of Oracle databases, SQL, NoSQL, and data warehousing solutions including administration and development
Machine Learning & MLOps
Certified expertise in machine learning implementations and MLOps practices for data-driven solutions
Microservices Architecture
Experience in designing and implementing RESTful web services and microservices architectures
Data Engineering & ETL
Specialized skills in data pipeline development, ETL processes, and data integration across multiple systems
Expertise in designing and implementing massive distributed low-latency batch data processing and real-time event streaming pipelines in cloud environments with petabyte-scale data lakes
Cloud Platform Engineering
Advanced knowledge in AWS cloud services, Kubernetes, Docker, and DevOps practices for scalable platform solutions and cost optimization strategies
Software Development & Programming
Proficiency in multiple programming languages including Scala, Java, Python, and modern frameworks for enterprise-level software development
Apache Ecosystem Technologies
Deep experience with Apache Flink, Kafka, Spark EMR, Iceberg, and other big data processing frameworks
Database Technologies
Comprehensive knowledge of Oracle databases, SQL, NoSQL, and data warehousing solutions including administration and development
Machine Learning & MLOps
Certified expertise in machine learning implementations and MLOps practices for data-driven solutions
Microservices Architecture
Experience in designing and implementing RESTful web services and microservices architectures
Data Engineering & ETL
Specialized skills in data pipeline development, ETL processes, and data integration across multiple systems
Erfahrung
Berufserfahrungmehr als 10 Jahre
Freelancer seit1999
Sprachen
DeutschMutterspracheEnglischverhandlungssicher
Projekthistorie
Hybrid, Frankfurt, Germany
• Performance tuning of data integration pipelines between map repositories (SQL, REST API)
• Evolution of near real-time spatial data processing and event streaming pipelines between map repositories (SQL, REST API)
Java, Scala, Python, Kotlin, Apache Spark, REST Microservices, SQL, Oracle RAC, Postgres, GIS, AWS Cloud, Docker, DevOps, CI/CD, GitLab, Splunk, Kibana, Tableau
Remote, Hurst, TX, USA
Big Data, Data Lake, Data Lakehouse, Apache Iceberg, Trino, Starburst
FTE, Hybrid, Chicago, IL, USA
• AWS cost optimization by switching from real-time to low-latency analytics leveraging EMR batch runs
• Owned and operated petabyte VPD data lake with metrics and analytics
• Map-matching of VPD drives for enhanced analytics
Big Data, Data Lake, Scala, Java, Python, Flink, Kafka, Spark EMR, Parquet, Starburst, Ranger, Trino, Amazon Athena, AWS Cloud, Kubernetes, Docker, DevOps, GitLab, Grafana, Prometheus, Splunk, Tableau