Data Engineer | #13986 Data Engineer (m/w/d)

Job Summary

This role involves joining an agile DevOps team to drive the development and operation of cutting-edge data products. The Data Engineer will be responsible for the end-to-end implementation of data solutions, including ingestion, transformation, testing, deployment, scheduling, and monitoring. Key daily tasks include building and operating robust data pipelines for both streaming (using Kafka/Event Hubs) and batch data within Microsoft Fabric Lakehouses, leveraging Scala Spark and Delta Lake. The ideal candidate must possess strong practical experience in SQL, Scala Spark, and Delta Lake, coupled with knowledge of orchestration tools like Apache Airflow. They will also ensure data quality, implement anonymization techniques compliant with GDPR, and provide consumable datasets for analytics via Power BI. This position offers the opportunity to work on exciting projects for major clients and contribute to digital transformation initiatives in a collaborative, supportive environment.