Data Engineer | Data Engineer (m/w/d)

Job Summary

This Data Engineer role is pivotal in establishing the new "Business Insights Hub" within the Information Platform Energy Networks (iPEN), which centralizes data for regional distribution network operators. The core responsibility involves supporting all data integration activities using the existing platform tools like Databricks and Unity Catalog. Day-to-day tasks include designing processes for connecting source systems, transforming data into a unified model, and actively implementing efficient ETL pipelines. A key focus is on enabling other Data Engineers to contribute to the shared ETL codebase and ensuring the stable, reliable operation of all data pipelines. Candidates must possess deep knowledge of the Microsoft Azure stack, specifically Azure Data Factory and Azure Databricks, coupled with multi-year development experience using Python, Scala, SQL, and Spark in cloud-native environments. Success requires strong analytical thinking and fluency in both German and English, contributing directly to increased efficiency and data-driven decision-making across the network community.