Data Engineer | Data Engineer (m/w/d)
LM IT
Job Summary
This Data Engineer role is critical for transforming raw data into valuable business assets. Day-to-day responsibilities involve acting as the interface to the data world, integrating REST services, and extracting data from diverse sources, including relational and non-relational databases and various APIs. A core function is modern data engineering, requiring you to develop and automate robust Data Pipelines and process and transform data effectively using Apache Spark and Spark Notebooks (PySpark/SparkSQL). You will also be responsible for data preparation and semantic modeling to ensure data is analysis-ready. Candidates must possess a degree in (Business) Informatics or equivalent professional knowledge, coupled with proven experience in ETL/ELT processes, Data Modeling, and utilizing major cloud platforms like MS Azure and/or AWS. Proficiency in Microsoft Fabric and Power BI is also required. The position is attractive due to its focus on cutting-edge technologies, collaborative teamwork, and the opportunity to mentor junior staff and contribute to knowledge sharing within an international environment.
Required Skills
Education
Degree in (Business) Informatics or equivalent professional knowledge
Experience
- Professional experience with ETL/ELT processes
- Experience in Data Modeling and semantic data preparation
- Professional experience utilizing cloud platforms such as MS Azure and/or AWS
- Experience working with Apache Spark
- Experience analyzing customer requirements and developing solutions collaboratively
Languages
Additional
- Not specified