Senior Data Engineer | Senior Data Engineer (m/w/d) Lakehouse, Databricks

expertplace professionals GmbH

Köln, Nordrhein-Westfalen, Deutschland
Published May 7, 2026
Full-time
No information

Job Summary

As a Senior Data Engineer, you will play a pivotal role in evolving a modern data and AI platform within an insurance environment, transitioning it toward a Lakehouse architecture. Your daily responsibilities include designing and administering Databricks workspaces, developing resilient data pipelines using PySpark, and implementing automated development processes. You will lead the migration of infrastructure from an existing Azure tenant to a new one, which involves migrating CI/CD pipelines from GitLab to GitHub Actions, re-establishing data assets, and integrating with SIEM and IAM systems. This role is ideal for an expert who thrives in cloud-based environments and is passionate about data governance, as you will be deeply involved in implementing Unity Catalog permissions and Data Contracts. The position offers a hybrid work model, requiring onsite presence in Cologne just two days every two weeks after an initial onboarding phase, providing a balance of professional collaboration and flexibility.

Required Skills

Education

Not specified

Experience

  • Professional experience in data engineering and platform architecture
  • Experience in designing and administering Databricks workspaces
  • Experience in developing resilient data pipelines with PySpark and test automation
  • Experience with CI/CD migration using GitLab and GitHub Actions
  • Experience with cloud infrastructure migration and asset management

Languages

German (Fluent)

Additional

  • Must be able to work onsite in Cologne for 2 consecutive days every 2 weeks after onboarding. Requires valid work permit for Germany.