Senior Azure Data Engineer (Databricks)

In this role you will design, build, and deploy scalable data pipelines on Databricks for Azure, collaborating with clients to translate data needs into practical technology solutions. You’ll apply DevOps practices to deliver CI/CD-ready data solutions and contribute to cross-functional engineering initiatives. The work centers on data lakehouse architectures, real-time processing, and secure, GDPR-compliant data handling. You will operate in a consulting culture that values collaboration, innovation, and continuous learning to transform financial services data landscapes.

• Discretionary bonus
• Health insurance
• Life insurance and critical illness cover
• 5 weeks of annual leave
• Continuous learning with minimum 40 hours of training annually
• Gympass

• Design and develop robust data pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog
• Build real-time event-driven solutions with Kafka and Azure Event Hubs
• Apply DevOps practices to CI/CD using Azure DevOps, Jenkins, or GitHub Actions
• Collaborate with clients and stakeholders to translate data needs into strategic technical solutions
• Champion clean code, data lifecycle optimization, and software engineering best practices

• Databricks platform hands-on experience
• Strong Python, PySpark, and SQL skills
• Experience developing full lifecycle data pipelines (ingestion, transformation, serving)
• Knowledge of data lakehouse architecture, schema design, GDPR-compliant solutions
• Working knowledge of DevOps tools and CI/CD processes

• Collaborative mindset
• Willingness to learn and adapt quickly
• Strong problem-solving and communication skills
• Databricks on Azure
• DeltaLake
• Spark Structured Streaming