Senior Azure Data Engineer (Databricks)
Capco
Overview
In this Senior Azure Data Engineer role, you design, build, and deploy scalable data pipelines on Azure Databricks, partnering with clients to translate data needs into transformative technical solutions. You’ll advance best practices, work with cross-functional teams, and drive data lifecycle optimisation. You contribute to secure, lakehouse-based architectures and real-time event-driven processes, shaping impactful outcomes for financial services clients.
Pay / Benefits- Discretionary bonus
- competitive pension
- health insurance
- life insurance and critical illness cover
- Mental Health support and in-house first aiders
- 5 weeks annual leave with buy/sell option
- Design and develop robust data pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog
- Create real-time event-driven solutions with Kafka and Azure Event Hubs
- Implement CI/CD pipelines using Azure DevOps, Jenkins, or GitHub Actions
- Collaborate with clients and stakeholders to translate data needs into technical solutions
- Champion clean code and data lifecycle optimisation, aligning with software engineering best practices
- Proven hands-on Databricks platform experience
- Strong Python, PySpark, and SQL skills with distributed data systems knowledge
- Experience developing full lifecycle data pipelines (ingestion, transformation, serving)
- Knowledge of data lakehouse architectures, schema design, GDPR-compliant solutions
- Working knowledge of DevOps tools and CI/CD processes
- Collaborative mindset
- innovative and continuous learning orientation
- strong communication with stakeholders
- Databricks platform
- Python
- PySpark
Reference: WJ-747_31291799 · Posted 13 Nov 2026, 04:57 AM