IT & Software

Lead Data Engineer

Quilter

London · Greater London · United Kingdom

Share this job: X Facebook WhatsApp Save job : Lead Data Engineer
Overview

In this Lead Data Engineer role, you guide technical direction across one or more data domains to accelerate Quilter’s data strategy. You design and implement robust data pipelines and platforms, coordinating with engineers, architects and stakeholders to translate requirements into scalable solutions. You’ll uphold engineering best practices and foster a culture of technical excellence while remaining hands-on when needed. This is an opportunity to shape data products that support actionable insights across the organization and drive high standards of quality, security and governance.

Pay / Benefits
  • Holiday: 182 hours (26 days)
  • Quilter Incentive Scheme
  • Pension Scheme (non-contributory)
  • Private Medical Insurance (single cover, optional family)
  • Life Assurance: 4x salary
  • Income Protection: 75% of salary after 26 weeks
Responsibilities
  • Provide technical leadership for one or more data domains as the primary engineering authority
  • Define and evolve data engineering standards, patterns and best practices
  • Lead design and implementation of scalable data pipelines, data products, and platform capabilities
  • Review code and architectures for quality and alignment with strategy
  • Stay hands-on to resolve complex technical challenges and delivery issues
  • Lead the technical delivery of key initiatives to meet business requirements
  • Translate business/product requirements into detailed technical designs and plans
  • Collaborate with Managers, Owners, Architects and stakeholders to prioritise work
  • Promote automation, testing, CI/CD, observability, and infrastructure-as-code
  • Contribute to roadmap planning by identifying opportunities and risks
  • Provide coaching and technical guidance to data engineers
  • Support knowledge sharing, pair programming and communities of practice
  • Foster collaborative, inclusive culture focused on quality and continuous improvement
  • Act as a role model for engineering excellence and professional standards
  • Partner with product managers, analysts, data scientists and governance teams to ensure enterprise alignment
  • Communicate technical concepts clearly to technical and non-technical audiences
  • Influence decision-making with expert technical advice
  • Promote operational stability, reliability, and performance of data products and pipelines
  • Champion data quality, security, governance, and regulatory compliance
  • Identify opportunities to improve platform efficiency and resilience
  • Support root cause analysis and continuous improvement activities
Key requirements
  • Senior or lead data engineer experience in a complex enterprise environment
  • Hands-on experience with Databricks on Azure (data platforms, pipelines)
  • Experience delivering batch and real-time data processing (event-driven/streaming)
  • Proven ability to design and deliver data products and platform capabilities across domains
  • Experience implementing data quality frameworks, SLOs, data contracts, observability tooling
  • Strong data governance knowledge ( lineage, metadata, cataloguing, security, access controls)
  • Experience ensuring GDPR, data retention and information security controls
  • Ability to define technical standards and drive adoption across teams
  • Experience mentoring, code reviews and promoting engineering excellence
  • Strong data modelling knowledge (Kimball, Data Vault, medallion)
  • Experience in Agile delivery with cross-functional teams
  • Strong communication skills
  • Collaborative and mentoring mindset
  • Analytical and problem-solving
  • Databricks: Delta Lake, Unity Catalog, Workflows, Notebooks, Compute Management, Delta Live Tables, Spark Declarative Pipelines
  • Microsoft Fabric: Lakehouse, Data Warehouse, Real-Time Intelligence, Semantic Models
  • Azure: ADLS Gen2, Data Factory, Key Vault, Functions, Monitor

Reference: WJ-747_31295658 · Posted 15 Nov 2026, 08:50 PM

Find more on GigBlow

This role is listed on GigBlow for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.

Data Engineer jobs in other states

Browse jobs