Senior Data Engineer

In this role you design and operate repeatable data pipelines to support a large-scale migration, turning diverse source data into a unified platform. You work with a cross-functional team across data, platform, and source teams to ensure robust ingestion, transformation, and delivery. You’ll implement automated checks, monitor data quality, and maintain auditable data lineage. The position offers a path to grow within a responsible, innovation-driven environment that values collaboration and cloud-native data engineering at scale.

• Hybrid working model
• 25 days holiday
• Private Medical Health care via Vitality
• Pension contribution
• Life Assurance
• Professional certifications supported

• Collaborate within a migration team to deliver data solutions
• Build repeatable data ingestion processes from multiple sources
• Transform source extracts into consistent structures for migration
• Develop modular ingestion and transformation code using SQL, Python, PySpark and dbt
• Implement automated checks for completeness and accuracy of data
• Monitor, diagnose and recover failed or incomplete data processing
• Maintain auditable data source mappings, transformations and outcomes with secure handling controls

• Hands-on experience building and operating data pipelines in structured migration environments
• Experience with cloud data platforms (Azure, AWS or Google Cloud)
• Experience with Spark, PySpark, Databricks or equivalent distributed processing tech
• Experience building modular, tested transformations with dbt or equivalent
• Strong SQL and Python skills for transformations, validation and reconciliation
• Experience scheduling, monitoring and recovering pipelines using cloud-native orchestration tools
• Experience with Delta Lake (transactions, schema changes, batch loading)
• Experience with Terraform or equivalent infrastructure as code

• Collaborative
• Trustworthy and supportive
• Ability to work across cross-functional teams
• SQL
• Python
• PySpark