Lead Data Platform Engineer - AWS, Spark

As Lead Data Platform Engineer, you drive hands-on technical leadership to build a fraud data capability on Experian's Data Analytics Platform. You’ll guide a cross-functional team, align with platform patterns, and deliver secure, scalable data pipelines in a cloud-first environment. The role balances engineering depth with team leadership and DevSecOps practices to accelerate delivery. You’ll work with central platform teams and stakeholders to shape practical, high-quality data solutions in a hybrid Nottingham setup.

• Great compensation package and discretionary bonus plan
• 25 days annual leave with 8 bank holidays and 3 volunteering days
• Pension
• Bupa healthcare
• Sharesave scheme
• Diversity and inclusion culture

• Lead an agile team delivering data platform solutions for fraud-related data assets
• Guide AWS-based data pipelines, data lake components, and producer-side data platform capability
• Oversee handover and enhancement of pipelines and cloud components from central DAP team
• Lead development of high-quality data pipelines from Snowflake and internal platforms
• Ensure accurate metadata publishing to surface assets via the DAP catalogue
• Champion DevSecOps, CI/CD, Infrastructure as Code, and cloud-native tooling
• Mentor engineers and promote collaboration, innovation and learning
• Advocate automation and AI-assisted development to improve speed and quality

• Strong experience building data pipelines, data lake solutions or data platform capabilities
• Strong experience with AWS services relevant to data engineering and platform delivery (Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge, SQS)
• Strong experience with DevOps and IaC tooling (Terraform, CI/CD pipelines, Git, Jenkins)
• Strong experience developing on Apache Spark or Hadoop
• Significant programming experience in Scala or Python
• Experience with Configuration as Code and API integration
• Strong understanding of cloud security, data privacy, access control and governance principles

• Mentoring and coaching
• Cross-functional collaboration
• Innovation and continuous learning
• AWS Glue
• S3
• Step Functions