Senior Data Engineer - Databricks

In this role you will own the design and delivery of scalable data pipelines and products using Databricks to create a single source of truth and enable self-service data access. You will work with cross-functional teams to shape data architecture, embed governance, and mentor a junior engineer. The position offers visibility, hands-on impact, and the chance to influence the data platform strategy at a fast-growing software business. This is a UK-based, remote-friendly role with a path to shape the Data Ops journey.

• health insurance
• income protection
• life assurance
• subsidised gym membership
• 25 days' holiday plus birthday off
• remote work

• Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake
• Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems
• Shape enterprise data architecture balancing scalability, performance, security and maintainability
• Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to translate business challenges into technical solutions
• Embed data quality, governance and access controls throughout the data lifecycle
• Mentor a junior engineer and help mature the data function

• Senior level data engineering experience with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake)
• Advanced SQL and Python coding skills
• Track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions
• Solid grounding in data architecture, modelling and modern data platform design
• Experience mentoring junior Data Engineers
• Broad data source experience (structured and unstructured) including CRM, revenue, financial and subscription data
• Cloud experience (AWS preferred; Azure acceptable) with CI/CD and source control best practices
• Desirable: Data Science leaning background, ML/AI and predictive modelling strategies

• Cross-functional collaboration
• Mentoring/leadership
• Data governance mindset
• Databricks (PySpark, Spark SQL, Delta Lake)
• SQL
• Python