Data Engineer
UK Tote Group
In this role, you will design and optimise Databricks-based data pipelines to deliver real-time analytics and reporting. You’ll work with cross-functional teams to ensure trusted data supports commercial decisions and safer gambling initiatives. You operate in a hands-on capacity, building scalable, governed data solutions and shaping the technical direction. This is a collaborative, agile position with a strong impact on business growth and data-driven decision making.
Pay / Benefits- Competitive Basic Salary
- Discretionary Bonus Scheme
- Company Shares Option Plan
- Contributory pension scheme
- Life insurance (4 x basic salary)
- Study Support and progression opportunities
- Design, build, and optimise streaming and batch pipelines in Databricks
- Develop bronze, silver, and gold Delta tables using the Medallion Architecture
- Implement integrations from AWS MSK, S3, and external APIs into the Lakehouse
- Collaborate with reporting engineers to enable high-performance dashboards via Databricks SQL Warehouses
- Monitor, tune, and troubleshoot pipeline performance using Databricks metrics, CloudWatch, and AWS Cost Explorer
- Proven expertise in building pipelines in Databricks and strong Apache Spark (PySpark) experience including Structured Streaming
- Experience with Kafka (MSK) and real-time data ingestion; deep understanding of Delta Lake, DLT, and Medallion Architecture
- Strong AWS background (S3)
- Proficiency in Python and SQL for data engineering and analytics
- Experience implementing CI/CD pipelines with GitHub Actions or Azure DevOps
- Solid experience with Git, version control, and Spark performance tuning
- Collaborative, proactive attitude with good communication skills
- collaborative
- proactive
- analytical
- Databricks
- Apache Spark
- PySpark
Reference: WJ-747_31297324 · Posted 17 Nov 2026, 06:01 AM
More jobs like this: