Data Engineer

In this role you will help turn data into strategic insights by building and maintaining data pipelines, data lakes, and data services. You will collaborate with the Data Team to support analytics, reporting, and ML initiatives that guide business decisions. You’ll work on real-time and batch ETL, data warehousing, and a recommender service to enrich user experiences. This is a hands-on, high-impact role in a fast-paced, collaborative data environment at Smarkets.

• Stock Options: vest over 4 years
• Pension Scheme with up to 6% matched contributions
• Health Insurance
• Enhanced Parental Leave
• Hybrid working: 3 days in office, 2 at home
• Learning & Development budget: 1000 per year

• Develop and maintain real-time and batch Data ETL pipelines
• Keep data lakes and data warehouses (Redshift and BigQuery) healthy
• Create and maintain Flask services and Postgres databases for data access and business entities
• Support automated reporting pipelines and cross-team reporting needs
• Explore data, train and deploy ML models, and maintain the recommender service for sport competitions

• 3+ years of experience
• Experience building ETL pipelines with Python using tools like Luigi or Airflow
• Experience developing Python-based REST APIs / services and integrating with Postgres
• Familiarity with Python data science stack (Pandas, NumPy, scikit-learn)
• Experience training and deploying ML models
• Strong, clean, well-tested code and teamwork orientation
• Bachelor’s in Computer Science, Math or equivalent or relevant experience

• team player
• proactive and collaborative
• communication and knowledge sharing
• Python ETL frameworks (Luigi, Airflow)
• Python-based REST APIs / Flask / FastAPI
• Postgres database access and management