Data Engineer

In this Data Engineer role, you will design and optimise a scalable data platform to support advanced analytics and research. You’ll build high-performance pipelines, integrate real-time feeds, and ensure secure, accessible data across structured and unstructured sources. Collaborating with analysts and researchers, you’ll enhance data architecture and automate ETL to streamline modelling and insights. You’ll support event-driven systems and data quality measures while enabling data preparation for ML workflows. This is a fast-paced, data-driven environment where your work delivers tangible impact.

• Design and maintain scalable data pipelines handling large-scale datasets
• Integrate real-time data feeds and external APIs
• Enhance data architecture for accessibility, efficiency, and security
• Automate ETL workflows for data modelling and analysis
• Support event-driven systems with technologies like Kafka and Protobuf
• Ensure data quality, integrity, and consistency across inputs and outputs
• Collaborate with analysts, researchers, and teams to prepare data for ML model training and deployment

• 3+ years of data engineering experience
• Strong proficiency in Python and Rust
• Hands-on AWS, Linux, and Docker experience
• Experience with distributed computing frameworks (Ray, Dask, or Apache Arrow)
• Strong analytical skills for large-scale, high-frequency data
• Solid understanding of ETL, data modelling, and database optimisation
• Experience with real-time streaming technologies

• data-driven mindset
• collaboration
• problem-solving
• Python
• Rust
• AWS