Azure Databricks Engineer

Azure Databricks Engineer | Hybrid | London | Inside IR35 | £350 - £400 | 6 months

I'm currently working with a client who is looking for an experienced Azure Databricks Engineer to work 3 days on site in London. You will join a data transformation programme. The role will involve designing and optimising data pipelines, integrating multiple data sources, and ensuring the reliability and scalability of the data platform.

Key Responsibilities:

• Design, develop, and optimize data pipelines using Azure Databricks.
• Ensure data reliability, scalability, and quality.
• Integrate data sources into a unified platform.
• Monitor and troubleshoot data workflows.

Skills Required:

• Expertise in Azure Databricks, Spark, and big data tools.
• Strong SQL skills
• Knowledge of Python, ETL processes and cloud technologies.
• Familiarity with CI/CD practices for data pipelines.
• Experience within the insurance sector would be highly beneficial

If this aligns with your skill set, you are available within 2 weeks and can work 3 days on site in central London per week then please apply for the job advert directly.