Databricks Engineer
Lumora Solutions
Salary: $44 – $74 per year
Daily Rate: Up to £400 Per Day OUTSIDE IR35
Duration: 3 Months
About the role:
We are looking for an experienced Databricks Engineer to build data pipelines and AI solutions for a major UK client. You will transform data from multiple sources into trusted datasets for reporting and AI applications.
What you will do:
- Build Databricks pipelines using the Medallion Architecture (Bronze, Silver and Gold layers).
- Configure Unity Catalog to manage permissions, data access and lineage.
- Develop AI solutions
- Deploy across Dev, Test and Production using Asset Bundles and CI/CD.
- Optimise pipeline performance and manage cluster costs.
- Implement data quality checks to identify issues early.
- Work with architects and business stakeholders to deliver technical solutions.
What you will bring:
- Databricks experience, including PySpark, Spark SQL, Delta Lake, Delta Live Tables and Workflows.
- Hands-on Unity Catalog configuration, including schemas, groups and permissions.
- Delivered at least one Databricks AI solution.
- Strong Python and SQL skills.
- Azure Data Factory and Azure Data Lake Storage (ADLS) experience.
- Experience with Asset Bundles or Terraform and CI/CD deployments.
- Strong communication skills across technical and business teams.
Reference: WJ-766_24847652 · Posted 16 Nov 2026, 11:42 PM
More jobs like this: