Databricks Engineer
Gazelle Global
Salary: $85 – $120 per year
We're looking for an experienced Databricks Engineer to join an exciting banking and financial services programme, building and managing enterprise-scale Lakehouse platforms.
You'll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms. This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation.
Key Responsibilities:
- Build and maintain Databricks Lakehouse platforms across development, testing and production environments.
- Develop data pipelines using PySpark, SQL and Delta Lake.
- Configure Unity Catalog, permissions, access controls and security policies.
- Implement CI/CD pipelines and automate platform deployments.
- Manage Databricks Jobs, Workflows and Declarative Pipelines.
- Integrate Databricks with AWS services and cloud infrastructure.
- Support batch and incremental data processing.
- Optimise platform performance, monitoring and operational reliability.
Key Skills:
- Strong hands-on experience with Databricks and PySpark.
- Excellent knowledge of Delta Lake and Lakehouse architecture.
- Experience with Unity Catalog, Autoloader and Structured Streaming.
- Knowledge of AWS S3, IAM, KMS, Glue and Lambda.
- Experience with Git, CI/CD and data pipeline development.
Location: London / Manchester - Hybrid, 3 days onsite.
#J-18808-LjbffrReference: WJ-766_24984319 · Posted 19 Nov 2026, 06:43 PM
More jobs like this: