Senior Lead Databricks Data Engineer
Vanguard
Lead enterprise Data and AI engineering with Databricks and AWS in Vanguard’s hybrid working model, building scalable platforms for analytics.
Vanguard seeks an experienced Senior Lead Data and AI Engineer with 9–12+ years in Data Engineering and modern cloud data platforms. You will apply Lakehouse architecture, Delta Lake, Unity Catalog, Spark, PySpark, SQL, and Python. The work supports analytics, operational decision-making, machine learning, Generative AI, and intelligent business applications.
Key Responsibilities:
- Lead enterprise data solution architecture using Databricks and AWS
- Design reusable batch, streaming, and event-driven data pipelines
- Build Delta Live Tables and Lakeflow Pipelines
- Establish metadata-driven engineering frameworks and standards
- Mentor engineers and lead architecture reviews
Requirements:
- 9–12+ years in Data, Platform, or Analytics Engineering
- 5+ years building enterprise Databricks solutions
- Expertise in Lakehouse architecture, Delta Lake, and Unity Catalog
- Proficiency with Spark, PySpark, SQL, and Python
- Experience with AWS, CI/CD, and Infrastructure-as-Code
Apply Databricks, AWS, and Lakehouse expertise to lead governed data platforms supporting analytics and Generative AI initiatives.
#J-18808-LjbffrReference: WJ-4483_1647391 · Posted 16 Nov 2026, 05:28 PM