Principal AI Data Engineer - GenAI & Agentic AI
EPAM Systems
As Principal AI Data Engineer in London, you will design and deliver enterprise-grade AI, GenAI and Agentic AI solutions. You translate business needs into scalable data pipelines and AI workflows, partnering with stakeholders to drive adoption and impact. You’ll prototype and productionize AI systems, from RAG deployments to agent-based frameworks, while shaping technical direction and AI capabilities for the platform. This role combines deep data engineering with practical AI experimentation to scale AI across business functions.
Pay / Benefits- ESPP
- life assurance
- private medical and dental care
- Employee Assistance Program
- pension plan
- season ticket loans
- Develop, prototype and evaluate AI, GenAI and Agentic AI solutions for enterprise integration
- Build and optimize Retrieval-Augmented Generation (RAG) systems with embedding selection, prompt engineering and traceable evaluation
- Design and deploy AI agents using LangChain, AutoGen, smolagents and LangGraph
- Deliver GenAI and Agentic AI solutions from prototype to production for commercial teams
- Build and integrate AI solutions using Databricks capabilities (Mosaic AI, Genie, MLflow, AgentBricks)
- Deploy models and apps using Azure OpenAI, Azure AI Foundry, Databricks Mosaic Gateway and Docker
- Manage large-scale text and structured datasets with Databricks infrastructure
- Create GenAI evaluation and testing frameworks with benchmarking and reproducibility checks
- Contribute to data platform and AI architecture, CI/CD and automated testing
- Develop reusable Python code and collaborate with agile teams and stakeholders to translate requirements into practical AI solutions
- 8–12 years of experience in data science and AI projects
- Deep understanding of LLM families (GPT, Llama, Claude, Mistral) and reasoning capabilities
- Hands-on Databricks experience (Delta Live Tables, Delta Lake, Unity Catalog governance)
- Strong knowledge of streaming (Spark Structured Streaming, Auto Loader)
- Programming in Python, SQL or Scala; data modeling and ETL/ELT
- Experience with data ingestion and replication (ADF and Qlik Replicate)
- Azure cloud experience and Generative AI evaluation frameworks and benchmarking
- Experience with Copilot, Azure AI Foundry, Databricks AI capabilities (Mosaic AI, MLflow, AgentBricks, Genie)
- Strong Git, analytical, problem-solving, stakeholder management, and collaboration skills
- stakeholder management
- communication
- independent and collaborative work style
- Databricks Delta Live Tables (DLT)
- Delta Lake concepts
- Unity Catalog
Reference: WJ-747_31295817 · Posted 15 Nov 2026, 08:52 PM