Free cookie consent management tool by TermsFeed Lead AI Data Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Lead AI Data Engineer

decor
Mumbai, Maharashtra, IN
Information Technology
Full-Time
EXL Service

Overview

Job Description: Key Responsibilities

1. Solution Architecture & Technical Leadership

  • Architect enterprise-grade agentic and LLM solutions (single-agent, multi-agent, tool-driven workflows)
  • Define scalable GenAI system design patterns (RAG, orchestration layers, evaluation frameworks)
  • Act as the technical anchor for GenAI initiatives across projects
  • Drive design reviews, architecture governance, and best practices

2. Agentic AI & LLM Engineering

  • Design and build agentic systems using LLMs for use cases such as:
    • Knowledge assistants
    • Document automation & intelligence
    • Workflow orchestration
  • Implement advanced prompt engineering strategies , prompt orchestration, and reasoning chains
  • Build tool-calling / function-calling frameworks for agent workflows

3. RAG & Retrieval Systems

  • Lead end-to-end implementation of RAG pipelines : Data ingestion chunking embeddings vector indexing retrieval
    • response generation
  • Optimise retrieval quality (recall, relevance, grounding)
  • Evaluate and benchmark different architectures

4. Productisation & Engineering Excellence

  • Develop production-grade APIs/services (FastAPI, Flask, etc.)
  • Drive code quality, testing standards, and reusable architecture components
  • Ensure solutions are performance optimised (latency, cost, reliability)

5. Governance, Safety & Evaluation

  • Implement LLM guardrails :
    • Hallucination control
    • Safety filters
    • Policy enforcement
  • Define evaluation frameworks :
    • Response quality metrics
    • RAG benchmarking
    • Human-in-the-loop validation

6. Collaboration & Delivery Leadership

Partner with: Data Engineering
    • pipelines, data quality, governance
    • MLOps
    • deployment, CI/CD, monitoring
    • Business/Product
    • use-case alignment
  • Drive end-to-end delivery ownership across multiple projects

7. Technical Leadership Responsibilities (Critical Addition)

  • Mentor and guide junior engineers and project teams
  • Conduct technical reviews, solution walkthroughs, and code reviews
  • Support pre-sales / RFPs / solution proposals with architecture inputs
  • Drive reusable accelerators, frameworks, and COE assets
  • Stay ahead of industry evolution and help shape EXL’s GenAI strategy
  • Influence technology choice, design decisions, and roadmap planning

Must-Have Skills

Experience

  • 9–12 years total experience
  • 2–4+ years hands-on in LLM / GenAI delivery (production use cases)

LLM / GenAI & Agentic Engineering

  • Strong hands-on experience with:
    • LLMs (Claude, OpenAI, etc.)
    • RAG pipelines and retrieval optimisation
    • GPT + Agentic AI implementation experience
  • Experience with:
    • LangChain, LangGraph, or similar frameworks
    • Agent orchestration and tool-calling architectures
  • Deep understanding of: LLM limitations, evaluation, and optimisation strategies

Core Engineering

  • Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
  • Deep data analysis experience and handling large volume of data
  • Fabric/Azure Databricks/Snowflake data engineering integration skills
  • Good exposure to:
    • Cloud platforms (Azure/AWS/GCP)
    • SQL
    • Containers, CI/CD, monitoring

Data / AI Foundations (Mandatory)

Prior experience in one or more:

  • Data Engineering (ETL/ELT, pipelines, orchestration)
  • Data Science / ML lifecycle (especially NLP)
  • Analytics engineering / data products

Leadership Capabilities

  • Experience leading solution design or small teams
  • Ability to translate business problems into AI solutions
  • Strong stakeholder communication and influencing skills

Good-to-Have / Preferred

  • Fine-tuning approaches: LoRA / PEFT / prompt tuning
  • Experience with Azure AI stack (Azure OpenAI, AI Search)
  • Exposure to:
    • Enterprise security & data privacy in GenAI
    • Coding agents / autonomous agent frameworks
  • Experience in insurance / BFSI domains (valuable for EXL use cases)

Responsibilities: Key Responsibilities

1. Solution Architecture & Technical Leadership

  • Architect enterprise-grade agentic and LLM solutions (single-agent, multi-agent, tool-driven workflows)
  • Define scalable GenAI system design patterns (RAG, orchestration layers, evaluation frameworks)
  • Act as the technical anchor for GenAI initiatives across projects
  • Drive design reviews, architecture governance, and best practices

2. Agentic AI & LLM Engineering

  • Design and build agentic systems using LLMs for use cases such as:
    • Knowledge assistants
    • Document automation & intelligence
    • Workflow orchestration
  • Implement advanced prompt engineering strategies , prompt orchestration, and reasoning chains
  • Build tool-calling / function-calling frameworks for agent workflows

3. RAG & Retrieval Systems

  • Lead end-to-end implementation of RAG pipelines : Data ingestion chunking embeddings vector indexing retrieval
    • response generation
  • Optimise retrieval quality (recall, relevance, grounding)
  • Evaluate and benchmark different architectures

4. Productisation & Engineering Excellence

  • Develop production-grade APIs/services (FastAPI, Flask, etc.)
  • Drive code quality, testing standards, and reusable architecture components
  • Ensure solutions are performance optimised (latency, cost, reliability)

5. Governance, Safety & Evaluation

  • Implement LLM guardrails :
    • Hallucination control
    • Safety filters
    • Policy enforcement
  • Define evaluation frameworks :
    • Response quality metrics
    • RAG benchmarking
    • Human-in-the-loop validation

6. Collaboration & Delivery Leadership

Partner with: Data Engineering
    • pipelines, data quality, governance
    • MLOps
    • deployment, CI/CD, monitoring
    • Business/Product
    • use-case alignment
  • Drive end-to-end delivery ownership across multiple projects

7. Technical Leadership Responsibilities (Critical Addition)

  • Mentor and guide junior engineers and project teams
  • Conduct technical reviews, solution walkthroughs, and code reviews
  • Support pre-sales / RFPs / solution proposals with architecture inputs
  • Drive reusable accelerators, frameworks, and COE assets
  • Stay ahead of industry evolution and help shape EXL’s GenAI strategy
  • Influence technology choice, design decisions, and roadmap planning

Must-Have Skills

Experience

  • 9–12 years total experience
  • 2–4+ years hands-on in LLM / GenAI delivery (production use cases)

LLM / GenAI & Agentic Engineering

  • Strong hands-on experience with:
    • LLMs (Claude, OpenAI, etc.)
    • RAG pipelines and retrieval optimisation
    • GPT + Agentic AI implementation experience
  • Experience with:
    • LangChain, LangGraph, or similar frameworks
    • Agent orchestration and tool-calling architectures
  • Deep understanding of: LLM limitations, evaluation, and optimisation strategies

Core Engineering

  • Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
  • Deep data analysis experience and handling large volume of data
  • Fabric/Azure Databricks/Snowflake data engineering integration skills
  • Good exposure to:
    • Cloud platforms (Azure/AWS/GCP)
    • SQL
    • Containers, CI/CD, monitoring

Data / AI Foundations (Mandatory)

Prior experience in one or more:

  • Data Engineering (ETL/ELT, pipelines, orchestration)
  • Data Science / ML lifecycle (especially NLP)
  • Analytics engineering / data products

Leadership Capabilities

  • Experience leading solution design or small teams
  • Ability to translate business problems into AI solutions
  • Strong stakeholder communication and influencing skills

Good-to-Have / Preferred

  • Fine-tuning approaches: LoRA / PEFT / prompt tuning
  • Experience with Azure AI stack (Azure OpenAI, AI Search)
  • Exposure to:
    • Enterprise security & data privacy in GenAI
    • Coding agents / autonomous agent frameworks
  • Experience in insurance / BFSI domains (valuable for EXL use cases)

Qualifications: Key Responsibilities

1. Solution Architecture & Technical Leadership

  • Architect enterprise-grade agentic and LLM solutions (single-agent, multi-agent, tool-driven workflows)
  • Define scalable GenAI system design patterns (RAG, orchestration layers, evaluation frameworks)
  • Act as the technical anchor for GenAI initiatives across projects
  • Drive design reviews, architecture governance, and best practices

2. Agentic AI & LLM Engineering

  • Design and build agentic systems using LLMs for use cases such as:
    • Knowledge assistants
    • Document automation & intelligence
    • Workflow orchestration
  • Implement advanced prompt engineering strategies , prompt orchestration, and reasoning chains
  • Build tool-calling / function-calling frameworks for agent workflows

3. RAG & Retrieval Systems

  • Lead end-to-end implementation of RAG pipelines : Data ingestion chunking embeddings vector indexing retrieval
    • response generation
  • Optimise retrieval quality (recall, relevance, grounding)
  • Evaluate and benchmark different architectures

4. Productisation & Engineering Excellence

  • Develop production-grade APIs/services (FastAPI, Flask, etc.)
  • Drive code quality, testing standards, and reusable architecture components
  • Ensure solutions are performance optimised (latency, cost, reliability)

5. Governance, Safety & Evaluation

  • Implement LLM guardrails :
    • Hallucination control
    • Safety filters
    • Policy enforcement
  • Define evaluation frameworks :
    • Response quality metrics
    • RAG benchmarking
    • Human-in-the-loop validation

6. Collaboration & Delivery Leadership

Partner with: Data Engineering
    • pipelines, data quality, governance
    • MLOps
    • deployment, CI/CD, monitoring
    • Business/Product
    • use-case alignment
  • Drive end-to-end delivery ownership across multiple projects

7. Technical Leadership Responsibilities (Critical Addition)

  • Mentor and guide junior engineers and project teams
  • Conduct technical reviews, solution walkthroughs, and code reviews
  • Support pre-sales / RFPs / solution proposals with architecture inputs
  • Drive reusable accelerators, frameworks, and COE assets
  • Stay ahead of industry evolution and help shape EXL’s GenAI strategy
  • Influence technology choice, design decisions, and roadmap planning

Must-Have Skills

Experience

  • 9–12 years total experience
  • 2–4+ years hands-on in LLM / GenAI delivery (production use cases)

LLM / GenAI & Agentic Engineering

  • Strong hands-on experience with:
    • LLMs (Claude, OpenAI, etc.)
    • RAG pipelines and retrieval optimisation
    • GPT + Agentic AI implementation experience
  • Experience with:
    • LangChain, LangGraph, or similar frameworks
    • Agent orchestration and tool-calling architectures
  • Deep understanding of: LLM limitations, evaluation, and optimisation strategies

Core Engineering

  • Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
  • Deep data analysis experience and handling large volume of data
  • Fabric/Azure Databricks/Snowflake data engineering integration skills
  • Good exposure to:
    • Cloud platforms (Azure/AWS/GCP)
    • SQL
    • Containers, CI/CD, monitoring

Data / AI Foundations (Mandatory)

Prior experience in one or more:

  • Data Engineering (ETL/ELT, pipelines, orchestration)
  • Data Science / ML lifecycle (especially NLP)
  • Analytics engineering / data products

Leadership Capabilities

  • Experience leading solution design or small teams
  • Ability to translate business problems into AI solutions
  • Strong stakeholder communication and influencing skills

Good-to-Have / Preferred

  • Fine-tuning approaches: LoRA / PEFT / prompt tuning
  • Experience with Azure AI stack (Azure OpenAI, AI Search)
  • Exposure to:
    • Enterprise security & data privacy in GenAI
    • Coding agents / autonomous agent frameworks
  • Experience in insurance / BFSI domains (valuable for EXL use cases)
Share job
Similar Jobs
View All
1 Day ago
Senior Software Engineer - VP
Information Technology
  • Mumbai, Maharashtra, IN
Date live: 06/26/2026 Business Area: Global Payment Services Area of Expertise: Technology Contract: Permanent Reference Code: JR-0000093121Embark your transformative journey as a Senior Software Engineer - VP. You are accountable for the integrati...
decor
1 Day ago
Data Engineer
Information Technology
  • Mumbai, Maharashtra, IN
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes...
decor
2 Days ago
IT Specialist
Information Technology
  • Bangalore, KA, India
Additional Information Job Number26077959 Job CategoryInformation Technology LocationMaradu, Kochi, Kerala, India, 682304 ScheduleFull Time Located Remotely?N Position Type Non-Management POSITION SUMMARYInstall, configure, manage, maintain, test, ev...
decor
2 Days ago
System/Network Engineer
Information Technology
  • 500000 - 1400000 INR - Yearly
  • Bangalore, KA, India
Job Title: System / Network EngineerLocation: Coimbatore, Tamil NaduExperience: 5–6 Years Key Requirements:Strong experience in Linux AdministrationHands-on expertise in Cisco Networking (Routing & Switching)System Administration & TroubleshootingKn...
decor
2 Days ago
Data Engineer III
Information Technology
  • Bangalore, KA, India
Data Engineer III Join a Collaborative, Inclusive Team Driving Innovation in Healthcare Technology Make a Difference with Us Are you passionate about developing high-quality software that positively impacts people’s lives? Do you enjoy collaborating ...
decor
2 Days ago
Data Engineer
Information Technology
  • Bangalore, KA, India
Date live: 06/24/2026 Business Area: Trade and Working Capital Area of Expertise: Technology Contract: Permanent Reference Code: JR-0000114909Join us as a Data Engineer at Barclays, where you will spearhead the evolution of our infrastructure and d...
decor
2 Days ago
.NET Developer
Information Technology
  • Bangalore, KA, India
Lucknow, Uttar Pradesh Job Summary ABAP on HANA Key Responsibilities 1. Develop And Deliver Code For Assigned Projects Using .Net Framework And C#, Adhering To Established Quality Standards And Delivery Slas. 2. Maintain Existing Applications By Tr...
decor
2 Days ago
IN_Senior Associate_Business Analyst_FS Tech_Advisory_Mumbai
Information Technology
  • Bangalore, KA, India
Line of Service Advisory Industry/Sector FS X-Sector Specialism Operations Management Level Senior Associate Job Description & Summary At PwC, our people in business application consulting specialise in consulting services for a variety of business a...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media