Bangalore, Karnataka, India
Information Technology
Full-Time
FiftyFive Technologies
Overview
Job Title: Mid Senior Data Engineer (LLM & AI Infrastructure)
About the Role
We are looking for a Data Engineer with a minimum of 1 year of experience working with LLMs and a strong background in data pipelines, storage optimization, and AI-driven data processing. The ideal candidate will play a key role in managing, optimizing, and scaling data architectures to support LLM applications and AI workflows.
Key Responsibilities
Design and develop scalable, high-performance data pipelines for AI and LLM-powered applications.- Work with structured and unstructured data, ensuring efficient preprocessing, transformation, and storage.
- Implement and optimize data retrieval and indexing strategies for LLM fine-tuning and inference.
- Manage vector databases (FAISS, Chroma, Pinecone, Weaviate, Astra DB.) for retrieval-augmented generation (RAG) workflows.
- Build and maintain ETL/ELT workflows using tools like Airflow, Prefect, or Dagster.
- Ensure data quality, governance, and lineage to support AI-driven insights.
- Collaborate with ML engineers and researchers to improve LLM data pipelines and infrastructure.
- Work with cloud-based data storage solutions (AWS S3, GCP BigQuery, Azure Data Lake, etc.).
- Automate data monitoring, validation, and debugging to ensure seamless pipeline execution.
Required Skills & Experience
4+ years of overall experience in data engineering, AI infrastructure, or related fields.- At least 1 year of hands-on experience working with LLMs and AI data workflows.
- Strong expertise in Python, SQL, and distributed data processing frameworks (Spark, Dask, Ray, or similar).
- Experience with vector databases and retrieval systems for AI-driven applications.
- Knowledge of data modeling, indexing, and storage optimization.
- Familiarity with ETL/ELT frameworks like Apache Airflow, Prefect, or Dagster.
- Experience handling large-scale datasets and optimizing data ingestion pipelines.
- Understanding of cloud-based data architectures (AWS, GCP, Azure).
- Basic knowledge of MLOps principles and integrating data workflows with AI models.
Nice to Have
Exposure to LLM fine-tuning, embeddings, and retrieval-augmented generation (RAG).- Experience with LangChain, Hugging Face Transformers, or OpenAI APIs.
- Familiarity with feature stores (Feast, Tecton) and streaming platforms (Kafka)
Similar Jobs
View All
3 Hours ago
US Voice Process (Banking Domain)
Telecommunications
- 40000 - 45000 INR - Monthly
- 1 - 1 Yrs
- Greater Noida
Process: US Voice – Banking (International)
Eligibility: Graduate / Undergraduate with 6 months international voice process experience
Experience: 6 months – 2+ years (in International BPO – Voice)
Salary:
₹40,000 CTC (6 months+ experienc...
1 Day ago
Data Analyst
Information Technology
- 300000 - 1200000 INR - Annual
- 1 - 7 Yrs
- Anywhere in India/Multiple Locations
Location: Remote – India
Experience: 1–7 years
Employment Type: Full-time & Part-time options available
About the Role
We’re seeking analytical minds who love turning data into actionable insights. As a Data Analyst, you’ll work closely w...
1 Day ago
Sr. ServiceNow Developer | 8+ Years | Pune
Information Technology
- 30 - 40 INR - Annual
- 8 - 11 Yrs
- Pune
About the Role:
This is a senior-level ServiceNow Developer role where you’ll be responsible for driving the technical vision and execution of complex ServiceNow solutions across the organization.
What We’re Looking For:
Strong hands-...
1 Day ago
Mobile Developer
Information Technology
- 350000 - 1000000 INR - Annual
- 1 - 6 Yrs
- Anywhere in India/Multiple Locations
About the Role
We're looking for talented Mobile Developers—whether you're a rising star with a year of experience or a seasoned engineer with eight—to build intuitive, high-performance mobile applications for Android and iOS. You’ll collaborate w...
1 Day ago
Senior Software Engineer - Data Platform
Information Technology
- Lucknow, Uttar Pradesh, India
Get to know OktaOkta is The World’s Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and auto...
1 Day ago
Business Analyst - Fertilizers Industry
Information Technology
- 600000 - 800000 INR - Yearly
- Hyderabad, Telangana, India
Job Summary: The role is open for a Business Analyst with 3 to 6 years of experience in the Fertilizers Industry. The candidate should be proficient in gathering, reviewing, and analyzing business operations data, preparing models and process maps ...
1 Day ago
Senior Program Manager - IT
Information Technology
- Lucknow, Uttar Pradesh, India
R1 RCM Inc. is a leading provider of technology-enabled revenue cycle management services that transform and solve challenges across health systems, hospitals, and physician practices. Headquartered in Chicago, R1® is a publicly traded organization ...
1 Day ago
Software Developer in Mohali, Chandigarh
Information Technology
- Thane, Maharashtra, India
Key Responsibilities Develop, test, and maintain high-quality software applications Collaborate with cross-functional teams to define, design, and ship new features Participate in code reviews to ensure code quality and integrity Write clean, sc...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in