Bangalore, Karnataka, India
Information Technology
Full-Time
Gainwell Technologies LLC
Overview
Summary
Gainwell is seeking LLM Ops Engineers and ML Ops Engineers to join our growing AI/ML team. This role is responsible for developing, deploying, and maintaining scalable infrastructure and pipelines for Machine Learning (ML) models and Large Language Models (LLMs). You will play a critical role in ensuring smooth model lifecycle management, performance monitoring, version control, and compliance while collaborating closely with Data Scientists, DevOps, and
Role Description
Core LLM Ops Responsibilities:
Core LLM Ops Responsibilities:
- Develop and manage scalable deployment strategies specifically tailored for LLMs (GPT, Llama, Claude, etc.).
- Optimize LLM inference performance, including model parallelization, quantization, pruning, and fine-tuning pipelines.
- Integrate prompt management, version control, and retrieval-augmented generation (RAG) pipelines.
- Manage vector databases, embedding stores, and document stores used in conjunction with LLMs.
- Monitor hallucination rates, token usage, and overall cost optimization for LLM APIs or on-prem deployments.
- Continuously monitor models for its performance and ensure alert system in place.
- Ensure compliance with ethical AI practices, privacy regulations, and responsible AI guidelines in LLM workflows.
- Design, build, and maintain robust CI/CD pipelines for ML model training, validation, deployment, and monitoring.
- Implement version control, model registry, and reproducibility strategies for ML models.
- Automate data ingestion, feature engineering, and model retraining workflows.
- Monitor model performance, drift, and ensure proper alerting systems are in place.
- Implement security, compliance, and governance protocols for model deployment.
- Collaborate with Data Scientists to streamline model development and experimentation.
What We’re Looking For
- Bachelor's or Master's degree or higher in Computer Science, Data Sciences-Machine Learning, Engineering, or related fields.
- Strong experience with ML Ops tools (Kubeflow, ML flow, TFX, Sage Maker, etc.).
- Experience with LLM-specific tools and frameworks ( LangChain, Lang Graph, LlamaIndex, Hugging Face, OpenAI APIs, Vector DBs like Pinecone, FAISS, Weavite, Chroma DB etc.).
- Solid experience in deploying models in cloud (AWS, Azure, GCP) and on-prem environments.
- Proficient in containerization (Docker, Kubernetes) and CI/CD practices.
- Familiarity with monitoring tools like Prometheus, Grafana, and ML observability platforms.
- Strong coding skills in Python, Bash, and familiarity with infrastructure-as-code tools (Terraform, Helm, etc.).Knowledge of healthcare AI applications and regulatory compliance (HIPAA, CMS) is a plus.
- Strong skills in Giskard, Deepeval etc.
- Bachelor or Masters or Higher in Computer Sciences, Data Sciences, or any related field
- 3+ years to 7 Years of experience in deploying ML/DL and LLM based solutions in large scale deployment environment or related experience
- Experience with fine-tuning LLMs and serving them in production at scale.
- Knowledge of model compression techniques for LLMs (LoRA, QLoRA, quantization-aware training).
- Experience with distributed systems and high-performance computing for large-scale model serving.
What You Should Expect in This Role
- Fully Remote Opportunity – Work from anywhere in the U.S. / India
- Minimal Travel Required – Occasional travel opportunities (0-10%).
- Opportunity to Work on Cutting-Edge AI Solutions in a mission-driven healthcare technology environment.
Similar Jobs
View All
1 Day ago
Python Developer
Information Technology
- Bangalore, Karnataka, India
We are looking for a highly skilled Python Developer to join our team in building and optimizing advanced AI/ML frameworks. As a Python Developer in our AI/ML team, you will be responsible for creating, implementing, and scaling innovative machine le...
1 Day ago
Web Developer
Information Technology
- 400000 - 400000 Indian Rupee - Yearly
- Bangalore, Karnataka, India
C#.NET Web Developer Location: On-site | Type:Experienced, In-Office Full-time, Permanent Required Experience: Min-2years and Max-3years CTC: ₹4LPASantronix is a team driven by passion for excellence in software srevices. We are looking forward to...
2 Days ago
Product Security Engineer
Information Technology
- 3 - 6 Yrs
- Noida
Role: Product Security Engineer
Experience: 3+ Years
Location: Noida
Job Description:
Security Specialist in areas of Security Vulnerability Assessment & Penetration Testing. Responsible for periodic assessment and implementation of remediation...
2 Days ago
Sr. DevOps Engineer
Information Technology
- 7 - 12 Yrs
- Mumbai
ComUnus is hiring for Sr. DevOps Engineer
No Of Position : 3
Exp. Req : 7+ Yrs
Work Location : Mumbai (Vikhroli)
Max NP : Immediate Joiners are preferred
Must Have Skills : AWS
Key Responsibilities:
1. 7+ years of Hands-On experience as De...
2 Days ago
Java FullStack developer
Information Technology
- Bangalore, Karnataka, India
Urgent opening for Java FullStack developer (Java+React)Job Title: Full Stack Developer (Java+ ReactJS)Experience: 5 – 10 YearsSalary: Up to 38 LPALocation: RemoteNotice Period:immediate to 15 days(take candidate who are in serving notice period only...
2 Days ago
Senior Data Analyst
Information Technology
- Bangalore, Karnataka, India
As a Data Analyst, you should be able to propose creative solutions to develop/solve a business problem. Should be able to recommend design and develop state-of-the-art data-driven analysis using statistical; understating of advanced analytics method...
2 Days ago
Refrigeration & Energy Systems - Data Analytics Engineer
Information Technology
- Bangalore, Karnataka, India
Join Energy Recovery and Help Build a Sustainable Future At Energy Recovery, we build products that help limit global temperature rise, reduce carbon emissions, provide safe drinking water for millions of people, and bring efficiency and sustainabil...
2 Days ago
Interesting Job Opportunity: Bitkraft Technologies - Full Stack Developer - AngularJS & Node.js
Information Technology
SummaryBitkraft Technologies LLP is looking for Full-stack Engineers to join our software engineering team. You will be working across the stack on cutting edge web development projects for our custom services business.As a Full-stack Engineer, you ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in