AI Engineer (LLM finetuning)

Overview

About MostEdge

MostEdge empowers retailers with smart, trusted, and sustainable solutions to run their stores more efficiently. Through our Inventory Management Service, powered by the StockUPC app, we provide accurate, real-time insights that help stores track inventory, prevent shrink, and make smarter buying decisions.

Our mission is to deliver trusted, profitable experiences—empowering retailers, partners and employees to accelerate commerce in a sustainable manner.

Job Summary:

We are hiring an experienced AI Engineer / ML Specialist with deep expertise in Large Language Models (LLMs), who can fine-tune, customize, and integrate state-of-the-art models like OpenAI GPT, Claude, LLaMA, Mistral, and Gemini into real-world business applications.

The ideal candidate should have hands-on experience with foundation model customization, prompt engineering, retrieval-augmented generation (RAG), and deployment of AI assistants using public cloud AI platforms like Azure OpenAI, Amazon Bedrock, Google Vertex AI, or Anthropic’s Claude.

Key Responsibilities:

LLM Customization & Fine-Tuning

• Fine-tune popular open-source LLMs (e.g., LLaMA, Mistral, Falcon, Mixtral) using business/domain-specific data.
• Customize foundation models via instruction tuning, parameter-efficient fine-tuning (LoRA, QLoRA, PEFT), or prompt tuning.
• Evaluate and optimize the performance, factual accuracy, and tone of LLM responses.

AI Assistant Development

• Build and integrate AI assistants/chatbots for internal tools or customer-facing applications.
• Design and implement Retrieval-Augmented Generation (RAG) pipelines using tools like LangChain, LlamaIndex, Haystack, or OpenAI Assistants API.
• Use embedding models, vector databases (e.g., Pinecone, FAISS, Weaviate, ChromaDB), and cloud AI services.
• Must have experience of finetuning, and maintaining microservices or LLM driven databases.

Cloud Integration

• Deploy and manage LLM-based solutions on AWS Bedrock, Azure OpenAI, Google Vertex AI, Anthropic Claude, or OpenAI API.
• Optimize API usage, performance, latency, and cost.
• Secure integrations with identity/auth systems (OAuth2, API keys) and logging/monitoring.

Evaluation, Guardrails & Compliance

• Implement guardrails, content moderation, and RLHF techniques to ensure safe and useful outputs.
• Benchmark models using human evaluation and standard metrics (e.g., BLEU, ROUGE, perplexity).
• Ensure compliance with privacy, IP, and data governance requirements.

Collaboration & Documentation

• Work closely with product, engineering, and data teams to scope and build AI-based solutions.
• Document custom model behaviors, API usage patterns, prompts, and datasets.
• Stay up-to-date with the latest LLM research and tooling advancements.

Required Skills & Qualifications:

• Bachelor’s or Master’s in Computer Science, AI/ML, Data Science, or related fields.
• 3–6+ years of experience in AI/ML, with a focus on LLMs, NLP, and GenAI systems.
• Strong Python programming skills and experience with Hugging Face Transformers, LangChain, LlamaIndex.
• Hands-on with LLM APIs from OpenAI, Azure, AWS Bedrock, Google Vertex AI, Claude, Cohere, etc.
• Knowledge of PEFT techniques like LoRA, QLoRA, Prompt Tuning, Adapters.
• Familiarity with vector databases and document embedding pipelines.
• Experience deploying LLM-based apps using FastAPI, Flask, Docker, and cloud services.

Preferred Skills:

• Experience with open-source LLMs: Mistral, LLaMA, GPT-J, Falcon, Vicuna, etc.
• Knowledge of AutoGPT, CrewAI, Agentic workflows, or multi-agent LLM orchestration.
• Experience with multi-turn conversation modeling, dialogue state tracking.
• Understanding of model quantization, distillation, or fine-tuning in low-resource environments.
• Familiarity with ethical AI practices, hallucination mitigation, and user alignment.

Tools & Technologies:

LLM Frameworks - Hugging Face, Transformers, PEFT, LangChain, LlamaIndex, Haystack

LLMs & APIs - OpenAI (GPT-4, GPT-3.5), Claude, Mistral, LLaMA, Cohere, Gemini, Azure OpenAI

Vector Databases - FAISS, Pinecone, Weaviate, ChromaDB

Serving & DevOps - Docker, FastAPI, Flask, GitHub Actions, Kubernetes

Deployment Platforms - AWS Bedrock, Azure ML, GCP Vertex AI, Lambda, Streamlit

Monitoring - Prometheus, MLflow, Langfuse, Weights & Biases

Benefits:

• Competitive salary with performance incentives.
• Work with cutting-edge GenAI and LLM technologies.
• Build real-world products using state-of-the-art AI research.

Job Types: Full-time, Permanent

Pay: From ₹400,000.00 per year

Benefits:

• Health insurance
• Life insurance
• Paid sick time
• Paid time off
• Provident Fund

Schedule:

• Evening shift
• Monday to Friday
• Morning shift
• Night shift
• Rotational shift
• US shift
• Weekend availability

Supplemental Pay:

• Performance bonus
• Quarterly bonus
• Yearly bonus

Work Location: In person

Application Deadline: 25/07/2025
Expected Start Date: 01/08/2025