Applied AI Engineer (Agentic Workflows, Model Routing)

Job Description

Why Gainsight?

We are ranked #1 on Glassdoor’s 2023 Best Place to Work List. Here’s why.

At Gainsight, our mission is to be living proof you can win in business while being human-first.

Our industry-leading platform helps companies of all sizes and industries build durable businesses. Gainsight offers a powerful set of customer success, product, and community engagement solutions that enable businesses to scale efficiently, create alignment, and have a holistic view of their customers—all of which help increase product adoption, prevent churn, and grow renewals and expansions. Our software is used by hundreds of companies, including nearly 200 publicly traded organizations and industry leaders such as GE Digital, SAP Concur, and Box. We have offices in the US, UK, Netherlands, Israel, Japan, and India.

Gainsight joined the Vista Equity Partners portfolio in 2020. In 2021, we won their Excellence in Engineering award in recognition of our product and engineering advancements.

Gainsight has also been named one of the top 100 private cloud companies in the world by Forbes, one of the fastest-growing private companies in America by Inc. Magazine, and one of 20 Great Workplaces in Tech by Fortune Magazine.

With diversity and inclusion at the forefront of our values, we promote a culture that celebrates diversity and inclusiveness regardless of, but not limited to, race, gender, sexual orientation, family status, religion, ethnicity, national origin, physical disability, veteran status, or age.

Job Summary

Applied AI Engineer (Agentic Workflows, Model Routing)

As an Applied AI Engineer specializing in Agentic Workflows and Model Routing, you will focus on orchestrating complex, multi-model AI systems that enable intelligent decision-making. Your work goes beyond selecting the right models—you will design and build adaptive AI agents that dynamically route tasks between different LLMs, APIs, and external data sources.

This role requires deep expertise in agentic behavior design, multi-model coordination, and workflow optimization, ensuring that AI-driven agents can autonomously reason, select models, and handle complex decision trees.

What You Will Do

• Evaluate and integrate orchestration frameworks (e.g., LangChain, LlamaIndex) to optimize model routing logic.
• Configure AI agents to intelligently select the best model for each query, leveraging GPT-4 for complex reasoning, Llama 2 for rapid responses, and Claude for nuanced understanding.
• Develop fallback and escalation mechanisms, ensuring tasks are reassigned to the appropriate model if an initial response lacks confidence or accuracy.
• Fine-tune multi-step agentic workflows that incorporate external APIs, retrieval-augmented data (RAG), and reflection prompts to ensure high-quality outputs.
• Monitor performance metrics and AI decision policies, continuously refining workflows based on real-world feedback and LLM evaluation metrics.
• Design AI-driven handoff strategies for seamless agent communication, error recovery, and reasoning enhancements.
• Implement dashboards and evaluation criteria to measure how agentic workflows evolve over time.
• Collaborate with AI researchers, engineers, and product teams to enhance autonomous agent capabilities in a real-world production environment.
  
  

Who You Are: (Experience & Qualifications):

• 5–8+ years of experience in AI, Machine Learning, NLP, or AI Systems Engineering.
• 2–3+ years of hands-on experience building AI agents, designing model routing architectures, or working with multi-model AI orchestration.
• Expertise in agentic frameworks such as LangChain, LlamaIndex, CrewAI, or OpenAI function calling.
• Deep knowledge of LLM architectures (GPT-4, Claude, Llama 2, Mistral) and experience orchestrating multi-model decision workflows.
• Strong understanding of retrieval-augmented generation (RAG) and how to integrate vector databases into AI workflows.
• Experience designing self-assessment and reflection prompts that improve agent reasoning accuracy.
• Proficiency in Python, OpenAI SDK, Hugging Face, and cloud-based AI deployments.
• Strong grasp of LLM safety mechanisms, fallback strategies, and ethical AI development.
• Experience implementing evaluation dashboards and tracking model performance using AI metrics (win-rate comparisons, perplexity, response confidence).
  
  

Bonus Skills (Nice to Have)

• Experience fine-tuning open-source LLMs for domain-specific use cases.
• Strong grasp of automated agent handoffs and escalation pathways.
• Familiarity with multi-agent AI research, including self-improving agent architectures.
• Knowledge of LLM caching, latency optimization, and efficient model-switching technique
  
  

Why You’ll Love It Here

Your job shouldn’t stand in the way of your happiness—it should be a path to achieve it. At Gainsight, we’re passionate about achieving our goals—at the office and everywhere—and we work every day to create an environment that nurtures our best selves.

Gainsters love working here for several reasons. Here are a few:

• Our Core Values: We are guided by our values on our mission to be living proof you can win in business while being human-first. Learn more here.
• Our CEO: With a 99% approval rating on Glassdoor, Nick Mehta is one of the most beloved CEOs in Silicon Valley.
• Our Growth Opportunities: From mentoring to career development opportunities, we’re passionate about helping our Gainsters learn, grow and thrive.
• Our Teammate Resource Groups: A huge source of pride for Gainsight, these groups are on a mission to put our values into action and make Gainsight a great place to work for all.
• Our Wellness Priorities: Quarterly Recharge Days that re-energize us.
• Our Parody Videos: No explanation needed. Just watch them here!
  
  

Job Description Summary

By joining the Gainsight team, you’ll have a unique opportunity to make your mark at a truly human-first company and have loads of fun doing it. Come join us!