Sr. Test Engineer - API Testing Job

Overview

We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any time whether you accept cookies or choose to opt out of cookies to improve website's performance, as well as cookies used to display content tailored to your interests. Your experience of the site and the services we are able to offer may be impacted if you do not accept all cookies.

Skip to main content

• Home Page
• Home Page
• Life At YASH
• Core Values
• Careers
• Business Consulting Jobs
• Digital Jobs
• ERP
• IT Infrastructure Jobs
• Sales & Marketing Jobs
• Software Development Jobs
• Solution Architects Jobs
• Join Our Talent Community
• Social Media
• LinkedIn
• Twitter
• Instagram
• Facebook
  

Search by Keyword

Search by Location

• Home Page
• Home Page
• Life At YASH
• Core Values
• Careers
• Business Consulting Jobs
• Digital Jobs
• ERP
• IT Infrastructure Jobs
• Sales & Marketing Jobs
• Software Development Jobs
• Solution Architects Jobs
• Join Our Talent Community
• Social Media
• LinkedIn
• Twitter
• Instagram
• Facebook
  

View Profile

Employee Login

Search by Keyword

Search by Location

Show More Options

Loading...

Requisition ID

All

Skills

All

Select How Often (in Days) To Receive An Alert:

Create Alert

Select How Often (in Days) To Receive An Alert:

Apply now »

• Apply Now
• Start apply with LinkedIn
• Please wait...
  
  

Sr. Test Engineer - API Testing Job

Date: Mar 7, 2026

Job Requisition Id: 64248

Location:

Indore, MP, IN

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire API Testing Professionals in the following areas :

Senior AI QA Tester (AI / GenAI Testing)

Role Purpose

We are seeking a detail-oriented AI QA Tester to join our team to ensure the quality of our AI agents. Unlike traditional software, you will focus on human-in-the-loop validation of AI behavior, testing conversational accuracy, decision-making capabilities, and tool integration (API/function calling) to ensure the AI behaves as expected in real-world scenarios.

Key Responsibilities

• Design and implement test strategies for text-based AI agents and conversational systems
• Understands LLM responses, reasoning accuracy, and hallucination risks
• AI Response Validation: Manually verify that AI agent responses are accurate, non-toxic, and free of hallucinations.
• Functional & Agentic Testing: Test the agent's ability to call external tools (MCP, APIs) and execute complex workflows correctly.
• Scenario Testing: Develop and execute manual test cases for diverse, edge-case user queries, including adversarial testing (prompt injection).
• Defect Documentation: Identify, document, and report bugs in AI reasoning, UI, and performance in tools like JIRA.
• UAT & Usability: Perform User Acceptance Testing to ensure the AI interaction is intuitive and meets end-user needs.
• Dataset Curation: Collaborate with developers to create high-quality datasets for training and testing.
  
  

• Testing Expertise: 4+ years of experience in functional, regression, and usability testing.
• Additional weightage will be given to candidates worked on AI Product Testing.
• AI Familiarity: Understanding of LLM behavior, chatbots, or agentic systems.
• API Testing: Hands-on experience with tools like Postman to validate AI API calls.
• Analytical Skills: Strong ability to analyze unstructured conversational data and identify patterns.
• Technical Aptitude: Basic knowledge of Python or SQL is a plus for analyzing logs.
  
  

Must-Have Skills

AI Testing & Evaluation

• Experience testing AI chatbots
• Prompt testing and response evaluation
• Hallucination detection and output validation
• Testing RAG pipelines and knowledge retrieval
• Understanding of LLM evaluation metrics
  
  

Technical Skills

• API testing
• Test automation frameworks (PyTest or similar)
• REST services testing
  
  

AI System Testing

• Testing agent workflows and tool integrations
• Multi-turn conversation testing
  
  

Good-to-Have Skills

• LLM evaluation tools such as:
• LangSmith
• Promptfoo
• DeepEval
• Experience with vector databases (Pinecone, Weaviate, FAISS)
• Knowledge of AI safety and responsible AI
• Experience with MLOps tools (MLflow, Kubeflow)
  

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture
  
  

Apply now »

• Apply Now
• Start apply with LinkedIn
• Please wait...
  
  

• Careers Home
• View All Jobs
• Top Jobs
  
  

Quick Links

• Blogs
• Events
• Webinars
• Media
  
  

Contact

• Contact Us
  
  

Copyright © 2020. YASH Technologies. All Rights Reserved.