Test Engineer, AI/ML

Responsibilities:

• Part of a team (BA/PO, Developers, SDETs etc) that develops enterprise software applications.
• Understand the business requirements and design, development/coding aspects.
• Participate in the complete development life cycle.
• Design and Implement test strategy, test plan, test cases, test automation and execution.
• Focus on validating the functionality, performance and reliability of AI/ML models.
• Evaluate various aspects of AI/ML models, including functionality, performance, accuracy, bias, robustness and safety.
• Track model performance, identify issues and provide regular reports on quality and reliability
• Craft and refine the prompts or instructions to guide, develop the Generative AI models
• Strive for self-excellence along with enabling success of the team/stakeholders.

Requirements:

• 2 to 6 years of experience with enterprise software product development lifecycle/phases.
• Blend of software testing experience with strong knowledge of AI/ML concepts, tools, frameworks.
• Strong understanding of Generative AI model algorithms, training and deployment processes.
• Experience in evaluating model performance using metrics like Accuracy, Precision, Recall, F1-Score, Latency, Stress etc
• Experience in prompt engineering and assessing models for bias, fairness and ethical concerns.
• Experience in validating data quality and integrate throughout the model development lifecycle.
• Experience in crafting and refining prompts to guide Large Language Models (LLM) and Small Language Models (SLM)
• Experience in Python programming and tools like OpenAI, TensorFlow, PyTorch, DialogFLow etc.
• Experience in integrating testing processes into CI/CD pipelines.