Senior QA Engineer

Overview

Senior Quality Engineer

Experience: 5- 7 years

Requirements:

• Bachelor's/Master's degree in Computer Science or related field.
• 5-6 years of experience in Quality Engineering (QE) domain.
• Good understanding of Generative AI tools and platforms - especially LLMs.
• Foundation Knowledge of Gen-AI concepts, technologies, tools and frameworks
• Basic understanding of LLM models, prompt engineering, and some exposure to AI Art models and tools
• Detailed understanding and solid hands-on working knowledge of LLM evaluations, and using evaluators to validate the quality of LLM outputs.
• Solid knowledge of software testing methodologies, tools, and processes.
• Excellent analytical and problem-solving skills.
• Effective communication and collaboration skills.
• Proven ability to lead and mentor team members.
• Ability to lead quality assurance for data-driven and data-intensive apps and solutions
• Ability to prepare and organize test data sets and manage large amounts of test data
• Performing thorough data validation and verification to ensure accuracy and consistency of data. This includes developing and executing test plans, scripts, and tools for data verification.
• Build and execute test plans for workflow driven apps and solutions, and pipeline automation solutions
• Developing and implementing automated testing tools and frameworks to streamline QA processes. Optimize testing procedures for efficiency and effectiveness.
  
  
  

 

Responsibilities:

>Take ownership of solution quality for a digital product or platform

>Collaborate closely with the Dev team and Product team to drive quality engineering and assurance for an existing digital product

>Ensure successful client adoption and client onboarding as new clients are onboarded onto a digital product/platform.

>Lead and execute comprehensive automated testing strategies for cloud applications, ensuring high quality and reliability.

>Hands-on experience with API test tools (ex. Postman, SOAP UI, etc.) , API test automation

>Hands-on experience with Test Automation overall – and the ability to automate all aspects of testing, from UE to Back-End Testing

>Proficient in designing, implementing, and maintaining automated test scripts.

>Thorough understanding of Gen AI automation principles and implementation.

>Solid understanding of using LLM Evaluation frameworks and libraries (such as RAGAS and others) to perform automated evaluation of LLM Outputs

>Solid understanding of LLM Quality metrics and validating AI generated outputs

> Proven experience on testing of creative apps .

> Experience with testing mobile apps is an advantage (nice-to-have)

> Collaborate with cross-functional teams to define testing requirements and ensure effective test coverage.

>Conduct test case reviews, identify gaps, and provide constructive feedback to improve overall test quality.

>Analyze and troubleshoot complex issues in a timely manner, documenting and communicating findings.

>Stay updated with industry best practices and emerging technologies in QA and automation.

>Mentor and guide junior QA engineers, fostering a collaborative and knowledge-sharing environment.

>Continuously improve testing processes and methodologies to enhance efficiency and effectiveness.

Location:

Pune

Brand:

Dentsu Creative

Time Type:

Full time

Contract Type:

Permanent