Overview
PwC AC is hiring for QA Analyst
Apply and get a chance to work with one of the Big4 companies #PwC AC.
Job Title: QA Analyst
Years of Experience: 4+ years
Shift Timings: 2PM-11PM
Qualification: Graduate and above(Full time)
About PwC CTIO – EmTech
PwC’s Commercial Technology and Innovation Office (CTIO) is committed to shaping the future of technology within the firm. The EmTech (Emerging Technologies) division pioneers next-gen AI/ML/GenAI solutions, explores groundbreaking technologies, and delivers scalable innovation. We blend engineering rigor with applied AI research to transform ideas into real-world impact.
We are at the intersection of software engineering and AI innovation — pushing boundaries in LLMOps, MLOps, and AI infrastructure to enable agile, secure, and scalable delivery of AI-powered products across domains.
Role Overview
We are seeking Test Automation QA with 4 -6+ years of experience in IT, specializing in Generative AI Testing and Test Automation management. Expertise in designing and implementing AI-driven test strategies using advanced tools. Proficient in key skills such as test strategy design, test execution planning, test development & monitoring, and enterprise testing frameworks, with a strong focus on process automation and team leadership.
Key Responsibilities:
- Design, develop, and maintain scalable and reliable test automation frameworks utilizing Python, Java/C##. Expertise in designing and implementing AI-driven test strategies using advanced tools like OpenAI, GitHub Copilot, etc.
- Demonstrate understanding of or possess hands-on experience with testing methodologies specific to Generative AI and large language model (LLM)-based systems.
- Perform thorough manual testing across web applications, APIs, and backend services to ensure functional stability and performance.
- Collaborate closely with software engineers and business analysts to gather and interpret requirements, ensuring comprehensive test coverage and alignment with business objectives.
- Execute various types of testing including functional, regression, integration, and system-level testing to ensure product quality and reliability.
- Develop and manage test plans, create detailed test cases, and document clear, actionable defect reports.
- Integrate automated test suites into CI/CD pipelines to enable continuous testing and quality assurance throughout the development lifecycle.
- Actively participate in Agile ceremonies such as sprint planning, daily stand-ups, and retrospectives, contributing to continuous improvement initiatives.
Mandatory Skills:
- Over 4 to 6 years of professional experience in the IT industry, with a strong focus on test automation management.
- A minimum of 1.5 years of hands-on experience in testing Generative AI systems.
- Proven expertise in both automated and manual testing methodologies across diverse application landscapes.
- Sound understanding and/or practical experience in testing strategies specific to Generative AI and Large Language Model (LLM)-based applications.
- Strong proficiency in API testing and backend system validation to ensure data integrity and service reliability.
- Skilled in developing and maintaining test automation scripts using Python and Java.
- Extensive experience with automation frameworks such as Pytest, Selenium, Playwright, Rest Assured.
- Well-versed in Continuous Integration/Continuous Deployment (CI/CD) practices, with familiarity in integrating test suites into CI/CD pipelines using industry-standard tools.
Good to Have:
- Experience with Azure DevOps (ADO) for comprehensive test management, task tracking, and collaboration within Agile development environments.
- Solid experience in leveraging AI and LLM evaluation frameworks like RAGAS for quality assessment, combined with proficiency in developing and validating custom GPT models for domain-specific applications.
Soft Skills & Team Expectations
- Strong communication and documentation skills; ability to clearly articulate technical concepts to both technical and non-technical audiences.
- Demonstrated ability to work independently as well as collaboratively in a fast-paced environment.
- A builder's mindset with a strong desire to innovate, automate, and scale.
- Comfortable in an agile, iterative development environment.
- Willingness to mentor junior engineers and contribute to team knowledge growth.
Why Join PwC CTIO?
- Work at the cutting edge of AI engineering, deploying real solutions at production scale.
- Collaborate with visionary AI researchers, engineers, and product leaders to redefine what’s possible.
- Be part of a team that values both rapid experimentation and engineering excellence.
- Gain exposure to LLMOps and GenAI infrastructure at an enterprise scale.
- Join a culture that encourages continuous learning, bold thinking, and inclusive innovation.