





Niche GenAI testing skills but common QA title and metro location yield medium competition.
Requires ML/GenAI testing expertise and automation skills, making cross-industry fit moderately sensitive.
Specific 8-year requirement plus mandatory PyTest, Python, LangSmith and CI/CD creates high shortlisting strictness.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Design and execute validation and verification strategies for AI/ML and GenAI systems focusing on accuracy, safety, and robustness evaluation.
Build and maintain scalable automation testing frameworks using PyTest integrated with CI/CD pipelines, covering APIs, microservices, and AI pipelines.
Analyze test results, track defects, and provide quality assurance reporting for test processes across QA, UAT, and production environments.
6-8 years of experience in software testing and automation with hands-on Python programming expertise.
Bachelor's degree in Engineering (B.E./B.Tech) mandatory.
Experience with AI/ML and GenAI testing, including use of LangSmith for LLM observability and evaluation.
Knowledge of CI/CD, cloud platforms (Azure/AWS), SQL & NoSQL databases, and test automation frameworks with PyTest.
Experienced in end-to-end test strategy and execution for AI/GenAI, including testing model performance, safety, and bias during model lifecycle.
Familiar with multi-stakeholder delivery in an onshore-offshore setup and effective communication across technical and business teams.
Skilled in applying diverse automation strategies (Keyword-driven, Data-driven, BDD, Hybrid) and integrating testing into CI/CD pipelines.