Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Design and implement AI quality strategy including evaluation gates, golden datasets, and failure classifications to ensure readiness of AI releases.
Develop, automate, and integrate tests for AI models, APIs (REST and streaming), UI workflows, data and retrieval pipelines using Python, TypeScript, pytest, Playwright, and AI-assisted tools.
Collaborate with domain experts and cross-functional teams to validate test coverage, diagnose distributed failures, and produce release and post-deployment quality evidence.
Minimum Requirements
Strong hands-on experience with AI evaluation strategies, including LLM calibration, non-determinism handling, drift, and severity-based failure classification.
Proficiency in Python with pytest or equivalent for automation, plus strong experience in TypeScript and Playwright for UI and API automation.
Experience integrating evaluation and regression suites into CI/CD pipelines and managing test reporting and test case management tools.
Hyderabad-based candidates only with ability to work onsite; Work Experience Required: Not explicitly mentioned in the JD.
Ideal Candidate Profile
Experienced with complex AI and software quality assurance, including adversarial testing, security, privacy guardrails, and performance/cost diagnostics.
Skilled in leveraging AI-assisted development tools and creating reusable test frameworks and automation components.
Familiar with collaborative workflows involving Git/GitHub, cross-browser cloud testing, operational readiness checks, and thorough audit-ready reporting.
