Senior AI Quality Engineer (Hyderabad-based)

Design and implement AI quality strategy including evaluation gates, golden datasets, and failure classifications to ensure readiness of AI releases.

Develop, automate, and integrate tests for AI models, APIs (REST and streaming), UI workflows, data and retrieval pipelines using Python, TypeScript, pytest, Playwright, and AI-assisted tools.

Collaborate with domain experts and cross-functional teams to validate test coverage, diagnose distributed failures, and produce release and post-deployment quality evidence.

Strong hands-on experience with AI evaluation strategies, including LLM calibration, non-determinism handling, drift, and severity-based failure classification.

Proficiency in Python with pytest or equivalent for automation, plus strong experience in TypeScript and Playwright for UI and API automation.

Experience integrating evaluation and regression suites into CI/CD pipelines and managing test reporting and test case management tools.

Hyderabad-based candidates only with ability to work onsite; Work Experience Required: Not explicitly mentioned in the JD.

Experienced with complex AI and software quality assurance, including adversarial testing, security, privacy guardrails, and performance/cost diagnostics.

Skilled in leveraging AI-assisted development tools and creating reusable test frameworks and automation components.

Familiar with collaborative workflows involving Git/GitHub, cross-browser cloud testing, operational readiness checks, and thorough audit-ready reporting.