Back
Mid-level QA role in metro Hyderabad with popular title and 3–5 years attracts high competition.
Specialized AI/LLM evaluation and harness experience reduces cross-industry transferability.
Many mandatory AI-evaluation, automation, developer-level coding and CI/CD requirements make screening strict.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Own the integration of quality in the build phase by contributing to test strategy, automation, and quality gates with developers.
Engineer and review production-quality code related to AI and LLM feature evaluations, including designing and running system evaluations using AI harnesses or custom frameworks.
Design and implement automated tests across all layers (unit to end-to-end), contribute to CI/CD quality gates, and track quality metrics like risk-weighted coverage and escaped defects.
3 to 5 years of experience in software building and testing with strong engineering and AI fluency, including evaluation experience.
Hands-on experience with AI or LLM feature evaluation and familiarity with AI harness tools (e.g., Deepeval, promptfoo, Braintrust, LangSmith).
Proficient coding skills in modern languages such as TypeScript or JavaScript; Python is advantageous for evaluation tasks.
Practical experience with modern test frameworks (Cypress, Playwright, Selenium), CI/CD processes, and quality gates integration.
Demonstrates ability to combine strategic thinking with tactical execution on AI-centric quality engineering projects.
Experienced in working with AI-driven testing tools and agentic coding assistants (e.g., Claude Code, Copilot) in daily development workflows.
Comfortable operating in complex AI software environments, capable of designing automated test frameworks covering API, microservices, and UI automation aspects.