Back
Niche Agentic AI QA role with moderate employer brand and seniority, yielding moderate applicant competition.
Specialized Agentic AI testing and LLM skills limit cross-industry transferability.
Explicit 7–12 years, 3+ years GenAI, plus mandatory QA/AI tooling and leadership requirements.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Define and execute testing strategies and automation for Agentic AI systems including LLMs, multi-agent orchestration, and RAG frameworks.
Lead a team of quality engineers, establishing testing standards, mentoring, and driving adoption of AI testing tools and best practices.
Deliver quality assessments, KPI reporting, and stakeholder communication to govern AI quality across the organization.
7–12 years of experience in Software Testing, Quality Engineering, or Test Automation.
Minimum 3+ years hands-on experience in GenAI, LLM Testing, or Agentic AI Quality Engineering.
Proficient in Python automation, test framework development, and CI/CD integration for AI systems.
Experience with AI evaluation frameworks (DeepEval, OpenAI Evals, etc.) and cloud platforms (Azure, AWS, GCP).
Experienced leader capable of building and managing a specialized AI quality engineering team focused on autonomous AI systems.
Technical expert in defining and implementing AI quality metrics, evaluation strategies, and benchmarking for large-scale multi-agent AI.
Skilled in collaborating cross-functionally with product, engineering, research teams and communicating complex AI quality KPIs to leadership.