Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Own release readiness and quality assurance for AI agents producing client-facing content like RFPs, data grids, and pitch decks.
Define and implement quality standards and automated release gates based on groundedness, citation accuracy, hallucination, and agent behavior.
Build golden datasets with business SMEs and run comprehensive testing including citation verification, permission checks, multi-agent behavior, document output accuracy, adversarial testing, and automate regression testing in CI/CD pipelines.
Minimum Requirements
5–8 years of experience in QA or test engineering, including 2+ years testing LLM, RAG or agent systems.
Experience building automated LLM evaluation suites that gate real product releases.
Ability to collaborate directly with business reviewers to translate output issues into repeatable tests.
Work Experience Required: 5–8 years in QA/testing with 2+ years in LLM or agent system testing.
Ideal Candidate Profile
Experienced in integrating automated AI evaluation methods within CI/CD environments for release gating.
Able to interpret complex AI outputs and work closely with business SMEs to develop practical, repeatable quality tests.
Has sufficient technical depth in AI agent behavior testing rather than traditional manual QA or deep ML modelling expertise.