





Remote mid-level QA role with popular title but niche AI/voice specialization reduces applicant pool.
Specialized AI and voice QA skillset limits transferability across industries and general QA roles.
Explicit 5+ years plus mandatory AI/voice QA, LLM evaluation, and CI/CD expertise enforces strict filters.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Own and scale automated testing of AI pipelines including voice and chat agents to ensure release quality.
Build, maintain, and extend test automation frameworks covering UI/E2E, API, AI output layers, and CI/CD pipelines to catch regressions early.
Make go/no-go release decisions based on regression testing and maintain quality assurance standards across BFSI-regulated AI products.
5+ years experience as a QA Automation Engineer with proven AI systems testing expertise.
Hands-on experience testing conversational AI (voice and/or chat agents) on real shipped projects.
Strong knowledge of LLMs, prompt engineering, RAG pipelines, and evaluation/testing of nondeterministic AI outputs.
Proficiency in building test automation frameworks, CI/CD pipeline automation, and familiarity with UI/E2E (e.g., Playwright) and API test automation.
Experienced in fast-paced, fast-shipping environments with the ability to quickly ramp on unfamiliar AI systems and pragmatic about processes.
Technical depth in AI/ML evaluation tooling and voice pipeline testing (STT and TTS) integrated into automation.
Builder mindset: comfortable owning and evolving testing frameworks and CI/CD pipelines from scratch, focusing on scalable, evidence-based release quality decisions.