Back
Metro-based, senior niche QA-platform role with AI focus yields medium competition.
Highly domain-specific AI evaluation and release engineering skills limit cross-industry transferability.
Requires platform-level QA, release engineering, SRE and AI evaluation experience, raising shortlisting strictness.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Design and build the test platform including execution, isolation, test-data lifecycle, reporting, and flake handling to determine build readiness for release.
Develop an agent evaluation harness to detect behavioural regressions across prompt, model, tool, or configuration changes.
Own release gating processes including enforceable gates in code, post-deploy verification, canary criteria, and managing narrow hotfix paths.
Strong software engineering experience with ability to design and implement complex systems from ambiguous problems.
Experience owning quality, reliability, release, or evaluation platforms beyond writing test suites.
Experience with conversational AI, voice, LLM evaluation, or evaluating non-deterministic systems without ground truth.
Experience in release engineering, progressive delivery, or SRE with ownership of gates, canaries, and production signals.
Hands-on builder of CI/CD quality infrastructure at a meaningful scale.
Has a product-oriented mindset tying quality work directly to customer-visible risk and delivery outcomes.
Capable of influencing and working with small teams and engineers who do not report directly.