Back
Tier-1 brand and Bangalore metro increase applicant density despite niche LLM QA specialization.
Strong automation skills transferable, but specialized GenAI/LLM evaluation and RAG orientation increase domain specificity.
Mandatory 8+ years plus specific tools (Pytest, Playwright, JMeter, GitHub Actions, Python, LLM expertise) restricts candidates.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Develop and own AI quality evaluation frameworks focusing on Faithfulness, Relevancy, and Hallucination detection for GenAI solutions.
Architect and lead dual-layered test automation including E2E UI/API deterministic tests and probabilistic evaluation of LLM outputs.
Integrate automated quality checks into CI/CD via GitHub Workflows and lead performance testing using JMeter.
8+ years of experience in Software QA.
Bachelor's or Master's degree in Computer Science, Software Engineering, or related field.
Expert-level Python skills and hands-on experience with Pytest (API testing), Playwright (E2E UI testing), and JMeter (performance testing).
Advanced experience designing and maintaining GitHub Actions/Workflows for automated test execution.
Strong expertise in AI quality metrics and automated evaluation metrics for LLMs including Faithfulness, Relevancy, and Groundedness.
Experience with or willingness to implement 'LLM-as-a-Judge' evaluation strategies and familiarity with LLM concepts such as prompting and context windows.
Orientation towards data-driven probabilistic quality monitoring beyond pass/fail, and interest in Retrieval-Augmented Generation (RAG) validation systems.