Manager | Automation Testing | Mumbai | Engineering | Quality Engineering
DeloitteMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Own and define end-to-end quality strategy, automation roadmap, and quality gates for AI-powered application testing.
Design, develop, and maintain scalable automation frameworks using Playwright with Python, BDD (Behave), and support UI, API, integration, regression, and end-to-end automation.
Validate AI/LLM applications for accuracy, safety, bias, hallucination, and performance; integrate automated tests into CI/CD pipelines and monitor quality dashboards.
Minimum Requirements
9+ years of experience in Quality Engineering and Test Automation.
Strong hands-on expertise in Playwright with Python and experience with BDD frameworks like Behave.
Experience testing AI, Generative AI, or LLM-powered applications, including AI evaluation techniques such as prompt testing and hallucination validation.
Bachelor’s degree in Computer Science, Information Technology, or related field.
Ideal Candidate Profile
Experienced in leading quality assurance for AI and LLM-based software products with end-to-end automation ownership.
Capable of building and scaling test automation frameworks using Python-based tools and integrating with modern CI/CD pipelines and agile practices.
A strategic quality engineering leader who can collaborate cross-functionally with Product, Engineering, Data Science, Security, and DevOps teams.