Lead Quality Engineer - R01573517
Brillio (company site, opens in a new tab)4–6 yrsBengaluruOn-siteDirect career pageEst. 12–20 LPA
Posted 1h ago
Reach people at Brillio
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Brillio you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Build evaluation frameworks for AI agents, measuring Responsible AI and safety risks including bias, toxicity, alignment failures, and prompt-injection vulnerabilities.
- Create synthetic and adversarial testing scenarios; integrate automated evaluation into CI/CD for continuous quality assurance.
- Analyze and track defects and performance or alignment issues, provide risk-focused recommendations, and support regulatory and ethical review with policy and legal teams.
Minimum Requirements
- Work Experience Required: 4 to 6 years in quality engineering, including hands-on testing and evaluation of AI-powered product applications and microservices.
- Required AI testing and safety capabilities include agent safety evaluations, red teaming, adversarial testing, prompt-injection testing, and API testing for AI/ML systems.
- Required tools and technical skills include Python, PyTest, DeepEval, Ragas, Giskard, LangSmith, Google ADK, Vertex AI, Pandas, and SQL.
Ideal Candidate Profile
- Likely to succeed with hands-on experience testing AI agents and microservices, particularly by designing simulations and adversarial scenarios rather than relying only on conventional application testing.
- Best fit for work that connects test automation and CI/CD with safety-risk analysis, actionable defect reporting, and regulatory or ethical evaluation.
- A bachelor's degree in a listed computing field and ISTQB/CST or AI/ML testing or Responsible AI certification are desired qualifications, not stated as mandatory.