Senior AI Evals Engineer
Rubrik, Inc. (company site, opens in a new tab)8+ yrsBengaluruOn-siteDirect career pageEst. 28–45 LPA
Posted 17h ago
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Reach people at Rubrik, Inc.
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Rubrik, Inc. you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Define, develop, and execute evaluation frameworks and test strategies for AI agents built with Google ADK or similar frameworks.
- Design scalable evaluation pipelines, build synthetic test environments, and automate regression and drift detection within CI/CD-integrated eval pipelines.
- Lead technical efforts in Responsible AI safety evals, including adversarial testing, red-teaming, bias detection, toxicity measurement, and production observability for AI agent quality.
Minimum Requirements
- Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent experience.
- 8+ years in software test engineering, including 5+ years in test engineering or QA automation and building AI/ML evaluation systems.
- 2+ years hands-on working with ML/AI systems, including LLM-based applications and agentic workflows, plus 2+ years in senior/lead roles owning evaluation strategy for complex AI agent systems.
- Technical skills: expert in LLM evaluation tools (DeepEvals, LLM as a Judge), Python proficiency, experience with automated CI/CD evaluation pipelines, familiarity with Google Cloud Platform or similar AI/ML cloud services.
Ideal Candidate Profile
- Experienced technical leader with a strong focus on AI agent evaluation, quality frameworks, and safety in production enterprise environments.
- Deep domain expertise in agentic AI, including tool use, multi-step reasoning, retrieval-augmented generation (RAG), and evaluation of conversational or goal-oriented AI agents.
- Proven ability to build scalable, automated evaluation infrastructures tightly integrated with AI development lifecycles and deploy cross-functional coordination across engineering, policy, and product teams.