Staff Technical Product Manager – AI/LLM expertise + AI Evaluation Science
ServiceNowMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Lead and scale AI Evaluation as a core engineering capability across the organization, making trusted evaluations the evidence layer for AI quality.
Drive platform evaluation strategy and adoption by partnering with AI platform and product teams to implement and validate out-of-the-box evaluations and influence roadmap.
Develop custom evaluation metrics, rubrics, datasets, and strategies for enterprise-specific AI applications, embedding evaluation throughout the AI lifecycle for continuous quality measurement.
Minimum Requirements
10+ years in Product Management with a focus on AI.
Expertise in AI/LLM, Evaluation Science, Quality Engineering, Product Management, and Platform Strategy.
Experience with evaluation techniques such as LLM-as-a-Judge, rubrics, evaluation datasets, agent evaluation, AI observability, CI/CD, and developer platforms.
Servicenow AI Platform experience is a significant plus.
Ideal Candidate Profile
Technically strong Product Manager able to influence AI specialists, engineers, and platform teams without direct authority.
Experienced in AI integration into workflows, decision-making, or problem-solving, emphasizing evaluation-driven development.
Strategic thinker focused on establishing AI Eval-driven development as a standard practice ensuring continuous AI quality monitoring and improvement.