Principal AI Engineer - Agentic Systems and Evaluation Platform
Amgen (company site, opens in a new tab)10+ yrsHyderabadOn-siteDirect career pageEst. 45–85 LPA
Posted 6h ago
Reach people at Amgen
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Amgen you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Own the architecture, roadmap, delivery, adoption, and production operations of a shared enterprise platform for evaluating AI agents across teams and frameworks.
- Build APIs, SDKs, integrations, and execution services for configuring and running evaluations; manage versioned datasets, configurations, traces, and results to support reproducible comparisons.
- Lead a small engineering team of approximately 2–3 engineers; partner across platform, application, infrastructure, security, and governance teams, with success measured by adoption, reliability, reproducibility, and evaluation turnaround time.
Minimum Requirements
- Work Experience Required: 10+ years in software engineering, AI engineering, ML systems, or platform engineering.
- Bachelor’s or master’s degree in computer science, AI, or a related field.
- Strong Python and production software engineering experience, including APIs, reusable libraries, distributed backend services, and shared platform services.
- Hands-on experience integrating AI evaluation frameworks or automated AI quality workflows into production; understanding of LLM/agent architectures and experience with asynchronous processing, cloud services, CI/CD, observability, versioning, and secure enterprise access.
Ideal Candidate Profile
- Has built or operated shared platform services used by multiple engineering teams and can own a component from architecture through production support and adoption.
- Can turn recurring application-team needs into reusable evaluation interfaces while supporting varied models, agent frameworks, workloads, and domain-specific criteria.
- Brings practical experience with agent traces and evaluation methods, and can balance reproducibility, service reliability, developer workflows, security, and operating cost.