Senior QA AI Engineer
Moody's CorporationMatch Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Own and lead quality engineering initiatives for AI-integrated Java backend services and RESTful APIs, ensuring scalable, secure, and reliable software releases.
Develop and maintain automated test suites, test strategies for Anthropic Claude features, and continuous integration evaluation frameworks for non-deterministic AI outputs.
Conduct AI-specific security testing, database validation, performance/load testing, and monitor AI observability metrics within cloud-native SaaS platforms on AWS and Azure.
Minimum Requirements
5-7 years of software quality engineering experience focused on Java backend services and RESTful APIs.
Proficiency with test automation frameworks: Selenium, TestNG, JUnit, RestAssured, or Cucumber.
Strong skills in relational databases: PostgreSQL and Microsoft SQL Server for data validation.
Bachelor's or Master's degree in Computer Science, Mathematics, Physics, or related field.
Ideal Candidate Profile
Experienced in AI testing including large language model output validation, semantic evaluation, hallucination detection, and AI security testing (prompt injection, jailbreak validation).
Capable of designing comprehensive test strategies for microservices architectures and AI-driven software products in cloud environments (AWS/Azure).
Proven leadership in managing AI risks and governance, fostering responsible AI adoption, and integrating AI quality metrics into CI/CD pipelines.