Back
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Metro senior role at a known consultancy with specialized LLM skills yields moderate competition.
Niche LLM, vector DB, LangChain QA expertise creates high domain-specific fit requirements.
Explicit 9+ years plus many mandatory LLM, automation, and tooling requirements makes shortlisting strict.
Design, develop, and maintain automation test frameworks primarily in Python and/or Java for AI-driven applications including LLMs and RAG architectures.
Validate and test AI workflows and components such as LLM prompt accuracy, RAG pipelines, vector databases, and OpenAI APIs within CI/CD environments.
Collaborate with cross-functional teams to define quality metrics and implement AI-assisted testing strategies ensuring security, performance, and scalability standards.
9+ years of professional experience; Work Experience Required: 9+ years.
Strong programming skills in Python and experience with automation testing tools such as Selenium, Playwright, REST Assured, PyTest, etc.
Practical experience with LLMs (OpenAI GPT or similar), RAG architectures, Vector Databases, LangChain, and API testing including OpenAI APIs.
Education: Any graduation or related field with minimum 3 years of relevant experience. Location: Bangalore/Chennai/Pune/Hyderabad; Shift timing 1PM to 10PM EST.
Experienced in integrating AI and automation testing frameworks in Agile and CI/CD environments to ensure continuous quality delivery for AI applications.
Demonstrates deep understanding of AI model validation specifics including hallucination detection, semantic search, and prompt engineering testing.
Able to collaborate effectively with Data Scientists, Developers, and Product teams to establish and measure AI system quality metrics.