Principal QA Engineer – AI/MLCareerXperts Consulting • Pune, Maharashtra, India
Principal QA Engineer – AI / ML
CareerXperts Consulting • Pune, Maharashtra, India
4 days ago
Job descriptionTest model accuracy, robustness, fairness, drift, and performance. Ensure reliable and ethical AI outputs using manual and automated evaluation techniques. Develop scalable API and end-to-end automation using Python / Java or similar. Ensure fast, reliable validation of AI microservices. Partner with Developers, ML Engineers, and Product Owners to embed quality from the design stage (Shift-Left). Drive quality mindset across the ML lifecycle. Oversee data integrity, statistical distribution, and input quality for training / inference pipelines. Conduct deep debugging, RCA, and continuous improvement. Guide and mentor QA engineers, uplift technical capabilities, and set best practices. Evaluate and integrate emerging ML testing tools and frameworks. 5–7 years of experience in Software Testing / QA. Minimum 2+ years of hands-on experience testing Agentic AI / AI-ML systems . Strong understanding of ML model lifecycle, MLOps , and AI testing techniques. Expertise in API testing (Postman, RestAssured, etc.). Strong proficiency in Python (preferred) or Java for automation. Solid understanding of SDLC, MDLC, QA methodologies , and Agile. Experience mentoring or leading QA / Automation teams. Excellent communication and analytical skills.
Job Opening : Principal Quality Assurance Engineer – AI / ML
We are looking for a visionary Principal QA Engineer to lead the end-to-end Quality Assurance strategy for advanced AI-driven applications. This role is ideal for someone who has deep experience in Agentic AI testing , strong technical leadership, and the ability to build scalable QA frameworks for AI / ML systems.
Key Responsibilities
Lead AI / ML QA Strategy
- Define and evolve the overall QA roadmap for AI / ML models and services.
- Establish standards for model testing, data validation, and MLOps pipeline quality.
Validate AI Models & Agentic AI Workflows
Build & Scale Automation Frameworks
Cross-functional Quality Ownership
Data Quality & Analysis
Leadership & Mentorship
Required Skills & Experience
Location : Pune (Hybrid)
Experience : 5–7 years
Mandatory : Proven experience in Agentic AI testing
Interested candidates can apply by sending their resume to : namitha@careerxperts.com
Create a job alert for this search
Qa Engineer • Pune, Maharashtra, India
Related jobs
AI / ML Engineer
MangoApps • Pune, Maharashtra, India
A modern work platform means a single source of truth for your desk and deskless employees alike, where everything they need is organized and easy to find.
MangoApps was designed to unify your emplo...Show more
Last updated: 30+ days ago • Promoted
AI / ML Engineer
Lingaro • pune, maharashtra, in
AI / ML Engineer – Senior Consultant.AI Engineering Group is part of Data Science & AI Competency Center and is focusing technical and engineering aspects of DS / ML / AI solutions.We are looking for exp...Show more
Last updated: 30+ days ago • Promoted
Lead AI / ML Engineer
Optum • pune, maharashtra, in
Lead AI / ML Engineer – Clinical AI systems.Optum is a global organization that delivers care, aided by technology, to help millions of people live healthier lives.
The work you do with our team will ...Show more
Last updated: 18 days ago • Promoted
AI / ML Engineer
RingCentral • pune, maharashtra, in
We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI.In this role, you will...Show more
Last updated: 21 days ago • Promoted
Machine Learning Engineer-Agentic AI
Innodata Inc. • pune, maharashtra, in
Design and implement multi-agent systems using LangChain, LangGraph, CrewAI, AutoGen or similar frameworks.Build A2A (agent-to-agent) orchestration and implement MCP (multi-context protocol) for co...Show more
Last updated: 21 days ago • Promoted
AI / ML Engineer
Innodata Inc. • Pune, IN
Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show more
Last updated: 21 days ago • Promoted
Lead AI Engineer
Blend • Pune, IN
We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
Last updated: 18 days ago • Promoted
AI / ML Engineer
Synechron • Pune, Maharashtra, India
AI systems that leverage LLMs, multi-agent frameworks, and enterprise data platforms.The ideal candidate will combine deep technical expertise in AI architecture with practical experience in buildi...Show more
Last updated: 4 days ago • Promoted
Principal Architect-AIML
Intellect Design Arena Ltd • Pune, Maharashtra, India
Role : AI / ML & Generative AI Architect / Engineering Leader.Mandatory-Should have a stable track record.Suitable candidate shall be notified the same day.
Technology Leader in AI / ML and Generative AI...Show more
Last updated: 15 days ago • Promoted
Lead Engineer - AI / ML
Mindfire Solutions • Pune, IN
As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models.
Your role involves guiding a team of engineers ensuring the successful...Show more
Last updated: 30+ days ago • Promoted
AI / ML Engineer
TransPerfect • pune, maharashtra, in
We are seeking a Senior AI / ML Engineer to join our client’s AI team and contribute to the development of cutting-edge intelligent systems.
In this role, you’ll be responsible for designing, training...Show more
Last updated: 30+ days ago • Promoted
AI Developer - ML & AI Agents (3 to 9 Years)
AIMLEAP • Pune, IN
AI Developer - ML & AI Agents (3 to 9 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development.
Strong Python programming background f...Show more
Last updated: 8 days ago • Promoted
AIML Architect
ValueLabs • pune, maharashtra, in
We at ValueLabs have an Opening for AI / ML Architect role.At least 7+ years of relevant AI / ML experience or previous ML experience with strong engineering competencies and at least 2+ years in Gener...Show more
Last updated: 5 days ago • Promoted
Principal Software Engineer AI / ML
Cotiviti • Pune, IN
We are seeking a software architect designing comprehensive MLOps platform, establishing technical standards, and leading infrastructure integration for ML deployment.
Principal Responsibilities and...Show more
Last updated: 20 days ago • Promoted
Principal RTL Design Engineer / Co-founder - AI / ML Accelerator
Faststream Technologies • Pune, IN
Lead / Own a world class NPU for Edge AI Inference.Develop ultra-low-power machine learning chips for intelligent sensing and autonomous navigation.
Architect / Work independently and collaborativel...Show more
Last updated: 3 days ago • Promoted
AI / ML Engineer
C4 Technical Services • Pune, IN
AI Solution Development & Deployment : Design and implement AI models and algorithms using Azure AI services, including Azure Machine Learning, Cognitive Services, and Azure OpenAI.Develop and deploy...Show more
Last updated: 1 day ago • Promoted
AI / ML Architect / Engineering Leader
Intellect Design Arena Ltd • Pune, Maharashtra, India
About the Role : We're looking for a Technology Leader in AI / ML and Generative AI with strong experience in architecting, designing, and delivering enterprise-grade AI platforms.The ideal candidate...Show more
Last updated: 22 days ago • Promoted
Lead AI Engineer
Genisys Group • pune, maharashtra, in
As an AI / ML Engineer at Genisys Group, you will be instrumental in developing and.AI solutions, with a strong focus on Large Language Models.
LLMs) and Retrieval-Augmented Generation (RAG) technique...Show more
Last updated: 22 days ago • Promoted