Principal QA Engineer – AI/MLCareerXperts Consulting • Pune, Maharashtra, India
Principal QA Engineer – AI / ML
CareerXperts Consulting • Pune, Maharashtra, India
2 days ago
Job descriptionTest model accuracy, robustness, fairness, drift, and performance. Ensure reliable and ethical AI outputs using manual and automated evaluation techniques. Develop scalable API and end-to-end automation using Python / Java or similar. Ensure fast, reliable validation of AI microservices. Partner with Developers, ML Engineers, and Product Owners to embed quality from the design stage (Shift-Left). Drive quality mindset across the ML lifecycle. Oversee data integrity, statistical distribution, and input quality for training / inference pipelines. Conduct deep debugging, RCA, and continuous improvement. Guide and mentor QA engineers, uplift technical capabilities, and set best practices. Evaluate and integrate emerging ML testing tools and frameworks. 5–7 years of experience in Software Testing / QA. Minimum 2+ years of hands-on experience testing Agentic AI / AI-ML systems. Strong understanding of ML model lifecycle, MLOps, and AI testing techniques. Expertise in API testing (Postman, RestAssured, etc.). Strong proficiency in Python (preferred) or Java for automation. Solid understanding of SDLC, MDLC, QA methodologies, and Agile. Experience mentoring or leading QA / Automation teams. Excellent communication and analytical skills.
Job Opening : Principal Quality Assurance Engineer – AI / ML
We are looking for a visionary Principal QA Engineer to lead the end-to-end Quality Assurance strategy for advanced AI-driven applications. This role is ideal for someone who has deep experience in Agentic AI testing, strong technical leadership, and the ability to build scalable QA frameworks for AI / ML systems.
Key Responsibilities
Lead AI / ML QA Strategy
- Define and evolve the overall QA roadmap for AI / ML models and services.
- Establish standards for model testing, data validation, and MLOps pipeline quality.
Validate AI Models & Agentic AI Workflows
Build & Scale Automation Frameworks
Cross-functional Quality Ownership
Data Quality & Analysis
Leadership & Mentorship
Required Skills & Experience
Location : Pune (Hybrid)
Experience : 5–7 years
Mandatory : Proven experience in Agentic AI testing
Interested candidates can apply by sending their resume to : namitha@careerxperts.com
Create a job alert for this search
Qa Engineer • Pune, Maharashtra, India
Related jobs
AI / ML Engineer
MangoApps • Pune, Maharashtra, India
A modern work platform means a single source of truth for your desk and deskless employees alike, where everything they need is organized and easy to find.
MangoApps was designed to unify your emplo...Show more
Last updated: 30+ days ago • Promoted
AI / ML Engineer
Lingaro • Pune, IN
AI / ML Engineer – Senior Consultant.AI Engineering Group is part of Data Science & AI Competency Center and is focusing technical and engineering aspects of DS / ML / AI solutions.We are looking for exp...Show more
Last updated: 30+ days ago • Promoted
Senior AI / ML Engineer
Luxoft • Pune, IN
Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process.
We are seeking a highly skilled and innovative Python / AI Engine...Show more
Last updated: 16 days ago • Promoted
AI / ML Engineer
Edstem Technologies • Pune, IN
The ideal candidate will have hands-on expertise across the full ML lifecycle—from data exploration and feature engineering to model training, optimization, and production deployment.You will work ...Show more
Last updated: 19 days ago • Promoted
AI / ML Engineer
Innodata Inc. • Pune, IN
Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show more
Last updated: 18 days ago • Promoted
AI / ML Engineer
Synechron • Pune, Maharashtra, India
AI systems that leverage LLMs, multi-agent frameworks, and enterprise data platforms.The ideal candidate will combine deep technical expertise in AI architecture with practical experience in buildi...Show more
Last updated: 2 days ago • Promoted
Lead AI Engineer
Blend • Pune, IN
We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
Last updated: 15 days ago • Promoted
Principal Architect-AIML
Intellect Design Arena Ltd • Pune, Maharashtra, India
Role : AI / ML & Generative AI Architect / Engineering Leader.Mandatory-Should have a stable track record.Suitable candidate shall be notified the same day.
Technology Leader in AI / ML and Generative AI...Show more
Last updated: 12 days ago • Promoted
Lead Engineer - AI / ML
Mindfire Solutions • Pune, IN
As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models.
Your role involves guiding a team of engineers ensuring the successful...Show more
Last updated: 30+ days ago • Promoted
AI / ML 2–5 Years Experience
AAVIL Inc • Pune, IN
AAVIL INC is Hiring Talented AI / ML Engineers!.Remote | 0–5 Years Experience | AI ML Agentic AI Expertise.We’re expanding our team and looking for passionate AI / ML Engineers who are ready to build t...Show more
Last updated: 15 hours ago • Promoted • New!
AI / ML Engineer
TransPerfect • pune, maharashtra, in
We are seeking a Senior AI / ML Engineer to join our client’s AI team and contribute to the development of cutting-edge intelligent systems.
In this role, you’ll be responsible for designing, training...Show more
Last updated: 30+ days ago • Promoted
Machine Learning Engineer-Agentic AI
Innodata Inc. • Pune, IN
Design and implement multi-agent systems using LangChain, LangGraph, CrewAI, AutoGen or similar frameworks.Build A2A (agent-to-agent) orchestration and implement MCP (multi-context protocol) for co...Show more
Last updated: 19 days ago • Promoted
AI Developer - ML & AI Agents (3 to 9 Years)
AIMLEAP • Pune, IN
AI Developer - ML & AI Agents (3 to 9 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development.
Strong Python programming background f...Show more
Last updated: 5 days ago • Promoted
Principal Software Engineer AI / ML
Cotiviti • Pune, IN
We are seeking a software architect designing comprehensive MLOps platform, establishing technical standards, and leading infrastructure integration for ML deployment.
Principal Responsibilities and...Show more
Last updated: 17 days ago • Promoted
Principal RTL Design Engineer / Co-founder - AI / ML Accelerator
Faststream Technologies • Pune, IN
Lead / Own a world class NPU for Edge AI Inference.Develop ultra-low-power machine learning chips for intelligent sensing and autonomous navigation.
Architect / Work independently and collaborativel...Show more
Last updated: 15 hours ago • Promoted • New!
AI / ML Architect / Engineering Leader
Intellect Design Arena Ltd • Pune, Maharashtra, India
About the Role : We’re looking for a Technology Leader in AI / ML and Generative AI with strong experience in architecting, designing, and delivering enterprise-grade AI platforms.The ideal candid...Show more
Last updated: 19 days ago • Promoted
AI ML Engineer
Futran Solutions • Pune, Maharashtra, India
We're seeking an AI / ML Engineer to design, build, and deploy intelligent systems that leverage large language models, machine learning, and agentic AI architectures.
You'll work at the intersection ...Show more
Last updated: 5 days ago • Promoted
AI / ML Engineer – Founding Team (HealthTech | $430B Industry)
Souli.help • Pune, IN
AI-driven mental & emotional wellness agent.RAG architecture grounded in our proprietary Framework.LLM orchestration, multimodal understanding, contextual memory, and Human-in-the-Loop verification...Show more
Last updated: 15 hours ago • Promoted • New!