Principal Qa Engineer – Ai/MlCareerXperts Consulting • Pune, Republic Of India, IN
Principal Qa Engineer – Ai / Ml
CareerXperts Consulting • Pune, Republic Of India, IN
6 days ago
Job descriptionTest model accuracy, robustness, fairness, drift, and performance. Ensure reliable and ethical AI outputs using manual and automated evaluation techniques. Develop scalable API and end-to-end automation using Python / Java or similar. Ensure fast, reliable validation of AI microservices. Partner with Developers, ML Engineers, and Product Owners to embed quality from the design stage (Shift-Left). Drive quality mindset across the ML lifecycle. Oversee data integrity, statistical distribution, and input quality for training / inference pipelines. Conduct deep debugging, RCA, and continuous improvement. Guide and mentor QA engineers, uplift technical capabilities, and set best practices. Evaluate and integrate emerging ML testing tools and frameworks. 5–7 years of experience in Software Testing / QA. Minimum 2+ years of hands-on experience testing Agentic AI / AI-ML systems . Strong understanding of ML model lifecycle, MLOps , and AI testing techniques. Expertise in API testing (Postman, RestAssured, etc.). Strong proficiency in Python (preferred) or Java for automation. Solid understanding of SDLC, MDLC, QA methodologies , and Agile. Experience mentoring or leading QA / Automation teams. Excellent communication and analytical skills.
Job Opening : Principal Quality Assurance Engineer – AI / ML
We are looking for a visionary Principal QA Engineer to lead the end-to-end Quality Assurance strategy for advanced AI-driven applications. This role is ideal for someone who has deep experience in Agentic AI testing , strong technical leadership, and the ability to build scalable QA frameworks for AI / ML systems.
Key Responsibilities
Lead AI / ML QA Strategy
- Define and evolve the overall QA roadmap for AI / ML models and services.
- Establish standards for model testing, data validation, and MLOps pipeline quality.
Validate AI Models & Agentic AI Workflows
Build & Scale Automation Frameworks
Cross-functional Quality Ownership
Data Quality & Analysis
Leadership & Mentorship
Required Skills & Experience
Location : Pune (Hybrid)
Experience : 5–7 years
Mandatory : Proven experience in Agentic AI testing
Interested candidates can apply by sending their resume to : namitha@careerxperts.com
Create a job alert for this search
Qa Engineer • Pune, Republic Of India, IN
Related jobs
Lead Engineer - Ai / Ml
Mindfire Solutions • Republic Of India, IN
As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models.
Your role involves guiding a team of engineers ensuring the successful...Show more
Last updated: 30+ days ago • Promoted
Principal Software Engineer Ai / Ml
Cotiviti • Republic Of India, IN
We are seeking a software architect designing comprehensive MLOps platform, establishing technical standards, and leading infrastructure integration for ML deployment.
Principal Responsibilities and...Show more
Last updated: 21 days ago • Promoted
Lead AI / ML QA Engineer
CareerXperts Consulting • Pune, Republic Of India, IN
Job Opening : Principal Quality Assurance Engineer – AI / ML.We are looking for a visionary.Quality Assurance strategy for advanced AI-driven applications.
This role is ideal for someone who has deep e...Show more
Last updated: 6 days ago • Promoted
Principal RTL Design Engineer / Co-founder - AI / ML Accelerator
Faststream Technologies • India, India
Lead / Own a world class NPU for Edge AI Inference.Develop ultra-low-power machine learning chips for intelligent sensing and autonomous navigation.
Architect / Work independently and collaborativel...Show more
Last updated: 4 days ago • Promoted
Principal Software Engineer AI / ML
Cotiviti • India, India
We are seeking a software architect designing comprehensive MLOps platform, establishing technical standards, and leading infrastructure integration for ML deployment.
Principal Responsibilities and...Show more
Last updated: 20 days ago • Promoted
Lead AI / ML Engineer
Simelabs - Digital, AI / ML, Automation, Robotics, Gen AI. • India, India
Architect scalable ML pipelines, services, and platforms using modern cloud and MLOps practices.Build, fine-tune, and integrate Generative AI models (LLMs, Vision Models, Multimodal Models) into bu...Show more
Last updated: 6 hours ago • Promoted • New!
Principal Engineer, AI Quality
CareerXperts Consulting • Pune, Republic Of India, IN
Job Opening : Principal Quality Assurance Engineer – AI / ML.We are looking for a visionary.Quality Assurance strategy for advanced AI-driven applications.
This role is ideal for someone who has deep e...Show more
Last updated: 6 days ago • Promoted
Principal AI Engineer
Blend • Chennai, Republic Of India, IN
We are looking for a Manager / Lead AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edg...Show more
Last updated: 16 days ago • Promoted
Principal AI Engineer
Quantiphi • Republic Of India, IN
Role : Senior Machine Learning Engineer.Work location : Bangalore / Mumbai.Experience in AI / ML, with a track record of working in large-scale programs and solving complex use cases using GCP AI Platfor...Show more
Last updated: 10 days ago • Promoted
Lead Ai / Ml Engineer
Simelabs - Digital, AI / ML, Automation, Robotics, Gen AI. • Republic Of India, IN
Architect scalable ML pipelines, services, and platforms using modern cloud and MLOps practices.Build, fine-tune, and integrate Generative AI models (LLMs, Vision Models, Multimodal Models) into bu...Show more
Last updated: 12 hours ago • Promoted • New!
Principal Automation Engineer
XPO • Pune, Republic Of India, IN
What you’ll do on a typical day : .Lead the development and implementation of automation testing frameworks using WebDriverIO, Appium, and TypeScript.
Automating UI and API interactions using tools su...Show more
Last updated: 13 days ago • Promoted
Principal Qa Engineer - Ai / Ml
CareerXperts Consulting • Pune, Republic Of India, IN
Job Opening : Principal Quality Assurance Engineer – AI / ML.We are looking for a visionary.Quality Assurance strategy for advanced AI-driven applications.
This role is ideal for someone who has deep e...Show more
Last updated: 5 days ago • Promoted
Principal AI Architect
TekGenio • Republic Of India, IN
Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development.
Strong experience in machine learning, deep lea...Show more
Last updated: 2 days ago • Promoted
Principal AI Architect
IDfy • Republic Of India, IN
IDfy is Asia's leading TrustStack, making compliance easy, fraud detection smarter, and onboarding seamless.Trusted by global leaders like.
HDFC Bank, Zomato, Amazon, PhonePe, Paytm, and HUL.DPDPA c...Show more
Last updated: 5 days ago • Promoted
Principal AI / ML Engineer
Vitraya • New Delhi, Republic Of India, IN
Every day, thousands of patients across India face delays, stress, and reduced quality of care due to cumbersome administrative processes and insurance claim challenges.
At Vitraya, we directly conf...Show more
Last updated: 30+ days ago • Promoted
Ai / Ml Engineer
MangoApps • Pune, Republic Of India, IN
A modern work platform means a single source of truth for your desk and deskless employees alike, where everything they need is organized and easy to find.
MangoApps was designed to unify your emplo...Show more
Last updated: 30+ days ago • Promoted
Lead Ml / Ai Engineer
Digital Green • Republic Of India, IN
Job Title : Lead, ML / AI Engineer.Digital Green is a pioneer global not for profit organization, utilizing digital platforms and community-driven approaches to amplify the voices of smallholder farm...Show more
Last updated: 1 day ago • Promoted
Principal Rtl Design Engineer / Co-Founder - Ai / Ml Accelerator
Faststream Technologies • Republic Of India, IN
Lead / Own a world class NPU for Edge AI Inference.Develop ultra-low-power machine learning chips for intelligent sensing and autonomous navigation.
Architect / Work independently and collaborativel...Show more
Last updated: 4 days ago • Promoted