Principal QA Engineer – AI/MLCareerXperts Consulting • Delhi, India

Principal QA Engineer – AI / ML

CareerXperts Consulting • Delhi, India

2 days ago

Job description

Job Opening : Principal Quality Assurance Engineer – AI / ML

We are looking for a visionary Principal QA Engineer to lead the end-to-end Quality Assurance strategy for advanced AI-driven applications. This role is ideal for someone who has deep experience in Agentic AI testing, strong technical leadership, and the ability to build scalable QA frameworks for AI / ML systems.

Key Responsibilities

Lead AI / ML QA Strategy

Define and evolve the overall QA roadmap for AI / ML models and services.
Establish standards for model testing, data validation, and MLOps pipeline quality.

Validate AI Models & Agentic AI Workflows

Test model accuracy, robustness, fairness, drift, and performance.

Ensure reliable and ethical AI outputs using manual and automated evaluation techniques.

Build & Scale Automation Frameworks

Develop scalable API and end-to-end automation using Python / Java or similar.

Ensure fast, reliable validation of AI microservices.

Cross-functional Quality Ownership

Partner with Developers, ML Engineers, and Product Owners to embed quality from the design stage (Shift-Left).

Drive quality mindset across the ML lifecycle.

Data Quality & Analysis

Oversee data integrity, statistical distribution, and input quality for training / inference pipelines.

Conduct deep debugging, RCA, and continuous improvement.

Leadership & Mentorship

Guide and mentor QA engineers, uplift technical capabilities, and set best practices.

Evaluate and integrate emerging ML testing tools and frameworks.

Required Skills & Experience

5–7 years of experience in Software Testing / QA.

Minimum 2+ years of hands-on experience testing Agentic AI / AI-ML systems.

Strong understanding of ML model lifecycle, MLOps, and AI testing techniques.

Expertise in API testing (Postman, RestAssured, etc.).

Strong proficiency in Python (preferred) or Java for automation.

Solid understanding of SDLC, MDLC, QA methodologies, and Agile.

Experience mentoring or leading QA / Automation teams.

Excellent communication and analytical skills.

Location : Pune (Hybrid)

Experience : 5–7 years

Mandatory : Proven experience in Agentic AI testing

Interested candidates can apply by sending their resume to : namitha@careerxperts.com

Create a job alert for this search

Qa Engineer • Delhi, India

Related jobs

AI / ML Engineer

Innodata Inc. • Delhi, IN

Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show more

Last updated: 20 days ago • Promoted

AI / ML Engineer

DataAlchemy.AI • Noida, Uttar Pradesh, India

AI solutions that simplify complex technology and drive measurable business impact.We offer comprehensive services—including AI strategy, digital transformation consulting, high-quality data labeli...Show more

Last updated: 3 days ago • Promoted

Lead AI Engineer

Blend • Ghaziabad, IN

We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more

Last updated: 17 days ago • Promoted

AI / ML Lead

Talent Toppers • Delhi, India, India

Global consulting and technology company focused on delivering operational excellence to the insurance industry.It provides strategic solutions across underwriting, claims, analytics, and digital t...Show more

Last updated: 14 days ago • Promoted

AI ML Engineer

Prudent Technologies and Consulting, Inc. • Delhi, India, India

Use of AI / ML tools and technologies to automate various cybercrime investigation process, identify and implement most suitable AI tools available in market for use by I4C.Train machine learning mo...Show more

Last updated: less than 1 hour ago • Promoted • New!

Senior AI / ML Solutions Engineer

Finastra • Delhi, India

What will you contribute? Finastra’s Global Data Office is responsible for the strategy, governance, and enablement of data assets across 130+ countries globally to unlock innovation for our busine...Show more

Last updated: 14 days ago • Promoted

Senior AI / ML Engineer

NextDimension AI • Gurugram, Haryana, India

INR 12-30 LPA Base + Bonus + Equity.NextDimension is a US-based technology startup building AI Agents in Healthcare, established by a team of distinguished AI / ML Scientists and Engineers from Googl...Show more

Last updated: 3 days ago • Promoted

Principal Software Engineer AI / ML

Cotiviti • Ghaziabad, IN

We are seeking a software architect designing comprehensive MLOps platform, establishing technical standards, and leading infrastructure integration for ML deployment. Principal Responsibilities and...Show more

Last updated: 19 days ago • Promoted

AI / ML Engineer

Edstem Technologies • Meerut, IN

The ideal candidate will have hands-on expertise across the full ML lifecycle—from data exploration and feature engineering to model training, optimization, and production deployment.You will work ...Show more

Last updated: 21 days ago • Promoted

AI / ML Engineers L4 / L5

Griphic • Delhi, India, India

Location & Type : Delhi, Full-time.We’re looking for a hands-on AI / ML Lead Engineer.You’ll guide a small team of engineers, collaborate with product and design, and turn ideas into working AI featur...Show more

Last updated: 21 days ago • Promoted

Principal RTL Design Engineer / Co-founder - AI / ML Accelerator

Faststream Technologies • Ghaziabad, IN

Lead / Own a world class NPU for Edge AI Inference.Develop ultra-low-power machine learning chips for intelligent sensing and autonomous navigation. Architect / Work independently and collaborativel...Show more

Last updated: 1 day ago • Promoted

AI / ML Engineer

BIG Language Solutions • Noida, Uttar Pradesh, India

Location : Noida(Work from Office).Reports to : VP of Artificial Intelligence.At BIG Language Solutions, we're shaping the future of multilingual communication through cutting-edge AI.As an AI / ML Lea...Show more

Last updated: 13 days ago • Promoted

Principal Architect-AIML

Intellect Design Arena Ltd • Delhi, India

Role : AI / ML & Generative AI Architect / Engineering Leader.Mandatory-Should have a stable track record.Suitable candidate shall be notified the same day. We're looking for a Technology Leader in AI / ...Show more

Last updated: 13 days ago • Promoted

AI Lead Engineer

TekGenio • Delhi, IN

Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development. Strong experience in machine learning, deep lea...Show more

Last updated: less than 1 hour ago • Promoted • New!

Lead Engineer - AI / ML

Mindfire Solutions • Delhi, IN

As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models. Your role involves guiding a team of engineers ensuring the successful...Show more

Last updated: 30+ days ago • Promoted

AI / ML Engineer

C4 Technical Services • Meerut, IN

AI Solution Development & Deployment : Design and implement AI models and algorithms using Azure AI services, including Azure Machine Learning, Cognitive Services, and Azure OpenAI.Develop and deploy...Show more

Last updated: less than 1 hour ago • Promoted • New!

Machine Learning Engineer-Agentic AI

Innodata Inc. • Meerut, IN

Design and implement multi-agent systems using LangChain, LangGraph, CrewAI, AutoGen or similar frameworks.Build A2A (agent-to-agent) orchestration and implement MCP (multi-context protocol) for co...Show more

Last updated: 20 days ago • Promoted

AI Developer - ML & AI Agents (3 to 9 Years)

AIMLEAP • Delhi, IN

AI Developer - ML & AI Agents (3 to 9 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development. Strong Python programming background f...Show more

Last updated: 7 days ago • Promoted