Principal QA Engineer – AI / ML

CareerXperts ConsultingPune, Maharashtra, India

1 hour ago

Job description

Job Opening : Principal Quality Assurance Engineer – AI / ML

We are looking for a visionary Principal QA Engineer to lead the end-to-end Quality Assurance strategy for advanced AI-driven applications. This role is ideal for someone who has deep experience in Agentic AI testing , strong technical leadership, and the ability to build scalable QA frameworks for AI / ML systems.

Key Responsibilities

Lead AI / ML QA Strategy

Define and evolve the overall QA roadmap for AI / ML models and services.
Establish standards for model testing, data validation, and MLOps pipeline quality.

Validate AI Models & Agentic AI Workflows

Test model accuracy, robustness, fairness, drift, and performance.

Ensure reliable and ethical AI outputs using manual and automated evaluation techniques.

Build & Scale Automation Frameworks

Develop scalable API and end-to-end automation using Python / Java or similar.

Ensure fast, reliable validation of AI microservices.

Cross-functional Quality Ownership

Partner with Developers, ML Engineers, and Product Owners to embed quality from the design stage (Shift-Left).

Drive quality mindset across the ML lifecycle.

Data Quality & Analysis

Oversee data integrity, statistical distribution, and input quality for training / inference pipelines.

Conduct deep debugging, RCA, and continuous improvement.

Leadership & Mentorship

Guide and mentor QA engineers, uplift technical capabilities, and set best practices.

Evaluate and integrate emerging ML testing tools and frameworks.

Required Skills & Experience

5–7 years of experience in Software Testing / QA.

Minimum 2+ years of hands-on experience testing Agentic AI / AI-ML systems .

Strong understanding of ML model lifecycle, MLOps , and AI testing techniques.

Expertise in API testing (Postman, RestAssured, etc.).

Strong proficiency in Python (preferred) or Java for automation.

Solid understanding of SDLC, MDLC, QA methodologies , and Agile.

Experience mentoring or leading QA / Automation teams.

Excellent communication and analytical skills.

Location : Pune (Hybrid)

Experience : 5–7 years

Mandatory : Proven experience in Agentic AI testing

Interested candidates can apply by sending their resume to : namitha@careerxperts.com

Create a job alert for this search

Qa Engineer • Pune, Maharashtra, India