AI Validation Engineer

Position : QA Engineer – Machine Learning Systems (5 - 7 years)

Location : Remote (Company in Mumbai)

Company : Big Rattle Technologies Private Limited

Immediate Joiners only.

Summary :

The QA Engineer will own quality assurance across the ML lifecycle—from raw data validation through feature engineering checks, model training / evaluation verification, batch prediction / optimization validation, and end-to-end (E2E) workflow testing. The role is hands-on with Python automation, data profiling, and pipeline test harnesses in Azure ML and Azure DevOps. Success means probably correct data, models, and outputs at production scale and cadence.

Key Responsibilities :

• Test Strategy & Governance
• ○ Define an ML-specific Test Strategy covering data quality KPIs, feature consistency
• checks, model acceptance gates (metrics + guardrails), and E2E run acceptance
• (timeliness, completeness, integrity).
• ○ Establish versioned test datasets & golden baselines for repeatable regression of
• features, models, and optimizers.
• Data Quality & Transformation
• Validate raw data extracts and landed data lake data : schema / contract checks, null / outlier thresholds, time-window completeness, duplicate detection, site / material coverage.
• Validate transformed / feature datasets : deterministic feature generation, leakage detection, drift vs. historical distributions, feature parity across runs (hash or statistical similarity tests).

Implement automated data quality checks (e.G., Great Expectations / pytest + Pandas / SQL) executed in CI and AML pipelines.

ADLS ->

AML ->

RDBMS ->

assert

ADLS immutable).

integrate with Azure DevOps (pipelines, badges, gates).

maintain a defect taxonomy (data vs. model vs. serving vs. optimization).

Required Skills (hands-on experience in the following) :

Required Qualifications :

Why should you join Big Rattle?

Big Rattle Technologies specializes in AI / ML Products and Solutions as well as Mobile and Web Application Development. Our clients include Fortune 500 companies. Over the past 13 years, we have delivered multiple projects for international and Indian clients from various industries like FMCG, Banking and Finance, Automobiles, Ecommerce, etc. We also specialise in Product Development for our clients.

Big Rattle Technologies Private Limited is ISO 27001 : 2022 certified and CyberGRX certified.

What We Offer :

How to Apply :

Interested candidates are invited to submit their resume detailing their experience. Please detail out your work experience and the kind of projects you have worked on. Ensure you highlight your contributions and accomplishments to the projects.

Send your resume to jobs@bigrattle.com with 'Application for QA Engineer' in the subject line.