Big Rattle Technologies - QA Engineer - Machine Learning Systems

Position : QA Engineer - Machine Learning Systems (5 - 7 years)

Location : Remote (Company in Mumbai)

Immediate Joiners only.

Summary :

The QA Engineer will own quality assurance across the ML lifecyclefrom raw data validation through feature engineering checks, model training / evaluation verification, batch prediction / optimization validation, and end-to-end (E2E) workflow testing.

The role is hands-on with Python automation, data profiling, and pipeline test harnesses in Azure ML and Azure DevOps.

Success means probably correct data, models, and outputs at production scale and cadence.

Key Responsibilities :

Test Strategy & Governance :

• Define an ML-specific Test Strategy covering data quality KPIs, feature consistency checks, model acceptance gates (metrics + guardrails), and E2E run acceptance (timeliness, completeness, integrity).
• Establish versioned test datasets & golden baselines for repeatable regression of features, models, and optimizers.

Data Quality & Transformation :

Model Training & Evaluation :

Predictions, Optimization & Guardrails :

Pipelines & E2E :

Automation & Tooling :

Reporting & Quality Ops :

Required Skills (hands-on experience in the following) :

Required Qualifications :

(ref : hirist.tech)