Talent.com
No longer accepting applications
QA Engineer – Machine Learning Systems

QA Engineer – Machine Learning Systems

Big Rattle Technologies | Big Rattle AIchennai, tamil nadu, in
8 days ago
Job description

Position : QA Engineer – Machine Learning Systems (5 - 7 years)

Location : Remote (Company in Mumbai)

Company : Big Rattle Technologies Private Limited

Immediate Joiners only.

Summary :

The QA Engineer will own quality assurance across the ML lifecycle—from raw data validation through feature engineering checks, model training / evaluation verification, batch prediction / optimization validation, and end-to-end (E2E) workflow testing. The role is hands-on with Python automation, data profiling, and pipeline test harnesses in Azure ML and Azure DevOps. Success means probably correct data, models, and outputs at production scale and cadence.

Key Responsibilities :

  • Test Strategy & Governance
  • ○ Define an ML-specific Test Strategy covering data quality KPIs, feature consistency
  • checks, model acceptance gates (metrics + guardrails), and E2E run acceptance
  • (timeliness, completeness, integrity).
  • ○ Establish versioned test datasets & golden baselines for repeatable regression of
  • features, models, and optimizers.
  • Data Quality & Transformation
  • Validate raw data extracts and landed data lake data : schema / contract checks, null / outlier thresholds, time-window completeness, duplicate detection, site / material coverage.
  • Validate transformed / feature datasets : deterministic feature generation, leakage detection, drift vs. historical distributions, feature parity across runs (hash or statistical similarity tests).

Implement automated data quality checks (e.g., Great Expectations / pytest + Pandas / SQL) executed in CI and AML pipelines.

  • Model Training & Evaluation
  • Verify training inputs (splits, windowing, target leakage prevention) and hyperparameter configs per site / cluster.
  • Automate metric verification (e.g., MAPE / MAE / RMSE, uplift vs. last model, stability tests) with acceptance thresholds and champion / challenger logic.
  • Validate feature importance stability and sensitivity / elasticity sanity checks (price / volume monotonicity where applicable).
  • Gate model registration / promotion in AML based on signed test artifacts and reproducible metrics.
  • Predictions, Optimization & Guardrails
  • Validate batch predictions : result shapes, coverage, latency, and failure handling.
  • Test model optimization outputs and enforced guardrails : detect violations and prove idempotent writes to DB.
  • Verify API push to third party system (idempotency keys, retry / backoff, delivery receipts).
  • Pipelines & E2E
  • Build pipeline test harnesses for AML pipelines (data-gen nightly, training weekly,
  • prediction / optimization) including orchestrated synthetic runs and fault injection
  • (missing slice, late competitor data, SB backlog).
  • Run E2E tests from raw data store ->
  • ADLS ->

    AML ->

    RDBMS ->

    APIM / Frontend; assert

  • freshness SLOs and audit event completeness (Event Hubs ->
  • ADLS immutable).

  • Automation & Tooling
  • Develop Python-based automated tests (pytest) for data checks, model metrics, and API contracts; integrate with Azure DevOps (pipelines, badges, gates).
  • Implement data-driven test runners (parameterized by site / material / model-version) and store signed test artifacts alongside models in AML Registry.
  • Create synthetic test data generators and golden fixtures to cover edge cases (price gaps, competitor shocks, cold starts).
  • Reporting & Quality Ops
  • Publish weekly test reports and go / no-go recommendations for promotions; maintain a defect taxonomy (data vs. model vs. serving vs. optimization).
  • Contribute to SLI / SLO dashboards (prediction timeliness, queue / DLQ, push success, data drift) used for release gates.
  • Required Skills (hands-on experience in the following) :

  • Python automation (pytest, pandas, NumPy), SQL (PostgreSQL / Snowflake), and CI / CD (Azure
  • DevOps) for fully automated ML QA.
  • Strong grasp of ML validation : leakage checks, proper splits, metric selection
  • (MAE / MAPE / RMSE), drift detection, sensitivity / elasticity sanity checks.
  • Experience testing AML pipelines (pipelines / jobs / components), and message-driven integrations
  • (Service Bus / Event Hubs).
  • API test skills (FastAPI / OpenAPI, contract tests, Postman / pytest-httpx) + idempotency and retry
  • patterns.
  • Familiar with feature stores / feature engineering concepts and reproducibility.
  • Solid understanding of observability (App Insights / Log Analytics) and auditability requirements.
  • Required Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
  • 5–7+ years in QA with 3+ years focused on ML / Data systems (data pipelines + model validation).
  • Certification in Azure Data or ML Engineer Associate is a plus.
  • Why should you join Big Rattle?

    Big Rattle Technologies specializes in AI / ML Products and Solutions as well as Mobile and Web Application Development. Our clients include Fortune 500 companies. Over the past 13 years, we have delivered multiple projects for international and Indian clients from various industries like FMCG, Banking and Finance, Automobiles, Ecommerce, etc. We also specialise in Product Development for our clients.

    Big Rattle Technologies Private Limited is ISO 27001 : 2022 certified and CyberGRX certified.

    What We Offer :

  • Opportunity to work on diverse projects for Fortune 500 clients.
  • Competitive salary and performance-based growth.
  • Dynamic, collaborative, and growth-oriented work environment.
  • Direct impact on product quality and client satisfaction.
  • 5-day hybrid work week.
  • Certification reimbursement.
  • Healthcare coverage.
  • How to Apply :

    Interested candidates are invited to submit their resume detailing their experience. Please detail out your work experience and the kind of projects you have worked on. Ensure you highlight your contributions and accomplishments to the projects.

    Send your resume to jobs@bigrattle.com with 'Application for QA Engineer' in the subject line.

    Create a job alert for this search

    Machine Learning Engineer • chennai, tamil nadu, in

    Related jobs
    • Promoted
    Founding Sr. Machine Learning Engineer : No Salary Only Equity

    Founding Sr. Machine Learning Engineer : No Salary Only Equity

    Truxt.aiChennai, IN
    As an early-stage company driven by a meaningful mission, we seek exceptional engineering talent who values purpose, long-term impact, and significant equity ownership over traditional salary compe...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Infosys FinacleChennai, Tamil Nadu, India
    Job Title : Senior Machine Learning Engineer.Machine Learning Model Development : .Research, design, and implement advanced machine learning algorithms and models to address business challenges.Extrac...Show moreLast updated: 6 days ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Innodata Inc.Chennai, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show moreLast updated: 7 days ago
    • Promoted
    AI ML Engineer

    AI ML Engineer

    GiggsoChennai, Tamil Nadu, India
    Founded in 2018, Giggso is a responsible AI platform for enterprise operations with security and automations.Giggso provides a single integrated platform for AI Agent orchestration, AI governance, ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Diligente Technologieschennai, tamil nadu, in
    Title : Senior Machine Learning Engineer.Location : Vaishnavi Signature, Bellandur, Bengaluru( hybrid2 days onsite a week). What You Will Achieve and Key Responsibilities.Research, Design, Develop and...Show moreLast updated: 1 day ago
    • Promoted
    Sr. AI / ML Engineer

    Sr. AI / ML Engineer

    Soulaxchennai, tamil nadu, in
    We’re looking for a Senior AI / ML Engineer with a strong foundation in geometric reasoning, hands-on Python and SQL expertise, and a flair for creative problem-solving. This role is ideal for someone...Show moreLast updated: 2 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    LuxoftChennai, IN
    We are seeking a skilled Machine Learning Engineer to develop and deploy Graph Neural Network (GNN) based surrogate models that approximate complex physics simulations for oil & gas pipeline and we...Show moreLast updated: 2 days ago
    • Promoted
    Engineer

    Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS we are hiring for ML / AI Engineer.Deep understanding of various GenAI applications (e.Qualifications : Any Graduation. Expert proficiency in Python and specialized ML frameworks (e.TensorFlow, Py...Show moreLast updated: 6 days ago
    • Promoted
    Software Engineer - AI / ML

    Software Engineer - AI / ML

    Mindfire SolutionsChennai, IN
    As an AI / ML Engineer, you will be responsible for designing, validating, and integrating cutting-edge machine learning models and algorithms. Collaborate closely with cross-functional teams, includi...Show moreLast updated: 1 day ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    BayOne SolutionsChennai, IN
    Machine Learning Development & Implementation (40%).Design and implement end-to-end ML pipelines for recommendation systems, search ranking, and classification problems. Build and optimize tradition...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer-Agentic AI

    Machine Learning Engineer-Agentic AI

    Innodata Inc.Chennai, IN
    Design and implement multi-agent systems using LangChain, LangGraph, CrewAI, AutoGen or similar frameworks.Build A2A (agent-to-agent) orchestration and implement MCP (multi-context protocol) for co...Show moreLast updated: 8 days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Tata Consultancy ServicesChennai, IN
    Senior Machine Learning Engineer.Senior Machine Learning Engineer.Developer with hands on experience in ML Algorithms.Required technical Skill Set : -. A Senior Machine Learning (ML) Engineer designs...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Machine Learning Engineer

    Machine Learning Engineer

    Infosys FinacleChennai, IN
    Minimum 4+years of Experience required.Excellent analytical and problem-solving skills.Experience using statistical computer languages (Python, SLQ, etc. Knowledge of advanced statistical techniques...Show moreLast updated: 12 hours ago
    • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    OcrolusChennai, IN
    Come build at the intersection of AI and fintech.At Ocrolus, we’re on a mission to help lenders automate workflows with confidence—streamlining how financial institutions evaluate borrowers and ena...Show moreLast updated: 8 days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    INSPYR Solutionschennai, tamil nadu, in
    MLOps Engineer II ( Mid-Senior-Level).Remote (Night Shift – 10 PM to 7 AM CST).Proficient MLOps engineer capable of independently managing production model deployments, pipelines, and infrastructur...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Machine Learning Engineer (AppSec)

    Senior Machine Learning Engineer (AppSec)

    Black DuckChennai, IN
    Senior Machine Learning Engineer – AI for AppSec Products.Senior Product-focused Machine Learning Engineer.LLM-powered systems that secure enterprise software development lifecycles.Work bridges cu...Show moreLast updated: 12 hours ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    RecroChennai, IN
    We are looking for an experienced.Azure and AWS cloud ecosystems.The ideal candidate should bring a strong background in. GenAI tooling, automation, and CI / CD pipelines.Design, implement, and manage...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Intellect Design Arena LtdChennai, Tamil Nadu, India
    Intellect Design Arena Limited is a global leader in Financial Technology for Banking, Insurance and other Financial Services. With a rich suite of products across the organization, we are an author...Show moreLast updated: 29 days ago