Talent.com
QA Engineer – Machine Learning Systems

QA Engineer – Machine Learning Systems

Big Rattle Technologies | Big Rattle AIvijayapura, rajasthan, in
22 hours ago
Job description

Position : QA Engineer – Machine Learning Systems (5 - 7 years)

Location : Remote (Company in Mumbai)

Company : Big Rattle Technologies Private Limited

Immediate Joiners only.

Summary :

The QA Engineer will own quality assurance across the ML lifecycle—from raw data validation through feature engineering checks, model training / evaluation verification, batch prediction / optimization validation, and end-to-end (E2E) workflow testing. The role is hands-on with Python automation, data profiling, and pipeline test harnesses in Azure ML and Azure DevOps. Success means probably correct data, models, and outputs at production scale and cadence.

Key Responsibilities :

  • Test Strategy & Governance
  • ○ Define an ML-specific Test Strategy covering data quality KPIs, feature consistency
  • checks, model acceptance gates (metrics + guardrails), and E2E run acceptance
  • (timeliness, completeness, integrity).
  • ○ Establish versioned test datasets & golden baselines for repeatable regression of
  • features, models, and optimizers.
  • Data Quality & Transformation
  • Validate raw data extracts and landed data lake data : schema / contract checks, null / outlier thresholds, time-window completeness, duplicate detection, site / material coverage.
  • Validate transformed / feature datasets : deterministic feature generation, leakage detection, drift vs. historical distributions, feature parity across runs (hash or statistical similarity tests).

Implement automated data quality checks (e.g., Great Expectations / pytest + Pandas / SQL) executed in CI and AML pipelines.

  • Model Training & Evaluation
  • Verify training inputs (splits, windowing, target leakage prevention) and hyperparameter configs per site / cluster.
  • Automate metric verification (e.g., MAPE / MAE / RMSE, uplift vs. last model, stability tests) with acceptance thresholds and champion / challenger logic.
  • Validate feature importance stability and sensitivity / elasticity sanity checks (price / volume monotonicity where applicable).
  • Gate model registration / promotion in AML based on signed test artifacts and reproducible metrics.
  • Predictions, Optimization & Guardrails
  • Validate batch predictions : result shapes, coverage, latency, and failure handling.
  • Test model optimization outputs and enforced guardrails : detect violations and prove idempotent writes to DB.
  • Verify API push to third party system (idempotency keys, retry / backoff, delivery receipts).
  • Pipelines & E2E
  • Build pipeline test harnesses for AML pipelines (data-gen nightly, training weekly,
  • prediction / optimization) including orchestrated synthetic runs and fault injection
  • (missing slice, late competitor data, SB backlog).
  • Run E2E tests from raw data store ->
  • ADLS ->

    AML ->

    RDBMS ->

    APIM / Frontend; assert

  • freshness SLOs and audit event completeness (Event Hubs ->
  • ADLS immutable).

  • Automation & Tooling
  • Develop Python-based automated tests (pytest) for data checks, model metrics, and API contracts; integrate with Azure DevOps (pipelines, badges, gates).
  • Implement data-driven test runners (parameterized by site / material / model-version) and store signed test artifacts alongside models in AML Registry.
  • Create synthetic test data generators and golden fixtures to cover edge cases (price gaps, competitor shocks, cold starts).
  • Reporting & Quality Ops
  • Publish weekly test reports and go / no-go recommendations for promotions; maintain a defect taxonomy (data vs. model vs. serving vs. optimization).
  • Contribute to SLI / SLO dashboards (prediction timeliness, queue / DLQ, push success, data drift) used for release gates.
  • Required Skills (hands-on experience in the following) :

  • Python automation (pytest, pandas, NumPy), SQL (PostgreSQL / Snowflake), and CI / CD (Azure
  • DevOps) for fully automated ML QA.
  • Strong grasp of ML validation : leakage checks, proper splits, metric selection
  • (MAE / MAPE / RMSE), drift detection, sensitivity / elasticity sanity checks.
  • Experience testing AML pipelines (pipelines / jobs / components), and message-driven integrations
  • (Service Bus / Event Hubs).
  • API test skills (FastAPI / OpenAPI, contract tests, Postman / pytest-httpx) + idempotency and retry
  • patterns.
  • Familiar with feature stores / feature engineering concepts and reproducibility.
  • Solid understanding of observability (App Insights / Log Analytics) and auditability requirements.
  • Required Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
  • 5–7+ years in QA with 3+ years focused on ML / Data systems (data pipelines + model validation).
  • Certification in Azure Data or ML Engineer Associate is a plus.
  • Why should you join Big Rattle?

    Big Rattle Technologies specializes in AI / ML Products and Solutions as well as Mobile and Web Application Development. Our clients include Fortune 500 companies. Over the past 13 years, we have delivered multiple projects for international and Indian clients from various industries like FMCG, Banking and Finance, Automobiles, Ecommerce, etc. We also specialise in Product Development for our clients.

    Big Rattle Technologies Private Limited is ISO 27001 : 2022 certified and CyberGRX certified.

    What We Offer :

  • Opportunity to work on diverse projects for Fortune 500 clients.
  • Competitive salary and performance-based growth.
  • Dynamic, collaborative, and growth-oriented work environment.
  • Direct impact on product quality and client satisfaction.
  • 5-day hybrid work week.
  • Certification reimbursement.
  • Healthcare coverage.
  • How to Apply :

    Interested candidates are invited to submit their resume detailing their experience. Please detail out your work experience and the kind of projects you have worked on. Ensure you highlight your contributions and accomplishments to the projects.

    Send your resume to jobs@bigrattle.com with 'Application for QA Engineer' in the subject line.

    Create a job alert for this search

    Machine Learning Engineer • vijayapura, rajasthan, in

    Related jobs
    • Promoted
    • New!
    AI / ML Engineer – Founding Team (Healthtech | $430 B Industry)

    AI / ML Engineer – Founding Team (Healthtech | $430 B Industry)

    Souli.helpvijayapura, rajasthan, in
    Early traction is already proven : customers in the US and Europe have paid.The industry we are entering is valued at.This isn’t a typical job. it’s a.You’ll work alongside the founder to : .Architect...Show moreLast updated: 22 hours ago
    • Promoted
    AI Exploration Engineer

    AI Exploration Engineer

    Mitchell Martin Inc.vijayapura, rajasthan, in
    Design and execute machine learning experiments to evaluate emerging AI technologies and frameworks.Prototype and assess end-to-end AI solutions to inform product and platform strategy.Formulate hy...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Aakaar AIvijayapura, rajasthan, in
    We're a small but ambitious startup revolutionizing the e-commerce landscape with cutting-edge AI solutions.Our mission is to empower sellers with the tools and insights they need to thrive in the ...Show moreLast updated: 11 days ago
    • Promoted
    Senior MLOps Engineer (Production)

    Senior MLOps Engineer (Production)

    SAIVA AIvijayapura, rajasthan, in
    We are seeking a Senior Machine Learning Engineer to join our team and help shape the future of healthcare technology.In this role, you will design, build, and deploy machine learning systems that ...Show moreLast updated: 18 days ago
    • Promoted
    ML Ops

    ML Ops

    EXLvijayapura, rajasthan, in
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show moreLast updated: 30+ days ago
    • Promoted
    AiOps Engineer

    AiOps Engineer

    L&T Technology Servicesvijayapura, rajasthan, in
    Only immediate to 15 days joiner.Develop and Deploy AI Solutions : .Design, build, and deploy end-to-end Machine Learning and Generative AI pipelines on. Google Cloud Platform, using Vertex AI service...Show moreLast updated: 19 days ago
    • Promoted
    Remote GenAI Engineer

    Remote GenAI Engineer

    EazyMLvijayapura, rajasthan, in
    Remote
    Founded by Bell Labs research veterans, and associated with breakthrough startups like Amelia, EazyML, specializes in Transparent Machine Learning. Early on EazyML founders saw the need for Transpa...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Manager, Data Scientist and Machine Learning Engineer

    Manager, Data Scientist and Machine Learning Engineer

    Ocwen Financial Solutions Pvt. Ltd. - APACvijayapura, rajasthan, in
    We’re seeking a Data Scientist to support the development and deployment of machine learning models and analytics solutions that improve decision-making across the mortgage lifecycle—from acquisiti...Show moreLast updated: 22 hours ago
    • Promoted
    • New!
    Machine Learning Engineer

    Machine Learning Engineer

    V3 Staffingvijayapura, rajasthan, in
    Machine Learning Engineers and ML Leads.AI, data engineering, and MLOps.If you have hands-on experience in.ML model development, cloud platforms, and Generative AI tools. Python, PySpark, and AWS (S...Show moreLast updated: 22 hours ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Recrovijayapura, rajasthan, in
    We are looking for an experienced.Azure and AWS cloud ecosystems.The ideal candidate should bring a strong background in. GenAI tooling, automation, and CI / CD pipelines.Design, implement, and manage...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    BayOne Solutionsvijayapura, rajasthan, in
    Machine Learning Development & Implementation (40%).Design and implement end-to-end ML pipelines for recommendation systems, search ranking, and classification problems. Build and optimize tradition...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead AI Engineer

    Lead AI Engineer

    Genisys Groupvijayapura, rajasthan, in
    As an AI / ML Engineer at Genisys Group, you will be instrumental in developing and.AI solutions, with a strong focus on Large Language Models. LLMs) and Retrieval-Augmented Generation (RAG) technique...Show moreLast updated: 22 hours ago
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Mitchell Martin Inc.vijayapura, rajasthan, in
    Include, but are not limited to, the following : .Own productionizing models—from tracked experiments to governed releases—ensuring resilient services with clear SLOs, runbooks, and fast, safe rollba...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    goMLvijayapura, rajasthan, in
    Looking for a culture to thrive & build a rewarding career for yourself, join the core team of young hustlers building the next generation of Machine Learning platform & services.You will develop t...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AI / ML Engineer (3 to 5 Years)

    AI / ML Engineer (3 to 5 Years)

    DXFactorvijayapura, rajasthan, in
    DXFactor is looking for AI / ML Engineer (3 to 6 Yrs).DXFactor is a US-based tech company working with fortune 500 customers across the globe. Location : SG Highway, Ahmedabad (Work from Office).Machin...Show moreLast updated: 22 hours ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire Solutionsvijayapura, rajasthan, in
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 13 days ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Chargebeevijayapura, rajasthan, in
    Chargebee’s GBT AI team builds internal AI agents and workflows that power smarter, faster operations across Finance, HR, Legal , Marketing, RevOps and GTM. We’re looking for an AI Engineer who can ...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    AI / ML Engineer

    AI / ML Engineer

    Kresta Softech Private Limitedvijayapura, rajasthan, in
    Job Title : Senior AI / ML Engineer - Generative AI & LLMs.Industry : Healthcare / Automotive OEC.Location : Hyderabad (On-Site) / Remote. We're seeking an expert AI / ML Engineer to lead development of cut...Show moreLast updated: 22 hours ago