Talent.com
This job offer is not available in your country.
▷ [Only 24h Left] QA Analyst – Data Science

▷ [Only 24h Left] QA Analyst – Data Science

Volga InfotechIndia
14 hours ago
Job description
  • We are currently hiring for a senior-level position and are looking for immediate joiners only.
  • If you are interested, please send your updated resume to resume@volgainfotech.com along with details of your CTC, ECTC and notice period

    Location : Remote

    Employment Type : Full-time

    About the Role

    The QA Engineer will own quality assurance across the ML lifecycle—from raw data validation through

    feature engineering checks, model training / evaluation verification, batch prediction / optimization

    validation, and end-to-end (E2E) workflow testing. The role is hands-on with Python automation, data

    profiling, and pipeline test harnesses in Azure ML and Azure DevOps. Success means provably correct

    data, models, and outputs at production scale and cadence.

    About the Role

    The QA Engineer will own quality assurance across the ML lifecycle—from raw data validation through

    feature engineering checks, model training / evaluation verification, batch prediction / optimization

    validation, and end-to-end (E2E) workflow testing. The role is hands-on with Python automation, data

    profiling, and pipeline test harnesses in Azure ML and Azure DevOps. Success means provably correct

    data, models, and outputs at production scale and cadence.

    Key Responsibilities

    • Test Strategy & Governance
    • ○ Define an ML-specific Test Strategy covering data quality KPIs, feature consistency

      checks, model acceptance gates (metrics + guardrails), and E2E run acceptance

      (timeliness, completeness, integrity).

      ○ Establish versioned test datasets & golden baselines for repeatable regression of

      features, models, and optimizers.

    • Data Quality & Transformation
    • ○ Validate raw data extracts and landed datalake data : schema / contract checks,

      null / outlier thresholds, time-window completeness, duplicate detection, site / material

      coverage.

      ○ Validate transformed / feature datasets : deterministic feature generation, leakage

      detection, drift vs. historical distributions, feature parity across runs (hash or statistical

      similarity tests).

      ○ Implement automated data quality checks (e.g., Great Expectations / pytest +

      Pandas / SQL) executed in CI and AML pipelines.

    • Model Training & Evaluation
    • ○ Verify training inputs (splits, windowing, target leakage prevention) and

      hyperparameter configs per site / cluster.

      ○ Automate metric verification (e.g., MAPE / MAE / RMSE, uplift vs. last model, stability

      tests) with acceptance thresholds and champion / challenger logic.

      ○ Validate feature importance stability and sensitivity / elasticity sanity checks (pricevolume

      monotonicity where applicable).

      ○ Gate model registration / promotion in AML based on signed test artifacts and

      reproducible metrics.

    • Predictions, Optimization & Guardrails
    • ○ Validate batch predictions : result shapes, coverage, latency, and failure handling.

      © 2025 Insurge Partners. All rights reserved.

      ○ Test model optimization outputs and enforced guardrails : detect violations and prove

      idempotent writes to DB.

      ○ Verify API push to third party system (idempotency keys, retry / backoff, delivery

      receipts).

    • Pipelines & E2E
    • ○ Build pipeline test harnesses for AML pipelines (data-gen nightly, training weekly,

      prediction / optimization) including orchestrated synthetic runs and fault injection

      (missing slice, late competitor data, SB backlog).

      ○ Run E2E tests from raw data store ->

      ADLS ->

      AML ->

      RDBMS ->

      APIM / Frontend; assert

      freshness SLOs and audit event completeness (Event Hubs ->

      ADLS immutable).

    • Automation & Tooling
    • ○ Develop Python-based automated tests (pytest) for data checks, model metrics, and API

      contracts; integrate with Azure DevOps (pipelines, badges, gates).

      ○ Implement data-driven test runners (parameterized by site / material / model-version)

      and store signed test artifacts alongside models in AML Registry.

      ○ Create synthetic test data generators and golden fixtures to cover edge cases (price

      gaps, competitor shocks, cold starts).

    • Reporting & Quality Ops
    • ○ Publish weekly test reports and go / no-go recommendations for promotions; maintain a

      defect taxonomy (data vs. model vs. serving vs. optimization).

      ○ Contribute to SLI / SLO dashboards (prediction timeliness, queue / DLQ, push success, data

      drift) used for release gates.

      Required Qualifications

      ○ 5–7+ years in QA with 3+ years focused on ML / Data systems (data pipelines + model validation).

      ○ Python automation (pytest, pandas, NumPy), SQL (PostgreSQL / Snowflake), and CI / CD (Azure

      DevOps) for fully automated ML QA.

      ○ Strong grasp of ML validation : leakage checks, proper splits, metric selection

      (MAE / MAPE / RMSE), drift detection, sensitivity / elasticity sanity checks.

      ○Experience testing AML pipelines (pipelines / jobs / components), and message-driven integrations

      (Service Bus / Event Hubs).

      ○ API test skills (FastAPI / OpenAPI, contract tests, Postman / pytest-httpx) + idempotency and retry

      patterns.

      ○ Familiar with feature stores / feature engineering concepts and reproducibility.

      ○Solid understanding of observability (App Insights / Log Analytics) and auditability requirements.

      Education

    • Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
    • Certification in Azure Data or ML Engineer Associate is a plus..
    Create a job alert for this search

    Only 24H Left Data Analyst • India

    Related jobs
    • Promoted
    Data Quality Analysts

    Data Quality Analysts

    Akronintel Private LimitedIndia
    We are seeking a highly skilled Data Quality Analyst with 3 to 6 years of experience and a strong foundation in both business and technical expertise in Investment Banking Domain.The ideal candidat...Show moreLast updated: 6 days ago
    • Promoted
    AI-First QA Engineer (with Business Analysis Expertise)

    AI-First QA Engineer (with Business Analysis Expertise)

    CESNagpur, IN
    The role focuses on building quality from the first requirement using.You’ll work closely with product and development teams, using an AI-first approach to make testing faster, sharper, and more ef...Show moreLast updated: 4 days ago
    • Promoted
    Senior Technical Analyst

    Senior Technical Analyst

    Insight GlobalNagpur, IN
    Strong experience within data validation, data testing and data accuracy.Fluent in English and ability to communicate with internal / external stakeholders. Experience with ETL Development.This role w...Show moreLast updated: 16 days ago
    • Promoted
    Data Governance & Systems Analyst (Rightsline / Metadata Management)

    Data Governance & Systems Analyst (Rightsline / Metadata Management)

    Sky Systems, Inc. (SkySys)Nagpur, IN
    We’re looking for a detail-oriented.Data Governance & Systems Analyst.The ideal candidate will act as a.Maintain and organize Rightsline metadata, ensuring title hierarchy accuracy.Monitor data qua...Show moreLast updated: 6 days ago
    • Promoted
    Veeva RIM Business Analyst – Data Migration & Remediation

    Veeva RIM Business Analyst – Data Migration & Remediation

    vueverse.Nagpur, IN
    Senior Business Analyst with 8+ years of experience.Veeva using the migration-center.Advise stakeholders on best practices for. Partner with technical teams to review data extracts, conduct.Define r...Show moreLast updated: 4 days ago
    • Promoted
    APM Data Integration Analyst

    APM Data Integration Analyst

    TribolaTech IncNagpur, IN
    Title - APM Data Integration Analyst.This role ensures data integrity, integration, and governance across the APM ecosystem. The Data Integration Analyst will manage application metadata completenes...Show moreLast updated: 28 days ago
    • Promoted
    Data Analyst

    Data Analyst

    Unotech GlobalIndia, India
    Unotech Global is dedicated to solving real-world problems through innovative AI-driven solutions.Our company specializes in Artificial Intelligence applications across various fields, including Io...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    ▷ [Only 24h Left] Data Analyst

    ▷ [Only 24h Left] Data Analyst

    InfogainIndia
    The Data Analyst is a critical role responsible for driving product, UX, and marketing decisions by transforming data into actionable insights. You will be a cross-functional partner, embedding a da...Show moreLast updated: 14 hours ago
    • Promoted
    Forward Deployed Data Analyst (Contract-to-Hire)

    Forward Deployed Data Analyst (Contract-to-Hire)

    Fig LabsIndia, India
    Analytics Agent—an AI agentic analyst that monitors business data 24 / 7, explains what changed and why, and recommends next-best actions. We help organizations move from static dashboards to.Snowflak...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Data Quality Analyst (15h Left)

    Data Quality Analyst (15h Left)

    Tata Consultancy ServicesIndia
    Job Location – Mumbai, Pune, Bengaluru, Hyderabad, Noida.Experience Range – 5 to 10 Years.Skillset Required - Test script creation, writing, performing UAT of edit checks and screen, UAT.Educationa...Show moreLast updated: 14 hours ago
    • Promoted
    QA Analyst - Immediate start

    QA Analyst - Immediate start

    ConfidencialNagpur, IN
    We are looking for an QA Supporting UK hours for one of the clients.Strong Communicator is a must, Max salary is 11 LPA.Bachelor’s degree in Computer Science, Engineering, or a related field (or eq...Show moreLast updated: 6 days ago
    • Promoted
    QA Analyst – Capital Markets / Fintech

    QA Analyst – Capital Markets / Fintech

    Akronintel Pvt LtdNagpur, IN
    Job Title : QA Analyst – Capital Markets / Fintech.Location - Multicity (Chennai, Bangalore, Mumbai, Pune).We are seeking a highly motivated. The ideal candidate will have hands-on experience in.Coll...Show moreLast updated: 16 days ago
    • Promoted
    Data Analyst

    Data Analyst

    Sympera AINagpur, IN
    Sympera is an AI-driven banking intelligence platform designed to scale relationship banking.We enable financial institutions to deliver personalized services at scale by empowering bankers to focu...Show moreLast updated: 2 days ago
    • Promoted
    Data Scientist

    Data Scientist

    EntrustechNagpur, IN
    We’re looking for a highly skilled and motivated professional to join our team and help shape the future of.As a Data Scientist, you’ll wear multiple hats and play a key role in advancing our AI-po...Show moreLast updated: 6 days ago
    • Promoted
    QA Analyst – Data Science

    QA Analyst – Data Science

    Volga InfotechIndia
    We are currently hiring for a senior-level position and are looking for immediate joiners only.If you are interested, please send your updated resume to resume@volgainfotech.CTC, ECTC and notice pe...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    [15h Left] Forward Deployed Data Analyst (Contract-to-Hire)

    [15h Left] Forward Deployed Data Analyst (Contract-to-Hire)

    Fig LabsIndia
    Fig Labs is building the Fig Analytics Agent—an AI agentic analyst that monitors business data 24 / 7, explains what changed and why, and recommends next-best actions. We help organizations move from ...Show moreLast updated: 14 hours ago
    • Promoted
    Data Analyst

    Data Analyst

    AdeptmindNagpur, IN
    Our platform helps online retailers bridge the gap between online and offline conversion rates.Our technology uses deep learning and natural. Our results speak for themselves.Search should be intuit...Show moreLast updated: 4 days ago
    • Promoted
    Senior Data Analyst_Remote

    Senior Data Analyst_Remote

    Bee Talent SolutionsNagpur, IN
    Remote
    As a Senior Data Analyst, you'll be at the forefront of fostering a data-driven culture across our client's organization. Your role extends beyond traditional data analysis; you'll play a pivotal ro...Show moreLast updated: 6 days ago
    • Promoted
    Data Steward

    Data Steward

    Insight GlobalNagpur, IN
    Collibra, Informatica EDC, Atlan).Proven experience translating technical data logic into.Strong communication, facilitation, and stakeholder management skills. Bachelor's degree in Computer Science...Show moreLast updated: 2 days ago
    • Promoted
    Data Analytics & Insights Analyst

    Data Analytics & Insights Analyst

    AstreyaNagpur, IN
    Data Analytics & Insights Analyst.Astreya offers comprehensive IT support and managed services.Center and Network Management, Digital Workplace Services (like Service Desk, Audio Visual, and.IT Ass...Show moreLast updated: 30+ days ago