Talent.com
AI/ML Test Engineer
AI/ML Test EngineerConfidential • Pune, India
AI / ML Test Engineer

AI / ML Test Engineer

Confidential • Pune, India
23 days ago
Job description

Responsibilities

  • Design and execute test strategies for AI / ML models, ensuring data quality, accuracy, and reproducibility.
  • Validate ML models against defined metrics such as precision, recall, accuracy, and F1 score.
  • Develop automated test scripts and frameworks for model validation and monitoring.
  • Perform functional, performance, and regression testing of AI-driven applications.
  • Verify data pipelines and ensure data integrity from source to model input / output.
  • Conduct bias and fairness testing to ensure ethical AI behavior.
  • Work with data scientists to understand model logic, training datasets, and expected outcomes.
  • Validate model deployment workflows (MLOps) and ensure smooth model versioning and retraining cycles.
  • Integrate test automation into CI / CD pipelines for continuous model validation.
  • Document test scenarios, defect reports, and model validation results.
  • Research and implement new tools for AI model testing, explainability (XAI), and monitoring.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or related field.
  • 3+ years of experience in software testing or QA, with at least 1+ year focused on AI / ML systems.
  • Strong understanding of machine learning concepts, including supervised / unsupervised learning, NLP, and computer vision.
  • Experience in testing ML pipelines, APIs, and data validation workflows.
  • Proficiency in Python with libraries such as Pandas, NumPy, Scikit-learn, TensorFlow, or PyTorch.
  • Familiarity with MLOps tools like MLflow, Kubeflow, or AWS SageMaker.
  • Knowledge of model interpretability and explainability frameworks (e.g., SHAP, LIME).
  • Experience with automated testing tools and frameworks (e.g., PyTest, Robot Framework).
  • Good understanding of REST APIs, JSON, and data serialization formats.
  • Excellent problem-solving, analytical, and communication skills.
  • Skills Required

    Pytest, Json, Tensorflow, Numpy, Pandas, Pytorch, Robot Framework, Rest Apis, Python

    Create a job alert for this search

    Test Engineer • Pune, India

    Related jobs
    AI / ML Engineer — Physiological Intelligence

    AI / ML Engineer — Physiological Intelligence

    ONLYQ • Pune / Pimpri-Chinchwad Area, India
    We’re building the next-generation .Bioimpedance + Temperature sensing.Women’s health & autonomic intelligence.Preventive, personalised insights. A Lab on Hand — for every human.Cymetree Projects LL...Show more
    Last updated: 1 day ago • Promoted
    SR AI Engineer

    SR AI Engineer

    Fulcrum Digital Inc • Pune, Maharashtra, India
    We are seeking a skilled and hands-on.The ideal candidate has a strong foundation in classification, anomaly detection, and time-series modeling, along with experience in Transformer-based architec...Show more
    Last updated: 1 day ago • Promoted
    Principal QA Engineer – AI / ML

    Principal QA Engineer – AI / ML

    CareerXperts Consulting • Pune, Maharashtra, India
    Job Opening : Principal Quality Assurance Engineer – AI / ML.We are looking for a visionary.Quality Assurance strategy for advanced AI-driven applications. This role is ideal for someone who has deep e...Show more
    Last updated: 1 day ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Edstem Technologies • pune, maharashtra, in
    The ideal candidate will have hands-on expertise across the full ML lifecycle—from data exploration and feature engineering to model training, optimization, and production deployment.You will work ...Show more
    Last updated: 19 days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Innodata Inc. • Pune, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show more
    Last updated: 18 days ago • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, Mumbai • Pune, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI & AI / ML Engineer

    Generative AI & AI / ML Engineer

    Evonence • Pune, Maharashtra, India
    Experience Level - 5 to 7 Years.Evonence is looking for Generative AI & AI / ML Engineer to drive end-to-end AI solution development from architecture and model training to responsible deployment and...Show more
    Last updated: 19 days ago • Promoted
    Lead Engineer - AI / ML

    Lead Engineer - AI / ML

    Mindfire Solutions • Pune, IN
    As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models. Your role involves guiding a team of engineers ensuring the successful...Show more
    Last updated: 30+ days ago • Promoted
    AI / ML 2–5 Years Experience

    AI / ML 2–5 Years Experience

    AAVIL Inc • Pune, IN
    AAVIL INC is Hiring Talented AI / ML Engineers!.Remote | 0–5 Years Experience | AI ML Agentic AI Expertise.We’re expanding our team and looking for passionate AI / ML Engineers who are ready to build t...Show more
    Last updated: 7 hours ago • Promoted • New!
    AI / ML Engineer

    AI / ML Engineer

    TransPerfect • pune, maharashtra, in
    We are seeking a Senior AI / ML Engineer to join our client’s AI team and contribute to the development of cutting-edge intelligent systems. In this role, you’ll be responsible for designing, training...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer - AI / ML

    Software Engineer - AI / ML

    Mindfire Solutions • Pune, IN
    As an AI / ML Engineer, you will be responsible for designing, validating, and integrating cutting-edge machine learning models and algorithms. Collaborate closely with cross-functional teams, includi...Show more
    Last updated: 12 days ago • Promoted
    Machine Learning Engineer-Agentic AI

    Machine Learning Engineer-Agentic AI

    Innodata Inc. • Pune, IN
    Design and implement multi-agent systems using LangChain, LangGraph, CrewAI, AutoGen or similar frameworks.Build A2A (agent-to-agent) orchestration and implement MCP (multi-context protocol) for co...Show more
    Last updated: 19 days ago • Promoted
    AI Developer - ML & AI Agents (3 to 9 Years)

    AI Developer - ML & AI Agents (3 to 9 Years)

    AIMLEAP • Pune, IN
    AI Developer - ML & AI Agents (3 to 9 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development. Strong Python programming background f...Show more
    Last updated: 5 days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Oracle • Pune, Maharashtra, India
    Job Location- Hyderabad / Bangalore / Pune / Noida.Join Oracle Applications Labs, where we design, build, and operate Oracle’s mission-critical AI-based enterprise applications—including systems that aut...Show more
    Last updated: 18 days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    MangoApps • Pune, India
    A modern work platform means a single source of truth for your desk and deskless employees alike, where everything they need is organized and easy to find. MangoApps was designed to unify your emplo...Show more
    Last updated: 30+ days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Synechron • Pune, Maharashtra, India
    AI-ML Engineers / Lead We are seeking an experienced AI-ML engineer / lead to design and implement intelligent, autonomous, and orchestrated AI systems that leverage LLMs, multi-agent frameworks, and ...Show more
    Last updated: 1 day ago • Promoted
    Principal RTL Design Engineer / Co-founder - AI / ML Accelerator

    Principal RTL Design Engineer / Co-founder - AI / ML Accelerator

    Faststream Technologies • Pune, IN
    Lead / Own a world class NPU for Edge AI Inference.Develop ultra-low-power machine learning chips for intelligent sensing and autonomous navigation. Architect / Work independently and collaborativel...Show more
    Last updated: 7 hours ago • Promoted • New!
    AI ML Engineer

    AI ML Engineer

    Futran Solutions • Pune, Maharashtra, India
    We're seeking an AI / ML Engineer to design, build, and deploy intelligent systems that leverage large language models, machine learning, and agentic AI architectures. You'll work at the intersection ...Show more
    Last updated: 5 days ago • Promoted