Talent.com
AI Trainer - QA Tester
AI Trainer - QA TesterMyRemoteTeam Inc • Meerut, IN
No longer accepting applications
AI Trainer - QA Tester

AI Trainer - QA Tester

MyRemoteTeam Inc • Meerut, IN
4 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Meerut, IN

    Related jobs
    Subject Matter Expert - AI trainer

    Subject Matter Expert - AI trainer

    MyRemoteTeam Inc • meerut, uttar pradesh, in
    Team Lead for STEM Data (Math, Physics, Chemistry, Biology).Fill up this form - https : / / forms.We’re Hiring : Team Lead – STEM (Math, Physics, Chemistry, Biology). Are you a STEM expert who loves blen...Show more
    Last updated: 13 days ago • Promoted
    SOX Business Controls Tester

    SOX Business Controls Tester

    VOIS • Meerut, IN
    Hiring SOX Business Controls Tester with Vodafone Intelligent Solutions (_VOIS).Required Qualification : CA / CMA.The Manager – SOX Compliance is responsible for the execution of SOX (Sarbanes-Oxley A...Show more
    Last updated: 22 days ago • Promoted
    Senior AI & Automation Specialist

    Senior AI & Automation Specialist

    Yamathos • meerut, uttar pradesh, in
    Senior AI & Automation Specialist (N8N etc).Join Yamathos — a fast-moving AI consultancy helping companies automate smarter, not harder. If you’re passionate about AI, automation, and creative probl...Show more
    Last updated: 14 days ago • Promoted
    AI Model Tester

    AI Model Tester

    Recro • Meerut, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show more
    Last updated: 25 days ago • Promoted
    Generative AI Architect- Customer Experience -Trainer Role

    Generative AI Architect- Customer Experience -Trainer Role

    Patch the Skill • Meerut, IN
    The ideal candidate will be a qualified architect who is able to construct clear diagrams using AutoCAD.This candidate should have an in-depth knowledge of all steps related to project completion a...Show more
    Last updated: 3 days ago • Promoted
    AI Data Trainer

    AI Data Trainer

    Innodata Inc. • Meerut, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show more
    Last updated: 3 days ago • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, Mumbai • Ghaziabad, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 30+ days ago • Promoted
    AI Solutions Trainer

    AI Solutions Trainer

    AIONOS • Noida, Republic Of India, IN
    Artificial Intelligence on Operating Systems.AIonOS is pioneering the shift towards building AI-Native enterprises.Our proprietary Products and Solutions seamlessly integrate AI into core business ...Show more
    Last updated: 5 days ago • Promoted
    Software Tester

    Software Tester

    SAI • ghaziabad, uttar pradesh, in
    SAI is an innovative platform that leverages machine vision AI technology to enhance existing CCTV systems, helping retailers prevent theft, reclaim lost sales, and boost operational efficiency.By ...Show more
    Last updated: 16 hours ago • Promoted • New!
    AI Trainer

    AI Trainer

    MyRemoteTeam Inc • Delhi, Delhi, India
    About Us MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operat...Show more
    Last updated: 4 days ago • Promoted
    Trainer – No-Code AI & Machine Learning

    Trainer – No-Code AI & Machine Learning

    MyAnatomy Integration • New Delhi, Delhi, India
    We are seeking a highly motivated and knowledgeable No-Code AI & Machine Learning Trainer to deliver a practical, hands-on program that enables students to design, build, and deploy AI / ML solutions...Show more
    Last updated: 30+ days ago • Promoted
    Expert Rater – AI Model Evaluation & Code Quality

    Expert Rater – AI Model Evaluation & Code Quality

    MyRemoteTeam Inc • Meerut, IN
    Expert Rater – AI Model Evaluation & Code Quality.Fill up this form- https : / / forms.We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, deb...Show more
    Last updated: 20 hours ago • Promoted • New!
    ADP Tester

    ADP Tester

    Aptonet • Meerut, IN
    ADP Tester supporting Workday-to-ADP (GlobalView / Workforce Now) payroll transformation.Test payroll processing, data mapping, and integrations. Validate inbound / outbound files between Workday and ...Show more
    Last updated: 3 days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Meerut, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 7 days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • Meerut, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 14 days ago • Promoted
    Stem Rater - Gen AI

    Stem Rater - Gen AI

    Aceolution India • Meerut, IN
    As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your prima...Show more
    Last updated: 20 hours ago • Promoted • New!
    AI Agent Architect

    AI Agent Architect

    Luxoft • Meerut, IN
    We are seeking a hands-on and qualified AI Agent Architect to design and deploy advanced Agentic AI systems—comprising task-specific autonomous tools governed by a master agent—to support complex t...Show more
    Last updated: 7 days ago • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmind • Meerut, IN
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show more
    Last updated: 20 hours ago • Promoted • New!