Talent.com
Ai Trainer - Qa Tester
Ai Trainer - Qa TesterMyRemoteTeam Inc • Jhārkhand, Republic Of India, IN
Ai Trainer - Qa Tester

Ai Trainer - Qa Tester

MyRemoteTeam Inc • Jhārkhand, Republic Of India, IN
2 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

email-sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Jhārkhand, Republic Of India, IN

    Related jobs
    API automation testing

    API automation testing

    Qodex - AI Agent for API Testing & Security • ranchi, India
    AI powered API testing and security platform.We are looking for a detail oriented and logically strong API Tester to work closely with our product and engineering teams. You will test REST and Graph...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Aem Tester

    Aem Tester

    People Prime Worldwide • Jhārkhand, Republic Of India, IN
    Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernization and ma...Show more
    Last updated: 1 day ago • Promoted
    Sap Cfin Functional Tester

    Sap Cfin Functional Tester

    Xsell Resources • Ranchi, Republic Of India, IN
    Seeking a Senior SAP Central Finance Functional Tester for our Fortune 5 Healthcare client in the US.You will work remotely from India during 2nd shift hours. Design and execute functional test case...Show more
    Last updated: 11 days ago • Promoted
    Qa Test Engineer / Azure - + 5 Years Exp - Full Remote - Contractor In Usd

    Qa Test Engineer / Azure - + 5 Years Exp - Full Remote - Contractor In Usd

    All European Careers • Jhārkhand, Republic Of India, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior QA Test Engineer with +5 years of experience. We are looking for a motivated contractor.Candidates need to b...Show more
    Last updated: 11 days ago • Promoted
    AI Model Tester

    AI Model Tester

    Recro • ranchi, jharkhand, in
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show more
    Last updated: 22 days ago • Promoted
    AEM Tester

    AEM Tester

    People Prime Worldwide • ranchi, jharkhand, in
    Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernization and ma...Show more
    Last updated: 1 day ago • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, Mumbai • ranchi, jharkhand, in
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 30+ days ago • Promoted
    Hybrid Mobile Test Automation QA Engineer - React Native- iOS App

    Hybrid Mobile Test Automation QA Engineer - React Native- iOS App

    TAMMIRA • ranchi, jharkhand, in
    Hybrid Mobile Test Automation QA Engineer – Contract Work – React Native iOS Mobile Application.We're seeking a part-time, freelance QA Automation Engineer with a strong background in React Native ...Show more
    Last updated: 9 days ago • Promoted
    SAP CFIN Functional Tester

    SAP CFIN Functional Tester

    Xsell Resources • ranchi, jharkhand, in
    Seeking a Senior SAP Central Finance Functional Tester for our Fortune 5 Healthcare client in the US.You will work remotely from India during 2nd shift hours. Design and execute functional test case...Show more
    Last updated: 11 days ago • Promoted
    Senior AI & Automation Specialist

    Senior AI & Automation Specialist

    Yamathos • ranchi, jharkhand, in
    Senior AI & Automation Specialist (N8N etc).Join Yamathos — a fast-moving AI consultancy helping companies automate smarter, not harder. If you’re passionate about AI, automation, and creative probl...Show more
    Last updated: 11 days ago • Promoted
    Mobile QA Automation Engineer

    Mobile QA Automation Engineer

    Applicantz • ranchi, jharkhand, in
    THIS IS A LONG CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADERS.Mobile Platform team in delivering high-quality, high-performing mobile app releases. In this role, you will lead...Show more
    Last updated: 1 day ago • Promoted
    Api Automation Testing

    Api Automation Testing

    Qodex - AI Agent for API Testing & Security • Jhārkhand, Republic Of India, IN
    Ai is an AI powered API testing and security platform.We are looking for a detail oriented and logically strong API Tester to work closely with our product and engineering teams.You will test REST ...Show more
    Last updated: 1 day ago • Promoted
    Quality Assurance Engineer - Ai

    Quality Assurance Engineer - Ai

    TerraFinn Technologies, Mumbai • Ranchi, Republic Of India, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 2 days ago • Promoted
    Mobile Qa Automation Engineer

    Mobile Qa Automation Engineer

    Applicantz • Jhārkhand, Republic Of India, IN
    THIS IS A LONG CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADERS.Mobile Platform team in delivering high-quality, high-performing mobile app releases. In this role, you will lead...Show more
    Last updated: 1 day ago • Promoted
    Power Bi Developer / Tester

    Power Bi Developer / Tester

    TWO95 International, Inc • Jhārkhand, Republic Of India, IN
    Title : Power BI Developer / Tester.Hands-on experience with Power BI Service testing and development.Strong SQL skills for data validation and troubleshooting. Proficiency in Excel for data analysis...Show more
    Last updated: 10 days ago • Promoted
    Penetration Tester

    Penetration Tester

    NTT DATA, Inc. • ranchi, jharkhand, in
    The Penetration Tester is a seasoned subject matter expert, responsible for assessing and evaluating the security posture of the company's information systems, networks, applications and infrastruc...Show more
    Last updated: 25 days ago • Promoted
    AI Trainer - QA Tester

    AI Trainer - QA Tester

    MyRemoteTeam Inc • ranchi, India
    AI Agent Evaluation Analyst Application Form.We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract).TAU (Tool–Agent–User) framework. AI agents perform in realistic, multi-step environme...Show more
    Last updated: 6 hours ago • Promoted • New!
    Ai Model Tester

    Ai Model Tester

    Recro • Jhārkhand, Republic Of India, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show more
    Last updated: 22 days ago • Promoted