Talent.com
AI Trainer - QA Tester
AI Trainer - QA TesterMyRemoteTeam Inc • ranchi, jharkhand, in
AI Trainer - QA Tester

AI Trainer - QA Tester

MyRemoteTeam Inc • ranchi, jharkhand, in
1 day ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • ranchi, jharkhand, in

    Related jobs
    AI Data Trainer

    AI Data Trainer

    Innodata Inc. • ranchi, jharkhand, in
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show more
    Last updated: 10 hours ago • Promoted • New!
    Applied AI Engineer (Contract-to-Hire)

    Applied AI Engineer (Contract-to-Hire)

    Adspirer • ranchi, jharkhand, in
    Adspirer is redefining marketing automation with its autonomous marketing agent, capable of independently executing tasks ranging from research to campaign creation and optimization without any sup...Show more
    Last updated: 5 days ago • Promoted
    AI Agent Architect

    AI Agent Architect

    Luxoft • ranchi, jharkhand, in
    We are seeking a hands-on and qualified AI Agent Architect to design and deploy advanced Agentic AI systems—comprising task-specific autonomous tools governed by a master agent—to support complex t...Show more
    Last updated: 4 days ago • Promoted
    AI Engineer

    AI Engineer

    QX Labs • ranchi, jharkhand, in
    QX Labs is looking for a full stack AI engineer with a strong software background to join our expanding team of AI experts. We are an early-stage London-based startup building cutting-edge workflow ...Show more
    Last updated: 23 days ago • Promoted
    AI Model Tester

    AI Model Tester

    Recro • ranchi, jharkhand, in
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show more
    Last updated: 21 days ago • Promoted
    Generative AI Architect- Customer Experience -Trainer Role

    Generative AI Architect- Customer Experience -Trainer Role

    Patch the Skill • ranchi, jharkhand, in
    The ideal candidate will be a qualified architect who is able to construct clear diagrams using AutoCAD.This candidate should have an in-depth knowledge of all steps related to project completion a...Show more
    Last updated: 10 hours ago • Promoted • New!
    AEM Tester

    AEM Tester

    People Prime Worldwide • ranchi, jharkhand, in
    Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernization and ma...Show more
    Last updated: 10 hours ago • Promoted • New!
    AI Engineer

    AI Engineer

    Sutra.AI • ranchi, jharkhand, in
    Our mission is to help enterprises transform raw data into intelligent, actionable insights through AI, automation, and decision intelligence. The ideal candidate is hands-on, detail-oriented, and t...Show more
    Last updated: 2 days ago • Promoted
    Ai Trainer - Qa Tester

    Ai Trainer - Qa Tester

    MyRemoteTeam Inc • Jhārkhand, Republic Of India, IN
    AI Agent Evaluation Analyst Application Form.We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract).TAU (Tool–Agent–User) framework. AI agents perform in realistic, multi-step environme...Show more
    Last updated: 1 day ago • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, Mumbai • ranchi, jharkhand, in
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 30+ days ago • Promoted
    Artificial Intelligence Intern

    Artificial Intelligence Intern

    Teqrox® • ranchi, jharkhand, in
    Teqrox is a forward-thinking management consultancy and technology solutions company.We combine consulting expertise with AI-driven innovation to deliver scalable, intelligent solutions for .We’re ...Show more
    Last updated: 10 days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • ranchi, jharkhand, in
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 10 days ago • Promoted
    AI Architect

    AI Architect

    Persistent Systems • ranchi, jharkhand, in
    We are seeking a highly skilled and innovative Agentic AI Developer to architect and implement intelligent, autonomous AI workflows and backend systems. This role is ideal for someone passionate abo...Show more
    Last updated: 25 days ago • Promoted
    AI ML Engineer– Sartech Labs (Remote / Hybrid)

    AI ML Engineer– Sartech Labs (Remote / Hybrid)

    SARTECH Labs • ranchi, jharkhand, in
    Remote
    At Sartech Labs, we are on a mission to make Artificial Intelligence safe, responsible, and accessible for everyone.We build cutting-edge AI solutions (like RAG systems and AI Agents), run an AI Ed...Show more
    Last updated: 10 hours ago • Promoted • New!
    Intern-AI(ChatGPT models)

    Intern-AI(ChatGPT models)

    greytHR • ranchi, jharkhand, in
    We are looking for a motivated and technically skilled.This role is ideal for someone passionate about AI, conversational design, and prompt engineering. The intern’s day-to-day responsibilities inc...Show more
    Last updated: 10 hours ago • Promoted • New!
    Penetration Tester

    Penetration Tester

    NTT DATA, Inc. • ranchi, jharkhand, in
    The Penetration Tester is a seasoned subject matter expert, responsible for assessing and evaluating the security posture of the company's information systems, networks, applications and infrastruc...Show more
    Last updated: 24 days ago • Promoted
    Mobile QA Automation Engineer

    Mobile QA Automation Engineer

    Applicantz • ranchi, jharkhand, in
    THIS IS A LONG CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADERS.Mobile Platform team in delivering high-quality, high-performing mobile app releases. In this role, you will lead...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    RingCentral • ranchi, jharkhand, in
    We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI.In this role, you will...Show more
    Last updated: 10 days ago • Promoted