Talent.com
No longer accepting applications
AI Trainer - QA Tester

AI Trainer - QA Tester

MyRemoteTeam IncDelhi, IN
9 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Delhi, IN

    Related jobs
    • Promoted
    Instructor- Artificial Intelligence

    Instructor- Artificial Intelligence

    AccredianDelhi, IN
    We’re looking for a passionate and experienced.This is an exciting opportunity for professionals who enjoy teaching, mentoring, and making complex AI concepts accessible and relevant to business co...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Trainer

    Technical Trainer

    Amity University, NoidaNoida, Uttar Pradesh, India
    Technical Proficiency Required in SME / Tech Trainers at the University Level : - Strong command of programming languages : Proficient in languages like Python, Java, C++, or JavaScript, depending on...Show moreLast updated: 17 days ago
    • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, MumbaiDelhi, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Trainer

    Technical Trainer

    Talent Corner HR Services Pvt LtdDelhi, India
    Role #1 : Trainer - Data Science with AI.Role #2 : Trainer - Machine Learning with AI.Open Positions : 4 + 4 respectively. Job Type : Full Time & Permanent.The Trainer in Data Science with AI will be re...Show moreLast updated: 17 days ago
    • Promoted
    AI Data Trainer

    AI Data Trainer

    Innodata Inc.Ghaziabad, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show moreLast updated: 8 days ago
    • Promoted
    AI Healthcare Trainer

    AI Healthcare Trainer

    VoiceCare AIDelhi, India
    Voicecare AI is a Healthcare Administration General Intelligence company specializing in Revenue Cycle Management (RCM) and back-office automation. Our mission is to improve access, adherence, and o...Show moreLast updated: 2 days ago
    • Promoted
    AI Agent Architect

    AI Agent Architect

    LuxoftDelhi, IN
    We are seeking a hands-on and qualified AI Agent Architect to design and deploy advanced Agentic AI systems—comprising task-specific autonomous tools governed by a master agent—to support complex t...Show moreLast updated: 12 days ago
    • Promoted
    Healthcare Specialist (AI Training)

    Healthcare Specialist (AI Training)

    Taskify AIDelhi, Delhi, India
    We're Hiring Healthcare Specialist For AI Training (Remote) | Earn Between $5,000 - $8,000 / Month About the Role : Are you a medical professional with a passion for advancing AI? We are seeking medi...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    AI Engineer

    AI Engineer

    AsiteDelhi, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show moreLast updated: 21 hours ago
    • Promoted
    Technical Trainer

    Technical Trainer

    Sustainable Living Lab (SL2)Ghaziabad, IN
    Location : Delhi or Bangalore (Hybrid).The trainer will primarily conduct sessions on.The candidate should have experience delivering sessions in both. The selected candidate should be open to.As a T...Show moreLast updated: 1 day ago
    • Promoted
    AI Model Tester

    AI Model Tester

    RecroDelhi, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show moreLast updated: 29 days ago
    • Promoted
    • New!
    AI Engineer

    AI Engineer

    Tensor PilotDelhi, Delhi, India
    Company Description Tensor Pilot, through its flagship product Tensor AI, provides a sophisticated desktop-based AI assistant for interacting with local files such as code, documents, images, and ...Show moreLast updated: 14 hours ago
    • Promoted
    AI Developer - ML & AI Agents (3 to 9 Years)

    AI Developer - ML & AI Agents (3 to 9 Years)

    AIMLEAPDelhi, IN
    AI Developer - ML & AI Agents (3 to 9 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development. Strong Python programming background f...Show moreLast updated: 4 days ago
    • Promoted
    • New!
    Automation Tester with Gen AI

    Automation Tester with Gen AI

    ShepHertz TechnologiesGurugram, Haryana, India
    We are currently seeking an experienced Automation Testing professional with a strong background in Gen AI for our dynamic team at ShepHertz. This role is pivotal in ensuring the highest quality of ...Show moreLast updated: 11 hours ago
    • Promoted
    LLM Trainer

    LLM Trainer

    Insight GlobalDelhi, IN
    Insight Global Client is developing a computer usage dataset to train intelligent systems that understand how users interact with software applications. LLM Trainer (Computer Usage Data Collection)....Show moreLast updated: 2 days ago
    • Promoted
    Technical Trainer

    Technical Trainer

    NIITGhaziabad, IN
    At NIIT, we’re transforming the way the world learns, for the better.That’s why the world’s best-run learning functions across 30 countries trust us with their learning and talent.Since 1981, we ha...Show moreLast updated: 1 day ago
    • Promoted
    Product Trainer

    Product Trainer

    HRipple SolutionsDelhi, India
    We are a global leader in digital cinema solutions, with over 25 years of first-to-market innovation.We deliver a full suite of digital cinema products and services 3D solutions, immersive audio eq...Show moreLast updated: 2 days ago
    • Promoted
    Stem Rater - Gen AI

    Stem Rater - Gen AI

    Aceolution IndiaGhaziabad, IN
    As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your prima...Show moreLast updated: 5 days ago