Talent.com
No longer accepting applications
AI Trainer - QA Tester

AI Trainer - QA Tester

MyRemoteTeam IncHyderabad, IN
9 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Hyderabad, IN

    Related jobs
    • Promoted
    GEN AI Instructor

    GEN AI Instructor

    NxtWaveHyderabad, Telangana, India
    We are seeking an experienced and passionate.The ideal candidate will have 1-3 years of technical experience in.This role is critical in bridging the gap between foundational AI / ML knowledge and pr...Show moreLast updated: 30+ days ago
    • Promoted
    AI Model Tester

    AI Model Tester

    RecroHyderabad, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show moreLast updated: 29 days ago
    • Promoted
    Product Testing

    Product Testing

    Akron IntelHyderabad, Republic Of India, IN
    Capital Markets Product QA Analyst (EMEA Shift) - Hyd / Blr / Chennai.Capital Markets Product QA Analyst.Hyderabad, Bangalore, or Chennai. This is a critical role focused on.Core Product / Model Office Te...Show moreLast updated: 18 days ago
    • Promoted
    LLM Trainer

    LLM Trainer

    Insight GlobalHyderabad, IN
    Insight Global Client is developing a computer usage dataset to train intelligent systems that understand how users interact with software applications. LLM Trainer (Computer Usage Data Collection)....Show moreLast updated: 2 days ago
    • Promoted
    Instructor- Artificial Intelligence

    Instructor- Artificial Intelligence

    AccredianHyderabad, IN
    We’re looking for a passionate and experienced.This is an exciting opportunity for professionals who enjoy teaching, mentoring, and making complex AI concepts accessible and relevant to business co...Show moreLast updated: 30+ days ago
    • Promoted
    Gen Ai Instructor

    Gen Ai Instructor

    NxtWaveHyderabad, Republic Of India, IN
    We are seeking an experienced and passionate.The ideal candidate will have 1-3 years of technical experience in.This role is critical in bridging the gap between foundational AI / ML knowledge and pr...Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Tester - Automation Testing

    Generative AI Tester - Automation Testing

    BB WorksHyderabad
    Role Overview : We are seeking a highly skilled Gen AI Tester to design and execute test strategies that ensure the quality, reliability, and accuracy of AI-driven ap...Show moreLast updated: 30+ days ago
    • Promoted
    AI Data Trainer

    AI Data Trainer

    Innodata Inc.Hyderabad, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show moreLast updated: 8 days ago
    • Promoted
    Gen AI Instructor

    Gen AI Instructor

    NxtWaveHyderabad, Telangana, India
    We are seeking an experienced and passionate.The ideal candidate will have 1-3 years of technical experience in.This role is critical in bridging the gap between foundational AI / ML knowledge and pr...Show moreLast updated: 30+ days ago
    • Promoted
    Consultant (AI Trainer)

    Consultant (AI Trainer)

    ConfidentialHyderabad / Secunderabad, Telangana
    Soul AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI...Show moreLast updated: 30+ days ago
    • Promoted
    AI QA

    AI QA

    Intellistaff Services Pvt. LtdHyderabad, Telangana, India
    Role : AI-QA Experience : 7+ years Location : Pan India Fulltime - Hybrid Key Skills The candidate should have : • Min 7+ years of experience in software quality engineering & assurance.Min 3+ ye...Show moreLast updated: 2 days ago
    • Promoted
    AI Trainer : BBA

    AI Trainer : BBA

    ConfidentialHyderabad / Secunderabad, Telangana
    Create, review, and refine questions and answers related to core BBA subjects (Eg- Management, Marketing, HR, Business Law, Organizational Behavior). Analyze AI-generated responses for relevance, bu...Show moreLast updated: 30+ days ago
    • Promoted
    QA Automation Tester

    QA Automation Tester

    Brace Infotech Private LtdHyderabad, Telangana, India
    Exp - 9+ years & 6+years into Selenium.Notice period - Immediate to 15 days.Interview Mode - 1st Level virtual and 2nd level is In-person. Developing and maintaining automated test scripts using tes...Show moreLast updated: 30+ days ago
    • Promoted
    Technical Trainer

    Technical Trainer

    NIITsecunderabad, India
    At NIIT, we’re transforming the way the world learns, for the better.That’s why the world’s best-run learning functions across 30 countries trust us with their learning and talent.Since 1981, we ha...Show moreLast updated: 1 day ago
    • Promoted
    Technical Trainer

    Technical Trainer

    Sustainable Living Lab (SL2)Hyderabad, IN
    Location : Delhi or Bangalore (Hybrid).The trainer will primarily conduct sessions on.The candidate should have experience delivering sessions in both. The selected candidate should be open to.As a T...Show moreLast updated: 1 day ago
    • Promoted
    Gen-AI Trainer

    Gen-AI Trainer

    NxtWaveHyderabad, Telangana, India
    Technical Instructor - Digital Content.We’re on a mission to create the next million software engineers!.India's fastest-growing Ed-Tech startups. NxtWave is revolutionizing the 21st-century job mar...Show moreLast updated: 30+ days ago
    • Promoted
    AI & Machine Learning Corporate Trainer

    AI & Machine Learning Corporate Trainer

    BOT Campus AIHyderabad, Telangana, India
    Location : India / UAE (Remote + Onsite as required).Engagement : Contract / Part-Time.BotCampus AI is an AI Upskilling Platform operating across India, UAE, Qatar, Bahrain, and Saudi Arabia.We deliv...Show moreLast updated: 3 days ago
    • Promoted
    Ai & Machine Learning Corporate Trainer

    Ai & Machine Learning Corporate Trainer

    BOT Campus AIHyderabad, Republic Of India, IN
    Location : India / UAE (Remote + Onsite as required).Engagement : Contract / Part-Time.BotCampus AI is an AI Upskilling Platform operating across India, UAE, Qatar, Bahrain, and Saudi Arabia.We deliv...Show moreLast updated: 3 days ago