Talent.com
AI Trainer - QA Tester
AI Trainer - QA TesterMyRemoteTeam Inc • Vellore, IN
No longer accepting applications
AI Trainer - QA Tester

AI Trainer - QA Tester

MyRemoteTeam Inc • Vellore, IN
5 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Vellore, IN

    Related jobs
    Senior QA Automation Tester (Playwright + TypeScript)

    Senior QA Automation Tester (Playwright + TypeScript)

    Aveosoft Pvt Ltd • Vellore, IN
    Senior QA Automation Tester (Playwright + TypeScript).Aveosoft Pvt Ltd is seeking a highly skilled Senior QA Automation Tester with strong hands-on experience in Playwright (TypeScript) for UI and ...Show more
    Last updated: 11 hours ago • Promoted • New!
    Automation Tester

    Automation Tester

    Edstruments • Vellore, IN
    We are seeking a detail-oriented and proactive Automation Tester with at least 2 years of hands-on experience in designing and executing automated test scripts. The ideal candidate will play a key r...Show more
    Last updated: 11 hours ago • Promoted • New!
    Hybrid Tester

    Hybrid Tester

    HR PLACEMENT CONSULTANTS (HRPC) • Vellore, IN
    Qualifications Educational - B.Sc / BCA / MCA – IT or Computer Science.Domain / Vertical - Insurance and / or Finance (preferred). Automation testing using TOSCA.Effective and consistent service delivery ...Show more
    Last updated: 11 hours ago • Promoted • New!
    Instructor- Artificial Intelligence

    Instructor- Artificial Intelligence

    Accredian • Vellore, IN
    We’re looking for a passionate and experienced.This is an exciting opportunity for professionals who enjoy teaching, mentoring, and making complex AI concepts accessible and relevant to business co...Show more
    Last updated: 30+ days ago • Promoted
    AI Integration Engineer

    AI Integration Engineer

    NowWiN International • Vellore, IN
    Job Title : AI Integration Engineer.Job Type : Full-time / Contract.Joiners : Immediate or short notice preferred.AI Integration Engineers (2 Positions). Integrate open-source AI models (Hugging Face, ...Show more
    Last updated: 11 hours ago • Promoted • New!
    SOX Business Controls Tester

    SOX Business Controls Tester

    VOIS • Vellore, IN
    Hiring SOX Business Controls Tester with Vodafone Intelligent Solutions (_VOIS).Required Qualification : CA / CMA.The Manager – SOX Compliance is responsible for the execution of SOX (Sarbanes-Oxley A...Show more
    Last updated: 23 days ago • Promoted
    AI Data Trainer

    AI Data Trainer

    Innodata Inc. • Vellore, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show more
    Last updated: 4 days ago • Promoted
    Expert Rater – AI Model Evaluation & Code Quality

    Expert Rater – AI Model Evaluation & Code Quality

    MyRemoteTeam Inc • Vellore, IN
    Expert Rater – AI Model Evaluation & Code Quality.Fill up this form- https : / / forms.We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, deb...Show more
    Last updated: 1 day ago • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, Mumbai • Vellore, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 30+ days ago • Promoted
    Stem Rater - Gen AI

    Stem Rater - Gen AI

    Aceolution India • Vellore, IN
    As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your prima...Show more
    Last updated: 1 day ago • Promoted
    Agentic AI & n8n Automation Expert

    Agentic AI & n8n Automation Expert

    Dentalkart • Vellore, IN
    Agentic AI & n8n Automation Expert.The ideal candidate must have strong experience in automation tools, API integrations, and building multi-step automated processes. Build advanced n8n workflows, i...Show more
    Last updated: 11 hours ago • Promoted • New!
    AI Model Tester

    AI Model Tester

    Recro • Vellore, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show more
    Last updated: 25 days ago • Promoted
    AI Developer - ML & AI Agents (3 to 9 Years)

    AI Developer - ML & AI Agents (3 to 9 Years)

    AIMLEAP • Vellore, IN
    AI Developer - ML & AI Agents (3 to 9 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development. Strong Python programming background f...Show more
    Last updated: 11 hours ago • Promoted • New!
    AI / ML Engineer

    AI / ML Engineer

    Reqpedia • Vellore, IN
    Proficiency in enterprise-approved AI tools as part of their day-to-day responsibilities.This includes, but is not limited to : . Consistent Use : Maintain a minimum of 90% weekly usage of AI tools suc...Show more
    Last updated: 11 hours ago • Promoted • New!
    Generative AI Architect- Customer Experience -Trainer Role

    Generative AI Architect- Customer Experience -Trainer Role

    Patch the Skill • Vellore, IN
    The ideal candidate will be a qualified architect who is able to construct clear diagrams using AutoCAD.This candidate should have an in-depth knowledge of all steps related to project completion a...Show more
    Last updated: 4 days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • Vellore, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 14 days ago • Promoted
    Director – QA & Testing (AI / Data CoE)

    Director – QA & Testing (AI / Data CoE)

    Futuristic Underwriters Pvt Ltd • Vellore, IN
    About Futuristic Underwriters Pvt.We are a business transformation center dedicated to achieving efficient underwriting operations, utilizing its artificial intelligence capabilities, and further a...Show more
    Last updated: 11 hours ago • Promoted • New!
    ETL Tester

    ETL Tester

    Tesslogs IT Solutions • Vellore, IN
    We are looking for an experienced.The ideal candidate should have solid experience in validating data pipelines, performing data quality checks, and ensuring end-to-end data accuracy across cloud-b...Show more
    Last updated: 6 days ago • Promoted