Talent.com
Ai Trainer - Qa Tester
Ai Trainer - Qa TesterMyRemoteTeam Inc • Dehra Dūn, Republic Of India, IN
No longer accepting applications
Ai Trainer - Qa Tester

Ai Trainer - Qa Tester

MyRemoteTeam Inc • Dehra Dūn, Republic Of India, IN
4 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

email-sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Dehra Dūn, Republic Of India, IN

    Related jobs
    TOSCA Automation Testing

    TOSCA Automation Testing

    Tata Consultancy Services • dehradun, uttarakhand, in
    Greetings from TATA Consultancy Services.Skill : TOSCA Automation Testing.Current location : Anywhere In India.Pls find the Job Description below. Good Knowledge in Tosca Automation framework, TBOX ...Show more
    Last updated: 12 days ago • Promoted
    Prompt & AI / ML Engineer – Chatbot Voice Agent LLM & RAG

    Prompt & AI / ML Engineer – Chatbot Voice Agent LLM & RAG

    QuantumLoopAi • dehradun, uttarakhand, in
    Prompt & AI / ML Engineer – Chatbot LLM & RAGOverview.UK’s leading AI receptionist for GP practices.By combining cutting-edge Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), advan...Show more
    Last updated: 10 days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • dehradun, uttarakhand, in
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 13 days ago • Promoted
    SOX Business Controls Tester

    SOX Business Controls Tester

    VOIS • dehradun, uttarakhand, in
    Hiring SOX Business Controls Tester with Vodafone Intelligent Solutions (_VOIS).Required Qualification : CA / CMA.The Manager – SOX Compliance is responsible for the execution of SOX (Sarbanes-Oxley A...Show more
    Last updated: 22 days ago • Promoted
    Senior AI & Automation Specialist

    Senior AI & Automation Specialist

    Yamathos • dehradun, uttarakhand, in
    Senior AI & Automation Specialist (N8N etc).Join Yamathos — a fast-moving AI consultancy helping companies automate smarter, not harder. If you’re passionate about AI, automation, and creative probl...Show more
    Last updated: 13 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    RingCentral • dehradun, uttarakhand, in
    We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI.In this role, you will...Show more
    Last updated: 13 days ago • Promoted
    AI Engineer - Experience in building AI agents at scale and implementing robust AI evaluation - CTC INR 50 L

    AI Engineer - Experience in building AI agents at scale and implementing robust AI evaluation - CTC INR 50 L

    CareerXperts Consulting • dehradun, uttarakhand, in
    We are seeking a highly skilled and motivated AI Engineer with expertise in large language models (LLMs), AI workflows, and machine learning. This role combines deep technical knowledge in ML / AI wit...Show more
    Last updated: 18 hours ago • Promoted • New!
    Stem Rater - Gen AI

    Stem Rater - Gen AI

    Aceolution India • dehradun, uttarakhand, in
    As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your prima...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior Automation Test Engineer

    Senior Automation Test Engineer

    Scilife • dehradun, uttarakhand, in
    We are a SaaS company specializing in innovative quality management systems (QMS) tailored for the life sciences sector.Our mission is to ensure compliance, enhance quality processes, and improve o...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior Quality Assurance Automation Engineer

    Senior Quality Assurance Automation Engineer

    Concentrix • dehradun, uttarakhand, in
    Title : • • Senior Automation Tester.Department : • • Software Testing.Must have a minimum of 5 years of experience in development and execution of automation test frameworks. Data-driven, Keyword-driven ...Show more
    Last updated: 12 days ago • Promoted
    Test Lead

    Test Lead

    Indium • dehradun, uttarakhand, in
    We are looking for a 10+ years skilled Senior Test Lead with strong expertise in.Should be capable of translating business requirements into effective test scenarios, collaborating closely with sta...Show more
    Last updated: 13 days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Ironbook AI • dehradun, uttarakhand, in
    Job Description : AI Engineer (AWS AI Stack).We are looking for a highly skilled.You will design, build, and deploy AI systems, collaborate with cross-functional teams, and contribute to scalable, p...Show more
    Last updated: 11 days ago • Promoted
    Software Tester

    Software Tester

    SAI • dehradun, uttarakhand, in
    SAI is an innovative platform that leverages machine vision AI technology to enhance existing CCTV systems, helping retailers prevent theft, reclaim lost sales, and boost operational efficiency.By ...Show more
    Last updated: 10 hours ago • Promoted • New!
    Product Manager (Generative AI)

    Product Manager (Generative AI)

    HT Digital Streams • dehradun, uttarakhand, in
    AI can shape user experiences — and the technical ability to build and test ideas independently.You will translate business goals into AI-powered workflows and products, building working prototypes...Show more
    Last updated: 13 days ago • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmind • dehradun, uttarakhand, in
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show more
    Last updated: 10 hours ago • Promoted • New!
    Expert Rater – AI Model Evaluation & Code Quality

    Expert Rater – AI Model Evaluation & Code Quality

    MyRemoteTeam Inc • dehradun, uttarakhand, in
    Expert Rater – AI Model Evaluation & Code Quality.Fill up this form- https : / / forms.We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, deb...Show more
    Last updated: 10 hours ago • Promoted • New!
    Test Manager (SAS Testing)

    Test Manager (SAS Testing)

    EXL • dehradun, uttarakhand, in
    Excel-based validation templates and reporting.Support go-live readiness through.Excellent analytical, communication, and problem-solving skills.Show more
    Last updated: 11 days ago • Promoted
    AI Automation Engineer

    AI Automation Engineer

    Vagaro • dehradun, uttarakhand, in
    Develop and deploy AI-driven automation workflows and chatbots integrated into existing applications to improve efficiency and user experience. Design and implement AI-based automation using Python,...Show more
    Last updated: 10 days ago • Promoted