Talent.com
AI Trainer - QA Tester
AI Trainer - QA TesterMyRemoteTeam Inc • Junagadh, IN
No longer accepting applications
AI Trainer - QA Tester

AI Trainer - QA Tester

MyRemoteTeam Inc • Junagadh, IN
4 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Junagadh, IN

    Related jobs
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • Junagadh, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 13 days ago • Promoted
    Subject Matter Expert - AI trainer

    Subject Matter Expert - AI trainer

    MyRemoteTeam Inc • junagadh, gujarat, in
    Team Lead for STEM Data (Math, Physics, Chemistry, Biology).Fill up this form - https : / / forms.We’re Hiring : Team Lead – STEM (Math, Physics, Chemistry, Biology). Are you a STEM expert who loves blen...Show more
    Last updated: 13 days ago • Promoted
    Generative AI Architect- Customer Experience -Trainer Role

    Generative AI Architect- Customer Experience -Trainer Role

    Patch the Skill • Junagadh, IN
    The ideal candidate will be a qualified architect who is able to construct clear diagrams using AutoCAD.This candidate should have an in-depth knowledge of all steps related to project completion a...Show more
    Last updated: 3 days ago • Promoted
    Artificial Intelligence Intern

    Artificial Intelligence Intern

    Teqrox® • Junagadh, IN
    Teqrox is a forward-thinking management consultancy and technology solutions company.We combine consulting expertise with AI-driven innovation to deliver scalable, intelligent solutions for .We’re ...Show more
    Last updated: 13 days ago • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, Mumbai • Junagadh, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 30+ days ago • Promoted
    AI Agent Architect

    AI Agent Architect

    Luxoft • Junagadh, IN
    We are seeking a hands-on and qualified AI Agent Architect to design and deploy advanced Agentic AI systems—comprising task-specific autonomous tools governed by a master agent—to support complex t...Show more
    Last updated: 7 days ago • Promoted
    Software Tester

    Software Tester

    SAI • Junagadh, IN
    SAI is an innovative platform that leverages machine vision AI technology to enhance existing CCTV systems, helping retailers prevent theft, reclaim lost sales, and boost operational efficiency.By ...Show more
    Last updated: 12 hours ago • Promoted • New!
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Cloud 9 Solutions, LLC • Junagadh, IN
    Should have experience in building.Having knowledge in Microsoft Copilot studio is an advantage.Type : Fulltime (40 hours per week). AI / ML architecture, with at least 3 years focused on enterprise-le...Show more
    Last updated: 30+ days ago • Promoted
    AI Model Tester

    AI Model Tester

    Recro • Junagadh, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show more
    Last updated: 24 days ago • Promoted
    Expert Rater – AI Model Evaluation & Code Quality

    Expert Rater – AI Model Evaluation & Code Quality

    MyRemoteTeam Inc • Junagadh, IN
    Expert Rater – AI Model Evaluation & Code Quality.Fill up this form- https : / / forms.We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, deb...Show more
    Last updated: 12 hours ago • Promoted • New!
    ADP Tester

    ADP Tester

    Aptonet • Junagadh, IN
    ADP Tester supporting Workday-to-ADP (GlobalView / Workforce Now) payroll transformation.Test payroll processing, data mapping, and integrations. Validate inbound / outbound files between Workday and ...Show more
    Last updated: 3 days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Junagadh, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 7 days ago • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmind • Junagadh, IN
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show more
    Last updated: 12 hours ago • Promoted • New!
    AI Data Trainer

    AI Data Trainer

    Innodata Inc. • Junagadh, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show more
    Last updated: 3 days ago • Promoted
    Stem Rater - Gen AI

    Stem Rater - Gen AI

    Aceolution India • Junagadh, IN
    As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your prima...Show more
    Last updated: 12 hours ago • Promoted • New!
    AI Engineer

    AI Engineer

    Sutra.AI • Junagadh, IN
    Our mission is to help enterprises transform raw data into intelligent, actionable insights through AI, automation, and decision intelligence. The ideal candidate is hands-on, detail-oriented, and t...Show more
    Last updated: 5 days ago • Promoted
    SOX Business Controls Tester

    SOX Business Controls Tester

    VOIS • Junagadh, IN
    Hiring SOX Business Controls Tester with Vodafone Intelligent Solutions (_VOIS).Required Qualification : CA / CMA.The Manager – SOX Compliance is responsible for the execution of SOX (Sarbanes-Oxley A...Show more
    Last updated: 22 days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Ironbook AI • Junagadh, IN
    Job Description : AI Engineer (AWS AI Stack).We are looking for a highly skilled.You will design, build, and deploy AI systems, collaborate with cross-functional teams, and contribute to scalable, p...Show more
    Last updated: 11 days ago • Promoted