Talent.com
Ai Trainer - Qa Tester
Ai Trainer - Qa TesterMyRemoteTeam Inc • Vijayawada, Republic Of India, IN
No longer accepting applications
Ai Trainer - Qa Tester

Ai Trainer - Qa Tester

MyRemoteTeam Inc • Vijayawada, Republic Of India, IN
3 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

email-sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Vijayawada, Republic Of India, IN

    Related jobs
    AI Model Tester

    AI Model Tester

    Recro • Eluru, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show more
    Last updated: 24 days ago • Promoted
    SOX Business Controls Tester

    SOX Business Controls Tester

    VOIS • Vijayawada, IN
    Hiring SOX Business Controls Tester with Vodafone Intelligent Solutions (_VOIS).Required Qualification : CA / CMA.The Manager – SOX Compliance is responsible for the execution of SOX (Sarbanes-Oxley A...Show more
    Last updated: 22 days ago • Promoted
    Generative AI Architect- Customer Experience -Trainer Role

    Generative AI Architect- Customer Experience -Trainer Role

    Patch the Skill • Guntur, IN
    The ideal candidate will be a qualified architect who is able to construct clear diagrams using AutoCAD.This candidate should have an in-depth knowledge of all steps related to project completion a...Show more
    Last updated: 3 days ago • Promoted
    Test Automation API and UI Specialist

    Test Automation API and UI Specialist

    Zitrominds • Guntur, IN
    Creation and implementation of BDD test scenarios based on business requirements.Adding automation layer for the BDD tests that contribute to the Regression Suite. Carrying out test runs and perform...Show more
    Last updated: 30+ days ago • Promoted
    AI Data Trainer

    AI Data Trainer

    Innodata Inc. • Guntur, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show more
    Last updated: 3 days ago • Promoted
    SAP SuccessFactorsHCM Testing Manager

    SAP SuccessFactorsHCM Testing Manager

    MAK Technologies LLC • Eluru, IN
    SAP SuccessFactors HCM Testing Manager.Support HR and IT teams in writing test cases.Support with running end-to-end test scripts. Document test results, using templates / frameworks of the project.Dr...Show more
    Last updated: 5 days ago • Promoted
    Lead QA Test Automation Engineer SDET

    Lead QA Test Automation Engineer SDET

    OmniReach • Vijayawada, IN
    We are looking for 8+ years experience Lead QA Automation Engineers (Engineering background mandatory.Ability to interact with Customer. This is a full-time remote role for a Lead QA Test Automatio...Show more
    Last updated: 7 days ago • Promoted
    TOSCA Automation Testing

    TOSCA Automation Testing

    Tata Consultancy Services • guntur, andhra pradesh, in
    Greetings from TATA Consultancy Services.Skill : TOSCA Automation Testing.Current location : Anywhere In India.Pls find the Job Description below. Good Knowledge in Tosca Automation framework, TBOX ...Show more
    Last updated: 12 days ago • Promoted
    ADP Tester

    ADP Tester

    Aptonet • Eluru, IN
    ADP Tester supporting Workday-to-ADP (GlobalView / Workforce Now) payroll transformation.Test payroll processing, data mapping, and integrations. Validate inbound / outbound files between Workday and ...Show more
    Last updated: 3 days ago • Promoted
    Subject Matter Expert - AI trainer

    Subject Matter Expert - AI trainer

    MyRemoteTeam Inc • vijayawada, andhra pradesh, in
    Team Lead for STEM Data (Math, Physics, Chemistry, Biology).Fill up this form - https : / / forms.We’re Hiring : Team Lead – STEM (Math, Physics, Chemistry, Biology). Are you a STEM expert who loves blen...Show more
    Last updated: 13 days ago • Promoted
    QA Engineer (Blackbox Testing - Remote)

    QA Engineer (Blackbox Testing - Remote)

    Abacus.AI • Eluru, IN
    Remote
    Must overlap with US Pacific Time until 11 : 00 AM PST on weekdays.We’re looking for a skilled QA Engineer specializing in. This role is entirely focused on functional, regression, and exploratory tes...Show more
    Last updated: 5 days ago • Promoted
    Software Tester

    Software Tester

    SAI • Vijayawada, IN
    SAI is an innovative platform that leverages machine vision AI technology to enhance existing CCTV systems, helping retailers prevent theft, reclaim lost sales, and boost operational efficiency.By ...Show more
    Last updated: 10 hours ago • Promoted • New!
    QA Test Engineer / Azure - + 5 years exp - Full remote - contractor in USD

    QA Test Engineer / Azure - + 5 years exp - Full remote - contractor in USD

    All European Careers • Vijayawada, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior QA Test Engineer with +5 years of experience. We are looking for a motivated contractor.Candidates need to b...Show more
    Last updated: 13 days ago • Promoted
    Test Automation Specialist

    Test Automation Specialist

    Zensar Technologies • Vijayawada, IN
    Responsible for designing, developing, and maintaining automated test frameworks and scripts using C# to test web based and API based applications across different projects.Develop and maintain aut...Show more
    Last updated: 8 days ago • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmind • Vijayawada, IN
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show more
    Last updated: 10 hours ago • Promoted • New!
    Manual Tester

    Manual Tester

    Vaultize • Eluru, IN
    Vaultize is a leading enterprise file security platform designed to safeguard corporate files wherever they are stored or shared. The platform offers robust solutions such as Enterprise Digital Righ...Show more
    Last updated: 1 day ago • Promoted
    Test Automation Engineer with UFT, Playwright exp

    Test Automation Engineer with UFT, Playwright exp

    BS Resourcing • Guntur, IN
    For one of our reputed customers, we are looking for a Test Automation Engineer with experience in UFT, Playwright and HP ALM.Show more
    Last updated: 3 days ago • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, Mumbai • Eluru, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 30+ days ago • Promoted