Talent.com
No longer accepting applications
Ai Trainer - Qa Tester

Ai Trainer - Qa Tester

MyRemoteTeam IncBelgaum, Republic Of India, IN
5 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

email-sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Belgaum, Republic Of India, IN

    Related jobs
    • Promoted
    • New!
    Senior QA Automation Tester (Playwright + TypeScript)

    Senior QA Automation Tester (Playwright + TypeScript)

    Aveosoft Pvt Ltdbelgaum, karnataka, in
    Senior QA Automation Tester (Playwright + TypeScript).Aveosoft Pvt Ltd is seeking a highly skilled Senior QA Automation Tester with strong hands-on experience in Playwright (TypeScript) for UI and ...Show moreLast updated: 22 hours ago
    • Promoted
    SAP S / 4 HANA Group Reporting Tester

    SAP S / 4 HANA Group Reporting Tester

    Dexian IndiaBelgaum, IN
    Immediate Joiner are appreciated • •.We are looking for a QA Tester with deep expertise in S / 4 HANA Group Reporting.Key responsibilities include : Support Close and Consolidation processes.Validate ba...Show moreLast updated: 23 hours ago
    • Promoted
    • New!
    API Automation testing

    API Automation testing

    People Prime Worldwidebelagavi, karnataka, in
    Our client is a global technology cons,ulting and digital solutions company, resulting from the merger.It focuses on helping businesses leverage digital technologies to reimagine business models, a...Show moreLast updated: 22 hours ago
    • Promoted
    Subject Matter Expert - AI trainer

    Subject Matter Expert - AI trainer

    MyRemoteTeam Incbelagavi, karnataka, in
    Team Lead for STEM Data (Math, Physics, Chemistry, Biology).Fill up this form - https : / / forms.We’re Hiring : Team Lead – STEM (Math, Physics, Chemistry, Biology). Are you a STEM expert who loves blen...Show moreLast updated: 14 days ago
    • Promoted
    Test Automation API and UI Specialist

    Test Automation API and UI Specialist

    ZitromindsBelgaum, IN
    Creation and implementation of BDD test scenarios based on business requirements.Adding automation layer for the BDD tests that contribute to the Regression Suite. Carrying out test runs and perform...Show moreLast updated: 30+ days ago
    • Promoted
    QA Automation

    QA Automation

    ACL DigitalBelgaum, IN
    ACL Digital is hiring for Senior Automation Test Engineer for Bangalore location.Job Description : - Network Security Tools-Python Automation Test Engineer. Experience : 4 Years to 9 Years.We are seek...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmindBelgaum, IN
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Automation Tester

    Automation Tester

    Edstrumentsbelagavi, karnataka, in
    We are seeking a detail-oriented and proactive Automation Tester with at least 2 years of hands-on experience in designing and executing automated test scripts. The ideal candidate will play a key r...Show moreLast updated: 19 hours ago
    • Promoted
    • New!
    Automation Tester

    Automation Tester

    Zemoso Technologiesbelgaum, karnataka, in
    Hyderabad / Bengaluru / Pune / Mumbai — Hybrid.Develop and maintain automation test scripts using Java and Selenium.Participate in design and code reviews to understand system functionality and ide...Show moreLast updated: 22 hours ago
    • Promoted
    Automation Tester

    Automation Tester

    Tata Consultancy Servicesbelagavi, karnataka, in
    TCS - Direct Walk-In interview opportunity at Mumbai on Saturday, 22nd Nov, 2025.Candidates with relevant experience in Automation Testing can directly attend Walk-in interview.Please go through No...Show moreLast updated: 6 days ago
    • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, MumbaiBelgaum, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show moreLast updated: 30+ days ago
    • Promoted
    TOSCA Automation Testing

    TOSCA Automation Testing

    Tata Consultancy Servicesbelagavi, karnataka, in
    Greetings from TATA Consultancy Services.Skill : TOSCA Automation Testing.Current location : Anywhere In India.Pls find the Job Description below. Good Knowledge in Tosca Automation framework, TBOX ...Show moreLast updated: 13 days ago
    • Promoted
    • New!
    Director – QA & Testing (AI / Data CoE)

    Director – QA & Testing (AI / Data CoE)

    Futuristic Underwriters Pvt Ltdbelgaum, karnataka, in
    About Futuristic Underwriters Pvt.We are a business transformation center dedicated to achieving efficient underwriting operations, utilizing its artificial intelligence capabilities, and further a...Show moreLast updated: 22 hours ago
    • Promoted
    SOX Business Controls Tester

    SOX Business Controls Tester

    VOISBelgaum, IN
    Hiring SOX Business Controls Tester with Vodafone Intelligent Solutions (_VOIS).Required Qualification : CA / CMA.The Manager – SOX Compliance is responsible for the execution of SOX (Sarbanes-Oxley A...Show moreLast updated: 24 days ago
    • Promoted
    Expert Rater – AI Model Evaluation & Code Quality

    Expert Rater – AI Model Evaluation & Code Quality

    MyRemoteTeam Incbelgaum, karnataka, in
    Expert Rater – AI Model Evaluation & Code Quality.Fill up this form- https : / / forms.We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, deb...Show moreLast updated: 1 day ago
    • Promoted
    AI Data Trainer

    AI Data Trainer

    Innodata Inc.Belgaum, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show moreLast updated: 4 days ago
    • Promoted
    AI Model Tester

    AI Model Tester

    RecroBelgaum, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Hybrid Tester

    Hybrid Tester

    HR PLACEMENT CONSULTANTS (HRPC)belagavi, karnataka, in
    Qualifications Educational - B.Sc / BCA / MCA – IT or Computer Science.Domain / Vertical - Insurance and / or Finance (preferred). Automation testing using TOSCA.Effective and consistent service delivery ...Show moreLast updated: 22 hours ago