Talent.com
AI Trainer - QA Tester
AI Trainer - QA TesterMyRemoteTeam Inc • Lucknow, IN
No longer accepting applications
AI Trainer - QA Tester

AI Trainer - QA Tester

MyRemoteTeam Inc • Lucknow, IN
4 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Lucknow, IN

    Related jobs
    AI Model Tester

    AI Model Tester

    Recro • Lucknow, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show more
    Last updated: 25 days ago • Promoted
    ADP Tester

    ADP Tester

    Aptonet • Lucknow, IN
    ADP Tester supporting Workday-to-ADP (GlobalView / Workforce Now) payroll transformation.Test payroll processing, data mapping, and integrations. Validate inbound / outbound files between Workday and ...Show more
    Last updated: 3 days ago • Promoted
    Expert Rater – AI Model Evaluation & Code Quality

    Expert Rater – AI Model Evaluation & Code Quality

    MyRemoteTeam Inc • Lucknow, IN
    Expert Rater – AI Model Evaluation & Code Quality.Fill up this form- https : / / forms.We’re expanding our elite rater team and looking for highly skilled technical experts who love reviewing code, deb...Show more
    Last updated: 20 hours ago • Promoted • New!
    Generative AI Architect- Customer Experience -Trainer Role

    Generative AI Architect- Customer Experience -Trainer Role

    Patch the Skill • Lucknow, IN
    The ideal candidate will be a qualified architect who is able to construct clear diagrams using AutoCAD.This candidate should have an in-depth knowledge of all steps related to project completion a...Show more
    Last updated: 3 days ago • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmind • Lucknow, IN
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show more
    Last updated: 20 hours ago • Promoted • New!
    SOX Business Controls Tester

    SOX Business Controls Tester

    VOIS • Lucknow, IN
    Hiring SOX Business Controls Tester with Vodafone Intelligent Solutions (_VOIS).Required Qualification : CA / CMA.The Manager – SOX Compliance is responsible for the execution of SOX (Sarbanes-Oxley A...Show more
    Last updated: 22 days ago • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent Partner • Lucknow, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show more
    Last updated: 14 days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Cloud 9 Solutions, LLC • Lucknow, IN
    Should have experience in building.Having knowledge in Microsoft Copilot studio is an advantage.Type : Fulltime (40 hours per week). AI / ML architecture, with at least 3 years focused on enterprise-le...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Lucknow, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 9 days ago • Promoted
    AI Agent Architect

    AI Agent Architect

    Luxoft • Lucknow, IN
    We are seeking a hands-on and qualified AI Agent Architect to design and deploy advanced Agentic AI systems—comprising task-specific autonomous tools governed by a master agent—to support complex t...Show more
    Last updated: 7 days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Lucknow, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 7 days ago • Promoted
    Responsible AI

    Responsible AI

    EXL • Lucknow, IN
    We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.This role spans tradit...Show more
    Last updated: 30+ days ago • Promoted
    AI & Automation Intern (Remote – India)

    AI & Automation Intern (Remote – India)

    Automynx • Lucknow, IN
    Remote
    Our mission is to simplify business operations through the power of.ChatGPT, Dialogflow, and custom-built AI models.We’re a small, passionate team exploring how automation can transform communicati...Show more
    Last updated: 27 days ago • Promoted
    Stem Rater - Gen AI

    Stem Rater - Gen AI

    Aceolution India • Lucknow, IN
    As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your prima...Show more
    Last updated: 20 hours ago • Promoted • New!
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Ironbook AI • Lucknow, IN
    Job Description : AI Engineer (AWS AI Stack).We are looking for a highly skilled.You will design, build, and deploy AI systems, collaborate with cross-functional teams, and contribute to scalable, p...Show more
    Last updated: 11 days ago • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, Mumbai • Lucknow, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show more
    Last updated: 30+ days ago • Promoted
    AI Data Trainer

    AI Data Trainer

    Innodata Inc. • Lucknow, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show more
    Last updated: 3 days ago • Promoted
    AI Engineer

    AI Engineer

    Sutra.AI • Lucknow, IN
    Our mission is to help enterprises transform raw data into intelligent, actionable insights through AI, automation, and decision intelligence. The ideal candidate is hands-on, detail-oriented, and t...Show more
    Last updated: 5 days ago • Promoted