Talent.com
No longer accepting applications
AI Trainer - QA Tester

AI Trainer - QA Tester

MyRemoteTeam IncVisakhapatnam, IN
7 days ago
Job description

Apply here 👉 AI Agent Evaluation Analyst Application Form

Email-Sandeep.patel@truelancer.com

We’re Hiring : AI Task Evaluator – TAU Framework (Remote | Contract)

We’re collaborating with a leading global AI company on the TAU (Tool–Agent–User) framework , an advanced benchmark designed to evaluate how AI agents perform in realistic, multi-step environments.

As part of this project, you’ll help test and refine AI reasoning by reviewing simulated real-world interactions — where an AI Agent uses tools to complete user requests while following business rules, policies, and logic.

🧠 Role Overview

You’ll analyze and annotate AI-agent conversations and task trajectories to determine if :

  • The agent’s reasoning and tool usage are logical and consistent.
  • The policies (privacy, accuracy, authorization) are respected.
  • The final outcome matches the correct “golden path.”
  • The conversation flow is realistic, clear, and aligned with the user’s intent.

This role blends quality assurance, research, and logic-based evaluation — ideal for people who love breaking down processes and improving system intelligence.

🔍 Key Responsibilities

  • Review agent–user interactions and identify logical gaps or policy violations.
  • Validate tool sequences and end results against golden sets.
  • Flag inconsistencies, missing steps, or unrealistic actions.
  • Annotate errors and reasoning issues clearly and concisely.
  • Suggest edge cases or task improvements to enhance coverage and realism.
  • ✅ What We’re Looking For

  • Excellent analytical and critical-thinking skills.
  • Strong attention to detail and logical consistency .
  • Ability to understand structured workflows (JSON / YAML reading familiarity is a plus).
  • Clear English communication and documentation skills.
  • Background in QA, consulting, linguistics, research, or systems analysis preferred.
  • Create a job alert for this search

    Qa Tester • Visakhapatnam, IN

    Related jobs
    • Promoted
    • New!
    Senior Software Tester

    Senior Software Tester

    Wall Street Consulting Services LLCVisakhapatnam, IN
    Location : Onsite in Rayadurgam, Hyderabad.Experience Level : 7 - 12 Years.We are seeking a highly skilled Senior QA Analyst with strong expertise in Power BI Testing, Azure Data Factory (ADF), ETL / E...Show moreLast updated: 14 hours ago
    • Promoted
    ADP Tester

    ADP Tester

    AptonetVisakhapatnam, IN
    ADP Tester supporting Workday-to-ADP (GlobalView / Workforce Now) payroll transformation.Test payroll processing, data mapping, and integrations. Validate inbound / outbound files between Workday and ...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    AI ML _Tester (work from Office)

    AI ML _Tester (work from Office)

    Recruise India Consulting Pvt LtdVisakhapatnam, IN
    AI / ML Testing Tools Familiarity : Experience with testing frameworks and tools specific to AI / ML such as MLflow, pytest for Python testing, and AWS SageMaker for model validation and monitoring.Bias...Show moreLast updated: 14 hours ago
    • Promoted
    Instructor- Artificial Intelligence

    Instructor- Artificial Intelligence

    AccredianVisakhapatnam, IN
    We’re looking for a passionate and experienced.This is an exciting opportunity for professionals who enjoy teaching, mentoring, and making complex AI concepts accessible and relevant to business co...Show moreLast updated: 30+ days ago
    • Promoted
    Stem Rater - Gen AI

    Stem Rater - Gen AI

    Aceolution IndiaVisakhapatnam, IN
    As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your prima...Show moreLast updated: 3 days ago
    • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent PartnerVisakhapatnam, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show moreLast updated: 16 days ago
    • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmindVisakhapatnam, IN
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show moreLast updated: 3 days ago
    • Promoted
    AI Data Trainer

    AI Data Trainer

    Innodata Inc.Visakhapatnam, IN
    AI and Machine Learning talent network.Data Annotators and Content Moderators (Review & Labeling).If you enjoy working with data, pay close attention to detail, and want to contribute to real-world...Show moreLast updated: 6 days ago
    • Promoted
    Senior QA Tester – Selenium & AI / ML Validation Technical Interview Panel Expert

    Senior QA Tester – Selenium & AI / ML Validation Technical Interview Panel Expert

    Tek SupportVisakhapatnam, IN
    We are seeking a highly experienced.The ideal candidate will have deep expertise in.Automation & Selenium (Foundational Experience). Selenium WebDriver automation frameworks.Collaborate with develop...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Artificial Trainer

    Artificial Trainer

    CPA-Institute of Pharmaceuticals & Life SciencesVisakhapatnam, IN
    The CPA Institute is a premier educational institution specializing in Pharmaceuticals, Clinical Research, Medical Coding, and Life Sciences. With over 12 years of experience, we are dedicated to eq...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    AI QA

    AI QA

    Intellistaff Services Pvt. LtdVisakhapatnam, IN
    Min 7+ years of experience in software quality engineering & assurance.Min 3+ years of Quality engineering experience in AI / ML projects. Solid understanding of and experience in Data engineering.Tho...Show moreLast updated: 12 hours ago
    • Promoted
    • New!
    SR AI Engineer

    SR AI Engineer

    Fulcrum Digital IncVisakhapatnam, IN
    We are seeking a skilled and hands-on.The ideal candidate has a strong foundation in classification, anomaly detection, and time-series modeling, along with experience in Transformer-based architec...Show moreLast updated: 14 hours ago
    • Promoted
    AI Developer - ML & AI Agents (3 to 9 Years)

    AI Developer - ML & AI Agents (3 to 9 Years)

    AIMLEAPVisakhapatnam, IN
    AI Developer - ML & AI Agents (3 to 9 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development. Strong Python programming background f...Show moreLast updated: 2 days ago
    • Promoted
    AI Engineer

    AI Engineer

    MightyBotVisakhapatnam, IN
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    LLM Trainer

    LLM Trainer

    Insight GlobalVisakhapatnam, IN
    Insight Global Client is developing a computer usage dataset to train intelligent systems that understand how users interact with software applications. LLM Trainer (Computer Usage Data Collection)....Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    Automation with Playwright | Bangalore | Leading Big 4 Consulting Firm

    Automation with Playwright | Bangalore | Leading Big 4 Consulting Firm

    Acme ServicesVisakhapatnam, IN
    Job Title : Automation Tester with Playwright.Design, develop, and maintain automated test scripts using.Build robust, scalable, and maintainable automation frameworks. Execute automated test suites,...Show moreLast updated: 14 hours ago
    • Promoted
    AI Model Tester

    AI Model Tester

    RecroVisakhapatnam, IN
    Up to ₹19 LPA (pro-rated for 4 months).The role involves designing and executing test cases, validating model outputs, and ensuring the overall quality, reliability, and fairness of AI systems.This...Show moreLast updated: 27 days ago
    • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, MumbaiVisakhapatnam, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show moreLast updated: 30+ days ago