Talent.com
Agentic AI Quality Assurance Engineer

Agentic AI Quality Assurance Engineer

Zeal ConsultantsBangalore
3 days ago
Job description

Description :

  • Location : Bangalore (Work from Office)
  • Experience : 1- 4 Years

Key Responsibilities :

  • Test and validate AI agents and LLM workflows to ensure correctness and stability.
  • Design and execute test cases to evaluate agentic behavior, prompt responses, and task accuracy.
  • Use DeepEval to create and automate evaluation frameworks for LLM and agent testing.
  • Identify, document, and track bugs, performance issues, or logic errors.
  • Collaborate with developers, prompt engineers, and data scientists to improve system quality.
  • Develop and maintain test documentation, including plans, cases, and reports.
  • Ensure AI agents handle contexts, prompts, and tasks as intended in real-world scenarios.
  • Contribute to building automated QA pipelines for continuous testing and monitoring of Skills & Qualifications :
  • 1- 4 years of experience in QA, software testing, or AI testing.
  • Strong understanding of Generative AI, LLM agents, and autonomous workflows.
  • Experience with manual testing and familiarity with automation testing frameworks.
  • Hands-on experience or working knowledge of DeepEval for evaluating LLM outputs.
  • Good analytical, debugging, and documentation skills.
  • Familiarity with Java or Python for writing scripts or automation utilities.
  • Excellent collaboration and communication to Have :
  • Experience with LangChain, CrewAI, AutoGen, or similar agentic frameworks.
  • Understanding of AI evaluation metrics (accuracy, coherence, relevance, hallucination detection).
  • Exposure to CI / CD, test automation, or model monitoring tools.
  • (ref : hirist.tech)

    Create a job alert for this search

    Quality Assurance Engineer • Bangalore

    Related jobs
    • Promoted
    Quality Assurance Engineer

    Quality Assurance Engineer

    The Reliable JobsBengaluru, Karnataka, India
    We’re hiring an SEO Specialist for one of our clients in the Fintech domain.Preferred Industry Experience : Fintech / OTT / Startup. Develop and execute SEO strategies to improve organic rankings and...Show moreLast updated: 2 days ago
    • Promoted
    Agentic AI Engineer

    Agentic AI Engineer

    BeGigbangalore, karnataka, in
    Agentic AI Engineer – Real Estate & Construction.We are seeking a talented engineer to.You will own the full lifecycle of agent frameworks, including toolchain architecture, prompt engineering, dat...Show moreLast updated: 2 days ago
    • Promoted
    Quality Assurance (QA) Engineer

    Quality Assurance (QA) Engineer

    Sonata Softwarebangalore, karnataka, in
    In today's market, there is a unique duality in technology adoption.On one side, extreme focus on cost containment by clients, and on the other, deep motivation to modernize their Digital storefron...Show moreLast updated: 14 days ago
    • Promoted
    Quality Assurance Engineer

    Quality Assurance Engineer

    CareerXperts Consultingbangalore district, karnataka, in
    Software Quality Assurance (QA) Engineer.CareerXperts Workforce Solutions.Software Quality Assurance Engineer.Tech / MCA in Computer Science or related field. Identify, record, and track bugs throug...Show moreLast updated: 2 days ago
    • Promoted
    Quality Assurance Engineer

    Quality Assurance Engineer

    Ennoventure, Inc.Bangalore Urban, Karnataka, India
    Ennoventure is a venture-backed deep-tech company with revolutionary technology to detect counterfeit goods.Our vision is to create a trusted value chain for delivering authentic products and exper...Show moreLast updated: 2 days ago
    • Promoted
    Senior QA Engineer – AI-Driven Product Assurance

    Senior QA Engineer – AI-Driven Product Assurance

    engineersmindbangalore, karnataka, in
    Senior Application Test Engineer.API layers, ensuring seamless integration, performance, and security.This is a hands-on role that requires strong technical depth, problem-solving ability, and a pr...Show moreLast updated: 2 days ago
    • Promoted
    QA Engineer (Conversational AI)

    QA Engineer (Conversational AI)

    RecroBengaluru, Karnataka, India
    We are seeking a highly motivated and detail-oriented Quality Assurance (QA) Engineer to join our team.You will play a key role in ensuring the reliability, accuracy, and user experience of our Con...Show moreLast updated: 5 days ago
    • Promoted
    AI Agents Engineer

    AI Agents Engineer

    QpiAIBengaluru, Karnataka, India
    The Artificial Intelligence team at QpiAI builds cutting edge platforms to address our customers' most challenging problems in AI across a variety of industry verticals and domains.The team support...Show moreLast updated: 17 days ago
    • Promoted
    Quality Assurance Automation Engineer

    Quality Assurance Automation Engineer

    BrightEdgeBengaluru, IN
    BrightEdge is a global leader in enterprise SEO and content performance solutions, driving AI-powered digital marketing success for the world’s top brands. Our culture is product-first, innovation-d...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Quality Assurance Engineer

    Senior Quality Assurance Engineer

    PROADSW3 Relations pvt. ltd.Bengaluru, Karnataka, India
    QA Automation Engineer (Subcon) – Bangalore.Engagement Type : Subcontract (Full-time).This role is ideal for a QA professional with a passion for automation, scalability, and ensuring excellence acr...Show moreLast updated: 2 days ago
    • Promoted
    Quality Assurance Engineer

    Quality Assurance Engineer

    LTIMindtreehosur, tamil nadu, in
    Experience with cloud data platforms like.Snowflake, Redshift, Databricks, or BigQuery.You’ll work closely with data engineers and platform teams to build robust. Develop and implement test strategi...Show moreLast updated: 24 days ago
    • Promoted
    AI Engineer

    AI Engineer

    QX Labshosur, tamil nadu, in
    QX Labs is looking for a full stack AI engineer with a strong software background to join our expanding team of AI experts. We are an early-stage London-based startup building cutting-edge workflow ...Show moreLast updated: 18 days ago
    • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon GalaxyBengaluru, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show moreLast updated: 30+ days ago
    • Promoted
    Quality Assurance Automation Engineer

    Quality Assurance Automation Engineer

    Techmates Technologieshosur, tamil nadu, in
    We are seeking a highly skilled and experienced QA Automation Engineer with over 5 years of experience in both automation and manual testing. The ideal candidate will possess strong expertise in Pyt...Show moreLast updated: 1 day ago
    • Promoted
    Quality Assurance Engineer

    Quality Assurance Engineer

    GoQuantBengaluru, Karnataka, India
    Job Description : QA Engineer (Paid).GoQuant is a financial technology company dedicated to providing high-performance trading solutions for digital assets. We empower professional traders and instit...Show moreLast updated: 30+ days ago
    • Promoted
    Quality Assurance Automation Engineer

    Quality Assurance Automation Engineer

    NIKSUNhosur, tamil nadu, in
    NIKSUN is the recognized worldwide leader in making the Unknown Known, by using next generation technology that revolutionizes the way networks and services are secured, protected, and managed.The ...Show moreLast updated: 30+ days ago
    • Promoted
    Quality Assurance Engineer

    Quality Assurance Engineer

    Synthio Labshosur, tamil nadu, in
    QA Engineer (India) — Join SynthioLabs (YC X25).SynthioLabs growing fast and looking for a.Design and maintain detailed test plans and test cases. Run daily testing cycles across web and mobile apps...Show moreLast updated: 26 days ago
    • Promoted
    Engineer-AI

    Engineer-AI

    Sakonhosur, tamil nadu, in
    Role : AI Engineer – Agentic Systems & LLM Applications.We’re looking for a well-rounded, forward-thinking AI Engineer who can design, build, and deploy intelligent systems powered by LLMs, retrieva...Show moreLast updated: 5 days ago