Agentic AI Quality Assurance Engineer

Zeal ConsultantsBangalore

3 days ago

Job description

Description :

Location : Bangalore (Work from Office)
Experience : 1- 4 Years

Key Responsibilities :

Test and validate AI agents and LLM workflows to ensure correctness and stability.

Design and execute test cases to evaluate agentic behavior, prompt responses, and task accuracy.

Use DeepEval to create and automate evaluation frameworks for LLM and agent testing.

Identify, document, and track bugs, performance issues, or logic errors.

Collaborate with developers, prompt engineers, and data scientists to improve system quality.

Develop and maintain test documentation, including plans, cases, and reports.

Ensure AI agents handle contexts, prompts, and tasks as intended in real-world scenarios.

Contribute to building automated QA pipelines for continuous testing and monitoring of Skills & Qualifications :

1- 4 years of experience in QA, software testing, or AI testing.

Strong understanding of Generative AI, LLM agents, and autonomous workflows.

Experience with manual testing and familiarity with automation testing frameworks.

Hands-on experience or working knowledge of DeepEval for evaluating LLM outputs.

Good analytical, debugging, and documentation skills.

Familiarity with Java or Python for writing scripts or automation utilities.

Excellent collaboration and communication to Have :

Experience with LangChain, CrewAI, AutoGen, or similar agentic frameworks.

Understanding of AI evaluation metrics (accuracy, coherence, relevance, hallucination detection).

Exposure to CI / CD, test automation, or model monitoring tools.

(ref : hirist.tech)

Create a job alert for this search

Quality Assurance Engineer • Bangalore

Related jobs

Promoted

Quality Assurance Engineer

The Reliable JobsBengaluru, Karnataka, India

We’re hiring an SEO Specialist for one of our clients in the Fintech domain.Preferred Industry Experience : Fintech / OTT / Startup. Develop and execute SEO strategies to improve organic rankings and...Show moreLast updated: 2 days ago

Promoted

Agentic AI Engineer

BeGigbangalore, karnataka, in

Agentic AI Engineer – Real Estate & Construction.We are seeking a talented engineer to.You will own the full lifecycle of agent frameworks, including toolchain architecture, prompt engineering, dat...Show moreLast updated: 2 days ago

Promoted

Quality Assurance (QA) Engineer

Sonata Softwarebangalore, karnataka, in

In today's market, there is a unique duality in technology adoption.On one side, extreme focus on cost containment by clients, and on the other, deep motivation to modernize their Digital storefron...Show moreLast updated: 14 days ago

Promoted

Quality Assurance Engineer

CareerXperts Consultingbangalore district, karnataka, in

Software Quality Assurance (QA) Engineer.CareerXperts Workforce Solutions.Software Quality Assurance Engineer.Tech / MCA in Computer Science or related field. Identify, record, and track bugs throug...Show moreLast updated: 2 days ago

Promoted

Quality Assurance Engineer

Ennoventure, Inc.Bangalore Urban, Karnataka, India

Ennoventure is a venture-backed deep-tech company with revolutionary technology to detect counterfeit goods.Our vision is to create a trusted value chain for delivering authentic products and exper...Show moreLast updated: 2 days ago

Promoted

Senior QA Engineer – AI-Driven Product Assurance

engineersmindbangalore, karnataka, in

Senior Application Test Engineer.API layers, ensuring seamless integration, performance, and security.This is a hands-on role that requires strong technical depth, problem-solving ability, and a pr...Show moreLast updated: 2 days ago

Promoted

QA Engineer (Conversational AI)

RecroBengaluru, Karnataka, India

We are seeking a highly motivated and detail-oriented Quality Assurance (QA) Engineer to join our team.You will play a key role in ensuring the reliability, accuracy, and user experience of our Con...Show moreLast updated: 5 days ago

Promoted

AI Agents Engineer

QpiAIBengaluru, Karnataka, India

The Artificial Intelligence team at QpiAI builds cutting edge platforms to address our customers' most challenging problems in AI across a variety of industry verticals and domains.The team support...Show moreLast updated: 17 days ago

Promoted

Quality Assurance Automation Engineer

BrightEdgeBengaluru, IN

BrightEdge is a global leader in enterprise SEO and content performance solutions, driving AI-powered digital marketing success for the world’s top brands. Our culture is product-first, innovation-d...Show moreLast updated: 30+ days ago

Promoted

Senior Quality Assurance Engineer

PROADSW3 Relations pvt. ltd.Bengaluru, Karnataka, India

QA Automation Engineer (Subcon) – Bangalore.Engagement Type : Subcontract (Full-time).This role is ideal for a QA professional with a passion for automation, scalability, and ensuring excellence acr...Show moreLast updated: 2 days ago

Promoted

Quality Assurance Engineer

LTIMindtreehosur, tamil nadu, in

Experience with cloud data platforms like.Snowflake, Redshift, Databricks, or BigQuery.You’ll work closely with data engineers and platform teams to build robust. Develop and implement test strategi...Show moreLast updated: 24 days ago

Promoted

AI Engineer

QX Labshosur, tamil nadu, in

QX Labs is looking for a full stack AI engineer with a strong software background to join our expanding team of AI experts. We are an early-stage London-based startup building cutting-edge workflow ...Show moreLast updated: 18 days ago

Promoted

Lead Quality Assurance Engineer (Backgammon Galaxy)

Backgammon GalaxyBengaluru, IN

Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show moreLast updated: 30+ days ago

Promoted

Quality Assurance Automation Engineer

Techmates Technologieshosur, tamil nadu, in

We are seeking a highly skilled and experienced QA Automation Engineer with over 5 years of experience in both automation and manual testing. The ideal candidate will possess strong expertise in Pyt...Show moreLast updated: 1 day ago

Promoted

Quality Assurance Engineer

GoQuantBengaluru, Karnataka, India

Job Description : QA Engineer (Paid).GoQuant is a financial technology company dedicated to providing high-performance trading solutions for digital assets. We empower professional traders and instit...Show moreLast updated: 30+ days ago

Promoted

Quality Assurance Automation Engineer

NIKSUNhosur, tamil nadu, in

NIKSUN is the recognized worldwide leader in making the Unknown Known, by using next generation technology that revolutionizes the way networks and services are secured, protected, and managed.The ...Show moreLast updated: 30+ days ago

Promoted

Quality Assurance Engineer

Synthio Labshosur, tamil nadu, in

QA Engineer (India) — Join SynthioLabs (YC X25).SynthioLabs growing fast and looking for a.Design and maintain detailed test plans and test cases. Run daily testing cycles across web and mobile apps...Show moreLast updated: 26 days ago

Promoted

Engineer-AI

Sakonhosur, tamil nadu, in

Role : AI Engineer – Agentic Systems & LLM Applications.We’re looking for a well-rounded, forward-thinking AI Engineer who can design, build, and deploy intelligent systems powered by LLMs, retrieva...Show moreLast updated: 5 days ago