Talent.com
Agentic QA Engineer
Agentic QA EngineerHirly • Bangalore
Agentic QA Engineer

Agentic QA Engineer

Hirly • Bangalore
30+ days ago
Job description

Description Title : Agentic QA Engineer

Experience Required : 2 to 4 years

Location : Bengaluru (HSR Layout)

About the Role are looking for an Agentic QA Engineer who will be responsible for testing, validating, and ensuring the accuracy and reliability of our AI agents and automation workflows. The ideal candidate will have hands-on experience with GenAI-based systems, QA methodologies, and AI testing frameworks to guarantee high-quality performance of AI-driven Responsibilities Test and validate AI agents to ensure they perform tasks accurately and as intended.

- Design, develop, and execute test cases for conversational and task-based AI workflows.

- Analyze test results and identify functional issues, bugs, or performance gaps.

- Work closely with engineering, data science, and prompt engineering teams to resolve issues.

- Document test processes, results, and improvement recommendations.

- Ensure AI agents correctly interpret prompts, contexts, and multi-step actions.

- Contribute to the development of automated QA pipelines for AI Skills & Qualifications 1- 5 years of experience in QA, software testing, or AI testing roles.

- Strong understanding of Generative AI, LLM agents, or autonomous AI systems.

- Familiarity with DeepEval, AI evaluation tools, or similar frameworks.

- Experience in manual testing; exposure to automation testing tools is a plus.

- Strong analytical thinking, problem-solving ability, and communication skills.

- Ability to collaborate effectively with cross-functional to Have Exposure to frameworks like LangChain, CrewAI, AutoGen, or other LLM orchestration tools.

- Basic scripting/programming skills in Python or Java.

- Understanding of AI evaluation metrics, model behavior, and performance tuning.

(ref:hirist.tech)
Create a job alert for this search

Agentic QA Engineer • Bangalore

Similar jobs

QA Engineer

Match Point SolutionsBengaluru, KA, India
Quick Apply

MatchPoint Solutions is a fast-growing, young, energetic global IT-Engineering services company with clients across the US.We provide technology solutions to various clients like Uber, Robinhood, N...Show more

Senior Quality Assurance Engineer

Geniusbangalore district, karnataka, in

Genius is building a professional, high-velocity on-chain trading terminal where correctness, determinism, and execution integrity are non-negotiable.This role owns automated testing across both th...Show more

 • Promoted

QA Embedded Engineer

Creative Synergies Groupbangalore, karnataka, in

Location: Whitefield, Bangalore.Test case design, execution, regression, and test reporting for sprint releases.Perform Black-box testing (requirements-driven) and Grey-box testing (using logs, con...Show more

 • Promoted

Senior QA Engineer

Under Armour IndiaBengaluru, India

The Under Armour Sr QA Engineer will be embedded within Ecommerce and Omni Digital projects and feature teams, taking ownership of quality and establishing best practices while driving continuous p...Show more

 • Promoted

AI-GTM Engineer

Signeasybangalore, karnataka, in

We are unlocking the intelligence inside them.Signeasy began fifteen years ago with a simple idea.That idea helped the world go paperless.But signatures were only the beginning.Today, the real prob...Show more

 • Promoted

Lead ETL QA Engineer

Bahwan CyberTekbangalore, karnataka, in

As a Lead ETL QA Engineer, you will drive the QA strategy and execution for a major data pipeline modernization initiative on Azure and Snowflake.This role requires a deep understanding of data qua...Show more

 • Promoted

QA Engineer

h2o.aiBangalore, IN
Quick Apply

As the world’s leading agentic AI company, H2O.Generative and Predictive AI to help enterprises and public sector agencies develop purpose-built GenAI applications on their private data.With a focu...Show more

QA Engineer

CIEL HRBengaluru, Karnataka, India
Quick Apply

Experience Level: 3 to 5 years.Show more

QA Infra Testing Engineer (API + AWS + Gen AI)

LTMbangalore, karnataka, in

Mandate skills – Performance / Load Tester – Voice AI (AWS): Experience in performance and scalability testing of AWS Voice AI systems, covering concurrent calls, WebSocket audio streaming, STT/TTS...Show more

 • Promoted

QA engineer 3

ScaleneWorksBengaluru, Karnataka, India
Quick Apply

Has working experience and advanced and specialized technical/functional knowledge in own discipline.Understands how own area contributes to the business.Acts as a reference for colleagues with les...Show more

QA Engineer 2

ScaleneWorksBengaluru, Karnataka, India
Quick Apply

Participate in specification and architecture reviews, including customer specification reviews when applicable, and provide feedback based on experience, highlighting any potential impacts, risks,...Show more

Senior QA Engineer

FergusonBengaluru, India

Responsible for devising a strategic test plan with a focus on API Testing based on reviewing Requirements, User Stories and Tech Design.Responsible for design and development of automated API Test...Show more

 • Promoted

QA Engineer

DrMartensBengaluru, India

Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly adopted by diverse youth subcultures a...Show more

 • Promoted

QA Engineer 3

ScaleneWorksBengaluru, Karnataka, India
Quick Apply

Attend to specification/architecture reviews (also on customer specification reviews when applicable), and provide feedback along with any potential impact, risk, issue or missed gap based on exper...Show more

Principal Mobile QA Engineer

Pocket FMBengaluru, Republic Of India, IN

Senior Software Development Engineer Test.At our core, we are an AI-powered entertainment company with a deeply human-first philosophy.We believe technology should amplify creativity.Our proprietar...Show more

 • Promoted

Functional QA Engineer (Generative AI)

LTMBengaluru, Republic Of India, IN

Mandate skills – Performance / Load Tester – Voice AI (AWS): Experience in performance and scalability testing of AWS Voice AI systems, covering concurrent calls, WebSocket audio streaming, STT/TTS...Show more

 • Promoted

Lead QA Automation Engineer

RecroBengaluru, Republic Of India, IN

We are looking for a highly motivated and detail-oriented.The ideal candidate will have strong experience in test automation, a solid understanding of QA methodologies, and a passion for delivering...Show more

 • Promoted

QA Engineer Expert

Weekday AIBengaluru, KA, IN
Quick Apply

This role is for one of the Weekday's clients.Take full ownership of the QA strategy across our product ecosystem, including the desktop application, CLI, and API workflows.Develop and manage autom...Show more