Lead Quality Engineer

Description :

We are seeking a Lead Quality Engineering (QE) Engineer to define, operationalize, and own the quality strategy for our Agentic AI application teams. This leader will be accountable for functional, operational, and security quality across 25+ engineers (AI + UI engineers in India & USA).

This role requires deep awareness of quality challenges unique to LLM- and SLM-powered Agentic AI applications, especially in healthcare and education, where correctness, reliability, and compliance are essential.

Typical quality challenges include :

• LLM / SLM Latency & Token Efficiency : unpredictable response times, throughput constraints, and cost-performance tradeoffs.
• Non-Deterministic Outputs : validating variable responses in sensitive domains (medical correctness, educational appropriateness).
• RAG & Vector DB Use Cases : testing retrieval relevance, embedding coverage, semantic accuracy, and fallback handling.
• SME-Driven UAT Cycles : unpredictable validation cycles with clinicians or educators.
• Operational Risks : agent workflow reliability, cand system behavior under load.
• Security Risks : prompt injection, adversarial inputs, data leakage, and access control.

This is a transformational role : you will move the organization from manual QA toward automation-first and AI-driven evaluation, enabling every engineer to take responsibility for quality.

Key Responsibilities Leadership & Culture :

Functional Quality :

Build evaluation frameworks for :

Operational Quality (Enablement Role) :

Security & Compliance Quality :

Qualifications : Must Have :

Nice to Have (Big Plus) :

(ref : hirist.tech)