Senior AI QA Engineer

Job Title : Senior AI QA Test Engineer – Agentic GenAI

We are seeking a Senior AI - QA Test Engineer with extensive experience in AI / ML Quality Engineering, specializing in Agentic GenAI systems, evaluation frameworks, observability, and reliability testing. You will ensure the quality and consistent performance of our enterprise-scale AI ecosystem across Snowflake, AWS, and Azure.

Responsibilities

• Design and implement QA strategies for LLM, RAG, and Agentic AI pipelines.
• Develop automated test suites for agentic workflows, LLM applications, APIs, and vector-search systems.
• Validate retrieval workflows, reasoning behavior, grounding quality, and reduce hallucination tendencies.
• Build evaluation pipelines with robust metrics and regression frameworks (covering grounding, hallucination risks, and retrieval evaluation).
• Implement AI observability : telemetry, drift monitoring, quality dashboards.
• Integrate automated testing into CI / CD workflows.
• Establish enterprise QA best practices for AI governance and reliability.

Required Qualifications