Generative AI Testing Lead - Automation & Manual Testing

Role Description :

We are seeking an experienced Gen AI Testing Lead to join our team in Chennai. This is a full-time, on-site leadership position responsible for defining, implementing, and executing comprehensive testing strategies for Generative AI applications and Large Language Model (LLM)-based solutions. You will oversee test planning, automation, and execution, ensuring that AI-driven systems meet performance, security, compliance, and functional requirements.

You will work closely with AI / ML engineers, data scientists, product managers, and quality teams to validate AI models, optimize testing frameworks, and maintain robust quality standards across the product lifecycle.

Key Responsibilities :

• Lead the end-to-end testing lifecycle for Gen AI and LLM-based applications, from test strategy definition to execution and reporting.
• Develop, maintain, and optimize manual and automated test cases tailored for AI / ML workloads, model pipelines, and prompt engineering scenarios.
• Conduct functional, performance, security, and compliance testing for LLM deployments.
• Validate AI / ML architecture components, ensuring model outputs meet accuracy, bias, interpretability, and safety benchmarks.
• Implement Gen AI security testing methodologies to detect prompt injection, data leakage, adversarial attacks, and other vulnerabilities.
• Ensure regulatory and ethical compliance for AI systems, particularly in sensitive domains such as Life Sciences.
• Collaborate with AI researchers to assess LLM fine-tuning, model versioning, and inference behavior against expected outcomes.
• Monitor model drift and data quality, recommending improvements to maintain high-performance levels.
• Document testing procedures, results, and lessons learned to support continuous improvement.

Qualifications :

(ref : hirist.tech)