AI Testing and Validation Director

About Futuristic Underwriters Pvt. Ltd.

We are a business transformation center dedicated to achieving efficient underwriting operations, utilizing its artificial intelligence capabilities, and further advancing its digital transformation and innovation. We will advance Futuristic Group’s global strategy through pioneering work in streamlined underwriting processes, artificial intelligence, telematics, and analytics, while also providing critical business support functions across underwriting, claims, and operations. Our focus is to set up a hub for incubation—developing next-generation insurance and technology solutions that will shape the industry’s future.

Role : Director – QA & Testing (AI / Data CoE)

The Position

Lead the Quality Assurance and Testing organization within the AI / Data Center of Excellence (CoE), ensuring delivery of reliable, high-performing, and compliant AI and data-driven systems across the enterprise.

Location : Delhi NCR (Noida), India | Reporting : Head of Digital Innovation Unit - India |

Key Responsibilities

• Quality & Testing Leadership : Establish and lead comprehensive QA strategy across traditional software, data, and AI-driven systems in alignment with enterprise digital transformation goals.
• AI Evaluations : Define frameworks and metrics for AI / ML testing—covering model accuracy, robustness, fairness, explainability, and bias detection. Develop automated evaluation pipelines for LLMs and AI applications.
• Test Automation & Innovation : Drive automation-first strategy using AI-powered testing tools to improve speed, accuracy, and coverage across regression, performance, and integration testing.
• MLOps & Data Quality : Collaborate with MLOps and data engineering teams to ensure model validation, monitoring, and continuous testing of data pipelines and ML workflows.
• Governance & Compliance : Establish quality governance processes for AI and data systems adhering to internal standards, industry best practices, and regulatory requirements for P&C insurance operations.
• Cross-Functional Collaboration : Partner with AI architects, data scientists, software engineers, underwriters, and claims teams to integrate testing early in development and ensure reliable deployment.
• AI-in-QA Enablement : Evaluate and deploy AI-based testing solutions, including intelligent defect prediction, test case generation, and anomaly detection in production systems.
• Team Development : Build and mentor a high-performing QA / testing organization specializing in AI applications, automation, and performance testing.
• Performance & Reliability : Ensure AI systems and digital applications meet SLAs for scalability, reliability, interpretability, and compliance.
• Stakeholder Management : Collaborate with business, technology, and innovation leaders to drive quality culture, risk mitigation, and continuous improvement.

Required Qualifications

proven track record in managing enterprise-scale QA functions, including testing of AI / ML systems.

Preferred Qualifications

Why You’ll Love Working Here