Talent.com
No longer accepting applications
Director – QA & Testing (AI / Data CoE)

Director – QA & Testing (AI / Data CoE)

Futuristic Underwriters Pvt LtdKolhapur, IN
1 day ago
Job description

About Futuristic Underwriters Pvt. Ltd.

We are a business transformation center dedicated to achieving efficient underwriting operations, utilizing its artificial intelligence capabilities, and further advancing its digital transformation and innovation. We will advance Futuristic Group’s global strategy through pioneering work in streamlined underwriting processes, artificial intelligence, telematics, and analytics, while also providing critical business support functions across underwriting, claims, and operations. Our focus is to set up a hub for incubation—developing next-generation insurance and technology solutions that will shape the industry’s future.

Role : Director – QA & Testing (AI / Data CoE)

The Position

Lead the Quality Assurance and Testing organization within the AI / Data Center of Excellence (CoE), ensuring delivery of reliable, high-performing, and compliant AI and data-driven systems across the enterprise.

Location : Delhi NCR (Noida), India | Reporting : Head of Digital Innovation Unit - India |

Key Responsibilities

  • Quality & Testing Leadership : Establish and lead comprehensive QA strategy across traditional software, data, and AI-driven systems in alignment with enterprise digital transformation goals.
  • AI Evaluations : Define frameworks and metrics for AI / ML testing—covering model accuracy, robustness, fairness, explainability, and bias detection. Develop automated evaluation pipelines for LLMs and AI applications.
  • Test Automation & Innovation : Drive automation-first strategy using AI-powered testing tools to improve speed, accuracy, and coverage across regression, performance, and integration testing.
  • MLOps & Data Quality : Collaborate with MLOps and data engineering teams to ensure model validation, monitoring, and continuous testing of data pipelines and ML workflows.
  • Governance & Compliance : Establish quality governance processes for AI and data systems adhering to internal standards, industry best practices, and regulatory requirements for P&C insurance operations.
  • Cross-Functional Collaboration : Partner with AI architects, data scientists, software engineers, underwriters, and claims teams to integrate testing early in development and ensure reliable deployment.
  • AI-in-QA Enablement : Evaluate and deploy AI-based testing solutions, including intelligent defect prediction, test case generation, and anomaly detection in production systems.
  • Team Development : Build and mentor a high-performing QA / testing organization specializing in AI applications, automation, and performance testing.
  • Performance & Reliability : Ensure AI systems and digital applications meet SLAs for scalability, reliability, interpretability, and compliance.
  • Stakeholder Management : Collaborate with business, technology, and innovation leaders to drive quality culture, risk mitigation, and continuous improvement.

Required Qualifications

  • Education : Bachelor’s / Master’s degree in Computer Science, Information Technology, or related technical discipline.
  • Experience : 12+ years of QA / Testing experience with 5+ years in leadership roles; proven track record in managing enterprise-scale QA functions, including testing of AI / ML systems.
  • Technical Skills : Expertise in test automation frameworks, performance testing, CI / CD integration, and quality engineering of AI models and APIs.
  • AI Testing Expertise : Experience designing AI evaluation strategies for LLMs, NLP systems, computer vision, or predictive models, including use of benchmarks and bias / fairness tools.
  • Tools & Platforms : Proficiency with tools like Selenium, PyTest, Robot Framework, Postman, JMeter, TensorBoard, and AI Eval frameworks (e.g., PromptBench, DeepEval, LangSmith).
  • Insurance Domain : Understanding of Property & Casualty (P&C) insurance workflows including underwriting, claims, and policy management is preferred.
  • Governance & Compliance : Familiarity with ISO, SOC2, and model validation standards for AI assurance.
  • Communication : Strong ability to communicate technical quality concepts to executive and non-technical stakeholders
  • Preferred Qualifications

  • Insurance & AI : Experience testing AI applications in P&C insurance domain, including underwriting automation, claims triage, and telematics.
  • AI in QA : Proven experience integrating AI tools for intelligent automation, defect analysis, and test optimization.
  • Leadership : Strong team-building, mentorship, and stakeholder engagement experience in global organizations.
  • Innovation Focus : Background in developing next-generation QA frameworks for digital transformation and AI assurance
  • Why You’ll Love Working Here

  • Founding member of India’s AI engineering team
  • Hands-on work with global insurance data & real business impact
  • Learn from cutting-edge AI practices in an innovation-first culture
  • Create a job alert for this search

    Qa Testing • Kolhapur, IN

    Related jobs
    • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Calyx GlobalKolhapur, IN
    Calyx Global is a ClimateTech startup founded by Donna Lee and Duncan van Bergen, backed by Sequoia, Susquehanna (SIG), New Climate Ventures, and others. We provide ratings and research on the globa...Show moreLast updated: 1 day ago
    • Promoted
    Responsible AI

    Responsible AI

    EXLKolhapur, IN
    We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.This role spans tradit...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Architect (Adobe AEP)

    Data Architect (Adobe AEP)

    RibbitZ LLCKolhapur, IN
    Define overall AEP data architecture, schemas (XDM), and identity strategy.Design and oversee ingestion pipelines (batch, streaming, APIs). Ensure data quality, scalability, and governance across da...Show moreLast updated: 11 hours ago
    • Promoted
    Senior Automation Test Engineer

    Senior Automation Test Engineer

    ScilifeKolhapur, IN
    We are a SaaS company specializing in innovative quality management systems (QMS) tailored for the life sciences sector.Our mission is to ensure compliance, enhance quality processes, and improve o...Show moreLast updated: 2 days ago
    • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Tata Consultancy ServicesKolhapur, IN
    Job Title : Artificial Intelligence Engineer.Required Skillset : Senior Full Stack & AI Engineer (AWS | Node.Location : Delhi / Bangalore / Hyderabad / Pune / Mumbai. We are looking for an experienced.Seni...Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Architect- Customer Experience -Trainer Role

    Generative AI Architect- Customer Experience -Trainer Role

    Patch the SkillKolhapur, IN
    The ideal candidate will be a qualified architect who is able to construct clear diagrams using AutoCAD.This candidate should have an in-depth knowledge of all steps related to project completion a...Show moreLast updated: 5 days ago
    • Promoted
    • New!
    Director of Data Engineering – 100% Remote

    Director of Data Engineering – 100% Remote

    Hyly.AIKolhapur, IN
    Remote
    AI is multifamily’s only Intelligence Fabric™, weaving Artificial, Business, and Human intelligence into one operating system for growth. The company connects raw data to decisions, decisions to act...Show moreLast updated: 8 hours ago
    • Promoted
    Quality Assurance Engineer - AI

    Quality Assurance Engineer - AI

    TerraFinn Technologies, MumbaiKolhapur, IN
    We are seeking a highly skilled.Automation QA Engineer with expertise in AI-driven testing.The ideal candidate will have strong experience in building automated test frameworks, integrating AI / ML t...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Solutions Architect – Data & Analytics (Life Sciences)

    Senior Solutions Architect – Data & Analytics (Life Sciences)

    Celito Tech, Inc.Kolhapur, IN
    Job Title : Senior Solutions Architect – Data & Analytics (Life Sciences).Timings : Can extend upto 11 pm IST.The Celito Team architects the buildout of simplified, integrated, and compliant technol...Show moreLast updated: 6 days ago
    • Promoted
    Vice President, Data Engineering & Architecture

    Vice President, Data Engineering & Architecture

    Three AcrossKolhapur, IN
    Role : - Vice President – Data Engineering & Architecture.We are seeking a hands-on and visionary leader to serve as Vice President – Data Engineering & Architecture. This role will drive digital tran...Show moreLast updated: 14 days ago
    • Promoted
    Lead AI Engineer

    Lead AI Engineer

    BlendKolhapur, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show moreLast updated: 11 days ago
    • Promoted
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting SolutionsKolhapur, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior QA Tester – Selenium & AI / ML Validation Technical Interview Panel Expert

    Senior QA Tester – Selenium & AI / ML Validation Technical Interview Panel Expert

    Tek SupportKolhapur, IN
    We are seeking a highly experienced.The ideal candidate will have deep expertise in.Automation & Selenium (Foundational Experience). Selenium WebDriver automation frameworks.Collaborate with develop...Show moreLast updated: 11 hours ago
    • Promoted
    Director Operations - AI-Powered Global Tech Startup

    Director Operations - AI-Powered Global Tech Startup

    SkillsCapitalKolhapur, IN
    We are a high-growth startup revolutionizing how companies access top-tier tech talent.Our proprietary AI / ML / NLP-powered Talent Cloud and Blockchain-based vetting engine enable global clients to hi...Show moreLast updated: 9 days ago
    • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Ironbook AIKolhapur, IN
    Job Description : AI Engineer (AWS AI Stack).We are looking for a highly skilled.You will design, build, and deploy AI systems, collaborate with cross-functional teams, and contribute to scalable, p...Show moreLast updated: 13 days ago
    • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    Aptus Data LabsKolhapur, IN
    Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains.We offer innovative analytical solutions and consulting services to help business...Show moreLast updated: 3 days ago
    • Promoted
    • New!
    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Sky Systems, Inc. (SkySys)Kolhapur, IN
    Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire). Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show moreLast updated: 10 hours ago
    • Promoted
    Senior AI & Automation Engineer

    Senior AI & Automation Engineer

    engineersmindKolhapur, IN
    Role : Senior AI & Automation Engineer.Quality Engineering & Product Assurance.API layers, ensuring seamless integration, performance, and security. This is a hands-on role that requires strong techn...Show moreLast updated: 2 days ago