Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • India, India
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • India, India
3 hours ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :   https : / / shorturl.at / Of9gU

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • India, India

    Related jobs
    Senior Lead

    Senior Lead

    Tata Communications • India
    Responsible for managing customer queries related to all services and solutions delivered, including diagnosing, and resolving complex technical issues in respective areas of Network / SDWAN / Cloud & ...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Lead Engineer - Platform [T500-19638]

    Senior Lead Engineer - Platform [T500-19638]

    REA Cyber City • India
    In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question : “Can we change the way the world experiences property?”. Fast forward 30 years, REA Group is a market leader ...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdge • nagpur, maharashtra, in
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show more
    Last updated: 20 days ago • Promoted
    Senior Technical Lead - IBM MQ / ACE

    Senior Technical Lead - IBM MQ / ACE

    HCLTech • India
    The primary purpose of this role is to support the IT Business in managing Integration solutions comprised of both proprietary and open-source components, including provisioning, configuring, deplo...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Qa Lead

    Data Qa Lead

    Persistent Systems • Pune, Republic Of India, IN
    We are seeking QA Lead for Data Projects with expertise in ETL testing, SQL, and visualization testing using Power BI, plus working knowledge of Snowflake, Python, and DBT.Location : All Persistent ...Show more
    Last updated: 17 days ago • Promoted
    Senior QA Engineer

    Senior QA Engineer

    Huptech HR Solutions • Nagpur, IN
    QA Engineer (Automation + Manual).Location : Remote (Candidate should reside in India).The Quality Assurance Engineer will be responsible for ensuring the product quality through the planning and ex...Show more
    Last updated: 20 days ago • Promoted
    Senior QA Engineer

    Senior QA Engineer

    TransPerfect • India
    Client seeks experienced Senior QA Engineers to ensure the quality and reliability of mission-critical software and hardware systems. Lead QA planning and execution for complex projects.Develop auto...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior QA Engineer – IGA Platform

    Senior QA Engineer – IGA Platform

    Indexnine Technologies • India
    Identity Governance & Administration (IGA) modules.Saviynt, SailPoint, or similar IGA / IAM platforms.IGA modules (Provisioning, Lifecycle Management, Access Reviews). UI and API automation frameworks...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior QA Engineer - IoT

    Senior QA Engineer - IoT

    TransPerfect • India
    We are seeking a Senior QA Engineer with extensive experience testing connected devices, firmware, companion apps, cloud interfaces, leading quality strategy, and driving end-to-end testing across ...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data QA Lead

    Data QA Lead

    Persistent Systems • India
    We are seeking QA Lead for Data Projects with expertise in ETL testing, SQL, and visualization testing using Power BI, plus working knowledge of Snowflake, Python, and DBT.Location : All Persistent ...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Technical Lead

    Senior Technical Lead

    Straive • India
    Lead the design, development, and implementation of high-quality software solutions.Provide effective technical guidance and mentorship to a project team of 5+ members. Apply strong programming skil...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior QA

    Senior QA

    Net2Source (N2S) • India
    Join a Global Leader in Workforce Solutions – Net2Source Inc.Operating in 32 countries | 5,500+ Employees.Hands-on experience on trade product life cycle such as import LC, Export LC, Collections, ...Show more
    Last updated: 3 hours ago • Promoted • New!
    Associate | Senior QA Engineer [T500-20983]

    Associate | Senior QA Engineer [T500-20983]

    Deutsche Börse Group • India
    Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and com...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior QA Engineer (5-8 years)

    Senior QA Engineer (5-8 years)

    Landmark Group • India
    About the Role- We are looking for a highly skilled.Tooling and AI Automation Engineer with 5-8 years.Automation team—not in a traditional application testing but as a specialist focused on buildin...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior QA Engineering Lead & Technical Product Manager

    Senior QA Engineering Lead & Technical Product Manager

    Teachally • Nagpur, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 3 days ago • Promoted
    Senior Associate | Lead QA Engineer [T500-20982]

    Senior Associate | Lead QA Engineer [T500-20982]

    Deutsche Börse Group • India
    Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and com...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Qa Engineer - Iot

    Senior Qa Engineer - Iot

    TransPerfect • Pune, Republic Of India, IN
    We are seeking a Senior QA Engineer with extensive experience testing connected devices, firmware, companion apps, cloud interfaces, leading quality strategy, and driving end-to-end testing across ...Show more
    Last updated: 9 days ago • Promoted
    Senior IoT Embeded QA Engineer

    Senior IoT Embeded QA Engineer

    Freespace • India
    Location : Embassy 247, Vikhroli, Mumbai.Workplace type : In-office, Hybrid.Other skills we consider : (3As) Adaptability, Accountability and Attention to detail . We’re a workplace technology company ...Show more
    Last updated: 9 hours ago • Promoted • New!