Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • gurgaon, haryana, in
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • gurgaon, haryana, in
2 days ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :   https : / / shorturl.at / Of9gU

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • gurgaon, haryana, in

    Related jobs
    QA Lead

    QA Lead

    Shipway by Unicommerce • Gurgaon, India
    We are looking for a dedicated QA Lead with over 6 years of experience to join our team.The ideal candidate will have a strong background in both Manual and Automation Testing.Lead the QA team in d...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    NextDimension AI • Gurugram, Haryana, India
    INR 12-30 LPA Base + Bonus + Equity.NextDimension is a US-based technology startup building AI Agents in Healthcare, established by a team of distinguished AI / ML Scientists and Engineers from Googl...Show more
    Last updated: 5 days ago • Promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    Zupee • Gurugram, Haryana, India
    Develop, fine-tune, and deploy LLMs for domain-specific generative and conversational use cases.Design and implement Agentic AI workflows integrating tool-use, reasoning, and memory components.Buil...Show more
    Last updated: 30+ days ago • Promoted
    Project Manager – MERN & Product Delivery

    Project Manager – MERN & Product Delivery

    Srchout Software • gurugram, India
    We are looking for an Immediate joiner (0 to 10 days).Project Manager / Technical Manager.Strong understanding of MERN Stack development workflows. Excellent analytical & problem-solving skills.Stro...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior Manager - Analytics & Generative AI

    Senior Manager - Analytics & Generative AI

    Athena • Gurgaon
    Description : Job Responsibilities : - Develop and implement AI models and pipelines, leveraging LLMs to ...Show more
    Last updated: 7 days ago • Promoted
    Senior Manager - L&D (Sales Enablement)

    Senior Manager - L&D (Sales Enablement)

    PeopleStrong • Gurgaon, Haryana, India
    Role Overview We’re looking for a Senior Manager – L&D (Sales Enablement) to lead end-to-end sales training, onboarding, and capability-building for our Sales, Marketing, Demand Gen, and Solu...Show more
    Last updated: 1 day ago • Promoted
    Senior Ml Engineer

    Senior Ml Engineer

    Torinit • Gurgaon, Republic Of India, IN
    Machine Learning Engineer (3–5 Years Experience).Canadian-based digital consulting company.At Torinit, we don't just serve our clients. .Our goal is to create an environment of continuous learning a...Show more
    Last updated: 5 days ago • Promoted
    One MobiKwik Systems - Senior Director - Quality Assurance

    One MobiKwik Systems - Senior Director - Quality Assurance

    ONE MOBIKWIK SYSTEMS LIMITED • Gurugram, India
    India's leading Digital Financial Services platform & Largest Digital Wallet, trusted by over 167 million users & 4.As a pioneer in the Fintech space, Mobikwik empowers its users with ...Show more
    Last updated: 30+ days ago • Promoted
    Senior SAP Analytics Developer - S / 4 HANA Module

    Senior SAP Analytics Developer - S / 4 HANA Module

    Valvoline Global Operations • Gurugram
    Description : The SAP Analytics Developer will be responsible for overseeing data collection, storage, and management.Re...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager - Analytics & Platform Enablement

    Senior Manager - Analytics & Platform Enablement

    Confidential • Gurugram, Gurgaon / Gurugram, India
    Role : Senior Manager - Data & System Integrations – CRM, Analytics & Platform Enablement.Performance Lead – Digital & Martech. VML, a WPP company, is a global powerhouse born from the unification of...Show more
    Last updated: 27 days ago • Promoted
    Senior Manager AI / ML

    Senior Manager AI / ML

    VAYUZ Technologies • Gurugram, Haryana, India
    Your experience should include.AI / ML leadership roles as a people manager, in an agile Technology / SaaS business, with a portfolio of large-scale AI / ML solutions, deployed globally.Confirmed experti...Show more
    Last updated: 2 days ago • Promoted
    Lead AI / ML Engineer

    Lead AI / ML Engineer

    Simelabs - Digital, AI / ML, Automation, Robotics, Gen AI. • gurugram, uttar pradesh, in
    Architect scalable ML pipelines, services, and platforms using modern cloud and MLOps practices.Build, fine-tune, and integrate Generative AI models (LLMs, Vision Models, Multimodal Models) into bu...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior VOIP QA Engineer

    Senior VOIP QA Engineer

    Ecosmob Technologies • gurgaon, haryana, in
    Proficient knowledge in telephony infrastructure and design, including PBX, VoIP and SIP trunking, IVR, SBC, Media Gateways. Clear concept of Manual Testing of VoIP, Web, Mobile App Testing and API ...Show more
    Last updated: 2 hours ago • Promoted • New!
    Qa Lead

    Qa Lead

    Shipway by Unicommerce • Gurgaon, Republic Of India, IN
    We are looking for a dedicated.The ideal candidate will have a strong background in both.Lead the QA team in developing and executing comprehensive test plans and test cases for both manual and aut...Show more
    Last updated: 3 days ago • Promoted
    Corporate QA Head

    Corporate QA Head

    TajSATS • Gurgaon, Haryana, India
    Title : Corporate QA Head Reporting Matrix : Reporting to CEO and Vice President-Operations Reportees : All Regional / Unit QA Managers across Pan India Work Location : Mumbai Function : Quality Assu...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Senior ML Engineer

    Senior ML Engineer

    Torinit • gurugram, India
    Machine Learning Engineer (3–5 Years Experience).Canadian-based digital consulting company.At Torinit, we don't just serve our clients. we work with them to create transformative digital journeys b...Show more
    Last updated: 5 days ago • Promoted
    Lead Reporting & Insights Engineer

    Lead Reporting & Insights Engineer

    Tidyhire • Gurgaon
    Roles and Responsibilities : - Requirement gathering and evaluation of clients' business situations in order to implement appropriate analytic solutions.Designs,...Show more
    Last updated: 10 days ago • Promoted
    QA Lead

    QA Lead

    Confidential • Gurgaon / Gurugram
    What you will be doing at Evalueserve : .Solid understanding of software testing methodologies, principles, and best practice. Writes performant SQL statement to analyze data with Hive / Impala / Oracle.E...Show more
    Last updated: 28 days ago • Promoted