Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • gurgaon, haryana, in
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • gurgaon, haryana, in
3 days ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :   https : / / shorturl.at / Of9gU

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • gurgaon, haryana, in

    Related jobs
    Senior QA- Lead

    Senior QA- Lead

    Confidential • Gurgaon / Gurugram
    We are seeking a highly motivated and experienced Senior Executive in Quality Assurance (QA) to join our team.As a AGM- QA with 7-8 years of experience, you will play a key role in ensuring the qua...Show more
    Last updated: 11 days ago • Promoted
    QA Lead01

    QA Lead01

    Harman Becker Automotive Systems Manufacturing Kft • Gurgaon, Haryana, India
    HARMANs engineers and designers are creative purposeful and agile.As part of this team youll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car e...Show more
    Last updated: 30+ days ago • Promoted
    QA Lead

    QA Lead

    Shipway by Unicommerce • Gurgaon, India
    We are looking for a dedicated QA Lead with over 6 years of experience to join our team.The ideal candidate will have a strong background in both Manual and Automation Testing.Lead the QA team in d...Show more
    Last updated: 30+ days ago • Promoted
    One MobiKwik Systems - Senior Director - Quality Assurance

    One MobiKwik Systems - Senior Director - Quality Assurance

    ONE MOBIKWIK SYSTEMS LIMITED • Gurgaon, India
    India's leading Digital Financial Services platform & Largest Digital Wallet, trusted by over 167 million users & 4.As a pioneer in the Fintech space, Mobikwik empowers its users with ...Show more
    Last updated: 30+ days ago • Promoted
    Gen AI Senior Tech Lead

    Gen AI Senior Tech Lead

    Virtusa • Gurgaon, Haryana, India
    Extensive implementation experience in data analytics space or a senior developer role in one of the modern technology stack Excellent programming skills and proficiency in at least one of the maj...Show more
    Last updated: 8 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    NextDimension AI • Gurugram, Haryana, India
    INR 12-30 LPA Base + Bonus + Equity.NextDimension is a US-based technology startup building AI Agents in Healthcare, established by a team of distinguished AI / ML Scientists and Engineers from Googl...Show more
    Last updated: 5 days ago • Promoted
    Senior Manager - Analytics & Platform Enablement

    Senior Manager - Analytics & Platform Enablement

    Confidential • Gurugram, Gurgaon / Gurugram, India
    Role : Senior Manager - Data & System Integrations – CRM, Analytics & Platform Enablement.Performance Lead – Digital & Martech. VML, a WPP company, is a global powerhouse born from the unification of...Show more
    Last updated: 27 days ago • Promoted
    Senior Engineer - Solutions QA

    Senior Engineer - Solutions QA

    Confidential • Delhi, Delhi NCR
    Participate in test planning activities with Solution Architects for Integration, UAT, and HAT cases.Verify and validate JSON data structures for solution accuracy. Conduct end-to-end solution testi...Show more
    Last updated: 27 days ago • Promoted
    Senior QA Engineer

    Senior QA Engineer

    Confidential • Gurgaon / Gurugram, India
    Konrad is a next generation digital consultancy.We are dedicated to solving complex business problems for our global clients with creative and forward-thinking solutions. Our employees enjoy a cultu...Show more
    Last updated: 27 days ago • Promoted
    Senior Manager AI / ML

    Senior Manager AI / ML

    VAYUZ Technologies • Gurugram, Haryana, India
    Your experience should include.AI / ML leadership roles as a people manager, in an agile Technology / SaaS business, with a portfolio of large-scale AI / ML solutions, deployed globally.Confirmed experti...Show more
    Last updated: 2 days ago • Promoted
    Senior Manager - Analytics & Generative AI

    Senior Manager - Analytics & Generative AI

    Athena • Gurugram
    Description : Job Responsibilities : - Develop and implement AI models and pipelines, leveraging LLMs to ...Show more
    Last updated: 7 days ago • Promoted
    Senior Product Manager

    Senior Product Manager

    boAt Lifestyle • Gurugram, Haryana, India
    Product Management (Mobile Accessories).Product Lead for boAt’s Mobile Accessories division.This role demands strong ownership, cross-functional leadership, and an ability to take products from con...Show more
    Last updated: 4 days ago • Promoted
    Senior QA Engineer - ll

    Senior QA Engineer - ll

    Confidential • Gurgaon / Gurugram
    Create and develop automated tests for product features and optimize them within CI / CD pipelines.Collaborate with developers to create and execute test plans for new features prior to release.Deter...Show more
    Last updated: 27 days ago • Promoted
    Senior Engineer - Solution QA

    Senior Engineer - Solution QA

    Confidential • Gurgaon / Gurugram
    Solution Architects for Integration, UAT, and HAT cases.JSONs, and validation of data flows across systems.Automate functional and non-functional test scenarios. Grafana or similar visualization too...Show more
    Last updated: 27 days ago • Promoted
    Delivery Lead-Qual & Quant

    Delivery Lead-Qual & Quant

    Acuity Knowledge Partners • Gurugram, Haryana, India
    Preparing pitch books, industry reports, deals and peers screening, company profiles, macroeconomic updates and company focused discussion documents related to various industries.Preparing financia...Show more
    Last updated: 5 days ago • Promoted
    QA Lead

    QA Lead

    Confidential • Gurgaon / Gurugram
    What you will be doing at Evalueserve : .Solid understanding of software testing methodologies, principles, and best practice. Writes performant SQL statement to analyze data with Hive / Impala / Oracle.E...Show more
    Last updated: 28 days ago • Promoted
    Senior / QA Engineer

    Senior / QA Engineer

    Confidential • Gurugram, Gurgaon / Gurugram, India
    Paxcom a leading Digital Solution Provider is a part of Paymentus now, a leading electronic bill payment provider.PaymentUs leads the North American marketplace in electronic bill payment solutions...Show more
    Last updated: 27 days ago • Promoted
    Senior / Lead QA Automation_India

    Senior / Lead QA Automation_India

    Luxoft • Gurgaon, India
    We have an ambitious goal to migrate a legacy system written in HLASM (High-Level Assembler) from the mainframe to a cloud-based Java environment for one of the largest banks in the USA.We are seek...Show more
    Last updated: less than 1 hour ago • Promoted • New!