Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • bhopal, India
No longer accepting applications
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • bhopal, India
2 days ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • bhopal, India

    Related jobs
    Senior / Lead QA Automation_India

    Senior / Lead QA Automation_India

    Luxoft • Bhopal, Madhya Pradesh, India
    Project Description : We have an ambitious goal to migrate a legacy system written in HLASM (High-Level Assembler) from the mainframe to a cloud-based Java environment for one of the largest banks in...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior Software Engineer

    Senior Software Engineer

    Programmers.io • bhopal, madhya pradesh, in
    We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team.The ideal candidate will have deep expertise in Microsoft Azure data services, cloud-based data engineeri...Show more
    Last updated: 30+ days ago • Promoted
    Lead Generation Specialist

    Lead Generation Specialist

    Confidential • Bhopal, India
    We are looking for an experienced Lead Generation Expert with a proven track record of delivering ROI-driven results.The ideal candidate will be well-versed in generating high-quality leads for IT ...Show more
    Last updated: 27 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • bhopal, madhya pradesh, in
    We offer a vibrant and collaborative work environment, cutting-edge tools and technologies, and ample opportunities for professional growth. Job Title : Azure Data Architect.Experience required : 15+ ...Show more
    Last updated: 16 days ago • Promoted
    Lead Quality Assurance Engineer - Manual / Automation Testing

    Lead Quality Assurance Engineer - Manual / Automation Testing

    Kadel Labs Private Limited • Bhopal
    About Kadel Labs : Kadel Labs is a leading IT services company delivering top-quality technology solutions since 2017, focused on enhancing business operations and pr...Show more
    Last updated: 3 days ago • Promoted
    Senior System Engineer

    Senior System Engineer

    ZoofyTechX • bhopal, madhya pradesh, in
    IT solutions partner helping businesses bridge the gap between their goals and the right technology.We support organizations in identifying, integrating, and managing solutions across hardware, sof...Show more
    Last updated: 6 hours ago • Promoted • New!
    Machine Learning Engineer

    Machine Learning Engineer

    Recro • bhopal, madhya pradesh, in
    What would you be doing / Expected from this role?.Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.Drive the archite...Show more
    Last updated: 30+ days ago • Promoted
    Lead Software Engineer

    Lead Software Engineer

    Confidential Jobs • bhopal, madhya pradesh, in
    Lead Backend-heavy Fullstack Engineers.AI powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and driv...Show more
    Last updated: 30+ days ago • Promoted
    Senior Lead Architect / Solution Architect

    Senior Lead Architect / Solution Architect

    Core Minds Tech SOlutions • Bhopal
    Job Description : As a Senior Lead Architect you will be an integral part of a team that works to develop high-quality architecture solutions for various software applications...Show more
    Last updated: 30+ days ago • Promoted
    Senior IT Product Manager

    Senior IT Product Manager

    Core Minds Tech SOlutions • Bhopal
    Job Description : Roles and Responsibilities : - Product Strategy & Vision : Collaborate with stakeholders to define and ...Show more
    Last updated: 30+ days ago • Promoted
    SAP Developer

    SAP Developer

    Digital Skills ltd • bhopal, madhya pradesh, in
    Convergent Mediation Senior Developer (SAP BRIM).Rate : Negotiable dependent on experience.Remote – Must work to CET timezone. We’re working with a leading global travel company looking for an experi...Show more
    Last updated: 15 days ago • Promoted
    Technotask Business Solutions - Manager - Middle Mile Operations

    Technotask Business Solutions - Manager - Middle Mile Operations

    TECHNOTASK BUSINESS SOLUTIONS PRIVATE LIMITED • Bhopal, India
    Accountable for all Hub Operations under the span of control and seek intervention from superior as appropriate.Ensure Profitable operations in the region. Continuously improve in reducing Error rat...Show more
    Last updated: 30+ days ago • Promoted
    Technotask Business Solutions - Sales & Growth Specialist

    Technotask Business Solutions - Sales & Growth Specialist

    TECHNOTASK BUSINESS SOLUTIONS PRIVATE LIMITED • Bhopal, India
    About : - Manage and optimise Google My Business and other business listing sites to improve local SEO.Execute social media campaigns, including conte...Show more
    Last updated: 18 days ago • Promoted
    Quality Assurance Manager - Manual & Automation Testing

    Quality Assurance Manager - Manual & Automation Testing

    TECHNOTASK BUSINESS SOLUTIONS PRIVATE LIMITED • Bhopal
    Description : - Lead and manage the entire testing lifecycle including test strategy, planning, design, execution, automation, and reporting.Desig...Show more
    Last updated: 30+ days ago • Promoted
    Senior Technical Business Analyst - Agile / Scrum Methodologies

    Senior Technical Business Analyst - Agile / Scrum Methodologies

    Kadel Labs Private Limited • Bhopal
    Description : About Kadel Labs : Kadel Labs is a leading IT services company delivering top-quality technology solutions since 2017, focused on...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Torinit • Bhopal, Madhya Pradesh, India
    Machine Learning Engineer (3–5 Years Experience)OverviewTorinit Technologies Inc.Canadian-based digital consulting company. At Torinit, we don't just serve our clients; we work with them to create t...Show more
    Last updated: 2 hours ago • Promoted • New!
    Engineering Lead

    Engineering Lead

    Altellect • Bhopal, Madhya Pradesh, India
    We’re Hiring : Engineering Lead | Altellect Koramangala, Bangalore | 5 Days WFO Reports to : Head of Technology Altellect is building the next generation of intelligent, high-growth, product-led v...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Capace Software - Manager - Business Development

    Capace Software - Manager - Business Development

    Capace Software Private Limited • Bhopal, India
    About the Role : We are seeking a results-driven Business Development Specialist to join our growing team.The ideal candidate will be responsible for identifying new business op...Show more
    Last updated: 29 days ago • Promoted