Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • Pushkar, IN
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • Pushkar, IN
1 day ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :   https : / / shorturl.at / Of9gU

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • Pushkar, IN

    Related jobs
    Technical Lead

    Technical Lead

    INFIGER - GRATASTE • Ajmer, IN
    We are building a technology-driven consumer platform focused on improving everyday lifestyle experiences through structured systems, smart operations, and seamless digital interaction.Our mission ...Show more
    Last updated: 17 hours ago • Promoted • New!
    Lead Generation Specialist

    Lead Generation Specialist

    Loyyal • Ajmer, IN
    Loyyal is a leader in loyalty and payments innovation, offering an advanced Enterprise SaaS Suite powered by patented blockchain technology. Our platform helps loyalty programs enhance customer enga...Show more
    Last updated: 4 days ago • Promoted
    Senior QA Engineering Lead & Technical Product Manager

    Senior QA Engineering Lead & Technical Product Manager

    Teachally • Pushkar, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 4 days ago • Promoted
    Senior Qa Engineering Lead & Technical Product Manager

    Senior Qa Engineering Lead & Technical Product Manager

    Teachally • Ajmer, Republic Of India, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 4 days ago • Promoted
    Qa Team Leader

    Qa Team Leader

    Huxley • Ajmer, Republic Of India, IN
    QA Team Leader – E-Commerce Platform.Join a dynamic development team responsible for building and maintaining large-scale online commerce services. This role focuses on a popular cashback and reward...Show more
    Last updated: 4 hours ago • Promoted • New!
    Senior QA Engineer

    Senior QA Engineer

    Huptech HR Solutions • Pushkar, IN
    QA Engineer (Automation + Manual).Location : Remote (Candidate should reside in India).The Quality Assurance Engineer will be responsible for ensuring the product quality through the planning and ex...Show more
    Last updated: 21 days ago • Promoted
    Technical Lead - Gen AI

    Technical Lead - Gen AI

    Aceolution • Pushkar, IN
    Freelance Remote Opportunity : Tech Lead – GenAI Code Initiatives.Tech Lead / Senior Software Engineer.AI-driven code generation systems. Write, evaluate, and refine complex code solutions.This is a ...Show more
    Last updated: 30+ days ago • Promoted
    Senior QA Lead / QA Manager (GenAI & MLOps Platform)

    Senior QA Lead / QA Manager (GenAI & MLOps Platform)

    Katonic AI • Ajmer, IN
    We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and driv...Show more
    Last updated: 1 day ago • Promoted
    QA Team Leader

    QA Team Leader

    Huxley • Ajmer, IN
    QA Team Leader – E-Commerce Platform.Join a dynamic development team responsible for building and maintaining large-scale online commerce services. This role focuses on a popular cashback and reward...Show more
    Last updated: 17 hours ago • Promoted • New!
    Senior Qa Lead / Qa Manager

    Senior Qa Lead / Qa Manager

    Katonic AI • Ajmer, Republic Of India, IN
    We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and driv...Show more
    Last updated: 1 day ago • Promoted
    Technical Lead

    Technical Lead

    Mphasis • Ajmer, IN
    Looking for Senior Ingenium Developer with 10+ years' experience and following skills.Experience in Mainframe O / S and Development using COBOL programming language & JCL. Experience in development an...Show more
    Last updated: 6 days ago • Promoted
    Senior AI / ML Cloud Engineer – Graph Analytics Platform

    Senior AI / ML Cloud Engineer – Graph Analytics Platform

    ContexQ • Pushkar, IN
    Senior AI / ML Cloud Engineer – Graph Analytics Platform.ContexQ, a Singapore-based B2B SaaS AI startup, is dedicated to transforming financial crime, fraud, and risk management through a groundbre...Show more
    Last updated: 5 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Ajmer, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 17 days ago • Promoted
    Senior Product Manager

    Senior Product Manager

    Grizmo Labs • Ajmer, IN
    Lead the product strategy and roadmap for enterprise-grade SaaS products.Collaborate with cross-functional teams to define, prioritize, and deliver impactful features. Use data-driven insights to so...Show more
    Last updated: 4 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Pushkar, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 18 days ago • Promoted
    QA Engineer

    QA Engineer

    Embitel Technologies • Pushkar, IN
    We are seeking an experienced and detail-oriented QA Lead with over 6 years of expertise in quality assurance and test automation. The ideal candidate will have strong technical skills in Cypress, C...Show more
    Last updated: 21 days ago • Promoted
    Senior Quality Engineer

    Senior Quality Engineer

    HiroJet • Ajmer, IN
    Job Title : Quality Assurance Engineer (SIEM / SaaS experience preferred).It is an early-stage cybersecurity startup building a next-generation platform for security data analytics.We process and qu...Show more
    Last updated: 2 days ago • Promoted
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdge • Pushkar, IN
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show more
    Last updated: 21 days ago • Promoted