Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • ajmer, India
No longer accepting applications
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • ajmer, India
1 day ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • ajmer, India

    Related jobs
    Technical Lead - Gen AI

    Technical Lead - Gen AI

    Aceolution • Ajmer, IN
    Freelance Remote Opportunity : Tech Lead – GenAI Code Initiatives.Tech Lead / Senior Software Engineer.AI-driven code generation systems. Write, evaluate, and refine complex code solutions.This is a ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Gen AI Engineer

    Lead Gen AI Engineer

    Impetus • Ajmer, Rajasthan, India
    About the Role : We are looking for a Software Engineer who combines deep data engineering expertise with hands-on experience in Generative AI and Agentic AI system development on AWS Cloud.This rol...Show more
    Last updated: 16 days ago • Promoted
    Team Lead

    Team Lead

    Zensar Technologies • Ajmer, IN
    ZENSAR -TEAM LEAD | PROJECT MANAGER OPPORTUNITY FOR GEN AI PROJECT.Dear Aspirant, Greetings from Zensar!!.We are a technology consulting and services company with over 11,500 associates in 33 globa...Show more
    Last updated: 19 days ago • Promoted
    Qa Team Leader

    Qa Team Leader

    Huxley • Pushkar, Republic Of India, IN
    QA Team Leader – E-Commerce Platform.Join a dynamic development team responsible for building and maintaining large-scale online commerce services. This role focuses on a popular cashback and reward...Show more
    Last updated: 1 day ago • Promoted
    Ai Implementation Manager

    Ai Implementation Manager

    Sutra.AI • Ajmer, Republic Of India, IN
    Role : Senior Implementation Manager.As we expand our delivery footprint, we’re seeking a.Sutra’s implementation workflows into a. The Implementation Leader will own the.AI solution deployments - fro...Show more
    Last updated: 3 days ago • Promoted
    Lead Generation Specialist

    Lead Generation Specialist

    Loyyal • Pushkar, Rajasthan, India
    Company Description Loyyal is a leader in loyalty and payments innovation, offering an advanced Enterprise SaaS Suite powered by patented blockchain technology. Our platform helps loyalty programs e...Show more
    Last updated: 5 days ago • Promoted
    Senior Qa Engineering Lead & Technical Product Manager

    Senior Qa Engineering Lead & Technical Product Manager

    Teachally • Ajmer, Republic Of India, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 5 days ago • Promoted
    AI Implementation Manager

    AI Implementation Manager

    Sutra.AI • Ajmer, Rajasthan, India
    Role : Senior Implementation Manager About Sutra.AI is a rapidly scaling AI Enterprise SaaS platform powering data-to-decision transformations for mid-market and enterprise clients.As we expand...Show more
    Last updated: 3 days ago • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon Galaxy • Pushkar, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show more
    Last updated: 30+ days ago • Promoted
    Senior Quality Engineer

    Senior Quality Engineer

    HiroJet • Pushkar, Rajasthan, India
    Job Title : Quality Assurance Engineer (SIEM / SaaS experience preferred) Location : Remote (India) About Company It is an early-stage cybersecurity startup building a next-generation platform for ...Show more
    Last updated: 3 days ago • Promoted
    Senior QA Lead / QA Manager (GenAI & MLOps Platform)

    Senior QA Lead / QA Manager (GenAI & MLOps Platform)

    Katonic AI • Ajmer, IN
    We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and driv...Show more
    Last updated: 2 days ago • Promoted
    Senior Qa Lead / Qa Manager

    Senior Qa Lead / Qa Manager

    Katonic AI • Ajmer, Republic Of India, IN
    We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and driv...Show more
    Last updated: 2 days ago • Promoted
    QA Team Leader

    QA Team Leader

    Huxley • Ajmer, IN
    QA Team Leader – E-Commerce Platform.Join a dynamic development team responsible for building and maintaining large-scale online commerce services. This role focuses on a popular cashback and reward...Show more
    Last updated: 1 day ago • Promoted
    Remote GenAI Engineer

    Remote GenAI Engineer

    EazyML • Ajmer, IN
    Remote
    Founded by Bell Labs research veterans, and associated with breakthrough startups like Amelia, EazyML, specializes in Transparent Machine Learning. Early on EazyML founders saw the need for Transpa...Show more
    Last updated: 30+ days ago • Promoted
    Technical Lead

    Technical Lead

    Mphasis • Ajmer, IN
    Looking for Senior Ingenium Developer with 10+ years' experience and following skills.Experience in Mainframe O / S and Development using COBOL programming language & JCL. Experience in development an...Show more
    Last updated: 7 days ago • Promoted
    Lead Gen Ai Engineer

    Lead Gen Ai Engineer

    Impetus • Ajmer, Republic Of India, IN
    We are looking for a Software Engineer who combines deep data engineering expertise with hands-on experience in Generative AI and Agentic AI system development on AWS Cloud.This role is ideal for s...Show more
    Last updated: 16 days ago • Promoted
    Senior QA Engineering Lead & Technical Product Manager

    Senior QA Engineering Lead & Technical Product Manager

    Teachally • Ajmer, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 6 days ago • Promoted
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdge • Pushkar, IN
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show more
    Last updated: 23 days ago • Promoted