Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • ajmer, India
No longer accepting applications
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • ajmer, India
1 day ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • ajmer, India

    Related jobs
    Technical Lead - Gen AI

    Technical Lead - Gen AI

    Aceolution • Ajmer, IN
    Freelance Remote Opportunity : Tech Lead – GenAI Code Initiatives.Tech Lead / Senior Software Engineer.AI-driven code generation systems. Write, evaluate, and refine complex code solutions.This is a ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Gen AI Engineer

    Lead Gen AI Engineer

    Impetus • Ajmer, Rajasthan, India
    About the Role : We are looking for a Software Engineer who combines deep data engineering expertise with hands-on experience in Generative AI and Agentic AI system development on AWS Cloud.This rol...Show more
    Last updated: 16 days ago • Promoted
    Remote GenAI Engineer

    Remote GenAI Engineer

    EazyML • Pushkar, IN
    Remote
    Founded by Bell Labs research veterans, and associated with breakthrough startups like Amelia, EazyML, specializes in Transparent Machine Learning. Early on EazyML founders saw the need for Transpa...Show more
    Last updated: 30+ days ago • Promoted
    Team Lead

    Team Lead

    Zensar Technologies • Pushkar, IN
    ZENSAR -TEAM LEAD | PROJECT MANAGER OPPORTUNITY FOR GEN AI PROJECT.Dear Aspirant, Greetings from Zensar!!.We are a technology consulting and services company with over 11,500 associates in 33 globa...Show more
    Last updated: 19 days ago • Promoted
    Senior QA Engineering Lead & Technical Product Manager

    Senior QA Engineering Lead & Technical Product Manager

    Teachally • Pushkar, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 5 days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Torinit • Ajmer, IN
    Machine Learning Engineer (3–5 Years Experience).Canadian-based digital consulting company.At Torinit, we don't just serve our clients. we work with them to create transformative digital journeys b...Show more
    Last updated: 5 days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Piramal Finance • Pushkar, Rajasthan, India
    Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show more
    Last updated: 21 days ago • Promoted
    Senior Dell Boomi Integration Engineer

    Senior Dell Boomi Integration Engineer

    Maitsys • Ajmer, IN
    Job Description : Senior Boomi Integration Engineer.Atom migration (on-prem → cloud), integration development, and ongoing support. Senior Dell Boomi Integration Engineer.Boomi Atom to a cloud-hosted...Show more
    Last updated: 8 days ago • Promoted
    Senior Qa Lead / Qa Manager

    Senior Qa Lead / Qa Manager

    Katonic AI • Ajmer, Republic Of India, IN
    We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and driv...Show more
    Last updated: 2 days ago • Promoted
    QA Team Leader

    QA Team Leader

    Huxley • Ajmer, IN
    QA Team Leader – E-Commerce Platform.Join a dynamic development team responsible for building and maintaining large-scale online commerce services. This role focuses on a popular cashback and reward...Show more
    Last updated: 1 day ago • Promoted
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdge • Ajmer, IN
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show more
    Last updated: 22 days ago • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon Galaxy • Ajmer, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show more
    Last updated: 30+ days ago • Promoted
    Technical Lead

    Technical Lead

    Mphasis • Ajmer, IN
    Looking for Senior Ingenium Developer with 10+ years' experience and following skills.Experience in Mainframe O / S and Development using COBOL programming language & JCL. Experience in development an...Show more
    Last updated: 7 days ago • Promoted
    Senior Growth Consultant - Quality Team Lead

    Senior Growth Consultant - Quality Team Lead

    Convin • Ajmer, Rajasthan, India
    Senior Growth Consultant – Quality Team Lead About Convin Convin is a Conversation Intelligence platform built by IIT Delhi alumni to transform sales, collections, and customer experience.With our...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior QA Lead / QA Manager (GenAI & MLOps Platform)

    Senior QA Lead / QA Manager (GenAI & MLOps Platform)

    Katonic AI • Pushkar, IN
    We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and driv...Show more
    Last updated: 2 days ago • Promoted
    Lead Generation Specialist

    Lead Generation Specialist

    NyxaLabs • pushkar, gujarat, in
    We're looking for a results-oriented Offshore Lead Generation Specialist with proven experience generating high-quality B2B service leads for US and international markets.This role demands someone ...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior QA Automation

    Senior QA Automation

    Hellowork Consultants • Pushkar, Rajasthan, India
    Role : Sr QA Automation Experience : 5 to 8 Years Location : Hyderabad Work Mode : Hybrid Notice Period : Immediate to 15 Days Job Description At least 5 to 8 years’ experience in testing Overall, 1 ye...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior Manager, New Initiatives

    Senior Manager, New Initiatives

    Knowledge Networks • Pushkar, Rajasthan, India
    Location : Flexible (Remote) | Employment Type : Full-Time | Reports To : Founder & President About Knowledge Networks Knowledge Networks (KN) is a global platform driving responsible AI govern...Show more
    Last updated: 13 days ago • Promoted