Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • Pushkar, IN
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • Pushkar, IN
2 days ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :   https : / / shorturl.at / Of9gU

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • Pushkar, IN

    Related jobs
    Lead Gen AI Engineer

    Lead Gen AI Engineer

    Impetus • ajmer, rajasthan, in
    We are looking for a Software Engineer who combines deep data engineering expertise with hands-on experience in Generative AI and Agentic AI system development on AWS Cloud.This role is ideal for s...Show more
    Last updated: 15 days ago • Promoted
    Senior QA Engineer

    Senior QA Engineer

    Huptech HR Solutions • Ajmer, IN
    QA Engineer (Automation + Manual).Location : Remote (Candidate should reside in India).The Quality Assurance Engineer will be responsible for ensuring the product quality through the planning and ex...Show more
    Last updated: 22 days ago • Promoted
    AI Implementation Manager

    AI Implementation Manager

    Sutra.AI • pushkar, gujarat, in
    Role : Senior Implementation Manager.As we expand our delivery footprint, we’re seeking a.Sutra’s implementation workflows into a. The Implementation Leader will own the.AI solution deployments - fro...Show more
    Last updated: 3 days ago • Promoted
    Technical Lead - Gen AI

    Technical Lead - Gen AI

    Aceolution • Pushkar, IN
    Freelance Remote Opportunity : Tech Lead – GenAI Code Initiatives.Tech Lead / Senior Software Engineer.AI-driven code generation systems. Write, evaluate, and refine complex code solutions.This is a ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Qa Lead / Qa Manager

    Senior Qa Lead / Qa Manager

    Katonic AI • Ajmer, Republic Of India, IN
    We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and driv...Show more
    Last updated: 1 day ago • Promoted
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdge • Ajmer, IN
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show more
    Last updated: 22 days ago • Promoted
    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Lead Quality Assurance Engineer (Backgammon Galaxy)

    Backgammon Galaxy • Ajmer, IN
    Backgammon Galaxy (backgammongalaxy.Remote (HQ in Cyprus) | Full-time.Backgammon Galaxy is the leading web and mobile platform for playing backgammon, with a community of 150,000+ players worldwide...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Piramal Finance • pushkar, gujarat, in
    Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show more
    Last updated: 20 days ago • Promoted
    Team Lead

    Team Lead

    Zensar Technologies • pushkar, gujarat, in
    ZENSAR -TEAM LEAD | PROJECT MANAGER OPPORTUNITY FOR GEN AI PROJECT.Dear Aspirant, Greetings from Zensar!!.We are a technology consulting and services company with over 11,500 associates in 33 globa...Show more
    Last updated: 18 days ago • Promoted
    Senior Qa Engineer

    Senior Qa Engineer

    Huptech HR Solutions • Pushkar, Republic Of India, IN
    QA Engineer (Automation + Manual).Location : Remote (Candidate should reside in India).The Quality Assurance Engineer will be responsible for ensuring the product quality through the planning and ex...Show more
    Last updated: 21 days ago • Promoted
    Senior QA Engineering Lead & Technical Product Manager

    Senior QA Engineering Lead & Technical Product Manager

    Teachally • Ajmer, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 5 days ago • Promoted
    QA Team Leader

    QA Team Leader

    Huxley • Pushkar, IN
    QA Team Leader – E-Commerce Platform.Join a dynamic development team responsible for building and maintaining large-scale online commerce services. This role focuses on a popular cashback and reward...Show more
    Last updated: 1 day ago • Promoted
    Senior Manager, New Initiatives

    Senior Manager, New Initiatives

    Knowledge Networks • Pushkar, Rajasthan, India
    Location : Flexible (Remote) | Employment Type : Full-Time | Reports To : Founder & President About Knowledge Networks Knowledge Networks (KN) is a global platform driving responsible AI govern...Show more
    Last updated: 13 days ago • Promoted
    Senior Iot Qa Engineer

    Senior Iot Qa Engineer

    IntraEdge • Pushkar, Republic Of India, IN
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show more
    Last updated: 21 days ago • Promoted
    Senior Ml Engineer

    Senior Ml Engineer

    Piramal Finance • Ajmer, Republic Of India, IN
    Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show more
    Last updated: 20 days ago • Promoted
    Senior Dell Boomi Integration Engineer

    Senior Dell Boomi Integration Engineer

    Maitsys • ajmer, rajasthan, in
    Job Description : Senior Boomi Integration Engineer.Atom migration (on-prem → cloud), integration development, and ongoing support. Senior Dell Boomi Integration Engineer.Boomi Atom to a cloud-hosted...Show more
    Last updated: 7 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    BeGig • pushkar, gujarat, in
    We are looking for an experienced.The ideal candidate should be proficient in FastAPI, Python, LangChain, and modern AI application design. You will be responsible for designing, developing, and dep...Show more
    Last updated: 1 day ago • Promoted
    Senior Qa Engineering Lead & Technical Product Manager

    Senior Qa Engineering Lead & Technical Product Manager

    Teachally • Pushkar, Republic Of India, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 4 days ago • Promoted