Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • Aurangabad, IN
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • Aurangabad, IN
4 hours ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :   https : / / shorturl.at / Of9gU

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • Aurangabad, IN

    Related jobs
    Senior Qa Engineering Lead & Technical Product Manager

    Senior Qa Engineering Lead & Technical Product Manager

    Teachally • Aurangabad, Republic Of India, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 2 days ago • Promoted
    Technical Lead

    Technical Lead

    Mphasis • Aurangabad, IN
    Looking for Senior Ingenium Developer with 10+ years' experience and following skills.Experience in Mainframe O / S and Development using COBOL programming language & JCL. Experience in development an...Show more
    Last updated: 5 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Aurangabad, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 16 days ago • Promoted
    Senior IoT QA Engineer

    Senior IoT QA Engineer

    IntraEdge • Aurangabad, IN
    Senior IoT QA Engineer (Pune / Hyderabad).We're modernizing a legacy IoT monolith into a microservices-based platform.Seeking a hands-on QA engineer who can quickly grasp the domain and drive both ...Show more
    Last updated: 20 days ago • Promoted
    Technical Lead - Gen AI

    Technical Lead - Gen AI

    Aceolution • Aurangabad, IN
    Freelance Remote Opportunity : Tech Lead – GenAI Code Initiatives.Tech Lead / Senior Software Engineer.AI-driven code generation systems. Write, evaluate, and refine complex code solutions.This is a ...Show more
    Last updated: 30+ days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Torinit • Aurangabad, IN
    Canadian-based digital consulting company.At Torinit, we don't just serve our clients; we work with them to create transformative digital journeys by leveraging the latest technologies and world-cl...Show more
    Last updated: 2 days ago • Promoted
    Senior QA Engineering Lead & Technical Product Manager

    Senior QA Engineering Lead & Technical Product Manager

    Teachally • Aurangabad, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 3 days ago • Promoted
    SAP PPQM

    SAP PPQM

    Tata Consultancy Services • Aurangabad, IN
    Years of experience - 4 - 8 years.Desired Competencies (Technical / Behavioral Competency).SAP PP / QM experience and 2+ years of good domain experience in Variant Configuration and manufacturing.VC / PP...Show more
    Last updated: 14 days ago • Promoted
    Lead Generation Specialist

    Lead Generation Specialist

    Loyyal • Aurangabad, IN
    Loyyal is a leader in loyalty and payments innovation, offering an advanced Enterprise SaaS Suite powered by patented blockchain technology. Our platform helps loyalty programs enhance customer enga...Show more
    Last updated: 3 days ago • Promoted
    Senior QA Engineer

    Senior QA Engineer

    Huptech HR Solutions • Aurangabad, IN
    QA Engineer (Automation + Manual).Location : Remote (Candidate should reside in India).The Quality Assurance Engineer will be responsible for ensuring the product quality through the planning and ex...Show more
    Last updated: 20 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    BeGig • Aurangabad, IN
    We are looking for an experienced.The ideal candidate should be proficient in FastAPI, Python, LangChain, and modern AI application design. You will be responsible for designing, developing, and dep...Show more
    Last updated: 4 hours ago • Promoted • New!
    Senior AI / ML Cloud Engineer – Graph Analytics Platform

    Senior AI / ML Cloud Engineer – Graph Analytics Platform

    ContexQ • Aurangabad, IN
    Senior AI / ML Cloud Engineer – Graph Analytics Platform.ContexQ, a Singapore-based B2B SaaS AI startup, is dedicated to transforming financial crime, fraud, and risk management through a groundbre...Show more
    Last updated: 4 days ago • Promoted
    Module Lead

    Module Lead

    IDfy • Aurangabad, IN
    Location - Pune / Mumbai / Bengaluru.IDfy is Asia’s leading TrustStack, trusted by the best.With global expertise and enterprise-grade tech, we’re solving trust challenges, making compliance easy, frau...Show more
    Last updated: 4 hours ago • Promoted • New!
    Technical Lead

    Technical Lead

    Responsive • Aurangabad, IN
    Responsive is looking for a Technical Lead who combines strong technical expertise with leadership skills to drive complex projects and mentor a team of engineers. In this role, you will take owners...Show more
    Last updated: 4 hours ago • Promoted • New!
    QA Engineer

    QA Engineer

    Embitel Technologies • Aurangabad, IN
    We are seeking an experienced and detail-oriented QA Lead with over 6 years of expertise in quality assurance and test automation. The ideal candidate will have strong technical skills in Cypress, C...Show more
    Last updated: 20 days ago • Promoted
    Senior Product Manager

    Senior Product Manager

    Confidential Jobs • Aurangabad, IN
    Promise this isn’t your usual job post — this one’s genuinely exciting.A global, AI-powered organisation (trusted by.If you love building at scale and shaping the future of AI-driven customer engag...Show more
    Last updated: 1 day ago • Promoted
    Senior QA

    Senior QA

    Net2Source (N2S) • Aurangabad, IN
    Join a Global Leader in Workforce Solutions – Net2Source Inc.Operating in 32 countries | 5,500+ Employees.Hands-on experience on trade product life cycle such as import LC, Export LC, Collections, ...Show more
    Last updated: 4 hours ago • Promoted • New!
    Senior AI Developer

    Senior AI Developer

    PioVation GmbH • Aurangabad, IN
    Cloud Operating System and we need someone who can ship.If you like taking AI from prototype → scalable product, this is for you. Design and ship AI / LLM features that run in production.Build RAG-sty...Show more
    Last updated: 20 days ago • Promoted