Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • vizianagaram, India
No longer accepting applications
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • vizianagaram, India
9 days ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • vizianagaram, India

    Related jobs
    Senior Manual QA Engineer

    Senior Manual QA Engineer

    Intellias • vizianagaram, andhra pradesh, in
    Work within UK business hours (8 : 00 - 17 : 00).Experience in writing manual tests.Able to construct manual test scripts. Write test plans based on project requirements.Project management tools - Jira ...Show more
    Last updated: 13 hours ago • Promoted • New!
    Senior GenAI Engineer

    Senior GenAI Engineer

    Mitra AI • vizianagaram, andhra pradesh, in
    AI System Design & Development : .Architect, develop, and deploy large-scale Generative AI, LLM-based systems, including intelligent agents and automation workflows. LLM Integration & Optimization : .In...Show more
    Last updated: 14 days ago • Promoted
    Senior Implementation Specialist (PowerScale / Isilon)

    Senior Implementation Specialist (PowerScale / Isilon)

    Norwin Technologies • vizianagaram, andhra pradesh, in
    Senior Implementation Specialist.Interested candidates can share profile on anjalihb@norwintechnologies.Administer and optimize PowerScale clusters across Multi-potocols (NFS / SMB / HDFS / S3) environme...Show more
    Last updated: 1 day ago • Promoted
    SDK QA Engineer

    SDK QA Engineer

    Revolut • vizianagaram, India
    QA Engineer for SDKs – Analytics & Metrics Platform.Join a team dedicated to building a large-scale data and analytics platform that aggregates online and offline data to enable advanced analysis a...Show more
    Last updated: 8 hours ago • Promoted • New!
    QA Consultant – ETL & API Testing (MDM Preferred)

    QA Consultant – ETL & API Testing (MDM Preferred)

    Askzenix Technologies Pvt. Ltd. (Formerly known as Askme Technologies) • vizianagaram, andhra pradesh, in
    We are looking for a QA Consultant with strong hands-on experience in ETL / Data Pipeline Testing and API Testing.Experience with MDM Testing is preferred. The ideal candidate will have strong SQL ski...Show more
    Last updated: 3 days ago • Promoted
    Quality Assurance Engineer

    Quality Assurance Engineer

    TransFi • vizianagaram, India
    QA Engineer (Automation+ Manual).Fintech / Web3 (preferred but not mandatory).TransFi powers the world’s payments, helping businesses and individuals access better ways to move money.Combining indu...Show more
    Last updated: 30+ days ago • Promoted
    Senior JavaScript QA

    Senior JavaScript QA

    Luxoft • vizianagaram, andhra pradesh, in
    Our Client is on a mission to build the IPO process support of the future, and we're looking for passionate collaborators, innovators, advisors, and leaders who can get us there.As a QA Engineer, y...Show more
    Last updated: 30+ days ago • Promoted
    Technical Lead

    Technical Lead

    RapidBrains • vizianagaram, andhra pradesh, in
    We are looking for an experienced Technical Lead who can architect scalable systems, mentor development teams, and guide complex projects from concept to deployment. You’ll partner closely with Prod...Show more
    Last updated: 3 days ago • Promoted
    Lead QA – Automated Testing & AI Validation

    Lead QA – Automated Testing & AI Validation

    RapidBrains • vizianagaram, andhra pradesh, in
    Lead QA – Automated Testing & AI Validation.We are seeking a Lead QA – Automated Testing & AI Validation with strong expertise in Python automation, LLM evaluation, RAG pipelines, observability, ad...Show more
    Last updated: 13 hours ago • Promoted • New!
    Senior Manual Qa Engineer

    Senior Manual Qa Engineer

    Intellias • Vizianagaram, Republic Of India, IN
    Work within UK business hours (8 : 00 - 17 : 00).Experience in writing manual tests.Able to construct manual test scripts. Write test plans based on project requirements.Project management tools - Jira ...Show more
    Last updated: 2 hours ago • Promoted • New!
    Lead AIML

    Lead AIML

    Mulya Technologies • vizianagaram, andhra pradesh, in
    We are a US based Stealth mode Start-up.Hyderabad / Bangalore / Remote ( any where in India ).We unify the processes used in Semiconductor and Hardware Systems design - thus reducing bugs, improvin...Show more
    Last updated: 17 hours ago • Promoted • New!
    AWS Tech Lead - Contract

    AWS Tech Lead - Contract

    Gravity Infosolutions, Inc. • vizianagaram, India
    Participate in refining and scoping upcoming sprint work.Assist solution architects with technical design and breaking down complex tasks. Accountable for timely delivery of assigned tickets, meetin...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior SAP Consultant

    Senior SAP Consultant

    Net2Source (N2S) • Vizianagaram, Andhra Pradesh, India
    We Are Hiring : SAP Production Planning (SAP PP / QM) – Sr.Functional Analyst Location : Remote (Bangalore, KA) Shift Timing : 1 PM – 10 PM IST Experience : 12+ years One of our premium clients is lo...Show more
    Last updated: 1 day ago • Promoted
    Senior Solutions Architect – Mobility DataOps

    Senior Solutions Architect – Mobility DataOps

    iMerit Technology • vizianagaram, andhra pradesh, in
    The Solutions Architect is the strategic designer of iMerit’s Mobility DataOps ecosystem.This role defines the work before the work begins—turning complex client requirements, data flows, and tool ...Show more
    Last updated: 17 hours ago • Promoted • New!
    Sr Manager Analytics

    Sr Manager Analytics

    Live Connections • vizianagaram, andhra pradesh, in
    Required Notice Period - Immediate Joiners or Serving Notice Period.Should have a technical background.Should be working on production projects. Required Skills and Qualifications.Proven experience ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Genai Engineer

    Senior Genai Engineer

    Mitra AI • Vizianagaram, Republic Of India, IN
    AI System Design & Development : .Architect, develop, and deploy large-scale Generative AI, LLM-based systems, including intelligent agents and automation workflows. LLM Integration & Optimization : .In...Show more
    Last updated: 14 days ago • Promoted
    SAP S / 4HANA R2R Functional Lead (FI / CO)

    SAP S / 4HANA R2R Functional Lead (FI / CO)

    Sky Systems, Inc. (SkySys) • vizianagaram, andhra pradesh, in
    SAP S / 4HANA Functional Lead Record to Report (R2R).Full-Time Contract (40hrs / week).We are seeking an experienced SAP S / 4HANA R2R Functional Lead to drive and optimize financial processes across SAP...Show more
    Last updated: 1 day ago • Promoted
    Senior Quality Assurance Engineer

    Senior Quality Assurance Engineer

    IntraEdge • vizianagaram, andhra pradesh, in
    We are looking for a detail-oriented QA Engineer to join our dynamic team.This role involves ensuring the delivery of high-quality software solutions by designing and executing effective test strat...Show more
    Last updated: 13 hours ago • Promoted • New!