Talent.com
Senior QA Lead / QA Manager (GenAI & MLOps Platform)
Senior QA Lead / QA Manager (GenAI & MLOps Platform)Katonic AI • Hyderabad, IN
Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Senior QA Lead / QA Manager (GenAI & MLOps Platform)

Katonic AI • Hyderabad, IN
6 hours ago
Job description

Experience : 10+ Years

Job Type : Full-time

About Katonic :   We are a young, Aussie Generative AI startup headquartered in Sydney, Australia.

Job Description :

We are seeking a highly experienced Senior QA Lead / QA Manager with 10+ years in quality engineering to own and drive the QA strategy for our enterprise-grade GenAI and MLOps platform. This platform includes LLM-based chatbots, knowledge search and retrieval, web search integration, text and document processing, image processing, connector integrations, persona and brand voice configurations, multi-tenant operations, model fine-tuning, GPU-based LLM deployments, and API-based chatbot interfaces. The ideal candidate will lead QA teams, define scalable test processes, and ensure end-to-end reliability, performance, and security across all AI / ML and platform components.

Key Responsibilities :

  • Lead and manage the QA team, establishing QA strategy, processes, and governance.
  • Design comprehensive test plans for GenAI features, including enterprise chatbot, RAG search, Ask-AI modules, guardrails, persona / brand voice workflows, and multimodal pipelines.
  • Validate ML workflows such as embedding generation, model fine-tuning, LLM deployments on GPU, GPU slicing, resource allocation, and model lifecycle management.
  • Test platform components : tenancy management, connectors, integrations, microservices, and multi-tenant SaaS modules.
  • Build and maintain automation for UI, API, backend services, and ML pipelines (functional, regression, integration, and E2E).
  • Perform performance, scalability, and load testing for chat-based and API-driven systems.
  • Validate Node.js, Streamlit, Gradio, and Dash applications for stability and compatibility.
  • Ensure quality coverage for document, text, image, and tabular data processing features.
  • Collaborate with Engineering, AI / ML, and DevOps teams to ensure high-quality releases.
  • Drive root-cause analysis, defect management, and continuous improvements across the QA lifecycle.

Required Skills :

  • 10+ years of QA experience with at least 3–5 years in a lead or managerial role.
  • Strong experience testing GenAI / ML systems, including LLMs, embeddings, RAG pipelines, and multimodal processing.
  • Hands-on automation expertise using Selenium, Playwright, Cypress, Pytest, Robot Framework, or similar.
  • Strong API testing experience (Postman, RestAssured, Playwright API, JMeter).
  • Knowledge of Python, Node.js, or other scripting languages for test automation.
  • Familiarity with GPU-based model deployment, Docker, Kubernetes, and cloud platforms.
  • Experience testing multi-tenant SaaS applications, microservices, and real-time chat APIs.
  • Strong analytical and debugging skills, with an ability to work closely with cross-functional teams.
  • Preferred Skills :

  • Experience with MLflow, Kubeflow, or other MLOps tools.
  • Knowledge of vector databases (FAISS, Pinecone, Chroma, Weaviate).
  • Experience with guardrails frameworks (NeMo Guardrails, Guardrails AI, etc.).
  • Exposure to GPU orchestration, vLLM, Triton, or Hugging Face model servers.
  • What We Offer :

  • Opportunity to lead QA for a cutting-edge GenAI & MLOps ecosystem.
  • Work with advanced LLMs, GPUs, embeddings, and multimodal AI technologies.
  • Collaborative environment with engineering, AI / ML research, DevOps, and product teams.
  • 100% work from home
  • "Please apply only if you match the criteria.”

    To apply, please fill out this form here :   https : / / shorturl.at / Of9gU

    Without filling out the form, your application is not complete.

    Create a job alert for this search

    Qa Lead • Hyderabad, IN

    Related jobs
    Senior QA

    Senior QA

    Confidential • Hyderabad / Secunderabad, Telangana
    Develop and execute manual and automated test plans, test cases, and test scripts to ensure the highest levels of software quality and reliability. Collaborate with the development team to identify ...Show more
    Last updated: 30+ days ago • Promoted
    QA - Lead

    QA - Lead

    Confidential • Hyderabad / Secunderabad, Telangana
    Perform software testing in both Windows and Unix environments to ensure application quality and performance.Conduct automation testing using QTP 8. Execute different types of testing including func...Show more
    Last updated: 24 days ago • Promoted
    Senior Engineer - SQA in AI / ML

    Senior Engineer - SQA in AI / ML

    Confidential • Hyderabad / Secunderabad, Telangana, India
    As a Senior QA Engineer in the AI / ML team at Silicon Labs, you will play a pivotal role in defining and upholding quality standards for machine learning and deep learning models deployed on IoT edg...Show more
    Last updated: 30+ days ago • Promoted
    Senior Qa Engineering Lead & Technical Product Manager

    Senior Qa Engineering Lead & Technical Product Manager

    Teachally • Hyderabad, Republic Of India, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 3 days ago • Promoted
    Associate Director, SQA Engineering

    Associate Director, SQA Engineering

    Confidential • Hyderabad / Secunderabad, Telangana, India
    Grade Level (for internal use) : .As a QA Manager, you will make a key contribution provide expertise in the design, development, and operation of test automation and in building innovative solutions...Show more
    Last updated: 24 days ago • Promoted
    Lead QA Engineer

    Lead QA Engineer

    Confidential • Hyderabad / Secunderabad, Telangana
    Provide leadership, mentorship, and guidance to business analysts and QA team members on manual and automated testing.Collaborate with product owners and business analysts to ensure user stories ar...Show more
    Last updated: 30+ days ago • Promoted
    Qa Lead

    Qa Lead

    Shipway by Unicommerce • Secunderabad, Republic Of India, IN
    We are looking for a dedicated.The ideal candidate will have a strong background in both.Lead the QA team in developing and executing comprehensive test plans and test cases for both manual and aut...Show more
    Last updated: 15 hours ago • Promoted • New!
    Senior Software QA Lead Engineer

    Senior Software QA Lead Engineer

    Saaki Argus & Averil Consulting • Hyderabad, Telangana, India
    Quick Apply
    Contribute to test process, tools, and methodologies to include both manual & automated test execution.Responsible for interpreting testability requirements and ensure coverage in test case des...Show more
    Last updated: 30+ days ago
    Senior QA Engineer

    Senior QA Engineer

    CyberArk • Hyderabad, Telangana, India
    As a QA Engineer you will play a key role in ensuring the quality of CyberArks products.The role focuses primarily on manual testing with additional responsibilities for UI automation using record-...Show more
    Last updated: 30+ days ago • Promoted
    Senior Associate | Lead QA Engineer

    Senior Associate | Lead QA Engineer

    Deutsche Börse Group • Hyderabad, India
    Development, maintenance, and execution of test cycles.Stability tests (load tests, failover).Development and maintenance of testing automation tools. Development and maintenance of software install...Show more
    Last updated: 30+ days ago • Promoted
    Senior QA Engineering Lead & Technical Product Manager

    Senior QA Engineering Lead & Technical Product Manager

    Teachally • Hyderabad, IN
    Senior QA Engineering Lead & Technical Product Manager.We're seeking an experienced QA professional who can wear multiple hats—leading our quality assurance initiatives while driving product delive...Show more
    Last updated: 3 days ago • Promoted
    Senior QA

    Senior QA

    Net2Source (N2S) • Hyderabad, IN
    Join a Global Leader in Workforce Solutions – Net2Source Inc.Operating in 32 countries | 5,500+ Employees.Hands-on experience on trade product life cycle such as import LC, Export LC, Collections, ...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Associate - Lead SIEM Engineer

    Senior Associate - Lead SIEM Engineer

    Deutsche Börse Group • Hyderabad, India
    In your new position, you will become a member of the Cyber Defense team, part of Group Security.Cyber Defense team is responsible for all aspects of Security Information and Event Management (SIEM...Show more
    Last updated: 1 day ago • Promoted
    Senior QA Engineer

    Senior QA Engineer

    Huptech HR Solutions • Hyderabad, IN
    QA Engineer (Automation + Manual).Location : Remote (Candidate should reside in India).The Quality Assurance Engineer will be responsible for ensuring the product quality through the planning and ex...Show more
    Last updated: 20 days ago • Promoted
    Senior Associate | Lead QA Engineer [T500-20982]

    Senior Associate | Lead QA Engineer [T500-20982]

    Deutsche Börse Group • Hyderabad, Telangana, India
    About Deutsche Börse Group : Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider.They empower investors, fi...Show more
    Last updated: 12 days ago • Promoted
    Senior Associate | Lead Qa Engineer T500-20982

    Senior Associate | Lead Qa Engineer T500-20982

    Deutsche Börse Group • Hyderabad, Republic Of India, IN
    Headquartered in Frankfurt, Germany, Deutsche Börse Group is a leading international exchange organization and market infrastructure provider. They empower investors, financial institutions, and com...Show more
    Last updated: 12 days ago • Promoted
    Senior Quality Engineer

    Senior Quality Engineer

    S&P Global • Hyderabad, Telangana, India
    This job is with S&P Global, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.About the Rol...Show more
    Last updated: 26 days ago • Promoted
    QA Lead

    QA Lead

    Confidential • Hyderabad / Secunderabad, Telangana, India
    AutoRABIT is the leader in DevOps and CI / CD for SaaS platforms such as Salesforce.Its unique metadata-aware capability makes Release Management, Version Control, and Backup & Recovery complete, rel...Show more
    Last updated: 30+ days ago • Promoted