Sr Manager - GenAI / LLM Ops

Organization : Leading Global Management Consulting firm

Role : - Sr Manager - AI / LLM Ops

Location : - Gurugram

Experience : - 12+ Yrs

Working Mode : - Hybrid

What You'll Do

We are seeking a highly skilled and experienced Platform Engineer Senior Manager with Gen AI / LLM expertise to join our Gen AI platform team. This role focuses on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. The ideal candidate will have a strong background in platform engineering, cloud infrastructure, LLM Observability and DevOps / MLOps / LLMOps, with a passion for creating scalable, reliable, and efficient systems.

What You'll Bring

Bachelor's degree in computer science engineering (or equivalent degree or experience)

Proven building and supporting scalable, reliable Gen AI or LLM powered applications in production.

Proven experience in building & enabling self-serve observability tools, dashboards for engineering teams.

12+ years of relevant experience in delivering and maintaining platform or complex technology solutions with strong technical background, preferably in global organization / enterprise.

1+ years of experience in develop, deploy, test, and maintain production-grade access to LLMs and related services.

Strong expertise in Modern Engineering, DevOps / GitOps, Infra as a Code practices - Strong understanding of CI / CD, AI / ML pipelines and automation tools.

Experience & Skills (Mandatory)¿ Strong knowledge and experience in Generative AI / LLM based development.

Strong experience in building and integrating LLM observability tools Strong experience in optimizing LLM performance, usage and cost Strong experience in building CI / CD pipeline templates for AI SDLC (ML Ops, RAG pipelines, Data Ingestion pipelines) Proficiency in cloud platforms (AWS, Azure, GCP) and infrastructure as code (Terraform, Terraform Cloud, Github Actions, ArgoCD and equivalent).

Experience with containerization and orchestration technologies (Kubernetes, Docker).

Strong experience working with and enabling key LLM models APIs (e.g. AWS Bedrock, Azure Open AI / OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex).

Expertise in building enterprise grade, secure data ingestion pipelines for structured / unstructured data – including indexing, search, and advance retrieval patterns.

Proficiency in Python, Go, Terraform (and equivalent) Experience in LLM Testing and Evaluation is preferred Experience with security related to LLM integration is preferred