Talent.com
MLOps Engineer

MLOps Engineer

Yotta Data Services Private LimitedMumbai, Maharashtra, India
30+ days ago
Job description

About the Role :

We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Responsibilities :

  • Core MLOps Pipelines : Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .
  • Model Serving & CI / CD : Lead efforts in model serving, versioning, automated CI / CD, and real-time monitoring of AI workflows .
  • Inference-as-a-Service : Build and optimize GPU-backed serving infrastructure targeting p99 latency

80% GPU utilization .

  • Governance & Drift Detection : Drive initiatives on model governance, automated drift detection (≤10% false positives), and data-management best practices .
  • Vector Search & Agent Orchestration : Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.
  • Enterprise Multi-Tenancy : Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations.
  • Observability & Logging : Design Prometheus / Grafana dashboards, ELK / Fluentd logging pipelines, and alerting for all ML workloads.

  • CI / CD for Inference APIs : Maintain CI / CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.
  • Metrics & Cost Optimization : Define and track SLAs / SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at >
  • 80% utilization.

  • Cross-Functional Leadership : Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.
  • Mentorship & Community : Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers / quarter), and publish ≥ 1 open-source contribution or talk annually.
  • Requirements :

  • 9–15 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure
  • Strong expertise in cloud platforms (AWS / GCP / Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow
  • Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe)
  • Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration

  • Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.)
  • Proven track record building reliable, scalable ML systems in production.
  • Plus These Critical Skills :

  • Vector DB integration (Qdrant, Pinecone)
  • Agent orchestration (LangChain, LlamaIndex)
  • Multi-tenant security and RBAC
  • Observability stacks (Prometheus / Grafana, ELK)
  • CI / CD for FastAPI / NestJS services
  • Minimum Qualification : Bachelor's or Master's Degree in Computer Science, Engineering, or a related field.

    Preferred :

  • Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs.
  • Understanding of low-latency streaming inference or agent-based LLM systems.
  • Excellent written and verbal communication, and a proven ability to drive consensus across functions.
  • Create a job alert for this search

    Mlops Engineer • Mumbai, Maharashtra, India

    Related jobs
    • Promoted
    Software Engineer - AI / ML

    Software Engineer - AI / ML

    Mindfire SolutionsThane, IN
    As an AI / ML Engineer, you will be responsible for designing, validating, and integrating cutting-edge machine learning models and algorithms. Collaborate closely with cross-functional teams, includi...Show moreLast updated: 9 days ago
    • Promoted
    • New!
    Lead AI / ML Engineer

    Lead AI / ML Engineer

    KPI PartnersMumbai, IN
    KPI Partners is seeking a highly skilled and experienced.Lead Agentic AI Engineer with over 5 years experience to manage AI Engineer Team in the the design, build, and deploy autonomous, goal-drive...Show moreLast updated: 17 hours ago
    • Promoted
    • New!
    Jr. ML engineer

    Jr. ML engineer

    OnPoint Insightsmumbai city, maharashtra, in
    We’re looking for a passionate.This role is perfect for someone eager to apply their knowledge of.Machine Learning, AI, and Python. Deep Learning, NLP, and Large Language Models (LLMs).Natural Langu...Show moreLast updated: 11 hours ago
    • Promoted
    Senior MLOps Engineer (Production)

    Senior MLOps Engineer (Production)

    SAIVA AIKalyan-Dombivli, IN
    We are seeking a Senior Machine Learning Engineer to join our team and help shape the future of healthcare technology.In this role, you will design, build, and deploy machine learning systems that ...Show moreLast updated: 30+ days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    Bolt-on Global Solutions Pvt Ltd.Navi Mumbai
    Requirement : MLOps Engineer Technology : MLOps, LLM, Machine Learning, Docker, Kubernetes Experience : 5+ years< / ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior AI / ML Engineer (5+ Yr)

    Senior AI / ML Engineer (5+ Yr)

    MindBraindombivli, maharashtra, in
    The ideal candidate will collaborate within a team to design, build, and optimize real-world AI solutions.This role is hands-on in software engineering and AI agent development, without requiring p...Show moreLast updated: 11 hours ago
    • Promoted
    Giggso - AI / ML Engineer - MLOps

    Giggso - AI / ML Engineer - MLOps

    GiggsoMumbai
    About Giggso : Giggso is an award-winning, Michigan-based AI startup, recognized in the Top 50 Michigan Startups of 2023 & 2024.Founde...Show moreLast updated: 30+ days ago
    • Promoted
    Senior MLops Engineer with Airamatrix(Software Product Company) - Work From Office - 5 Days a Week

    Senior MLops Engineer with Airamatrix(Software Product Company) - Work From Office - 5 Days a Week

    AIRA Matrixthane, India
    Design the data pipelines and engineering infrastructure to support our clients’.Take offline models data scientists build and turn them into a real machine. Develop and deploy scalable tools and se...Show moreLast updated: 1 day ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Innodata Inc.Thane, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show moreLast updated: 15 days ago
    • Promoted
    Celebal Technologies - MLOps Engineer

    Celebal Technologies - MLOps Engineer

    Celebal TechnologiesNavi Mumbai
    Job Description : Key Responsibilities : <...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    ML / Gen AI Engineer

    ML / Gen AI Engineer

    Intuition IT – Intuitive Technology RecruitmentThane, IN
    Design, deploy, and manage scalable ML and GenAI workloads using AWS services including SageMaker Studio and Bedrock.Implement and maintain infrastructure using AWS Lambda, EKS, ECS on Fargate, and...Show moreLast updated: 17 hours ago
    • Promoted
    AmpsTek - Senior Prompt Engineer - LLM Models

    AmpsTek - Senior Prompt Engineer - LLM Models

    AmpstekMumbai
    Job Title : Senior Prompt Engineer Department : Innovation / AI Engineering Location : Mumbai &l...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    MLFlow / MLops Engineer

    MLFlow / MLops Engineer

    People Prime WorldwideMumbai, IN
    SRE ML Ops - Predominantly development exp, some experience of devops.Primarily development-focused with exposure to.Involves managing ML pipelines using frameworks like PyTorch and TensorFlow, imp...Show moreLast updated: 17 hours ago
    • Promoted
    ML Ops

    ML Ops

    EXLMumbai, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    MLOps Engineer

    MLOps Engineer

    Teamware Solutionsmumbai, maharashtra, in
    Teamware Solutions a division of Quantum Leap Consulting Pvt.Proficiency in at least one Python web framework (Flask, Django). Strong understanding of ORM tools(SQL Alchemy / Django ORM) and relationa...Show moreLast updated: 11 hours ago
    • Promoted
    Senior AI ML Engineer (MLOps)

    Senior AI ML Engineer (MLOps)

    Balancehero IndiaThane, IN
    BHI), the wholly-owned subsidiary of Balancehero Co.Korea which runs and operates the mobile app “True Balance”- a one-stop destination for financial services. Founded by Charlie Lee in Korea in 201...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    AI / ML Engineer | WFO | Gandhinagar

    AI / ML Engineer | WFO | Gandhinagar

    Mantras2Success.comThane, IN
    Build and optimize document classification & information extraction pipelines.Build Agentic AI for FinTech usacases.Train / fine-tune NLP models (Transformers / LLMs) for classification tasks.Implement...Show moreLast updated: 17 hours ago
    • Promoted
    AI Engineer (LLMs, Agentic Systems & Model Training)

    AI Engineer (LLMs, Agentic Systems & Model Training)

    Kayana | Ordering & Payment SolutionsMumbai, Maharashtra, India
    Job Title : AI Engineer (LLMs, Agentic Systems & Model Training).We are seeking a highly skilled.The ideal candidate has hands-on experience training and optimizing LLMs, building agentic workflows,...Show moreLast updated: 1 day ago