Talent.com
This job offer is not available in your country.
MLOps Engineer

MLOps Engineer

Yotta Data Services Private LimitedIndia
30+ days ago
Job description

Location : Mumbai, India

Experience Level : 9 Plus Years

Minimum Qualification : Master’s Degree in Computer Science, Engineering, or related field.

About the Role :

We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Responsibilities :

  • Core MLOps Pipelines : Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .
  • Model Serving & CI / CD : Lead efforts in model serving, versioning, automated CI / CD, and real-time monitoring of AI workflows .
  • Inference-as-a-Service : Build and optimize GPU-backed serving infrastructure targeting p99 latency

80% GPU utilization .

  • Governance & Drift Detection : Drive initiatives on model governance, automated drift detection (≤10% false positives), and data-management best practices .
  • Vector Search & Agent Orchestration : Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.
  • Enterprise Multi-Tenancy : Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations.
  • Observability & Logging : Design Prometheus / Grafana dashboards, ELK / Fluentd logging pipelines, and alerting for all ML workloads.

  • CI / CD for Inference APIs : Maintain CI / CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.
  • Metrics & Cost Optimization : Define and track SLAs / SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at >
  • 80% utilization.

  • Cross-Functional Leadership : Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.
  • Mentorship & Community : Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers / quarter), and publish ≥ 1 open-source contribution or talk annually.
  • Requirements :

  • 9–14 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure
  • Strong expertise in cloud platforms (AWS / GCP / Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow
  • Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe)
  • Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration

  • Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.)
  • Proven track record building reliable, scalable ML systems in production.
  • Plus These Critical Skills :

  • Vector DB integration (Qdrant, Pinecone)
  • Agent orchestration (LangChain, LlamaIndex)
  • Multi-tenant security and RBAC
  • Observability stacks (Prometheus / Grafana, ELK)
  • CI / CD for FastAPI / NestJS services
  • Preferred :

  • Master’s / PhD in CS / AI and certifications such as AWS ML Specialty, Google Cloud Professional ML Engineer, or CNCF CKA / CKAD.
  • Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs.
  • Understanding of low-latency streaming inference or agent-based LLM systems.
  • Excellent written and verbal communication, and a proven ability to drive consensus across functions.
  • Create a job alert for this search

    Mlops Engineer • India

    Related jobs
    • Promoted
    ML Ops

    ML Ops

    EXLNagpur, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show moreLast updated: 23 days ago
    • Promoted
    Robotics Engineer (SLAM Lead)

    Robotics Engineer (SLAM Lead)

    ClutterbotIndia
    About Clutterbot Imagine a world where you never have to worry about picking up clutter again! At our robotics startup, we understand the challenges families face trying to balance work and daily r...Show moreLast updated: 7 days ago
    • Promoted
    DevOps / Platform Engineer

    DevOps / Platform Engineer

    iVedha Inc.Nagpur, IN
    Hiring a seasoned DevOps / Platform Engineer to drive automation, platform reliability, and robust.Design, deploy, and manage CI / CD pipelines and infrastructure automation, leveraging AI for.Implemen...Show moreLast updated: 30+ days ago
    • Promoted
    Mlops Engineer

    Mlops Engineer

    Persistent SystemsIndia
    We are conducting an in-person hiring drive for the position of Mlops Engineer in Chennai on 6th Sep 2025.Interview Location is mentioned below : . Chennai : Olympia Pinnacle, #1, S.Old Mahabalipuram R...Show moreLast updated: 30+ days ago
    • Promoted
    DevOps / MLOps Engineer – Robotics.

    DevOps / MLOps Engineer – Robotics.

    MerilIndia
    Job Title : DevOps / MLOps Engineer for Robotics Location : Vapi, Gujarat Employment Type : Full-Time.Overview We are seeking an experienced • •DevOps / MLOps Engineer for Robotics • • to build and manag...Show moreLast updated: 25 days ago
    • Promoted
    MLOps Engineer (5-8 Years)

    MLOps Engineer (5-8 Years)

    Mancer Consulting ServicesIndia
    The Staff MLOps Engineer plays a pivotal role in shaping our MLOps practice within ITG by building and enhancing a scalable, reliable, and cutting-edge Machine Learning Operations (MLOps) platform....Show moreLast updated: 5 days ago
    • Promoted
    MLOPs Engg

    MLOPs Engg

    Tech MahindraIndia
    Location-Pune / Bangalore / Hyderabad / Chennai / Mumbai / Noida Experience- 4-10 Yrs.Mandate Skill- MLOPS with Cloud (GCP & Azure is preferred) Work Type-Hybrid. JD - Strong hands-on experience on MLOps and ...Show moreLast updated: 30+ days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    YAL.aiIndia
    Location : Hyderabad / Bangalore, India Type : Full-Time | Immediate Joining Preferred CTC : Competitive.Your Alternative Life) is reimagining the way people connect, communicate, and discover in a...Show moreLast updated: 6 days ago
    • Promoted
    Deployment Engineer

    Deployment Engineer

    AvocaNagpur, Maharashtra, India
    Build, launch & optimize AI agents that power the next generation of home-service customer experiences.About Avoca Avoca is the all-in-one AI lead-conversion platform for home-service brands.Our ...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML Engineer

    AI / ML Engineer

    RecroNagpur, IN
    PDFs, scanned images, invoices, etc.OCR output post-processing (JSON / CSV) using.OCR technologies, intelligent document processing, and enterprise-scale AI / ML solutions. Form Recognizer / Document Inte...Show moreLast updated: 30+ days ago
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Mitchell Martin Inc.India, India
    Include, but are not limited to, the following : .Own productionizing models—from tracked experiments to governed releases—ensuring resilient services with clear SLOs, runbooks, and fast, safe rollba...Show moreLast updated: 19 days ago
    • Promoted
    MLOps Lead Engineer

    MLOps Lead Engineer

    Innodata Inc.nagpur, maharashtra, in
    Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field.Proven experience in designing and implementing AI / ML models. Proficiency in programming languages suc...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    (Urgent Search) MLOps Engineer

    (Urgent Search) MLOps Engineer

    SourcebaeIndia
    Location : Ghansoli, Navi Mumbai.Notice Period : Immediate joiners preferred or within 15 days.We are seeking a skilled MLOps Engineer with hands-on experience in Azure, Databricks, and DevOps to des...Show moreLast updated: 1 hour ago
    • Promoted
    MLops Engineer

    MLops Engineer

    PeoplefyIndia
    Hi Techies, I am on lookout for MLOps engineer for a leading MNC based in Pune, Yerwada.About the Role We are looking for an experienced MLOps Engineer to support our AI and ML initiatives, includi...Show moreLast updated: 17 days ago
    • Promoted
    ML Engineer III

    ML Engineer III

    GrowwIndia
    About Groww : We are a passionate group of people focused on making financial services accessible to every Indian through a multi-product platform. Each day, we help millions of customers take charge...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer / ML Engineer (2–4 yrs)

    AI Engineer / ML Engineer (2–4 yrs)

    Nexoria Techworks Inc.nagpur, maharashtra, in
    Data Science & Machine Learning.Build datasets and features; implement training / evaluation loops for classic ML (classification / ranking). Ship inference services (REST / gRPC) with monitoring, logging...Show moreLast updated: 5 days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    SourcebaeIndia
    Ghansoli, Navi Mumbai Experience : .Immediate joiners preferred or within 15 days.Job Description : We are seeking a skilled. Azure, Databricks, and DevOps to design, automate, and maintain ML pipeline...Show moreLast updated: 5 days ago
    • Promoted
    Forward Deployed AI Engineer - LLM

    Forward Deployed AI Engineer - LLM

    DashhireIndia
    Job Overview : We are seeking a highly motivated and technically skilled Forward Deployed AI Engineer to bridge the gap between our cutting-edge AI technologies and real-world ...Show moreLast updated: 27 days ago