Talent.com
MLOps Engineer
MLOps EngineerYotta Data Services Private Limited • Mumbai, India
MLOps Engineer

MLOps Engineer

Yotta Data Services Private Limited • Mumbai, India
30+ days ago
Job description

About the Role :

We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Responsibilities :

  • Core MLOps Pipelines : Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .
  • Model Serving & CI / CD : Lead efforts in model serving, versioning, automated CI / CD, and real-time monitoring of AI workflows .
  • Inference-as-a-Service : Build and optimize GPU-backed serving infrastructure targeting p99 latency 80% GPU utilization .
  • Governance & Drift Detection : Drive initiatives on model governance, automated drift detection (≤10% false positives), and data-management best practices .
  • Vector Search & Agent Orchestration : Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.
  • Enterprise Multi-Tenancy : Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations.

Observability & Logging : Design Prometheus / Grafana dashboards, ELK / Fluentd logging pipelines, and alerting for all ML workloads.

  • CI / CD for Inference APIs : Maintain CI / CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.
  • Metrics & Cost Optimization : Define and track SLAs / SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at >
  • 80% utilization.

  • Cross-Functional Leadership : Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.
  • Mentorship & Community : Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers / quarter), and publish ≥ 1 open-source contribution or talk annually.
  • Requirements :

  • 9–15 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure
  • Strong expertise in cloud platforms (AWS / GCP / Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow
  • Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe)
  • Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration

  • Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.)
  • Proven track record building reliable, scalable ML systems in production.
  • Plus These Critical Skills :

  • Vector DB integration (Qdrant, Pinecone)
  • Agent orchestration (LangChain, LlamaIndex)
  • Multi-tenant security and RBAC
  • Observability stacks (Prometheus / Grafana, ELK)
  • CI / CD for FastAPI / NestJS services
  • Minimum Qualification : Bachelor's or Master's Degree in Computer Science, Engineering, or a related field.

    Preferred :

  • Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs.
  • Understanding of low-latency streaming inference or agent-based LLM systems.
  • Excellent written and verbal communication, and a proven ability to drive consensus across functions.
  • Create a job alert for this search

    Mlops Engineer • Mumbai, India

    Related jobs
    Senior MLOps Engineer

    Senior MLOps Engineer

    Confidential • Mumbai, India
    Saint-Gobain group through its group company Grindwell Norton Limited has established INDEC - an International Delivery Center in Mumbai to provide IT solutions and services to the groups' business...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI ML Engineer (MLOps)

    Senior AI ML Engineer (MLOps)

    Balancehero India • Mumbai, IN
    BHI), the wholly-owned subsidiary of Balancehero Co.Korea which runs and operates the mobile app “True Balance”- a one-stop destination for financial services. Founded by Charlie Lee in Korea in 201...Show more
    Last updated: 16 days ago • Promoted
    Senior MLOps Engineer (Production)

    Senior MLOps Engineer (Production)

    SAIVA AI • Mumbai, IN
    We are seeking a Senior Machine Learning Engineer to join our team and help shape the future of healthcare technology.In this role, you will design, build, and deploy machine learning systems that ...Show more
    Last updated: 30+ days ago • Promoted
    Software Engineer Intern (AI / ML) - Global AI Powered Tech Talent Startup

    Software Engineer Intern (AI / ML) - Global AI Powered Tech Talent Startup

    SkillsCapital • Mumbai, IN
    Are you a passionate AI / ML enthusiast eager to work on real-world systems instead of toy models? Want to learn directly from experienced tech leaders while building solutions that are already impac...Show more
    Last updated: 16 days ago • Promoted
    Lead Engineer - AI / ML

    Lead Engineer - AI / ML

    Mindfire Solutions • Mumbai, IN
    As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models. Your role involves guiding a team of engineers ensuring the successful...Show more
    Last updated: 30+ days ago • Promoted
    Founding MLOps Engineer

    Founding MLOps Engineer

    Vectorial AI • Mumbai, IN
    Vectorial is a simulation engine platform powered by millions of synthetic users—state-of-the-art models that capture real human behavior—to deliver instant, nuanced validation across the entire pr...Show more
    Last updated: 16 days ago • Promoted
    MLOps Engineer

    MLOps Engineer

    Bolt-on Global Solutions Pvt Ltd. • Navi Mumbai
    Requirement : MLOps Engineer Technology : MLOps, LLM, Machine Learning, Docker, Kubernetes Experience : 5+ years< / ...Show more
    Last updated: 30+ days ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    C4 Technical Services • Mumbai, IN
    AI Solution Development & Deployment : Design and implement AI models and algorithms using Azure AI services, including Azure Machine Learning, Cognitive Services, and Azure OpenAI.Develop and deploy...Show more
    Last updated: 1 day ago • Promoted
    AI / ML Engineer

    AI / ML Engineer

    Innodata Inc. • Mumbai, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show more
    Last updated: 21 days ago • Promoted
    Software Engineer - AI / ML

    Software Engineer - AI / ML

    Mindfire Solutions • Mumbai, IN
    As an AI / ML Engineer, you will be responsible for designing, validating, and integrating cutting-edge machine learning models and algorithms. Collaborate closely with cross-functional teams, includi...Show more
    Last updated: 15 days ago • Promoted
    AI Engineer

    AI Engineer

    TechKareer • Mumbai, IN
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    C5i - MLOps Engineer

    C5i - MLOps Engineer

    Course5i • Mumbai
    Job Description : We are looking for an experienced MLOps Engineer to join our team.The ideal candidate will design, implement, and manage robust MLOps pipeli...Show more
    Last updated: 30+ days ago • Promoted
    ML Ops

    ML Ops

    EXL • Mumbai, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Cloud Engineer – Graph Analytics Platform

    Senior AI / ML Cloud Engineer – Graph Analytics Platform

    ContexQ • Mumbai, IN
    Senior AI / ML Cloud Engineer – Graph Analytics Platform.ContexQ, a Singapore-based B2B SaaS AI startup, is dedicated to transforming financial crime, fraud, and risk management through a groundbre...Show more
    Last updated: 6 days ago • Promoted
    Mlops engineer

    Mlops engineer

    Yotta Data Services Private Limited • Mumbai, Maharashtra, India
    Cross-Functional Leadership : Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals. Mentorship & Community : Mentor junior engineers, run...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    AI Engineer (LLMs, Agentic Systems & Model Training)

    AI Engineer (LLMs, Agentic Systems & Model Training)

    Kayana | Ordering & Payment Solutions • Mumbai, Maharashtra, India
    Job Title : AI Engineer (LLMs, Agentic Systems & Model Training).We are seeking a highly skilled.The ideal candidate has hands-on experience training and optimizing LLMs, building agentic workflows,...Show more
    Last updated: 7 days ago • Promoted
    Search Engineer

    Search Engineer

    YourTribe • Mumbai, IN
    Design & implement search solutions.Architect and develop advanced search features using.OpenSearch / Elasticsearch, including custom analysers, tokenisers, and scoring algorithms.Create and maintain...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Engineer

    Cloud Engineer

    Tata Consultancy Services • Mumbai, Maharashtra, India
    TCS is Hiring Cloud Engineer For Mumbai and Bangalore location.Understanding of AI platforms in a cloud environment (Vertex AI, CoPilot, Sagemaker, Bedrock). Proficiency in Cloud Platforms with an u...Show more
    Last updated: 3 days ago • Promoted