Talent.com
No longer accepting applications
MLOps Engineer

MLOps Engineer

Yotta Data Services Private Limitedchennai, India
3 days ago
Job description

About the Role :

We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Responsibilities :

  • Core MLOps Pipelines : Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .
  • Model Serving & CI / CD : Lead efforts in model serving, versioning, automated CI / CD, and real-time monitoring of AI workflows .
  • Inference-as-a-Service : Build and optimize GPU-backed serving infrastructure targeting p99 latency

80% GPU utilization .

  • Governance & Drift Detection : Drive initiatives on model governance, automated drift detection (≤10% false positives), and data-management best practices .
  • Vector Search & Agent Orchestration : Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.
  • Enterprise Multi-Tenancy : Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations.
  • Observability & Logging : Design Prometheus / Grafana dashboards, ELK / Fluentd logging pipelines, and alerting for all ML workloads.

  • CI / CD for Inference APIs : Maintain CI / CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.
  • Metrics & Cost Optimization : Define and track SLAs / SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at >
  • 80% utilization.

  • Cross-Functional Leadership : Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.
  • Mentorship & Community : Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers / quarter), and publish ≥ 1 open-source contribution or talk annually.
  • Requirements :

  • 9–15 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure
  • Strong expertise in cloud platforms (AWS / GCP / Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow
  • Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe)
  • Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration

  • Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.)
  • Proven track record building reliable, scalable ML systems in production.
  • Plus These Critical Skills :

  • Vector DB integration (Qdrant, Pinecone)
  • Agent orchestration (LangChain, LlamaIndex)
  • Multi-tenant security and RBAC
  • Observability stacks (Prometheus / Grafana, ELK)
  • CI / CD for FastAPI / NestJS services
  • Minimum Qualification : Bachelor's or Master's Degree in Computer Science, Engineering, or a related field.

    Preferred :

  • Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs.
  • Understanding of low-latency streaming inference or agent-based LLM systems.
  • Excellent written and verbal communication, and a proven ability to drive consensus across functions.
  • Create a job alert for this search

    Mlops Engineer • chennai, India

    Related jobs
    • Promoted
    MLOps Engineer || Bangalore / Chennai / Noida / Hyderabad

    MLOps Engineer || Bangalore / Chennai / Noida / Hyderabad

    HCLTechChennai, Tamil Nadu, India
    HCLTech is hiring MLOps Engineer.We are looking for an experienced MLOps Engineer to help deploy, scale, and manage machine learning models in production environments. You will work closely with dat...Show moreLast updated: 22 days ago
    • Promoted
    Senior MLOps Engineer (Production)

    Senior MLOps Engineer (Production)

    SAIVA AIChennai, IN
    We are seeking a Senior Machine Learning Engineer to join our team and help shape the future of healthcare technology.In this role, you will design, build, and deploy machine learning systems that ...Show moreLast updated: 22 days ago
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Mitchell Martin Inc.Chennai, IN
    Include, but are not limited to, the following : .Own productionizing models—from tracked experiments to governed releases—ensuring resilient services with clear SLOs, runbooks, and fast, safe rollba...Show moreLast updated: 30+ days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    Capgeminichennai, tamil nadu, in
    Experience in developing MLOps framework cutting ML lifecycle : model development, training, evaluation, deployment, monitoring including Model Governance. Expert in Azure Databricks, Azure ML, Unity...Show moreLast updated: 2 days ago
    • Promoted
    MLOPs

    MLOPs

    MerilChennai, Tamil Nadu, India
    We are seeking an experienced MLOps Engineer with a focus on healthcare AI to join our innovative team.This role involves designing, implementing, and maintaining scalable MLOps pipelines for deplo...Show moreLast updated: 13 days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    Ixceed SolutionsChennai
    Role - MLOps - Chennai - Permanent Job Description : - University Degree in Computer Science, Information Te...Show moreLast updated: 30+ days ago
    • Promoted
    Python & MLOps Engineer

    Python & MLOps Engineer

    Devlats Pvt LtdChennai
    Job Description : We are seeking an experienced Python + ML Ops Engineer with strong hands-on expertise in developing, deploying, and managing machine learning solutions in pr...Show moreLast updated: 16 days ago
    • Promoted
    Senior MLOps / DevOps Engineer

    Senior MLOps / DevOps Engineer

    YubiChennai, Tamil Nadu, India
    Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the disco...Show moreLast updated: 4 days ago
    • Promoted
    DevOps / Platform Engineer

    DevOps / Platform Engineer

    iVedha Inc.Chennai, IN
    Hiring a seasoned DevOps / Platform Engineer to drive automation, platform reliability, and robust.Design, deploy, and manage CI / CD pipelines and infrastructure automation, leveraging AI for.Implemen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Standard Chartered BankChennai, Tamil Nadu, India
    This job is with Standard Chartered Bank, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly....Show moreLast updated: 2 days ago
    • Promoted
    MLOPS Engineer

    MLOPS Engineer

    ConfidentialChennai, Gandhinagar
    Design, implement, and maintain end-to-end ML pipelines for model training, evaluation, and deployment.Collaborate with data scientists and software engineers to operationalize ML models.Develop an...Show moreLast updated: 3 days ago
    • Promoted
    Engineer, MLOps

    Engineer, MLOps

    ConfidentialChennai, India
    KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, smartpho...Show moreLast updated: 2 days ago
    • Promoted
    MLOps Databricks Engineer

    MLOps Databricks Engineer

    ConfidentialChennai
    As a Senior / Lead specializing in Generative AI and Machine Learning Engineering (MLE), you will be at the forefront of AI innovation. You will design, deploy, and operationalize sophisticated models...Show moreLast updated: 30+ days ago
    • Promoted
    Valuebound - MLOps Engineer - Data Modeling

    Valuebound - MLOps Engineer - Data Modeling

    ValueboundChennai
    Responsibilities : - Manage Data : Extract, clean, and structure both structured and unstructured data.Coordinate Pipelines : Utilize tools such as ...Show moreLast updated: 3 days ago
    • Promoted
    MLOps Lead Engineer

    MLOps Lead Engineer

    RecroChennai, IN
    Experience with Azure services such as Azure AI services, Azure Search, Azure ML, Databricks, Azure Kubernetes Service, and AWS services like AWS SageMaker, AWS Bedrock and AWS Lambda.Exposure to G...Show moreLast updated: 25 days ago
    • Promoted
    • New!
    15h Left : Senior MLOps / DevOps Engineer

    15h Left : Senior MLOps / DevOps Engineer

    YubiChennai, Tamil Nadu, India
    About Yubi Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform f...Show moreLast updated: 2 hours ago
    • Promoted
    Capgemini - MLOps Engineer

    Capgemini - MLOps Engineer

    Capgemini Technology Services India LimitedChennai
    Your Role : - Design, implement, and maintain end-to-end ML pipelines for model training, evaluation, and deployment &...Show moreLast updated: 30+ days ago
    • Promoted
    ▷ 3 Days Left! MLOps Engineer || Bangalore / Chennai / Noida / Hyderabad

    ▷ 3 Days Left! MLOps Engineer || Bangalore / Chennai / Noida / Hyderabad

    HCLTechChennai, Tamil Nadu, India
    HCLTech is hiring MLOps Engineer Job Title : ML Ops Engineer / ML Engineer Job Overview : We are looking for an experienced MLOps Engineer to help deploy, scale, and manage machine learning model...Show moreLast updated: 18 days ago