Talent.com
MLOps Engineer

MLOps Engineer

Yotta Data Services Private Limitedvellore, India
21 hours ago
Job description

About the Role :

We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.

Responsibilities :

  • Core MLOps Pipelines : Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .
  • Model Serving & CI / CD : Lead efforts in model serving, versioning, automated CI / CD, and real-time monitoring of AI workflows .
  • Inference-as-a-Service : Build and optimize GPU-backed serving infrastructure targeting p99 latency

80% GPU utilization .

  • Governance & Drift Detection : Drive initiatives on model governance, automated drift detection (≤10% false positives), and data-management best practices .
  • Vector Search & Agent Orchestration : Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks.
  • Enterprise Multi-Tenancy : Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations.
  • Observability & Logging : Design Prometheus / Grafana dashboards, ELK / Fluentd logging pipelines, and alerting for all ML workloads.

  • CI / CD for Inference APIs : Maintain CI / CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services.
  • Metrics & Cost Optimization : Define and track SLAs / SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at >
  • 80% utilization.

  • Cross-Functional Leadership : Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals.
  • Mentorship & Community : Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers / quarter), and publish ≥ 1 open-source contribution or talk annually.
  • Requirements :

  • 9–15 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure
  • Strong expertise in cloud platforms (AWS / GCP / Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow
  • Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe)
  • Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration

  • Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.)
  • Proven track record building reliable, scalable ML systems in production.
  • Plus These Critical Skills :

  • Vector DB integration (Qdrant, Pinecone)
  • Agent orchestration (LangChain, LlamaIndex)
  • Multi-tenant security and RBAC
  • Observability stacks (Prometheus / Grafana, ELK)
  • CI / CD for FastAPI / NestJS services
  • Minimum Qualification : Bachelor's or Master's Degree in Computer Science, Engineering, or a related field.

    Preferred :

  • Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs.
  • Understanding of low-latency streaming inference or agent-based LLM systems.
  • Excellent written and verbal communication, and a proven ability to drive consensus across functions.
  • Create a job alert for this search

    Mlops Engineer • vellore, India

    Related jobs
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Mitchell Martin Inc.Vellore, IN
    Include, but are not limited to, the following : .Own productionizing models—from tracked experiments to governed releases—ensuring resilient services with clear SLOs, runbooks, and fast, safe rollba...Show moreLast updated: 30+ days ago
    • Promoted
    Senior MLOps Engineer (Production)

    Senior MLOps Engineer (Production)

    SAIVA AIVellore, IN
    We are seeking a Senior Machine Learning Engineer to join our team and help shape the future of healthcare technology.In this role, you will design, build, and deploy machine learning systems that ...Show moreLast updated: 19 days ago
    • Promoted
    • New!
    Machine Learning Engineer

    Machine Learning Engineer

    INSPYR Solutionsvellore, India
    MLOps Engineer II ( Mid-Senior-Level).Remote (Night Shift – 10 PM to 7 AM CST).Proficient MLOps engineer capable of independently managing production model deployments, pipelines, and infrastructur...Show moreLast updated: 21 hours ago
    • Promoted
    MLOps Lead Engineer

    MLOps Lead Engineer

    RecroVellore, IN
    Experience with Azure services such as Azure AI services, Azure Search, Azure ML, Databricks, Azure Kubernetes Service, and AWS services like AWS SageMaker, AWS Bedrock and AWS Lambda.Exposure to G...Show moreLast updated: 22 days ago
    • Promoted
    AI / ML Engineer (3 to 5 Years)

    AI / ML Engineer (3 to 5 Years)

    DXFactorVellore, IN
    DXFactor is looking for AI / ML Engineer (3 to 6 Yrs).DXFactor is a US-based tech company working with fortune 500 customers across the globe. Location : SG Highway, Ahmedabad (Work from Office).We are...Show moreLast updated: 2 days ago
    • Promoted
    DevOps / Platform Engineer

    DevOps / Platform Engineer

    iVedha Inc.Vellore, IN
    Hiring a seasoned DevOps / Platform Engineer to drive automation, platform reliability, and robust.Design, deploy, and manage CI / CD pipelines and infrastructure automation, leveraging AI for.Implemen...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AI / ML Engineer

    AI / ML Engineer

    Innodata Inc.Vellore, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show moreLast updated: 19 hours ago
    • Promoted
    • New!
    Ai / Ml Engineer

    Ai / Ml Engineer

    Innodata Inc.Vellore, Republic Of India, IN
    Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show moreLast updated: 13 hours ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    RecroVellore, IN
    We are looking for an experienced.Azure and AWS cloud ecosystems.The ideal candidate should bring a strong background in. GenAI tooling, automation, and CI / CD pipelines.Design, implement, and manage...Show moreLast updated: 30+ days ago
    • Promoted
    Deployment Engineer

    Deployment Engineer

    Avocavellore, India
    Build, launch & optimize AI agents that power the next generation of home-service customer experiences.Avoca is the all-in-one AI lead-conversion platform. Our technology boosts booking rates, slash...Show moreLast updated: 14 days ago
    • Promoted
    • New!
    AI / ML Engineer - Recommendations Engine (Nyburs)

    AI / ML Engineer - Recommendations Engine (Nyburs)

    NybursVellore, Tamil Nadu, India
    About Nyburs Nyburs is building a trustable, creator-first social platform focused on high quality conversations and media. We are hiring a hands-on Senior AI / ML Engineer to own the recommendation p...Show moreLast updated: 11 hours ago
    • Promoted
    • New!
    Lead PLM Engineer

    Lead PLM Engineer

    Varrocvellore, tamil nadu, in
    Product Lifecycle Management (PLM) : .Expertise in PLM processes and methodologies.Functional expertise in New Product Introduction (NPI), product engineering & Bill of Materials (BOM) management, pr...Show moreLast updated: 15 hours ago
    • Promoted
    ML Ops

    ML Ops

    EXLVellore, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Mobile Engineer

    Lead Mobile Engineer

    SenpiVellore, IN
    In just four months since launching on Base, Senpi has processed.Backed with $4M in Seed capital by top investors including Lemniscap, Coinbase Ventures, and SuperLayer, we’re building on a track r...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AI / ML Engineer

    AI / ML Engineer

    RingCentralvellore, tamil nadu, in
    We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI.In this role, you will...Show moreLast updated: 15 hours ago
    • Promoted
    SDE 2 AI / ML Engineer (Bangalore Only - atleast 4 years experience)

    SDE 2 AI / ML Engineer (Bangalore Only - atleast 4 years experience)

    JobTwinevellore, tamil nadu, in
    Reach out to : careers@jobtwine.Location : Bengaluru or NCR but fully remote for a few months.Meet JayT : Your 24 / 7 AI Hiring Agent that powers Human Decisions for fastest and best hiring outcomes.It...Show moreLast updated: 12 days ago
    • Promoted
    Senior MLOps / DevOps Engineer

    Senior MLOps / DevOps Engineer

    Yubivellore, tamil nadu, in
    Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the disco...Show moreLast updated: 1 day ago
    • Promoted
    LLM Engineer

    LLM Engineer

    Insight GlobalVellore, IN
    Insight Global is sourcing for an AI / LLM Engineer to sit remotely in India, joining a global consulting firm.This position will support various Digital Products Teams in the AI Center of Excellence...Show moreLast updated: 2 days ago