ML Model Deployment Lead
Yotta Data Services Private LimitedRepublic Of India, IN4 days ago
Job descriptionGovernance & Drift Detection : Drive initiatives on model governance, automated drift detection (≤10% false positives), and data-management best practices . Vector Search & Agent Orchestration : Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks. Enterprise Multi-Tenancy : Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations. CI / CD for Inference APIs : Maintain CI / CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services. Metrics & Cost Optimization : Define and track SLAs / SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at > Cross-Functional Leadership : Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals. Mentorship & Community : Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers / quarter), and publish ≥ 1 open-source contribution or talk annually. 9–15 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure Strong expertise in cloud platforms (AWS / GCP / Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe) Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.) Proven track record building reliable, scalable ML systems in production. Vector DB integration (Qdrant, Pinecone) Agent orchestration (LangChain, LlamaIndex) Multi-tenant security and RBAC Observability stacks (Prometheus / Grafana, ELK) CI / CD for FastAPI / NestJS services Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs. Understanding of low-latency streaming inference or agent-based LLM systems. Excellent written and verbal communication, and a proven ability to drive consensus across functions.
About the Role :
We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.
Responsibilities :
- Core MLOps Pipelines : Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .
- Model Serving & CI / CD : Lead efforts in model serving, versioning, automated CI / CD, and real-time monitoring of AI workflows .
- Inference-as-a-Service : Build and optimize GPU-backed serving infrastructure targeting p99 latency <
100 ms, 99.9% uptime, and >
80% GPU utilization .
Observability & Logging : Design Prometheus / Grafana dashboards, ELK / Fluentd logging pipelines, and alerting for all ML workloads.
80% utilization.
Requirements :
Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration
Plus These Critical Skills :
Minimum Qualification : Bachelor's or Master's Degree in Computer Science, Engineering, or a related field.
Preferred :
Create a job alert for this search
Deployment Lead • Republic Of India, IN
Related jobs
- Promoted
AI / ML Solutions Architect_Consulting
HireginieNagpur, IN A leading IT and data solutions provider offering services in consulting, systems integration, data science, IoT, and business process outsourcing.
The company enables organizations to enhance effic...Show moreLast updated: 4 days ago
- Promoted
AI / ML Developer
Viionn Labsnagpur, maharashtra, in Derive and design use cases from structured and unstructured data.Provide LLM expertise to solve AI problems using state-of-the-art language models and off-the-shelf LLM services such as OpenAI mod...Show moreLast updated: 4 days ago
- Promoted
Lead AI / ML – Build Agentic LLM Systems Powering the Future of Healthcare
Geektrustnagpur, maharashtra, in Join a fast-growing health-tech company that’s reimagining primary care for the modern world.You’ll lead the architecture for multi-agent orchestration, RAG pipelines, and LLM-driven reasoning fram...Show moreLast updated: 3 days ago
- Promoted
MLOps Lead Engineer
RecroNagpur, IN Experience with Azure services such as Azure AI services, Azure Search, Azure ML, Databricks, Azure Kubernetes Service, and AWS services like AWS SageMaker, AWS Bedrock and AWS Lambda.Exposure to G...Show moreLast updated: 25 days ago
- Promoted
Vice President - Model Developer (Wholesale Risk)
MashreqIndia, India The main purpose of the role is to lead the wholesale Risk model development team and assist the Head of Risk Analytics and Capital Management in execution of risk governance and practices around q...Show moreLast updated: 30+ days ago
- Promoted
Machine Learning Engineer
RecroNagpur, IN We are looking for an experienced.Azure and AWS cloud ecosystems.The ideal candidate should bring a strong background in.
GenAI tooling, automation, and CI / CD pipelines.Design, implement, and manage...Show moreLast updated: 30+ days ago
- Promoted
ML Ops
EXLIndia, India Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools.
Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show moreLast updated: 30+ days ago
- Promoted
Data Modeler
RecroNagpur, IN NoSQL) to support enterprise information management, BI, analytics, machine learning, and other business use cases.They drive data strategies, build models (conceptual, logical, physical), ensure p...Show moreLast updated: 25 days ago
- Promoted
MLOps Engineer
Capgemininagpur, maharashtra, in Experience in developing MLOps framework cutting ML lifecycle : model development, training, evaluation, deployment, monitoring including Model Governance.
Expert in Azure Databricks, Azure ML, Unity...Show moreLast updated: 2 days ago
- Promoted
Polarion ALM Expert – Process Implementation & Support
Hexad Infosoft INNagpur, IN Polarion ALM Expert – Process Implementation & Support.R&D process digitalization project.The role involves implementing, configuring, and optimizing.
The expert will collaborate with global stakeho...Show moreLast updated: 1 day ago
- Promoted
Senior MLOps Engineer
Mitchell Martin Inc.Nagpur, IN Include, but are not limited to, the following : .Own productionizing models—from tracked experiments to governed releases—ensuring resilient services with clear SLOs, runbooks, and fast, safe rollba...Show moreLast updated: 30+ days ago
- Promoted
DS with Python : LLM Model training
DeepLLMDataNagpur, IN DeepLLMData focuses on coding SFT, RLHF, STEM, PhD, Maths, Image and Video data annotators and provisioning.This is a Part-time remote role for LLM Model training.
The task needs LLM Trainers to cre...Show moreLast updated: 2 days ago
- Promoted
AI / ML Engineer
Innodata Inc.Nagpur, IN Our AI-driven platforms and expert teams empower clients in healthcare, life insurance, and other industries to identify risks, improve efficiency, and make smarter decisions.By combining proprieta...Show moreLast updated: 3 days ago
- Promoted
Engineer : Senior LLM Optimization (LLMO) / GEO Expert – Google Vertex
Proso.ainagpur, maharashtra, in Generative Engine Optimization (GEO).You’ll help make sa products and services.AI-driven assistants and LLMs like ChatGPT, Copilot, and Gemini.
Optimize LLM pipelines on Google Vertex AI : .Design RAG...Show moreLast updated: 2 days ago
- Promoted
Senior Data Modeler
Neutrino Advisory, an Inc 5000 CompanyNagpur, IN The role involves designing and optimizing data models across transactional, analytical, and cloud environments using platforms such as SQL Server, Oracle, Snowflake, and Azure Synapse.The ideal ca...Show moreLast updated: 25 days ago
- Promoted
Reltio Lead / Architect
Mastech Digitalnagpur, maharashtra, in Chennai / Bangalore / Hyderabad / Noida / Remote with quarterly visit.LPA (Depending on level of expertise).Immediate joiner / Currently serving notice / Notice is less than 60 days.We are looking for a hands...Show moreLast updated: 25 days ago
- Promoted
Senior ML Engineer
Piramal Financenagpur, maharashtra, in Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show moreLast updated: 3 days ago
- Promoted
Senior Mulesoft Developer
BillenniumNagpur, IN Minimum 5+ years of experience in MuleSoft.Ability to Identify, Analyse and Develop interfaces and integration flows using Mule ESB AnyPoint platform including Mule Runtime, Connectors, Design Cent...Show moreLast updated: 30+ days ago