AI Infrastructure Engineer
Yotta Data Services Private LimitedRepublic Of India, IN30+ days ago
Job descriptionGovernance & Drift Detection : Drive initiatives on model governance, automated drift detection (≤10% false positives), and data-management best practices . Vector Search & Agent Orchestration : Integrate vector databases (Qdrant, Pinecone) for low-latency semantic retrieval, and build agentic workflows using LangChain or similar frameworks. Enterprise Multi-Tenancy : Architect RBAC-driven, isolated ML services to securely serve 100–500+ organizations. CI / CD for Inference APIs : Maintain CI / CD pipelines for Python (FastAPI) and TypeScript (NestJS) inference services. Metrics & Cost Optimization : Define and track SLAs / SLOs, optimize cloud spend by ≥ 20% year-over-year, and ensure GPU clusters operate at > Cross-Functional Leadership : Partner with AI researchers, product managers, and legal to align MLOps standards with compliance and roadmap goals. Mentorship & Community : Mentor junior engineers, run quarterly brown-bags, own onboarding docs (upskill 5+ engineers / quarter), and publish ≥ 1 open-source contribution or talk annually. 9–15 years in software engineering, including ≥ 4 years in MLOps or ML infrastructure Strong expertise in cloud platforms (AWS / GCP / Azure), Kubernetes, Docker, Terraform, Helm, Kubeflow, and MLflow Experience with inference frameworks (Triton, TensorFlow Serving, BentoML, TorchServe) Proficiency in Python, TypeScript, and infrastructure-as-code (Terraform, Helm, etc.) Proven track record building reliable, scalable ML systems in production. Vector DB integration (Qdrant, Pinecone) Agent orchestration (LangChain, LlamaIndex) Multi-tenant security and RBAC Observability stacks (Prometheus / Grafana, ELK) CI / CD for FastAPI / NestJS services Prior experience at AI-focused startups or enterprises scaling ML for 100–500 orgs. Understanding of low-latency streaming inference or agent-based LLM systems. Excellent written and verbal communication, and a proven ability to drive consensus across functions.
About the Role :
We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to turn prototypes into production services that meet strict SLAs for latency, reliability, and cost efficiency.
Responsibilities :
- Core MLOps Pipelines : Design and implement scalable ML pipelines (training, evaluation, deployment) for LLMs, CV, and multimodal models .
- Model Serving & CI / CD : Lead efforts in model serving, versioning, automated CI / CD, and real-time monitoring of AI workflows .
- Inference-as-a-Service : Build and optimize GPU-backed serving infrastructure targeting p99 latency <
100 ms, 99.9% uptime, and >
80% GPU utilization .
Observability & Logging : Design Prometheus / Grafana dashboards, ELK / Fluentd logging pipelines, and alerting for all ML workloads.
80% utilization.
Requirements :
Familiarity with distributed training, workload schedulers, and GPU-cluster orchestration
Plus These Critical Skills :
Minimum Qualification : Bachelor's or Master's Degree in Computer Science, Engineering, or a related field.
Preferred :
Create a job alert for this search
Infrastructure Engineer • Republic Of India, IN
Related jobs
- Promoted
Lead AI Engineer
BlendNagpur, IN We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show moreLast updated: 13 days ago
- Promoted
- New!
AI Engineer
Tensor PilotNagpur, IN Tensor Pilot, through its flagship product Tensor AI, provides a sophisticated desktop-based AI assistant for interacting with local files such as code, documents, images, and videos.Tensor AI emph...Show moreLast updated: less than 1 hour ago
- Promoted
AI Platform Engineer
BayOne SolutionsNagpur, IN We are seeking a highly skilled.In this role, you will work on advanced AI systems including.Retrieval-Augmented Generation (RAG).
Model Context Protocol (MCP) tools.OpenWebUI or custom-built soluti...Show moreLast updated: 8 days ago
- Promoted
- New!
AI Engineer
AsiteNagpur, IN We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show moreLast updated: 1 hour ago
- Promoted
Generative AI Engineer
Live ConnectionsNagpur, IN We’re Hiring | Generative AI Lead / Principal Engineer.Are you passionate about building cutting-edge.Generative AI and LLM solutions.
We’re looking for an experienced.Generative AI Lead / Principal...Show moreLast updated: 9 days ago
- Promoted
ML / Gen AI Engineer
Intuition IT – Intuitive Technology RecruitmentNagpur, IN Design, deploy, and manage scalable ML and GenAI workloads using AWS services including SageMaker Studio and Bedrock.Implement and maintain infrastructure using AWS Lambda, EKS, ECS on Fargate, and...Show moreLast updated: 1 day ago
- Promoted
AI Engineer
Aura Recruitment SolutionsNagpur, IN Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show moreLast updated: 11 days ago
- Promoted
INFOR XA / Mapics
Programmers.ioNagpur, IN IO is actively seeking talented individuals who are skilled in IBMi and Infor XA / Mapics.If you're looking for a flexible work environment that allows you to contribute from anywhere, we want to hea...Show moreLast updated: 30+ days ago
- Promoted
AI Inference Kernel Engineer (CUDA)
PhinityNagpur, IN We look forward to when AI can discover the next quantum AI accelerator, or when AI can make RL much more compute-efficient.
We want to enable AI to bootstrap its own intelligence, to discover new c...Show moreLast updated: 26 days ago
- Promoted
Artificial Intelligence Engineer
Ironbook AINagpur, IN Job Description : AI Engineer (AWS AI Stack).We are looking for a highly skilled.You will design, build, and deploy AI systems, collaborate with cross-functional teams, and contribute to scalable, p...Show moreLast updated: 15 days ago
- Promoted
Generative AI Engineer
Sesheng CompanyNagpur, IN GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show moreLast updated: 17 days ago
- Promoted
AI Engineer
TechKareerNagpur, IN Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show moreLast updated: 30+ days ago
- Promoted
AI Engineer
Idea Elan IndiaNagpur, IN AI Engineer (2 - 4 Years Experience).Idea Elan LLC is a product based company that provides comprehensive software solutions for.
Universities and Institutions worldwide.We are seeking a skilled AI ...Show moreLast updated: 3 days ago
- Promoted
Senior AI / ML Cloud Engineer – Graph Analytics Platform
ContexQNagpur, IN Senior AI / ML Cloud Engineer – Graph Analytics Platform.ContexQ, a Singapore-based B2B SaaS AI startup, is dedicated to transforming financial crime, fraud, and risk management through a groundbre...Show moreLast updated: 1 day ago
- Promoted
Cloud Orchestration & Scheduling Architect (AI Infrastructure)
Sustainability Economics.aiIndia AI, enabling profitable energy transitions while powering end-to-end AI infrastructure.By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems t...Show moreLast updated: 11 days ago
- Promoted
Agentic AI Engineer
Intellectt IncNagpur, IN Agentic AI Engineer (100% Remote).Intellectt is seeking a highly experienced.The ideal candidate will have hands-on expertise in.
LLMs, LangChain, LangGraph, RAG.AI applications for real-world use.O...Show moreLast updated: 11 days ago
- Promoted
- New!
Cloud IAM Engineer
Vertex AgilityIndia, India Job title : Cloud IAM Engineer.Join Vertex Agility — a high-performance, remote-first consultancy shaping the future of identity security and cloud-native automation.
Own and deploy IAM across cloud...Show moreLast updated: less than 1 hour ago
- Promoted
Cloud Infrastructure Architect
AscendionIndia Cloud Infrastructure Architect.All Ascendion Locations – Bengaluru, Pune, Chennai, Vadodara and Hyderabad.We are seeking a highly skilled Cloud Infrastructure Architect to lead the design, optimiza...Show moreLast updated: 1 day ago