MLOps Engineer

Requirement : MLOps Engineer

Technology : MLOps, LLM, Machine Learning, Docker, Kubernetes

Experience : 5+ years

Work Location : Western Suburb, Mumbai

Client Location : Navi Mumbai

CANDIDATES FROM / IN Western Suburb / MUMBAI LOCATION SHALL ONLY APPLY. This role is open exclusively to candidates based in Western Suburb / MUMBAI. Applications from candidates requiring RELOCATION WILL NOT BE ENTERTAINED.

Notice Period : Immediate to 15 days ONLY (Urgent Requirement)

Job Description :

• Develop, and manage efficient MLOps pipelines tailored for Large Language Models, automating the deployment and lifecycle management of models in production.
• Deploy, scale, and monitor LLM inference services across cloud-native environments using - Kubernetes, Docker, and other container orchestration frameworks.
• Optimize LLM serving infrastructure for latency, throughput, and cost, including hardware acceleration setups with GPUs or TPUs.
• Build and maintain CI / CD pipelines specifically for ML workflows, enabling automated validation, and seamless rollouts of continuously updated language models.
• Implement comprehensive monitoring, logging, and alerting systems (e.g., Prometheus, Grafana, ELK stack) to track model performance, resource utilization, and system health.
• Collaborate cross-functionally with ML research and data science teams to operationalize fine-tuned models, prompt engineering experiments, and multi agentic LLM workflows.
• Handle integration of LLMs with APIs and downstream applications, ensuring reliability, security, and compliance with data governance standards.
• Evaluate, select, and incorporate the latest model-serving frameworks and tooling (e.g., Hugging Face Inference API, NVIDIA Triton Inference Server).
• Troubleshoot complex operational issues impacting model availability and degradation, implementing fixes and preventive measures.
• Stay up to date with emerging trends in LLM deployment, optimization techniques such as quantization and distillation, and evolving MLOps best practices.

Desired Profile :

Qualification : Bachelors or Masters degree from premier Indian institutes :

(ref : hirist.tech)