ML Ops Engineer

About the Role

We are seeking an experienced MLOps Engineer to design, build, and maintain scalable machine learning infrastructure with strong focus on Azure cloud ecosystem. You will deploy and optimize ML / AI models in production, with emphasis on GPU-accelerated workloads and large language models.

Key Responsibilities

• Design and implement MLOps pipelines using Kubeflow and KServe for model deployment and serving
• Deploy and manage production ML models on Kubernetes with NVIDIA GPU acceleration
• Optimize model inference using vLLM, TensorRT-LLM, Triton Inference Server, and PyTorch Dynamo
• Implement auto-scaling using KEDA, HPA, and Azure Cluster Autoscaler
• Build CI / CD pipelines using Azure DevOps for automated ML model deployment
• Manage Azure infrastructure (AKS, Azure ML, Container Registry) using IaC (Terraform / ARM / Bicep)
• Implement monitoring and observability using Prometheus and Grafana
• Perform Linux system administration and optimize containerized workloads
• Deploy and manage LLM applications with OpenAI API and Azure OpenAI services
• Monitor GPU utilization, model performance, and implement drift detection
• Build RAG systems and manage vector databases for LLM applications