Talent.com
AI Infrastructure Engineer
AI Infrastructure EngineerEROS GenAI • Chennai, Republic Of India, IN
AI Infrastructure Engineer

AI Infrastructure Engineer

EROS GenAI • Chennai, Republic Of India, IN
19 hours ago
Job description

Role Overview

We are looking for an experienced MLOps Engineer to build and scale our AI infrastructure across Kubernetes, cloud-native environments, and serverless GPU platforms. You will own the end-to-end operational lifecycle of machine learning models—from training to deployment, monitoring, optimization, and automated retraining.

Key Roles

  • Design and implement highly scalable AI / ML infrastructure using Kubernetes, Kubeflow, Ray, and cloud-native services.
  • Build robust CI / CD and CT (Continuous Training) pipelines for model deployment, inference, monitoring, and automated retraining.
  • Architect and deploy ML workflows on serverless GPU platforms (AWS, GCP, Yotta, RunPod, Modal, etc.) for cost-efficient, elastic scaling.
  • Establish automated systems for model drift, data drift, performance monitoring, and lineage tracking.
  • Promote best practices in reproducible ML, infrastructure-as-code, automation, and internal tooling.

Responsibilities

  • Evaluate, integrate, and optimize MLOps tools (MLflow, Weights & Biases, KServe, Seldon, BentoML, Argo, Airflow, etc.) to streamline AI development.
  • Develop scalable inference-serving layers—batch, real-time, streaming—using GPU-optimized serving frameworks.
  • Build observability stacks for GPU utilization, latency, throughput, and model health metrics.
  • Implement robust systems for model governance, versioning, rollout strategies (blue / green, canary), and automated rollback.
  • Collaborate closely with ML engineers, data engineers, and product teams to deliver production-ready AI features.
  • Knowledge & Skills Requirements

  • Strong understanding of ML / DL fundamentals and hands-on experience with model training and optimization.
  • Expertise in Kubernetes, containerization, Helm, and cloud-native infrastructure.
  • Experience with serverless GPU architectures and distributed computing frameworks.
  • Solid knowledge of CI / CD tools (GitHub Actions, GitLab CI, Jenkins), IaC (Terraform), and workflow engines.
  • Understanding of drift detection, performance tracking, experiment management, and scalable model deployment patterns.
  • We Accept International Applicants
  • Create a job alert for this search

    Infrastructure Engineer • Chennai, Republic Of India, IN

    Related jobs
    AWS Infrastructure Architect

    AWS Infrastructure Architect

    HCLTech • Chennai, Republic Of India, IN
    AWS IaaS Infrastructure Engineer.This role ensures high availability, security, and scalability of cloud environments, supports automation and integration with CI / CD pipelines, and provides operati...Show more
    Last updated: 15 hours ago • Promoted • New!
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    EXL • Republic Of India, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Infrastructure Architect

    Lead AI Infrastructure Architect

    Veltris • Republic Of India, IN
    AI Architect - Telecom & Networking.Routing, Switching / SD-WAN / Provider Edge).Graph Neural Networks, Time-series Forecasting Algorithms (ARIMA, LSTM…). ML / DL libraries (PyTorch, TensorFlow, Sciki...Show more
    Last updated: 15 hours ago • Promoted • New!
    Cloud Infrastructure Architect

    Cloud Infrastructure Architect

    People Prime Worldwide • Pune, Republic Of India, IN
    AWS Services, Cloud Formation, IaC.Documentation & Validation Skills.Computer System Validation (CSV) Knowledge.Deep understanding of core AWS services like EC2, S3, RDS, IAM, VPC, CloudWatch, Clou...Show more
    Last updated: 30+ days ago • Promoted
    IaaS Solutions Engineer

    IaaS Solutions Engineer

    HCLTech • Chennai, Republic Of India, IN
    AWS IaaS Infrastructure Engineer.This role ensures high availability, security, and scalability of cloud environments, supports automation and integration with CI / CD pipelines, and provides operati...Show more
    Last updated: 15 hours ago • Promoted • New!
    Generative AI Infrastructure Engineer

    Generative AI Infrastructure Engineer

    Seventh Contact Hiring Solutions • Pune, Republic Of India, IN
    Hiring : Data Engineer – AI / ML | Pune | Hybrid | Full-time.We are looking for a Data Engineer with strong experience in Machine Learning, MLOps, and Generative AI to join our Engineering team.In thi...Show more
    Last updated: 3 days ago • Promoted
    AI Infrastructure Architect

    AI Infrastructure Architect

    KPIT • Republic Of India, IN
    Notice Period- Immediate joiner.Architecture & design of scalable AI platforms.Expertise in agentic AI frameworks (LangChain, AutoGPT, CrewAI, AWS). Deep understanding of LLMs (GPT, LLaMA, Gemini) a...Show more
    Last updated: 2 days ago • Promoted
    API Infrastructure Architect

    API Infrastructure Architect

    Peoplefy • Pune, Republic Of India, IN
    Apigee Hybrid (some experience is must).Kubernetes (principal understanding must be clear).Person can handle his / her work independently. Also one of the below combination of skills is must to have : ...Show more
    Last updated: 24 days ago • Promoted
    Agentic AI Infrastructure Specialist

    Agentic AI Infrastructure Specialist

    Insight Global • Republic Of India, IN
    Agentic & AI Tech Ops Engineer.Agentic & AI Tech Ops Engineer.AI and Agentic AI systems in production.You will manage deployments, monitor performance, troubleshoot issues, and implement best pract...Show more
    Last updated: 1 day ago • Promoted
    AI Data Infrastructure Engineer

    AI Data Infrastructure Engineer

    Tata Consultancy Services • Republic Of India, IN
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI & Cloud Infrastructure Architect

    Generative AI & Cloud Infrastructure Architect

    CoinFantasy • Chennai, Republic Of India, IN
    As an AI Architect, you will design and deploy scalable, autonomous AI systems, ensuring seamless integration with cloud platforms and enterprise workflows. You will lead AI strategy, evaluate emerg...Show more
    Last updated: 3 days ago • Promoted
    AI / ML Cloud Infrastructure Engineer

    AI / ML Cloud Infrastructure Engineer

    GoML • Republic Of India, IN
    At goML, we design and build cutting-edge Generative AI, AI / ML, and Data Engineering solutions that help businesses unlock the full potential of their data, drive intelligent automation, and create...Show more
    Last updated: 3 days ago • Promoted
    AI-Powered Infrastructure Engineer

    AI-Powered Infrastructure Engineer

    Platform9 • Republic Of India, IN
    Platform9 is a leader in simplifying enterprise private clouds.Our flagship product, Private Cloud Director, turns existing infrastructure into a full-featured private cloud.Enterprise IT teams can...Show more
    Last updated: 22 days ago • Promoted
    Data Infrastructure Engineer

    Data Infrastructure Engineer

    Persistent Systems • Pune, Republic Of India, IN
    We are seeking a highly skilled and experienced Platform Engineer to join our Team.The ideal candidate will bring deep expertise in cloud-based data engineering, healthcare data modeling, and consu...Show more
    Last updated: 30+ days ago • Promoted
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    Yotta Data Services Private Limited • Republic Of India, IN
    We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to...Show more
    Last updated: 30+ days ago • Promoted
    Ai Infrastructure Architect

    Ai Infrastructure Architect

    The Adecco Group • Chennai, Republic Of India, IN
    Design and implement large-scale AI / ML infrastructure solutions using NVIDIA GPU clusters, SMCI server platforms, and high-performance computing architectures to support enterprise AI workloads.Lea...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Infrastructure Engineer

    Senior Data Infrastructure Engineer

    INDI Staffing Services • Republic Of India, IN
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 24 days ago • Promoted
    AI Infrastructure and Scaling Engineer

    AI Infrastructure and Scaling Engineer

    INSPYR Solutions • Republic Of India, IN
    Hybrid / Remote / Onsite — Add as needed].LLMs, RAG systems, AI agents, and autonomous workflows.You will play a key role in designing architecture, building scalable pipelines, and enabling production...Show more
    Last updated: 7 days ago • Promoted