Talent.com
AI Infrastructure Engineer
AI Infrastructure EngineerEROS GenAI • Chennai, Republic Of India, IN
AI Infrastructure Engineer

AI Infrastructure Engineer

EROS GenAI • Chennai, Republic Of India, IN
1 day ago
Job description

Role Overview

We are looking for an experienced MLOps Engineer to build and scale our AI infrastructure across Kubernetes, cloud-native environments, and serverless GPU platforms. You will own the end-to-end operational lifecycle of machine learning models—from training to deployment, monitoring, optimization, and automated retraining.

Key Roles

  • Design and implement highly scalable AI / ML infrastructure using Kubernetes, Kubeflow, Ray, and cloud-native services.
  • Build robust CI / CD and CT (Continuous Training) pipelines for model deployment, inference, monitoring, and automated retraining.
  • Architect and deploy ML workflows on serverless GPU platforms (AWS, GCP, Yotta, RunPod, Modal, etc.) for cost-efficient, elastic scaling.
  • Establish automated systems for model drift, data drift, performance monitoring, and lineage tracking.
  • Promote best practices in reproducible ML, infrastructure-as-code, automation, and internal tooling.

Responsibilities

  • Evaluate, integrate, and optimize MLOps tools (MLflow, Weights & Biases, KServe, Seldon, BentoML, Argo, Airflow, etc.) to streamline AI development.
  • Develop scalable inference-serving layers—batch, real-time, streaming—using GPU-optimized serving frameworks.
  • Build observability stacks for GPU utilization, latency, throughput, and model health metrics.
  • Implement robust systems for model governance, versioning, rollout strategies (blue / green, canary), and automated rollback.
  • Collaborate closely with ML engineers, data engineers, and product teams to deliver production-ready AI features.
  • Knowledge & Skills Requirements

  • Strong understanding of ML / DL fundamentals and hands-on experience with model training and optimization.
  • Expertise in Kubernetes, containerization, Helm, and cloud-native infrastructure.
  • Experience with serverless GPU architectures and distributed computing frameworks.
  • Solid knowledge of CI / CD tools (GitHub Actions, GitLab CI, Jenkins), IaC (Terraform), and workflow engines.
  • Understanding of drift detection, performance tracking, experiment management, and scalable model deployment patterns.
  • We Accept International Applicants
  • Create a job alert for this search

    Infrastructure Engineer • Chennai, Republic Of India, IN

    Related jobs
    AWS Infrastructure Architect

    AWS Infrastructure Architect

    HCLTech • Chennai, Republic Of India, IN
    AWS IaaS Infrastructure Engineer.This role ensures high availability, security, and scalability of cloud environments, supports automation and integration with CI / CD pipelines, and provides operati...Show more
    Last updated: 1 day ago • Promoted
    AI Infrastructure Engineer (Python)

    AI Infrastructure Engineer (Python)

    People Prime Worldwide • Republic Of India, IN
    Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018.It helps companies connect with remote software developers using AI-powered vetting and matching technology.Ori...Show more
    Last updated: 6 hours ago • Promoted • New!
    Platform Development Engineer - AIML Infrastructure

    Platform Development Engineer - AIML Infrastructure

    Initus HR Consulting Pvt.Ltd-US Client • Republic Of India, IN
    Platform Development Engineer – AI / ML Infrastructure.If interested share your profile to rajesh@initus.AI / ML infrastructure solutions. The role involves working at the intersection of hardware and s...Show more
    Last updated: 25 days ago • Promoted
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    EXL • Republic Of India, IN
    Deploy, monitor, and scale ML models on.GCP (Vertex AI, GKE, Cloud Functions).GitHub Actions / Jenkins / cloud-native tools. Containerize and orchestrate workloads with.MLflow, Feast, Prometheus / Gra...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Infrastructure Architect

    Lead AI Infrastructure Architect

    Veltris • Republic Of India, IN
    AI Architect - Telecom & Networking.Routing, Switching / SD-WAN / Provider Edge).Graph Neural Networks, Time-series Forecasting Algorithms (ARIMA, LSTM…). ML / DL libraries (PyTorch, TensorFlow, Sciki...Show more
    Last updated: 1 day ago • Promoted
    Cloud Infrastructure Architect

    Cloud Infrastructure Architect

    People Prime Worldwide • Pune, Republic Of India, IN
    AWS Services, Cloud Formation, IaC.Documentation & Validation Skills.Computer System Validation (CSV) Knowledge.Deep understanding of core AWS services like EC2, S3, RDS, IAM, VPC, CloudWatch, Clou...Show more
    Last updated: 30+ days ago • Promoted
    IaaS Solutions Engineer

    IaaS Solutions Engineer

    HCLTech • Chennai, Republic Of India, IN
    AWS IaaS Infrastructure Engineer.This role ensures high availability, security, and scalability of cloud environments, supports automation and integration with CI / CD pipelines, and provides operati...Show more
    Last updated: 1 day ago • Promoted
    AI Infrastructure Architect

    AI Infrastructure Architect

    KPIT • Republic Of India, IN
    Notice Period- Immediate joiner.Architecture & design of scalable AI platforms.Expertise in agentic AI frameworks (LangChain, AutoGPT, CrewAI, AWS). Deep understanding of LLMs (GPT, LLaMA, Gemini) a...Show more
    Last updated: 2 days ago • Promoted
    API Infrastructure Architect

    API Infrastructure Architect

    Peoplefy • Pune, Republic Of India, IN
    Apigee Hybrid (some experience is must).Kubernetes (principal understanding must be clear).Person can handle his / her work independently. Also one of the below combination of skills is must to have : ...Show more
    Last updated: 25 days ago • Promoted
    Agentic AI Infrastructure Specialist

    Agentic AI Infrastructure Specialist

    Insight Global • Republic Of India, IN
    Agentic & AI Tech Ops Engineer.Agentic & AI Tech Ops Engineer.AI and Agentic AI systems in production.You will manage deployments, monitor performance, troubleshoot issues, and implement best pract...Show more
    Last updated: 2 days ago • Promoted
    AI Data Infrastructure Engineer

    AI Data Infrastructure Engineer

    Tata Consultancy Services • Republic Of India, IN
    Build and maintain data infrastructure : Design and construct scalable, reliable data pipelines, storage, and processing systems in the cloud. Ensure data quality : Clean, transform, and enrich raw da...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Data Infrastructure Engineer

    Cloud Data Infrastructure Engineer

    Persistent Systems • Pune, Republic Of India, IN
    We’re looking for an AWS Data Platform Engineer to help automate and scale our cloud-based analytics environment.You’ll work with our BI and Data Engineering teams to build secure, automated, and r...Show more
    Last updated: 18 days ago • Promoted
    AI / ML Cloud Infrastructure Engineer

    AI / ML Cloud Infrastructure Engineer

    GoML • Republic Of India, IN
    At goML, we design and build cutting-edge Generative AI, AI / ML, and Data Engineering solutions that help businesses unlock the full potential of their data, drive intelligent automation, and create...Show more
    Last updated: 3 days ago • Promoted
    AI-Powered Infrastructure Engineer

    AI-Powered Infrastructure Engineer

    Platform9 • Republic Of India, IN
    Platform9 is a leader in simplifying enterprise private clouds.Our flagship product, Private Cloud Director, turns existing infrastructure into a full-featured private cloud.Enterprise IT teams can...Show more
    Last updated: 22 days ago • Promoted
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    Yotta Data Services Private Limited • Republic Of India, IN
    We’re looking for a strategic Senior MLOps Engineer to lead the end-to-end design, implementation, and scaling of our AI infrastructure. You’ll partner with researchers, product teams, and DevOps to...Show more
    Last updated: 30+ days ago • Promoted
    Ai Infrastructure Architect

    Ai Infrastructure Architect

    The Adecco Group • Chennai, Republic Of India, IN
    Design and implement large-scale AI / ML infrastructure solutions using NVIDIA GPU clusters, SMCI server platforms, and high-performance computing architectures to support enterprise AI workloads.Lea...Show more
    Last updated: 2 days ago • Promoted
    AI Infrastructure Specialist

    AI Infrastructure Specialist

    Digivance Solutions • Republic Of India, IN
    Senior AI Engineer / SageMaker Administrator.Location : Bangalore / Pune / Mysore / Hyderabad.Experience : 8+ years (3+ years relevant in AI Engineering / AWS / SageMaker). Shift Timing : 10 : 30 AM – 8 : ...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior Data Infrastructure Engineer

    Senior Data Infrastructure Engineer

    INDI Staffing Services • Republic Of India, IN
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 25 days ago • Promoted