Talent.com
AI Infrastructure Engineer
AI Infrastructure EngineerSociete Generale Global Solution Centre • Bengaluru, Republic Of India, IN
AI Infrastructure Engineer

AI Infrastructure Engineer

Societe Generale Global Solution Centre • Bengaluru, Republic Of India, IN
6 days ago
Job description

We are looking for an experienced Senior AI Platform Engineer to join our team and lead the development of our core AI execution infrastructure. This role is central to our strategy, focusing on designing, building, and scaling a robust, high-performance platform capable of deploying and managing thousands of concurrent AI agents. You will be responsible for ensuring the platform provides reliability, observability, and cost-efficiency at scale.

What You Will Do

  • Platform Architecture : Design and implement the core components of the AI platform, including runtime environments, distributed scheduling, and resource management systems (e.G., CPU / GPU compute clusters, autoscaling).
  • Scalability & Performance : Develop and optimize distributed systems and microservices to handle massive scale and low-latency requirements for agent execution.
  • Infrastructure Automation : Work closely with DevOps / SRE teams to automate deployment, scaling, and monitoring using technologies like Kubernetes, Terraform, and CI / CD pipelines.
  • Agent Lifecycle : Implement APIs and services that manage the full lifecycle of an AI agent, from ingestion and registration to execution, monitoring, and versioning.
  • Observability : Implement comprehensive logging, tracing, and metrics for all platform components to provide deep insights into agent behavior and system health.
  • Best Practices : Drive best practices for code quality, security, and operational excellence within the platform engineering team.

Key Requirements

  • 10+ years of professional software engineering experience, with a significant focus on cloud infrastructure and platform development.
  • Mandatory : Proven expertise in developing, deploying, and scaling distributed systems (e.G., Kafka or HPC distributed compute frameworks) in a production environment.
  • Expert-level proficiency in at least one modern programming language (e.G., .NET, Python, Rust).
  • Deep practical experience with container orchestration (e.G., Kubernetes, Knative), cloud providers (e.G., Azure, AWS) and infra as code (Terraform).
  • Solid understanding of networking, security, and performance optimization for data-intensive applications.
  • Experience building high-throughput APIs (REST / gRPC) and developing platform service interfaces.
  • Bonus Points

  • Prior experience in MLOps, LLMOps, or building systems specifically for running machine learning models or AI agents.
  • Familiarity with agentic frameworks, large language models (LLMs), agent protocols (MCP, A2A) and their unique deployment challenges.
  • Experience with high-performance computing (HPC) environments or GPU virtualization.
  • Comes from an lead AI software company or a software company delivering LLM frameworks.
  • Create a job alert for this search

    Infrastructure Engineer • Bengaluru, Republic Of India, IN

    Similar jobs
    Platform Engineer, AI Infrastructure

    Platform Engineer, AI Infrastructure

    Movate • Bengaluru, Republic Of India, IN
    Job Title : Platform Support Engineer for AI Solutions | Experience : 3-5 Years.We are seeking a proactive and skilled Platform Support Engineer to join our team, supporting cutting-edge AI-based sol...Show more
    Last updated: 18 days ago • Promoted
    Cloud Infrastructure Engineer

    Cloud Infrastructure Engineer

    ALIANDO • Bengaluru, IN
    Senior Cloud Infrastructure Engineer.ALIANDO is an award-winning Azure Expert Managed Service solutions company focused on selling and deploying Microsoft technologies for U.For over 20 years, Micr...Show more
    Last updated: 1 day ago • Promoted
    Infrastructure Operation Engineer

    Infrastructure Operation Engineer

    Evolving Systems • Bengaluru, Karnataka, India
    Shift timings : 9 PM to 3 AM (IST).HeadSpin, a PartnerOne company, is an AI-powered testing platform that enables real-world testing on SIM-enabled mobile devices, browsers, Smart TVs, and OTT devic...Show more
    Last updated: 1 day ago • Promoted
    AWS Network Architect

    AWS Network Architect

    Tata Consultancy Services • Bengaluru, Karnataka, India
    TCS is Hiring AWS Network Architect For Bangalore location.Versed in infrastructure as code practices using Terraform.Working knowledge of DevOps and delivery tools like Gitlab.Knowledge of process...Show more
    Last updated: 1 day ago • Promoted
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    Recro • Bengaluru, Republic Of India, IN
    Workmode : 4 days wfo+ 1 day wfh.MLOps, Model Deployment & Monitoring.Azure Cloud (Azure ML, ADF, AKS, etc.Databricks (Delta Lake, MLflow, Notebooks, Jobs). CI / CD, GitOps, Infrastructure as Code (Ter...Show more
    Last updated: 24 days ago • Promoted
    Senior AI Infrastructure Engineer - DGX Cloud

    Senior AI Infrastructure Engineer - DGX Cloud

    Confidential • Bengaluru / Bangalore, India
    NVIDIA is looking for an outstanding, passionate, and talented Senior AI Infrastructure Engineer to join our DGX Cloud group. This engineering role will design, build and maintain large scale produc...Show more
    Last updated: 15 days ago • Promoted
    Infra Engineer

    Infra Engineer

    sugar.fit • Bengaluru, Karnataka, India
    Founded in 2021, Sugarfit provides a “Personalised evidence-based path to Type 2 and.Pre-Diabetes Reversal & management”. Sugarfit leverages a precision health platform combining.CGM sensors, Machin...Show more
    Last updated: 1 day ago • Promoted
    Platform Engineer- AI

    Platform Engineer- AI

    Smarsh • Bengaluru, Karnataka, India
    Smarsh empowers its customers to manage risk and unleash intelligence in their digital communications.Our growing community of over 6500 organizations in regulated industries counts on Smarsh every...Show more
    Last updated: 1 day ago • Promoted
    AI infrastructure engineer

    AI infrastructure engineer

    Confidential • Bengaluru / Bangalore, India
    Trident Consulting is seeking a.A global leader in business and technology services.Bangalore, IN – Remote (Requires travel when needed). We are looking for an AI infrastructure engineer with strong...Show more
    Last updated: 6 days ago • Promoted
    Sr. Cloud Infrastructure Support Engineer (AWS, Azure and GCP) _HCL Cloud Product (Bangalore)

    Sr. Cloud Infrastructure Support Engineer (AWS, Azure and GCP) _HCL Cloud Product (Bangalore)

    HCLSoftware • Bengaluru, Karnataka, India
    Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the areas of Customer Experien...Show more
    Last updated: 1 day ago • Promoted
    Network Infrastructure Engineer

    Network Infrastructure Engineer

    Infogain • Bengaluru, Karnataka, India
    Position : Network Infrastructure / DCP Engineer.Experience Required : 3 to 6 Years.Primary Skills : Deployment, Activation and Operation of hyperscale data centre network infrastructure.Secondary Ski...Show more
    Last updated: 1 day ago • Promoted
    AI Engineer (Conversational Analytics & GenAI Systems)

    AI Engineer (Conversational Analytics & GenAI Systems)

    IRISS, Inc. • Bengaluru, Karnataka, India
    Our commitment to pushing boundaries and delivering exceptional solutions has positioned us as a trusted partner for clients seeking top-tier technical expertise in Condition Based Monitoring.IRISS...Show more
    Last updated: 1 day ago • Promoted
    Generative AI Engineer with Cloud (GCP) || Bangalore and Noida

    Generative AI Engineer with Cloud (GCP) || Bangalore and Noida

    HCLTech • Bengaluru, Karnataka, India
    HCLTech is hiring Gen AI Engineer with Cloud (GCP) experience for Noida and Bangalore location.Please find below mentioned Job Description : . Job Description : GenAI Engineer.Lead the development of s...Show more
    Last updated: 1 day ago • Promoted
    Infrastructure Operations Engineer

    Infrastructure Operations Engineer

    HeadSpin • Bengaluru, Karnataka, India
    PartnerOne company, is an AI-powered testing platform that enables real-world testing on SIM-enabled mobile devices, browsers, Smart TVs, and OTT devices across 50+ global locations, with flexible ...Show more
    Last updated: 1 day ago • Promoted
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    Capgemini • Bengaluru, Republic Of India, IN
    Hands on experience with Azure devops, Mlops, CI / CD pipelines, Python, Git, docker.Expert in Azure databricks, Azure machine learning, Unity catlog.Show more
    Last updated: 30+ days ago • Promoted
    Senior AI Platform & Infrastructure Engineer

    Senior AI Platform & Infrastructure Engineer

    Confidential • Bengaluru / Bangalore, India
    Title : Senior AI Platform & Infrastructure Engineer.Were looking for an experienced Infrastructure Engineer with a strong background in Kubernetes (K8s), GPU-based workloads, and scaling large dist...Show more
    Last updated: 18 days ago • Promoted
    Lead Infrastructure Engineer

    Lead Infrastructure Engineer

    Dar • Bengaluru, Karnataka, India
    Dar, the founding member of the Sidara group, is an international multidisciplinary consulting organization specializing in engineering, architecture, planning, environment, project management, fac...Show more
    Last updated: 15 hours ago • Promoted • New!
    AI Infrastructure Engineer

    AI Infrastructure Engineer

    Stealth AI Startup • Bengaluru, Republic Of India, IN
    Job Role : Backend Engineer – AI Applications.AI Infrastructure and Applications.Generative AI, Agentic Frameworks, Cloud Platforms, and AI Infrastructure. If you are passionate about building robus...Show more
    Last updated: 16 days ago • Promoted