Talent.com
Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Sustainability Economics.aichennai, tamil nadu, in
7 hours ago
Job description

Location : Bengaluru, Karnataka

About the Company :

Sustainability Economics.ai is a global organization, pioneering the convergence of clean energy and AI, enabling profitable energy transitions while powering end-to-end AI infrastructure. By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems that drive efficiency, innovation, and long-term impact across industries. Guided by exceptional leaders and visionaries with decades of expertise in finance, policy, technology, and innovation, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.

Role Summary :

We are seeking a  Cloud Orchestration & Scheduling Architect  to design and implement intelligent systems that dynamically balance  AI workload demand, supply and compute capacity across cloud data  centers. The role focuses on  building orchestration, scheduling, and optimization frameworks  for large-scale AI inference workloads, ensuring efficient use of compute, energy, and cost resources.

The ideal candidate will have strong experience in  Kubernetes, distributed systems, and scheduling frameworks , with a deep understanding of how to align  AI compute workloads with real-time demand and supply.

Key Responsibilities :

  • Design and implement  workload orchestration and scheduling systems  for AI inference pipelines across distributed data centers.
  • Develop mechanisms to  match workload demand with available compute and supply , optimizing for performance, cost, and sustainability.
  • Integrate  predictive demand forecasting  and  energy availability data  into scheduling decisions.
  • Manage  multi-region orchestration  using Kubernetes, Ray, or similar distributed compute frameworks.
  • Build automation to dynamically  scale GPU / CPU clusters  based on real-time and forecasted AI inference workloads.
  • Implement  cost-aware, and latency-aware scheduling policies  for optimal workload placement.
  • Build dashboards and observability tools to track  compute utilization, cost efficiency.
  • Continuously evaluate new frameworks and optimization algorithms to enhance system scalability and resilience.

Education & Experience :

  • Bachelor's or master's degree in computer science, Information Technology, or related field.
  • Proven experience of 2–5   years   in cloud infrastructure, distributed systems, or large-scale DevOps environments.
  • Proven experience in AI / ML infrastructure orchestration, workflow scheduling, or HPC environments.
  • Hands-on experience managing workloads on AWS, or hybrid cloud platforms.
  • Certifications  (preferred) :
  • AWS Certified Solutions Architect – Associate
  • Certified Kubernetes Administrator (CKA)
  • Skills Required :

  • Strong proficiency in  Kubernetes ,  EKS , or  Ray  for distributed workload orchestration.
  • Experience with  workflow orchestration tools  like Airflow, Argo, or Prefect.
  • Familiarity with containerization  (Docker), IaC tools (Terraform / CloudFormation) , and  GitOps (Argo CD) .
  • Understanding  scheduling algorithms ,  cluster autoscaling , and  load balancing  in large systems.
  • Experience with inference batching, request routing, and autoscaling strategies using frameworks like  Ray Serve ,  Triton Inference Server , or  KServe .
  • Experience building or tuning  custom schedulers  for optimization.
  • Knowledge of  GPU orchestration ,  NVIDIA Triton , or  KServe  for model serving at scale.
  • Understanding of  GPU utilization optimization , and  CUDA profiling  for efficient model execution.
  • Experience in AIOps : automated monitoring, anomaly detection, root-cause analysis, and predictive operations for AI workloads.
  • Experience building or tuning  custom schedulers  for optimization.
  • Experience building  demand forecasting  and  queue-based scheduling  (Redis, Kafka, or similar) systems to balance compute load and supply.
  • Proficiency in Python, Go, or Bash scripting for automation.
  • Exposure to monitoring and observability tools (Prometheus, Grafana, CloudWatch).
  • What You’ll Do :

  • Design the orchestration layer for AI workloads across distributed data centers.
  • Optimize resource allocation by balancing compute demand, supply and economics.
  • Build automation pipelines for dynamic scaling and job scheduling.
  • Monitor system performance and drive continuous improvements in utilization and efficiency.
  • What you will bring

  • Strong systems thinking and the ability to design control mechanisms for complex, distributed workloads.
  • Passion for optimizing AI infrastructure for efficiency, reliability, and sustainability.
  • Curiosity about  distributed scheduling  and  cloud optimization.
  • Hands-on experience with container orchestration, automation, and observability.
  • A proactive, ownership-driven mindset suited for a fast-paced, mission-driven environment.
  • Agile mindset, adaptability, and eagerness to learn emerging tools and technologies.
  • Proactive, ownership-driven approach, with the ability to improve systems end-to-end.
  • Startup DNA → bias to action, comfort with ambiguity, love for fast iteration, and flexible and growth mindset.
  • Why Join Us

  • Shape a  first-of-its-kind AI + clean energy platform .
  • Work with a small, mission-driven team obsessed with impact.
  • An aggressive growth path.
  • A chance to leave your mark at the intersection of  AI and sustainability .
  • Create a job alert for this search

    Cloud Infrastructure Architect • chennai, tamil nadu, in

    Related jobs
    • Promoted
    • New!
    Oracle Subscription Cloud Architect

    Oracle Subscription Cloud Architect

    Tata Consultancy Serviceschennai, tamil nadu, in
    Relevant Experience (in Yrs) : 8 to 16 Yrs.Oracle ERP implementations with at least 5+ years in Oracle Cloud Financial and Subscription Management applications. Experience of performing as lead Subsc...Show moreLast updated: 7 hours ago
    • Promoted
    Cloud Architect

    Cloud Architect

    Green HR SolutionsChennai, IN
    Hiring for a USA based multinational Company (MNC).We are seeking an experienced and visionary Cloud Architect to design, implement, and manage scalable cloud infrastructure solutions.The ideal can...Show moreLast updated: 27 days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    The Goodyear Tire & Rubber Companychennai, tamil nadu, in
    Strong experience designing and building cloud-native applications.Proficiency in modern backend and frontend frameworks (e. Deep knowledge of DevSecOps, CI / CD pipelines, and infrastructure-as-code....Show moreLast updated: 19 days ago
    • Promoted
    • New!
    Azure Cloud Architect

    Azure Cloud Architect

    Tata Consultancy Servicesmount, India
    Designs scalable, secure, and highly available cloud solutions using Microsoft Azure services • Design end-to-end cloud solutions using Azure services •. Create architecture diagrams, deployment mod...Show moreLast updated: 14 hours ago
    Cloud architect

    Cloud architect

    ScaleneWorksChennai, Tamil Nadu, India
    Quick Apply
    Position Name : Cloud Architect.Position Title : Manager Cloud Engineering.A Cloud Architect is responsible for designing, managing, and overseeing the cloud computing strategy of an organization.T...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    Hexaware Technologieschennai, tamil nadu, in
    Total IT Experience 12 to 18 years.Must experience in Cloud Architect.Must experience in Azure (Func, Blob storage, API Mgmt, Logic apps). Can be from any technical programming background like.NET C...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Cloud Architect

    Cloud Architect

    AspiringITchennai, tamil nadu, in
    Job Title : Cloud Architect (Multi-Cloud & Solution Architecture).We are seeking a seasoned Cloud Architect with deep expertise in multi-cloud environments (AWS, Azure, GCP) and a strong background ...Show moreLast updated: 7 hours ago
    • Promoted
    SAP Basis Cloud architect Advisory

    SAP Basis Cloud architect Advisory

    HCLTechChennai, IN
    CAA (Cloud Architect Advisory).This is SAP Cloud Architect position which is elevated role as per career progression / path for SAP Basis consultant. Architect’s primary role / responsibility is to pl...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Cloud Architect - IAC Terraform

    Azure Cloud Architect - IAC Terraform

    Sampoorna Consultants Pvt. LtdChennai
    Essential Functions : - Azure Infrastructure enterprise level projects that design and deploy cloud environments for hosting business application services ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Cloud Architect - IAC Terraform

    Azure Cloud Architect - IAC Terraform

    ConfidentialChennai, India
    Azure Infrastructure enterprise level projects that design and deploy cloud environments for hosting business application services. Working closely with application, network, and security teams to e...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    GCP Cloud Architect

    GCP Cloud Architect

    Tata Elxsichennai, tamil nadu, in
    The GCP Cloud Architect is responsible for designing, implementing, and optimizing cloud-native solutions on Google Cloud Platform. This role will work closely with engineering, security, networking...Show moreLast updated: 7 hours ago
    • Promoted
    Cloud Architect (Infrastructure)

    Cloud Architect (Infrastructure)

    ConfidentialChennai, India
    Cloud Architect (infrastructure).Infrastructure Architecture team.You will play a key role in designing, building, and maintaining our hybrid and multi cloud infrastructure architecture, ensuring i...Show moreLast updated: 10 days ago
    • Promoted
    IFS Architect

    IFS Architect

    Numeric TechnologiesChennai, IN
    Shift Timing : 2 : 00 PM - 10 : 00 PM IST / Remote.This is a cross-functional leadership role responsible for solution architecture, integration strategy, and governance across modules like Supply Chain...Show moreLast updated: 19 days ago
    • Promoted
    Cloud Solution Architect

    Cloud Solution Architect

    WorkassistChennai
    Description : Cloud Solution Architect (Azure) Experience : 12-15 Years ...Show moreLast updated: 20 days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    iVedha Inc.Chennai, IN
    Seeking a highly experienced Cloud Architect to design and oversee robust, scalable, and secure.Architect end-to-end cloud solutions (public, private, hybrid) with a focus on reliability, security,...Show moreLast updated: 30+ days ago
    • Promoted
    Platform and Cloud Architect

    Platform and Cloud Architect

    ANI Pharmaceuticals, Inc.Chennai, Tamil Nadu, India
    Welcome to ANI Pharmaceuticals, where we are dedicated to improving and enhancing patients' lives through the manufacturing and distribution of high-quality pharmaceutical products.With a diverse p...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Cloud Architect

    Cloud Architect

    Technogen India Pvt. Ltd.chennai, tamil nadu, in
    Skills : Azure, Terraform and Githubhub Actions.Please share your resumes to jyothsna.Technical Design, Development & Problem Solving : . Provide recommendations on architectural changes to improve ef...Show moreLast updated: 7 hours ago
    • Promoted
    Senior Manager–Cloud Infra Architect

    Senior Manager–Cloud Infra Architect

    Best Infosystems Ltd.chennai, tamil nadu, in
    Senior Manager–Cloud Infra Architect_Full-Time_Remote (Delhi NCR).Senior Manager–Cloud Infra Architect.Azure Cloud Architect, migration, Infrastructure as Code (IAM), Terraform, ARM templates, Bice...Show moreLast updated: 30+ days ago