Talent.com
Cloud Orchestration & Scheduling Architect (AI Infrastructure)
Cloud Orchestration & Scheduling Architect (AI Infrastructure)Sustainability Economics.ai • hyderabad, India
Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Sustainability Economics.ai • hyderabad, India
10 days ago
Job description

Location : Bengaluru, Karnataka

About the Company :

Sustainability Economics.ai is a global organization, pioneering the convergence of clean energy and AI, enabling profitable energy transitions while powering end-to-end AI infrastructure. By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems that drive efficiency, innovation, and long-term impact across industries. Guided by exceptional leaders and visionaries with decades of expertise in finance, policy, technology, and innovation, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.

Role Summary :

We are seeking a Cloud Orchestration & Scheduling Architect to design and implement intelligent systems that dynamically balance AI workload demand, supply and compute capacity across cloud data centers. The role focuses on building orchestration, scheduling, and optimization frameworks for large-scale AI inference workloads, ensuring efficient use of compute, energy, and cost resources.

The ideal candidate will have strong experience in Kubernetes, distributed systems, and scheduling frameworks, with a deep understanding of how to align AI compute workloads with real-time demand and supply.

Key Responsibilities :

  • Design and implement workload orchestration and scheduling systems for AI inference pipelines across distributed data centers.
  • Develop mechanisms to match workload demand with available compute and supply, optimizing for performance, cost, and sustainability.
  • Integrate predictive demand forecasting and energy availability data into scheduling decisions.
  • Manage multi-region orchestration using Kubernetes, Ray, or similar distributed compute frameworks.
  • Build automation to dynamically scale GPU / CPU clusters based on real-time and forecasted AI inference workloads.
  • Implement cost-aware, and latency-aware scheduling policies for optimal workload placement.
  • Build dashboards and observability tools to track compute utilization, cost efficiency.
  • Continuously evaluate new frameworks and optimization algorithms to enhance system scalability and resilience.

Education & Experience :

  • Bachelor's or master's degree in computer science, Information Technology, or related field.
  • Proven experience of 2–5 years in cloud infrastructure, distributed systems, or large-scale DevOps environments.
  • Proven experience in AI / ML infrastructure orchestration, workflow scheduling, or HPC environments.
  • Hands-on experience managing workloads on AWS, or hybrid cloud platforms.
  • Certifications (preferred) :
  • AWS Certified Solutions Architect – Associate
  • Certified Kubernetes Administrator (CKA)
  • Skills Required :

  • Strong proficiency in Kubernetes, EKS, or Ray for distributed workload orchestration.
  • Experience with workflow orchestration tools like Airflow, Argo, or Prefect.
  • Familiarity with containerization (Docker), IaC tools (Terraform / CloudFormation), and GitOps (Argo CD).
  • Understanding scheduling algorithms, cluster autoscaling, and load balancing in large systems.
  • Experience with inference batching, request routing, and autoscaling strategies using frameworks like Ray Serve, Triton Inference Server, or KServe.
  • Experience building or tuning custom schedulers for optimization.
  • Knowledge of GPU orchestration, NVIDIA Triton, or KServe for model serving at scale.
  • Understanding of GPU utilization optimization, and CUDA profiling for efficient model execution.
  • Experience in AIOps : automated monitoring, anomaly detection, root-cause analysis, and predictive operations for AI workloads.
  • Experience building or tuning custom schedulers for optimization.
  • Experience building demand forecasting and queue-based scheduling (Redis, Kafka, or similar) systems to balance compute load and supply.
  • Proficiency in Python, Go, or Bash scripting for automation.
  • Exposure to monitoring and observability tools (Prometheus, Grafana, CloudWatch).
  • What You’ll Do :

  • Design the orchestration layer for AI workloads across distributed data centers.
  • Optimize resource allocation by balancing compute demand, supply and economics.
  • Build automation pipelines for dynamic scaling and job scheduling.
  • Monitor system performance and drive continuous improvements in utilization and efficiency.
  • What you will bring

  • Strong systems thinking and the ability to design control mechanisms for complex, distributed workloads.
  • Passion for optimizing AI infrastructure for efficiency, reliability, and sustainability.
  • Curiosity about distributed scheduling and cloud optimization.
  • Hands-on experience with container orchestration, automation, and observability.
  • A proactive, ownership-driven mindset suited for a fast-paced, mission-driven environment.
  • Agile mindset, adaptability, and eagerness to learn emerging tools and technologies.
  • Proactive, ownership-driven approach, with the ability to improve systems end-to-end.
  • Startup DNA → bias to action, comfort with ambiguity, love for fast iteration, and flexible and growth mindset.
  • Why Join Us

  • Shape a first-of-its-kind AI + clean energy platform.
  • Work with a small, mission-driven team obsessed with impact.
  • An aggressive growth path.
  • A chance to leave your mark at the intersection of AI and sustainability.
  • Create a job alert for this search

    Cloud Infrastructure Architect • hyderabad, India

    Related jobs
    Cloud Architect

    Cloud Architect

    ValueMomentum • Hyderabad, Telangana, India
    Cloud Architect (Managed Services) About the Role We are an MSP (Managed Services Provider) seeking an experienced Azure Cloud Architect to guide the architecture and design of multi-cloud enviro...Show more
    Last updated: 17 days ago • Promoted
    Cloud Solutions Architect

    Cloud Solutions Architect

    Tata Consultancy Services • Hyderabad, Telangana, India
    TCS presents excellent opportunity for.Chennai / Bangalore / Hyderabad / Mumbai / Pune / Kolkata / Delhi / Noida / Gurgaon. Experience as Cloud Solution Architect in any one of the following cloud t...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Solutions Architect

    Cloud Solutions Architect

    Cloud4C Services • Hyderabad, Republic Of India, IN
    Cloud4C is the fastest growing Cloud Infrastructure and Managed Services Provider supporting mission critical workloads of 3500+ enterprises including 60+ of the Global Fortune 500 companies.Cloud4...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Architect

    Cloud Architect

    Vagaro Technologies • secunderabad, telangana, in
    Lead the cloud architecture design and implementation across multiple Azure environments, ensuring scalability, performance, cost efficiency, and compliance. Responsible for defining best practices,...Show more
    Last updated: 17 days ago • Promoted
    AWS Cloud Solution Architect

    AWS Cloud Solution Architect

    ValueLabs • Hyderabad, Telangana, India
    Valuelabs is a leading technology company that has been revolutionizing the way businesses operate for 27 years.With over 7000+ employees across 28 office locations, we have established ourselves a...Show more
    Last updated: 2 days ago • Promoted
    Cloud Architect - Azure / AWS / Google Cloud Platform

    Cloud Architect - Azure / AWS / Google Cloud Platform

    The Modern Data Company • Hyderabad
    At Modern, we are seeking a highly skilled and motivated Cloud Architect with a strong consulting and engineering background to join our Client Technologies Team. As a senior cloud architect, you wi...Show more
    Last updated: 30+ days ago • Promoted
    Platform Architect - Cloud, Application

    Platform Architect - Cloud, Application

    Optum • Hyderabad, Telangana, India
    Principal Cloud Architect & Enterprise Architect who takes pride in what you deliver and passionate about developing strategy for migration in the cloud as well as developing new applications in th...Show more
    Last updated: 17 days ago • Promoted
    Azure Infrastructure Solution Architect

    Azure Infrastructure Solution Architect

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Design Azure infra, Network, load balancer.Design and manage Azure cloud infrastructure, including IaaS, PaaS, and SaaS solutions. Configure and maintain Azure networking, security, and identity man...Show more
    Last updated: 17 days ago • Promoted
    Cloud Architect

    Cloud Architect

    ValueLabs • Hyderabad, Telangana, India
    Experience : 10+ Years We are looking at expanding our Cloud COE group to support multiple cloud environments and looking for one Azure architect (hands on) and one AWS architect (hands on).Here ar...Show more
    Last updated: 30+ days ago • Promoted
    Azure Architect

    Azure Architect

    KPI Partners • Hyderabad, India
    Strong experience in Azure Databricks administration & platform design.Hands-on experience with Terraform / Bicep for Databricks / Azure automation. Good understanding of Azure DevOps or GitHub CI / CD.Fa...Show more
    Last updated: 3 days ago • Promoted
    Azure Cloud Architect

    Azure Cloud Architect

    ValueMomentum • Hyderabad, Republic Of India, IN
    Cloud Architect (Azure / AWS) – Hyderabad / Pune.This is an exciting opportunity to lead.As a Cloud Architect, you will : . DevSecOps and platform engineering teams.Drive cloud strategy, architecture st...Show more
    Last updated: 30+ days ago • Promoted
    Azure Infrastructure Architect

    Azure Infrastructure Architect

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Designs scalable, secure, and highly available cloud solutions using Microsoft Azure services • Design end-to-end cloud solutions using Azure services •. Create architecture diagrams, deployment mod...Show more
    Last updated: 30+ days ago • Promoted
    Auxo AI - Oracle Cloud Fusion Architect

    Auxo AI - Oracle Cloud Fusion Architect

    AuxoAI • Hyderabad
    Description : Key Responsibilities : - Architect and lead the migration roadmap from Oracle EBS R12 to Fusion ERP on O...Show more
    Last updated: 10 days ago • Promoted
    Azure infrastructure solution architect

    Azure infrastructure solution architect

    Tata Consultancy Services • Hyderabad, Telangana, India
    Design Azure infra, Network, load balancer.Design and manage Azure cloud infrastructure, including IaaS, PaaS, and SaaS solutions. Configure and maintain Azure networking, security, and identity man...Show more
    Last updated: 17 days ago • Promoted
    Cloud Infrastructure Architect

    Cloud Infrastructure Architect

    ValueLabs • Hyderabad, Republic Of India, IN
    Valuelabs is a leading technology company that has been revolutionizing the way businesses operate for 27 years.With over 7000+ employees across 28 office locations, we have established ourselves a...Show more
    Last updated: 17 days ago • Promoted
    Azure Cloud Architect

    Azure Cloud Architect

    Tata Consultancy Services • Hyderabad, Telangana, India
    Designs scalable, secure, and highly available cloud solutions using Microsoft Azure services • Design end-to-end cloud solutions using Azure services •. Create architecture diagrams, deployment mod...Show more
    Last updated: 30+ days ago • Promoted
    Migration Architect – Wireless & Cloud Platform Transformation

    Migration Architect – Wireless & Cloud Platform Transformation

    Veltris • Hyderabad, Telangana, India
    Wireless Networking Expertise : - Deep understanding of WLAN architecture (802.SSID, VLAN, Radius, DHCP, DNS), RF fundamentals, and mobility. Hands-on experience with Aruba AOS 6 / 8 / 10 platforms.Cloud...Show more
    Last updated: 28 days ago • Promoted
    Sr Cloud Architect

    Sr Cloud Architect

    The Edge Partnership • Hyderabad, India
    Some of the key responsibilities will include : .To design and implement scalable, secure, and highly available cloud-based solutions, primarily utilizing Azure Cloud. To drive the design and evolutio...Show more
    Last updated: 30+ days ago • Promoted