Talent.com
Cloud Orchestration & Scheduling Architect (AI Infrastructure)
Cloud Orchestration & Scheduling Architect (AI Infrastructure)Sustainability Economics.ai • Karnataka, India
No longer accepting applications
Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Sustainability Economics.ai • Karnataka, India
19 days ago
Job description

Location : Bengaluru, Karnataka

About the Company :

Sustainability Economics.ai is a global organization, pioneering the convergence of clean energy and AI, enabling profitable energy transitions while powering end-to-end AI infrastructure. By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems that drive efficiency, innovation, and long-term impact across industries. Guided by exceptional leaders and visionaries with decades of expertise in finance, policy, technology, and innovation, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.

Role Summary :

We are seeking a Cloud Orchestration & Scheduling Architect to design and implement intelligent systems that dynamically balance AI workload demand, supply and compute capacity across cloud data centers. The role focuses on building orchestration, scheduling, and optimization frameworks for large-scale AI inference workloads, ensuring efficient use of compute, energy, and cost resources.

The ideal candidate will have strong experience in Kubernetes, distributed systems, and scheduling frameworks, with a deep understanding of how to align AI compute workloads with real-time demand and supply.

Key Responsibilities :

  • Design and implement workload orchestration and scheduling systems for AI inference pipelines across distributed data centers.
  • Develop mechanisms to match workload demand with available compute and supply, optimizing for performance, cost, and sustainability.
  • Integrate predictive demand forecasting and energy availability data into scheduling decisions.
  • Manage multi-region orchestration using Kubernetes, Ray, or similar distributed compute frameworks.
  • Build automation to dynamically scale GPU / CPU clusters based on real-time and forecasted AI inference workloads.
  • Implement cost-aware, and latency-aware scheduling policies for optimal workload placement.
  • Build dashboards and observability tools to track compute utilization, cost efficiency.
  • Continuously evaluate new frameworks and optimization algorithms to enhance system scalability and resilience.

Education & Experience :

  • Bachelor's or master's degree in computer science, Information Technology, or related field.
  • Proven experience of 2–5 years in cloud infrastructure, distributed systems, or large-scale DevOps environments.
  • Proven experience in AI / ML infrastructure orchestration, workflow scheduling, or HPC environments.
  • Hands-on experience managing workloads on AWS, or hybrid cloud platforms.
  • Certifications (preferred) :
  • AWS Certified Solutions Architect – Associate
  • Certified Kubernetes Administrator (CKA)
  • Skills Required :

  • Strong proficiency in Kubernetes, EKS, or Ray for distributed workload orchestration.
  • Experience with workflow orchestration tools like Airflow, Argo, or Prefect.
  • Familiarity with containerization (Docker), IaC tools (Terraform / CloudFormation), and GitOps (Argo CD).
  • Understanding scheduling algorithms, cluster autoscaling, and load balancing in large systems.
  • Experience with inference batching, request routing, and autoscaling strategies using frameworks like Ray Serve, Triton Inference Server, or KServe.
  • Experience building or tuning custom schedulers for optimization.
  • Knowledge of GPU orchestration, NVIDIA Triton, or KServe for model serving at scale.
  • Understanding of GPU utilization optimization, and CUDA profiling for efficient model execution.
  • Experience in AIOps : automated monitoring, anomaly detection, root-cause analysis, and predictive operations for AI workloads.
  • Experience building or tuning custom schedulers for optimization.
  • Experience building demand forecasting and queue-based scheduling (Redis, Kafka, or similar) systems to balance compute load and supply.
  • Proficiency in Python, Go, or Bash scripting for automation.
  • Exposure to monitoring and observability tools (Prometheus, Grafana, CloudWatch).
  • What You’ll Do :

  • Design the orchestration layer for AI workloads across distributed data centers.
  • Optimize resource allocation by balancing compute demand, supply and economics.
  • Build automation pipelines for dynamic scaling and job scheduling.
  • Monitor system performance and drive continuous improvements in utilization and efficiency.
  • What you will bring

  • Strong systems thinking and the ability to design control mechanisms for complex, distributed workloads.
  • Passion for optimizing AI infrastructure for efficiency, reliability, and sustainability.
  • Curiosity about distributed scheduling and cloud optimization.
  • Hands-on experience with container orchestration, automation, and observability.
  • A proactive, ownership-driven mindset suited for a fast-paced, mission-driven environment.
  • Agile mindset, adaptability, and eagerness to learn emerging tools and technologies.
  • Proactive, ownership-driven approach, with the ability to improve systems end-to-end.
  • Startup DNA → bias to action, comfort with ambiguity, love for fast iteration, and flexible and growth mindset.
  • Why Join Us

  • Shape a first-of-its-kind AI + clean energy platform.
  • Work with a small, mission-driven team obsessed with impact.
  • An aggressive growth path.
  • A chance to leave your mark at the intersection of AI and sustainability.
  • Create a job alert for this search

    Cloud Infrastructure Architect • Karnataka, India

    Related jobs
    Transition Solution Architect

    Transition Solution Architect

    Tata Consultancy Services • Karnataka, India, India
    TCS is hiring for Transition Solution Architect.Skills required : Transition methodologies, Presales, RFP's, RFIs.Desired Experience Range : 8 to 15 years. Preferred / Current Location : Pan India.Transi...Show more
    Last updated: 17 days ago • Promoted
    AWS Cloud DevOps Engineer - SSE

    AWS Cloud DevOps Engineer - SSE

    Trigent Software Private Limited • KA, India
    Quick Apply
    Design, implement, and manage AWS cloud infrastructure using Terraform.Automate configuration management using Ansible Playbooks and Ansible Tower. Perform Linux system administration including patc...Show more
    Last updated: 6 hours ago • New!
    Cloud Engineer (AWS, GCP)

    Cloud Engineer (AWS, GCP)

    Tata Consultancy Services • Are Telagadde, Karnataka, India
    Greetings from TATA CONSULTANCY SERVICES!!! TCS is hiring for Cloud Engineer(AWS, GCP) Experience Range : 5 -10 years Location : PAN India Notice Period : 0 -15 / 30 days, Immediate joiners are also pr...Show more
    Last updated: 8 hours ago • Promoted • New!
    Hadoop Admin

    Hadoop Admin

    LTIMindtree • Karnataka, India, India
    Job Location : Bangalore, Hyderabad, Chennai, Mumbai, Pune.Notice Period : Immediate to 15 days.Please do not apply Notice Period with more than 15 days of Notice Period. Mandatory Skills : Build Cloud...Show more
    Last updated: 19 days ago • Promoted
    Engineering Manager / Solution Architect

    Engineering Manager / Solution Architect

    Qode • Karnataka, KA, IN
    Quick Apply
    Experience Required : 12+ Years.Department : Technology / Digital Commerce.We are seeking a highly experienced and visionary Engineering Manager / Solution Architect. Salesforce Commerce Cloud (SFCC),...Show more
    Last updated: 30+ days ago
    Google Cloud Engineer - SSE

    Google Cloud Engineer - SSE

    Trigent Software Private Limited • KA, India
    Quick Apply
    Skill : Google Cloud Engineer - SSE exp : 5+ Yrs Location : Pan India, Priority Bangalore JD : Key Responsibilities : Position Description<...Show more
    Last updated: 6 hours ago • New!
    Senior Platform Engineer

    Senior Platform Engineer

    ACL Digital • Karnataka, India, India
    ACL Digital is hiring for Senior Platfor Developer for Bangalore.Senior Platform Developer (C / C++ – Linux Kernel, Drivers, Networking). Linux kernel, device driver development, and networking techno...Show more
    Last updated: 20 days ago • Promoted
    Technical Consultant

    Technical Consultant

    HCLTech • Karnataka, India, India
    Job Description : Full Stack ServiceNow Developer SPM – Agentic Workforce AI • •.We are on the lookout for a highly skilled Full Stack ServiceNow Developer to join our dynamic team.This role is pivota...Show more
    Last updated: 17 days ago • Promoted
    System Support Engineer

    System Support Engineer

    Vinebrook Technology • Karnataka, India, India
    Communicate clearly with customers both in writing and over the phone.Perform mid-level and advanced troubleshooting of issues across the services provided by the Managed Services team.Engage direc...Show more
    Last updated: 30+ days ago • Promoted
    Gen AI

    Gen AI

    ObjectWin Technology India Pvt. Ltd • KA, India
    Quick Apply
    Job Description Enterprise Azure Solution Architect GenAI Agentic AI We are seeking a highly experienced Azure Solution Architect with a strong background in Generative AI GenAI...Show more
    Last updated: 30+ days ago
    Oracle Planning Consultant (Fusion Supply Chain Planning)

    Oracle Planning Consultant (Fusion Supply Chain Planning)

    PURVIEW • Karnataka, India, India
    Oracle Fusion Supply Chain Planning Consultant.Supply Planning, Demand Planning, Sales & Operations Planning (S&OP), and Global Order Promising (GOP). The ideal candidate will have at least one end-...Show more
    Last updated: 18 days ago • Promoted
    Network Engineer

    Network Engineer

    TerraGiG • Karnataka, India, India
    Bangalore – Plot #19-B, Phase 2, Sector 1, Shyanamangala Cross, KIADB Industrial Area, Bidadi, Ramanagara District – 562109, Karnataka. Regular business hours 8 AM to 5 PM.Some off-hours might be re...Show more
    Last updated: 6 days ago • Promoted
    Senior Security Engineer

    Senior Security Engineer

    First American (India) • Karnataka, India, India
    The Senior Security Engineer will be responsible for designing and implementing the Database Activity Monitoring (DAM) function to ensure the security, integrity, and compliance of enterprise data ...Show more
    Last updated: 12 days ago • Promoted
    Coupa Consultant

    Coupa Consultant

    Tata Consultancy Services • Karnataka, India, India
    Coupa Certified Professional having at least 6+ years of Industry experience out of which at least 3 years in Coupa technology. Must have worked on at least one Coupa Implementation / Rollout projec...Show more
    Last updated: 18 days ago • Promoted
    Senior Software Engineer-Multicast

    Senior Software Engineer-Multicast

    ACL Digital • Karnataka, India, India
    We are seeking a highly skilled Senior C Network Protocol Engineer to join our growing team.In this role, you will be responsible for the design, development, and maintenance of high-performance ne...Show more
    Last updated: 28 days ago • Promoted
    SAP HANA DBA

    SAP HANA DBA

    Tata Consultancy Services • Karnataka, India, India
    Analyze and implement SAP support methodology.Bring comprehensive knowledge on SAP S / 4HANA architecture, conversion, and migration path. Understand the SAP high availability or disaster recovery arc...Show more
    Last updated: 30+ days ago • Promoted
    Technical Project Manager

    Technical Project Manager

    ACL Digital • Karnataka, India, India
    ACL Digital is hiring for Software Engineer Manager- Networking Domain for Bangalore location.Job Role - Software Engineering Manager - Networking Domain. Lead end‑to‑end protocol development projec...Show more
    Last updated: 16 days ago • Promoted
    SAP S / 4HANA Service Consultant

    SAP S / 4HANA Service Consultant

    Freedom Consulting Inc. • Karnataka, India, India
    Role : SAP S / 4HANA Service Consultant.Experience : 7–12 years Location : —.Type : Implementation project (ongoing).We are looking for an SAP S / 4HANA Service Consultant with strong hands-on experience i...Show more
    Last updated: 13 days ago • Promoted