Talent.com
Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Sustainability Economics.aiKarnataka, India
9 days ago
Job description

Location : Bengaluru, Karnataka

About the Company :

Sustainability Economics.ai is a global organization, pioneering the convergence of clean energy and AI, enabling profitable energy transitions while powering end-to-end AI infrastructure. By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems that drive efficiency, innovation, and long-term impact across industries. Guided by exceptional leaders and visionaries with decades of expertise in finance, policy, technology, and innovation, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.

Role Summary :

We are seeking a Cloud Orchestration & Scheduling Architect to design and implement intelligent systems that dynamically balance AI workload demand, supply and compute capacity across cloud data centers. The role focuses on building orchestration, scheduling, and optimization frameworks for large-scale AI inference workloads, ensuring efficient use of compute, energy, and cost resources.

The ideal candidate will have strong experience in Kubernetes, distributed systems, and scheduling frameworks, with a deep understanding of how to align AI compute workloads with real-time demand and supply.

Key Responsibilities :

  • Design and implement workload orchestration and scheduling systems for AI inference pipelines across distributed data centers.
  • Develop mechanisms to match workload demand with available compute and supply, optimizing for performance, cost, and sustainability.
  • Integrate predictive demand forecasting and energy availability data into scheduling decisions.
  • Manage multi-region orchestration using Kubernetes, Ray, or similar distributed compute frameworks.
  • Build automation to dynamically scale GPU / CPU clusters based on real-time and forecasted AI inference workloads.
  • Implement cost-aware, and latency-aware scheduling policies for optimal workload placement.
  • Build dashboards and observability tools to track compute utilization, cost efficiency.
  • Continuously evaluate new frameworks and optimization algorithms to enhance system scalability and resilience.

Education & Experience :

  • Bachelor's or master's degree in computer science, Information Technology, or related field.
  • Proven experience of 2–5 years in cloud infrastructure, distributed systems, or large-scale DevOps environments.
  • Proven experience in AI / ML infrastructure orchestration, workflow scheduling, or HPC environments.
  • Hands-on experience managing workloads on AWS, or hybrid cloud platforms.
  • Certifications (preferred) :
  • AWS Certified Solutions Architect – Associate
  • Certified Kubernetes Administrator (CKA)
  • Skills Required :

  • Strong proficiency in Kubernetes, EKS, or Ray for distributed workload orchestration.
  • Experience with workflow orchestration tools like Airflow, Argo, or Prefect.
  • Familiarity with containerization (Docker), IaC tools (Terraform / CloudFormation), and GitOps (Argo CD).
  • Understanding scheduling algorithms, cluster autoscaling, and load balancing in large systems.
  • Experience with inference batching, request routing, and autoscaling strategies using frameworks like Ray Serve, Triton Inference Server, or KServe.
  • Experience building or tuning custom schedulers for optimization.
  • Knowledge of GPU orchestration, NVIDIA Triton, or KServe for model serving at scale.
  • Understanding of GPU utilization optimization, and CUDA profiling for efficient model execution.
  • Experience in AIOps : automated monitoring, anomaly detection, root-cause analysis, and predictive operations for AI workloads.
  • Experience building or tuning custom schedulers for optimization.
  • Experience building demand forecasting and queue-based scheduling (Redis, Kafka, or similar) systems to balance compute load and supply.
  • Proficiency in Python, Go, or Bash scripting for automation.
  • Exposure to monitoring and observability tools (Prometheus, Grafana, CloudWatch).
  • What You’ll Do :

  • Design the orchestration layer for AI workloads across distributed data centers.
  • Optimize resource allocation by balancing compute demand, supply and economics.
  • Build automation pipelines for dynamic scaling and job scheduling.
  • Monitor system performance and drive continuous improvements in utilization and efficiency.
  • What you will bring

  • Strong systems thinking and the ability to design control mechanisms for complex, distributed workloads.
  • Passion for optimizing AI infrastructure for efficiency, reliability, and sustainability.
  • Curiosity about distributed scheduling and cloud optimization.
  • Hands-on experience with container orchestration, automation, and observability.
  • A proactive, ownership-driven mindset suited for a fast-paced, mission-driven environment.
  • Agile mindset, adaptability, and eagerness to learn emerging tools and technologies.
  • Proactive, ownership-driven approach, with the ability to improve systems end-to-end.
  • Startup DNA → bias to action, comfort with ambiguity, love for fast iteration, and flexible and growth mindset.
  • Why Join Us

  • Shape a first-of-its-kind AI + clean energy platform.
  • Work with a small, mission-driven team obsessed with impact.
  • An aggressive growth path.
  • A chance to leave your mark at the intersection of AI and sustainability.
  • Create a job alert for this search

    Cloud Infrastructure Architect • Karnataka, India

    Related jobs
    • Promoted
    Hadoop Admin

    Hadoop Admin

    LTIMindtreeKarnataka, India, India
    Job Location : Bangalore, Hyderabad, Chennai, Mumbai, Pune.Notice Period : Immediate to 15 days.Please do not apply Notice Period with more than 15 days of Notice Period. Mandatory Skills : Build Cloud...Show moreLast updated: 9 days ago
    • Promoted
    DevOps+Openshift- Engineer

    DevOps+Openshift- Engineer

    ValueLabsKarnataka, India
    We are hiring for CICD / OpenShift for Dubai Location.Max or Serving Notice period • •.Bachelor of Computer Science or Equivalent. Red Hat Certified Architect or Equivalent, Azure Cloud Architect, AWS C...Show moreLast updated: 24 days ago
    • Promoted
    Data Architect

    Data Architect

    BrillioKarnataka, India
    Architecting, designing and implementing Modern Data Platforms and Solutions using Microsoft Azure Cloud and understands reference architectures. Deep understanding Data Migration Strategies with 2+...Show moreLast updated: 17 days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    ApexonKarnataka, India
    Apexon is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they...Show moreLast updated: 3 days ago
    • Promoted
    Cloud Architect

    Cloud Architect

    MolexKarnataka
    Description : Your Job : As a Cloud Architect (Azure), you will drive the design and implementati...Show moreLast updated: 19 days ago
    • Promoted
    Cloud Infrastructure Architect

    Cloud Infrastructure Architect

    AscendionKarnataka, India
    Cloud Infrastructure Architect.All Ascendion Locations – Bengaluru, Pune, Chennai, Vadodara and Hyderabad.We are seeking a highly skilled Cloud Infrastructure Architect to lead the design, optimiza...Show moreLast updated: 1 day ago
    • Promoted
    Enterprise Architect

    Enterprise Architect

    Bread FinancialKarnataka, India
    Staff Enterprise Architect provides strategic leadership in the development and implementation of complex architectural solutions across the enterprise. Guide projects to ensure alignment with archi...Show moreLast updated: 3 days ago
    • Promoted
    Solutions Architect - Cloud, AI & Automation (Remote)

    Solutions Architect - Cloud, AI & Automation (Remote)

    AvanteNowKarnataka, India
    Remote
    Job Title : Solutions Architect.We are seeking a highly experienced Solutions Architect to play a strategic role in defining the technology vision, designing scalable architectures, and ensuring con...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Security Architect

    Cloud Security Architect

    Nazztec Private LimitedKarnataka
    Position : Cloud Security Architect / Senior Cloud Security Engineer Experience Required : 6+ years (with minimum 2+ years in cloud Type : Full-time< / b&g...Show moreLast updated: 30+ days ago
    • Promoted
    Coupa Consultant

    Coupa Consultant

    Tata Consultancy ServicesKarnataka, India, India
    Coupa Certified Professional having at least 6+ years of Industry experience out of which at least 3 years in Coupa technology. Must have worked on at least one Coupa Implementation / Rollout projec...Show moreLast updated: 9 days ago
    • Promoted
    Principal Engineer Solutions Architect

    Principal Engineer Solutions Architect

    CoffeeBeansKarnataka, India
    CoffeeBeans Consulting is a tech consulting firm focused on making organizations.We are looking for a Principal Engineer who can design and implement complex solutions that are scalable, future-pro...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Intellistaff Services Pvt. LtdKarnataka, India
    Cloud Engineer – Google Cloud Platform.Location-Hyderabad / Chennai / Bangalore / Pune / Gurugram.Deploy, enhance, and maintain GCP landing zone and associated infrastructure, ensuring compliance, security...Show moreLast updated: 11 days ago
    Azure Cloud Engineer

    Azure Cloud Engineer

    Ashra Technologies Private LimitedKA, India
    Quick Apply
    Azure Operations Engineer (Data Platform / Databricks / DevOps) Job Description : We are seeking a...Show moreLast updated: 11 days ago
    • Promoted
    SAP HANA DBA

    SAP HANA DBA

    Tata Consultancy ServicesKarnataka, India, India
    Analyze and implement SAP support methodology.Bring comprehensive knowledge on SAP S / 4HANA architecture, conversion, and migration path. Understand the SAP high availability or disaster recovery arc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Science Solution Architect

    Data Science Solution Architect

    Tredence Inc.Karnataka, India
    Relevant Experience as Architect- 2+ Years.Location- Bangalore, Pune, Gurgaon, Hyderabad, Chennai, Kolkata.As a Data Science Solution Architect at Tredence, you will lead the design and development...Show moreLast updated: 3 days ago
    • Promoted
    Senior Cloud Network Engineer

    Senior Cloud Network Engineer

    sliceKarnataka, India
    We’ve all felt how slow, confusing, and complicated banking can be.We’re building every product from scratch to be fast, transparent, and feel good, because we believe that the best products transc...Show moreLast updated: 1 day ago
    • Promoted
    Cloud Solution Architect - AWS / Azure

    Cloud Solution Architect - AWS / Azure

    AlconKarnataka
    Description : Summary of Position : The Cloud Solution Architect will design and implement secure, scalable, and resilient c...Show moreLast updated: 2 days ago
    • Promoted
    AVP - Salesforce Technical Architect

    AVP - Salesforce Technical Architect

    Impetus Career Consultantskarnataka, karnataka, in
    Role : Assistant Vice President – Salesforce Technical Architect.Senior Salesforce Solution / Technical Architect with proven experience in designing scalable enterprise solutions across Sales, Servic...Show moreLast updated: 1 day ago