Talent.com
Cloud Orchestration & Scheduling Architect (AI Infrastructure)
Cloud Orchestration & Scheduling Architect (AI Infrastructure)Sustainability Economics.ai • Karnataka, India
Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Sustainability Economics.ai • Karnataka, India
17 days ago
Job description

Location : Bengaluru, Karnataka

About the Company :

Sustainability Economics.ai is a global organization, pioneering the convergence of clean energy and AI, enabling profitable energy transitions while powering end-to-end AI infrastructure. By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems that drive efficiency, innovation, and long-term impact across industries. Guided by exceptional leaders and visionaries with decades of expertise in finance, policy, technology, and innovation, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.

Role Summary :

We are seeking a Cloud Orchestration & Scheduling Architect to design and implement intelligent systems that dynamically balance AI workload demand, supply and compute capacity across cloud data centers. The role focuses on building orchestration, scheduling, and optimization frameworks for large-scale AI inference workloads, ensuring efficient use of compute, energy, and cost resources.

The ideal candidate will have strong experience in Kubernetes, distributed systems, and scheduling frameworks, with a deep understanding of how to align AI compute workloads with real-time demand and supply.

Key Responsibilities :

  • Design and implement workload orchestration and scheduling systems for AI inference pipelines across distributed data centers.
  • Develop mechanisms to match workload demand with available compute and supply, optimizing for performance, cost, and sustainability.
  • Integrate predictive demand forecasting and energy availability data into scheduling decisions.
  • Manage multi-region orchestration using Kubernetes, Ray, or similar distributed compute frameworks.
  • Build automation to dynamically scale GPU / CPU clusters based on real-time and forecasted AI inference workloads.
  • Implement cost-aware, and latency-aware scheduling policies for optimal workload placement.
  • Build dashboards and observability tools to track compute utilization, cost efficiency.
  • Continuously evaluate new frameworks and optimization algorithms to enhance system scalability and resilience.

Education & Experience :

  • Bachelor's or master's degree in computer science, Information Technology, or related field.
  • Proven experience of 2–5 years in cloud infrastructure, distributed systems, or large-scale DevOps environments.
  • Proven experience in AI / ML infrastructure orchestration, workflow scheduling, or HPC environments.
  • Hands-on experience managing workloads on AWS, or hybrid cloud platforms.
  • Certifications (preferred) :
  • AWS Certified Solutions Architect – Associate
  • Certified Kubernetes Administrator (CKA)
  • Skills Required :

  • Strong proficiency in Kubernetes, EKS, or Ray for distributed workload orchestration.
  • Experience with workflow orchestration tools like Airflow, Argo, or Prefect.
  • Familiarity with containerization (Docker), IaC tools (Terraform / CloudFormation), and GitOps (Argo CD).
  • Understanding scheduling algorithms, cluster autoscaling, and load balancing in large systems.
  • Experience with inference batching, request routing, and autoscaling strategies using frameworks like Ray Serve, Triton Inference Server, or KServe.
  • Experience building or tuning custom schedulers for optimization.
  • Knowledge of GPU orchestration, NVIDIA Triton, or KServe for model serving at scale.
  • Understanding of GPU utilization optimization, and CUDA profiling for efficient model execution.
  • Experience in AIOps : automated monitoring, anomaly detection, root-cause analysis, and predictive operations for AI workloads.
  • Experience building or tuning custom schedulers for optimization.
  • Experience building demand forecasting and queue-based scheduling (Redis, Kafka, or similar) systems to balance compute load and supply.
  • Proficiency in Python, Go, or Bash scripting for automation.
  • Exposure to monitoring and observability tools (Prometheus, Grafana, CloudWatch).
  • What You’ll Do :

  • Design the orchestration layer for AI workloads across distributed data centers.
  • Optimize resource allocation by balancing compute demand, supply and economics.
  • Build automation pipelines for dynamic scaling and job scheduling.
  • Monitor system performance and drive continuous improvements in utilization and efficiency.
  • What you will bring

  • Strong systems thinking and the ability to design control mechanisms for complex, distributed workloads.
  • Passion for optimizing AI infrastructure for efficiency, reliability, and sustainability.
  • Curiosity about distributed scheduling and cloud optimization.
  • Hands-on experience with container orchestration, automation, and observability.
  • A proactive, ownership-driven mindset suited for a fast-paced, mission-driven environment.
  • Agile mindset, adaptability, and eagerness to learn emerging tools and technologies.
  • Proactive, ownership-driven approach, with the ability to improve systems end-to-end.
  • Startup DNA → bias to action, comfort with ambiguity, love for fast iteration, and flexible and growth mindset.
  • Why Join Us

  • Shape a first-of-its-kind AI + clean energy platform.
  • Work with a small, mission-driven team obsessed with impact.
  • An aggressive growth path.
  • A chance to leave your mark at the intersection of AI and sustainability.
  • Create a job alert for this search

    Cloud Infrastructure Architect • Karnataka, India

    Related jobs
    Observability Engineer - Elasticsearch & Azure (7-10 yrs)

    Observability Engineer - Elasticsearch & Azure (7-10 yrs)

    PineQ Lab Technology • Karnataka, India, India
    Job Description : Observability Engineer - Elasticsearch & Azure.We are seeking an experienced Observability Engineer with deep expertise in Elasticsearch and Azure enterprise environments to unlock...Show more
    Last updated: 4 days ago • Promoted
    Hadoop Admin

    Hadoop Admin

    LTIMindtree • Karnataka, India, India
    Job Location : Bangalore, Hyderabad, Chennai, Mumbai, Pune.Notice Period : Immediate to 15 days.Please do not apply Notice Period with more than 15 days of Notice Period. Mandatory Skills : Build Cloud...Show more
    Last updated: 17 days ago • Promoted
    SAP Cloud ALM

    SAP Cloud ALM

    WILLWARE TECHNOLOGIES PRIVATE LIMITED • Karnataka, India
    Job Title : SAP Cloud ALM - Delivery Assurance Specialist Company : WillWare Technologies Location : Bangalore Mode : Hybrid &...Show more
    Last updated: 2 hours ago • New!
    Senior Platform Engineer

    Senior Platform Engineer

    ACL Digital • Karnataka, India, India
    ACL Digital is hiring for Senior Platfor Developer for Bangalore.Senior Platform Developer (C / C++ – Linux Kernel, Drivers, Networking). Linux kernel, device driver development, and networking techno...Show more
    Last updated: 19 days ago • Promoted
    Cloud FinOps (2 to 4 years)

    Cloud FinOps (2 to 4 years)

    Athenahealth • karnataka, karnataka, in
    Join us as we work to create a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all. Our modern, open ecosystem connects care teams and delivers actionable i...Show more
    Last updated: 2 hours ago • Promoted • New!
    Transition Solution Architect

    Transition Solution Architect

    Tata Consultancy Services • Karnataka, India, India
    TCS is hiring for Transition Solution Architect.Skills required : Transition methodologies, Presales, RFP's, RFIs.Desired Experience Range : 8 to 15 years. Preferred / Current Location : Pan India.Transi...Show more
    Last updated: 16 days ago • Promoted
    ServiceNow - Solution Architect

    ServiceNow - Solution Architect

    ObjectWin Technology India Pvt. Ltd • KA, India
    Quick Apply
    Role / Level Responsibilities Required Qualifications Preferred Qualifications ServiceNow Technical Architect Manage the ServiceNow solu...Show more
    Last updated: 8 days ago
    Gen AI

    Gen AI

    ObjectWin Technology India Pvt. Ltd • KA, India
    Quick Apply
    Job Description Enterprise Azure Solution Architect GenAI Agentic AI We are seeking a highly experienced Azure Solution Architect with a strong background in Generative AI GenAI...Show more
    Last updated: 30+ days ago
    Network Engineer-Aruba SilverPeak SD-WAN Engineer

    Network Engineer-Aruba SilverPeak SD-WAN Engineer

    ObjectWin Technology India Pvt. Ltd • KA, India
    Quick Apply
    MessageBody"> Aruba SilverPeak SD-WAN Engineer PAN India Exp : 6+ yrs Rate : 150 KPM Hybr...Show more
    Last updated: 4 days ago
    110124-AWS Glue

    110124-AWS Glue

    ObjectWin Technology India Pvt. Ltd • KA, India
    Quick Apply
    Professional & Technical Skills : - Must To Have Skills : Proficiency in AWS Glue.Good To Have Skills : Experience with PySpark. Strong understanding of data modeling and database desig...Show more
    Last updated: 5 days ago
    IBM Liberty

    IBM Liberty

    ObjectWin Technology India Pvt. Ltd • KA, India
    Quick Apply
    Job Description Role : Middleware Administrator IBM Liberty Location : Offshore / India Who are we looking for? We are se...Show more
    Last updated: 7 days ago
    Network Engineer

    Network Engineer

    TerraGiG • Karnataka, India, India
    Bangalore – Plot #19-B, Phase 2, Sector 1, Shyanamangala Cross, KIADB Industrial Area, Bidadi, Ramanagara District – 562109, Karnataka. Regular business hours 8 AM to 5 PM.Some off-hours might be re...Show more
    Last updated: 5 days ago • Promoted
    Senior Security Engineer

    Senior Security Engineer

    First American (India) • Karnataka, India, India
    The Senior Security Engineer will be responsible for designing and implementing the Database Activity Monitoring (DAM) function to ensure the security, integrity, and compliance of enterprise data ...Show more
    Last updated: 11 days ago • Promoted
    Coupa Consultant

    Coupa Consultant

    Tata Consultancy Services • Karnataka, India, India
    Coupa Certified Professional having at least 6+ years of Industry experience out of which at least 3 years in Coupa technology. Must have worked on at least one Coupa Implementation / Rollout projec...Show more
    Last updated: 17 days ago • Promoted
    AI Systems Integration Specialist

    AI Systems Integration Specialist

    Zone IT Solutions • KA, IN
    Remote
    Quick Apply
    AI Systems Integration Specialist.AI-driven solutions across enterprise environments.This role requires expertise in integrating. AI / ML models, APIs, and platforms.You will work closely with cross-f...Show more
    Last updated: 30+ days ago
    SAP HANA DBA

    SAP HANA DBA

    Tata Consultancy Services • Karnataka, India, India
    Analyze and implement SAP support methodology.Bring comprehensive knowledge on SAP S / 4HANA architecture, conversion, and migration path. Understand the SAP high availability or disaster recovery arc...Show more
    Last updated: 30+ days ago • Promoted
    Microsoft 365 migration

    Microsoft 365 migration

    ObjectWin Technology India Pvt. Ltd • KA, India
    Quick Apply
    Microsoft 365 migration Job Title : Exchange Migration Architect On-Premises to Microsoft 365 ...Show more
    Last updated: 7 days ago
    CI / CD and Artifactory Governance Engineer

    CI / CD and Artifactory Governance Engineer

    Ashra Technologies Private Limited • KA, India
    Quick Apply
    CI / CD and Artifactory Governance Engineer with Python Development Expertise Location : Bangalore.Overview : Looking for a highly skilled CI / CD and Artifactory Governance Engin...Show more
    Last updated: 19 days ago