Talent.com
Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Cloud Orchestration & Scheduling Architect (AI Infrastructure)

Sustainability Economics.aiMangalore, IN
10 days ago
Job description

Location : Bengaluru, Karnataka

About the Company :

Sustainability Economics.ai is a global organization, pioneering the convergence of clean energy and AI, enabling profitable energy transitions while powering end-to-end AI infrastructure. By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems that drive efficiency, innovation, and long-term impact across industries. Guided by exceptional leaders and visionaries with decades of expertise in finance, policy, technology, and innovation, we are committed to making long-term efforts to fulfil this vision through our technical innovation, client services, expertise, and capability expansion.

Role Summary :

We are seeking a Cloud Orchestration & Scheduling Architect to design and implement intelligent systems that dynamically balance AI workload demand, supply and compute capacity across cloud data centers. The role focuses on building orchestration, scheduling, and optimization frameworks for large-scale AI inference workloads, ensuring efficient use of compute, energy, and cost resources.

The ideal candidate will have strong experience in Kubernetes, distributed systems, and scheduling frameworks, with a deep understanding of how to align AI compute workloads with real-time demand and supply.

Key Responsibilities :

  • Design and implement workload orchestration and scheduling systems for AI inference pipelines across distributed data centers.
  • Develop mechanisms to match workload demand with available compute and supply, optimizing for performance, cost, and sustainability.
  • Integrate predictive demand forecasting and energy availability data into scheduling decisions.
  • Manage multi-region orchestration using Kubernetes, Ray, or similar distributed compute frameworks.
  • Build automation to dynamically scale GPU / CPU clusters based on real-time and forecasted AI inference workloads.
  • Implement cost-aware, and latency-aware scheduling policies for optimal workload placement.
  • Build dashboards and observability tools to track compute utilization, cost efficiency.
  • Continuously evaluate new frameworks and optimization algorithms to enhance system scalability and resilience.

Education & Experience :

  • Bachelor's or master's degree in computer science, Information Technology, or related field.
  • Proven experience of 2–5 years in cloud infrastructure, distributed systems, or large-scale DevOps environments.
  • Proven experience in AI / ML infrastructure orchestration, workflow scheduling, or HPC environments.
  • Hands-on experience managing workloads on AWS, or hybrid cloud platforms.
  • Certifications (preferred) :
  • AWS Certified Solutions Architect – Associate
  • Certified Kubernetes Administrator (CKA)
  • Skills Required :

  • Strong proficiency in Kubernetes, EKS, or Ray for distributed workload orchestration.
  • Experience with workflow orchestration tools like Airflow, Argo, or Prefect.
  • Familiarity with containerization (Docker), IaC tools (Terraform / CloudFormation), and GitOps (Argo CD).
  • Understanding scheduling algorithms, cluster autoscaling, and load balancing in large systems.
  • Experience with inference batching, request routing, and autoscaling strategies using frameworks like Ray Serve, Triton Inference Server, or KServe.
  • Experience building or tuning custom schedulers for optimization.
  • Knowledge of GPU orchestration, NVIDIA Triton, or KServe for model serving at scale.
  • Understanding of GPU utilization optimization, and CUDA profiling for efficient model execution.
  • Experience in AIOps : automated monitoring, anomaly detection, root-cause analysis, and predictive operations for AI workloads.
  • Experience building or tuning custom schedulers for optimization.
  • Experience building demand forecasting and queue-based scheduling (Redis, Kafka, or similar) systems to balance compute load and supply.
  • Proficiency in Python, Go, or Bash scripting for automation.
  • Exposure to monitoring and observability tools (Prometheus, Grafana, CloudWatch).
  • What You’ll Do :

  • Design the orchestration layer for AI workloads across distributed data centers.
  • Optimize resource allocation by balancing compute demand, supply and economics.
  • Build automation pipelines for dynamic scaling and job scheduling.
  • Monitor system performance and drive continuous improvements in utilization and efficiency.
  • What you will bring

  • Strong systems thinking and the ability to design control mechanisms for complex, distributed workloads.
  • Passion for optimizing AI infrastructure for efficiency, reliability, and sustainability.
  • Curiosity about distributed scheduling and cloud optimization.
  • Hands-on experience with container orchestration, automation, and observability.
  • A proactive, ownership-driven mindset suited for a fast-paced, mission-driven environment.
  • Agile mindset, adaptability, and eagerness to learn emerging tools and technologies.
  • Proactive, ownership-driven approach, with the ability to improve systems end-to-end.
  • Startup DNA → bias to action, comfort with ambiguity, love for fast iteration, and flexible and growth mindset.
  • Why Join Us

  • Shape a first-of-its-kind AI + clean energy platform.
  • Work with a small, mission-driven team obsessed with impact.
  • An aggressive growth path.
  • A chance to leave your mark at the intersection of AI and sustainability.
  • Create a job alert for this search

    Cloud Infrastructure Architect • Mangalore, IN

    Related jobs
    • Promoted
    Solution Architect – Experience Cloud

    Solution Architect – Experience Cloud

    LTIMindtreemangalore, karnataka, in
    Experience Cloud (Community Cloud).The ideal candidate will design scalable, secure, and high-performance Salesforce solutions that deliver exceptional customer, partner, and employee experiences.S...Show moreLast updated: 16 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    ACL Digitalmangalore, karnataka, in
    You’ll win us over if you have : .Deep expertise in AWS Cloud Services and IaC (CloudFormation).A solid understanding of CI / CD and DevOps principles. Manage and optimize AWS services including S3, Dyn...Show moreLast updated: 16 days ago
    • Promoted
    • New!
    Cloud Architect

    Cloud Architect

    AventIQMangalore, IN
    AventIQ is a leading software development company specializing in Robotic Process Automation (RPA) to revolutionize businesses through cutting-edge automation technologies.Our mission is to deliver...Show moreLast updated: 9 hours ago
    • Promoted
    Cloud Architect

    Cloud Architect

    Vagaro Technologiesmangalore, karnataka, in
    Lead the cloud architecture design and implementation across multiple Azure environments, ensuring scalability, performance, cost efficiency, and compliance. Responsible for defining best practices,...Show moreLast updated: 15 days ago
    • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL DigitalMangalore, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show moreLast updated: 7 days ago
    • Promoted
    • New!
    Salesforce Revenue Cloud Architect

    Salesforce Revenue Cloud Architect

    Tata Consultancy Servicesmangalore, karnataka, in
    TCS is Hiring for Salesforce Revenue Cloud Architect.Required Qualifications : CPQ, Billing.We are looking for Immediate Joiners. A proven Salesforce Technical Lead with 10+ years of design and devel...Show moreLast updated: 3 hours ago
    • Promoted
    Cloud Consultant

    Cloud Consultant

    Mastekmangalore, karnataka, in
    We need an experienced AWS Data Engineer / Performance Optimization Consultant to help us analyze, tune, and optimize our existing AWS Glue ETL, Step Functions workflows and Amazon Redshift data wa...Show moreLast updated: 15 days ago
    • Promoted
    • New!
    Cloud Infrastructure Architect

    Cloud Infrastructure Architect

    AscendionMangalore, IN
    Cloud Infrastructure Architect.All Ascendion Locations – Bengaluru, Pune, Chennai, Vadodara and Hyderabad.We are seeking a highly skilled Cloud Infrastructure Architect to lead the design, optimiza...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Cloud Architect

    Cloud Architect

    People Prime WorldwideMangalore, IN
    They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by un...Show moreLast updated: 9 hours ago
    • Promoted
    • New!
    Azure Cybersecurity Architect – AI, Container & Cloud Security

    Azure Cybersecurity Architect – AI, Container & Cloud Security

    Low-Latency Technologies Private LimitedMangalore, IN
    Role : Azure Cybersecurity Architect – AI, Container & Cloud Security.Azure Cloud Security • Container Security • AI / LLM / Agent Security. We are looking for a highly experienced Azure Cybersecurity A...Show moreLast updated: 9 hours ago
    • Promoted
    Oracle Analytics & Ai Solutions Architect

    Oracle Analytics & Ai Solutions Architect

    TribolaTech IncMangalore, Republic Of India, IN
    Only considering candidates from wither Bengaluru or Hyderabad location.Job Title : Oracle Analytics & AI Solutions Architect. Time : 9 am to 6 pm OR 10 am to 7 pm.Analytics & AI : OAC, AI Assist, BI P...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Salesforce Data Cloud Solution Architect & Tech Lead

    Salesforce Data Cloud Solution Architect & Tech Lead

    10XTDMangalore, IN
    Compelling Opportunity for Salesforce Data Cloud Solution Architect & Tech Lead with Global Leader in IT Services.The Salesforce Data Cloud Solution Architect / Tech Lead will be responsible for orch...Show moreLast updated: 9 hours ago
    • Promoted
    Cloud Spend Optimization Engineer

    Cloud Spend Optimization Engineer

    Abacus.AIMangalore, IN
    We’re seeking an engineer with expertise in optimizing AWS cloud costs.In this role, you’ll drive cost efficiency across our infrastructure by analyzing usage, automating optimizations, and guiding...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    ProgliteMangalore, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AIOps Architect (Observability Expert)

    AIOps Architect (Observability Expert)

    Tata Consultancy Servicesmangalore, karnataka, in
    AIOps Architect (Observability Expert).AIOps Architect (Observability Expert).Experience : 4 years to 11years.Mandatory Skills : AIOps / Monitoring / Observability / ELK). Strong hands-on in AIOps / Observa...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Azure Cloud Architect

    Azure Cloud Architect

    ValueMomentumMangalore, IN
    Cloud Architect (Azure / AWS) – Hyderabad / Pune.This is an exciting opportunity to lead.As a Cloud Architect, you will : . DevSecOps and platform engineering teams.Drive cloud strategy, architecture st...Show moreLast updated: 9 hours ago
    • Promoted
    Tcs Hiring For Google Cloud Architect_pan India

    Tcs Hiring For Google Cloud Architect_pan India

    Tata Consultancy ServicesMangalore, Republic Of India, IN
    Job Title : Google Cloud Architect_PAN India.Architect and lead the migration of enterprise applications and workloads to GCP. Design secure, scalable, and cost-effective cloud solutions aligned with...Show moreLast updated: 15 days ago
    • Promoted
    Cloud Leader- Technology

    Cloud Leader- Technology

    ConfidentialUdupi, India
    The Solution Architect is responsible for designing and implementing technology solutions that meet the business needs of the organization. This role involves understanding the requirements of stake...Show moreLast updated: 20 days ago