Talent.com
Lead DevOps Engineer, Edge AI
Lead DevOps Engineer, Edge AIMulya Technologies • Bengaluru, Republic Of India, IN
Lead DevOps Engineer, Edge AI

Lead DevOps Engineer, Edge AI

Mulya Technologies • Bengaluru, Republic Of India, IN
5 days ago
Job description

Principal DevOps / Edge AI Engineer

Bangalore

Founded in 2023,by Industry veterans HQ in California,US

  • We are revolutionizing sustainable AI compute through intuitive software with composable silicon

Principal DevOps / Edge AI Engineer

Overview :

You will be responsible for building, deploying, and maintaining the local infrastructure that powers high-performance multimodal AI models (text, image, audio, video) on a compact AI appliance. You’ll bridge the gap between hardware, ML inference, and user-facing applications - ensuring reliability, scalability, and efficiency of on-device AI workloads.

Key Responsibilities :

  • System Deployment & Orchestration
  • Containerize AI inference services and web applications using Docker or Podman.
  • Design lightweight orchestration layers for local systems (Kubernetes, Nomad, or custom orchestration).
  • Automate build, test, and deployment pipelines (CI / CD) for local-first AI workloads.
  • Performance Optimization & Resource Management
  • Optimize compute utilization for concurrent multimodal workloads.
  • Develop monitoring tools for system health, thermal management, and memory / bandwidth usage.
  • Tune OS, drivers, and I / O subsystems for maximum throughput and low latency.
  • Edge Infrastructure & Networking
  • Configure low-latency local networking for browser-based access to the AI appliance.
  • Set up secure local APIs and data isolation layers — ensuring zero external data leakage.
  • Integrate hardware accelerators and manage firmware updates across different SKUs.
  • Reliability, Testing, and Scaling
  • Build test harnesses to validate multimodal model performance (e.G., LLM + diffusion + ASR pipelines).
  • Implement over-the-air (OTA) update mechanisms for edge devices without exposing user data.
  • Develop monitoring dashboards and alerting for real-time performance metrics.
  • Required Qualifications :

  • Strong background in Linux systems engineering and containerization (Docker, Podman, LXC).
  • Experience deploying AI inference services locally or at the edge (llama.Cpp, ollama, vLLM, ONNX).
  • Proficiency in CI / CD tools (GitHub Actions, Jenkins, ArgoCD) and infrastructure-as-code (Terraform, Ansible).
  • Expertise in GPU / accelerator optimization, CUDA stack management, or similar.
  • Solid understanding of networking, security, and firewall configurations for local appliances.
  • Scripting and automation skills (Python, Bash, Go, or Rust).
  • Preferred Qualifications :

  • Experience with embedded systems or edge AI devices (e.G., Jetson, Coral, FPGA-based accelerators).
  • experience minimum 10 years
  • Familiarity with low-bit quantization, model partitioning, or distributed inference.
  • Background in hardware / software co-design or systems integration.
  • Knowledge of browser-based local apps (WebSocket, WebRTC, RESTful APIs) and AI service backends.
  • Prior work in privacy-preserving AI systems or local-first architectures.
  • Contact : Uday

    Mulya Technologies

    muday_bhaskar@yahoo.com

    "Mining The Knowledge Community"

    Create a job alert for this search

    Lead Ai Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    Edge AI Engineer - Healthcare Applications

    Edge AI Engineer - Healthcare Applications

    Cancard Inc. • Bangalore, IN
    Position : Edge AI Engineer - Cancard Inc.Cancard Inc and Advaa Health are seeking an experienced, engaged, and hands-on healthcare industry Edge Computing / IOT / CV expert for the role of Edge AI ...Show more
    Last updated: 5 days ago • Promoted
    Principal DevOps / Edge AI Engineer

    Principal DevOps / Edge AI Engineer

    Mulya Technologies • Bengaluru, Karnataka, India
    Principal DevOps / Edge AI Engineer Bangalore Founded in 2023,by Industry veterans HQ in California,US We are revolutionizing sustainable AI compute through intuitive software with composable s...Show more
    Last updated: 5 days ago • Promoted
    Principal Devops / Edge Ai Engineer

    Principal Devops / Edge Ai Engineer

    Mulya Technologies • Bengaluru, Republic Of India, IN
    Principal DevOps / Edge AI Engineer.Founded in 2023,by Industry veterans HQ in California,US.We are revolutionizing sustainable AI compute through intuitive software with composable silicon.Princip...Show more
    Last updated: 5 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Bengaluru, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 19 days ago • Promoted
    AWS DevOps Lead

    AWS DevOps Lead

    Luxoft India • Bengaluru, Republic Of India, IN
    We're seeking a solid and creative AWS Cloud DevOps eager to solve scale problems and work on cutting-edge and open-source technologies. In this project, you will have the opportunity to write code ...Show more
    Last updated: 17 days ago • Promoted
    AI Platform DevOps Engineer

    AI Platform DevOps Engineer

    Prospance Inc • Bengaluru, Republic Of India, IN
    SRE & DevOps Engineer (ML / AI Platform).Contract Position | Global E-Commerce Leader | Hybrid.SRE & DevOps Engineer to join their AI Platform Team. This is your chance to shape the future of machine ...Show more
    Last updated: 30+ days ago • Promoted
    AWS Cloud DevOps Lead

    AWS Cloud DevOps Lead

    Luxoft India • Bengaluru, Karnataka, India
    We're seeking a solid and creative AWS Cloud DevOps eager to solve scale problems and work on cutting-edge and open-source technologies. In this project, you will have the opportunity to write code ...Show more
    Last updated: 17 days ago • Promoted
    Lead DevOps Platform Engineer

    Lead DevOps Platform Engineer

    apna • Bengaluru, Republic Of India, IN
    Job Title : Senior engineer (SDE-2)– Platform Engineering.We are looking for a passionate and hands-on DevOps Engineer to join our Platform. Engineering team and accelerate our platform modernization...Show more
    Last updated: 30+ days ago • Promoted
    AI DevOps Engineer

    AI DevOps Engineer

    Veca Consulting Pvt Ltd • Bengaluru, Republic Of India, IN
    Role Name : SRE & Devops Engineer(Node.Location : Bangalore(No relocation).Notice Period : 20-30 days(who are currently serving). You will be a member of our AI Platform Team, supporting the next gen...Show more
    Last updated: 14 days ago • Promoted
    Senior DevOps Platform Engineer

    Senior DevOps Platform Engineer

    apna • Bengaluru, Karnataka, India
    Job Title : Senior engineer (SDE-2)– Platform Engineering.We are looking for a passionate and hands-on DevOps Engineer to join our Platform. Engineering team and accelerate our platform modernization...Show more
    Last updated: 30+ days ago • Promoted
    Principal DevOps Engineer

    Principal DevOps Engineer

    apna • Bengaluru, Republic Of India, IN
    Job Title : Senior engineer (SDE-2)– Platform Engineering.We are looking for a passionate and hands-on DevOps Engineer to join our Platform. Engineering team and accelerate our platform modernization...Show more
    Last updated: 30+ days ago • Promoted
    Senior Edge AI Infrastructure Engineer

    Senior Edge AI Infrastructure Engineer

    Mulya Technologies • Bengaluru, Republic Of India, IN
    Principal DevOps / Edge AI Engineer.Founded in 2023,by Industry veterans HQ in California,US.We are revolutionizing sustainable AI compute through intuitive software with composable silicon.Princip...Show more
    Last updated: 5 days ago • Promoted
    Lead DevOps Engineer

    Lead DevOps Engineer

    London Stock Exchange Group • Bangalore, India
    LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business.We are open-access partners with a dedication to excellence in delivering the...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI DevOps Specialist

    Principal AI DevOps Specialist

    Mulya Technologies • Bengaluru, Republic Of India, IN
    Principal DevOps / Edge AI Engineer.Founded in 2023,by Industry veterans HQ in California,US.We are revolutionizing sustainable AI compute through intuitive software with composable silicon.Princip...Show more
    Last updated: 5 days ago • Promoted
    SRE & DevOps Engineer (ML / AI Platform)

    SRE & DevOps Engineer (ML / AI Platform)

    Prospance Inc • Bengaluru, Karnataka, India
    SRE & DevOps Engineer (ML / AI Platform).Contract Position | Global E-Commerce Leader | Hybrid.SRE & DevOps Engineer to join their AI Platform Team. This is your chance to shape the future of machine ...Show more
    Last updated: 30+ days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    APPIT Software Inc • Bengaluru, Karnataka, India
    Architect, build, and optimize production-grade Generative AI applications using modern frameworks such as LangChain, LlamaIndex, Semantic Kernel, or custom orchestration layers.Lead the design of ...Show more
    Last updated: 2 days ago • Promoted
    DevOps Engineering Lead

    DevOps Engineering Lead

    Luxoft India • Bengaluru, Republic Of India, IN
    We're seeking a solid and creative AWS Cloud DevOps eager to solve scale problems and work on cutting-edge and open-source technologies. In this project, you will have the opportunity to write code ...Show more
    Last updated: 17 days ago • Promoted
    AWS DevOps Engineer

    AWS DevOps Engineer

    iO Associates • Bengaluru, Republic Of India, IN
    AWS Cloud Engineer (Kubernetes & EKS).Months Contract (Possible Extension).A global IT services and consulting organisation is seeking an experienced. This organisation specialises in data, AI, and ...Show more
    Last updated: 16 hours ago • Promoted • New!