Talent.com
Lead DevOps Engineer, Edge AI
Lead DevOps Engineer, Edge AIMulya Technologies • Bengaluru, Republic Of India, IN
Lead DevOps Engineer, Edge AI

Lead DevOps Engineer, Edge AI

Mulya Technologies • Bengaluru, Republic Of India, IN
1 day ago
Job description

Principal DevOps / Edge AI Engineer

Bangalore

Founded in 2023,by Industry veterans HQ in California,US

  • We are revolutionizing sustainable AI compute through intuitive software with composable silicon

Principal DevOps / Edge AI Engineer

Overview :

You will be responsible for building, deploying, and maintaining the local infrastructure that powers high-performance multimodal AI models (text, image, audio, video) on a compact AI appliance. You’ll bridge the gap between hardware, ML inference, and user-facing applications - ensuring reliability, scalability, and efficiency of on-device AI workloads.

Key Responsibilities :

  • System Deployment & Orchestration
  • Containerize AI inference services and web applications using Docker or Podman.
  • Design lightweight orchestration layers for local systems (Kubernetes, Nomad, or custom orchestration).
  • Automate build, test, and deployment pipelines (CI / CD) for local-first AI workloads.
  • Performance Optimization & Resource Management
  • Optimize compute utilization for concurrent multimodal workloads.
  • Develop monitoring tools for system health, thermal management, and memory / bandwidth usage.
  • Tune OS, drivers, and I / O subsystems for maximum throughput and low latency.
  • Edge Infrastructure & Networking
  • Configure low-latency local networking for browser-based access to the AI appliance.
  • Set up secure local APIs and data isolation layers — ensuring zero external data leakage.
  • Integrate hardware accelerators and manage firmware updates across different SKUs.
  • Reliability, Testing, and Scaling
  • Build test harnesses to validate multimodal model performance (e.G., LLM + diffusion + ASR pipelines).
  • Implement over-the-air (OTA) update mechanisms for edge devices without exposing user data.
  • Develop monitoring dashboards and alerting for real-time performance metrics.
  • Required Qualifications :

  • Strong background in Linux systems engineering and containerization (Docker, Podman, LXC).
  • Experience deploying AI inference services locally or at the edge (llama.Cpp, ollama, vLLM, ONNX).
  • Proficiency in CI / CD tools (GitHub Actions, Jenkins, ArgoCD) and infrastructure-as-code (Terraform, Ansible).
  • Expertise in GPU / accelerator optimization, CUDA stack management, or similar.
  • Solid understanding of networking, security, and firewall configurations for local appliances.
  • Scripting and automation skills (Python, Bash, Go, or Rust).
  • Preferred Qualifications :

  • Experience with embedded systems or edge AI devices (e.G., Jetson, Coral, FPGA-based accelerators).
  • experience minimum 10 years
  • Familiarity with low-bit quantization, model partitioning, or distributed inference.
  • Background in hardware / software co-design or systems integration.
  • Knowledge of browser-based local apps (WebSocket, WebRTC, RESTful APIs) and AI service backends.
  • Prior work in privacy-preserving AI systems or local-first architectures.
  • Contact : Uday

    Mulya Technologies

    muday_bhaskar@yahoo.com

    "Mining The Knowledge Community"

    Create a job alert for this search

    Lead Ai Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    Edge AI Engineer - Healthcare Applications

    Edge AI Engineer - Healthcare Applications

    Cancard Inc. • Bangalore, IN
    Position : Edge AI Engineer - Cancard Inc.Cancard Inc and Advaa Health are seeking an experienced, engaged, and hands-on healthcare industry Edge Computing / IOT / CV expert for the role of Edge AI ...Show more
    Last updated: 1 day ago • Promoted
    AppScan Product _Lead Cloud DevOps Engineer

    AppScan Product _Lead Cloud DevOps Engineer

    HCLSoftware • bangalore district, karnataka, in
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show more
    Last updated: 30+ days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    AptEdge • hosur, tamil nadu, in
    AptEdge delivers Agentic Technical Support for B2B Enterprises.Our AI-powered Answer Engine, unlike traditional search engines, utilizes natural language processing to provide contextually relevant...Show more
    Last updated: 11 days ago • Promoted
    Sr AI Engineer

    Sr AI Engineer

    Litmus7 • hosur, tamil nadu, in
    As part of this initiative, resource should research and experiment with the latest AI and cloud innovations (such as AWS Agents, Databricks AI, and other Model Context Protocol (MCP integrations),...Show more
    Last updated: 19 days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Tata Consultancy Services • hosur, tamil nadu, in
    TCS is conducting virtual drive Engineer.Years of Experience : 5 to 10 Yrs.Mode of Interview : Virtual Mode.Date of Interview : 5th, 6th, 7th Nov, 2025. Python, Generative AI models (LLMs, Image Genera...Show more
    Last updated: 30+ days ago • Promoted
    Cloud Operations Engineer (DevOps)

    Cloud Operations Engineer (DevOps)

    Suronex • hosur, tamil nadu, in
    We’re expanding our team and looking for a skilled.Cloud Operations Engineer (DevOps).If you’re passionate about automation, infrastructure reliability, and modern cloud technologies, we’d love to ...Show more
    Last updated: 1 day ago • Promoted
    Principal DevOps / Edge AI Engineer

    Principal DevOps / Edge AI Engineer

    Mulya Technologies • Greater Bengaluru Area, India
    Principal DevOps / Edge AI Engineer.Founded in 2023,by Industry veterans HQ in California,US.We are revolutionizing sustainable AI compute through intuitive software with composable silicon.Princip...Show more
    Last updated: 1 day ago • Promoted
    AWS devops engineer

    AWS devops engineer

    techifyapps • bangalore, karnataka, in
    We are looking for a skilled AWS DevOps Engineer to join our growing engineering team.The ideal candidate should have strong hands-on experience in designing CI / CD pipelines, containerized deployme...Show more
    Last updated: 3 days ago • Promoted
    DevOps Engineer

    DevOps Engineer

    EXL • hosur, tamil nadu, in
    Tips : Provide a summary of the role, what success in the position looks like, and how this role fits into the organization overall. Experienced in concepts such as Continuous Integration and Continu...Show more
    Last updated: 19 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Bengaluru, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 15 days ago • Promoted
    AWS Cloud DevOps Lead

    AWS Cloud DevOps Lead

    Luxoft India • Bengaluru, Karnataka, India
    We're seeking a solid and creative AWS Cloud DevOps eager to solve scale problems and work on cutting-edge and open-source technologies. In this project, you will have the opportunity to write code ...Show more
    Last updated: 13 days ago • Promoted
    Senior DevOps Engineer (SRE)

    Senior DevOps Engineer (SRE)

    MightyBot • hosur, tamil nadu, in
    Title : Senior DevOps Engineer (SRE).Join our team as a Senior DevOps Engineer, where we're focused on graduating AI from interesting demos to indispensable products. You will build and maintain the ...Show more
    Last updated: 10 days ago • Promoted
    Generative AI Engineer (LLM Integration)- CONTRACT

    Generative AI Engineer (LLM Integration)- CONTRACT

    Trilyon, Inc. • Greater Bengaluru Area, India
    AI Engineer (LLM Integration experience is a must).Location : Hybrid – Cessna Business Park, Bangalore.Type : Ongoing Contract (Long Term ). Design, build, and maintain generative AI workflows and int...Show more
    Last updated: 1 day ago • Promoted
    EKS / Kubernetes Infra Lead Engineer

    EKS / Kubernetes Infra Lead Engineer

    FICO • Bengaluru, Karnataka, India
    The Opportunity "FICO is seeking a senior AWS Cloud Engineer who thrives working in a fast paced state of the art Cloud environment. This position will be heavily involved with the migration of our...Show more
    Last updated: 17 days ago • Promoted
    Senior DevOps Engineer

    Senior DevOps Engineer

    Concentric AI • bangalore, karnataka, in
    We are seeking an experienced DevOps & Infrastructure Engineer to design, build, and maintain scalable, secure AWS infrastructure using Infrastructure as Code (IaC). The ideal candidate will have a ...Show more
    Last updated: 30+ days ago • Promoted
    SRE & DevOps Engineer (ML / AI Platform)

    SRE & DevOps Engineer (ML / AI Platform)

    Prospance Inc • Bengaluru, Karnataka, India
    SRE & DevOps Engineer (ML / AI Platform) Contract Position | Global E-Commerce Leader | Hybrid About the Opportunity We're partnering with a leading global e-commerce company to find an exceptiona...Show more
    Last updated: 30+ days ago • Promoted
    Azure DevOps Engineer

    Azure DevOps Engineer

    Tata Consultancy Services • hosur, tamil nadu, in
    Job Title : Azure DevOps Engineer.CI / CD pipelines, build and release management).DevOps engineering with strong exposure to cloud-based CI / CD solutions. Design, implement, and maintain CI / CD pipeline...Show more
    Last updated: 6 hours ago • Promoted • New!
    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    Senior DevOps Engineer (Azure Focus) – IIT Graduates only

    ezAIx Inc. • hosur, tamil nadu, in
    As part of our expansion, we’re seeking an.Advanced Senior DevOps Engineer.This critical role will drive the scalability of our platform, ensuring robust performance and high availability while emb...Show more
    Last updated: 1 day ago • Promoted