Principal DevOps / Edge AI EngineerMulya Technologies • Bangalore (division)

Principal DevOps / Edge AI Engineer

Mulya Technologies • Bangalore (division)

1 day ago

Job description

Bangalore

Founded in 2023,by Industry veterans HQ in California,US

We are revolutionizing sustainable AI compute through intuitive software with composable silicon

Principal DevOps / Edge AI Engineer

Overview :

You will be responsible for building, deploying, and maintaining the local infrastructure that powers high-performance multimodal AI models (text, image, audio, video) on a compact AI appliance. You’ll bridge the gap between hardware, ML inference, and user-facing applications - ensuring reliability, scalability, and efficiency of on-device AI workloads.

Key Responsibilities :

System Deployment & Orchestration

Containerize AI inference services and web applications using Docker or Podman.

Design lightweight orchestration layers for local systems (Kubernetes, Nomad, or custom orchestration).

Automate build, test, and deployment pipelines (CI / CD) for local-first AI workloads.

Performance Optimization & Resource Management

Optimize compute utilization for concurrent multimodal workloads.

Develop monitoring tools for system health, thermal management, and memory / bandwidth usage.

Tune OS, drivers, and I / O subsystems for maximum throughput and low latency.

Edge Infrastructure & Networking

Configure low-latency local networking for browser-based access to the AI appliance.

Set up secure local APIs and data isolation layers — ensuring zero external data leakage.

Integrate hardware accelerators and manage firmware updates across different SKUs.

Reliability, Testing, and Scaling

Build test harnesses to validate multimodal model performance (e.g., LLM + diffusion + ASR pipelines).

Implement over-the-air (OTA) update mechanisms for edge devices without exposing user data.

Develop monitoring dashboards and alerting for real-time performance metrics.

Required Qualifications :

Strong background in Linux systems engineering and containerization (Docker, Podman, LXC).

Experience deploying AI inference services locally or at the edge (llama.cpp, ollama, vLLM, ONNX).

Proficiency in CI / CD tools (GitHub Actions, Jenkins, ArgoCD) and infrastructure-as-code (Terraform, Ansible).

Expertise in GPU / accelerator optimization, CUDA stack management, or similar.

Solid understanding of networking, security, and firewall configurations for local appliances.

Scripting and automation skills (Python, Bash, Go, or Rust).

Preferred Qualifications :

Experience with embedded systems or edge AI devices (e.g., Jetson, Coral, FPGA-based accelerators).

experience minimum 10 years

Familiarity with low-bit quantization, model partitioning, or distributed inference.

Background in hardware / software co-design or systems integration.

Knowledge of browser-based local apps (WebSocket, WebRTC, RESTful APIs) and AI service backends.

Prior work in privacy-preserving AI systems or local-first architectures.

Contact : Uday

Mulya Technologies

muday_bhaskar@yahoo.com

"Mining The Knowledge Community"

Create a job alert for this search

Principal Ai Engineer • Bangalore (division)

Related jobs

DevOps Engineer I - Cloud & Infra Automation

Astra Security • Bangalore (division)

Astra is shaping the future of security - fast, intuitive, and deeply integrated.Our engineering culture values clarity, velocity, and human connection. As a DevOps Engineer I, you’ll help architect...Show more

Last updated: 1 day ago • Promoted

DataOps Engineer / Data-Dev-ops Engineer / Big Data SRE

RingCentral • Bangalore (division)

RingCentral is seeking an experienced technical specialist to drive the support and continuous.The Data Operations team is dedicated to. As a key technical member, you'll tackle challenging proj...Show more

Last updated: 1 day ago • Promoted

AI Engineer (Conversational Analytics & GenAI Systems)

IRISS, Inc. • Bangalore (division)

Our commitment to pushing boundaries and delivering exceptional solutions has positioned us as a trusted partner for clients seeking top-tier technical expertise in Condition Based Monitoring.AI En...Show more

Last updated: 1 day ago • Promoted

Generative AI Engineer

TestZeus • Bangalore (division)

TestZeus is pioneering the next generation of AI-powered software testing.We’re the team behind Hercules, the world’s first open-source testing agent. By combining large language models, multi-agent...Show more

Last updated: 1 day ago • Promoted

Principal Cloud Solution Architect

Oracle • Bangalore (division)

We seek a technical expert with a strong foundation in systems architecture, operating systems, distributed systems, virtualization, and storage protocols. You will design, optimize, and deploy stor...Show more

Last updated: 1 day ago • Promoted

Cloud / AWS Architect

Geojit Technologies • Bangalore (division)

The Cloud Architect will be responsible for designing, implementing, and optimizing scalable, secure, and resilient cloud architectures to support modern digital and analytics platforms.The role re...Show more

Last updated: 2 days ago • Promoted

Agentic Architect

Recro • Bangalore (division)

AI Tech Architect (7–10 yrs) — Agentic & Gen AI Platforms.Location : Bengaluru / Gurugram.Team : AI Platforms & Architecture. Python, FastAPI, AWS (EKS, Bedrock, OpenSearch, S3, RDS), GenAI & RAG Arch...Show more

Last updated: 2 days ago • Promoted

AI Tech Architect

Recro • Bangalore (division)

Last updated: 23 days ago • Promoted

Data Engineer

Synechron • Bangalore (division)

We have immediate opportunity for AWS data engineer.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innova...Show more

Last updated: 30+ days ago • Promoted

Software Engineer - Gen AI

KPI Partners • Bangalore (division)

KPI Partners is seeking a talented and motivated Software Engineer specializing in Generative AI to join our dynamic team. This individual will play a crucial role in developing and integrating adva...Show more

Last updated: 1 day ago • Promoted

Generative AI Engineer

Alp Consulting Ltd. • Bangalore (division)

Hyderabad / Bangalore / Pune / Chennai / Coimbatore.We are seeking a DevOPS / MLOps Engineer to be the backbone of our AI tool development and deployment efforts. This role sits at the intersection of data ...Show more

Last updated: 1 day ago • Promoted

Agentic AI Engineer

Recro • Bangalore (division)

EKS, S3, RDS, ElastiCache, SNS / SQS, API Gateway, and Secrets Manager.Experience in service instrumentation and monitoring using. Excellent written and verbal communication skills — able to produce c...Show more

Last updated: 1 day ago • Promoted

Principal Engineer

Client of Solvecube • Bangalore (division)

I hope you are enjoying a great day! I am from Solvecube HCM, an AI Based global consulting firm head quartered in Singapore. Our client is a Healthcare AI Startup and looking for a great tech leade...Show more

Last updated: 1 day ago • Promoted

Platform Engineer Developer -AI

Smarsh • Bangalore (division)

Smarsh is seeking an experienced Senior Software Engineer to design and build the next generation of.Agentic Development Lifecycle (AI-SDLC). Modules are AI-ready, self-contained bundles that encaps...Show more

Last updated: 1 day ago • Promoted

CloudOps Engineer - I

Navi • Bangalore (division)

The Cloudops team at Navi deploys, operates, and scales a hybrid cloud architecture spanning AWS, Oracle Cloud Infrastructure (OCI), and specialized self-hosted environments.As Navi partners closel...Show more

Last updated: 1 day ago • Promoted

Principal SQA Engineer (SDWAN Solution)

Palo Alto Networks • Bangalore (division)

At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Emids • Bangalore (division)

We are looking for a highly skilled Data Engineer with strong expertise in AWS, Databricks, PySpark, and Airflow to join our growing Data Engineering team. The ideal candidate will be responsible fo...Show more

Last updated: 1 day ago • Promoted

GEN AI Architect

ITC Infotech • Bangalore (division)

The ideal candidate will leverage the.Azure OpenAI, Azure Document Intelligence, Cognitive Search, and Azure Functions.Solution Architecture & Design. Generative AI-based Knowledge Mining systems.Az...Show more

Last updated: 1 day ago • Promoted