Principal Machine Learning Engineer - Multimodal AI & Inference
Mulya TechnologiesGreater Bengaluru Area, India1 day ago
Job descriptionOptimize large-scale foundation models (e.g., Llama, gpt-oss, Whisper, HiDream, Qwen, Wan etc) for on-device inference. Adapt pre-trained models for multimodal tasks (text, image, audio, video, or cross-modal reasoning). Ensure seamless interoperability between modalities — e.g., enabling the system to “see, hear, and talk” naturally. Quantize and compress large models (4-bit or mixed precision) while maintaining high accuracy and low latency. Implement and benchmark inference runtimes using frameworks like Llama.cpp, Ollama, vLLM, ONNX etc. Collaborate with hardware engineers to co-design model architectures optimized for the appliance’s compute fabric. Build and maintain scalable, high-throughput inference pipelines capable of handling concurrent multimodal requests (text, audio, image, video). Implement token streaming, caching, and scheduling strategies for real-time responses. Develop APIs for low-latency local inference accessible via a web interface. Profile and benchmark performance (throughput, latency, energy efficiency) of deployed models. Run regression tests to validate numerical accuracy after quantization or pruning. Define KPIs for multimodal model performance under real-world usage. Investigate emerging multimodal architectures and lightweight model variants for local deployment. Prototype hybrid models that combine LLMs, diffusion models, and ASR / TTS pipelines for advanced multimodal applications. Stay current on state-of-the-art inference frameworks, compression techniques, and multimodal learning trends. Strong background in deep learning and model deployment, with hands-on experience in PyTorch and / or TensorFlow. Expertise in model optimization — quantization, pruning, distillation, or mixed-precision inference. Practical knowledge of inference engines (vLLM, llama.cpp, ONNX Runtime or similar). Experience deploying large models locally or on edge devices with limited memory / compute constraints. Familiarity with multimodal model architectures — e.g., CLIP, Flamingo, LLaVA, or AudioGPT-style systems. Strong software engineering skills (Python, C++, CUDA) and experience integrating models into production systems. Understanding of GPU / accelerator utilization, memory bandwidth optimization, and distributed inference. Experience with model-parallel or tensor-parallel inference at scale. Contributions to open-source inference frameworks or model serving systems. Familiarity with hardware-aware training or co-optimization of neural networks and hardware. Background in speech, vision, or multimodal ML research. Track record of deploying models that run entirely offline or on embedded / edge systems.
Principal Machine Learning Engineer - Multimodal AI & Inference
Bangalore
Founded in 2023,by Industry veterans HQ in California,US
- We are revolutionizing sustainable AI compute through intuitive software with composable silicon
Overview :
You will design, optimize, and deploy large multimodal models (language, vision, audio, video) to run efficiently on a compact, high-performance AI appliance capable of supporting 100B+ parameter models at real-time speeds. Your mission is to deliver state-of-the-art multimodal inference locally through advanced model optimization, quantization, and system-level integration.
Key Responsibilities :
1. Model Integration & Porting
2. Model Optimization for Edge Hardware
3. Inference Pipeline Development
4. Evaluation & Benchmarking
5. Research & Prototyping
Required Qualifications :
Preferred Qualifications :
experience-10+ years
Contact : Uday
Mulya Technologies
muday_bhaskar@yahoo.com
"Mining The Knowledge Community"
Create a job alert for this search
Machine Learning Engineer • Greater Bengaluru Area, India
Related jobs
)
- Promoted
AI / ML Engineer
RecroBengaluru, Karnataka, India We are looking for a GenAI / ML Engineer to join our AI & Machine Learning team and drive the.You will work at the forefront of Generative AI,.
Reinforcement Learning (RL), and Large Language Models (...Show moreLast updated: 18 days ago
- Promoted
Machine Learning Engineer
LuxoftBengaluru, Karnataka, India We are seeking a skilled and domain-expert Machine Learning Engineer to develop and deploy data-driven solutions in the context of Digital Oilfield (DOF) systems.
The ideal candidate will have a str...Show moreLast updated: 19 days ago
- Promoted
Lead Engineer - AI / ML
Mindfire SolutionsTumkur, IN As a Lead AI / ML Engineer, you spearhead the design, development, and implementation of advanced AI and machine learning models.
Your role involves guiding a team of engineers ensuring the successful...Show moreLast updated: 30+ days ago
- Promoted
Machine Learning Engineer-Agentic AI
Innodata Inc.Tumkur, IN Design and implement multi-agent systems using LangChain, LangGraph, CrewAI, AutoGen or similar frameworks.Build A2A (agent-to-agent) orchestration and implement MCP (multi-context protocol) for co...Show moreLast updated: 18 days ago
- Promoted
Machine Learning Engineer
GoMLTumkur, IN Looking for a culture to thrive & build a rewarding career for yourself, join the core team of young hustlers building the next generation of Machine Learning platform & services.You will develop t...Show moreLast updated: 3 days ago
- Promoted
AI / ML Engineer
Edstem TechnologiesTumkur, IN The ideal candidate will have hands-on expertise across the full ML lifecycle—from data exploration and feature engineering to model training, optimization, and production deployment.You will work ...Show moreLast updated: 19 days ago
- Promoted
Machine Learning Engineer- 2
CommerceIQBengaluru, Karnataka, India As an ML Engineer in the team, you will work closely with Data Science, Engineering, Platform, Product and Operations teams to build state-of- the-art ML based solutions for B2B SaaS products.This ...Show moreLast updated: 19 days ago
- Promoted
Senior Machine Learning Engineer
Tata Consultancy ServicesTumkur, IN Senior Machine Learning Engineer.Senior Machine Learning Engineer.Developer with hands on experience in ML Algorithms.Required technical Skill Set : -.
A Senior Machine Learning (ML) Engineer designs...Show moreLast updated: 30+ days ago
- Promoted
Machine Learning Engineer
DigileGreater Bengaluru Area, India We are looking for a passionate and skilled.The ideal candidate will have strong experience in.Data Analytics, AI / ML, Predictive Modelling.
This role involves collaborating with cross-functional tea...Show moreLast updated: 1 day ago
- Promoted
Machine Learning Engineer
BayOne SolutionsTumkur, IN Machine Learning Development & Implementation (40%).Design and implement end-to-end ML pipelines for recommendation systems, search ranking, and classification problems.
Build and optimize tradition...Show moreLast updated: 30+ days ago
- Promoted
ML / Gen AI Engineer
Intuition IT – Intuitive Technology RecruitmentTumkur, IN Design, deploy, and manage scalable ML and GenAI workloads using AWS services including SageMaker Studio and Bedrock.Implement and maintain infrastructure using AWS Lambda, EKS, ECS on Fargate, and...Show moreLast updated: 2 days ago
- Promoted
Principal Software Engineer AI / ML
CotivitiTumkur, IN We are seeking a software architect designing comprehensive MLOps platform, establishing technical standards, and leading infrastructure integration for ML deployment.
Principal Responsibilities and...Show moreLast updated: 16 days ago
- Promoted
Machine Learning Engineer
UptimeAI Inc.Bengaluru, Karnataka, India UptimeAI is leading the way in predictive analytics and AI-driven solutions to optimize operational uptime and reduce downtime for industrial and enterprise clients.
Our innovative platform harnesse...Show moreLast updated: 30+ days ago
- Promoted
Founding Sr. Machine Learning Engineer : No Salary Only Equity
Truxt.aiTumkur, IN As an early-stage company driven by a meaningful mission, we seek exceptional engineering talent who values purpose, long-term impact, and significant equity ownership over traditional salary compe...Show moreLast updated: 30+ days ago
- Promoted
AI & ML Engineer
Apna Technologies & Solutions (ApnaTech)Hosur, Tamil Nadu, India We are seeking a highly skilled.In this role, you will be responsible for designing, developing, and optimizing machine learning models and algorithms to solve complex problems.You will collaborate...Show moreLast updated: 12 days ago
- Promoted
Machine Learning Engineer - Agentic AI & AIOps
Platform9Tumkur, IN Platform9 is a leader in simplifying enterprise private clouds.Our flagship product, Private Cloud Director, turns existing infrastructure into a full-featured private cloud.Enterprise IT teams can...Show moreLast updated: 16 days ago
- Promoted
Machine Learning Engineer
RecroBangalore, IN Job Description : AI / ML Engineer (3D Geometry & Manufacturing).We are seeking an exceptionally talented and entrepreneurial.
Design for Manufacturability (DFM).If you are passionate about leveraging ...Show moreLast updated: 30+ days ago
- Promoted
Machine Learning Engineer
ResponsiveBengaluru, Karnataka, India Responsive is looking for an ML Engineer with a strong background in Python, NLP, structured and unstructured data, and basic understanding of ML and DL algorithms / frameworks.The ideal candidate wi...Show moreLast updated: 30+ days ago