Talent.com
Zocket
Senior AI / ML EngineerZocket • Chennai, India
Senior AI / ML Engineer

Senior AI / ML Engineer

Zocket • Chennai, India
4 days ago
Job description
We are looking for a senior AI/ML engineer who can take AI features from prototype to production with confidence. You will own the full lifecycle of our LLM-powered systems, from benchmarking model and pipeline performance to hardening the stack for scale to shipping it live to real users. This role sits at the intersection of applied LLM/GenAI work and MLOps and is critical to how quickly and reliably we can put new AI capabilities in front of customers. You will work closely with product, backend, and design to make sure what we ship is fast, accurate, cost-efficient, and observable in production.

Responsibilities

  • Design, build, and ship LLM-powered features end-to-end, including RAG pipelines, agentic workflows, prompt orchestration, and fine-tuning where it makes sense.
  • Define and run benchmarking frameworks for our AI applications: latency, throughput, accuracy, hallucination rate, cost per request, and quality regressions across model and prompt changes.
  • Establish offline evals (golden sets, LLM-as-judge, human-in-the-loop) and online evals (A/B tests, shadow traffic, canary releases) before any model or prompt goes live.
  • Take models and pipelines to production: containerise, deploy, autoscale, and monitor inference services with clear SLOs for latency, error rate, and cost.
  • Build the MLOps backbone CI/CD for models and prompts, versioning, feature stores where needed, observability (traces, metrics, and logs), and rollback paths.
  • Optimise inference performance and cost: batching, caching, quantisation, distillation, model routing, and choosing the right managed vs self-hosted trade-offs.
  • Partner with product to translate fuzzy product asks into measurable AI quality bars and own the 'is this good enough to ship ' decision with data behind it.
  • Mentor other engineers on LLM best practices, evaluation rigour, and production readiness.

Requirements

  • 3-6 years of engineering experience, with a meaningful portion spent shipping ML or AI systems to production (not just notebooks or POCs).
  • Strong hands-on experience with LLMs and GenAI: at least one production system using OpenAI / Anthropic / open-source models, plus practical experience with RAG, embeddings, vector stores, and prompt engineering.
  • Solid MLOps foundation model serving (FastAPI, vLLM, Triton, SageMaker, or similar), containerisation (Docker, Kubernetes), and at least one cloud (AWS, GCP, or Azure).
  • Demonstrated ability to benchmark systems rigorously: you can talk concretely about how you measured a model's quality and performance, what you optimised, and what you knowingly traded off.
  • Strong Python skills; comfortable with PyTorch or TensorFlow and with frameworks like LangChain, LlamaIndex, or equivalents (or a clear point of view on why not to use them).
  • Good engineering discipline: testing, code review, clear API design, and the instinct to add observability before it is needed.
  • Comfortable owning the path to production: you have taken something live, watched it break, and fixed it, and you do not need a separate team to do that for you.

Bonus Points

  • Experience fine-tuning or post-training open-source models (LoRA/QLoRA, DPO, RLHF).
  • Worked with multimodal models (image, video, or audio generation/understanding).
  • Built or contributed to an internal eval harness or LLM observability tooling.
  • Experience with high QPS, low-latency inference at consumer scale.
  • Open-source contributions or technical writing in the AI/ML space.

This job was posted by Dhanesh Sridhar from Zocket.
Skills Required
triton , Docker, Kubernetes, Tensorflow, Gcp, FastAPI, Pytorch, MLops, Azure, Aws, Python
Create a job alert for this search

Senior AI / ML Engineer • Chennai, India

Similar jobs

AI/ML Software Engineer

Avensys Consultingchennai, tamil nadu, in

Avensys is a reputed global IT professional services company headquartered in Singapore.Our service spectrum includes enterprise solution consulting, business intelligence, business process automat... Show more

 • Promoted

AI/ML Engineer (onsite) Singapore

GoWin TrainingChennai, Tamil Nadu, India
Quick Apply

Experience : 5 6 years of experience in AI/ML or IT systems.Industry : Artificial Intelligence / Data Analytics / IT Services.Salary Budget: SGD 6000 - SGD 6800.We are looking for an AI/ML Engineer... Show more

AI/ML Engineer (Voice Models, Cloning, TTS, STT, ASR)

Client of Prasha Consultancy Services Private Limitedchennai, tamil nadu, in

Immediate or early Joiners preferred.A US Based IT MNC is looking for a seasoned AI/ML Engineer with hands-on experience in building and optimizing voice models, for one its Reputed client in Enter... Show more

 • Promoted

AI/ML Engineer

Mindfire Solutionschennai, tamil nadu, in

As an AI/ML Engineer, you will be responsible for architecting, developing, and deploying production-grade Generative AI and Agentic AI solutions, including LLM-powered systems, autonomous workflow... Show more

 • Promoted

AI ML Architect

Tata Consultancy Serviceschennai, tamil nadu, India

Deep expertise in AI/ML architecture design (TensorFlow, PyTorch, etc.Familiarity with large language models and Generative AI - Experience with cloud-native architectures (AWS, Azure, GCP).Strong ... Show more

 • Promoted

AI ML engineer

Tata Consultancy Serviceschennai, tamil nadu, India

TCS is looking for AI/ML applications.Compute Fundamentals: Demonstrates a deep understanding of compute concepts, including virtualization, containerization, operating systems, and system administ... Show more

 • Promoted

Lead Machine learning Engineer

Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
Quick Apply

We are seeking a Machine Learning Engineer to design, develop, and deploy advanced AI/ML solutions, including agentic AI systems and traditional machine learning models, for the mortgage servicing ... Show more

AI/ML Engineer (Onsite) Singapore

Gowin Search LLCChennai, Tamil Nadu, India
Quick Apply

Experience : 5 6 years of experience in AI/ML or IT systems.Industry : Artificial Intelligence / Data Analytics / IT Services.Salary Budget: SGD 6000 - SGD 6800.We are looking for an AI/ML Engineer... Show more

AI/ML

Saaki Argus & Averil ConsultingChennai, Tamil Nadu, India
Quick Apply

About Company: One of the global leader in delivering digital transformation and engineering services exclusively for the Connectedness industry, including telecom, digital service providers, and n... Show more

Research Engineer – Generative AI (LLMs)

Abacus.AIchennai, tamil nadu, in

AI is an AGI control center from where you can create, deploy, and monitor AI agents.We offer an AI super assistant for enterprises and professionals.We are building a future where AI assists and a... Show more

 • Promoted

Senior AI ML Engineer

Giggsochennai, tamil nadu, India

Below are the mandatory skills/experience required for this role:.Hands-on with frameworks like .RAG architectures, tool-calling, memory, reflection/critique loops.Proven delivery of at least one .... Show more

 • Promoted

AI/ML Engineer

Vrinda InternationalChennai, KA, in
Quick Apply

Job Profile: AI/ML Engineer – Mega Hiring Drive (UHG).Location: PAN India (Wipro – Bangalore, Chennai, Hyderabad, Pune, Coimbatore, GNDC).Notice Period: Immediate to 30 Days Only.Hiring AI/ML Engin... Show more

AI/ML engineer

Tata Consultancy Serviceschennai, tamil nadu, India

TCS is looking for AI/ML engineer.Mode of interview: Face-to-face.Rajiv Gandhi Salai, Navalur, Chennai, Tamil Nadu.Compute Fundamentals: Demonstrates a deep understanding of compute concepts, inclu... Show more

 • Promoted

Gen AI Machine Learning Engineer

Astekchennai, tamil nadu, in

AI and machine learning, out of which 3+ years of experience in machine learning engineering, NLP, Generative AI, and LLM technologies.Experience with LLM Agentic workflows and frameworks (Langchai... Show more

 • Promoted

Machine Learning Engineer

Harper Russo Talent Partnerchennai, tamil nadu, in

AI / Machine Learning Engineer (Remote).Note: To be considered, Please apply with a 2-minute max Loom Video on the following page.Along with your application, I want to hear about the most exceptio... Show more

 • Promoted

Remote ML Engineer - 60735

Turingchennai, tamil nadu, in
Remote

Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems.Turing support... Show more

 • Promoted

Senior MLOps Engineer (GCP / CV / Perception Pipelines)

Jaipur Roboticschennai, tamil nadu, in

At Jaipur Robotics, we build AI systems that turn visual and sensor data into automation, efficiency, and operational intelligence for the waste industry.We are a fast-growing, VC-backed clean-tech... Show more

 • Promoted

Artificial Intelligence Engineer

Hyqoochennai, tamil nadu, in

Design, develop, and deploy AI models, particularly focusing on.Retrieval-Augmented Generation (RAG).Develop and maintain AI workflows using.Write clean, efficient, and scalable code primarily in.A... Show more

 • Promoted

AI/ML Engineer

SharpAtomschennai, tamil nadu, in

AI/ML Engineer (LLMs / Python / Automation).Full-Time / Global Delivery Roster.We are bypassing theoretical research and building an elite team of practitioners focused entirely on the real-world e... Show more

 • Promoted

ML engineer

ALESAYI HOLDING | العيسائي القابضةtamil nadu, chennai, India

Purpose of the role Build, train, deploy, and maintain all analytical and machine learning models serving the Investment Division and, in later phases, the Group’s operating divisions.This includes... Show more