Talent.com
This job offer is not available in your country.
Senior Java Engineer – Model Inference Platform (Microservices / ML / Seldon) Hiring For Pan India

Senior Java Engineer – Model Inference Platform (Microservices / ML / Seldon) Hiring For Pan India

Tata Consultancy Servicessalem, tamil nadu, in
5 days ago
Job description

Key Responsibilities

Design, build, and optimize high-performance microservices using Java 17+, Spring Boot, and reactive frameworks.

Develop and maintain APIs for model registration, inference request routing, and model version management.

Integrate with Seldon Core / KServe for model orchestration, deployment, A / B testing and shadow testing of ML models.

Implement asynchronous, event-driven architectures using Kafka, Pub / Sub, or RabbitMQ for high-throughput inference workloads.

Build monitoring, tracing, and observability into inference pipelines using Prometheus, Grafana, and OpenTelemetry.

Work closely with MLOps and data engineering teams to integrate CI / CD for ML models, manage containers, and deploy to Kubernetes / cloud-native platforms (GCP GKE, AWS EKS, or Azure AKS).

Collaborate with data scientists and architects to ensure efficient model packaging, feature ingestion, and inference scaling.

Apply performance tuning, caching strategies (Redis, Hazelcast), and load balancing to sustain millisecond-level response times.

Mentor engineers and participate in design reviews to ensure architectural consistency, quality, and scalability.

Required Qualifications

12+ years of backend engineering experience with Java HPC (17 or above) in large-scale, distributed systems.

Deep understanding of microservices, event-driven architectures, and reactive programming.

Proven expertise in Spring Boot, Kafka, REST / gRPC APIs, JPA / Hibernate, Redis, and SQL / NoSQL databases.

Strong understanding of containerization (Docker) and Kubernetes orchestration.

Hands-on experience integrating or developing AI / ML inference platforms such as Seldon, KServe, TensorFlow Serving, or TorchServe.

Familiarity with model lifecycle management, feature stores, and inference request optimization.

Experience with cloud environments (AWS, GCP, or Azure) and CI / CD pipelines (Jenkins, ArgoCD, GitLab CI).

Knowledge of observability and performance tuning in high-concurrency, low-latency applications.

Strong communication, analytical, and problem-solving skills with the ability to lead technical discussions across teams.

Preferred Skills

Exposure to Python-based ML pipelines and REST / gRPC integrations with data science environments.

Familiarity with model governance, A / B testing, and multi-model serving architectures.

Experience with API gateways (Kong, Istio, or Envoy) and service mesh architectures.

Understanding of data serialization formats (Avro, Protobuf, Parquet) and streaming analytics.

Knowledge of GPU / CPU optimization for inference workloads

Exp Range : 10 TO 15

Location : Pan India

Interview Type : Weekday Virtual Drive

Date : 16-Oct-2025

Day : Thursday

Create a job alert for this search

Platform • salem, tamil nadu, in

Related jobs
  • Promoted
GTM Engineer

GTM Engineer

Staple AISalem,Tamil Nadu, IN
India (remote / non-tier 1 cities welcome).At Staple, we’re not building just another SaaS product.Think data preparation, data governance and automation all-in-one. Staple AI helps global enterpris...Show moreLast updated: 6 days ago
  • Promoted
Java Software Engineer

Java Software Engineer

Brace Infotech Private LtdErode, IN
Job Title : Senior Java Developer / Data Engineer.We are seeking an experienced and highly skilled.Core Java, Spring Boot, and JBoss. SQL, Python, PySpark, and Power BI.The ideal candidate will also ...Show moreLast updated: 3 days ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS)erode, tamil nadu, in
This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you’re someone who takes initiative, val...Show moreLast updated: 5 days ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

SAIVA AISalem,Tamil Nadu, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 28 days ago
  • Promoted
AIML Engineer

AIML Engineer

IntraEdgesalem, tamil nadu, in
Artificial Intelligence (AI / ML).AI-powered enterprise applications.The engineer will be responsible for developing scalable. Design and develop enterprise-grade applications in.NLP, predictive analy...Show moreLast updated: 20 days ago
  • Promoted
Senior Engineer – AI & Java

Senior Engineer – AI & Java

IntraEdgeErode, IN
Artificial Intelligence (AI / ML).AI-powered enterprise applications.The engineer will be responsible for developing scalable. Design and develop enterprise-grade applications in.NLP, predictive analy...Show moreLast updated: 20 days ago
  • Promoted
Java Software Engineer

Java Software Engineer

ACL DigitalErode, IN
Title : Java Developer (Contract Role).Location : Remote or Bengaluru, India (Onsite).Focus on scalable APIs, workflow frameworks, and automation platforms that improve customer and agent experiences...Show moreLast updated: 20 days ago
  • Promoted
Senior Data Engineer – Snowflake & Python (Remote, India or EU)

Senior Data Engineer – Snowflake & Python (Remote, India or EU)

Az-Tec TalentSalem,Tamil Nadu, IN
Remote
Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 14 days ago
  • Promoted
Lead Engineer – AI-Powered Full Stack Solutions ( 5+ yrs)

Lead Engineer – AI-Powered Full Stack Solutions ( 5+ yrs)

AIMLEAPErode, IN
Lead Engineer – AI-Powered Full Stack Solutions (WFH).Work from Home / Bangalore / India.Tech / MCA / Computer Science / IT. Proven expertise in delivering complex, cross-domain projects across AI, ...Show moreLast updated: 6 days ago
  • Promoted
Java, Python Software Engineer

Java, Python Software Engineer

PCS InfoTechErode, IN
Job Description : Java, Python Software Engineer (Remote) - India .We are looking for a skilled Software Engineer with expertise in Java, Python to join our growing technology team.The ideal candida...Show moreLast updated: 20 days ago
  • Promoted
Hiring for Java + Big Data

Hiring for Java + Big Data

DeloitteSalem, Tamil Nadu, India
Deloitte India is hiring for Java + Big Data (Big data is mandatory) candidates for Chennai location.Interested candidates can apply. Looking for 6 to 9 Years of experience candidates.Job descriptio...Show moreLast updated: 4 days ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

PASO CoSalem,Tamil Nadu, IN
We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 6 days ago
  • Promoted
Senior Data Platform Engineer

Senior Data Platform Engineer

Black Dog LabsSalem,Tamil Nadu, IN
Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
  • Promoted
Senior Data Engineer

Senior Data Engineer

Incept Labserode, tamil nadu, in
Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 15 days ago
  • Promoted
AI Engineer

AI Engineer

Aventis SolutionsSalem,Tamil Nadu, IN
Aventis Solutions is igniting the AI revolution : .Now, our tech partner is establishing a new.AI Innovation Hub in Pune, India. These roles are at the heart of enabling large-scale AI and GenAI adopt...Show moreLast updated: 30+ days ago
  • Promoted
Java Software Engineer

Java Software Engineer

IntraEdgeSalem,Tamil Nadu, IN
Develop and maintain backend microservices using Python, Java and Spring Boot.Build and integrate APIs (both GraphQL and REST) for scalable service communication. Deploy and manage services on Googl...Show moreLast updated: 20 days ago
  • Promoted
AI / ML Engineer

AI / ML Engineer

TransPerfectsalem, tamil nadu, in
AI / ML Engineer (Remote – Bangalore, India).Location : Bangalore, India (Remote).Contract : 5 months (with potential 12-month extension based on performance). Client : A leading multinational telecommun...Show moreLast updated: 5 days ago
  • Promoted
Senior Software Engineer

Senior Software Engineer

People Prime Worldwidesalem, tamil nadu, in
Our client is a global digital solutions and technology consulting company headquartered in Mumbai, India.The company generates annual revenue of over $4. It has a workforce of around 86,000 profess...Show moreLast updated: 1 day ago