Talent.com
No longer accepting applications
Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Grid Dynamicsnavi mumbai, India
14 days ago
Job description

Role Overview :

We are looking for a skilled Senior Java Backend Engineer to join our team focused on building scalable and high-performance backend systems for Generative AI applications. You’ll play a key role in designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems. This role is ideal for backend developers with a passion for modern AI technologies and distributed systems.

Key Responsibilities :

  • Design, build, and maintain scalable backend services using Java and the Spring Boot framework
  • Develop APIs to enable LLM integration and support AI agent orchestration workflows
  • Architect microservices to power RAG (Retrieval-Augmented Generation) and other LLM-driven systems
  • Optimize performance through efficient caching strategies and vector database interactions
  • Integrate and manage connections with multiple LLM providers (e.g., OpenAI, Gemini, Claude), including rate limiting and failover handling
  • Implement real-time streaming features for conversational AI systems using WebSockets or similar technologies
  • Ensure robust system observability with logging , monitoring , and tracing

Required Skills & Qualifications :

3–7 years total, with a minimum of 1 year working on Generative AI projects

Backend Development :

  • Minimum 3 years of hands-on experience with Java and Spring Boot
  • Strong grasp of RESTful API design principles and microservices architecture
  • Proficiency with core Spring modules : Spring Security , Spring Data JPA , Spring Cloud
  • Experience working with relational and NoSQL databases : PostgreSQL , MongoDB , Redis
  • Familiarity with message brokers such as RabbitMQ or Apache Kafka
  • Expertise in caching mechanisms and system performance tuning
  • Generative AI Integration :

  • Experience integrating LLM APIs (OpenAI, Gemini, Claude, etc.) into backend services
  • Knowledge of vector databases and semantic search technologies
  • Familiarity with AI agent orchestration frameworks (e.g., LangGraph )
  • Understanding of RAG systems and how to implement them effectively
  • Experience developing streaming responses using WebSockets or server-sent events
  • Working knowledge of prompt templating and management systems
  • Nice to Have :

  • Experience in fine-tuning LLMs and managing model deployment pipelines
  • Knowledge of self-hosted LLM environments and infrastructure management
  • Exposure to observability tools like LangSmith or custom monitoring setups
  • Familiarity with natural language to SQL systems or BI applications powered by LLMs
  • Note : If you are matching on to the above job description & skills, please feel free to fill in your details on the below Form enclosed (

    Create a job alert for this search

    Java Developer • navi mumbai, India

    Related jobs
    • Promoted
    Full Stack Java Sr. Developer

    Full Stack Java Sr. Developer

    Matrix USAKalyan-Dombivli, IN
    We are looking for a highly skilled Full Stack Java Sr.Developer to join our team and contribute to various projects.The ideal candidate will have extensive experience in designing and developing w...Show moreLast updated: 21 days ago
    • Promoted
    Senior Java Engineer – Model Inference Platform (Microservices / ML / Seldon) Hiring For Pan India

    Senior Java Engineer – Model Inference Platform (Microservices / ML / Seldon) Hiring For Pan India

    Tata Consultancy Servicesmumbai city, maharashtra, in
    Design, build, and optimize high-performance microservices using Java 17+, Spring Boot, and reactive frameworks.Develop and maintain APIs for model registration, inference request routing, and mode...Show moreLast updated: 21 days ago
    • Promoted
    EDI Integration Developer - Java

    EDI Integration Developer - Java

    Wilco Source Technologies Pvt LtdMumbai
    Mandatory points : - Collaborate with clients internal specialists and external trading partners to troubleshoot complex mapping, AS2, or SFTP set...Show moreLast updated: 1 day ago
    • Promoted
    Senior Java Engineer – Model Inference Platform (Microservices / Ml / Seldon) Hiring For Pan India

    Senior Java Engineer – Model Inference Platform (Microservices / Ml / Seldon) Hiring For Pan India

    Tata Consultancy ServicesDombivli, Republic Of India, IN
    Design, build, and optimize high-performance microservices using Java 17+, Spring Boot, and reactive frameworks.Develop and maintain APIs for model registration, inference request routing, and mode...Show moreLast updated: 15 days ago
    • Promoted
    Sr. Software Engineer / Lead-(Java Backend, DB and Kafka)

    Sr. Software Engineer / Lead-(Java Backend, DB and Kafka)

    RingCentralthane, maharashtra, in
    We are looking for a Senior Backend and Infra Engineer that will work on a variety of exciting projects with responsibility for designing and delivering secure, distributed, scalable and fault tole...Show moreLast updated: 21 days ago
    • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    ACL Digitaldombivli, maharashtra, in
    Responsible for designing and building backend system.Focus on scalable APIs, workflow frameworks, and automation platforms that improve customer and agent experiences. Acts as a strong individual c...Show moreLast updated: 30+ days ago
    • Promoted
    Research And Development Associate

    Research And Development Associate

    MASH MakesKhopoli, Maharashtra, India
    Job Title : R&D Associate / R&D Trainee Location : Khopoli based or Vashi, Mumbai (Regular travel to Khopoli; occasional travel to Udupi) Type : Full-time (6 days / week) Experience : 0–3 years Educati...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Java Developer

    Sr. Java Developer

    HR PLACEMENT CONSULTANTS (HRPC)Mumbai, Maharashtra, India
    Domain / Vertical Insurance and / or Finance (preferred).Qualifications Educational - MSc / MCA / BE / B.Spring Framework (Spring Boot, Spring Integration, Spring Data JPA, Java JPA).Experience into Micro ...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    Java requirements (6.5 -15 Yrs) Immediate Joiners

    Java requirements (6.5 -15 Yrs) Immediate Joiners

    Infosys FinacleThane, IN
    Role : - Product technical lead / Technical Manager -EV / Senior Technical Manager -EV.Online Coding Assessment (180 Mins). Key Responsibilities include : -.Ability to provide solutions based on high ...Show moreLast updated: 12 hours ago
    • Promoted
    Design Engineer

    Design Engineer

    Vanson Engineering Pvt. Ltd.Virar, Maharashtra, India
    Responsibilities : Design & Development following products : - Electrical & Hydraulic driven anchor windlass & towing winches Electrical driven Rescue Boat Davit Marine Rudders & Propellers Stee...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Java Developer

    Sr Java Developer

    McLaren Strategic Solutions (MSS)Mumbai, Maharashtra, India
    Seeking an experienced L2 Senior Support Engineer with expertise in Java Quarkus and application support.The role involves advanced troubleshooting, incident management, and providing configuration...Show moreLast updated: 21 days ago
    • Promoted
    AppScan Product _Sr. Java Developer

    AppScan Product _Sr. Java Developer

    HCLSoftwarethane, maharashtra, in
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

    Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

    Grid DynamicsDombivali, Maharashtra, India
    You’ll play a key role in designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems. This role is ideal for backend developers with a passio...Show moreLast updated: 7 days ago
    • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    Accion Labsnavi mumbai, India
    Microservices & Microservice Architecture.Design, develop, and maintain scalable Java-based applications using Spring Boot and Microservices architecture. Implement design patterns and best coding p...Show moreLast updated: 10 days ago
    • Promoted
    Appscan Product _sr. Java Developer

    Appscan Product _sr. Java Developer

    HCL AppScanDombivli, Republic Of India, IN
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 14 days ago
    • Promoted
    Asst. / Associate Professor - AI&ML

    Asst. / Associate Professor - AI&ML

    Universal Ai UniversityKarjat, Maharashtra, India
    Universal Ai University, Karjat-Mumbai, is.India's first American Vice Chancellor with MIT (USA) pedigree.This is a full-time on-site role for an Assistant / Associate Professor - AI & ML, located in...Show moreLast updated: 30+ days ago
    • Promoted
    Integration Developer

    Integration Developer

    Vriba Solutionsdombivli, maharashtra, in
    PM IST to 3 : 30 AM IST (US Shift).Immediate joiners preferred (15–30 days max).We are looking for an experienced.Integration Developer (5–10 years). The role requires working closely with cross-funct...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML Educator

    AI / ML Educator

    Universal Ai UniversityKarjat, Republic Of India, IN
    Universal Ai University, Karjat-Mumbai, is.India's first American Vice Chancellor with MIT (USA) pedigree.This is a full-time on-site role for an Assistant / Associate Professor - AI & ML, located in...Show moreLast updated: 30+ days ago