Talent.com
This job offer is not available in your country.
Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Grid Dynamicsvadodara, gujarat, in
15 days ago
Job description

Role Overview :

We are looking for a skilled Senior Java Backend Engineer to join our team focused on building scalable and high-performance backend systems for Generative AI applications. You’ll play a key role in designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems. This role is ideal for backend developers with a passion for modern AI technologies and distributed systems.

Key Responsibilities :

  • Design, build, and maintain scalable backend services using Java and the Spring Boot framework
  • Develop APIs to enable LLM integration and support AI agent orchestration workflows
  • Architect microservices to power RAG (Retrieval-Augmented Generation) and other LLM-driven systems
  • Optimize performance through efficient caching strategies and vector database interactions
  • Integrate and manage connections with multiple LLM providers (e.g., OpenAI, Gemini, Claude), including rate limiting and failover handling
  • Implement real-time streaming features for conversational AI systems using WebSockets or similar technologies
  • Ensure robust system observability with logging , monitoring , and tracing

Required Skills & Qualifications :

3–7 years total, with a minimum of 1 year working on Generative AI projects

Backend Development :

  • Minimum 3 years of hands-on experience with Java and Spring Boot
  • Strong grasp of RESTful API design principles and microservices architecture
  • Proficiency with core Spring modules : Spring Security , Spring Data JPA , Spring Cloud
  • Experience working with relational and NoSQL databases : PostgreSQL , MongoDB , Redis
  • Familiarity with message brokers such as RabbitMQ or Apache Kafka
  • Expertise in caching mechanisms and system performance tuning
  • Generative AI Integration :

  • Experience integrating LLM APIs (OpenAI, Gemini, Claude, etc.) into backend services
  • Knowledge of vector databases and semantic search technologies
  • Familiarity with AI agent orchestration frameworks (e.g., LangGraph )
  • Understanding of RAG systems and how to implement them effectively
  • Experience developing streaming responses using WebSockets or server-sent events
  • Working knowledge of prompt templating and management systems
  • Nice to Have :

  • Experience in fine-tuning LLMs and managing model deployment pipelines
  • Knowledge of self-hosted LLM environments and infrastructure management
  • Exposure to observability tools like LangSmith or custom monitoring setups
  • Familiarity with natural language to SQL systems or BI applications powered by LLMs
  • Note : If you are matching on to the above job description & skills, please feel free to fill in your details on the below Form enclosed (https : / / forms.gle / bUyXMBhgSxxBZVeK9).

    Create a job alert for this search

    Java Developer • vadodara, gujarat, in