Talent.com
Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Grid Dynamicsvijayawada, India
8 days ago
Job description

Role Overview :

We are looking for a skilled Senior Java Backend Engineer to join our team focused on building scalable and high-performance backend systems for Generative AI applications. You’ll play a key role in designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems. This role is ideal for backend developers with a passion for modern AI technologies and distributed systems.

Key Responsibilities :

  • Design, build, and maintain scalable backend services using Java and the Spring Boot framework
  • Develop APIs to enable LLM integration and support AI agent orchestration workflows
  • Architect microservices to power RAG (Retrieval-Augmented Generation) and other LLM-driven systems
  • Optimize performance through efficient caching strategies and vector database interactions
  • Integrate and manage connections with multiple LLM providers (e.g., OpenAI, Gemini, Claude), including rate limiting and failover handling
  • Implement real-time streaming features for conversational AI systems using WebSockets or similar technologies
  • Ensure robust system observability with logging , monitoring , and tracing

Required Skills & Qualifications :

3–7 years total, with a minimum of 1 year working on Generative AI projects

Backend Development :

  • Minimum 3 years of hands-on experience with Java and Spring Boot
  • Strong grasp of RESTful API design principles and microservices architecture
  • Proficiency with core Spring modules : Spring Security , Spring Data JPA , Spring Cloud
  • Experience working with relational and NoSQL databases : PostgreSQL , MongoDB , Redis
  • Familiarity with message brokers such as RabbitMQ or Apache Kafka
  • Expertise in caching mechanisms and system performance tuning
  • Generative AI Integration :

  • Experience integrating LLM APIs (OpenAI, Gemini, Claude, etc.) into backend services
  • Knowledge of vector databases and semantic search technologies
  • Familiarity with AI agent orchestration frameworks (e.g., LangGraph )
  • Understanding of RAG systems and how to implement them effectively
  • Experience developing streaming responses using WebSockets or server-sent events
  • Working knowledge of prompt templating and management systems
  • Nice to Have :

  • Experience in fine-tuning LLMs and managing model deployment pipelines
  • Knowledge of self-hosted LLM environments and infrastructure management
  • Exposure to observability tools like LangSmith or custom monitoring setups
  • Familiarity with natural language to SQL systems or BI applications powered by LLMs
  • Note : If you are matching on to the above job description & skills, please feel free to fill in your details on the below Form enclosed (

    Create a job alert for this search

    Java Developer • vijayawada, India

    Related jobs
    • Promoted
    Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

    Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

    Grid Dynamicseluru, India
    You’ll play a key role in designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems. This role is ideal for backend developers with a passio...Show moreLast updated: 8 days ago
    • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    RecroVijayawada, IN
    VC-backed, cloud-native B2B platform.Highgate Technology Ventures (HTV).Live integrations with Hilton, Highgate, Wyndham — rapidly expanding across the US and Europe. Over the past 18 months, we've....Show moreLast updated: 29 days ago
    • Promoted
    Integration Developer

    Integration Developer

    Vriba SolutionsGuntur, IN
    PM IST to 3 : 30 AM IST (US Shift).Immediate joiners preferred (15–30 days max).We are looking for an experienced.Integration Developer (5–10 years). The role requires working closely with cross-funct...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    Curately AI, IncVijayawada, IN
    We are looking for a talented Java Developer to join our dynamic team.The ideal candidate will have extensive experience in Java development and will be proficient in AWS services, Elasticsearch, a...Show moreLast updated: 3 days ago
    • Promoted
    AppScan Product _Sr. Java Developer

    AppScan Product _Sr. Java Developer

    HCLSoftwareEluru, IN
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 29 days ago
    • Promoted
    Senior Integration Developer (Senior Software Engineer)

    Senior Integration Developer (Senior Software Engineer)

    Resourceful Talent GroupEluru, IN
    We are seeking a highly skilled Senior Integration Developer (Senior Software Engineer) to join our client’s Professional Services Team. In this role, you will design, develop, and implement complex...Show moreLast updated: 6 days ago
    • Promoted
    Cloud-Native Developer- Java

    Cloud-Native Developer- Java

    RapidBrainsGuntur, IN
    Senior Cloud-Native Java Engineer.In this role, you will design and deliver.AWS Lambda, Azure Functions, or Google Cloud Functions. Build solutions integrating with cloud services such as.API Gatewa...Show moreLast updated: 15 days ago
    • Promoted
    Senior / Lead IBM ACE+ JAVA Developer - 6+ Years - Immediate Joiners only

    Senior / Lead IBM ACE+ JAVA Developer - 6+ Years - Immediate Joiners only

    Blue Cloud Softech Solutions LimitedVijayawada, IN
    Simplified Job Description (clean + keyword highlights).Design and build integration flows using.IBM App Connect Enterprise (ACE). Lead or work on migrations from.JCN for complex transformations and...Show moreLast updated: 5 days ago
    • Promoted
    AppScan Product _Sr. Java Developer (Spring Boot, REST APIs & Microservices)

    AppScan Product _Sr. Java Developer (Spring Boot, REST APIs & Microservices)

    HCL AppScanVijayawada, IN
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Java Engineer – Model Inference Platform (Microservices / ML / Seldon) Hiring For Pan India

    Senior Java Engineer – Model Inference Platform (Microservices / ML / Seldon) Hiring For Pan India

    Tata Consultancy Servicesvijayawada, India
    Design, build, and optimize high-performance microservices using Java 17+, Spring Boot, and reactive frameworks.Develop and maintain APIs for model registration, inference request routing, and mode...Show moreLast updated: 8 days ago
    • Promoted
    TCS Walkin Drive For Java Spring boot Microservices

    TCS Walkin Drive For Java Spring boot Microservices

    Tata Consultancy ServicesEluru, IN
    TCS Walkin Drive_Java Spring boot_(Chennai).TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can st...Show moreLast updated: 15 days ago
    • Promoted
    Full Stack Java Sr. Developer

    Full Stack Java Sr. Developer

    Matrix USAGuntur, IN
    We are looking for a highly skilled Full Stack Java Sr.Developer to join our team and contribute to various projects.The ideal candidate will have extensive experience in designing and developing w...Show moreLast updated: 14 days ago
    • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    Accion Labsvijayawada, India
    Microservices & Microservice Architecture.Design, develop, and maintain scalable Java-based applications using Spring Boot and Microservices architecture. Implement design patterns and best coding p...Show moreLast updated: 4 days ago
    • Promoted
    Senior Java Backend Engineer

    Senior Java Backend Engineer

    Rrootshell Technologiiss Pvt LtdEluru, IN
    Rrootshell Technologiiss Pvt Ltd.This is for FULL -TIME role and Work From Home Opportunity.Hiring : Senior Software Backend Engineer (Java). Role : Senior Software Backend Engineer (Java).Hands-on Ja...Show moreLast updated: 5 days ago
    • Promoted
    Senior Java Developer

    Senior Java Developer

    ToptalEluru, IN
    Join Toptal’s Elite Network of Freelance Talent.Toptal is an exclusive network of the world’s top freelance software developers, designers, finance experts, product managers, and project managers.A...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Backend Developer (Remote)

    Senior Backend Developer (Remote)

    StealthGuntur, IN
    Remote
    Fintech Unicorn seeking backend engineers who love building systems that millions trust with their money.Your code directly affects millions of users' financial lives - from seamless payments to sm...Show moreLast updated: 30+ days ago
    • Promoted
    Java Application Developer

    Java Application Developer

    KPG99 INCGuntur, IN
    Strong knowledge of SQL and experience working with large data volumes and query optimization.Good understanding of agile development methodologies. Additional experience in following areas would be...Show moreLast updated: 1 day ago
    • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    ACL DigitalVijayawada, IN
    We are looking Remotly for Senior Java Developer for our offiice.Designation : Senior Java Developer.Experience : 5 Years to 8 Years. Notice Period : Immediate(Next Day joiner only).Design, implement, ...Show moreLast updated: 23 days ago