Talent.com
Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

Grid Dynamicsajit, India
7 days ago
Job description

Role Overview :

We are looking for a skilled Senior Java Backend Engineer to join our team focused on building scalable and high-performance backend systems for Generative AI applications. You’ll play a key role in designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems. This role is ideal for backend developers with a passion for modern AI technologies and distributed systems.

Key Responsibilities :

  • Design, build, and maintain scalable backend services using Java and the Spring Boot framework
  • Develop APIs to enable LLM integration and support AI agent orchestration workflows
  • Architect microservices to power RAG (Retrieval-Augmented Generation) and other LLM-driven systems
  • Optimize performance through efficient caching strategies and vector database interactions
  • Integrate and manage connections with multiple LLM providers (e.g., OpenAI, Gemini, Claude), including rate limiting and failover handling
  • Implement real-time streaming features for conversational AI systems using WebSockets or similar technologies
  • Ensure robust system observability with logging , monitoring , and tracing

Required Skills & Qualifications :

3–7 years total, with a minimum of 1 year working on Generative AI projects

Backend Development :

  • Minimum 3 years of hands-on experience with Java and Spring Boot
  • Strong grasp of RESTful API design principles and microservices architecture
  • Proficiency with core Spring modules : Spring Security , Spring Data JPA , Spring Cloud
  • Experience working with relational and NoSQL databases : PostgreSQL , MongoDB , Redis
  • Familiarity with message brokers such as RabbitMQ or Apache Kafka
  • Expertise in caching mechanisms and system performance tuning
  • Generative AI Integration :

  • Experience integrating LLM APIs (OpenAI, Gemini, Claude, etc.) into backend services
  • Knowledge of vector databases and semantic search technologies
  • Familiarity with AI agent orchestration frameworks (e.g., LangGraph )
  • Understanding of RAG systems and how to implement them effectively
  • Experience developing streaming responses using WebSockets or server-sent events
  • Working knowledge of prompt templating and management systems
  • Nice to Have :

  • Experience in fine-tuning LLMs and managing model deployment pipelines
  • Knowledge of self-hosted LLM environments and infrastructure management
  • Exposure to observability tools like LangSmith or custom monitoring setups
  • Familiarity with natural language to SQL systems or BI applications powered by LLMs
  • Note : If you are matching on to the above job description & skills, please feel free to fill in your details on the below Form enclosed (

    Create a job alert for this search

    Java Developer • ajit, India

    Related jobs
    • Promoted
    Senior / Lead IBM ACE+ JAVA Developer - 6+ Years - Immediate Joiners only

    Senior / Lead IBM ACE+ JAVA Developer - 6+ Years - Immediate Joiners only

    Blue Cloud Softech Solutions Limitedmohali, India
    Simplified Job Description (clean + keyword highlights).Design and build integration flows using.IBM App Connect Enterprise (ACE). Lead or work on migrations from.JCN for complex transformations and...Show moreLast updated: 3 days ago
    • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    Accion Labsajit, India
    Microservices & Microservice Architecture.Design, develop, and maintain scalable Java-based applications using Spring Boot and Microservices architecture. Implement design patterns and best coding p...Show moreLast updated: 3 days ago
    • Promoted
    Workday Integration Developer

    Workday Integration Developer

    GreystarMohali district, India, India
    The Workday Integration Developer is responsible for designing, developing, and maintaining integrations between Workday and other enterprise systems. Connectors, PECI, EIB & Studio.Work collaborati...Show moreLast updated: 30+ days ago
    • Promoted
    Senior & Lead Java Developer

    Senior & Lead Java Developer

    iSteerajit, India
    We are seeking for a Software Developer with 4 to 10 years of hands-on expertise in Java.Spring Boot, along with strong skills in cloud technologies. AWS / Azure) and DevOps practices.Proven track rec...Show moreLast updated: 7 days ago
    • Promoted
    Senior Architect

    Senior Architect

    Studio AARKSAmbala, Haryana, India
    Studio AARKS is an Ambala-based architectural and interior design firm founded in 2018 by Ar.With a focus on creating customized commercial, residential, and retail designs, Studio AARKS strives to...Show moreLast updated: 3 days ago
    • Promoted
    Senior Java Software Engineer

    Senior Java Software Engineer

    Recroajit, India
    VC-backed, cloud-native B2B platform.Highgate Technology Ventures (HTV).Live integrations with Hilton, Highgate, Wyndham — rapidly expanding across the US and Europe. Over the past 18 months, we've....Show moreLast updated: 7 days ago
    • Promoted
    Senior Java Developer

    Senior Java Developer

    Toptalajit, India
    Join Toptal’s Elite Network of Freelance Talent.Toptal is an exclusive network of the world’s top freelance software developers, designers, finance experts, product managers, and project managers.A...Show moreLast updated: 7 days ago
    • Promoted
    AppScan Product _Sr. Java Developer

    AppScan Product _Sr. Java Developer

    HCLSoftwareajit, India
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 7 days ago
    • Promoted
    Java Engineer - 20442

    Java Engineer - 20442

    TuringChandigarh, India, India
    Turing is seeking experienced Java developers to partner with a leading AI research lab in building datasets and evaluation pipelines that improve next-generation AI models.In this role, you’ll del...Show moreLast updated: 13 days ago
    • Promoted
    Senior Integration Developer (Senior Software Engineer)

    Senior Integration Developer (Senior Software Engineer)

    Resourceful Talent Groupajit, India
    We are seeking a highly skilled Senior Integration Developer (Senior Software Engineer) to join our client’s Professional Services Team. In this role, you will design, develop, and implement complex...Show moreLast updated: 4 days ago
    • Promoted
    Sr. Jahia Developer

    Sr. Jahia Developer

    Programmers.ioajit, India
    IO is actively seeking talented individuals who are skilled in Jahia and Java.If you're looking for a flexible work environment that allows you to contribute from anywhere, we want to hear from you...Show moreLast updated: 2 days ago
    • Promoted
    AppScan Product _Sr. Java Developer (Spring Boot, REST APIs & Microservices)

    AppScan Product _Sr. Java Developer (Spring Boot, REST APIs & Microservices)

    HCL AppScanmohali, India
    HCL Software” : - Is a Product Development Division of HCL Tech : That operates its primary Software business.At HCL Software we Develop, Market, Sell and Support over 20 Product families in the area...Show moreLast updated: 7 days ago
    • Promoted
    Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

    Sr. Java Developer with GenAI Integration (Java, LLM, RAG) - Immediate Joiners

    Grid Dynamicsmohali, India
    You’ll play a key role in designing APIs, orchestrating AI agents, and integrating Large Language Models (LLMs) into production-ready systems. This role is ideal for backend developers with a passio...Show moreLast updated: 7 days ago
    • Promoted
    Sr Java Developer with AWS and Kafka

    Sr Java Developer with AWS and Kafka

    iPivotmohali, India
    We are looking for a highly experienced.The ideal candidate will play a key role in designing, developing, and implementing scalable and high-performing backend systems. Design, develop, and maintai...Show moreLast updated: 4 days ago
    • Promoted
    Senior Java Engineer – Model Inference Platform (Microservices / ML / Seldon) Hiring For Pan India

    Senior Java Engineer – Model Inference Platform (Microservices / ML / Seldon) Hiring For Pan India

    Tata Consultancy Servicesmohali, India
    Design, build, and optimize high-performance microservices using Java 17+, Spring Boot, and reactive frameworks.Develop and maintain APIs for model registration, inference request routing, and mode...Show moreLast updated: 7 days ago
    • Promoted
    Full Stack Java Sr. Developer

    Full Stack Java Sr. Developer

    Matrix USAmohali, India
    We are looking for a highly skilled Full Stack Java Sr.Developer to join our team and contribute to various projects.The ideal candidate will have extensive experience in designing and developing w...Show moreLast updated: 7 days ago
    • Promoted
    Full Stack Trainer

    Full Stack Trainer

    Chitkara UniversityRajpura, Punjab, India
    We are seeking an experienced and passionate React / React.Development Trainers to join our team on a Full-time basis.As a trainer, you will be responsible for delivering engaging and informative tra...Show moreLast updated: 30+ days ago
    • Promoted
    Sr. Java Developer

    Sr. Java Developer

    ConfidentialMohali
    Core Advanced Java (Threading, Design Patterns, Data Structures).Excellent knowledge of Enterprise Design Patterns.Full stack development with Angular 8 experience will be a plus.Experience with te...Show moreLast updated: 30+ days ago