Talent.com
AI Engineer (RAG-based Chatbot)
AI Engineer (RAG-based Chatbot)Workfall • Bengaluru, Karnataka, India
AI Engineer (RAG-based Chatbot)

AI Engineer (RAG-based Chatbot)

Workfall • Bengaluru, Karnataka, India
21 hours ago
Job description

We are looking for an experienced AI / LLM Engineer to design, build, and maintain intelligent applications powered by Large Language Models (LLMs), embeddings, similarity search, and vector databases . The ideal candidate will work on building real-time AI systems such as chatbots, semantic search, recommendation systems, document intelligence, and autonomous AI workflows.

You will be responsible for the end-to-end lifecycle of AI pipelines that include data ingestion, embedding generation, vector storage, retrieval, and LLM-based response generation or automated actions.

Experience : 5–7 Years

Location : Bangalore

Employment Type : Full-Time

Key Responsibilities

  • Design and implement embedding pipelines for text, documents, images, or structured data.
  • Build and optimize semantic search and similarity search systems using vector databases.
  • Integrate and manage vector databases such as :
  • Pinecone, Weaviate, Milvus, FAISS, Chroma, OpenSearch Vector Engine, etc.
  • Develop LLM-powered applications for :
  • Chatbots
  • Q&A systems
  • Recommendation engines
  • AI agents and automation workflows
  • Implement RAG (Retrieval Augmented Generation) pipelines.
  • Fine-tune prompt strategies and system prompts for optimal LLM performance.
  • Integrate LLMs such as :
  • OpenAI, Azure OpenAI, Anthropic, Google Gemini, Meta LLaMA, Mistral, etc.
  • Build APIs and microservices for AI features using :
  • Python / Java / Node.js / Spring Boot / FastAPI
  • Implement similarity scoring, ranking, filtering, and metadata-based retrieval .
  • Monitor, optimize, and scale vector search performance.
  • Handle LLM cost optimization, latency reduction, and caching strategies .
  • Implement AI safety, hallucination reduction, and response validation mechanisms .
  • Work closely with product, frontend, and data teams.
  • Deploy AI workloads on cloud platforms (AWS, Azure, GCP, OCI) .
  • Maintain CI / CD pipelines for AI services.

Required Skills & Qualifications

Mandatory Core AI & LLM Skills

  • Strong understanding of :
  • Embeddings
  • Vector similarity search
  • Cosine similarity, dot product, ANN indexing
  • Hands-on experience with :
  • LangChain / LlamaIndex / Semantic Kernel / Spring AI
  • Experience with RAG architectures
  • Experience with at least one Vector Database
  • Proficient in prompt engineering and LLM orchestration
  • Programming & Backend

  • Strong in Python / Java / JavaScript / TypeScript
  • API development with FastAPI, Flask, Spring Boot, or Node.js
  • Strong understanding of REST APIs, background jobs, async processing
  • Data & Storage

  • Experience with :
  • PostgreSQL, MySQL, MongoDB
  • Object storage (S3, OCI, Azure Blob)
  • Data preprocessing, chunking, tokenization strategies
  • Cloud & DevOps (Good to Have)

  • Docker & Kubernetes
  • CI / CD pipelines (Jenkins, GitHub Actions, GitLab, Bitbucket)
  • Monitoring with Prometheus, Grafana, OpenTelemetry
  • Good to Have (Preferred Skills)

  • Experience with Agentic AI frameworks
  • Knowledge of Tool Calling / Function Calling
  • Experience with Speech-to-Text and Vision models
  • Fine-tuning or LoRA experience
  • Knowledge of security & data privacy for AI systems
  • Experience building autonomous AI workflows
  • Use Cases You Will Work On

  • AI chatbots for customer support
  • Semantic document search
  • Knowledge-base Q&A systems
  • Recommendation engines
  • Automated ticket triaging
  • AI assistants for developers or operations
  • Intelligent workflow automation
  • Create a job alert for this search

    Ai Engineer • Bengaluru, Karnataka, India

    Related jobs
    AI FullStack Engineer

    AI FullStack Engineer

    CirrusLabs • Bengaluru, Karnataka, India
    Java / Python | Microservices | AI Integration | Cloud | Hands-on Coding.We are seeking a highly skilled.The ideal candidate has strong expertise in. AI-integrated products or features.LLM apps, ML-...Show more
    Last updated: 7 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Zensar Technologies • Bengaluru, Karnataka, India
    Experience with Playbooks / DialogFlow and have delivered on Voice / Chat bots that should be fine.We are familiar with MCCS area and know what other skills fit in the e arena.Playbooks OR Dialog Flow ...Show more
    Last updated: 16 days ago • Promoted
    AI Engineer

    AI Engineer

    QX Labs • Bengaluru, Karnataka, India
    QX Labs is looking for a full stack AI engineer with a strong software background to join our expanding team of AI experts. We are an early-stage London-based startup building cutting-edge workflow ...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    TechKareer • Bangalore, IN
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    Founding AI Engineer

    Founding AI Engineer

    Refold AI • Bengaluru, Karnataka, India
    We want AI engineers who ship to prod, not publish to arxiv.If you've built something with LLMs that actually works—not a demo, not a notebook, something real—you'll fit right in.We're looking for ...Show more
    Last updated: 8 days ago • Promoted
    Voice AI Engineer (Building / Optimizing Voice Models)

    Voice AI Engineer (Building / Optimizing Voice Models)

    Client of Prasha Consultancy Services Private Limited • Bangalore, IN
    Immediate or early Joiners preferred.A US Based IT MNC is looking for a seasoned AI Engineer with hands-on experience in building and optimizing voice models, for one its Reputed client in Enterpri...Show more
    Last updated: 5 hours ago • Promoted • New!
    Applied AI Engineer

    Applied AI Engineer

    neuroGrid • Bengaluru, Karnataka, India
    Bengaluru, India (Residency Road, In-Office, Full-Time).Engineering Manager, Bengaluru.Grid is a well-funded startup building a next-generation SaaS platform to accelerate the development of modern...Show more
    Last updated: 30+ days ago • Promoted
    AI Platform Engineer - Agentic AI, Container orchestration (Kubernate, Docker, Terraform) LangGraph

    AI Platform Engineer - Agentic AI, Container orchestration (Kubernate, Docker, Terraform) LangGraph

    Societe Generale Global Solution Centre • Bengaluru, Karnataka, India
    We are looking for an experienced.This role is central to our strategy, focusing on designing, building, and scaling a robust, high-performance platform capable of deploying and managing thousands ...Show more
    Last updated: 21 hours ago • Promoted • New!
    Integration Engineer - AI

    Integration Engineer - AI

    apna • Bengaluru, Karnataka, India
    Integration Engineer (FDE) – Blue Machines.Location : Bangalore (Work From Office).Blue Machines is Apna’s next-generation AI platform powering large-scale voice, chat, and multimodal automations.We...Show more
    Last updated: 23 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    PwC India • Bengaluru, Karnataka, India
    Job Role -Gen AI / Agentic AI Engineers.RAG, embeddings, transformers).LangChain, LlamaIndex, DSPy) and.LangGraph, MCP, A2A, AutoGen, etc. Expertise with vector databases, elastic search, unstructured...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Senior Engineer

    Generative AI Senior Engineer

    ACL Digital • Bengaluru, Karnataka, India
    Senior GEN AI Engineer role for Bangalore Location.Work Experience : 6 Years - 10 Years.Design, develop, and productonize GenAI applications focused towards solving API integration challenges encom...Show more
    Last updated: 17 days ago • Promoted
    Chat and Voice Bot QA Specialist

    Chat and Voice Bot QA Specialist

    Yubi • Bangalore Urban, Karnataka, India
    We are looking for a detail-oriented and analytical Chat and Voice Bot QA Specialist to join our Conversational AI team.In this role, you'll be responsible for evaluating the performance and qualit...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Avensys Consulting UK • Bengaluru, IN
    Rate : 450-500 GBP Per Day – Inside IR35 MAX.The Gen AI Engineer will be a specialized type of artificial intelligence professional, focused on designing, developing & implementing generative AI mod...Show more
    Last updated: 2 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Saarthee • Bengaluru, Karnataka, India
    We are seeking a highly skilled Gen AI Engineer with a strong background in Natural Language Processing (NLP), model fine-tuning, deployment and evaluation. The ideal candidate possess hands on expe...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    MightyBot • Bengaluru, IN
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show more
    Last updated: 30+ days ago • Promoted
    AI Architect

    AI Architect

    KPIT • Bangalore Urban, Karnataka, India
    Notice Period- Immediate joiner.Architecture & design of scalable AI platforms.Expertise in agentic AI frameworks (LangChain, AutoGPT, CrewAI, AWS). Deep understanding of LLMs (GPT, LLaMA, Gemini) a...Show more
    Last updated: 8 days ago • Promoted
    AI Engineer (Conversational Analytics & GenAI Systems)

    AI Engineer (Conversational Analytics & GenAI Systems)

    IRISS, Inc. • Bengaluru, Karnataka, India
    Our commitment to pushing boundaries and delivering exceptional solutions has positioned us as a trusted partner for clients seeking top-tier technical expertise in Condition Based Monitoring.IRISS...Show more
    Last updated: 28 days ago • Promoted
    Forward Deployed Engineer

    Forward Deployed Engineer

    Searchability® • Bengaluru, IN
    Forward Deployed Engineer - AI💻.Remote-based - relocation to Dubai📍.Searchability MENA is working with an innovative AI startup looking for a. This is a rare chance to get involved with a company ...Show more
    Last updated: 17 days ago • Promoted