AU Small Finance Bank - AI Engineer - LLM/RAG

We are seeking an AI Engineer to design, develop, test, and optimize enterprise-grade conversational AI and Agentic AI solutions for banking use cases. The role involves working on LLM-powered chatbots, AI copilots, RAG systems, prompt engineering, conversation design, and multi-agent workflows.

The candidate will collaborate with business, engineering, product, and governance teams to deliver scalable AI systems that enhance customer experience, employee productivity, and operational efficiency.

This role is suitable for professionals with capabilities across conversational AI, prompt engineering, chatbot development, AI workflow orchestration, and AI evaluation.

Key Responsibilities :

1. Conversational AI Development :

- Build and enhance AI-powered chatbots and virtual assistants

- Develop customer-facing and employee-facing conversational AI systems

- Design contextual and personalized conversational experiences

- Improve chatbot accuracy, intent handling, and response quality

2. Agentic AI & LLM Engineering :

- Develop AI agents capable of reasoning, planning, and tool usage

- Build multi-step AI workflows and autonomous task execution systems

- Implement memory-enabled AI interactions

- Integrate external tools, APIs, and enterprise systems into AI workflows

3. Prompt Engineering & Conversation Design :

- Design and optimize prompts for banking use cases

- Create structured conversational flows and dialogue logic

- Tune prompts for accuracy, safety, and business alignment

- Improve AI behavior through prompt experimentation and testing

4. RAG & Knowledge Systems :

- Build Retrieval-Augmented Generation (RAG) pipelines

- Integrate enterprise knowledge bases and document repositories

- Improve retrieval quality and grounding mechanisms

- Work with vector databases and semantic search systems

5. AI Evaluation & Quality Assurance :

- Conduct AI testing, benchmarking, and regression validation

- Measure hallucination, factuality, latency, and response quality

- Create evaluation datasets and testing frameworks

- Ensure compliance with banking and governance standards

Banking Use Cases :

- Contribute to AI solutions such as : customer service chatbots, banking assistant copilots, loan servicing assistants, collections support bots, employee knowledge assistants, process automation assistants, and policy and FAQ assistants.

Collaboration & Delivery :

- Work closely with product managers, architects, and business teams

- Participate in agile delivery processes

- Contribute to reusable AI frameworks and accelerators

- Support deployment and production monitoring activities

Required Technical Skills :

Understanding of : Large Language Models (LLMs), Conversational AI systems, Prompt engineering, RAG architectures, Agentic AI workflows, and Semantic search and vector databases.

Hands-on experience with : OpenAI / Claude / Gemini APIs, LangChain / LangGraph / CrewAI, Python programming, REST APIs, FastAPI or backend integrations, and Git and CI/CD basics.

Preferred Skills :

- AI evaluation and observability tools

- Knowledge of chatbot analytics

- Experience with enterprise AI deployments

- Understanding of banking workflows and terminology

- Exposure to MCP/tool-calling frameworks

Educational Qualifications : BS or MS in Computer Science, Artificial Intelligence, Data Science, IT.

Experience Range :

- 3 to 5 years overall experience.

- Experience in GenAI, NLP, chatbot, or conversational AI projects preferred

- BFSI/Banking domain exposure preferred

Behavioral Competencies :

- Problem-solving mindset

- Strong communication skills

- Curiosity for emerging AI technologies

- Collaboration and teamwork

- Innovation-oriented thinking

- Ability to work in fast-paced AI environments

Success Metrics :

- Chatbot accuracy and containment improvement

- AI workflow efficiency gains

- Reduced hallucination and escalation rates

- Faster delivery of AI use cases

- User adoption and satisfaction

- Production stability and reliability

Tools & Technologies (Indicative) :

- OpenAI / Claude / Gemini

- LangGraph / CrewAI / LangChain

- Pinecone / Weaviate / FAISS

- Python / FastAPI

- Azure AI / AWS AI services

- Jira / GitHub / MLflow

(ref:hirist.tech)