AI / ML Engineer – Open Source LLM Product Development 3 yearsExperience

Job Title : AI / ML Engineer (Open-Source LLM – BFSI Domain)

Location : Marathahalli, Bangalore

Work Schedule : Monday to Saturday (Alternate Saturdays Off), 10 : 30 AM – 7 : 30 PM

Role Overview

We are seeking a skilled AI / ML Engineer to design, develop, and deploy open-source Large Language Models (LLMs) specifically tailored to the Banking, Financial Services, and Insurance (BFSI) sector. This is a hands-on engineering role where you'll collaborate with cross-functional teams to create cutting-edge AI solutions that improve customer interaction, operational efficiency, and data-driven decision-making.

Key Responsibilities

Develop and implement open-source LLMs for BFSI applications.

Collaborate with product managers , data scientists , and software engineers to define use cases and deliver high-quality solutions.

Conduct experiments and optimization of models using real-world datasets.

Monitor LLM performance in production environments and refine models based on usage data and feedback.

Ensure adherence to security , compliance , and scalability standards.

Stay current with advancements in the AI / ML field and contribute to incorporating best practices.

Create and maintain detailed documentation of models, workflows, and methodologies.

Requirements

Bachelor’s degree (or equivalent experience) in Computer Science, Engineering, or a related technical field.

Minimum 2 years of hands-on AI / ML development experience, preferably in the BFSI industry.

Must have built and deployed AI / ML solutions to production .

Strong programming skills in Python or Java .

Proficient with open-source ML frameworks such as TensorFlow or PyTorch .

Industry experience with open-source LLM ecosystems , e.g., LangChain , Ollama , etc.

Solid understanding of machine learning algorithms , data structures , and statistical methods .

Experience in data preprocessing , feature engineering , and model evaluation .

Strong analytical thinking and problem-solving skills .

Excellent communication skills to explain complex technical solutions to non-technical stakeholders.

Coding skills will be tested in interviews — use of AI agents or search engines during interviews is not allowed.

Interview Process

Technical Interview – Conducted by a Senior AI Engineer

Technical / Product Interview – Conducted by a Senior Product & Tech Lead

HR & Soft Skills Round