LLM Engineer

Company : Sparrow Risk Management Pvt Ltd

Location : Gurgaon, Haryana (On-site)

Experience : 1 - 3 Years

About Sparrow Risk Management

Sparrow is an AI First technology-based, knowledge-driven company building IndustryOS™ - A Universal Manufacturing Operating System Digital Twin Platform providing End to End Value, Strategic Foresight as well as Digital Execution which helps industries optimize their OEE, Operations, Process, & CMMS by providing Digital Twin Solutions with integrated sustainability solutions, making industries safer, faster, and more efficient workplaces.

Role Overview

As one of our AI-focused engineers, you will be at the forefront of building intelligent, LLM-powered applications from the ground up. You will have full ownership of the AI development lifecycle from designing agentic workflows and building RAG pipelines to productionizing robust backend services. This is a high-impact role for a hands-on builder who loves to ship, experiment, and solve complex problems in a fast-paced startup environment.

Key Responsibilities

• Design, build, and iterate LLM-powered workflows (retrieval, routing, tool use, function calling, multi-step agents).
• Implement agentic apps that can plan, call tools / APIs, and maintain state across complex tasks.
• Build and optimize end-to-end RAG pipelines : including data ingestion, chunking, embeddings, indexing, and latency-optimized retrieval.
• Own prompt engineering & evaluation (A / B tests, guardrails, metrics for latency, cost, quality, and safety).
• Productionize models and workflows with robust observability (traces, tokens, failures), cost controls, and fallbacks (e.G., using Langsmith or similar tools).
• Ship backend services and APIs (e.G., Python / FastAPI) that integrate with our data stores and vector DBs.
• Collaborate closely with product and leadership to translate business requirements into reliable, user-facing features.

Must-Have Skills & Qualifications