AI Engineer-LLM Integration / Platform Observability

Exp 4+ Years

Shift 2.00 PM to 11 : 30 PM IST

Mandatory Python with LLM Ops

Job Description

We are looking for a hands-on AI Engineer with strong expertise in LLM integration, platform observability, performance optimization, and API development . The ideal candidate will work on critical platform enhancements, including LLM API integrations, observability pipelines, structured search algorithms, and performance scaling for customer&aposs AI platform and related components.

You will collaborate with cross-functional teams to develop robust, scalable solutions, modernize our logging and monitoring infrastructure, and integrate advanced AI capabilities into production workflows.

Key Responsibilities :

1. LLM Integration & API Development

• Develop and maintain LLM API integration test cases for core model availability.
• Refactor and reorganize LLM API code (e.g., __init__.py) for better maintainability.
• Add support for Vertex AI batch generation and batch transcription processing.
• Implement multi-step structured search algorithms and tie model IDs to relevant endpoints.
• Explore and integrate emerging technologies like LightRAG, SurrealDB, Neo4j, and Puppygraph for structured search.

2. Platform Observability & Performance

3. Platform Integration & Testing

4. Architecture & Research Spikes

Required Skills & Experience :

Preferred Qualifications :

Show more

Show less

Skills Required

Github, Jira, Gcp, Confluence, Neo4j, Splunk, Postman, Azure, Python, Aws, Pytest