Talent.com
LLM Integration Engineer

LLM Integration Engineer

Trilyon, Inc.Bengaluru, Republic Of India, IN
11 hours ago
Job description

We are currently seeking an Generative AI Engineer (LLM Integration experience is a must) for our client,

Location : Hybrid – Cessna Business Park, Bangalore

Role : Generative AI Engineer

Type : Ongoing Contract (Long Term )

Role Responsibilities

  • Design, build, and maintain generative AI workflows and intelligent agent systems using Python
  • Develop and deploy containerized microservices on cloud platforms ( AWS, GCP, Azure )
  • Integrate with LLMs via APIs (e.G., OpenAI, Claude, Gemini) and implement prompt engineering best practices
  • Build agent orchestration tools using LangChain, ReAct, CrewAI , or similar
  • Manage data through vector databases (e.G., ChromaDB, Pinecone) and support RAG pipelines
  • Implement API proxies, session handling, and secure authentication (JWT)
  • Set up observability tools ( logging, tracing, monitoring ) for AI agents
  • Collaborate across distributed teams and document architecture decisions
  • Rapidly prototype and iterate using metrics, logs, and feedback
  • Apply security best practices to LLM integrations

Required Skills

  • 3–5+ years of experience with Python , including async and modular design
  • Strong hands-on experience with Docker / Podman and cloud deployment
  • Familiar with FastAPI , REST, WebSocket APIs
  • Experience with LLM agent frameworks like LangChain, AutoGen, or OpenAgents
  • Understanding of prompt / response logging , token usage , and cost tracking
  • Proficient in Git and CI / CD pipelines
  • Strong written communication;
  • comfortable in remote / distributed teams

    Nice-to-Have

  • Familiarity with OpenTelemetry , LangSmith , or LLM evaluation tools
  • Understanding of GenAI security practices
  • Experience integrating enterprise systems or external APIs
  • Background in NLP , ML , or cognitive architectures
  • Create a job alert for this search

    Integration Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    • Promoted
    • New!
    HCM Integration and Reporting Engineer

    HCM Integration and Reporting Engineer

    Tata Consultancy ServicesBengaluru, Republic Of India, IN
    Greetings from Tata Consultancy Services !!!.Hiring For : Oracle HCM - Technical.Mode Of Interview : Virtual Interview.Design, develop, and support HCM Extracts, HDL, Fast Formulas, OTBI, BI Publishe...Show moreLast updated: 5 hours ago
    • Promoted
    MLOps & AI Infrastructure Engineer – Scalable LLM Deployment (Telecom)

    MLOps & AI Infrastructure Engineer – Scalable LLM Deployment (Telecom)

    MobileumBengaluru, Karnataka, India
    Mobileum is a leading provider of Telecom analytics solutions for roaming, core network, security, risk management, domestic and international connectivity testing, and customer intelligence.More t...Show moreLast updated: 11 days ago
    • Promoted
    RTL Design Lead – SoC Integration (HBM / PCIe Gen6)

    RTL Design Lead – SoC Integration (HBM / PCIe Gen6)

    eInfochips (An Arrow Company)Bangalore, IN
    Job Title : RTL Design Lead – SoC Integration (HBM / PCIe Gen6).Bangalore, Hyderabad, Chennai, Pune, Noida, Ahmedabad, Indore. The ideal candidate will be responsible for leading RTL design, driving ...Show moreLast updated: 8 days ago
    • Promoted
    Optimization and ML Modelling Engineer

    Optimization and ML Modelling Engineer

    Sustainability Economics.aiBengaluru, Karnataka, India
    AI, enabling profitable energy transitions while powering end-to-end AI infrastructure.By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems t...Show moreLast updated: 9 days ago
    • Promoted
    GenAI / LLM Engineer – Domain-Specific AI Solutions (Telecom)

    GenAI / LLM Engineer – Domain-Specific AI Solutions (Telecom)

    MobileumBengaluru, Karnataka, India
    Mobileum is a leading provider of Telecom analytics solutions for roaming, core network, security, risk management, domestic and international connectivity testing, and customer intelligence.More t...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Generative AI Engineer (LLM Integration)- CONTRACT

    Generative AI Engineer (LLM Integration)- CONTRACT

    Trilyon, Inc.Greater Bengaluru Area, India
    AI Engineer (LLM Integration experience is a must).Location : Hybrid – Cessna Business Park, Bangalore.Type : Ongoing Contract (Long Term ). Design, build, and maintain generative AI workflows and int...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    MLFlow / MLops Engineer

    MLFlow / MLops Engineer

    People Prime WorldwideBengaluru, India
    JD : SRE ML Ops - Predominantly development exp, some experience of devops.SRE ML Ops Role – Primarily development-focused with exposure to DevOps practices. Involves managing ML pipelines using fram...Show moreLast updated: 3 hours ago
    • Promoted
    Mlops Engineer

    Mlops Engineer

    CapgeminiBengaluru, Republic Of India, IN
    Experience in developing MLOps framework cutting ML lifecycle : model development, training, evaluation, deployment, monitoring including Model Governance. Expert in Azure Databricks, Azure ML, Unity...Show moreLast updated: 15 days ago
    • Promoted
    Integration Engineer

    Integration Engineer

    BrightEdgeBengaluru, IN
    Integration Engineer – Brightedge.Please note - Candidates with Service / Consulting organization background OR not willing to work in EST / PST timezone OR Focused on Dell Boomi / Mulesoft Integra...Show moreLast updated: 30+ days ago
    • Promoted
    Control-M Integration Support

    Control-M Integration Support

    Neurones IT AsiaBengaluru, Karnataka, India
    We are hiring L1 Integration Support for remote full-time positions! Responsibilities Alert Monitoring and Event Monitoring. Alert to ticket creating and ticket dispatching (management); Respons...Show moreLast updated: 30+ days ago
    • Promoted
    Integration Engineer

    Integration Engineer

    ConfidentialBengaluru / Bangalore, India
    Provide consultative Business and System Integration services to help clients implement effective solutions.Understand and translate customer needs into business and technology solutions.Drive disc...Show moreLast updated: 30+ days ago
    • Promoted
    Genai / Llm Engineer – Domain-Specific Ai Solutions (Telecom)

    Genai / Llm Engineer – Domain-Specific Ai Solutions (Telecom)

    MobileumBengaluru, Republic Of India, IN
    Mobileum is a leading provider of Telecom analytics solutions for roaming, core network, security, risk management, domestic and international connectivity testing, and customer intelligence.More t...Show moreLast updated: 30+ days ago
    LLM Engineer

    LLM Engineer

    ScaleneWorksBengaluru, Karnataka, India
    Quick Apply
    Support the fine-tuning, testing, and deployment of LLMs (e.GPT, BERT) for specific use cases.Provide expertise on cloud-based AI platforms, including. Offer guidance on prompt engineering and optim...Show moreLast updated: 30+ days ago
    • Promoted
    Senior ML Engineer

    Senior ML Engineer

    TorinitBangalore, IN
    Canadian-based digital consulting company.At Torinit, we don't just serve our clients; we work with them to create transformative digital journeys by leveraging the latest technologies and world-cl...Show moreLast updated: 1 day ago
    • Promoted
    Integration Engineer - Middleware

    Integration Engineer - Middleware

    ConfidentialBengaluru / Bangalore, India
    We are seeking a highly skilled Integration Engineer to design, develop, and maintain integration layers between applications, systems, and services. This role focuses on building robust middleware ...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    LLM Systems Architect

    LLM Systems Architect

    TestZeusBengaluru, Republic Of India, IN
    TestZeus is pioneering the next generation of AI-powered software testing.We’re the team behind Hercules, the world’s first open-source testing agent. By combining large language models, multi-agent...Show moreLast updated: 11 hours ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    CapgeminiBengaluru, Karnataka, India
    Experience in developing MLOps framework cutting ML lifecycle : model development, training, evaluation, deployment, monitoring including Model Governance. Expert in Azure Databricks, Azure ML, Unity...Show moreLast updated: 16 days ago
    • Promoted
    LLM Engineer

    LLM Engineer

    ConfidentialBengaluru / Bangalore
    Design and implement LLM-based features across Qure's products, including clinician-facing assistants and automated diagnostic flows. Build internal tools, APIs, and developer-facing utilities to en...Show moreLast updated: 30+ days ago