Talent.com
LLM Application Engineer
LLM Application EngineerTrilyon, Inc. • Bengaluru, Republic Of India, IN
LLM Application Engineer

LLM Application Engineer

Trilyon, Inc. • Bengaluru, Republic Of India, IN
10 hours ago
Job description

We are looking for a talented AI Engineer to join our client

Location : Hybrid – Bangalore, Cessna Business Park

Type : Ongoing Contract – Long Term

Role Responsibilities :

  • Design, build, and maintain generative AI workflows and agent systems using Python
  • Develop and deploy containerized microservices on cloud platforms (AWS, GCP, Azure)
  • Integrate with LLMs via APIs (OpenAI, Claude, Gemini) and implement prompt engineering best practices
  • Build and support agent orchestration tools (LangChain, ReAct, CrewAI, or similar)
  • Manage data flow through vector stores (ChromaDB, Pinecone) and support RAG pipelines
  • Implement and manage API proxies, session handling, and authentication (JWT)
  • Set up observability tools (logging, tracing, monitoring) for AI workflows and agents
  • Collaborate asynchronously with cross-functional teams and document architecture decisions
  • Prototype quickly and iterate using metrics, logs, and user feedback
  • Apply security best practices to LLM integration

Required Skills & Experience :

  • 3–5+ years of Python development, including async and modular design patterns
  • Hands-on experience with container tools (Docker / Podman) and cloud deployments
  • Familiarity with API design, FastAPI, REST, and WebSocket integration
  • Experience with at least one LLM orchestration / agent framework (LangChain, AutoGen, OpenAgents)
  • Strong understanding of prompt / response logging, token usage, and cost tracking
  • Proficiency with version control (Git) and CI / CD workflows
  • Excellent written communication and comfort working in distributed teams
  • Nice-to-Have :

  • Experience with OpenTelemetry, LangSmith, or LLM eval frameworks
  • Familiarity with security concerns in GenAI environments
  • Prior work integrating enterprise systems or external APIs
  • Background in NLP, ML, or cognitive architectures
  • If you are passionate about AI, LLMs, and building next-gen intelligent systems , this is an exciting opportunity!

    Create a job alert for this search

    Application Engineer • Bengaluru, Republic Of India, IN

    Related jobs
    RTL Design Engineer

    RTL Design Engineer

    L&T Semiconductor Technologies • Bengaluru, Karnataka, India
    Digital Design Engineer for analog mixed signal IP / IC.Direct responsible individual for architecting the optimized digital solution for complex mixed signal IP / IC. End to end responsible for archite...Show more
    Last updated: 1 day ago • Promoted
    Application Engineer

    Application Engineer

    London Stock Exchange Group • Bangalore, India
    Application Engineer- Customer Lifecycle Engineering, CMR ABOUT US : LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business.We are de...Show more
    Last updated: 12 days ago • Promoted
    Applied AI / ML Systems Engineer

    Applied AI / ML Systems Engineer

    Peko • Bengaluru, Republic Of India, IN
    Peko is building intelligent, scalable, and secure technology solutions that empower small and medium businesses across India. We are expanding our AI capabilities to enhance product intelligence, a...Show more
    Last updated: 18 hours ago • Promoted • New!
    Manhattan WMS / TLM Application Support Analyst

    Manhattan WMS / TLM Application Support Analyst

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Desired Experience Range : 6 - 8 years.Desired Competencies (Technical / Behavioral Competency).Basic knowledge of Shell Script and good knowledge of. This role is for supporting all Manhattan applicat...Show more
    Last updated: 15 days ago • Promoted
    Senior Mlops Engineer - Bangalore

    Senior Mlops Engineer - Bangalore

    Concentrix • Bengaluru, Republic Of India, IN
    This role is responsible for customizing and validating the various components.Configures and customizes core Kubeflow components for the specific needs of the projects. Validation installation with...Show more
    Last updated: 20 days ago • Promoted
    Application Development Engineer (Ade) - Ml

    Application Development Engineer (Ade) - Ml

    Arista Networks • Bengaluru, Republic Of India, IN
    Arista Networks is looking for a Software Developer to build and implement software tools and Machine Learning models.The ADE will work with other Developers throughout the software development lif...Show more
    Last updated: 30+ days ago • Promoted
    Legacy Systems Application Engineer

    Legacy Systems Application Engineer

    Innova ESI • Bengaluru, Republic Of India, IN
    Show more
    Last updated: 10 hours ago • Promoted • New!
    MLOps & LLMOps Engineer

    MLOps & LLMOps Engineer

    Catalyst IQ • Bangalore
    We are looking for a highly skilled MLOps & LLM Ops Engineer with strong expertise in deploying, automating, and monitoring AI / ML models - including Large Language Models (LLMs) - in production...Show more
    Last updated: 12 days ago • Promoted
    Senior ML Engineer

    Senior ML Engineer

    Piramal Finance • hosur, tamil nadu, in
    Build and operate end-to-end ML / AI pipelines (data → training → deployment → monitoring).Automate CI / CD for ML / AI with Jenkins, integrate MLflow for tracking and registry.Deploy scalable batch and ...Show more
    Last updated: 20 days ago • Promoted
    Mlops Engineer

    Mlops Engineer

    Capgemini • Bengaluru, Republic Of India, IN
    Experience in developing MLOps framework cutting ML lifecycle : model development, training, evaluation, deployment, monitoring including Model Governance. Expert in Azure Databricks, Azure ML, Unity...Show more
    Last updated: 18 days ago • Promoted
    Implementation Engineer

    Implementation Engineer

    Tuebora Inc • Bengaluru, Karnataka, India
    Implementation Engineer Job Description Position Overview : The Implementation engineer role is customer facing and the prospective hire will be working with the customers in understanding their IAM...Show more
    Last updated: 30+ days ago • Promoted
    Lead Mlops Engineer

    Lead Mlops Engineer

    MathCo • Bengaluru, Republic Of India, IN
    As a Lead MLOps Engineer, you will play a pivotal role in building scalable and reliable machine learning infrastructure for enterprise-grade applications. We are looking for a Lead Data Engineer wi...Show more
    Last updated: 30+ days ago • Promoted
    LLM Trainer

    LLM Trainer

    Avance Consulting • hosur, tamil nadu, in
    Duration of contract : 1 month.Full Time Availability (8 Hrs) and 4 hours overlap with PST time zone.Any programming skills(Python OR JavaScript OR Java OR C++ OR C#). We are developing a computer u...Show more
    Last updated: 1 day ago • Promoted
    Full Stack LLM Engineer

    Full Stack LLM Engineer

    Cerebras • Bengaluru, Karnataka, India
    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programm...Show more
    Last updated: 19 days ago • Promoted
    Inference Optimization Engineer(LLM and Runtime)

    Inference Optimization Engineer(LLM and Runtime)

    Sustainability Economics.ai • Bangalore, Bangalore (district)
    AI, enabling profitable energy transitions while powering end-to-end AI infrastructure.By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems t...Show more
    Last updated: 3 days ago • Promoted
    Optimization and ML Modelling Engineer

    Optimization and ML Modelling Engineer

    Sustainability Economics.ai • Bengaluru, Karnataka, India
    AI, enabling profitable energy transitions while powering end-to-end AI infrastructure.By integrating AI-driven cloud solutions with sustainable energy, we create scalable, intelligent ecosystems t...Show more
    Last updated: 12 days ago • Promoted
    Senior MLOps Engineer - Bangalore

    Senior MLOps Engineer - Bangalore

    Concentrix • Bengaluru, Karnataka, India
    This role is responsible for customizing and validating the various components.Configures and customizes core Kubeflow components for the specific needs of the projects. Validation installation with...Show more
    Last updated: 21 days ago • Promoted
    Application Engineer

    Application Engineer

    Watlow • Bengaluru, Karnataka, India
    Watlow is a global technology and manufacturing leader who provides world class engineering expertise through innovative thermal products and systems, enabling our customers to thrive.We are making...Show more
    Last updated: 30+ days ago • Promoted