Talent.com
Senior LLM Engineer

Senior LLM Engineer

RingCentralmangalore, karnataka, in
7 days ago
Job description

Job Description :

We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI. In this role, you will design, develop, and deploy scalable AI solutions leveraging LLMs, Retrieval-Augmented Generation (RAG), and prompt engineering techniques to power intelligent products and services.

As part of our ML / AI team, you’ll own the full lifecycle of model development — from data preparation and fine-tuning to inference optimization and deployment in production environments.

Responsibilities :

  • Design, fine-tune, and deploy LLM-based applications for Conversational AI use cases
  • Build scalable retrieval-augmented generation (RAG) pipelines that combine LLMs with structured / unstructured data sources
  • Develop prompt engineering strategies, templates, and evaluation frameworks for LLM-driven workflows
  • Collaborate with cross-functional teams to identify and implement AI-driven solutions to business problems
  • Optimize models for low-latency inference using quantization, distillation, and other model optimization techniques (e.g., ONNX, TensorRT)
  • Build robust data processing, labeling, and augmentation pipelines to improve model performance
  • Implement monitoring and evaluation systems for deployed LLMs, ensuring reliability, fairness, and safety
  • Stay current with emerging trends in LLMs, retrieval systems, and generative AI frameworks

Requirements :

  • 5-8 years of hands-on experience in NLU
  • Strong proficiency in Python and PyTorch and related frameworks (like Hugging Face Transformers, Sentence Transformers etc.)
  • Proven experience developing and deploying NLP or LLM pipelines in production environments at scale
  • Solid understanding of transformer architectures and attention mechanisms
  • Proficiency in using LLM provider APIs such as OpenAI, Gemini etc.including prompt design, fine-tuning, and evaluation
  • Experience with model optimization techniques such as quantization, pruning, ONNX, TensorRT, or model distillation
  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, or a related field
  • Nice to Have :

  • Hands-on experience with RAG and vector databases (e.g., FAISS, Qdrant, pgVector etc. )
  • Prior work on LLM fine-tuning, alignment, or evaluation
  • Experience with LLM orchestration frameworks such as LlamaIndex or similar tools
  • Familiarity with multi-provider LLM orchestration, integrating APIs from OpenAI, Gemini etc. and others for fallbacks, routing, or ensemble strategies
  • Knowledge of MLOps for LLMs, including model serving and monitoring
  • Understanding of embedding models, context management, and token optimization for scalable LLM applications
  • Create a job alert for this search

    Engineer Llm • mangalore, karnataka, in

    Related jobs
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    LemongrassMangalore, IN
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago
    • Promoted
    Senior / Lead Firmware Design Engineer

    Senior / Lead Firmware Design Engineer

    Aiotlogy Services pvt ltd.Mangalore, IN
    Job Title : Senior / Lead Firmware Design Engineer.We are seeking a highly skilled and motivated Senior / Lead Firmware Design Engineer to join our dynamic team. This is an excellent opportunity for expe...Show moreLast updated: 7 days ago
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Mitchell Martin Inc.Mangalore, IN
    Include, but are not limited to, the following : .Own productionizing models—from tracked experiments to governed releases—ensuring resilient services with clear SLOs, runbooks, and fast, safe rollba...Show moreLast updated: 30+ days ago
    • Promoted
    Senior CV / LLM Engineer

    Senior CV / LLM Engineer

    doAZMangalore, IN
    Doaz is a hyper-growth startup on a mission to turn fragmented industrial knowledge into instant, actionable insight.We build LLM- and Vision-AI solutions for construction, heavy industry, and fina...Show moreLast updated: 6 days ago
    • Promoted
    MLOps Lead Engineer

    MLOps Lead Engineer

    RecroMangalore, IN
    Experience with Azure services such as Azure AI services, Azure Search, Azure ML, Databricks, Azure Kubernetes Service, and AWS services like AWS SageMaker, AWS Bedrock and AWS Lambda.Exposure to G...Show moreLast updated: 6 days ago
    • Promoted
    • New!
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    jeevahealth.aiMangalore, IN
    Exciting wellness startup consisting of medical and other clinicians based in Rhode Island, Boston, and Seattle with technical teams predominantly in India. Product is evolving from Pilot to commerc...Show moreLast updated: 5 hours ago
    • Promoted
    MLops Engineer

    MLops Engineer

    RecroMangalore, IN
    We are looking for an experienced.Azure and AWS cloud ecosystems.The ideal candidate should bring a strong background in. GenAI tooling, automation, and CI / CD pipelines.Design, implement, and manage...Show moreLast updated: 7 days ago
    • Promoted
    AIML Engineer

    AIML Engineer

    IntraEdgeMangalore, IN
    Artificial Intelligence (AI / ML).AI-powered enterprise applications.The engineer will be responsible for developing scalable. Design and develop enterprise-grade applications in.NLP, predictive analy...Show moreLast updated: 22 days ago
    • Promoted
    Staff ML Engineer (Conversational AI)

    Staff ML Engineer (Conversational AI)

    Yuna.ioMangalore, IN
    Yuna's mission is to radically transform the way mental health support is accessed and delivered.By providing 24 / 7 instant and private support at the push of a button, we aim to address the signifi...Show moreLast updated: 17 days ago
    • Promoted
    Data Integration & LLM Engineer

    Data Integration & LLM Engineer

    Chargebeemangalore, karnataka, in
    We are seeking a highly motivated.This role is ideal for engineers who enjoy working at the intersection of.APIs, SaaS connectors, and ETL / ELT pipelines to ensure reliable and scalable data flows.B...Show moreLast updated: 30+ days ago
    • Promoted
    TDM Senior Engineer

    TDM Senior Engineer

    QualiZealMangalore, IN
    Responsible for delivering test data management solutions focusing on enhanced data provisioning capabilities, data integration and devising efficient TDM processes. Work with other stakeholders lik...Show moreLast updated: 7 days ago
    • Promoted
    L2 Support Engineer

    L2 Support Engineer

    Insight GlobalMangalore, IN
    Experience supporting apps with the following tech stack : Spring boot, Microservices, Java.Experience supporting SQL databases. Experience in L2 IT support, including hardware / software troubleshooti...Show moreLast updated: 17 days ago
    • Promoted
    Senior AI / ML Software Engineer

    Senior AI / ML Software Engineer

    CabletequeMangalore, IN
    Cableteque comprises an international team with extraordinary wire interconnects, CAD deployments, and AI / ML expertise. Our team is located worldwide, including the US, Europe, and Asia.This enables...Show moreLast updated: 3 days ago
    • Promoted
    Generative AI Engineer (LLM Expert)

    Generative AI Engineer (LLM Expert)

    BigRioMangalore, IN
    Generative AI Engineer (LLM Expert).BigRio is a Boston-based, remote-first technology consulting firm specializing in advanced data and software solutions. We partner with forward-thinking organizat...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sales Coordinator

    Sales Coordinator

    Manipal Technologies LimitedUdupi, Karnataka, India
    Coordination with different KAMs for order processing.Coordination with Production team for production status and product availability. Dispatching the different products as per the requirement.Coor...Show moreLast updated: 13 hours ago
    • Promoted
    Senior Site Reliability Engineer- ELK Expert

    Senior Site Reliability Engineer- ELK Expert

    iVedha Inc.Mangalore, IN
    Senior Site Reliability Engineer (SRE) – ELK Expert | Platform Engineering Practice.Must be available to work in the EST (US / Canada) Time Zone. Are you a Senior Site Reliability Engineer (SRE) with ...Show moreLast updated: 30+ days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    X4 TechnologyMangalore, IN
    MLOps Engineer - Role & Responsibilities.Design, deploy and manage scalable & secure cloud infrastructure.Apply least privilege across cloud platforms (Azure, RBAC, AWS IAM).Enable audit logging co...Show moreLast updated: 7 days ago
    • Promoted
    Python Developer & LLM Engineer (Remote)

    Python Developer & LLM Engineer (Remote)

    EmergetechMangalore, Karnataka, India
    Remote
    Job Description We’re an early-stage AI initiative building cutting-edge agent-based architectures, including LangChain , MCP (Multi-agent Coordination Protocol) , and A2A (Agent-to-Agent) fram...Show moreLast updated: 15 days ago