Talent.com
Senior LLM Engineer

Senior LLM Engineer

RingCentralKarnataka, India
1 day ago
Job description

Job Description :

We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI. In this role, you will design, develop, and deploy scalable AI solutions leveraging LLMs, Retrieval-Augmented Generation (RAG), and prompt engineering techniques to power intelligent products and services.

As part of our ML / AI team, you’ll own the full lifecycle of model development — from data preparation and fine-tuning to inference optimization and deployment in production environments.

Responsibilities :

  • Design, fine-tune, and deploy LLM-based applications for Conversational AI use cases
  • Build scalable retrieval-augmented generation (RAG) pipelines that combine LLMs with structured / unstructured data sources
  • Develop prompt engineering strategies, templates, and evaluation frameworks for LLM-driven workflows
  • Collaborate with cross-functional teams to identify and implement AI-driven solutions to business problems
  • Optimize models for low-latency inference using quantization, distillation, and other model optimization techniques (e.g., ONNX, TensorRT)
  • Build robust data processing, labeling, and augmentation pipelines to improve model performance
  • Implement monitoring and evaluation systems for deployed LLMs, ensuring reliability, fairness, and safety
  • Stay current with emerging trends in LLMs, retrieval systems, and generative AI frameworks

Requirements :

  • 5-8 years of hands-on experience in NLU
  • Strong proficiency in Python and PyTorch and related frameworks (like Hugging Face Transformers, Sentence Transformers etc.)
  • Proven experience developing and deploying NLP or LLM pipelines in production environments at scale
  • Solid understanding of transformer architectures and attention mechanisms
  • Proficiency in using LLM provider APIs such as OpenAI, Gemini etc.including prompt design, fine-tuning, and evaluation
  • Experience with model optimization techniques such as quantization, pruning, ONNX, TensorRT, or model distillation
  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, or a related field
  • Nice to Have :

  • Hands-on experience with RAG and vector databases (e.g., FAISS, Qdrant, pgVector etc. )
  • Prior work on LLM fine-tuning, alignment, or evaluation
  • Experience with LLM orchestration frameworks such as LlamaIndex or similar tools
  • Familiarity with multi-provider LLM orchestration, integrating APIs from OpenAI, Gemini etc. and others for fallbacks, routing, or ensemble strategies
  • Knowledge of MLOps for LLMs, including model serving and monitoring
  • Understanding of embedding models, context management, and token optimization for scalable LLM applications
  • Create a job alert for this search

    Engineer Llm • Karnataka, India

    Related jobs
    • Promoted
    Engineer- OLE

    Engineer- OLE

    WSP in IndiaKarnataka, India
    Undertaking of tasks as assigned, in particular : .Delivering catenary engineering (design and consultancy) specific tasks. Contributing a catenary engineering input to electrification engineering (de...Show moreLast updated: 1 day ago
    • Promoted
    RTL Lead and above

    RTL Lead and above

    TessolveKarnataka, India
    Opportunity With Tessolve Semiconductor- Bangalore.RTL design engineer and design verification engineer for Bangalore location. Skills : RTL ASIC, CDC, Lint, Synthesis, Spyglass.We are hiring for RTL...Show moreLast updated: 1 day ago
    • Promoted
    ML Engineer III

    ML Engineer III

    GrowwKarnataka, India
    We are a passionate group of people focused on making financial services accessible to every Indian through a multi-product platform. Each day, we help millions of customers take charge of their fin...Show moreLast updated: 1 day ago
    • Promoted
    Subsurface Reliability Engineer

    Subsurface Reliability Engineer

    ChevronKarnataka, India
    The Subsurface Reliability Engineer is part of the Production Engineering team within the Chevron ENGINE Center and is responsible for ensuring the reliability and efficiency of subsurface operatio...Show moreLast updated: 1 day ago
    • Promoted
    Site Reliability Engineer

    Site Reliability Engineer

    o9 Solutions, Inc.Karnataka, India
    Be part of something revolutionary.At o9 Solutions, our mission is clear : be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate globa...Show moreLast updated: 1 day ago
    • Promoted
    K8S Lifecycle Automation Eng

    K8S Lifecycle Automation Eng

    LTIMindtreeKarnataka, India, India
    Senior Kubernetes Platform Engineer (Zero-Touch GPU Cloud – GitOps Automation).Senior Kubernetes Platform Engineer.Zero-Touch Build, Upgrade, and Certification pipeline. This role focuses on automat...Show moreLast updated: 16 days ago
    • Promoted
    Senior Engineer

    Senior Engineer

    TessolveKarnataka, India
    Job Title : Analog Layout Engineer.ASIC / SoC Design / Physical Design.Perform detailed transistor-level analog and mixed-signal layout for ASIC and IP design projects. Ensure layout designs meet elect...Show moreLast updated: 1 day ago
    • Promoted
    RTL Engineer

    RTL Engineer

    CoreEL TechnologiesKarnataka, India
    Understand customer’s requirements / specifications / tender enquiry.Define DSP, System and Board architecture.Project ownership from concept to delivery. This includes identifying risks, dependencies...Show moreLast updated: 1 day ago
    • Promoted
    Sr Site Reliability Engineer

    Sr Site Reliability Engineer

    Media.netKarnataka, India
    Our proprietary contextual technology is at the forefront of enhancing Programmatic buying, the latest industry standard in ad buying for digital platforms. HQ is based in New York, and the Global H...Show moreLast updated: 1 day ago
    • Promoted
    Senior RTL Design Engineer

    Senior RTL Design Engineer

    ACL DigitalKarnataka, India
    Notice Period : 15 days to 30 Days.Experience in Low power RTL design, microarchitecture, synthesis, timing closure, Low power estimation. Should be proficient in Verilog.Should have experience in op...Show moreLast updated: 1 day ago
    • Promoted
    RTL Design Engineer

    RTL Design Engineer

    ACL DigitalKarnataka, India
    Job Title : RTL Design Engineers.Top-level (SOC) level basic industry standard Arch knowledge.SoC & IP level Integration knowledge. IORING and Phys & GPIOs basic functionality.Design Partitioning(Til...Show moreLast updated: 1 day ago
    • Promoted
    Senior Site Reliability Engineer

    Senior Site Reliability Engineer

    ViewSonicKarnataka, India
    At ViewSonic Technologies, we’re passionate about building software that solves problems.We count on our site reliability engineers (SREs) to empower users with a rich feature set, high availabilit...Show moreLast updated: 1 day ago
    • Promoted
    Lead ML Engineer [T500-20548]

    Lead ML Engineer [T500-20548]

    ANSRKarnataka, India
    Headquartered in Berlin, Germany, 4flow provides consulting, software and services for logistics and supply chain management. More than 1300 team members leverage their supply chain expertise and IT...Show moreLast updated: 1 day ago
    • Promoted
    Senior Site Reliability Engineer

    Senior Site Reliability Engineer

    AllegionKarnataka, India
    Allegion India is seeking a highly motivated Senior Site Reliability Engineer who will play a critical role in ensuring the reliability, scalability, and performance of our organization's syste...Show moreLast updated: 1 day ago
    • Promoted
    Senior Staff Site Reliability Engineer

    Senior Staff Site Reliability Engineer

    Palo Alto NetworksKarnataka, India
    At Palo Alto Networks® everything starts and ends with our mission : .Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and m...Show moreLast updated: 1 day ago
    • Promoted
    Sr RTL Principal Design Engineer

    Sr RTL Principal Design Engineer

    Cadence System Design and AnalysisKarnataka, India
    Interface Controller IP development.The role would include design and support of the RTL of the PCIe / CXL / IDE / UALink IP solution of Cadence. The work involved will be working with the existing RTL, a...Show moreLast updated: 1 day ago
    • Promoted
    Senior Site Reliability Engineer

    Senior Site Reliability Engineer

    ITC InfotechKarnataka, India
    Proficiency in at least one coding language — preferably.Experience supporting and enhancing.Proven ability to implement automation solutions. Strong skills in diagnosing and resolving issues in.Str...Show moreLast updated: 1 day ago
    • Promoted
    Senior Platform Engineer [T500-20955]

    Senior Platform Engineer [T500-20955]

    FMKarnataka, India
    FM is a 190-year-old, Fortune 500 commercial property insurance company of 6,000+ employees with a unique focus on science and risk engineering. Serving over a quarter of the Fortune 500 and major c...Show moreLast updated: 1 day ago