Talent.com
This job offer is not available in your country.
(High Salary) Principal LLM Engineer

(High Salary) Principal LLM Engineer

Rapid7Pune, Maharashtra, India
10 hours ago
Job description

Principal LLM Engineer

Join Rapid7 : Secure the Future with AI

Are you ready to lead the charge in integrating cutting-edge Large Language Models (LLMs) into world-class Cyber Security products?

Rapid7 is looking for a Principal LLM Engineer with a rare combination of deep Data Science expertise, mastery of production MLOps, and 13+ years of experience. You won't just build models; you'll architect the AI systems that protect our customers from the world's most sophisticated threats. This is a role for a proven leader who turns breakthrough research into scalable, high-impact security solutions.

What You'll Be Doing : Technical Leadership

As a Principal Engineer, you will define and execute the technical strategy across three critical domains :

1. LLM & AI System Architecture

You'll design and build the next generation of AI-powered security features.

  • LLM Orchestration : Architect complex security applications using frameworks like LangChain and LangGraph to connect LLMs with our data and tools.
  • RAG Pipelines : Build and optimise high-performance Retrieval-Augmented Generation (RAG) systems using Vector DBs to give our AI the context it needs from vast security datasets.
  • Model Optimisation : Implement efficient adaptation techniques (LoRA / PEFT) and run rigorous evaluation using tools like Promptfoo / HELM to ensure model accuracy and safety.
  • Governance & Safety : Design and enforce security Guardrails and governance policies for all LLM deployments.

2. Security-Focused MLOps & Production

You'll ensure our AI is always live, stable, and fighting threats.

  • Real-Time Monitoring : Establish comprehensive monitoring with Prometheus / Grafana / CloudWatch and lead our response to production incidents (PagerDuty, On-call).
  • Model Life Cycle : Master the MLOps pipeline, from model versioning (MLflow / SageMaker) to automating Drift Detection & Retraining.
  • Infrastructure : Use Terraform and Docker / Kubernetes to deploy scalable microservices and APIs.
  • Cloud Security Integration : Leverage AWS Bedrock / SageMaker / Lambda and ensure all deployments adhere to the highest standards of Cloud Security (IAM, VPC, Secrets).
  • CI / CD : Drive continuous deployment for our AI systems using tools like GitHub Actions / Jenkins.
  • 3. Data Science & Security Foundation

    Your background will enable you to solve complex security problems with data.

  • Deep Learning : Apply expertise in NLP, CNN, RNN, etc. to analyse security data (logs, network traffic, etc.).
  • Security Models : Drive the development of Malware Detection models, User behavioural models, and Malware behaviour-based Models.
  • Data Engineering : Lead initiatives in Data Acquisition, Feature Engineering, and transformation across services like S3, DynamoDB, and Redshift.
  • Explainable AI (XAI) : Use SHAP / LIME to ensure transparency and explainability in security decisions made by AI.
  • What You'll Bring

  • 13+ years of professional experience in Data Science, with a significant focus on LLMs / NLP and production MLOps.
  • Advanced degree (Master's or PhD) in Computer Science, Data Science, or a related field, or equivalent practical experience.
  • A proven track record of taking complex ML / LLM projects from concept to highly available production systems.
  • Familiarity with Cost Optimisation (FinOps) for cloud resources.
  • If you thrive on solving the hardest problems in AI and applying that power to make the world a safer place, we want to hear from you!

    Create a job alert for this search

    Principal Engineer • Pune, Maharashtra, India

    Related jobs
    • Promoted
    LLM Engineer_4+years

    LLM Engineer_4+years

    ConfidentialPune, India
    Primary Title : Senior LLM Engineer (4+ years) — Hybrid, India.A technology consulting firm operating at the intersection of Enterprise AI, Generative AI and Cloud Engineering seeks an experienced L...Show moreLast updated: 18 days ago
    • Promoted
    Backend Engineer - LLM Frameworks Development

    Backend Engineer - LLM Frameworks Development

    TalentxoPune
    Role & Responsibilities : - Agentic AI Platform Delivery - Develop and maintain autonomous software agents using modern L...Show moreLast updated: 30+ days ago
    • Promoted
    AI / ML Engineer - LLM Models

    AI / ML Engineer - LLM Models

    UnipartPune
    About Unipart Group : Unipart Group specialises in manufacturing, logistics, and consultancy, delivering a diverse range of operational and business support solutions...Show moreLast updated: 7 days ago
    • Promoted
    Cloud AI Engineer - LLM

    Cloud AI Engineer - LLM

    Elite recruitmentsPune
    Role : Cloud AI Engineer.Location : : 7 Years.Notice Period : Immediate to 30 Days.What Youll Do : - B...Show moreLast updated: 30+ days ago
    Principal Engineer

    Principal Engineer

    TeamifiedPune, MH, IN
    Quick Apply
    We are seeking an exceptional Principal Engineer to serve as a technical advisor and problem-solver for our diverse client base. This role requires technical versatility to support both ea...Show moreLast updated: 30+ days ago
    • Promoted
    MLOps Engineer

    MLOps Engineer

    PeoplefyPune
    Position : MLOps : 7+ Type : Full-time Job Summary : &l...Show moreLast updated: 30+ days ago
    • Promoted
    Principal LLM Engineer

    Principal LLM Engineer

    Rapid7Pune, Maharashtra, India
    Principal LLM Engineer Join Rapid7 : Secure the Future with AI Are you ready to lead the charge in integrating cutting-edge Large Language Models (LLMs) into world-class Cyber Security products? ...Show moreLast updated: 4 days ago
    • Promoted
    Software Engineer - LLM Models

    Software Engineer - LLM Models

    MuoroPune
    About the Role : We are seeking a highly skilled and motivated AI Software Engineer to join our advanced AI development team.In this role, you will...Show moreLast updated: 22 days ago
    • Promoted
    LLM Engineer - AI / ML

    LLM Engineer - AI / ML

    ConfidentialPune, India
    T-Systems Information and Communication Technology India Private Limited (T-Systems ICT India Pvt.Great Place To Work® Certification™. As a wholly owned subsidiary of T-Systems International GmbH, T...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Principal llm engineer

    Principal llm engineer

    Rapid7Pune, Maharashtra, India
    Join Rapid7 : Secure the Future with AI.Are you ready to lead the charge in integrating cutting-edge Large Language Models (LLMs) into world-class Cyber Security products?.Rapid7 is looking for ...Show moreLast updated: 14 hours ago
    • Promoted
    MPLS Integration Engineer

    MPLS Integration Engineer

    Recruitement AgencyPune
    Role Summary : We are seeking a skilled network engineer with deep expertise in IP routing and MPLS integration to support the deployment and confi...Show moreLast updated: 11 days ago
    • Promoted
    Principal Engineer

    Principal Engineer

    Hotel TraderPune, IN
    We're Hiring : Staff / Principal Engineer (Java) - Remote.Location : Remote | 🌍 Global Team | 💼 Experience : 8–12 years. Ready to build the future of hotel distribution at scale?.At Hotel Trader, we're...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr MLOPS Infra Engineer

    Sr MLOPS Infra Engineer

    Rapid7Pune, Maharashtra, India
    Senior MLops Infrastructure Engineer Job Description ⚙️.Join Rapid7 : Secure the Future with AI.We are seeking an experienced and highly specialised. Senior MLops Infrastructure Engineer.Machine Lear...Show moreLast updated: 9 hours ago
    • Promoted
    Software Engineer - MLOps

    Software Engineer - MLOps

    TPI Global Solutionspune, maharashtra, in
    Job Title : Engineer - Software Lvl 3 - MLOps.Shift : Night (8 : 30 PM to 5 : 30 AM).Build tools for automation around ML workflows orchestration and model deployments using CI / CD workflows.Automate infr...Show moreLast updated: 2 days ago
    • Promoted
    LLM Engineer - Python / Tensorflow

    LLM Engineer - Python / Tensorflow

    Zorba Consulting India Pvt. Ltd.Pune,Maharashtra
    Company Description : At Zorba AI, we harness the power of Generative AI to help businesses unlock new possibilities and streaml...Show moreLast updated: 26 days ago
    • Promoted
    Python Developer & LLM Engineer (Remote)

    Python Developer & LLM Engineer (Remote)

    EmergetechPune, Maharashtra, India
    Remote
    Job Description We’re an early-stage AI initiative building cutting-edge agent-based architectures, including LangChain , MCP (Multi-agent Coordination Protocol) , and A2A (Agent-to-Agent) fram...Show moreLast updated: 2 days ago
    • Promoted
    Principal Engineer

    Principal Engineer

    ConfidentialPune, India
    Works on project design and development for new or existing products.Design and development of power gen system parts for diesel generator sets, alternate fuels, BESS or other systems as needed.Def...Show moreLast updated: 18 days ago
    • Promoted
    AmpsTek - Generative AI Engineer - LLM

    AmpsTek - Generative AI Engineer - LLM

    AmpstekPune
    Title : Generative AI Engineer.Location : Pune(Onsite).Job Type : Contract.You will be a key member of the Turing GenAI delivery organization and part of a GenAI pr...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Sr MLOPS Infra Engineer (15h Left)

    Sr MLOPS Infra Engineer (15h Left)

    Rapid7Pune, Maharashtra, India
    Senior MLops Infrastructure Engineer Job Description ⚙️ Join Rapid7 : Secure the Future with AI Overview We are seeking an experienced and highly specialised Senior MLops Infrastructure Engineer ...Show moreLast updated: less than 1 hour ago
    Principal Engineer

    Principal Engineer

    ScaleneWorksPune, Maharashtra, India
    Quick Apply
    Strong leadership qualities, including the ability to motivate, inspire, and guide the team.Strong analytical and problem-solving skills to identify challenges and develop effective solutions.Good ...Show moreLast updated: 30+ days ago