Talent.com
No longer accepting applications
[Immediate Start] Principal LLM Engineer

[Immediate Start] Principal LLM Engineer

Rapid7India
19 hours ago
Job description

Principal LLM Engineer

Join Rapid7 : Secure the Future with AI

Are you ready to lead the charge in integrating cutting-edge Large Language Models (LLMs) into world-class Cyber Security products?

Rapid7 is looking for a Principal LLM Engineer with a rare combination of deep Data Science expertise, mastery of production MLOps, and 13+ years of experience. You won't just build models; you'll architect the AI systems that protect our customers from the world's most sophisticated threats. This is a role for a proven leader who turns breakthrough research into scalable, high-impact security solutions.

What You'll Be Doing : Technical Leadership

As a Principal Engineer, you will define and execute the technical strategy across three critical domains :

1. LLM & AI System Architecture

You'll design and build the next generation of AI-powered security features.

  • LLM Orchestration : Architect complex security applications using frameworks like LangChain and LangGraph to connect LLMs with our data and tools.
  • RAG Pipelines : Build and optimise high-performance Retrieval-Augmented Generation (RAG) systems using Vector DBs to give our AI the context it needs from vast security datasets.
  • Model Optimisation : Implement efficient adaptation techniques (LoRA / PEFT) and run rigorous evaluation using tools like Promptfoo / HELM to ensure model accuracy and safety.
  • Governance & Safety : Design and enforce security Guardrails and governance policies for all LLM deployments.

2. Security-Focused MLOps & Production

You'll ensure our AI is always live, stable, and fighting threats.

  • Real-Time Monitoring : Establish comprehensive monitoring with Prometheus / Grafana / CloudWatch and lead our response to production incidents (PagerDuty, On-call).
  • Model Life Cycle : Master the MLOps pipeline, from model versioning (MLflow / SageMaker) to automating Drift Detection & Retraining.
  • Infrastructure : Use Terraform and Docker / Kubernetes to deploy scalable microservices and APIs.
  • Cloud Security Integration : Leverage AWS Bedrock / SageMaker / Lambda and ensure all deployments adhere to the highest standards of Cloud Security (IAM, VPC, Secrets).
  • CI / CD : Drive continuous deployment for our AI systems using tools like GitHub Actions / Jenkins.
  • 3. Data Science & Security Foundation

    Your background will enable you to solve complex security problems with data.

  • Deep Learning : Apply expertise in NLP, CNN, RNN, etc. to analyse security data (logs, network traffic, etc.).
  • Security Models : Drive the development of Malware Detection models, User behavioural models, and Malware behaviour-based Models.
  • Data Engineering : Lead initiatives in Data Acquisition, Feature Engineering, and transformation across services like S3, DynamoDB, and Redshift.
  • Explainable AI (XAI) : Use SHAP / LIME to ensure transparency and explainability in security decisions made by AI.
  • What You'll Bring

  • 13+ years of professional experience in Data Science, with a significant focus on LLMs / NLP and production MLOps.
  • Advanced degree (Master's or PhD) in Computer Science, Data Science, or a related field, or equivalent practical experience.
  • A proven track record of taking complex ML / LLM projects from concept to highly available production systems.
  • Familiarity with Cost Optimisation (FinOps) for cloud resources.
  • If you thrive on solving the hardest problems in AI and applying that power to make the world a safer place, we want to hear from you!

    Create a job alert for this search

    Principal Engineer • India

    Related jobs
    • Promoted
    MLOps Engineer

    MLOps Engineer

    X4 TechnologyNagpur, IN
    MLOps Engineer - Role & Responsibilities.Design, deploy and manage scalable & secure cloud infrastructure.Apply least privilege across cloud platforms (Azure, RBAC, AWS IAM).Enable audit logging co...Show moreLast updated: 13 days ago
    • Promoted
    Senior Site Reliability Engineer- ELK Expert

    Senior Site Reliability Engineer- ELK Expert

    iVedha Inc.Nagpur, IN
    Senior Site Reliability Engineer (SRE) – ELK Expert | Platform Engineering Practice.Must be available to work in the EST (US / Canada) Time Zone. Are you a Senior Site Reliability Engineer (SRE) with ...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    LaurenNagpur, IN
    Develop prompt engineering strategies.Specify ML methodologies for demo scenarios.Implement AI / ML components where applicable. Optimize model performance for demo environments.Expertise in prompt en...Show moreLast updated: 24 days ago
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsNagpur, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 5 days ago
    • Promoted
    Principal Engineer

    Principal Engineer

    Mancer Consulting ServicesIndia
    Shared Responsibility Models : Define and implement clear shared responsibility models, ensuring accountability across teams for infrastructure, platforms and application security and reliability.Co...Show moreLast updated: 13 days ago
    • Promoted
    MLOps Lead Engineer

    MLOps Lead Engineer

    RecroNagpur, IN
    Experience with Azure services such as Azure AI services, Azure Search, Azure ML, Databricks, Azure Kubernetes Service, and AWS services like AWS SageMaker, AWS Bedrock and AWS Lambda.Exposure to G...Show moreLast updated: 13 days ago
    • Promoted
    Oracle AI Agents Engineer (Mid / Senior / Lead) - Part Time

    Oracle AI Agents Engineer (Mid / Senior / Lead) - Part Time

    U2XAINagpur, IN
    U2XAI builds hallucination-proof AI Cobots that enhance both Oracle Cloud and On-Prem ERP systems.Our Cobots utilize an enterprise knowledge graph to unify data, workflows, and policies, delivering...Show moreLast updated: 22 days ago
    • Promoted
    Full Stack LLM Engineer

    Full Stack LLM Engineer

    Cerebras SystemsIndia
    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs.Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programm...Show moreLast updated: 13 days ago
    • Promoted
    Site Reliability Engineer

    Site Reliability Engineer

    CapgeminiNagpur, IN
    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues...Show moreLast updated: 2 days ago
    • Promoted
    Senior MLOps Engineer

    Senior MLOps Engineer

    Mitchell Martin Inc.Nagpur, IN
    Include, but are not limited to, the following : .Own productionizing models—from tracked experiments to governed releases—ensuring resilient services with clear SLOs, runbooks, and fast, safe rollba...Show moreLast updated: 30+ days ago
    • Promoted
    Distinguished LLM Engineer

    Distinguished LLM Engineer

    Trident ConsultingIndia
    Trident Consulting is looking for a "Distinguished LLM Engineer - Chennai / Tirunelveli / Coimbatore".Role : Distinguished LLM Engineer. Location : Chennai / Tirunelveli / Coimbatore.Salary : Depends on yo...Show moreLast updated: 12 days ago
    • Promoted
    Principal Engineer

    Principal Engineer

    Hotel TraderNagpur, IN
    We're Hiring : Staff / Principal Engineer (Java) - Remote.Location : Remote | 🌍 Global Team | 💼 Experience : 8–12 years. Ready to build the future of hotel distribution at scale?.At Hotel Trader, we're...Show moreLast updated: 30+ days ago
    • Promoted
    Principal Technical Engineer(Configurations)

    Principal Technical Engineer(Configurations)

    Qinecsa SolutionsNagpur, IN
    We are seeking a Principal Technical Engineer to develop and deploy client configurations for our flagship Qinecsa Vigilance Workbench signal detection platform. The ideal candidate will be dynamic ...Show moreLast updated: 13 days ago
    • Promoted
    Senior LLM Engineer

    Senior LLM Engineer

    RingCentralnagpur, maharashtra, in
    We are seeking an experienced AI Engineer with a strong background in Natural Language Understanding (NLU) who is passionate about pushing the boundaries of Conversational AI.In this role, you will...Show moreLast updated: 13 days ago
    • Promoted
    MLops Engineer

    MLops Engineer

    RecroNagpur, IN
    We are looking for an experienced.Azure and AWS cloud ecosystems.The ideal candidate should bring a strong background in. GenAI tooling, automation, and CI / CD pipelines.Design, implement, and manage...Show moreLast updated: 13 days ago
    • Promoted
    Principal LLM Engineer

    Principal LLM Engineer

    Rapid7India
    Join Rapid7 : Secure the Future with AI.Are you ready to lead the charge in integrating cutting-edge.Data Science expertise, mastery of production MLOps, and 13+ years of experience.You won't just b...Show moreLast updated: 23 days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    LemongrassNagpur, IN
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 30+ days ago
    • Promoted
    Data Integration & LLM Engineer

    Data Integration & LLM Engineer

    Chargebeenagpur, India
    We are seeking a highly motivated.This role is ideal for engineers who enjoy working at the intersection of.APIs, SaaS connectors, and ETL / ELT pipelines to ensure reliable and scalable data flows.B...Show moreLast updated: 6 days ago
    • Promoted
    Search Engineer

    Search Engineer

    YourTribeNagpur, IN
    Design & implement search solutions.Architect and develop advanced search features using.OpenSearch / Elasticsearch, including custom analysers, tokenisers, and scoring algorithms.Create and maintain...Show moreLast updated: 30+ days ago
    • Promoted
    Linux Engineer

    Linux Engineer

    RecroNagpur, IN
    As a Senior Software Engineer at Nasuni, you will play a key role in enhancing our cloud-scale NAS platform.Your responsibilities will include : . Collaborating on requirements analysis, architecture ...Show moreLast updated: 13 days ago