Talent.com
LLM & Data Pipeline Engineer

LLM & Data Pipeline Engineer

ChargebeeChennai, Republic Of India, IN
30+ days ago
Job description

About the Role

We are seeking a highly motivated Software Engineer with a strong foundation in Java (Spring Boot) , data integration , and a growing expertise in Large Language Models (LLMs) . This role is ideal for engineers who enjoy working at the intersection of scalable data systems and AI-driven applications , building robust pipelines while also exploring cutting-edge generative AI solutions.

Key Responsibilities

  • Design and implement data integrations including APIs, SaaS connectors, and ETL / ELT pipelines to ensure reliable and scalable data flows.
  • Build and maintain backend services and applications using Java (Spring Boot or equivalent frameworks) .
  • Develop Python-based workflows for AI / ML pipelines, experimentation, and automation scripting.
  • Integrate and experiment with LLMs (OpenAI, Anthropic, LLaMA, Mistral, etc.) for use cases such as retrieval-augmented generation (RAG), summarization, and intelligent data insights.
  • Implement vector search solutions using Pinecone, Weaviate, Milvus, or FAISS for LLM-backed applications.
  • Collaborate with product, data, and ML teams to design end-to-end solutions that combine data engineering with AI capabilities .
  • Ensure systems meet high standards of performance, scalability, security, and compliance .

Required Qualifications

  • Strong programming experience in Java (Spring Boot or equivalent frameworks) .
  • Familiarity with Python , particularly for AI / ML workflows and scripting .
  • Proven experience with data integrations : APIs, SaaS connectors, ETL / ELT pipelines.
  • Exposure to LLMs (OpenAI, Anthropic, LLaMA, Mistral, etc.) and associated frameworks (LangChain, LlamaIndex, Hugging Face Transformers).
  • Experience working with databases (SQL / NoSQL) and vector search technologies (Pinecone, Weaviate, Milvus, FAISS).
  • Preferred Skills

  • Knowledge of cloud platforms (AWS, GCP, or Azure) for deploying scalable systems and ML workloads.
  • Familiarity with containerization and orchestration (Docker, Kubernetes).
  • Understanding of data governance, observability, and security best practices .
  • Interest in generative AI advancements and a passion for building practical applications on top of them.
  • Create a job alert for this search

    Data Pipeline Engineer • Chennai, Republic Of India, IN

    Related jobs
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsNagpur, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 14 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsIndia, India
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    DigitalzoneNagpur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 1 day ago
    • Promoted
    LLM Engineer

    LLM Engineer

    Insight GlobalIndia, India
    Insight Global is sourcing for an AI / LLM Engineer to sit remotely in India, joining a global consulting firm.This position will support various Digital Products Teams in the AI Center of Excellence...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsnagpur, maharashtra, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    PLM Teamcenter Data Engineer Siemens

    PLM Teamcenter Data Engineer Siemens

    MSR Technology GroupNagpur, IN
    Solid knowledge of Teamcenter OOTB utilities such as CSV2TCXML, TCXML_IMPORT, and TCIN_IMPORT, with the ability to explore and utilize configuration options effectively. Proven expertise in troubles...Show moreLast updated: 1 day ago
    • Promoted
    Sr Data Engineer

    Sr Data Engineer

    Mitchell Martin Inc.Nagpur, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroNagpur, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyNagpur, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantNagpur, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 12 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian Indianagpur, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    Senior Data Engineer – ETL & Pipeline Development (7 to 12 yrs)

    AIMLEAPNagpur, IN
    Senior Data Engineer – ETL & Pipeline Development.Remote (Work from Home) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.Pandas, Airflow, o...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indianagpur, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer II

    Data Engineer II

    ClearDemandNagpur, IN
    Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our...Show moreLast updated: 1 day ago
    • Promoted
    Data Integration & LLM Engineer

    Data Integration & LLM Engineer

    Chargebeenagpur, maharashtra, in
    We are seeking a highly motivated.This role is ideal for engineers who enjoy working at the intersection of.APIs, SaaS connectors, and ETL / ELT pipelines to ensure reliable and scalable data flows.B...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesnagpur, maharashtra, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 9 days ago
    • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    upGradNagpur, IN
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreenagpur, maharashtra, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago