Talent.com
AI Engineer - GPT / LangChain / RAG / Data Pipelines
AI Engineer - GPT / LangChain / RAG / Data PipelinesPeak Trust Global Real Estate • Pune, IN
AI Engineer - GPT / LangChain / RAG / Data Pipelines

AI Engineer - GPT / LangChain / RAG / Data Pipelines

Peak Trust Global Real Estate • Pune, IN
18 hours ago
Job description

Location : Remote

Type : Full-time

Experience : 3+ Years

Salary : up to 70K / Month based on experience

Role Summary

We are looking for a hands-on AI Data Engineer who can independently manage end-to-end data workflows, including data collection, document processing, dataset preparation, retrieval pipelines, model fine-tuning, and data visualization.

This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.

Key Responsibilities (Technical) 1. Data Acquisition & Automation

  • Build automated data collection workflows using tools such as Firecrawl , Playwright , Scrapy , or similar frameworks
  • Extract multi-format documents (PDFs, HTML, text, images)
  • Handle large-scale crawling, rate limits, error handling, and scheduling

2. Document Processing & Transformation

  • Clean and process unstructured documents
  • Apply OCR (Tesseract, PaddleOCR) for scanned files
  • Convert and structure data using PyPDF2 , pymupdf , BeautifulSoup , etc.
  • Prepare data in formats such as JSON, JSONL, or CSV
  • 3. Dataset Preparation

  • Segment and structure text for ML training
  • Create Q&A datasets, summaries, instruction-response pairs, and labeled text
  • Build high-quality datasets compatible with fine-tuning frameworks
  • 4. Retrieval & Indexing Pipelines

  • Implement document chunking strategies
  • Generate embeddings and manage vector databases ( Qdrant , Pinecone , Weaviate )
  • Build retrieval workflows using LangChain or LlamaIndex
  • Optimize retrieval accuracy and latency
  • 5. Model Training & Fine-Tuning

  • Run fine-tuning jobs using HuggingFace Transformers , LoRA / QLoRA , or similar methods
  • Monitor training performance and refine datasets
  • Package and deploy fine-tuned models
  • 6. Data Visualization & Analytics

  • Create analytical charts, trends, and insights using :
  • Pandas
  • Matplotlib
  • Seaborn
  • Plotly
  • Build simple internal dashboards or visual summaries for reports
  • Transform raw datasets into meaningful visual insights
  • 7. Automation & Infrastructure

  • Write modular, maintainable Python scripts
  • Containerize workflows with Docker
  • Maintain version control with Git
  • Ensure reproducibility and pipeline stability
  • Required Technical Skills

  • Strong proficiency in Python
  • Experience with Firecrawl , Playwright, Scrapy, or similar tools
  • Strong background in document parsing , text processing, and OCR
  • Familiarity with LangChain or LlamaIndex
  • Experience with vector databases
  • Hands-on experience with HuggingFace , Transformer models, and fine-tuning
  • Ability to write clean, efficient data pipelines
  • Experience with Matplotlib , Seaborn , Plotly , or other visualization tools
  • Comfort using Docker and Git
  • Nice to Have

  • Experience serving models or building small APIs (FastAPI)
  • Exposure to GPU training environments
  • Background in large-scale unstructured data work
  • Ability to create lightweight dashboards (Plotly Dash, Streamlit)
  • Ideal Candidate

  • Comfortable owning full pipelines independently
  • Detail-oriented and analytical
  • Strong problem-solving ability
  • Can work with minimal supervision
  • Enjoys building structured systems from scratch
  • Create a job alert for this search

    Ai Data Engineer • Pune, IN

    Related jobs
    Python_ AIML Engineer

    Python_ AIML Engineer

    Atyeti Inc • Pune, Maharashtra, India
    Role Overview : We are seeking a highly skilled AI Engineer to design and implement intelligent systems using agentic AI capable of autonomous decision-making and task execution.This role involv...Show more
    Last updated: 24 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Pune, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 21 days ago • Promoted
    GenAI Engineer

    GenAI Engineer

    Persistent Systems • Pune, Maharashtra, India
    This role requires a strong understanding of various AIML models including deep learning and proficiency in building and deploying them on Google Cloud Platform. Location : All Persistent Locations.J...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer (Gen AI, Agentic AI)

    AI Engineer (Gen AI, Agentic AI)

    Chetty Technologies • Pune, IN
    Chetty Technologies is a specialized technology company with expertise in delivering advanced consulting services to industries including Banking & Finance, Telecom, Healthcare, and Hospitality.Wit...Show more
    Last updated: 2 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Ascendion • Pune, Maharashtra, India
    Python, Langchain, Langgraph, Autogen.We are actively seeking highly skilled.The ideal candidates will bring hands-on experience in developing and deploying Generative AI (GenAI) solutions from MVP...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer-AI / ML with US Product based Company-Pune (Hybrid)

    Data Engineer-AI / ML with US Product based Company-Pune (Hybrid)

    Seventh Contact Hiring Solutions • Pune, Maharashtra, India
    Hiring : Data Engineer – AI / ML | Pune | Hybrid | Full-time We are looking for a Data Engineer with strong experience in Machine Learning, MLOps, and Generative AI to join our Engineering team.In th...Show more
    Last updated: 3 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Persistent Systems • Pune, Maharashtra, India
    We are hiring a GenAI Engineer who can code, build, and deploy production-ready AI solutions.The ideal candidate is hands-on with Python, LLM frameworks (LangChain, LlamaIndex), and has experience ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python / / AI Engineer

    Senior Python / / AI Engineer

    Luxoft • Pune, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 3 days ago • Promoted
    AI and Databricks

    AI and Databricks

    Quantum Integrators • Pune, Maharashtra, India
    Role : AI and Databricks Engineer.Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers. Spark, Delta Lake, MLflow, Databr...Show more
    Last updated: 9 days ago • Promoted
    AI Lead Engineer

    AI Lead Engineer

    TekGenio • Pune, IN
    Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development. Strong experience in machine learning, deep lea...Show more
    Last updated: 3 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Sesheng Company • Pune, IN
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show more
    Last updated: 24 days ago • Promoted
    AI Engineer

    AI Engineer

    Asite • Pune, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show more
    Last updated: 7 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • Pune, IN
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted
    Lead Gen AI Engineer

    Lead Gen AI Engineer

    Impetus • Pune, India
    We are looking for a Software Engineer who combines deep data engineering expertise with hands-on experience in Generative AI and Agentic AI system development on AWS Cloud.This role is ideal for s...Show more
    Last updated: 17 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Pune, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 11 days ago • Promoted
    AI Engineer

    AI Engineer

    NyxaLabs • Pune, IN
    We're seeking an exceptional AI Engineer with deep expertise in TensorFlow model training to design and build next-generation AI systems. This role focuses on developing sophisticated machine learni...Show more
    Last updated: 2 days ago • Promoted
    AI Data Engineer - 17852

    AI Data Engineer - 17852

    Turing • Pune, India
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 22 days ago • Promoted
    AI Engineer

    AI Engineer

    VIVANET • Pune, India
    Location : Pune / Hyderabad / Bengaluru - Work from office.Employment Type : C2H / Full-time.At Vivanet, we’re building intelligent, reliable, and future-ready technology solutions that help businesses sta...Show more
    Last updated: 8 days ago • Promoted