Talent.com
AI Engineer - GPT / LangChain / RAG / Data Pipelines
AI Engineer - GPT / LangChain / RAG / Data PipelinesPeak Trust Global Real Estate • bhopal, madhya pradesh, in
AI Engineer - GPT / LangChain / RAG / Data Pipelines

AI Engineer - GPT / LangChain / RAG / Data Pipelines

Peak Trust Global Real Estate • bhopal, madhya pradesh, in
5 hours ago
Job description

Location : Remote

Type : Full-time

Experience : 3+ Years

Salary : up to 70K / Month based on experience

Role Summary

We are looking for a hands-on AI Data Engineer who can independently manage end-to-end data workflows, including data collection, document processing, dataset preparation, retrieval pipelines, model fine-tuning, and data visualization.

This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.

Key Responsibilities (Technical) 1. Data Acquisition & Automation

  • Build automated data collection workflows using tools such as Firecrawl , Playwright , Scrapy , or similar frameworks
  • Extract multi-format documents (PDFs, HTML, text, images)
  • Handle large-scale crawling, rate limits, error handling, and scheduling

2. Document Processing & Transformation

  • Clean and process unstructured documents
  • Apply OCR (Tesseract, PaddleOCR) for scanned files
  • Convert and structure data using PyPDF2 , pymupdf , BeautifulSoup , etc.
  • Prepare data in formats such as JSON, JSONL, or CSV
  • 3. Dataset Preparation

  • Segment and structure text for ML training
  • Create Q&A datasets, summaries, instruction-response pairs, and labeled text
  • Build high-quality datasets compatible with fine-tuning frameworks
  • 4. Retrieval & Indexing Pipelines

  • Implement document chunking strategies
  • Generate embeddings and manage vector databases ( Qdrant , Pinecone , Weaviate )
  • Build retrieval workflows using LangChain or LlamaIndex
  • Optimize retrieval accuracy and latency
  • 5. Model Training & Fine-Tuning

  • Run fine-tuning jobs using HuggingFace Transformers , LoRA / QLoRA , or similar methods
  • Monitor training performance and refine datasets
  • Package and deploy fine-tuned models
  • 6. Data Visualization & Analytics

  • Create analytical charts, trends, and insights using :
  • Pandas
  • Matplotlib
  • Seaborn
  • Plotly
  • Build simple internal dashboards or visual summaries for reports
  • Transform raw datasets into meaningful visual insights
  • 7. Automation & Infrastructure

  • Write modular, maintainable Python scripts
  • Containerize workflows with Docker
  • Maintain version control with Git
  • Ensure reproducibility and pipeline stability
  • Required Technical Skills

  • Strong proficiency in Python
  • Experience with Firecrawl , Playwright, Scrapy, or similar tools
  • Strong background in document parsing , text processing, and OCR
  • Familiarity with LangChain or LlamaIndex
  • Experience with vector databases
  • Hands-on experience with HuggingFace , Transformer models, and fine-tuning
  • Ability to write clean, efficient data pipelines
  • Experience with Matplotlib , Seaborn , Plotly , or other visualization tools
  • Comfort using Docker and Git
  • Nice to Have

  • Experience serving models or building small APIs (FastAPI)
  • Exposure to GPU training environments
  • Background in large-scale unstructured data work
  • Ability to create lightweight dashboards (Plotly Dash, Streamlit)
  • Ideal Candidate

  • Comfortable owning full pipelines independently
  • Detail-oriented and analytical
  • Strong problem-solving ability
  • Can work with minimal supervision
  • Enjoys building structured systems from scratch
  • Create a job alert for this search

    Ai Data Engineer • bhopal, madhya pradesh, in

    Related jobs
    Data Engineer

    Data Engineer

    Grantify • bhopal, madhya pradesh, in
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior LLM Engineer

    Senior LLM Engineer

    Infocusp Innovations • bhopal, madhya pradesh, in
    The Senior Agentic AI Engineer will lead the design, development, and deployment of.AI solutions within production environments, working across. AI, with a focus on delivering robust and fair agenti...Show more
    Last updated: 5 hours ago • Promoted • New!
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • bhopal, madhya pradesh, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Upstep Academy • bhopal, madhya pradesh, in
    Upstep Academy is a forward-thinking EdTech company dedicated to revolutionizing the world of chess education.We are building a cutting-edge learning platform that combines a world-class curriculum...Show more
    Last updated: 5 hours ago • Promoted • New!
    Python for Machine Learning

    Python for Machine Learning

    People Prime Worldwide • bhopal, madhya pradesh, in
    Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernisation and ma...Show more
    Last updated: 2 days ago • Promoted
    AI Engineer Intern

    AI Engineer Intern

    Qureal AI • bhopal, madhya pradesh, in
    Hiring : AI Engineer Intern (Remote + Paid).We are looking for a dedicated AI Engineer Intern.This role offers a real opportunity to transition into a full-time position based on performance.PPO / F...Show more
    Last updated: 5 hours ago • Promoted • New!
    AI Architect

    AI Architect

    TekPillar® • bhopal, madhya pradesh, in
    Cloud platforms (AWS or equivalent).Artificial Intelligence / Large Language Models (LLMs).Architect and design a scalable and robust agentic AI platform for automotive domains.Evaluate and impleme...Show more
    Last updated: 5 hours ago • Promoted • New!
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • bhopal, madhya pradesh, in
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 17 days ago • Promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Recro • bhopal, madhya pradesh, in
    What would you be doing / Expected from this role?.Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.Drive the archite...Show more
    Last updated: 30+ days ago • Promoted
    Architect

    Architect

    Veltris • bhopal, madhya pradesh, in
    AI Architect - Telecom & Networking.Routing, Switching / SD-WAN / Provider Edge).ML Algorithms; Graph Neural Networks, Time-series Forecasting Algorithms (ARIMA, LSTM…). ML / DL libraries (PyTorch, Te...Show more
    Last updated: 5 hours ago • Promoted • New!
    AI tester / experimentation engineer

    AI tester / experimentation engineer

    People Prime Worldwide • bhopal, madhya pradesh, in
    Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT modernization and ma...Show more
    Last updated: 5 hours ago • Promoted • New!
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • bhopal, madhya pradesh, in
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 13 days ago • Promoted
    Python Developer

    Python Developer

    TekXera • bhopal, madhya pradesh, in
    Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico. Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
    Last updated: 5 hours ago • Promoted • New!
    AI Engineer Intern

    AI Engineer Intern

    Signet Arms • bhopal, madhya pradesh, in
    Signet Arms is an innovative defense technology company.We are building next-generation agentic AI systems, enabling autonomous reasoning, workflow orchestration, and intelligent automation.Our wor...Show more
    Last updated: 5 hours ago • Promoted • New!
    AI ENGINE DEVELOPER (Computer Vision + Mobile App AI Integration)

    AI ENGINE DEVELOPER (Computer Vision + Mobile App AI Integration)

    Clause Holdings • bhopal, madhya pradesh, in
    We are looking for an experienced AI / ML Engineer (Computer Vision) to architect and build an advanced AI Scoring Engine for inputs. The role involves model selection, training, fine-tuning, evaluati...Show more
    Last updated: 5 hours ago • Promoted • New!
    AI Engineer

    AI Engineer

    Recruin • bhopal, madhya pradesh, in
    Our Client is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, s...Show more
    Last updated: 5 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • bhopal, madhya pradesh, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    N53 Tech • bhopal, madhya pradesh, in
    Our client is expanding their Data Engineering function and hiring across multiple levels (3 to 10 years).You will help build and scale their data architecture, data pipelines, data platform govern...Show more
    Last updated: 5 hours ago • Promoted • New!