Talent.com
Ai Engineer - Gpt / Langchain / Rag / Data Pipelines
Ai Engineer - Gpt / Langchain / Rag / Data PipelinesPeak Trust Global Real Estate • Erode, Republic Of India, IN
Ai Engineer - Gpt / Langchain / Rag / Data Pipelines

Ai Engineer - Gpt / Langchain / Rag / Data Pipelines

Peak Trust Global Real Estate • Erode, Republic Of India, IN
21 hours ago
Job description

Location : Remote

Type : Full-time

Experience : 3+ Years

Salary : up to 70K / Month based on experience

Role Summary

We are looking for a hands-on AI Data Engineer who can independently manage end-to-end data workflows, including data collection, document processing, dataset preparation, retrieval pipelines, model fine-tuning, and data visualization.

This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.

Key Responsibilities (Technical) 1. Data Acquisition & Automation

  • Build automated data collection workflows using tools such as Firecrawl , Playwright , Scrapy , or similar frameworks
  • Extract multi-format documents (PDFs, HTML, text, images)
  • Handle large-scale crawling, rate limits, error handling, and scheduling

2. Document Processing & Transformation

  • Clean and process unstructured documents
  • Apply OCR (Tesseract, PaddleOCR) for scanned files
  • Convert and structure data using PyPDF2 , pymupdf , BeautifulSoup , etc.
  • Prepare data in formats such as JSON, JSONL, or CSV
  • 3. Dataset Preparation

  • Segment and structure text for ML training
  • Create Q&A datasets, summaries, instruction-response pairs, and labeled text
  • Build high-quality datasets compatible with fine-tuning frameworks
  • 4. Retrieval & Indexing Pipelines

  • Implement document chunking strategies
  • Generate embeddings and manage vector databases ( Qdrant , Pinecone , Weaviate )
  • Build retrieval workflows using LangChain or LlamaIndex
  • Optimize retrieval accuracy and latency
  • 5. Model Training & Fine-Tuning

  • Run fine-tuning jobs using HuggingFace Transformers , LoRA / QLoRA , or similar methods
  • Monitor training performance and refine datasets
  • Package and deploy fine-tuned models
  • 6. Data Visualization & Analytics

  • Create analytical charts, trends, and insights using :
  • Pandas
  • Matplotlib
  • Seaborn
  • Plotly
  • Build simple internal dashboards or visual summaries for reports
  • Transform raw datasets into meaningful visual insights
  • 7. Automation & Infrastructure

  • Write modular, maintainable Python scripts
  • Containerize workflows with Docker
  • Maintain version control with Git
  • Ensure reproducibility and pipeline stability
  • Required Technical Skills

  • Strong proficiency in Python
  • Experience with Firecrawl , Playwright, Scrapy, or similar tools
  • Strong background in document parsing , text processing, and OCR
  • Familiarity with LangChain or LlamaIndex
  • Experience with vector databases
  • Hands-on experience with HuggingFace , Transformer models, and fine-tuning
  • Ability to write clean, efficient data pipelines
  • Experience with Matplotlib , Seaborn , Plotly , or other visualization tools
  • Comfort using Docker and Git
  • Nice to Have

  • Experience serving models or building small APIs (FastAPI)
  • Exposure to GPU training environments
  • Background in large-scale unstructured data work
  • Ability to create lightweight dashboards (Plotly Dash, Streamlit)
  • Ideal Candidate

  • Comfortable owning full pipelines independently
  • Detail-oriented and analytical
  • Strong problem-solving ability
  • Can work with minimal supervision
  • Enjoys building structured systems from scratch
  • Create a job alert for this search

    Ai Data Engineer • Erode, Republic Of India, IN

    Related jobs
    AI Engineer

    AI Engineer

    Idea Elan India • Erode, IN
    AI Engineer (2 - 4 Years Experience).Idea Elan LLC is a product based company that provides comprehensive software solutions for. Universities and Institutions worldwide.We are seeking a skilled AI ...Show more
    Last updated: 11 days ago • Promoted
    Artificial Intelligence Engineer

    Artificial Intelligence Engineer

    Ascendion • Erode, IN
    Job Title : : Python Artificial Engineer.Minimum relevant experience : : 6.We are seeking a highly motivated AI Engineer with hands-on experience in developing and deploying agentic AI architectures....Show more
    Last updated: 22 days ago • Promoted
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • Erode, IN
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 1 day ago • Promoted
    AI Engineer

    AI Engineer

    NyxaLabs • Erode, IN
    We're seeking an exceptional AI Engineer with deep expertise in TensorFlow model training to design and build next-generation AI systems. This role focuses on developing sophisticated machine learni...Show more
    Last updated: 3 days ago • Promoted
    AI Engineer

    AI Engineer

    Asite • Erode, IN
    We start with a simple idea : the built environment should be smarter, safer and more sustainable.Everything we do is about helping the people behind major construction and infrastructure projects w...Show more
    Last updated: 7 days ago • Promoted
    Ai Engineer

    Ai Engineer

    ACL Digital • Erode, Republic Of India, IN
    AI Engineer (2 - 4 Years Experience)Company Description : Idea Elan LLC is a product based company that provides comprehensive software solutions forresearch facilities in Universities and Institutio...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python / / AI Engineer

    Senior Python / / AI Engineer

    Luxoft • Erode, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 4 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Erode, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 22 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Erode, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 12 days ago • Promoted
    AI Engineer

    AI Engineer

    TechWaves Recruitment • Erode, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show more
    Last updated: 25 days ago • Promoted
    AI Engineer

    AI Engineer

    MightyBot • Erode, IN
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show more
    Last updated: 30+ days ago • Promoted
    AI Lead Engineer

    AI Lead Engineer

    TekGenio • Erode, IN
    Experience : 5+ Years | Type : Full-Time | Location : WFH.Minimum of 5+ years of experience in AI / ML engineering, data science, or algorithm development. Strong experience in machine learning, deep lea...Show more
    Last updated: 4 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Sesheng Company • Erode, IN
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show more
    Last updated: 25 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    LTIMindtree • Erode, IN
    This role demands deep expertise in.Architect end-to-end GenAI solutions for R&D use cases such as.Evaluate multiple solution approaches (e. Document architectural decisions with.Word, Excel, PDF, d...Show more
    Last updated: 10 days ago • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blend • Erode, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show more
    Last updated: 21 days ago • Promoted
    AI Engineer (Gen AI, Agentic AI)

    AI Engineer (Gen AI, Agentic AI)

    Chetty Technologies • Erode, IN
    Chetty Technologies is a specialized technology company with expertise in delivering advanced consulting services to industries including Banking & Finance, Telecom, Healthcare, and Hospitality.Wit...Show more
    Last updated: 2 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • Erode, IN
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 17 days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Erode, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show more
    Last updated: 19 days ago • Promoted