Talent.com
AI Engineer - GPT / LangChain / RAG / Data Pipelines
AI Engineer - GPT / LangChain / RAG / Data PipelinesPeak Trust Global Real Estate • Kochi, IN
No longer accepting applications
AI Engineer - GPT / LangChain / RAG / Data Pipelines

AI Engineer - GPT / LangChain / RAG / Data Pipelines

Peak Trust Global Real Estate • Kochi, IN
6 days ago
Job description

Location : Remote

Type : Full-time

Experience : 3+ Years

Salary : up to 70K / Month based on experience

Role Summary

We are looking for a hands-on AI Data Engineer who can independently manage end-to-end data workflows, including data collection, document processing, dataset preparation, retrieval pipelines, model fine-tuning, and data visualization.

This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.

Key Responsibilities (Technical) 1. Data Acquisition & Automation

  • Build automated data collection workflows using tools such as Firecrawl , Playwright , Scrapy , or similar frameworks
  • Extract multi-format documents (PDFs, HTML, text, images)
  • Handle large-scale crawling, rate limits, error handling, and scheduling

2. Document Processing & Transformation

  • Clean and process unstructured documents
  • Apply OCR (Tesseract, PaddleOCR) for scanned files
  • Convert and structure data using PyPDF2 , pymupdf , BeautifulSoup , etc.
  • Prepare data in formats such as JSON, JSONL, or CSV
  • 3. Dataset Preparation

  • Segment and structure text for ML training
  • Create Q&A datasets, summaries, instruction-response pairs, and labeled text
  • Build high-quality datasets compatible with fine-tuning frameworks
  • 4. Retrieval & Indexing Pipelines

  • Implement document chunking strategies
  • Generate embeddings and manage vector databases ( Qdrant , Pinecone , Weaviate )
  • Build retrieval workflows using LangChain or LlamaIndex
  • Optimize retrieval accuracy and latency
  • 5. Model Training & Fine-Tuning

  • Run fine-tuning jobs using HuggingFace Transformers , LoRA / QLoRA , or similar methods
  • Monitor training performance and refine datasets
  • Package and deploy fine-tuned models
  • 6. Data Visualization & Analytics

  • Create analytical charts, trends, and insights using :
  • Pandas
  • Matplotlib
  • Seaborn
  • Plotly
  • Build simple internal dashboards or visual summaries for reports
  • Transform raw datasets into meaningful visual insights
  • 7. Automation & Infrastructure

  • Write modular, maintainable Python scripts
  • Containerize workflows with Docker
  • Maintain version control with Git
  • Ensure reproducibility and pipeline stability
  • Required Technical Skills

  • Strong proficiency in Python
  • Experience with Firecrawl , Playwright, Scrapy, or similar tools
  • Strong background in document parsing , text processing, and OCR
  • Familiarity with LangChain or LlamaIndex
  • Experience with vector databases
  • Hands-on experience with HuggingFace , Transformer models, and fine-tuning
  • Ability to write clean, efficient data pipelines
  • Experience with Matplotlib , Seaborn , Plotly , or other visualization tools
  • Comfort using Docker and Git
  • Nice to Have

  • Experience serving models or building small APIs (FastAPI)
  • Exposure to GPU training environments
  • Background in large-scale unstructured data work
  • Ability to create lightweight dashboards (Plotly Dash, Streamlit)
  • Ideal Candidate

  • Comfortable owning full pipelines independently
  • Detail-oriented and analytical
  • Strong problem-solving ability
  • Can work with minimal supervision
  • Enjoys building structured systems from scratch
  • Create a job alert for this search

    Ai Data Engineer • Kochi, IN

    Related jobs
    AI Engineer

    AI Engineer

    TechKareer • Kochi, IN
    Mumbai / Bengaluru / Gurgaon (Hybrid : 3 days / week in office).Remote option for exceptional candidates.We’re building production-grade AI workflows and agentic applications that power real user expe...Show more
    Last updated: 30+ days ago • Promoted
    Gen AI Lead

    Gen AI Lead

    EXL • Kochi, IN
    Serve as the primary point of contact for clients in Gen AI needs, including senior executives, to understand their needs and deliver tailored generative AI solutions. Lead multiple generative AI pr...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python / / AI Engineer

    Senior Python / / AI Engineer

    Luxoft • Kochi, Kerala, India
    Project Description : Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innova...Show more
    Last updated: 9 days ago • Promoted
    AI Engineer

    AI Engineer

    Idea Elan India • Kochi, Kerala, India
    AI Engineer (2 - 4 Years Experience) Company Description : Idea Elan LLC is a product based company that provides comprehensive software solutions for research facilities in Universities and Instit...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Kochi, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Adastra • Kochi, IN
    We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
    Last updated: 17 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Focaloid Technologies • Kochi, Kerala, India
    Design and develop GenAI applications leveraging LLMs (OpenAI, Anthropic, LLaMA, Mistral, etc.Build and optimize RAG pipelines using vector databases (Pinecone, Weaviate, FAISS, Milvus, Chroma).Imp...Show more
    Last updated: 30+ days ago • Promoted
    AI Engineer

    AI Engineer

    MightyBot • Kochi, IN
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Turing • ernakulam, kerala, in
    Turing is looking for people with LLM experience to join us in solving business problems for our Fortune 500 customers.You will be a key member of the Turing GenAI delivery organization and part of...Show more
    Last updated: 27 days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Avensys Consulting UK • Kochi, Kerala, India
    Role : Gen AI Engineer Location : Remote Contract : 06 Months Rate : 450-500 GBP Per Day – Inside IR35 MAX The Gen AI Engineer will be a specialized type of artificial intelligence professional, focus...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Kochi, Kerala, India
    TCS present an excellent opportunity for Data Engineer.Experience required : 7- 12 yrs.Skills : Python, Pyspark, SQL, GCP. Walk in Interview Date : 22-Nov-25 (Saturday).Address : TCS Center, Infopark Ko...Show more
    Last updated: 17 days ago • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment Solutions • Kochi, Kerala, India
    Job Benefits : Title - AI Engineer Location - Remote Pay starts from 150,000 INR per Month Type - Full-time We’re hiring on behalf of our client, a fast-growing, AI-first company building cuttin...Show more
    Last updated: 24 days ago • Promoted
    AI Applications Engineer

    AI Applications Engineer

    Linksoft Technologies • ernakulam, kerala, in
    Position : AI Applications Engineer.We’re building agentic AI apps for real business use—voice / chat agents that orchestrate workflows across CRMs / ERPs and internal tools. You’ll help us shipfeatures ...Show more
    Last updated: 1 day ago • Promoted
    AI Data Engineer

    AI Data Engineer

    Turing • Kochi, IN
    We’re looking for experienced AI data engineers skilled in Python to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models ...Show more
    Last updated: 2 days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Kochi, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 27 days ago • Promoted
    AI Engineer (Gen AI, Agentic AI)

    AI Engineer (Gen AI, Agentic AI)

    Chetty Technologies • Kochi, IN
    Chetty Technologies is a specialized technology company with expertise in delivering advanced consulting services to industries including Banking & Finance, Telecom, Healthcare, and Hospitality.Wit...Show more
    Last updated: 8 days ago • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIG • Kochi, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show more
    Last updated: 30+ days ago • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Philodesign Technologies Inc • Kochi, IN
    Gen AI Engineer – Remote | 6+ Years Experience.We are seeking a highly skilled.AI / ML and Generative AI solutions.The ideal candidate will have practical expertise in. RAG pipelines, agent workflows,...Show more
    Last updated: 24 days ago • Promoted