Talent.com
AI Engineer (Data Pipelines & RAG)

AI Engineer (Data Pipelines & RAG)

BeGigKottayam, IN
2 days ago
Job description

Job Role- AI Engineer (Data Pipelines & RAG)

Job Type- Full-time

Work Mode- Remote(6 days working)

We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL / ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup environment.

What You’ll Do

Data Pipelines & Modeling

  • Build scalable ETL / ELT pipelines (batch & streaming) using Python + Spark
  • Automate ingestion from databases, APIs, files, SharePoint and other document sources
  • Process & structure unstructured files (PDFs, tables, charts, drawings, etc.)
  • Own chunking, indexing & embedding strategies for RAG / LLM use cases
  • Design logical & physical data models, schema mappings & data dictionaries

GenAI & RAG Integration

  • Feed real-time data into LLM prompts
  • Build retrieval workflows for downstream agent / RAG systems in RE / Construction
  • Observability & Governance

  • Implement monitoring, alerting & logging for pipeline reliability
  • Apply IAM, Unity Catalog and other data privacy / security controls
  • CI / CD & Automation

  • Use DevOps workflows with GitHub Actions / Azure DevOps / CircleCI
  • Build reproducible infra using Terraform / ARM templates
  • Use Prefect / Airflow for orchestration
  • What You’ll Need

  • 5+ years in data engineering, with 1–2 years working on pipelines for unstructured data & RAG systems
  • Strong Python + SQL, experience with dlt, DuckDB, DVC
  • Azure cloud experience in production
  • Experience with chunking / indexing strategies for RAG
  • Strong Git / CI / CD workflows
  • Familiarity with Prefect or equivalent
  • Good to Have : MLflow, Docker / K8s, Computer Vision, agentic AI concepts, governance & privacy frameworks (GDPR)
  • Create a job alert for this search

    Data Pipeline Engineer • Kottayam, IN

    Related jobs
    • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Calyx GlobalKochi, IN
    Calyx Global is a ClimateTech startup founded by Donna Lee and Duncan van Bergen, backed by Sequoia, Susquehanna (SIG), New Climate Ventures, and others. We provide ratings and research on the globa...Show moreLast updated: 1 day ago
    • Promoted
    AI Data Engineer

    AI Data Engineer

    Peak Trust Global Real EstateKochi, IN
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show moreLast updated: 2 days ago
    • Promoted
    AI Engineer

    AI Engineer

    Idea Elan IndiaKochi, IN
    AI Engineer (2 - 4 Years Experience).Idea Elan LLC is a product based company that provides comprehensive software solutions for. Universities and Institutions worldwide.We are seeking a skilled AI ...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeAlappuzha, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    Aura Recruitment SolutionsKottayam, IN
    Pay starts from 150,000 INR per Month.We’re hiring on behalf of our client, a fast-growing, AI-first company building cutting-edge AI-native applications that transform complex, real-world data int...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RecroKottayam, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Sr AI Engineer

    Sr AI Engineer

    Litmus7Kochi, Kerala, India
    As part of this initiative, resource should research and experiment with the latest AI and cloud innovations (such as AWS Agents, Databricks AI, and other Model Context Protocol (MCP integrations),...Show moreLast updated: 14 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Focaloid TechnologiesKochi, Kerala, India
    Design and develop GenAI applications leveraging LLMs (OpenAI, Anthropic, LLaMA, Mistral, etc.Build and optimize RAG pipelines using vector databases (Pinecone, Weaviate, FAISS, Milvus, Chroma).Imp...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    MightyBotKochi, IN
    Join our team as an AI Engineer, where we're focused on graduating AI from interesting demos to indispensable products.You will build reliable, self-improving systems that empower subject matter ex...Show moreLast updated: 30+ days ago
    • Promoted
    AI Engineer

    AI Engineer

    TechWaves RecruitmentAlappuzha, IN
    Location : Role is remote, however you must be based within a City location in India.Our client who provides world’s leading Agent and Agentic solution platform designed for teams looking to streaml...Show moreLast updated: 15 days ago
    • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    LuxoftKottayam, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TEKsystemsKochi, IN
    Location - Remote or Delhi or Hyderabad or Bangalore or Pune.Proficiency in Python and experience maintaining data-driven applications. Hands-on experience with ETL pipeline development, schema desi...Show moreLast updated: 30+ days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    CodewallaKottayam, IN
    Codewalla is a New York–based product studio with engineering teams in India.Since 2005, we’ve built innovative products that scale. We work at the intersection of design, engineering, and AI develo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AceolutionKochi, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago
    • Promoted
    AI and Databricks Engineer

    AI and Databricks Engineer

    Quantum Integratorsmount, kerala, in
    Please find the detailed Job Description below : .Strong experience developing industry grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers.Hands-on experienc...Show moreLast updated: 1 day ago
    • Promoted
    Applied AI Engineer

    Applied AI Engineer

    Strategic Talent PartnerKochi, IN
    Design and deploy advanced multi-agent pipelines for credit analysis.Optimize inference and prompt chains using frameworks like DSPy, GEPA, and LangChain. Implement reasoning techniques (CoT, ToT, G...Show moreLast updated: 15 days ago
    • Promoted
    Generative AI Engineer

    Generative AI Engineer

    Sesheng CompanyAlappuzha, IN
    GenAI Engineer (Semantic Search & RAG Systems).Remote in India (to work in US Time zone).You will be instrumental in designing and deploying a cutting-edge semantic search capability to power our n...Show moreLast updated: 15 days ago
    • Promoted
    Lead AI Engineer

    Lead AI Engineer

    BlendKottayam, IN
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show moreLast updated: 11 days ago