Talent.com
No longer accepting applications
Data Engineer – Etl & Pipeline Development (5 To 10 Yrs)

Data Engineer – Etl & Pipeline Development (5 To 10 Yrs)

AIMLEAPRaipur, Republic Of India, IN
7 days ago
Job description

Data Engineer – ETL & Pipeline Development

Experience : 5 to 10 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–10 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL.
  • Strong command of Python programming for data transformation, orchestration, and automation (e.G., using Pandas, Airflow, or custom schedulers).
  • Solid experience in writing complex SQL queries, optimizing database performance, and designing schemas for large-scale systems.
  • Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.).
  • Practical exposure to Docker, Kubernetes, and CI / CD pipelines for automating and deploying ETL and data workloads.
  • Familiarity with AI-driven data pipelines or automation workflows is an added advantage.

Responsibilities :

  • Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems.
  • Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality.
  • Build and maintain high-performance SQL queries and database structures to support analytics and AI teams.
  • Develop and integrate API-based data ingestion systems (internal and external).
  • Deploy and manage workloads using Docker, Kubernetes, and CI / CD tools ensuring high availability and version control.
  • Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions.
  • Implement data validation, monitoring, and alerting mechanisms for production pipelines.
  • Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • Proficiency in Python (FastAPI, Flask, or Django), SQL, and REST API design.
  • Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP / Azure components.
  • Hands-on exposure to Docker, Kubernetes, and Git-based CI / CD workflows.
  • Excellent problem-solving, debugging, and analytical skills with an ownership mindset.
  • Create a job alert for this search

    Data Pipeline Engineer • Raipur, Republic Of India, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Digitalzoneraipur, chattisgarh, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 13 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Cimpressraipur, chattisgarh, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 13 days ago
    • Promoted
    GCP Data engineer

    GCP Data engineer

    Tata Consultancy Servicesraipur, chattisgarh, in
    Greetings from Tata Consulting Services.TCS is Hiring for GCP Data engineer.GCP Data engineer, Pyspark, Data proc, Data flow.Show moreLast updated: 8 days ago
    • Promoted
    Big Data Developer(Hive, Pyspark)

    Big Data Developer(Hive, Pyspark)

    Tata Consultancy Servicesraipur, chattisgarh, in
    Big Data Developer(Hive, Pyspark).Years of Experience : 4 to 10 yrs.Location : Bengaluru,Chennai,Hyderabad.Date of Interview : 6th Nov, 2025. Mode of Interview : Virtual Drive( Cisco or WebEx).Hands-on ...Show moreLast updated: 26 days ago
    • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Incraipur, chattisgarh, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 12 days ago
    • Promoted
    Market Data Infrastructure Engineer - TREP, DACS (India / Remote)

    Market Data Infrastructure Engineer - TREP, DACS (India / Remote)

    Amaris Consultingraipur, chattisgarh, in
    Remote
    Amaris Consulting is an independent technology consulting firm with a global footprint, bringing together diverse talents from various backgrounds to deliver innovative solutions to clients worldwi...Show moreLast updated: 13 days ago
    • Promoted
    Unix & Cloud Data Support Engineer (ETL / AWS / Java Debugging / India)

    Unix & Cloud Data Support Engineer (ETL / AWS / Java Debugging / India)

    Amaris Consultingraipur, chattisgarh, in
    Amaris Consulting is an independent technology consulting firm with a global footprint, bringing together diverse talents from various backgrounds to deliver innovative solutions to clients worldwi...Show moreLast updated: 11 days ago
    • Promoted
    Data Analyst

    Data Analyst

    Scry AIraipur, chattisgarh, in
    Years in Data Analysis, Reporting, or Business Intelligence in Tech or SaaS.Scry AI is a research-led enterprise AI company that builds intelligent platforms for BFSI, insurance, logistics, and ind...Show moreLast updated: 13 days ago
    • Promoted
    ETL Developer

    ETL Developer

    Programmers.ioraipur, chattisgarh, in
    Shift Timings : General Shift (12 : 00 PM IST till 9 : 00 PM or 9 : 30 PM IST).Location : PAN India-Remote Until Office Resume, Work from Home. Experience required : 5 to 8 years.Design, develop, and maintai...Show moreLast updated: 10 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    CodeMyMobileraipur, chattisgarh, in
    Experience Required - 7 to 10 Years.Are you a Data Engineer who cares about clean engineering, autonomy, and solving real data challenges? If this sounds like you, we’d love to connect!.Email your ...Show moreLast updated: 12 days ago
    • Promoted
    Prompt Engineer

    Prompt Engineer

    Innodata Inc.raipur, chattisgarh, in
    Demonstrated experience programmatically using LLMs to automate data labeling, classification, localization and annotation tasks. Strong expertise in Python for NLU, for data processing & transforma...Show moreLast updated: 12 days ago
    • Promoted
    • New!
    Sr Data Engineer (Python + Polars)

    Sr Data Engineer (Python + Polars)

    iVoyantraipur, India
    Our client is looking for a Senior Python Data Engineer who not only builds pipelines but also understands business context, data modeling, and why certain schemas or architectures are used.They ex...Show moreLast updated: 5 hours ago
    • Promoted
    Lead AI Engineer

    Lead AI Engineer

    Blendraipur, chattisgarh, in
    We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show moreLast updated: 8 days ago
    • Promoted
    Sr Data Engineer - DBT Tech Lead

    Sr Data Engineer - DBT Tech Lead

    Ascendionraipur, chattisgarh, in
    We are seeking an experienced Senior DBT Technical lead to be part of our upcoming data 2025-2026 data initiatives.This role requires deep expertise in dbt, cloud data platforms, and complex ETL / EL...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesraipur, chattisgarh, in
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog Labsraipur, chattisgarh, in
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    HCLTechraipur, India
    We are inviting experienced GCP Data Engineers to participate in our exclusive F2F Hackathon scheduled on 22nd Nov 2025.If you are passionate about building scalable data solutions on Google Cloud ...Show moreLast updated: 5 hours ago
    • Promoted
    Lead Data Analyst

    Lead Data Analyst

    Pretium Enterprise Services, Indiaraipur, chattisgarh, in
    Design, develop, and maintain interactive dashboards and reports using Power BI.Write optimized SQL queries for data extraction, transformation, and analysis across multiple databases.Perform advan...Show moreLast updated: 9 days ago