Talent.com
Data Engineer – ETL & Pipeline Development (5 to 10 yrs)
Data Engineer – ETL & Pipeline Development (5 to 10 yrs)AIMLEAP • gandhinagar, gujarat, in
No longer accepting applications
Data Engineer – ETL & Pipeline Development (5 to 10 yrs)

Data Engineer – ETL & Pipeline Development (5 to 10 yrs)

AIMLEAP • gandhinagar, gujarat, in
10 days ago
Job description

Data Engineer – ETL & Pipeline Development

Experience : 5 to 10 Years

Location : Remote (Work from Home) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–10 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL.
  • Strong command of Python programming for data transformation, orchestration, and automation (e.g., using Pandas, Airflow, or custom schedulers).
  • Solid experience in writing complex SQL queries, optimizing database performance, and designing schemas for large-scale systems.
  • Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.).
  • Practical exposure to Docker, Kubernetes, and CI / CD pipelines for automating and deploying ETL and data workloads.
  • Familiarity with AI-driven data pipelines or automation workflows is an added advantage.

Responsibilities :

  • Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems.
  • Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality.
  • Build and maintain high-performance SQL queries and database structures to support analytics and AI teams.
  • Develop and integrate API-based data ingestion systems (internal and external).
  • Deploy and manage workloads using Docker, Kubernetes, and CI / CD tools ensuring high availability and version control.
  • Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions.
  • Implement data validation, monitoring, and alerting mechanisms for production pipelines.
  • Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • Proficiency in Python (FastAPI, Flask, or Django), SQL, and REST API design.
  • Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP / Azure components.
  • Hands-on exposure to Docker, Kubernetes, and Git-based CI / CD workflows.
  • Excellent problem-solving, debugging, and analytical skills with an ownership mindset.
  • Create a job alert for this search

    Data Pipeline Engineer • gandhinagar, gujarat, in

    Related jobs
    Data Engineer

    Data Engineer

    Alp Consulting Ltd. • Gandhinagar, IN
    Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (4 to 6 Years exp)

    Data Engineer (4 to 6 Years exp)

    DXFactor • Ahmedabad, Gujarat, India
    DXFactor is a US-based tech company working with customers across the globe.We are a Great place to work with certified company. We are looking for candidates for Data Engineer (4 to 6 Yrs exp) ...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Ahmedabad, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Ubique Systems • Gandhinagar, IN
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Ahmedabad, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Gandhinagar, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer - Python & GCP || Contract Job || 8-10 Years Experience

    Lead Data Engineer - Python & GCP || Contract Job || 8-10 Years Experience

    People Prime Worldwide • Gandhinagar, IN
    Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA.Founded in 1996, with a revenue of $1. B, with 35,000+ associates worldwide, specializes in digital engin...Show more
    Last updated: 3 hours ago • Promoted • New!
    LEAD DATA ENGINEER

    LEAD DATA ENGINEER

    Prophecy Technologies • Gandhinagar, IN
    We’re Hiring : LEAD DATA ENGINEER.Notice Period : Immediate to 30 Days.Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse.Develop ETL / ELT work...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Quality Engineer (Python + ETL)

    Data Quality Engineer (Python + ETL)

    Tata Consultancy Services • Gandhinagar, IN
    TCS Inviting Application for Walk-in Interview on 26th Nov 25 in Bangalore.Hands-on experience with Data Testing either with. Deep understanding of data test concepts primarily inclined towards.Hand...Show more
    Last updated: 3 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Ahmedabad, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Data Engineer | Bangalore | Leading Big 4 Consulting Firm

    Acme Services • Ahmedabad, IN
    Design, develop, and maintain scalable and robust data pipelines (ETL / ELT) using PySpark on the Databricks platform.Implement data ingestion strategies to load data from various sources (e.APIs, da...Show more
    Last updated: 3 hours ago • Promoted • New!
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancy • Gandhinagar, IN
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show more
    Last updated: 3 hours ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    HCLTech • Ahmedabad, IN
    Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Gandhinagar, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 16 days ago • Promoted
    ETL Developer

    ETL Developer

    Programmers.io • ahmedabad, gujarat, in
    Shift Timings : General Shift (12 : 00 PM IST till 9 : 00 PM or 9 : 30 PM IST).Location : PAN India-Remote Until Office Resume, Work from Home. Experience required : 5 to 8 years.Design, develop, and maintai...Show more
    Last updated: 13 days ago • Promoted
    Lead ETL ODI

    Lead ETL ODI

    Vienna Consultancy • Ahmedabad, IN
    We are seeking a skilled and experienced Data Integration Specialist with over 9 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI).The ideal candidat...Show more
    Last updated: 3 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Advantmed • Ahmedabad, Gujarat, India
    Lead Data Engineer – Azure Cloud.We are looking for an experienced.The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologi...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Gandhinagar, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted