Talent.com
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • Delhi, IN
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • Delhi, IN
21 hours ago
Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
  • Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
  • Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
  • Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
  • Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
  • Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

  • Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.
  • Develop custom Python-based data automation frameworks to improve quality and speed.
  • Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.
  • Create and manage API-based data ingestion / integration workflows.
  • Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.
  • Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.
  • Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.
  • Continuously optimize pipelines for performance, cost, scalability, and reliability.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science / Engineering / IT.
  • Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.
  • Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.
  • Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.
  • Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
  • Create a job alert for this search

    Senior Data Engineer • Delhi, IN

    Related jobs
    Data Engineer

    Data Engineer

    IGT Solutions • Gurugram, Haryana, India
    We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more
    Last updated: 2 days ago • Promoted
    Contract Role - Senior Data Engineer - Python / Data Pipeline / Unit Testing / Building CI-CD - INR

    Contract Role - Senior Data Engineer - Python / Data Pipeline / Unit Testing / Building CI-CD - INR

    CareerXperts Consulting • Delhi, India
    About the job : Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery. A place where you are a polyglot, working alongside the client, enab...Show more
    Last updated: 6 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Delhi, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Delhi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    NAB • Gurugram, Haryana, India
    Proficient in executing ETL processes between data environments.Proficient at coding in SQL (additional knowledge in Python and R is highly regarded). Proficient at creating analytics related docume...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Delhi, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Delhi, Delhi, India
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India) Salary : Up to 26 LPA ️ Skills : Python, SQL, Big Data, Cloud, Snowflake Job Description : We are looking for an experienced Data Eng...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    People Prime Worldwide • Delhi, IN
    Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellify Solutions • Delhi, IN
    Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Ghaziabad, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • new delhi, delhi, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ManpowerGroup India • Gurgaon, Haryana, India
    Qualifications : Strong 5 yrs to 8 yrs experience and understanding of ADF, ETL and SSIS, Python and SQL including data warehousing concepts and data warehousing principles.Proficiency in ETL ...Show more
    Last updated: 1 day ago • Promoted
    ETL Data Engineer

    ETL Data Engineer

    BPMLinks • Delhi, IN
    In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer (Databricks)

    Lead Data Engineer (Databricks)

    SII Group India • Noida, Uttar Pradesh, India
    We are looking for a highly skilled.The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, an...Show more
    Last updated: 1 day ago • Promoted
    Lead GCP Data Engineer

    Lead GCP Data Engineer

    Impetus • Gurgaon, Haryana, India
    Job Title : Lead Data Engineer – GCP (BigQuery • Composer • Python • PySpark) Location : Gurgaon Experience : 8+ years (data engineering / analytics engineering), with previous lead responsibilities...Show more
    Last updated: 1 day ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • Ghaziabad, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 21 hours ago • Promoted • New!
    Senior Python Developer (Programming)

    Senior Python Developer (Programming)

    Jobseekerspage.com • gurugram, uttar pradesh, in
    HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more
    Last updated: 3 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav Solutions • noida, delhi, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
    Last updated: 30+ days ago • Promoted