Talent.com
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • Hyderabad, IN
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • Hyderabad, IN
1 day ago
Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
  • Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
  • Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
  • Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
  • Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
  • Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

  • Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.
  • Develop custom Python-based data automation frameworks to improve quality and speed.
  • Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.
  • Create and manage API-based data ingestion / integration workflows.
  • Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.
  • Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.
  • Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.
  • Continuously optimize pipelines for performance, cost, scalability, and reliability.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science / Engineering / IT.
  • Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.
  • Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.
  • Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.
  • Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
  • Create a job alert for this search

    Senior Data Engineer • Hyderabad, IN

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Hyderabad, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 20 days ago • Promoted
    Senior Python Developer (Programming)

    Senior Python Developer (Programming)

    Jobseekerspage.com • hyderabad, telangana, in
    HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer (Onpremise)

    Senior Data Engineer (Onpremise)

    Blend • Hyderabad, Telangana, India
    Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable ro...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior On-Premise Data Solutions Engineer

    Senior On-Premise Data Solutions Engineer

    Blend • Hyderabad, Republic Of India, IN
    Python / Scala, and modern data engineering tools to help design and implement an end-to-end data architecture for a leading enterprise client. This role is part of a strategic initiative to enable ro...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    AWS Cloud Python Data Engineer - ETL / ELT Pipelines

    AWS Cloud Python Data Engineer - ETL / ELT Pipelines

    1HResource Solutions • Hyderabad
    Data Engineer (L3) - Python & AWS Job Overview : We are seeking a highly skilled Data Engineer with strong expertise in AWS cloud services and Python ...Show more
    Last updated: 11 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    People Prime Worldwide • Hyderabad, IN
    Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Quadrant Technologies • Hyderabad, Telangana, India
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer - GCP

    Data Pipeline Engineer - GCP

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    Bangalore / Chennai / Hyderabad / Delhi.Notice Period- Immediate Joiner.Desired Skills -Technical / Behavioral.GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub / Sub, ETL, Apache airflow...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Senior Data Analyst - ETL / Python

    Senior Data Analyst - ETL / Python

    People Staffing Solutions • Hyderabad
    Key Responsibilities : - Extract, clean, and analyze large datasets using advanced SQL queries and other analytical tools. Design and perform ETL (Extract, Transform, Load) oper...Show more
    Last updated: 12 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • secunderabad, telangana, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology Insights • Hyderabad, India
    We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) and BigQuery to join our growing data team. You will be responsible for designing, building, and ...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer - AWS & Python

    Senior Data Engineer - AWS & Python

    Egen • Hyderabad, Telangana, India
    Design, develop, and maintain ETL / ELT data pipelines using Python and AWS native services (Glue, Lambda, EMR, Step Functions, etc. Build and manage data lakes and data warehouses using Amazon S3, Re...Show more
    Last updated: 5 days ago • Promoted
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    People Prime Worldwide • Hyderabad, Republic Of India, IN
    Important Note (Please Read Before Applying).You have less than 5 years or more than 10 years of total data engineering experience. You do not have strong AWS data engineering experience.You do not ...Show more
    Last updated: 30+ days ago • Promoted
    Lead / Senior Engineer - Python

    Lead / Senior Engineer - Python

    TESTQ Technologies Limited • Hyderabad
    About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • secunderabad, telangana, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Hyderabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straive • Hyderabad, Telangana, India
    Job Summary We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • hyderabad, telangana, in
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted