Talent.com
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • secunderabad, telangana, in
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • secunderabad, telangana, in
2 days ago
Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
  • Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
  • Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
  • Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
  • Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
  • Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

  • Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.
  • Develop custom Python-based data automation frameworks to improve quality and speed.
  • Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.
  • Create and manage API-based data ingestion / integration workflows.
  • Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.
  • Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.
  • Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.
  • Continuously optimize pipelines for performance, cost, scalability, and reliability.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science / Engineering / IT.
  • Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.
  • Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.
  • Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.
  • Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
  • Create a job alert for this search

    Senior Data Engineer • secunderabad, telangana, in

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Hyderabad, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 21 days ago • Promoted
    Senior Python / / AI Engineer

    Senior Python / / AI Engineer

    Luxoft • Hyderabad, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 12 hours ago • Promoted • New!
    Azure Senior Data Engineer

    Azure Senior Data Engineer

    Tata Consultancy Services • Hyderabad, Republic Of India, IN
    TCS is hiring for AWS Data Engineer.Extensive coding experience including Python / Pyspark.Experience developing in Azure with key data technologies (e. ADLS, ADF, Azure Databricks etc.Software develo...Show more
    Last updated: 16 days ago • Promoted
    Python Engineer (Airflow, Cloud)

    Python Engineer (Airflow, Cloud)

    Luxoft • hyderabad, telangana, in
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • Hyderabad, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Quadrant Technologies • Hyderabad, Telangana, India
    Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Luxoft • Hyderabad, Republic Of India, IN
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 11 hours ago • Promoted • New!
    Senior Data Analyst - ETL / Python

    Senior Data Analyst - ETL / Python

    People Staffing Solutions • Hyderabad
    Key Responsibilities : - Extract, clean, and analyze large datasets using advanced SQL queries and other analytical tools. Design and perform ETL (Extract, Transform, Load) oper...Show more
    Last updated: 13 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • secunderabad, telangana, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 8 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    People Prime Worldwide • Hyderabad, Telangana, India
    Job Description : Key Responsibilities : • Design, develop, test, and maintain scalable ETL data pipelines using Python.Work extensively on Google Cloud Platform (GCP) services such as : ○ Dataflo...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Adaptive Technology Insights • Hyderabad, India
    We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) and BigQuery to join our growing data team. You will be responsible for designing, building, and ...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer - AWS & Python

    Senior Data Engineer - AWS & Python

    Egen • Hyderabad, Telangana, India
    Design, develop, and maintain ETL / ELT data pipelines using Python and AWS native services (Glue, Lambda, EMR, Step Functions, etc. Build and manage data lakes and data warehouses using Amazon S3, Re...Show more
    Last updated: 6 days ago • Promoted
    Lead / Senior Engineer - Python

    Lead / Senior Engineer - Python

    TESTQ Technologies Limited • Hyderabad
    About the Opportunity : We are seeking a highly skilled Lead / Senior Engineer Python / Data / AI to design and build large-scale data-driven systems and AI-powered...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • secunderabad, telangana, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Hyderabad, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Innova Solutions • Hyderabad, Telangana, India
    INNOVA Hiring Immediate Joiner For.AWS Data Engineer with SCD -1 / 2 ,AWS, SQL, Pyspark, Python @ Hyderabad, Chennai, Noida. JD : The role focuses on ETL development, AWS Cloud technologies (Glue, Athe...Show more
    Last updated: 21 days ago • Promoted
    EverestDX - Senior Data Engineer - Python / PySpark

    EverestDX - Senior Data Engineer - Python / PySpark

    EverestDX • Hyderabad
    Description : Job Summary : - We are seeking an experienced Azure Data Engineer / Lead with strong expertise in Azure servic...Show more
    Last updated: 6 days ago • Promoted
    Senior Python Developer (Programming)

    Senior Python Developer (Programming)

    Jobseekerspage.com • secunderabad, telangana, in
    HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more
    Last updated: 5 days ago • Promoted