Talent.com
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • Bengaluru, IN
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • Bengaluru, IN
9 hours ago
Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
  • Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
  • Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
  • Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
  • Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
  • Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

  • Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.
  • Develop custom Python-based data automation frameworks to improve quality and speed.
  • Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.
  • Create and manage API-based data ingestion / integration workflows.
  • Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.
  • Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.
  • Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.
  • Continuously optimize pipelines for performance, cost, scalability, and reliability.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science / Engineering / IT.
  • Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.
  • Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.
  • Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.
  • Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
  • Create a job alert for this search

    Senior Data Engineer • Bengaluru, IN

    Related jobs
    Senior Python Developer

    Senior Python Developer

    Aarav Solutions • hosur, tamil nadu, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Bengaluru, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 19 days ago • Promoted
    Senior Python / FastAPI Development Lead

    Senior Python / FastAPI Development Lead

    MindBrain • hosur, tamil nadu, in
    Python / FastAPI Development Lead.Python), 3+ years (FastAPI), 4+ years (Team Leadership).We are looking for a Python / FastAPI Development Lead to design, develop, and maintain high-quality backend ...Show more
    Last updated: 6 hours ago • Promoted • New!
    Python Developer

    Python Developer

    MyData Insights Pvt Ltd • hosur, tamil nadu, in
    We are seeking a Python / FastAPI Development Lead with strong expertise in FastAPI to join an exciting Reinforcement Learning (RL) Gym project. You will design, build, and optimize scalable APIs, col...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Delta Air Lines • Bengaluru, India
    Design, architect, and optimize Teradata EDW solutions with a focus on performance, scalability, and maintainability.Lead performance tuning efforts using TASM and other workload management tools.D...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python - FastAPI Development Lead (8+ Years)

    Senior Python - FastAPI Development Lead (8+ Years)

    MindBrain • hosur, tamil nadu, in
    Hiring : Python / FastAPI Development Lead.Remote | 🧑‍💻 8+ Years Experience | ⏳ Duration : 2 Months (Extendable).Python / FastAPI Development Lead. The ideal candidate will own the full API lifecycle—...Show more
    Last updated: 6 hours ago • Promoted • New!
    ETL & Tableau Data Engineer

    ETL & Tableau Data Engineer

    Magma Consultancy • hosur, tamil nadu, in
    ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show more
    Last updated: 3 days ago • Promoted
    Azure-ETL Engineer

    Azure-ETL Engineer

    Coforge • hosur, tamil nadu, in
    The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs. Design, implement, and maintain d...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Ubique Systems • Bengaluru, Karnataka, India
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show more
    Last updated: 2 days ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • Bangalore, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 9 hours ago • Promoted • New!
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • bangalore district, karnataka, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 6 days ago • Promoted
    Contract Role - Senior Data Engineer - Python / Data Pipeline / Unit Testing / Building CI-CD - INR 50 L

    Contract Role - Senior Data Engineer - Python / Data Pipeline / Unit Testing / Building CI-CD - INR 50 L

    CareerXperts Consulting • Bengaluru, Karnataka, India
    Our client is looking for a talented experienced software development consultants, specializing in Agile Delivery.A place where you are a polyglot, working alongside the client,.A world where you a...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Quantiphi • Greater Bengaluru Area, India
    Job Title : Senior Data Engineer (Power BI).Location : Bangalore / Mumbai / Hybrid.We are seeking a skilled and proactive. The ideal candidate will be responsible for designing, developing, and publish...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • hosur, tamil nadu, in
    TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show more
    Last updated: 28 days ago • Promoted
    Python Developer

    Python Developer

    Tata Consultancy Services • hosur, tamil nadu, in
    Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc). At least basic knowledge of depl...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python Developer (Programming)

    Senior Python Developer (Programming)

    Jobseekerspage.com • hosur, tamil nadu, in
    HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    K&K Talents • hosur, tamil nadu, in
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • bangalore, karnataka, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted