Talent.com
Senior Python Data Engineer – Etl & Pipeline Development (5 To 12 Yrs)
Senior Python Data Engineer – Etl & Pipeline Development (5 To 12 Yrs)AIMLEAP • Tirunelveli, Republic Of India, IN
Senior Python Data Engineer – Etl & Pipeline Development (5 To 12 Yrs)

Senior Python Data Engineer – Etl & Pipeline Development (5 To 12 Yrs)

AIMLEAP • Tirunelveli, Republic Of India, IN
1 day ago
Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
  • Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
  • Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
  • Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
  • Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
  • Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

  • Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.
  • Develop custom Python-based data automation frameworks to improve quality and speed.
  • Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.
  • Create and manage API-based data ingestion / integration workflows.
  • Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.
  • Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.
  • Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.
  • Continuously optimize pipelines for performance, cost, scalability, and reliability.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science / Engineering / IT.
  • Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.
  • Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.
  • Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.
  • Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
  • Create a job alert for this search

    Senior Data Engineer • Tirunelveli, Republic Of India, IN

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Thoothukudi, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 21 days ago • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIG • Thoothukudi, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • Thoothukudi, IN
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 2 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav Solutions • tirunelveli, tamil nadu, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Mastek • Thoothukudi, IN
    Deep hands-on experience with Unity Catalog — creating and managing catalogs, schemas, and tables.Experience automating data onboarding and metadata registration via Unity Catalog APIs or Databrick...Show more
    Last updated: 15 days ago • Promoted
    AI Engineer (Backend) - Python

    AI Engineer (Backend) - Python

    Edstem Technologies • Thoothukudi, IN
    We are building the next generation of AI-powered applications that deliver actionable financial and marketing insights to our clients. As an AI Engineer focused on backend development, you'll be in...Show more
    Last updated: 7 days ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • Thoothukudi, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 2 days ago • Promoted
    Senior Python / / AI Engineer

    Senior Python / / AI Engineer

    Luxoft • Thoothukudi, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 8 hours ago • Promoted • New!
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • thoothukudi, tamil nadu, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Thoothukudi, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    Luxoft • Thoothukudi, IN
    Our client, one of the leading Agriculture Companies, is modernising their landscape and adopting AI and innovations in their process. We are seeking a highly skilled and innovative Python / AI Engine...Show more
    Last updated: 18 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    HISH IT SERVICES • tirunelveli, tamil nadu, in
    Role : Senior Python Developer.Location : Remote(Banglore,Chennai,Pune).Pay : 23LPA - 27 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12...Show more
    Last updated: 11 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Thoothukudi, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 5 days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    Rapid Innovation • thoothukudi, tamil nadu, in
    Job Title : Senior Python Developer (5–6 Years Experience).We are looking for an experienced Senior Python Developer who can design, build, and optimise scalable backend systems.You will work closel...Show more
    Last updated: 3 hours ago • Promoted • New!
    Lead Data Engineer - Python & SQL

    Lead Data Engineer - Python & SQL

    Intellismith • thoothukudi, tamil nadu, in
    At Intellismith, we power digital transformation for enterprises while closing the skills gap across India.Since 2019, we’ve delivered innovative HR solutions, technology resource outsourcing, and ...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    IntraEdge • Thoothukudi, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Thoothukudi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Intellify Solutions • Thoothukudi, IN
    Total years of experience : 10+ years.Required : Bachelor’s degree or relevant experience.Required : Prior experience as a software engineer or data engineer in a. Required : Cloud Data Warehouse experi...Show more
    Last updated: 12 days ago • Promoted