Talent.com
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • guwahati, India
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • guwahati, India
22 hours ago
Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
  • Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
  • Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
  • Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
  • Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
  • Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

  • Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.
  • Develop custom Python-based data automation frameworks to improve quality and speed.
  • Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.
  • Create and manage API-based data ingestion / integration workflows.
  • Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.
  • Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.
  • Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.
  • Continuously optimize pipelines for performance, cost, scalability, and reliability.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science / Engineering / IT.
  • Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.
  • Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.
  • Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.
  • Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
  • Create a job alert for this search

    Senior Data Engineer • guwahati, India

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    Mastek • guwahati, assam, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
    Last updated: 30+ days ago • Promoted
    Python Developer

    Python Developer

    Tata Consultancy Services • guwahati, assam, in
    Required Skillset : Python, OOP, Django, Fast API.Core Python Knowledge, which is most important for any framework.Libraries and Frameworks (eg : Django, FastAPI etc). At least basic knowledge of depl...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    People Prime Worldwide • guwahati, assam, in
    Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more
    Last updated: 7 hours ago • Promoted • New!
    GCP Data Pipeline Engineer

    GCP Data Pipeline Engineer

    People Prime Worldwide • guwahati, assam, in
    Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for...Show more
    Last updated: 7 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • guwahati, assam, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 29 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • guwahati, assam, in
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 7 days ago • Promoted
    Python Lead developer

    Python Lead developer

    Cognizant • guwahati, assam, in
    Should have 10+ years of Python development experience.Experience with popular Python frameworks such as Django, Flask or Pyramid. Knowledge of data science and machine learning concepts and tools.A...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • guwahati, assam, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 7 hours ago • Promoted • New!
    Data Engineer – AWS

    Data Engineer – AWS

    Recruin • guwahati, assam, in
    Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3. Build and optimize data warehouses and data lakes on AWS (Redshift, Lake F...Show more
    Last updated: 7 hours ago • Promoted • New!
    Python Developer

    Python Developer

    GoML • guwahati, assam, in
    We are in search of a passionate and skilled Python Developer to join our dynamic team.This role is ideal for someone with a profound expertise in Python and its ecosystem, focused on backend devel...Show more
    Last updated: 5 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Spocto X (A Yubi Company) • guwahati, assam, in
    Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the disco...Show more
    Last updated: 7 hours ago • Promoted • New!
    Senior Python Developer (Programming)

    Senior Python Developer (Programming)

    Jobseekerspage.com • guwahati, assam, in
    HIRING - SENIOR PYTHON DEVELOPER.Senior Python Developer (Programming).We are seeking an experienced Python Developer with strong programming skills (not scripting) to develop and optimize data con...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    Persistent Systems • guwahati, assam, in
    We are looking for a Data Engineer with Python AWS experience.Job Type : Full Time Employment.Understand the domain for which the entities are being created. Understand the entity creation process fr...Show more
    Last updated: 10 days ago • Promoted
    ETL Data Engineer

    ETL Data Engineer

    BPMLinks • guwahati, assam, in
    In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python Developer

    Senior Python Developer

    Aarav Solutions • guwahati, assam, in
    Aarav Solutions is a global Product Engineering and IT Consulting services provider.Our goal is to enable organizations in their digital transformation journey, leveraging our domain knowledge and ...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • guwahati, assam, in
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • guwahati, assam, in
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India).Python, SQL, Big Data, Cloud, Snowflake.We are looking for an experienced. The ideal candidate will have deep experience in.Python, SQL...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    K&K Talents • guwahati, assam, in
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 1 day ago • Promoted