Talent.com
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)AIMLEAP • guwahati, India
No longer accepting applications
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

AIMLEAP • guwahati, India
5 days ago
Job description

Senior Python Data Engineer – ETL & Pipeline Development

Experience : 5 to 12 Years

Location : Remote (WFH) / Bangalore / India

Mode of Engagement : Full-time

No. of Positions : 5

Educational Qualification : B.E / B.Tech / M.Tech / MCA / Computer Science / IT

Industry : IT / Data / AI / LegalTech / Enterprise Solutions

Notice Period : Immediate Joiners Preferred

What We Are Looking For :

  • 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL).
  • Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers).
  • Ability to write complex SQL queries, optimize performance, and design scalable database schemas.
  • Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines.
  • Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.).
  • Hands-on exposure to Docker, Kubernetes, and CI / CD for deploying ETL & data workloads.
  • Experience building or working with AI-driven / automated data pipelines (preferred).

Responsibilities :

  • Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading.
  • Develop custom Python-based data automation frameworks to improve quality and speed.
  • Build and optimize SQL queries, tables, and database structures for analytics & AI use cases.
  • Create and manage API-based data ingestion / integration workflows.
  • Deploy and maintain workloads using Docker, Kubernetes, and CI / CD tools.
  • Collaborate with product, AI, and analytics teams to deliver intelligent data solutions.
  • Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines.
  • Continuously optimize pipelines for performance, cost, scalability, and reliability.
  • Qualifications :

  • Bachelor’s or Master’s degree in Computer Science / Engineering / IT.
  • Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development.
  • Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster).
  • Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP / Azure equivalents.
  • Hands-on experience with Docker, Kubernetes, and Git-based CI / CD workflows.
  • Strong debugging, problem-solving, and analytical capabilities with ownership mindset.
  • Create a job alert for this search

    Senior Data Engineer • guwahati, India

    Related jobs
    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    AI Engineer - GPT / LangChain / RAG / Data Pipelines

    Peak Trust Global Real Estate • guwahati, assam, in
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 14 hours ago • Promoted • New!
    Ai Data Engineer - 17852

    Ai Data Engineer - 17852

    Aarav Solutions • Guwahati, Republic Of India, IN
    AI Engineer (Backend) – PythonKey ResponsibilitiesDevelopment- Design and develop Python backend services using FastAPI FastAPI for AI-poweredapplications- Implement agentic workflows using LangCha...Show more
    Last updated: 12 days ago • Promoted
    Python Developer With Test Driven Development (TDD)

    Python Developer With Test Driven Development (TDD)

    ENCORE IT SOLUTIONS • guwahati, assam, in
    Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap). Candidate should be comfortable wo...Show more
    Last updated: 14 hours ago • Promoted • New!
    Generative AI Engineer

    Generative AI Engineer

    Live Connections • guwahati, assam, in
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field; Master’s or PhD preferred. ML / Data Science with a focus on generative AI, LLMs, or co...Show more
    Last updated: 16 days ago • Promoted
    Azure Senior Data Engineer

    Azure Senior Data Engineer

    Mastek • Guwahati, Republic Of India, IN
    Greetings from TCS!!!!TCS is hiring for AWS Data EngineerExperience : 5 to 10yrsLocation : Pan IndiaMode of Driving : VirtualDate : 15-Nov-25 (Saturday)Job Description : Technical Experience 4+ years’ ...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior Data Science Engineer

    Senior Data Science Engineer

    Confidential • Guwahati, India
    INR 3000000-4000000 / year (based on experience).Full Time Permanent position(Payroll and Compliance to be managed by : Winmore). Note : This is a requirement for one of Uplers' client - Winmore).What...Show more
    Last updated: 18 days ago • Promoted
    Python for Machine Learning

    Python for Machine Learning

    People Prime Worldwide • Guwahati, Assam, India
    About the Company : Our client is a trusted global innovator of IT and business services.They help clients transform through consulting, industry solutions, business process services, digital & IT m...Show more
    Last updated: 2 days ago • Promoted
    Python Developer With Test Driven Development

    Python Developer With Test Driven Development

    ENCORE IT SOLUTIONS • Guwahati, Republic Of India, IN
    Job Description – Senior Python Developer – Service Implementation (TDD) (Contract).Short-term Contract (9 months).Flexible (8 hours / day with 4 hours PST overlap). Candidate should be comfortable wo...Show more
    Last updated: 9 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Grantify • guwahati, assam, in
    Grantify is an innovative education platform that connects students and universities through a transparent admissions and tuition-matching ecosystem. By aligning student budgets and academic aspirat...Show more
    Last updated: 14 hours ago • Promoted • New!
    The Sourcing Team - Tableau Developer - Python / SQL

    The Sourcing Team - Tableau Developer - Python / SQL

    The Sourcing Team Pvt Ltd • Guwahati
    Job Description : - Design, develop, conducts unit testing, and maintains complex Tableau reports for scalability, manageability, extensibility, perf...Show more
    Last updated: 30+ days ago • Promoted
    PySpark Developer - Data Platform

    PySpark Developer - Data Platform

    Xped pvt Ltd • Guwahati
    Description : Key Responsibilities : - As part of the Infosys delivery team your primary role would be to inte...Show more
    Last updated: 19 days ago • Promoted
    Python Developer - 17852

    Python Developer - 17852

    Turing • guwahati, India
    We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and...Show more
    Last updated: 30+ days ago • Promoted
    Python Developer

    Python Developer

    TekXera • guwahati, assam, in
    Senior Python Engineer – Service Implementation.India | Pakistan | Nigeria | Kenya | Egypt | Ghana | Bangladesh | Turkey | Mexico. Full-Time Contract (9 Months, Extendable).San Francisco–based AI re...Show more
    Last updated: 14 hours ago • Promoted • New!
    Generative Ai Engineer

    Generative Ai Engineer

    Live Connections • Guwahati, Republic Of India, IN
    Required Notice Period - Immediate Joiners or Serving Notice or 30 days.Bachelor’s in CS / ML / AI or related field;.ML / Data Science with a focus on generative AI, LLMs, or computer vision.Expertise in...Show more
    Last updated: 16 days ago • Promoted
    Freelance Data Engineer

    Freelance Data Engineer

    Leading MNC • guwahati, assam, in
    Looking for a Freelance Data Engineer to join a team of rockstar developers.The candidate should have a minimum of 8+ yrs. If you're looking for freelance / part time opportunity (along with your day...Show more
    Last updated: 13 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Primesoft Inc • guwahati, assam, in
    Primesoft Enterprise IT Services Pvt.As a Software Engineer II - Data, you will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learnin...Show more
    Last updated: 30+ days ago • Promoted
    Freelance Python Full Stack Engineer

    Freelance Python Full Stack Engineer

    Leading MNC • Guwahati, Republic Of India, IN
    Looking for a Freelance Python Full Stack Engineer to join a team of rockstar developers.The candidate should have a minimum of 5+ yrs. If you're looking for freelance / part time opportunity (along ...Show more
    Last updated: 3 days ago • Promoted
    Ai Engineer - Gpt / Langchain / Rag / Data Pipelines

    Ai Engineer - Gpt / Langchain / Rag / Data Pipelines

    Peak Trust Global Real Estate • Guwahati, Republic Of India, IN
    This role requires strong technical skills across Python, automation, ML tooling, and analytical reporting.Key Responsibilities (Technical). Build automated data collection workflows using tools suc...Show more
    Last updated: 10 hours ago • Promoted • New!