Talent.com
Python Data Engineer
Python Data EngineerConfidential • Chennai, India
Python Data Engineer

Python Data Engineer

Confidential • Chennai, India
25 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor's / Master's Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Skills Required

    Agile Methodologies, Scala, Sql, Hive, Mysql, snowflake , Spark, Data Lake, Python

    Create a job alert for this search

    Data Engineer Python • Chennai, India

    Related jobs
    Data Engineer

    Data Engineer

    Aceolution • chennai, tamil nadu, in
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer-Airflow, Python,Pyspark, Databricks

    Data Engineer-Airflow, Python,Pyspark, Databricks

    NielsenIQ • Chennai, Tamil Nadu, India
    Were seeking a highly motivated Data Engineer to join our agile cross-functional team and drive end-to-end data pipeline development in a cloud-native big data ecosystem. Youll leverage ETL / ELT best...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Saint Thomas Mount, Tamil Nadu, India
    Greetings from TCS!!! TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • chennai, tamil nadu, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 8 days ago • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIG • Chennai, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show more
    Last updated: 30+ days ago • Promoted
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Syntasa • Chennai, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    LTIMindtree • Chennai, Tamil Nadu, India
    Ready to trade your to-do list for a to-do the impossible list?.Join a team that's building the future of IIOT.We have arranged a Walk-In Drive on 1-Nov ( Saturday). Location : L&T Innovation Campus...Show more
    Last updated: 30+ days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    SIRO • chennai, tamil nadu, in
    Good Python Programming with 6 years of experience; PyCharm; Well versed in AWS tools , will be good if AWS architect certified. GitHub; GitAction; Experience in deploying Data Pipelines.Good commu...Show more
    Last updated: 13 days ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • Chennai, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 2 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • Greater Chennai Area, India
    TCS is hiring for AzureData Engineer.Extensive coding experience including Python / Pyspark.Experience developing in Azure with key data technologies (e. ADLS, ADF, Azure Databricks etc.Software devel...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer (DOMO & Python / Kafka)

    Data Engineer (DOMO & Python / Kafka)

    Smart Moves Consultants • chennai, tamil nadu, in
    We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest. Design, build, and maintain scala...Show more
    Last updated: 17 hours ago • Promoted • New!
    Data Engineer (Airflow +Python)

    Data Engineer (Airflow +Python)

    Tata Consultancy Services • Saint Thomas Mount, Tamil Nadu, India
    Greetings from Tata Consulting Services TCS is Hiring for Data engineer Experience : 7-10 Years Location : PAN India Notice Period : 0 To 60 Days Please find the JD below Required Technical Skill - A...Show more
    Last updated: 16 days ago • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian India • Chennai, Tamil Nadu, India
    Design, build, and deploy robust ETL / ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Data...Show more
    Last updated: 21 days ago • Promoted
    Python Engineer ( Airflow / DBT Cloud )

    Python Engineer ( Airflow / DBT Cloud )

    Luxoft • Chennai, Tamil Nadu, India
    Project Description : This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure.The goal is ...Show more
    Last updated: 15 hours ago • Promoted • New!
    Lead Python Data Engineer _ Exp : 7+ Years

    Lead Python Data Engineer _ Exp : 7+ Years

    Atyeti Inc • chennai, tamil nadu, in
    Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles. Python; strong SQL and cloud-native development experience ...Show more
    Last updated: 12 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Chennai, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (Airflow, Azure)

    Data Engineer (Airflow, Azure)

    Luxoft • Greater Chennai Area, India
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 22 hours ago • Promoted • New!
    AWS Cloud Python Data Engineer - ETL / ELT Pipelines

    AWS Cloud Python Data Engineer - ETL / ELT Pipelines

    1HResource Solutions • Chennai
    Data Engineer (L3) - Python & AWS Job Overview : We are seeking a highly skilled Data Engineer with strong expertise in AWS cloud services and Python ...Show more
    Last updated: 2 days ago • Promoted