Talent.com
Python Data Engineer
Python Data EngineerDexian India • Chennai, Tamil Nadu, India
No longer accepting applications
Python Data Engineer

Python Data Engineer

Dexian India • Chennai, Tamil Nadu, India
16 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Create a job alert for this search

    Data Engineer Python • Chennai, Tamil Nadu, India

    Related jobs
    Data Engineer (Pyspark+Python)

    Data Engineer (Pyspark+Python)

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    Greetings from Tata Consulting Services!!!.Role : Data Engineer with Mandatory Pyspark, Python Knowledge.Desired Experience Range : 5 to 10 yrs. Location : Pune, Hyderabad, Chennai, Bangalore, Kochi, B...Show more
    Last updated: 14 days ago • Promoted
    Senior Data Engineer - Python / Spark

    Senior Data Engineer - Python / Spark

    Getinz • Chennai
    Description : Role Overview : We are looking for a highly skilled and motivated Senior Data Engineer to join our clients tea...Show more
    Last updated: 26 days ago • Promoted
    Senior Python Data Engineer

    Senior Python Data Engineer

    iVoyant • chennai, tamil nadu, in
    Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
    Last updated: 8 days ago • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIG • Chennai, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • Greater Chennai Area, India
    TCS is hiring for AzureData Engineer.Extensive coding experience including Python / Pyspark.Experience developing in Azure with key data technologies (e. ADLS, ADF, Azure Databricks etc.Software devel...Show more
    Last updated: 3 days ago • Promoted
    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)

    AIMLEAP • Chennai, IN
    Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT. IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
    Last updated: 2 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • Chennai, Tamil Nadu, India
    TCS is Hiring AWS Data Engineer For Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneshwar, Kolkata location.Bangalore, Chennai, Hyderabad, Pune, Kochi, Bhubaneshwar, Kolkata.Strong experience in...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • Chennai, Tamil Nadu, India
    Title : Data Engineer Location : Remote (3–4-hour time zone overlaps with EST if off shore) Duration : 6 months Musts : Python NextFlow Plus : Computer Vision Image Processing Project Overview : Exper...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Dexian India • Chennai, Tamil Nadu, India
    Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines. High proficiency in Python, ...Show more
    Last updated: 7 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live Connections • Chennai, Tamil Nadu, India
    Hiring : Data Engineer | 9-12 Years Experience | Remote (India) Salary : Up to 26 LPA ️ Skills : Python, SQL, Big Data, Cloud, Snowflake Job Description : We are looking for an experienced Data Eng...Show more
    Last updated: 30+ days ago • Promoted
    Python Engineer (Airflow, Cloud)

    Python Engineer (Airflow, Cloud)

    Luxoft • Chennai, Tamil Nadu, India
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 11 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Intellias • Chennai, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer (DOMO & Python / Kafka)

    Data Engineer (DOMO & Python / Kafka)

    Smart Moves Consultants • chennai, tamil nadu, in
    We are looking for candidates with strong Domo and Python / Kafka connect experience.Please find the JD below and share suitable and strong profiles at the earliest. Design, build, and maintain scala...Show more
    Last updated: 10 hours ago • Promoted • New!
    Senior Data Engineer - Python / SQL

    Senior Data Engineer - Python / SQL

    SGS & Co • Chennai
    Position Title : Senior Data Engineer Experience Required : 8 to 12 Years Location : Rem...Show more
    Last updated: 22 days ago • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian India • Chennai, Tamil Nadu, India
    Design, build, and deploy robust ETL / ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Data...Show more
    Last updated: 21 days ago • Promoted
    Senior Data Engineer - Python / SQL

    Senior Data Engineer - Python / SQL

    YO IT CONSULTING • Chennai
    Job Description : Title : Senior Data Engineer Experience : 6 to 8 years L...Show more
    Last updated: 14 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Chennai, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (Airflow, Azure)

    Data Engineer (Airflow, Azure)

    Luxoft • Greater Chennai Area, India
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 14 hours ago • Promoted • New!