Talent.com
Python Data Engineer

Python Data Engineer

Dexian IndiaChennai, Tamil Nadu, India
3 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor’s / Master’s Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Create a job alert for this search

    Data Engineer Python • Chennai, Tamil Nadu, India

    Related jobs
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticschennai, tamil nadu, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python / Spark

    Senior Data Engineer - Python / Spark

    GetinzChennai
    Description : Role Overview : We are looking for a highly skilled and motivated Senior Data Engineer to join our clients tea...Show moreLast updated: 8 days ago
    • Promoted
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    SyntasaChennai, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Serviceschennai, tamil nadu, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Notice Period : Immediate Joiner (or within 15 days).Shift : Includes Night Shifts (US Shift).Preferred Candidates : From Chennai. SQL, Python, ETL - Apache Airflow - Data Pipeline Optimization & Tunin...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Azure Platform

    Senior Data Engineer - Azure Platform

    Resource Tree Global ServicesChennai
    Job Name : Senior Data Engineer Azure Years of Experience : 5 Job Description : We are look...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    The Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations. Location - Kolkata / Chennai / Trivan...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreeChennai, Tamil Nadu, India
    Ready to trade your to-do list for a to-do the impossible list?.Join a team that's building the future of IIOT.We have arranged a Walk-In Drive on 1-Nov ( Saturday). Location : L&T Innovation Campus...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian IndiaChennai, Tamil Nadu, India
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsChennai, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantChennai, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 14 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasChennai, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyChennai, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python / SQL

    Senior Data Engineer - Python / SQL

    SGS & CoChennai
    Position Title : Senior Data Engineer Experience Required : 8 to 12 Years Location : Rem...Show moreLast updated: 4 days ago
    • Promoted
    Appglide - Senior Python Data Engineer

    Appglide - Senior Python Data Engineer

    Appglide.ioChennai
    We are seeking a Senior Python Data Engineer to join our customers Solutions Engineering Team.This role is ideal for an experienced professional who thrives in a fast-paced, customer-facing environ...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    ConfidentialChennai, India
    Note : Only candidates who meet the eligibility criteria should apply.Others are kindly requested not to apply.Q24 is a Software Development Company based in Chennai, TN, India, founded in 2019.We f...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeChennai, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Python / PySpark

    Senior Data Engineer - Python / PySpark

    Digivance SolutionChennai
    Job Title : Senior Data Engineer Location : Chennai (Hybrid 4 days from office per week) Experience ...Show moreLast updated: 30+ days ago