Talent.com
Python Data Engineer

Python Data Engineer

Dexian Indiadombivli, maharashtra, in
7 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor’s / Master’s Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Create a job alert for this search

    Data Engineer Python • dombivli, maharashtra, in

    Related jobs
    • Promoted
    Data Engineer (Airflow +Python)

    Data Engineer (Airflow +Python)

    Tata Consultancy ServicesMumbai, Maharashtra, India
    Greetings from Tata Consulting Services TCS is Hiring for Data engineer Experience : 7-10 Years Location : PAN India Notice Period : 0 To 60 Days Please find the JD below Required Technical Skill - A...Show moreLast updated: 2 days ago
    • Promoted
    ETL Data Engineer - Python / PySpark

    ETL Data Engineer - Python / PySpark

    Information TechnologyMumbai
    Key Responsibilities : - Design, develop, and maintain robust data pipelines and ETL / ELT workflows using PySpark, Python, and SQL. Build and manage data ingestion and ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiamumbai, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsthane, maharashtra, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    SolarSquare Energy - Data Engineer - Python

    SolarSquare Energy - Data Engineer - Python

    SolarSquare EnergyMumbai
    Description : As a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure.You will : - design and implement robust, sc...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesdombivli, maharashtra, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 16 days ago
    • Promoted
    Lead Data Engineer - Python / Big Data

    Lead Data Engineer - Python / Big Data

    HyreSnapMumbai
    Responsibilities : - Design, execution, and management of a large and complex distributed data system.Monitoring of performance and optimizing existing proje...Show moreLast updated: 30+ days ago
    • Promoted
    Data Science Engineer - Python / R / SQL

    Data Science Engineer - Python / R / SQL

    HyrEzy Talent SolutionsMumbai
    Job Description : Job Title : Data Science Engineer Experience : 2 + Years < / p...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeThane, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Dexian Indiamumbai, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesthane, maharashtra, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasMumbai, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 7 days ago
    • Promoted
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    SyntasaThane, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 17 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantKalyan-Dombivli, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionmumbai city, maharashtra, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 18 days ago
    • Promoted
    Sciative Solutions- Data Engineer - Python / Spark

    Sciative Solutions- Data Engineer - Python / Spark

    Sciative Solutions Private LimitedNavi Mumbai
    Job Responsibilities : - Collaborate with data scientists, software engineers, and business stakeholders to understand data requirements and design efficient data mod...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsThane, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    ConfidentialBengaluru / Bangalore, Pune, Mumbai
    We are seeking a highly skilled.This role involves supporting data preparation, curation, ingestion, and processing activities, with a particular focus on. The ideal candidate should be a proactive ...Show moreLast updated: 5 days ago