Talent.com
Python Data Engineer

Python Data Engineer

Dexian Indianavi mumbai, maharashtra, in
4 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor’s / Master’s Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Create a job alert for this search

    Data Engineer Python • navi mumbai, maharashtra, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyThane, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Sciative Solutions- Data Engineer - Python / Spark

    Sciative Solutions- Data Engineer - Python / Spark

    Sciative Solutions Private LimitedMumbai
    Job Responsibilities : - Collaborate with data scientists, software engineers, and business stakeholders to understand data requirements and design efficient data mod...Show moreLast updated: 30+ days ago
    • Promoted
    ETL Data Engineer - Python / PySpark

    ETL Data Engineer - Python / PySpark

    Information TechnologyMumbai
    Key Responsibilities : - Design, develop, and maintain robust data pipelines and ETL / ELT workflows using PySpark, Python, and SQL. Build and manage data ingestion and ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasThane, IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiamumbai, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 4 days ago
    • Promoted
    SolarSquare Energy - Data Engineer - Python

    SolarSquare Energy - Data Engineer - Python

    SolarSquare EnergyMumbai
    Description : As a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure.You will : - design and implement robust, sc...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsKalyan-Dombivli, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsmumbai, maharashtra, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer - Python / Big Data

    Lead Data Engineer - Python / Big Data

    HyreSnapMumbai
    Responsibilities : - Design, execution, and management of a large and complex distributed data system.Monitoring of performance and optimizing existing proje...Show moreLast updated: 30+ days ago
    • Promoted
    Data Science Engineer - Python / R / SQL

    Data Science Engineer - Python / R / SQL

    HyrEzy Talent SolutionsMumbai
    Job Description : Job Title : Data Science Engineer Experience : 2 + Years < / p...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeThane, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (AWS + Python Developer)

    Data Engineer (AWS + Python Developer)

    ConfidentialPune, Mumbai
    Neal Analytics is looking for Data Engineer (AWS + Python Developer) to join our dynamic team and embark on a rewarding career journey. Liaising with coworkers and clients to elucidate the requireme...Show moreLast updated: 30+ days ago
    • Promoted
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    SyntasaKalyan-Dombivli, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 14 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantThane, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsmumbai, maharashtra, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Servicesnavi mumbai, maharashtra, in
    Required Technical Skill Set -.Create and maintain optimal data pipeline architecture,.Assemble large, complex data sets that meet functional / non-functional business requirements.Identify, design...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesthane, maharashtra, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 12 days ago
    • Promoted
    Sav - Data Engineer - Python / LLM

    Sav - Data Engineer - Python / LLM

    Sav TechnologiesMumbai
    Responsibilities : - Build and maintain Savs data infrastructure, pipelines, and storage systems for structured and unstructured data <...Show moreLast updated: 30+ days ago