Talent.com
Python Data Engineer

Python Data Engineer

Dexian Indiapune, maharashtra, in
5 days ago
Job description

Python Data Engineer : -

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure for efficient ETL processes from various sources and storage systems.
  • Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements.
  • Leading the implementation of algorithms and prototypes to transform raw data into useful information.
  • Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI / ML transformations.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Interpreting data trends and patterns to establish operational alerts.
  • Developing analytical tools, programs, and reporting mechanisms.
  • Conducting complex data analysis and presenting results effectively.
  • Preparing data for prescriptive and predictive modeling.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Applying strong programming and problem-solving skills to develop scalable solutions.
  • Passion for testing strategy, problem-solving, and continuous learning.
  • Willingness to acquire new skills and knowledge.
  • Possess a product / engineering mindset to drive impactful data solutions.
  • Experience working in distributed environments with global teams.

Technical Skills and Experience requirements :

  • Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
  • High proficiency in Python, Scala and Spark for applied large-scale data processing.
  • Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
  • Solid understanding of batch and streaming data processing techniques.
  • Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
  • Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
  • Experience with RDBMS and OLAP databases like MySQL, Snowflake.
  • Familiarity with Agile methodologies.
  • Obsession for service observability, instrumentation, monitoring, and alerting.
  • Knowledge or experience in architectural best practices for building data lakes.
  • Qualification : Bachelor’s / Master’s Degree.

    Relevant Development Experience : 8+ Years

    Relevant Experience : 8+ Years (as Python and Data Engineer)

    Overall IT Experience : 8 to 12 Years

    Create a job alert for this search

    Data Engineer Python • pune, maharashtra, in

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgePune, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer @ Pune

    GCP Data Engineer @ Pune

    Quess IT StaffingPune, Maharashtra, India
    Position : GCP Data Engineer Location : Pune Duration : Contract to Hire Job Description : GCP Python PLSQL.Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Python

    Data Engineer - Python

    Human HorizonPune
    Responsibilities : - Developing / Supporting complex efforts involving Analysis, Design, Development, and testing of various application components within the ...Show moreLast updated: 14 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Synechronpune, maharashtra, in
    Looking for immediate to 30 days' joiners.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative techn...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Dexian Indiapune, maharashtra, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Python Data Engineer [High Salary]

    Python Data Engineer [High Salary]

    SynechronPune, Maharashtra, India
    Job Title : Python Data Engineer Notice Period : Looking for immediate to 30 days' joiners Experience Required : 6+ Years Job Location : Pune (Hybrid Work Model) At Synechron, we believe in the pow...Show moreLast updated: less than 1 hour ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsPune, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicespune, maharashtra, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticspune, maharashtra, in
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Canopus Infosystems - A CMMI Level 3 CompanyPune, IN
    Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization.The ideal candidate should be capable of building data pipelines, performing web scra...Show moreLast updated: 30+ days ago
    • Promoted
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    Platform Engineer – Python / Databricks / Notebooks / Kubernetes

    SyntasaPune, IN
    Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited. This position offers an exciting opportuni...Show moreLast updated: 15 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    Persistent Systemspune, maharashtra, in
    We are seeking a Python Data engineer with AWS experience.Location : ALL Persistent Location.Job Type : Full Time Employment. Candidate should have 5+ years of experience in Data Engineering.Must have...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer (PySpark)

    Data Engineer (PySpark)

    RSquareSoft TechnologiesPune, Maharashtra, India
    Role : Data Engineer Location : Pune (On-site) Job Type : Full-Time Experience : 4–7 Years Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL workflows.Work with...Show moreLast updated: 4 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGPune, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    LTIMindtreepune, maharashtra, in
    We are seeking a skilled Data Engineer with hands-on experience in.The ideal candidate will be responsible for developing scalable data pipelines, transforming and ingesting large-scale data, and e...Show moreLast updated: 30+ days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantPune, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer - Python

    Data Engineer - Python

    PeoplefyPune
    Description : Role : Data Engineer Job Summary : We are loo...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ClaidroidPune, Maharashtra, India
    Data Engineer | 8+ Years | Pune & Trivandrum | Immediate Joiners Preferred About the Role Claidroid Technologies is seeking an experienced Data Engineer with hands-on expertise in ETL, Python, P...Show moreLast updated: 30+ days ago