Data Engineer - ETL / Python

Description :

Job Title : Data Engineer.

Experience Required : 4+ Years.

Location : Pune.

Job Description :

We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, and Databricks to join our team.

The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring the quality and reliability of data across various sources and destinations.

Key Responsibilities :

• Analyze and understand source data structures, formats, and business requirements.
• Design and develop efficient data pipelines on Databricks using PySpark to extract, transform, and load (ETL) data into target Delta tables.
• Optimize and automate data workflows for improved performance and scalability.
• Ensure data accuracy, consistency, and integrity across systems.
• Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders to support data-driven initiatives.
• Implement best coding practices and ensure the quality and maintainability of the data engineering solutions.
• Monitor and troubleshoot production data issues, ensuring timely resolution.

Required Skills & Qualifications :

Nice to Have :

(ref : hirist.tech)