β‘ ππ¨π₯π : Data Engineer
β‘ ππ¨π ππ¨ππππ’π¨π§ : Mumbai, Maharashtara (5 Days Work from Office)
β‘ πππ₯ππ―ππ§π ππ±π©ππ«π’ππ§ππ : Minimum 4+ yrs.
β‘ ππ¨π’π§π’π§π : Can join immediately or within 30 Days
β‘ ππ¦π©π₯π¨π²π¦ππ§π ππ²π©π : Permanent
β‘ ππ‘π’ππ ππ’π¦π : 10 AM to 7 PM IST
Key Skills & Experience :
- 2+ years of hands-on experience with Databricks, including job optimization and performance tuning.
- 4+ years in Data Engineering, with a solid foundation in data pipeline design, development, and implementation.
- Expertise in PySpark for large-scale data processing and transformations.
- Proven experience in ETL design for scalable and efficient data workflows.
- Strong understanding of Data Quality, Data Governance, and Data Control principles to ensure data accuracy, consistency, and reliability.
- Proficiency with Delta Tables for data storage, versioning, and ACID transactions in Databricks.
Responsibilities :
Design and implement efficient ETL pipelines to process large datasets.Optimize Spark jobs in Databricks for better performance and cost efficiency.Implement best practices for data quality and data governance to ensure reliable and accurate datasets.Work with Delta Tables for transactional integrity and managing data lakes.Collaborate with cross-functional teams to ensure alignment on data management and reporting requirements.