Senior ETL Lead - Data Engineering

Overall Experience : Overall 6+ years of experience in development and maintenance in a data engineering :

• Collaborate with stakeholders to understand data requirements and translate them into technical :
• Experienced in writing complex SQL queries and knowledge of SQL Analytical :
• Design, develop, and deploy scalable data pipelines and ETL processes using Databricks.
• Optimize Spark jobs and ensure efficient data processing and storage
• Develop and maintain Databricks notebooks, workflows, and dashboards
• Proficient in building and optimizing data pipelines and workflows in Databricks
• Troubleshoot and resolve data pipeline issues and performance bottlenecks
• Monitor and manage data processing jobs to ensure high availability and reliability
• Work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services
• Knowledge of programming languages such as Python, Scala
• Stay current with the latest Databricks and big data technologies and :
• Experience working in cloud platforms(Azure / AWS platforms) and familiar with the cloud tools and technologies

(ref : hirist.tech)