This job offer is not available in your country.

ETL Developer - Python / SQL

HyrhubBangalore

7 days ago

Job description

Responsibilities :

Design, develop, and deploy scalable data pipelines and ETL processes using Databricks.
Optimize Spark jobs and ensure efficient data processing and storage.
Develop and maintain Databricks notebooks, workflows, and dashboards.
Proficient in building and optimizing data pipelines and workflows in Databricks.
Troubleshoot and resolve data pipeline issues and performance bottlenecks.
Monitor and manage data processing jobs to ensure high availability and reliability.
Work with cloud platforms such as AWS, Azure, or Google Cloud to integrate Databricks with other services.
Stay current with the latest Databricks and big data technologies and trends.

Requirements :

Overall 6+ years of experience in development and maintenance in a data engineering project.

Collaborate with stakeholders to understand data requirements and translate them into technical solutions.

SQL :

Experienced in writing complex SQL queries and knowledge of SQL Analytical functions.

Knowledge of programming languages such as Python and Scala.

Cloud :

Experience working in cloud platforms( Azure / AWS platforms) and familiar with the cloud tools and technologies.

(ref : hirist.tech)

Etl Developer • Bangalore