Senior Databricks Engineer
Description :
We are seeking a Senior Databricks Engineer to join our dynamic team in India. The ideal candidate will have extensive experience in building and optimizing data pipelines and will play a crucial role in leveraging Databricks to drive data :
- Design and implement scalable data pipelines using Databricks.
- Optimize existing data workflows for performance and cost efficiency.
- Collaborate with data scientists and analysts to understand data requirements.
- Ensure data quality and integrity throughout the ETL process.
- Monitor and troubleshoot data pipeline issues and performance bottlenecks.
- Implement best practices for data governance and security in Databricks.
Skills and Qualifications :
8-12 years of experience in data engineering or related field.Proficient in Databricks, Apache Spark, and big data technologies.Strong programming skills in Python, Scala, or Java.Experience with cloud platforms such as AWS, Azure, or Google Cloud.Familiarity with SQL and data warehousing concepts.Knowledge of data modeling and ETL processes.Ability to work in an agile environment and collaborate effectively in a team.ref : hirist.tech)