Description
We are seeking a skilled Databricks Administrator to join our dynamic team in India. The ideal candidate will be responsible for managing and optimizing our Databricks environments, ensuring seamless data processing and analytics capabilities.
Responsibilities
- Manage and maintain Databricks environments and clusters.
- Monitor performance and optimize configurations for Databricks jobs.
- Collaborate with data engineering and data science teams to ensure efficient data processing workflows.
- Implement and maintain security protocols and user access controls within Databricks.
- Troubleshoot and resolve issues related to Databricks applications and infrastructure.
- Conduct regular maintenance and upgrades of Databricks instances.
Skills and Qualifications
3-5 years of experience working with Databricks and Apache Spark.Strong understanding of cloud platforms (AWS, Azure, or GCP) and their integration with Databricks.Proficiency in programming languages such as Python, Scala, or SQL.Experience with ETL processes and data pipelines.Knowledge of data warehousing concepts and technologies.Familiarity with version control systems (e.g., Git) and CI / CD practices.Excellent problem-solving skills and attention to detail.Strong communication skills and the ability to work in a team environment.Skills Required
Databricks, Spark, Sql, Cloud Computing, Data Lake, Python, Azure, Automation, Monitoring, Terraform