Implement, and maintain the Databricks platform, including workspace setup, user and group management, access control, and security configurations.
Install, configure, and maintain Databricks clusters and workspaces. Monitor and manage cluster performance, resource utilization, and platform costs.
Provide technical support to data engineering, data science, and application teams. Perform restores / recoveries, troubleshoot service issues, and resolve platform-related problems.
Implement and manage access controls and security policies to protect sensitive data. Ensure compliance with relevant data governance and regulatory requirements.
Manage and maintain connections between Databricks and other data sources like Snowflake. Optimize data pipelines and workflows.
Develop and maintain automation scripts and tools for platform provisioning and routine tasks using Terraform.