3+ years of experience in production support of the Databricks platform.Implement and maintain the Databricks platform on AWS.Develop and maintain automation scripts and tools for platform provisioning and routine tasks using Terraform.Install, configure, and maintain Databricks clusters and workspaces.Implement, and maintain the Databricks platform, including workspace setup, user and group management, access control, and security configurations.Provide technical support to data engineering, data science, and application teams.Perform restores / recoveries, troubleshoot service issues, and resolve platform-related problems.Monitor and manage cluster performance, resource utilization, and platform costs.Implement and manage access controls and security policies to protect sensitive data.Ensure compliance with relevant data governance and regulatory requirements.Manage and maintain connections between Databricks and other data sources like Snowflake.Optimize data pipelines and workflows.Managing streaming and batch pipelines - SQL + PySpark skills to debug and support.Skills Required
Terraform, Pyspark, Databricks, Sql, Aws