Databricks Platform Production Support

We are looking for Enterprise data platform admin to implement and maintain the Databricks platform on AWS / Azure / GCP. Person should have passion to work in agile environment and experience in supporting databricks platform on AWS / Azure / GCP.

Responsibilities :

Platform Administration : Implement, and maintain the Databricks platform, including workspace setup, user and group management, access control, and security configurations.

Operational Support : Provide technical support to data engineering, data science, and application teams. Perform restores / recoveries, troubleshoot service issues, and resolve platform-related problems.

Cluster Management : Install, configure, and maintain Databricks clusters and workspaces. Monitor and manage cluster performance, resource utilization, and platform costs.

Security and Compliance : Implement and manage access controls and security policies to protect sensitive data. Ensure compliance with relevant data governance and regulatory requirements.

Integration : Manage and maintain connections between Databricks and other data sources like Snowflake. Optimize data pipelines and workflows.

Automation : Develop and maintain automation scripts and tools for platform provisioning and routine tasks using Terraform.

Required Skills :

Experience : 3+ years of production support of the Databricks platform.

Technical Expertise :

• Terraform, AWS / Azure / GCP cloud services, Databricks administration
• AWS IAM, VPC, private endpoints, firewalls, S3 and knowledge on how Databricks integrates with them
• MLflow, Workflows, Databricks Asset Bundles
• Databricks REST API : For automation, scripting, and integration
• dbx CLI : For CI / CD integration
• Delta Live Tables (DLT) : For managing streaming and batch pipelines
• SQL + PySpark skills to debug and support.

Preferred Skills : Databricks certification