Databricks Account Setup & Administrator

Job Description: Databricks Account Setup & Administrator

Role Overview

We are seeking a skilled Databricks Administrator to lead the setup configuration and ongoing governance of our Databricks environment. The role involves provisioning workspaces managing user access implementing security and compliance standards and ensuring seamless integration with cloud services AWS.

This position will work closely with Data Engineering Security Cloud Ops and DevOps teams to establish a scalable and well-governed Databricks platform.

Key Responsibilities

1. Databricks Account & Workspace Setup

• Create and configure Databricks accounts workspaces and metastore environments.
• Configure Unity Catalog cluster policies and workspace-level governance.
• Set up organizational structures such as groups folders catalogs schemas and access patterns.

2. Security & Access Management

• Implement and manage Identity Federation (SCIM SSO/SAML SCIM provisioning).
• Define role-based access controls (RBAC) across users service principals and groups.
• Configure secure data access patterns using Unity Catalog IAM roles and cloud storage permissions.
• Maintain compliance with data governance frameworks (e.g. GDPR SOC2).

3. Platform Administration

• Manage cluster creation policies job clusters and high-concurrency clusters.
• Monitor resource utilization jobs and cluster performance.
• Set up and maintain audit logging monitoring dashboards and alerting.

4. Integration & Automation

• Integrate Databricks with cloud-native services AWS IAM.
• Develop automation scripts using Terraform Databricks CLI or REST APIs for account-level configurations.
• Collaborate with DevOps to build CI/CD pipelines for notebooks ML models and data workflows.

5. Support & Governance

• Establish platform standards best practices and operational runbooks.
• Troubleshoot user cluster and job-related issues.
• Conduct periodic audits of permissions cluster usage and data access.

Required Skills & Qualifications

• minimum of 3 years of experience administering Databricks environments.
• Strong knowledge of AWS cloud architecture.
• Hands-on experience with Databricks security Unity Catalog and workspace governance.
• Proficiency in Terraform Python Shell scripting or Databricks CLI.
• Understanding of data engineering concepts (Delta Lake ETL Spark basics).
• Experience with IAM SSO SCIM provisioning and RBAC models.

Preferred Qualifications

• Databricks Administrator or Data Engineer certification.
• Experience with DevOps tools (AWS DevOps GitHub Actions Gitlab).
• Prior experience implementing enterprise-scale Databricks platforms.
• Knowledge of monitoring tools (CloudWatch Datadog or Grafana).

Soft Skills

• Strong communication and cross-functional collaboration.
• Ability to document processes and create knowledge bases.
• Problem-solving mindset and attention to detail.

Required Experience:

IC

Key Skills
Data Entry,Adobe Acrobat,AS400,EDI,Microsoft Outlook,Cloud Architecture,Microsoft Excel,Quick Books,Administrative Experience,Order Fulfillment,Project Implementation,Sales Support
Employment Type : Full-Time
Experience: years
Vacancy: 1