Cloud Administrator

We are seeking an experienced Databricks Administrator with 7+ years of expertise in managing and optimizing Databricks environments. The ideal candidate should have hands-on experience with Azure / AWS Databricks, cluster management, security configurations, and performance optimization. This role requires close collaboration with data engineering and analytics teams to ensure smooth operations and scalability.

About the Role

The Databricks Administrator will be responsible for managing and optimizing Databricks environments, ensuring performance, security, and scalability.

Responsibilities

• Deploy, configure, and manage Databricks workspaces, clusters, and jobs.
• Monitor and optimize Databricks performance, auto-scaling, and cost management.
• Implement security best practices, including role-based access control (RBAC) and encryption.
• Manage Databricks integration with cloud storage (Azure Data Lake, S3, etc.) and other data services.
• Automate infrastructure provisioning and management using Terraform, ARM templates, or CloudFormation.
• Troubleshoot Databricks runtime issues, job failures, and performance bottlenecks.
• Support CI / CD pipelines for Databricks workloads and notebooks.
• Collaborate with data engineering teams to enhance ETL pipelines and data processing workflows.
• Ensure compliance with data governance policies and regulatory requirements.
• Maintain and upgrade Databricks versions and libraries as needed.

Qualifications

Preferred Skills

Shift Timing : 10PM to 6AM IST (Fixed)