Tata Consultancy ServicesChennai, Tamil Nadu, India
10 days ago
Job description
Databricks Admin
Exp- 5 to 8 years
Location- Chennai / Kolkata
Required Skills
Databricks Administration
Terraform
AWS cloud services
MLflow
Workflows
Databricks Asset Bundles
AWS IAM
VPC
Private endpoints
Firewalls
S3
SQL + PySpark
dbx CLI
Responsibilities
Implement, and maintain the Databricks platform, including workspace setup, user and group management, access control, and security configurations.
Install, configure, and maintain Databricks clusters and workspaces. Monitor and manage cluster performance, resource utilization, and platform costs.
Provide technical support to data engineering, data science, and application teams. Perform restores / recoveries, troubleshoot service issues, and resolve platform-related problems.
Implement and manage access controls and security policies to protect sensitive data. Ensure compliance with relevant data governance and regulatory requirements.
Manage and maintain connections between Databricks and other data sources like Snowflake. Optimize data pipelines and workflows.
Develop and maintain automation scripts and tools for platform provisioning and routine tasks using Terraform.