No longer accepting applications
(Immediate Start) Databricks Platform Engineer / Administrator
Digitrix Software LLPBengaluru, Karnataka, India9 hours ago
Job descriptionImplement and enforce cluster policies to control resource consumption and prevent cost overruns. Promote efficient compute usage by enabling job clusters, auto-termination, and spot instance strategies. Monitor and analyze cost using AWS Cost Explorer, Databricks REST APIs, and internal dashboards. Optimize storage costs through S3 lifecycle policies, Delta Lake optimization, and table version management. Analyze and tune Spark job performance, including partitioning, caching, and join strategies. Provide guidance on using Photon runtime, Delta Live Tables, and SQL optimization best practices. Collaborate with data engineers and analytics teams to improve job execution efficiency and pipeline throughput. Set up and manage logging, monitoring, and alerting via CloudWatch, Databricks audit logs, and external tools. Track metrics such as cluster utilization, job failures, job durations, and resource bottlenecks. Develop dashboards for real-time visibility into platform usage, performance, and cost. Enforce access control through Unity Catalog, IAM roles, and cluster policies. Ensure compliance with enterprise security policies, data governance standards, and audit requirements. Prevent data duplication and misuse through strong access boundaries and usage monitoring. Automate provisioning and configuration using Terraform, Databricks CLI, and REST APIs. Maintain detailed documentation of cluster policies, platform standards, optimization playbooks, and cost governance guidelines. Drive platform standardization and advocate for best practices across teams. 3–6+ years of experience managing Databricks on AWS or similar Spark-based platforms. Strong hands-on experience with AWS services (S3, IAM, VPC, EC2, CloudWatch). Proficiency in Spark performance tuning and Databricks architecture. Solid understanding of cost optimization strategies in cloud-based data platforms. Experience with Databricks cluster policies, job scheduling, and Delta Lake. Familiarity with Python, SQL, Terraform, and Databricks REST APIs. Experience with Unity Catalog, Delta Live Tables, or MLflow. Knowledge of AWS cost governance tools (Cost Explorer, Budgets, Trusted Advisor). Prior work in FinOps, DataOps, or Cloud Center of Excellence (CCoE) roles. Certifications such as : Databricks Certified Data Engineer / Admin AWS Certified Solutions Architect / DevOps Engineer
Experience : 3 to 6 years
Notice Period : Immediate to 15 days
Location : Bangalore
Work from office
JOB DESCRIPTION
Job Description : Databricks Platform Engineer / Administrator (AWS)
Department : Data Engineering / Cloud Platform / DevOps
About the Role
We are looking for a skilled and proactive Databricks Platform Engineer / Administrator to manage, optimize, and govern our Databricks environment on AWS. The ideal candidate will be responsible for overseeing platform operations, optimizing performance and cost, and ensuring secure and efficient use of Databricks and integrated AWS services.
This role sits at the intersection of platform engineering, data infrastructure, and cost governance, requiring both technical depth and cross-functional collaboration.
Key Responsibilities
Platform Administration
- Deploy, configure, and manage Databricks workspaces on AWS.
- Set up and maintain AWS infrastructure (VPCs, IAM roles, S3, security groups) to support Databricks operations.
- Manage user access, job permissions, cluster configurations, and workspace-level controls.
Cost Optimization
Performance Tuning
Monitoring & Observability
Security & Governance
Automation & Documentation
Qualifications
Required
Preferred
Create a job alert for this search
Immediate Engineer • Bengaluru, Karnataka, India
Related jobs
)
![Advance Data Infrastructure Engineer (DevOps & Data Platform Focus) [T500-21049]](https://cdn-logos.talent.com/v1/logo/image?feedcode=clickcast-appcast-li-in-cpc&company_name=Albertsons%20Companies%20India)
- Promoted
Data Platform ProdOps Engineer
AMISEQBengaluru, India Title : Data Platform ProdOps Engineer.We are seeking a proactive and detail-oriented Production Operations Engineer to join our Data Platforms team.
This role plays a critical part in maintaining th...Show moreLast updated: 30+ days ago
- Promoted
Senior Analytics Support Engineer (GA4 | GTM | Looker | Tableau | SQL | AWS)
Sky Systems, Inc. (SkySys)hosur, tamil nadu, in Senior Analytics Support Engineer.Full-Time Contract (40hrs / week).Hybrid (2x days onsite) in Bangalore, India.We’re looking for a skilled Analytics Support Engineer experienced in.GA4, GTM, Looker,...Show moreLast updated: 7 days ago
- Promoted
Data Platform Engineer
Grizmo LabsBengaluru, Karnataka, India Design, build, and maintain scalable data platforms and pipelines to support the needs of the business.Ensure data quality and accuracy by implementing data validation and testing processes.Partici...Show moreLast updated: 17 days ago
- Promoted
Data Platform Engineer
Grizmo Labs?Bengaluru, Karnataka, India What you'll do : • Design, build, and maintain scalable data platforms and pipelines to support the needs of the business • Ensure data quality and accuracy by implementing data validation and tes...Show moreLast updated: 17 days ago
- Promoted
Platform Engineer – Python / Databricks / Notebooks / Kubernetes
Syntasahosur, tamil nadu, in Platform Engineer – Python / Databricks / Notebooks / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited.
This position offers an exciting opportuni...Show moreLast updated: 5 days ago
- Promoted
AWS Administrator
Tata Consultancy ServicesBengaluru, Karnataka, India TCS is hiring for JAVA + AWS SRE.Bangalore Mode of Interview : VIRTUAL / ONLINE SKILLS REQUIRED Core Java(must) AND Exposure to Unix troubleshooting AND One of the following Scripting languages : Sh...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer with Snowflake Experience- Contract
Gravity Infosolutions, Inc.hosur, tamil nadu, in Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical.
Most data to be migrated is already in Snowflake...Show moreLast updated: 6 days ago
- Promoted
Databricks Platform Engineer / Administrator
Digitrix Software LLPBengaluru, Karnataka, India Job Description : Databricks Platform Engineer / Administrator (AWS).Department : Data Engineering / Cloud Platform / DevOps.
We are looking for a skilled and proactive .Databricks Platform Engineer / ...Show moreLast updated: 17 days ago
- Promoted
Cloud Engineer
NAM Info IncBengaluru, Karnataka, India We have an immediate need for AWS Data Engineers all 5 Days Onsite at Office from 2nd stage Banashankari, Bengaluru location and need someone to start Immediate Joiners only NO ONE MONTH NOTICE.Rol...Show moreLast updated: 30+ days ago
- Promoted
Platform Engineer – Java / BigData / Kubernetes
Syntasahosur, tamil nadu, in Platform Engineer – Java / BigData / Kubernetes.Syntasa is seeking a high-caliber and dedicated.Syntasa Technologies India Private Limited.
This position offers an exciting opportunity to contribute t...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
Veraxionhosur, tamil nadu, in Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 7 days ago
- Promoted
AWS Data Lake Administrator
Tata Consultancy ServicesBengaluru, Karnataka, India We are seeking a highly skilled.The ideal candidate will have strong experience with AWS data services such as S3, Lake Formation, Glue Catalog, Redshift Spectrum, and extensive SQL knowledge.The r...Show moreLast updated: 30+ days ago
- Promoted
Full Stack Engineer
Dover IndiaGreater Bengaluru Area, India Roles & Responsibilities : SSE / TL Fullstack.Location : Bagmane Techpark CV Raman Nagar-Bangalore.Net Core with Angular,WEB API, SQL Database.
Develop and debug source code which includes : 1) Developin...Show moreLast updated: 30+ days ago
- Promoted
GCP Data Engineer
JRD Systemshosur, tamil nadu, in Collaborate with data architects, analysts, and business teams to define and maintain.Roadnet) and modernized data sources.
Partner with governance and infrastructure teams to establish.Automate and...Show moreLast updated: 1 day ago
- Promoted
Software Engineer (Data Platforms)
PhonePeBengaluru, India Building for Scale, Rapid Iterative Development, and Customer-centric Product Thinking at each step defines every day for a developer at PhonePe.
Though we engineer for a 50million+ strong user base...Show moreLast updated: 17 days ago
- Promoted
Platform Engineer-Data
ValueLabsBengaluru, Karnataka, India We’re Hiring : Senior Technology Engineer – DevOps & Big Data.Senior Technology Engineer (STE).Build robust CI / CD pipelines using Jenkins & GitOps.
Deploy applications using Kubernetes & OpenShift fo...Show moreLast updated: 17 days ago
- Promoted
Advance Data Infrastructure Engineer (DevOps & Data Platform Focus) [T500-21049]
Albertsons Companies IndiaBengaluru, Karnataka, India About Albertsons Companies Inc.As a leading food and drug retailer in the United States, Albertsons Companies, Inc.Our well-known banners across the United States, including Albertsons, Safeway, Vo...Show moreLast updated: 6 days ago
- Promoted
AWS Databricks Developer
CoforgeBengaluru, Karnataka, India The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Overall, 5 to 8 years...Show moreLast updated: 17 days ago