This job offer is not available in your country.
![[Immediate Start] Databricks Platform Engineer / Administrator](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobtraffic-in&company_name=Digitrix%20Software%20LLP){kind=logo}
[Immediate Start] Databricks Platform Engineer / Administrator
Digitrix Software LLPIndia10 hours ago
Job descriptionImplement and enforce cluster policies to control resource consumption and prevent cost overruns. Promote efficient compute usage by enabling job clusters, auto-termination, and spot instance strategies. Monitor and analyze cost using AWS Cost Explorer, Databricks REST APIs, and internal dashboards. Optimize storage costs through S3 lifecycle policies, Delta Lake optimization, and table version management. Analyze and tune Spark job performance, including partitioning, caching, and join strategies. Provide guidance on using Photon runtime, Delta Live Tables, and SQL optimization best practices. Collaborate with data engineers and analytics teams to improve job execution efficiency and pipeline throughput. Set up and manage logging, monitoring, and alerting via CloudWatch, Databricks audit logs, and external tools. Track metrics such as cluster utilization, job failures, job durations, and resource bottlenecks. Develop dashboards for real-time visibility into platform usage, performance, and cost. Enforce access control through Unity Catalog, IAM roles, and cluster policies. Ensure compliance with enterprise security policies, data governance standards, and audit requirements. Prevent data duplication and misuse through strong access boundaries and usage monitoring. Automate provisioning and configuration using Terraform, Databricks CLI, and REST APIs. Maintain detailed documentation of cluster policies, platform standards, optimization playbooks, and cost governance guidelines. Drive platform standardization and advocate for best practices across teams. 3–6+ years of experience managing Databricks on AWS or similar Spark-based platforms. Strong hands-on experience with AWS services (S3, IAM, VPC, EC2, CloudWatch). Proficiency in Spark performance tuning and Databricks architecture. Solid understanding of cost optimization strategies in cloud-based data platforms. Experience with Databricks cluster policies, job scheduling, and Delta Lake. Familiarity with Python, SQL, Terraform, and Databricks REST APIs. Experience with Unity Catalog, Delta Live Tables, or MLflow. Knowledge of AWS cost governance tools (Cost Explorer, Budgets, Trusted Advisor). Prior work in FinOps, DataOps, or Cloud Center of Excellence (CCoE) roles. Certifications such as : Databricks Certified Data Engineer / Admin AWS Certified Solutions Architect / DevOps Engineer
Experience : 3 to 6 years
Notice Period : Immediate to 15 days
Location : Bangalore
Work from office
JOB DESCRIPTION
Job Description : Databricks Platform Engineer / Administrator (AWS)
Department : Data Engineering / Cloud Platform / DevOps
About the Role
We are looking for a skilled and proactive Databricks Platform Engineer / Administrator to manage, optimize, and govern our Databricks environment on AWS. The ideal candidate will be responsible for overseeing platform operations, optimizing performance and cost, and ensuring secure and efficient use of Databricks and integrated AWS services.
This role sits at the intersection of platform engineering, data infrastructure, and cost governance, requiring both technical depth and cross-functional collaboration.
Key Responsibilities
Platform Administration
- Deploy, configure, and manage Databricks workspaces on AWS.
- Set up and maintain AWS infrastructure (VPCs, IAM roles, S3, security groups) to support Databricks operations.
- Manage user access, job permissions, cluster configurations, and workspace-level controls.
Cost Optimization
Performance Tuning
Monitoring & Observability
Security & Governance
Automation & Documentation
Qualifications
Required
Preferred
Create a job alert for this search
Immediate Engineer • India
Related jobs
- Promoted
GCP Data Engineer
EXLNagpur, IN Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 2 days ago
- Promoted
- New!
Contract role -Databricks Engineer
KPG99 INCNagpur, IN Duration : 12 months with extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development.
Python for data manipulation and automatio...Show moreLast updated: 4 hours ago
- Promoted
Database Administrator
Amicon Hub ServicesNagpur, IN Role : Databricks Administrator (Client : Patch).Strong hands-on experience in Databricks workspace setup & cluster management.
User & group administration via Azure AD / IAM / SCIM.Cluster configurat...Show moreLast updated: 1 day ago
- Promoted
Platform Engineer
Alp Consulting Ltd.India, India Platform Migration and Automation Engineer.SaaS / Low Code applications to support platform migration.Candidate should be able to configure AWS services, integrate data from various sources and creat...Show moreLast updated: 2 days ago
- Promoted
Senior AWS Data Engineer
CYAN360Nagpur, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer - Scala
Idyllic ServicesNagpur, IN Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 1 day ago
- Promoted
AWS Cloud Engineer
ProgliteNagpur, IN Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments.
Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 25 days ago
- Promoted
Lead Data Engineer
Eucloid Data SolutionsNagpur, IN Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 25 days ago
- Promoted
Data Engineer
TalogyNagpur, IN This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
KeasisNagpur, IN We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 2 days ago
- Promoted
Principal Data Engineer
K&K Talents - IndiaNagpur, IN This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.
Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Kumaran SystemsNagpur, IN Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 25 days ago
- Promoted
Data Engineer
Manuh TechnologiesNagpur, IN S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
- Promoted
Data Platform Engineer
Intuitive.CloudNagpur, IN With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 23 days ago
- Promoted
Cloud Engineer
VML Enterprise SolutionsNagpur, IN Type of position : Contract- 6 months.We are looking for talented developers with experience developing complex Cloud AWS serverless applications to join an exciting client project as part of our ex...Show moreLast updated: 2 days ago
- Promoted
- New!
Google Cloud Engineer / Administrator
66degreesNagpur, IN Al-focused, data-led solutions leveraging the latest advancements in cloud technology.With our unmatched engineering capabilities and vast industry experience, we help the world's leading brands tr...Show moreLast updated: 4 hours ago
- Promoted
Databricks Data Engineer
Insight GlobalNagpur, IN Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain.
The ideal candidate will have ha...Show moreLast updated: 1 day ago
- Promoted
Senior Data Platform Engineer
Black Dog LabsNagpur, IN Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps.
We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer_Immediate Joiners
VXI Global SolutionsNagpur, IN VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Vriba SolutionsNagpur, IN Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show moreLast updated: 13 days ago