Talent.com
This job offer is not available in your country.
(3 Days Left) Databricks Platform Engineer / Administrator

(3 Days Left) Databricks Platform Engineer / Administrator

Digitrix Software LLPIndia
9 hours ago
Job description

Experience : 3 to 6 years

Notice Period : Immediate to 15 days

Location : Bangalore

Work from office

JOB DESCRIPTION

Job Description : Databricks Platform Engineer / Administrator (AWS)

Department : Data Engineering / Cloud Platform / DevOps

About the Role

We are looking for a skilled and proactive Databricks Platform Engineer / Administrator to manage, optimize, and govern our Databricks environment on AWS. The ideal candidate will be responsible for overseeing platform operations, optimizing performance and cost, and ensuring secure and efficient use of Databricks and integrated AWS services.

This role sits at the intersection of platform engineering, data infrastructure, and cost governance, requiring both technical depth and cross-functional collaboration.

Key Responsibilities

Platform Administration

  • Deploy, configure, and manage Databricks workspaces on AWS.
  • Set up and maintain AWS infrastructure (VPCs, IAM roles, S3, security groups) to support Databricks operations.
  • Manage user access, job permissions, cluster configurations, and workspace-level controls.

Cost Optimization

  • Implement and enforce cluster policies to control resource consumption and prevent cost overruns.
  • Promote efficient compute usage by enabling job clusters, auto-termination, and spot instance strategies.
  • Monitor and analyze cost using AWS Cost Explorer, Databricks REST APIs, and internal dashboards.
  • Optimize storage costs through S3 lifecycle policies, Delta Lake optimization, and table version management.
  • Performance Tuning

  • Analyze and tune Spark job performance, including partitioning, caching, and join strategies.
  • Provide guidance on using Photon runtime, Delta Live Tables, and SQL optimization best practices.
  • Collaborate with data engineers and analytics teams to improve job execution efficiency and pipeline throughput.
  • Monitoring & Observability

  • Set up and manage logging, monitoring, and alerting via CloudWatch, Databricks audit logs, and external tools.
  • Track metrics such as cluster utilization, job failures, job durations, and resource bottlenecks.
  • Develop dashboards for real-time visibility into platform usage, performance, and cost.
  • Security & Governance

  • Enforce access control through Unity Catalog, IAM roles, and cluster policies.
  • Ensure compliance with enterprise security policies, data governance standards, and audit requirements.
  • Prevent data duplication and misuse through strong access boundaries and usage monitoring.
  • Automation & Documentation

  • Automate provisioning and configuration using Terraform, Databricks CLI, and REST APIs.
  • Maintain detailed documentation of cluster policies, platform standards, optimization playbooks, and cost governance guidelines.
  • Drive platform standardization and advocate for best practices across teams.
  • Qualifications

    Required

  • 3–6+ years of experience managing Databricks on AWS or similar Spark-based platforms.
  • Strong hands-on experience with AWS services (S3, IAM, VPC, EC2, CloudWatch).
  • Proficiency in Spark performance tuning and Databricks architecture.
  • Solid understanding of cost optimization strategies in cloud-based data platforms.
  • Experience with Databricks cluster policies, job scheduling, and Delta Lake.
  • Familiarity with Python, SQL, Terraform, and Databricks REST APIs.
  • Preferred

  • Experience with Unity Catalog, Delta Live Tables, or MLflow.
  • Knowledge of AWS cost governance tools (Cost Explorer, Budgets, Trusted Advisor).
  • Prior work in FinOps, DataOps, or Cloud Center of Excellence (CCoE) roles.
  • Certifications such as :
  • Databricks Certified Data Engineer / Admin
  • AWS Certified Solutions Architect / DevOps Engineer
  • Create a job alert for this search

    Platform Engineer • India

    Related jobs
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    EXLNagpur, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 6 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    Strobes Security, Inc.Nagpur, IN
    We are looking for a Mid-level Cloud Engineer with hands-on expertise in designing, automating, and operating production-grade cloud infrastructure. This role requires a strong background in AWS ser...Show moreLast updated: 30+ days ago
    • Promoted
    Contract role -Databricks Engineer

    Contract role -Databricks Engineer

    KPG99 INCNagpur, IN
    Duration : 12 months with extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Python for data manipulation and automatio...Show moreLast updated: 3 days ago
    • Promoted
    Database Administrator

    Database Administrator

    Amicon Hub ServicesNagpur, IN
    Role : Databricks Administrator (Client : Patch).Strong hands-on experience in Databricks workspace setup & cluster management. User & group administration via Azure AD / IAM / SCIM.Cluster configurat...Show moreLast updated: 4 days ago
    • Promoted
    Principal Azure Cloud Architect / Principal Engineer

    Principal Azure Cloud Architect / Principal Engineer

    First American (India)Nagpur, IN
    Job Title : Principal Azure Cloud Architect / Principal Engineer (20+ Years Experience).We are seeking a technical visionary Principal Azure Cloud Architect with 20+ years of experience to lead the tr...Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Nagpur, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyNagpur, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisNagpur, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 6 days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    Radiant Systems IncNagpur, IN
    Position : Snowflake Data Engineer.Need Strong Experience on Snowflake & SQL, ADF (Azure Data Factory), Microsoft MDS (Master Data Service). We are seeking a highly skilled and self-driven Data Engin...Show moreLast updated: 5 days ago
    • Promoted
    Principal Data Engineer

    Principal Data Engineer

    K&K Talents - IndiaNagpur, IN
    This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune. Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesNagpur, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.CloudNagpur, IN
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 26 days ago
    • Promoted
    Google Cloud Engineer / Administrator

    Google Cloud Engineer / Administrator

    66degreesNagpur, IN
    Al-focused, data-led solutions leveraging the latest advancements in cloud technology.With our unmatched engineering capabilities and vast industry experience, we help the world's leading brands tr...Show moreLast updated: 3 days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    VML Enterprise SolutionsNagpur, IN
    Type of position : Contract- 6 months.We are looking for talented developers with experience developing complex Cloud AWS serverless applications to join an exciting client project as part of our ex...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softnagpur, maharashtra, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 5 days ago
    • Promoted
    Platform Engineer

    Platform Engineer

    HireAlphaNagpur, IN
    Distributed Systems, EKS, Kubernetes, Cloud (AWS / Azure / GCP).Python, FastAPI, PostgreSQL, Terraform.We're looking for a Senior Software Engineer who can architect and build robust infrastructure sys...Show moreLast updated: 1 day ago
    • Promoted
    Infrastructure Administrator

    Infrastructure Administrator

    KniTTNagpur, IN
    As an OpenStack Administrator, you will be responsible for administration, configuration, deploying, installation and maintaining OpenStack infrastructure. You will collaborate with cross-functional...Show moreLast updated: 30+ days ago
    • Promoted
    CCH Tagetik Developer

    CCH Tagetik Developer

    EvolveXNagpur, IN
    Job Title : CCH Tagetik Developer – Financial Workspace (Consolidation).Experience Level : Mid to Senior.We are looking for an experienced . CCH Tagetik Developer & Administrator.Financial Workspace –...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsNagpur, IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Sapphire Software Solutions IncNagpur, IN
    Duration : 12 months with extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Proficiency in SQL for data querying, tran...Show moreLast updated: 2 days ago