Talent.com
Jade Global
Chief Lakehouse Architect Databricks CoEJade Global • Pune, India
Chief Lakehouse Architect Databricks CoE

Chief Lakehouse Architect Databricks CoE

Jade Global • Pune, India
30+ days ago
Job description
Chief Lakehouse Architect – Databricks CoE1

Principal architect responsible for defining and executing enterprise-grade Databricks Lakehouse architecture standards, engagements and guiding complex solution designs. Drive cost optimization and financial governance for Databricks platforms across clients and internal workloads.

Key Responsibilities

  • Define Databricks reference architectures (batch, streaming, ML, GenAI)
  • Own standards for Delta Lake, medallion architecture, Unity Catalog
  • Design multi-workspace Databricks platform architectures
  • Lead Databricks migrations from legacy data warehouses programs
  • Design, Review and approve architecture for all Databricks deals
  • Mentor architects and senior Databricks engineers
  • Define Databricks FinOps framework
  • Optimize cluster policies, DBU usage, and job scheduling
  • Work with engineering teams on performance-to-cost optimization
  • Advise leadership and clients on Databricks cost strategies

Experience

  • 12–15 years in data architecture
  • 5–7 years hands-on Databricks & Apache Spark
  • 3+ years designing enterprise Databricks platforms, managing Databricks costs at scale

Skills

  • Databricks platform internals & optimization
  • Spark performance tuning and scalability
  • Delta Lake internals (ACID, compaction, Z-order)
  • Databricks Jobs, Workflows, CI/CD, IaC
  • Cloud-native Databricks (AWS / Azure / GCP)
  • Cluster tuning & auto-scaling strategies, Databricks DBU model & pricing
  • Cloud billing & monitoring tools
  • Cost optimization patterns for Spark workloads

Certifications (Preferred)

  • Databricks Data Engineer Professional
  • FinOps Practitioner

Skills Required
Cloud billing monitoring tools, Cloud-native Databricks AWS Azure GCP, Cluster tuning auto-scaling strategies Databricks DBU model pricing, Cost optimization patterns for Spark workloads, Databricks Jobs Workflows CI CD IaC, Databricks platform internals optimization, Delta Lake internals ACID compaction Z-order, Spark performance tuning and scalability
Create a job alert for this search

Chief Lakehouse Architect Databricks CoE • Pune, India

Similar jobs

Senior Architect

Abhikalpan Architects and PlannersPune, Maharashtra, India

Role Overview: We are seeking a qualified Senior Architect at a leadership-level who will oversee, manage and guide the architectural vision of a project from conception to completion.The role re... Show more

 • Promoted

Architect

DarPune (district), Pune (division); Maharashtra, IN

Dar, the founding member of the Sidara group, is an international multidisciplinary consulting organization specializing in engineering, architecture, planning, environment, project management, fac... Show more

 • Promoted

Senior Architect

Naiknavare Developers Pvt. Ltd.Pune, Maharashtra, India

Preparation and checking of working drawings and details in time.Frequent site visits throughout construction phase of the projects to monitor the quality of work as per specifications and working ... Show more

 • Promoted

Lead Architect

DarPune, Maharashtra, India

Job Description About the job Dar Al-Handasah (Shair and Partners) is the founding company of the Dar Group, an international consortium of professional service firms.Through its 18,000 staff membe... Show more