Senior Databricks ArchitectJio • Mumbai, Maharashtra, India
Senior Databricks Architect
Jio • Mumbai, Maharashtra, India
30+ days ago
Job description810 years of professional experience in data engineering / architecture with at least 3 years hands-on in Databricks on Azure. Strong data modeling expertise : relational 3NF dimensional (Kimball) and practical experience with Delta Lake / medallion architecture. Advanced programming skills : PySpark and / or Scala; solid grasp of OOP principles and design patterns in data engineering contexts. Expert SQL skills (analytic / window functions performance tuning query optimization). Deep experience with Azure services : ADLS Gen2 ADF / Synapse Azure SQL / MI Event Hubs; identity and security (AAD service principals managed identities Key Vault). Hands-on with Databricks features : Delta Live Tables Unity Catalog Workflows Repos / CI-CD cluster policies Jobs API. Networking fundamentals for cloud data platforms : VNet design subnets routing Private Link / Endpoints peering DNS firewalling. Database fundamentals : relational and NoSQL (e.g. PostgreSQL SQL Server Cosmos DB) indexing partitioning transactions. Proven track record building robust ELT / ETL pipelines CDC (e.g. with Auto Loader Kafka) and streaming architectures. Experience with DevOps practices : Git CI-CD (Azure DevOps / GitHub Actions) Infrastructure-as-Code (Terraform / ARM / Bicep preferred). Strong communication stakeholder management and leadership / mentoring experience. Bachelors degree in Computer Science / Engineering or related field from a reputed Indian college / institute. Databricks certifications (Databricks Certified Data Engineer Professional Machine Learning Professional or Architect Associate). Experience with BI tools and semantic layers (Power BI dbt Tabular models). Exposure to MLOps and feature stores (Databricks Feature Store) and model serving. Cost governance experience : chargeback / showback cluster policy enforcement utilization dashboards. Knowledge of data privacy and compliance frameworks (DPDP Act GDPR HIPAA as applicable).
About the Role
We are seeking a Senior Databricks Architect to lead the design and implementation of scalable secure and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion transformation governance and analytics and mentor engineering teams to deliver high-quality data solutions.
Key Responsibilities
- Architect and implement enterprise-grade data platforms on Azure Databricks (DLT Workflows Unity Catalog) with strong security governance and reliability.
- Design end-to-end data pipelines : batch and streaming (Structured Streaming) CDC and near real-time analytics.
- Define and enforce data modeling standards (3NF dimensional modeling / starsnowflake data vault where applicable).
- Optimize Databricks workloads (cluster sizing autoscaling Delta Lake file management Z-Ordering OPTIMIZE / VACUUM) for performance and cost.
- Establish best practices for code (PySpark / Scala / SQL) notebooks repos / CI-CD testing observability and documentation.
- Integrate with broader Azure ecosystem : ADLS Gen2 ADF / Synapse pipelines Azure SQL / MI Azure Key Vault Event Hubs / Kafka Azure Functions / Logic Apps.
- Drive data governance lineage and access control with Unity Catalog data masking and RBAC / ABAC; align with organizational compliance (GDPR / DPDP SOC2).
- Collaborate with security / network teams on private networking (VNet injection) peering firewall rules Private Link NSGs VPN / ExpressRoute.
- Lead capacity planning SLAs / SLOs incident response and cost management (photon serverless job vs all-purpose clusters).
- Partner with stakeholders (data science BI product) to translate business requirements into scalable data solutions.
- Mentor and upskill data engineers; perform code / design reviews; establish architectural guardrails and reference architectures.
Required Qualifications
Preferred / Good-to-Have
Required Experience :
Manager
Key Skills
Apache Hive,S3,Redshift,Spark,AWS,Solr,NoSQL,Data Warehouse,Internet Of Things,Kafka,DynamoDB,ZooKeeper
Employment Type : Full-Time
Experience : years
Vacancy : 1
Create a job alert for this search
Senior Architect • Mumbai, Maharashtra, India
Related jobs
)
Azure + Databricks
PwC India • Mumbai, Maharashtra, India
Job Title : Azure Data Engineer.As a Manager in the Data Engineering practice, you will lead teams and client engagements to design, architect, and deliver enterprise-grade data platforms.You’ll dri...Show more
Last updated: 9 days ago • Promoted
Senior Solutions Architect (Data)
Hillview Consulting Solutions • Mumbai, IN
If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on.
You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
Last updated: 10 days ago • Promoted
Solution & Data Architect - Azure Applications
Infotechtion • Mumbai, IN
Solution & Data Architect - Azure Applications .Location : India (Remote) | Employment Type : Full-time .Senior - 8-11+ Years of experience.
We are seeking an accomplished Solution and Data Architect ...Show more
Last updated: 25 days ago • Promoted
Data Architect
Andela • Mumbai, IN
Andela exists to connect brilliance and opportunity.Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations ...Show more
Last updated: 10 days ago • Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.io • Mumbai, IN
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
Last updated: 10 days ago • Promoted
Data and Ai Solution Architect
Aventra Group • Mumbai, IN
Job Title : Data & AI Solution Architect.The Data & AI Architect role is accountable for designing high-level, end-to-end data platform solutions that address complex business problems.You will lead...Show more
Last updated: 3 days ago • Promoted
Lead Cloud Architect
Oracle • Mumbai, Maharashtra, India
Job Description : Lead Cloud Architect – Multicloud.We are seeking a visionary and hands-on Lead Cloud Architect to lead end-to-end architecture, solution development, innovation, and delivery acros...Show more
Last updated: 30+ days ago • Promoted
Senior Data Architect- Snowflake
USEReady • Mumbai, IN
USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage.
USEReady partners with cloud...Show more
Last updated: 8 days ago • Promoted
Senior Architect
Mount Talent Consulting Pvt Ltd. • Mumbai, Maharashtra, India
As a Senior Architect - Data Modeler, you will play a pivotal role in shaping the data architecture of our enterprise systems.
This role demands a seasoned professional with deep expertise in Oracle...Show more
Last updated: 14 days ago • Promoted
AI & Data Architect
CloudFronts - AI First Microsoft Solutions Partner • Mumbai, Maharashtra, India
AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI / ML solutions, data engineering, and analytics.The role i...Show more
Last updated: 30+ days ago • Promoted
Senior Architect - Data
Quantiphi • Mumbai, Maharashtra, India
Role : Senior Architect - Data & Cloud.Work location : Mumbai / Bangalore (hybrid).More than 15 years of experience in Technical, Solutioning, and Analytical roles.
Data Lakes, Data Warehouse, Data Int...Show more
Last updated: 30+ days ago • Promoted
AWS Data Architect
ACL Digital • Mumbai, IN
AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices.
.AWS Certified Solutions Architect preferred.Show more
Last updated: 15 days ago • Promoted
Senior Solutions Architect – Data & Analytics (Life Sciences)
Celito Tech, Inc. • Mumbai, IN
Job Title : Senior Solutions Architect – Data & Analytics (Life Sciences).Timings : Can extend upto 11 pm IST.The Celito Team architects the buildout of simplified, integrated, and compliant technol...Show more
Last updated: 15 days ago • Promoted
Databricks Architect
Jio • Mumbai, Maharashtra, India
We are seeking a Senior Databricks Architect to lead the design and implementation of scalable secure and cost-optimized data platforms on Azure using Databricks.
You will own end-to-end architectur...Show more
Last updated: 30+ days ago • Promoted
Data Architect
Epsilon Technologies Group • Mumbai, IN
About Epsilon Technologies Group.Epsilon is a capital markets technology solutions and services firm helping financial institutions manage everything on their balance sheet with a scalable and inno...Show more
Last updated: 14 days ago • Promoted
Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)
Sky Systems, Inc. (SkySys) • Mumbai, IN
Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire).
Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show more
Last updated: 9 days ago • Promoted
Senior Data Engineer
VRIZE • Mumbai, IN
Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database.
Develop and optimize complex SQL queries for data extract...Show more
Last updated: 3 days ago • Promoted
Data Architect - Remote
ACL Digital • Mumbai, Maharashtra, India
ACL is Hiring : AWS Data Architect.Remote - Mumbai, Pune, Bangalore (resources based in these locations).Review and assess existing AWS data environments and platforms.
Design and document scalable c...Show more
Last updated: 9 days ago • Promoted