Talent.com
Databricks Architect
Databricks ArchitectJio • Mumbai, Maharashtra, India
Databricks Architect

Databricks Architect

Jio • Mumbai, Maharashtra, India
30+ days ago
Job description

Title : Senior Databricks Architect

Location : Mumbai Gurgaon Hyderabad

About the Role

We are seeking a Senior Databricks Architect to lead the design and implementation of scalable secure and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion transformation governance and analytics and mentor engineering teams to deliver high-quality data solutions.

Key Responsibilities

  • Architect and implement enterprise-grade data platforms on Azure Databricks (DLT Workflows Unity Catalog) with strong security governance and reliability.
  • Design end-to-end data pipelines : batch and streaming (Structured Streaming) CDC and near real-time analytics.
  • Define and enforce data modeling standards (3NF dimensional modeling / starsnowflake data vault where applicable).
  • Optimize Databricks workloads (cluster sizing autoscaling Delta Lake file management Z-Ordering OPTIMIZE / VACUUM) for performance and cost.
  • Establish best practices for code (PySpark / Scala / SQL) notebooks repos / CI-CD testing observability and documentation.
  • Integrate with broader Azure ecosystem : ADLS Gen2 ADF / Synapse pipelines Azure SQL / MI Azure Key Vault Event Hubs / Kafka Azure Functions / Logic Apps.
  • Drive data governance lineage and access control with Unity Catalog data masking and RBAC / ABAC; align with organizational compliance (GDPR / DPDP SOC2).
  • Collaborate with security / network teams on private networking (VNet injection) peering firewall rules Private Link NSGs VPN / ExpressRoute.
  • Lead capacity planning SLAs / SLOs incident response and cost management (photon serverless job vs all-purpose clusters).
  • Partner with stakeholders (data science BI product) to translate business requirements into scalable data solutions.
  • Mentor and upskill data engineers; perform code / design reviews; establish architectural guardrails and reference architectures.

Required Qualifications

  • 810 years of professional experience in data engineering / architecture with at least 3 years hands-on in Databricks on Azure.
  • Strong data modeling expertise : relational 3NF dimensional (Kimball) and practical experience with Delta Lake / medallion architecture.
  • Advanced programming skills : PySpark and / or Scala; solid grasp of OOP principles and design patterns in data engineering contexts.
  • Expert SQL skills (analytic / window functions performance tuning query optimization).
  • Deep experience with Azure services : ADLS Gen2 ADF / Synapse Azure SQL / MI Event Hubs; identity and security (AAD service principals managed identities Key Vault).
  • Hands-on with Databricks features : Delta Live Tables Unity Catalog Workflows Repos / CI-CD cluster policies Jobs API.
  • Networking fundamentals for cloud data platforms : VNet design subnets routing Private Link / Endpoints peering DNS firewalling.
  • Database fundamentals : relational and NoSQL (e.g. PostgreSQL SQL Server Cosmos DB) indexing partitioning transactions.
  • Proven track record building robust ELT / ETL pipelines CDC (e.g. with Auto Loader Kafka) and streaming architectures.
  • Experience with DevOps practices : Git CI-CD (Azure DevOps / GitHub Actions) Infrastructure-as-Code (Terraform / ARM / Bicep preferred).
  • Strong communication stakeholder management and leadership / mentoring experience.
  • Bachelors degree in Computer Science / Engineering or related field from a reputed Indian college / institute.
  • Preferred / Good-to-Have

  • Databricks certifications (Databricks Certified Data Engineer Professional Machine Learning Professional or Architect Associate).
  • Experience with BI tools and semantic layers (Power BI dbt Tabular models).
  • Exposure to MLOps and feature stores (Databricks Feature Store) and model serving.
  • Cost governance experience : chargeback / showback cluster policy enforcement utilization dashboards.
  • Knowledge of data privacy and compliance frameworks (DPDP Act GDPR HIPAA as applicable).
  • Soft Skills

  • Ownership mindset bias for action and ability to operate in ambiguous environments.
  • Excellent problem-solving and architectural decision-making.
  • Ability to mentor teams and cultivate engineering best practices.
  • Key Skills

    APIs,Pegasystems,Spring,SOAP,.NET,Hybris,Solution Architecture,Service-Oriented Architecture,Adobe Experience Manager,J2EE,Java,Oracle

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Yearly Salary Salary : 2500000 - 8000000

    Create a job alert for this search

    Architect • Mumbai, Maharashtra, India

    Related jobs
    Senior Databricks Architect

    Senior Databricks Architect

    Jio • Mumbai, Maharashtra, India
    We are seeking a Senior Databricks Architect to lead the design and implementation of scalable secure and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architectur...Show more
    Last updated: 30+ days ago • Promoted
    Azure Databricks

    Azure Databricks

    Kumaran Systems • Mumbai, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 10 days ago • Promoted
    Azure Databricks Architect

    Azure Databricks Architect

    Confidential • Mumbai, Pune
    Handle day-to-day administration tasks such as configuring clusters and workspaces, monitor platform health, troubleshoot issues, and perform routine maintenance and upgrades.Evaluate new features ...Show more
    Last updated: 30+ days ago • Promoted
    Databricks Architect ( Full-time at a Fortune 500 tech MNC )

    Databricks Architect ( Full-time at a Fortune 500 tech MNC )

    HARP • Mumbai, IN
    Lead the architecture, design, and implementation of data lakehouse solutions leveraging Databricks, Delta Lake, Unity Catalog, and Apache Spark. Define and enforce architectural best practices for ...Show more
    Last updated: 4 days ago • Promoted
    Data Architect

    Data Architect

    Recro • Mumbai, IN
    Central Data Office – Data Architect.SMEs, engineers, and developers to design and govern enterprise-level data architectures, ensuring alignment with corporate data principles and standards.This p...Show more
    Last updated: 24 days ago • Promoted
    Solution & Data Architect - Azure Applications

    Solution & Data Architect - Azure Applications

    Infotechtion • Mumbai, IN
    Solution & Data Architect - Azure Applications .Location : India (Remote) | Employment Type : Full-time .Senior - 8-11+ Years of experience. We are seeking an accomplished Solution and Data Architect ...Show more
    Last updated: 24 days ago • Promoted
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Mumbai, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 10 days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • Mumbai, IN
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 10 days ago • Promoted
    Data and Ai Solution Architect

    Data and Ai Solution Architect

    Aventra Group • Mumbai, IN
    Job Title : Data & AI Solution Architect.The Data & AI Architect role is accountable for designing high-level, end-to-end data platform solutions that address complex business problems.You will lead...Show more
    Last updated: 2 days ago • Promoted
    AI Architect

    AI Architect

    TekPillar® • Mumbai, IN
    Cloud platforms (AWS or equivalent).Artificial Intelligence / Large Language Models (LLMs).Architect and design a scalable and robust agentic AI platform for automotive domains.Evaluate and impleme...Show more
    Last updated: 2 hours ago • Promoted • New!
    Senior Data Architect- Snowflake

    Senior Data Architect- Snowflake

    USEReady • Mumbai, IN
    USEReady is a data and analytics firm that provides the strategies, tools, capability, and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud...Show more
    Last updated: 8 days ago • Promoted
    AI & Data Architect

    AI & Data Architect

    CloudFronts - AI First Microsoft Solutions Partner • Mumbai, Maharashtra, India
    AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI / ML solutions, data engineering, and analytics.The role i...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Mumbai, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 15 days ago • Promoted
    Data Architect

    Data Architect

    Epsilon Technologies Group • Mumbai, IN
    About Epsilon Technologies Group.Epsilon is a capital markets technology solutions and services firm helping financial institutions manage everything on their balance sheet with a scalable and inno...Show more
    Last updated: 14 days ago • Promoted
    Data Architect

    Data Architect

    Visara Partners • Mumbai, IN
    Location - Blore / Hyderabad (Hybrid model 3 days).Gurgaon (Monthly thrice to office, if required additional days also).Expertise with minimum 5+ projects (10+ Yrs exp. SQL Server and Azure SQL Databa...Show more
    Last updated: 6 hours ago • Promoted • New!
    Freelance Data Architect

    Freelance Data Architect

    Leading MNC • Mumbai, IN
    The candidate should have a minimum of 12+ yrs.If you're looking for freelance / part time opportunity (along with your day job) & a chance to work with the top 0. You will report into IIT'ans / BITS g...Show more
    Last updated: 18 days ago • Promoted
    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Associate Director, Data Architecture (Snowflake • Databricks • AWS • CPG / FMCG • Enterprise Data)

    Sky Systems, Inc. (SkySys) • Mumbai, IN
    Associate Director, Data Architecture.Full-Time Contract (40hrs / week).Months+ (with a possibility of Contract-to-Hire). Marketing, Product, Finance, Supply Chain, and global business teams.This role...Show more
    Last updated: 8 days ago • Promoted
    Data Architect - Remote

    Data Architect - Remote

    ACL Digital • Mumbai, Maharashtra, India
    ACL is Hiring : AWS Data Architect.Remote - Mumbai, Pune, Bangalore (resources based in these locations).Review and assess existing AWS data environments and platforms. Design and document scalable c...Show more
    Last updated: 8 days ago • Promoted