Talent.com
This job offer is not available in your country.
Senior Databricks Architect (Mumbai / Hyderabad / Gurgaon)

Senior Databricks Architect (Mumbai / Hyderabad / Gurgaon)

Jio Platforms Limited (JPL)Mumbai, Maharashtra, India
12 hours ago
Job description

Work Locations : Mumbai OR Hyderabad OR Gurgaon

About the Role :

We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions.

Key Responsibilities

  • Architect and implement enterprise-grade data platforms on Azure Databricks (DLT, Workflows, Unity Catalog) with strong security, governance, and reliability.
  • Design end-to-end data pipelines : batch and streaming (Structured Streaming), CDC, and near real-time analytics.
  • Define and enforce data modeling standards (3NF, dimensional modeling / star–snowflake, data vault where applicable).
  • Optimize Databricks workloads (cluster sizing, autoscaling, Delta Lake file management, Z-Ordering, OPTIMIZE / VACUUM) for performance and cost.
  • Establish best practices for code (PySpark / Scala / SQL), notebooks, repos / CI-CD, testing, observability, and documentation.
  • Integrate with broader Azure ecosystem : ADLS Gen2, ADF / Synapse pipelines, Azure SQL / MI, Azure Key Vault, Event Hubs / Kafka, Azure Functions / Logic Apps.
  • Drive data governance, lineage, and access control with Unity Catalog, data masking, and RBAC / ABAC; align with organizational compliance (GDPR / DPDP, SOC2).
  • Collaborate with security / network teams on private networking (VNet injection), peering, firewall rules, Private Link, NSGs, VPN / ExpressRoute.
  • Lead capacity planning, SLAs / SLOs, incident response, and cost management (photon, serverless, job vs all-purpose clusters).
  • Partner with stakeholders (data science, BI, product) to translate business requirements into scalable data solutions.
  • Mentor and upskill data engineers; perform code / design reviews; establish architectural guardrails and reference architectures.

Required Qualifications

  • 8–10 years of professional experience in data engineering / architecture, with at least 3+ years hands-on in Databricks on Azure.
  • Strong data modeling expertise : relational 3NF, dimensional (Kimball), and practical experience with Delta Lake / medallion architecture.
  • Advanced programming skills : PySpark and / or Scala; solid grasp of OOP principles and design patterns in data engineering contexts.
  • Expert SQL skills (analytic / window functions, performance tuning, query optimization).
  • Deep experience with Azure services : ADLS Gen2, ADF / Synapse, Azure SQL / MI, Event Hubs; identity and security (AAD, service principals, managed identities, Key Vault).
  • Hands-on with Databricks features : Delta Live Tables, Unity Catalog, Workflows, Repos / CI-CD, cluster policies, Jobs API.
  • Networking fundamentals for cloud data platforms : VNet design, subnets, routing, Private Link / Endpoints, peering, DNS, firewalling.
  • Database fundamentals : relational and NoSQL (e.g., PostgreSQL, SQL Server, Cosmos DB), indexing, partitioning, transactions.
  • Proven track record building robust ELT / ETL pipelines, CDC (e.g., with Auto Loader, Kafka), and streaming architectures.
  • Experience with DevOps practices : Git, CI-CD (Azure DevOps / GitHub Actions), Infrastructure-as-Code (Terraform / ARM / Bicep preferred).
  • Strong communication, stakeholder management, and leadership / mentoring experience.
  • Bachelor’s degree in Computer Science / Engineering or related field from a reputed Indian college / institute.
  • Preferred / Good-to-Have

  • Databricks certifications (Databricks Certified Data Engineer Professional, Machine Learning Professional, or Architect Associate).
  • Experience with BI tools and semantic layers (Power BI, dbt, Tabular models).
  • Exposure to MLOps and feature stores (Databricks Feature Store) and model serving.
  • Cost governance experience : chargeback / showback, cluster policy enforcement, utilization dashboards.
  • Knowledge of data privacy and compliance frameworks (DPDP Act, GDPR, HIPAA as applicable).
  • Create a job alert for this search

    Senior Architect • Mumbai, Maharashtra, India

    Related jobs
    • Promoted
    • New!
    Databricks Engineer

    Databricks Engineer

    Tata Consultancy ServicesMumbai, Maharashtra, India
    Hyderabad, Noida, Chennai, Mumbai.Azure Databricks using Scala, PySpark.Experience of full Software Development Life Cycle experience. Design and develop reusable software modules that meet customer...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    Senior Software Engineer, Data Engineering

    Senior Software Engineer, Data Engineering

    Sony Pictures Networks IndiaMumbai, Maharashtra, India
    Senior Software Engineer, Data Engineering.Purpose : This position is required to provide technology leadership on medium to large scale products / platform with internal and direct customer impact.Te...Show moreLast updated: 14 hours ago
    • Promoted
    • New!
    GCP Data Engineer

    GCP Data Engineer

    EXLThane, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 17 hours ago
    • Promoted
    • New!
    Kafka Architect (Freelancing)

    Kafka Architect (Freelancing)

    ValueLabsKalyan-Dombivli, IN
    Kafka Architect (Kafka Event Hub Stream).The Kafka Architect will be a senior architect / engineer responsible for designing, implementing, and advising on large-scale Confluent Kafka platforms.This ...Show moreLast updated: 17 hours ago
    • Promoted
    • New!
    SAP WM & EWM (Data Migration)

    SAP WM & EWM (Data Migration)

    brabersmumbai city, maharashtra, in
    The SAP EWM / WM Data Migration serves as the global focal point for warehouse-related data objects during migration projects. This role ensures accurate collection, validation, and migration of EWM / W...Show moreLast updated: 15 hours ago
    • Promoted
    Databricks Architect

    Databricks Architect

    beBeeDataEngineerMumbai, Maharashtra, India
    Data architects design, develop and maintain data assets.Collaborate with stakeholders to understand data requirements.Create documentation for data integration processes.Lead data validation, UAT ...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Integration Reliability and Devops Engineer

    Data Integration Reliability and Devops Engineer

    RapidBrainsThane, IN
    Data Integration Reliability & DevOps Engineer.Normal IST (with 2–3 hours overlap as per client need).We are seeking a highly skilled Data Integration Reliability & DevOps Engineer to join our team...Show moreLast updated: 17 hours ago
    • Promoted
    Management Information System Executive

    Management Information System Executive

    The Hiring CompanyBandra, Maharashtra, India
    Job Description – MIS Executive.Project : Government Survey Project.Language Requirement : Marathi (Mandatory).We are looking for a detail-oriented and analytical MIS Executive to join our Government...Show moreLast updated: 22 days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Gretia Tech Services Private LimitedMumbai
    Description : Key Skills & Experience : - 2+ years of hands-on experience with Databricks, including job optimization and ...Show moreLast updated: 6 days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystemsKalyan-Dombivli, IN
    We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    MS Dynamics 365 Developer

    MS Dynamics 365 Developer

    Sataware TechnologiesKalyan-Dombivli, IN
    This is a full-time remote role for an MS Dynamics 365 Developer.The developer will be responsible for designing, developing, and implementing MS Dynamics 365 solutions to meet business needs.Key d...Show moreLast updated: 17 hours ago
    • Promoted
    • New!
    Senior Tableau Developer - Contract

    Senior Tableau Developer - Contract

    Korn FerryMumbai, IN
    Korn Ferry is a global organizational consulting firm.We help clients synchronize strategy and talent to drive superior performance. Korn Ferry works with organizations to design their structures, r...Show moreLast updated: 17 hours ago
    • Promoted
    snowflake Cloud Database Administrator

    snowflake Cloud Database Administrator

    Leading automobile GCCthane, maharashtra, in
    Cloud Platform Expertise : Familiarity with leading cloud platforms such as Amazon Web Services (AWS), Microsoft Azure, and Snowflake is essential. Understanding their database offerings, such as AWS...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Developer

    Databricks Developer

    Seaspan CorporationMumbai
    Position Description : We are seeking a skilled Databricks Developer to join our Data Development team.Reporting to the Team Lead, Data Development, the Databricks D...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Architect Lead

    Big Data Architect Lead

    beBeeDataThane, Maharashtra, India
    A senior data engineer leads a team of big data engineers in developing architectures to meet client and team requirements. They provide technical leadership, guidance, and support in setting up the...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Data Cloud Developer

    Data Cloud Developer

    People Prime WorldwideMumbai, IN
    They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by un...Show moreLast updated: 1 hour ago
    • Promoted
    Salesforce Data Cloud Architect

    Salesforce Data Cloud Architect

    RialtesKalyan-Dombivli, IN
    Job Description : Salesforce Data Cloud Lead.Freelance / Contract - 6 months.We are looking for an experienced.This role requires deep knowledge of. Salesforce Data Cloud (formerly Customer Data Plat...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Big Data Developer

    Big Data Developer

    BayOne SolutionsKalyan-Dombivli, IN
    We are seeking a highly skilled.The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and ef...Show moreLast updated: 1 hour ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Tata Consultancy ServicesMumbai, Maharashtra, India
    Notice Period- 0 to 60 days / Serving Notice period.Skills : GCP, PySpark, Python, HDFS, Hadoop, SQL.Good Hands on knowledge on GCP. Should have worked on Data Migration projects, from On-prem to Clo...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticsmumbai city, maharashtra, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 20 days ago