Talent.com
Databricks Architect
Databricks ArchitectJio • Mumbai, Maharashtra, India
Databricks Architect

Databricks Architect

Jio • Mumbai, Maharashtra, India
30+ days ago
Job description

Title : Senior Databricks Architect

Location : Mumbai Gurgaon Hyderabad

About the Role

We are seeking a Senior Databricks Architect to lead the design and implementation of scalable secure and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion transformation governance and analytics and mentor engineering teams to deliver high-quality data solutions.

Key Responsibilities

  • Architect and implement enterprise-grade data platforms on Azure Databricks (DLT Workflows Unity Catalog) with strong security governance and reliability.
  • Design end-to-end data pipelines : batch and streaming (Structured Streaming) CDC and near real-time analytics.
  • Define and enforce data modeling standards (3NF dimensional modeling / starsnowflake data vault where applicable).
  • Optimize Databricks workloads (cluster sizing autoscaling Delta Lake file management Z-Ordering OPTIMIZE / VACUUM) for performance and cost.
  • Establish best practices for code (PySpark / Scala / SQL) notebooks repos / CI-CD testing observability and documentation.
  • Integrate with broader Azure ecosystem : ADLS Gen2 ADF / Synapse pipelines Azure SQL / MI Azure Key Vault Event Hubs / Kafka Azure Functions / Logic Apps.
  • Drive data governance lineage and access control with Unity Catalog data masking and RBAC / ABAC; align with organizational compliance (GDPR / DPDP SOC2).
  • Collaborate with security / network teams on private networking (VNet injection) peering firewall rules Private Link NSGs VPN / ExpressRoute.
  • Lead capacity planning SLAs / SLOs incident response and cost management (photon serverless job vs all-purpose clusters).
  • Partner with stakeholders (data science BI product) to translate business requirements into scalable data solutions.
  • Mentor and upskill data engineers; perform code / design reviews; establish architectural guardrails and reference architectures.

Required Qualifications

  • 810 years of professional experience in data engineering / architecture with at least 3 years hands-on in Databricks on Azure.
  • Strong data modeling expertise : relational 3NF dimensional (Kimball) and practical experience with Delta Lake / medallion architecture.
  • Advanced programming skills : PySpark and / or Scala; solid grasp of OOP principles and design patterns in data engineering contexts.
  • Expert SQL skills (analytic / window functions performance tuning query optimization).
  • Deep experience with Azure services : ADLS Gen2 ADF / Synapse Azure SQL / MI Event Hubs; identity and security (AAD service principals managed identities Key Vault).
  • Hands-on with Databricks features : Delta Live Tables Unity Catalog Workflows Repos / CI-CD cluster policies Jobs API.
  • Networking fundamentals for cloud data platforms : VNet design subnets routing Private Link / Endpoints peering DNS firewalling.
  • Database fundamentals : relational and NoSQL (e.g. PostgreSQL SQL Server Cosmos DB) indexing partitioning transactions.
  • Proven track record building robust ELT / ETL pipelines CDC (e.g. with Auto Loader Kafka) and streaming architectures.
  • Experience with DevOps practices : Git CI-CD (Azure DevOps / GitHub Actions) Infrastructure-as-Code (Terraform / ARM / Bicep preferred).
  • Strong communication stakeholder management and leadership / mentoring experience.
  • Bachelors degree in Computer Science / Engineering or related field from a reputed Indian college / institute.
  • Preferred / Good-to-Have

  • Databricks certifications (Databricks Certified Data Engineer Professional Machine Learning Professional or Architect Associate).
  • Experience with BI tools and semantic layers (Power BI dbt Tabular models).
  • Exposure to MLOps and feature stores (Databricks Feature Store) and model serving.
  • Cost governance experience : chargeback / showback cluster policy enforcement utilization dashboards.
  • Knowledge of data privacy and compliance frameworks (DPDP Act GDPR HIPAA as applicable).
  • Soft Skills

  • Ownership mindset bias for action and ability to operate in ambiguous environments.
  • Excellent problem-solving and architectural decision-making.
  • Ability to mentor teams and cultivate engineering best practices.
  • Key Skills

    APIs,Pegasystems,Spring,SOAP,.NET,Hybris,Solution Architecture,Service-Oriented Architecture,Adobe Experience Manager,J2EE,Java,Oracle

    Employment Type : Full-Time

    Experience : years

    Vacancy : 1

    Yearly Salary Salary : 2500000 - 8000000

    Create a job alert for this search

    Architect • Mumbai, Maharashtra, India

    Related jobs
    Data Architect

    Data Architect

    Sodexo • Mumbai, Maharashtra, India
    The Azure Data Architect will be responsible for leading the design, development, and optimization of Sodexo’s data architecture across key platforms, including the API Hub, Azure Integration Platf...Show more
    Last updated: 26 days ago • Promoted
    Azure + Mongo- Data Architect

    Azure + Mongo- Data Architect

    People Prime Worldwide • Kalyan-Dombivli, IN
    Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.Powered by mo...Show more
    Last updated: 3 hours ago • Promoted • New!
    Senior Solutions Architect (Data)

    Senior Solutions Architect (Data)

    Hillview Consulting Solutions • Thane, IN
    If candidate is in Mumbai this would be onsite in Andheri East, Mumbai, Maharashtra.We’re looking for a senior, hands-on. You’ll own architecture for ETL / ELT, data warehousing, analytics pipelines, ...Show more
    Last updated: 2 days ago • Promoted
    Data Architect - Remote

    Data Architect - Remote

    ACL Digital • Mumbai, Maharashtra, India
    Remote
    ACL is Hiring : AWS Data Architect Mode : Remote Locations : Remote - Mumbai, Pune, Bangalore (resources based in these locations) Working Hours : 1 PM to 10 PM Joining : Immediate (Project starts 1...Show more
    Last updated: 1 day ago • Promoted
    Snowflake Architect

    Snowflake Architect

    Bahwan CyberTek • Thane, IN
    Job Title : Snowflake Architect.Location : [Chennai / Bengaluru / Pune / Mumbai or Remote].Experience Required : 10+ Years. We are seeking a highly skilled Snowflake Architect to design and implement s...Show more
    Last updated: 27 days ago • Promoted
    Senior Architect - Data

    Senior Architect - Data

    Quantiphi • mumbai, maharashtra, in
    Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quanti...Show more
    Last updated: 30+ days ago • Promoted
    Sr. Azure Data Architect & Presales Solution

    Sr. Azure Data Architect & Presales Solution

    Programmers.io • Mumbai, IN
    Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
    Last updated: 2 days ago • Promoted
    Data Architect

    Data Architect

    Andela • Kalyan-Dombivli, IN
    Andela exists to connect brilliance and opportunity.Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations ...Show more
    Last updated: 2 days ago • Promoted
    Data Architect

    Data Architect

    Recro • Thane, IN
    Central Data Office – Data Architect.SMEs, engineers, and developers to design and govern enterprise-level data architectures, ensuring alignment with corporate data principles and standards.This p...Show more
    Last updated: 16 days ago • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    DBiz.ai • Kalyan-Dombivli, IN
    You will ensure that data is modeled, structured and integrated across the organization to support analytics and AI / ML initiatives at scale. You will work closely with business stakeholders and tech...Show more
    Last updated: 27 days ago • Promoted
    Solution & Data Architect - Azure Applications

    Solution & Data Architect - Azure Applications

    Infotechtion • Kalyan-Dombivli, IN
    Solution & Data Architect - Azure Applications .Location : India (Remote) | Employment Type : Full-time .Senior - 8-11+ Years of experience. We are seeking an accomplished Solution and Data Architect ...Show more
    Last updated: 16 days ago • Promoted
    Senior Data Architect - Snowflake

    Senior Data Architect - Snowflake

    Reflections Info Systems • mumbai city, maharashtra, in
    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions...Show more
    Last updated: 1 day ago • Promoted
    AI & Data Architect

    AI & Data Architect

    CloudFronts - AI First Microsoft Solutions Partner • Mumbai, Maharashtra, India
    AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI / ML solutions, data engineering, and analytics.The role i...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Mumbai, IN
    AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. .AWS Certified Solutions Architect preferred.Show more
    Last updated: 7 days ago • Promoted
    Data Architect

    Data Architect

    Epsilon Technologies Group • Mumbai, IN
    About Epsilon Technologies Group.Epsilon is a capital markets technology solutions and services firm helping financial institutions manage everything on their balance sheet with a scalable and inno...Show more
    Last updated: 6 days ago • Promoted
    Enterprise Data Architect

    Enterprise Data Architect

    Aptus Data Labs • Thane, IN
    Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains.We offer innovative analytical solutions and consulting services to help business...Show more
    Last updated: 4 days ago • Promoted
    GCP Data Architect

    GCP Data Architect

    HCLTech • Mumbai, IN
    Job Title - GCP Data Architect.Location - Bangalore / Chennai / Hyderabad / Noida.Contribute to architectural decisions and support the Architecture Lead in defining and delivering technology strategy.He...Show more
    Last updated: 30+ days ago • Promoted
    GCP Data Architect

    GCP Data Architect

    Lykora Consulting Services Private Limited • Thane, IN
    GCP Architecture, Data Platform Design, DevOps, Security, Cloud Infrastructure.Leads architecture and delivery of enterprise data platforms on GCP, ensuring scalability, compliance, and performance...Show more
    Last updated: 23 hours ago • Promoted