Assistant Vice President - Databricks Architect & CoE Steward

Inviting applications for the role of Assistant Vice President - Databricks Architect & CoE Steward

The Databricks Architect & CoE Steward (AVP level) will play a key role in defining and governing the adoption of Databricks Lakehouse as the strategic platform for data engineering, analytics, and AI. This role will focus on establishing architecture standards, reusable frameworks, and best practices, while ensuring solutions are secure, scalable, and cost-optimized. As a CoE Steward, the role will support the Databricks Center of Excellence by evangelizing platform capabilities, enabling cross-functional teams, and driving consistency across projects. The architect will partner with delivery teams, data engineers, and business stakeholders to ensure that Databricks solutions align with enterprise strategy, governance frameworks, and data management principles.

Responsibilities

Lead and manage Databricks-based solution delivery, ensuring alignment with client requirements, industry standards, and best practices.

Act as the subject matter expert (SME) on Databricks, providing architecture, implementation, and optimization guidance.

Collaborate with architects, engineers, and business teams to design scalable solutions for data engineering, analytics, and machine learning.

Serve as the primary point of contact for stakeholders and clients, ensuring business-technology alignment and effective communication on status, risks, and achievements.

Oversee the setup, deployment, and optimization of Databricks workspaces, clusters, and pipelines for performance and cost efficiency.

Define and enforce Databricks architecture standards, governance, and security best practices across the enterprise.

Develop reference architectures, reusable frameworks, and accelerators to improve delivery speed and quality.

Provide architecture oversight and technical leadership to delivery teams.

Drive talent development by mentoring engineers, conducting trainings / workshops, and adoption programs to upskill teams and strengthen enterprise-wide Databricks adoption.

Continuously evaluate new Databricks features and innovations, recommending improvements to enhance efficiency and effectiveness.

Partner with stakeholders to align CoE initiatives with enterprise data & AI strategy.

Act as a thought leader, evangelizing Lakehouse capabilities and shaping enterprise data & AI strategy.

Qualifications we seek in you!

Minimum Qualifications / Skills

Bachelor's degree in Computer Science , Engineering, or a related field (Master's or MBA preferred).

Relevant years in IT services with experience specifically in Databricks and cloud-based data engineering.

Preferred Qualifications / Skills

overall experience, including a strong experience in data engineering, architecture, and analytics with a strong focus on modern cloud and big data platforms.

Proven experience in leading end-to-end delivery of data engineering, analytics, or AI / ML solutions on Databricks.

Strong expertise in Lakehouse integration and Medallion architecture, including Unity Catalog, Delta Lake, Delta Live Tables, Lakeflow Connect, MLflow , AI / BI Genie etc.

Hands-on experience with Spark, data pipelines, and big data tools, with deep understanding of ETL / ELT, data lakes, data warehousing, and distributed computing.

Strong knowledge of cloud platforms (AWS, Azure, GCP) and their integration with Databricks, with understanding of Well-Architected Framework principles for building secure, reliable, cost-optimized, and efficient solutions.

Strong knowledge of both batch and near / real-time data processing and streaming using Databricks and related technologies.

Solid understanding of CI / CD pipelines for data and analytics solutions.

Solid understanding of containerization technologies such as Docker and Kubernetes.

Solid understanding of ADF (Azure Data Factory), AWS Step Functions, Airflow, and other orchestration tools

Good experience in data management and data quality frameworks (metadata management, lineage, profiling, cleansing, and monitoring).

Demonstrated leadership in Data & AI, with ability to shape strategy, influence stakeholders, and represent the CoE in executive forums.

Proven ability to drive CoE initiatives, governance frameworks, and enterprise-wide adoption of Databricks.

Proven experience of working on organizational assets and accelerators to enable faster delivery and enterprise adoption.

Proven experience in contributing to internal and external thought leadership through publishing articles, blogs, or whitepapers.

Excellent stakeholder management, communication, and presentation skills with executive presence.

Preferred Certifications :

Databricks Certified Associate or Professional.

Cloud Architect certifications (AWS Certified Solutions Architect Associate or Professional, Azure Architect Expert, or equivalent).

Certifications in data engineering (AWS / Azure / GCP Data Engineer), big data technologies, or project management (e.g., PMP, Scrum Master).