Azure Data Lead

What you’ll do :

• Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL).
• Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) to drive optimal data transformation and organization.
• Oversee data governance, access control, and lineage using Databricks Unity Catalog; champion best practices for metadata management.
• Manage and mentor a team of data engineers; provide technical guidance and career development opportunities.
• Direct the management of data storage solutions using Azure Data Lake Storage (ADLS), ensuring robust access policies.
• Establish and maintain Delta Lake tables for reliable, scalable ACID transactions and incremental processing across projects.
• Optimize Spark jobs and Databricks clusters for performance, scalability, and cost efficiency at enterprise scale.
• Lead ingestion and transformation strategies from diverse sources (APIs, files, databases, cloud platforms).
• Partner with stakeholders and cross-functional teams to deliver well-governed, reusable data models and analytics solutions.
• Drive implementation of data quality frameworks, error handling mechanisms, and robust monitoring practices.
• Enforce data security, governance, and compliance requirements across all Azure and cloud data assets.
• Utilize Azure Synapse Analytics, Key Vault, and Azure Monitor to build resilient, secure, and observable data platforms.
• Own CI / CD and deployment best practices using Git and Azure DevOps; establish automation standards and code review processes.
• Stay ahead of industry trends in big data, ETL, and lakehouse technologies; proactively recommend improvements.
• Collaborate with data science and AI teams to support machine learning (ML), generative AI, and large language model (LLM) initiatives using enterprise data.
• Guide data consultation efforts for enterprise digital transformation, advising stakeholders on data architecture modernization and strategic priorities.
• Develop and articulate an “AI-ready” data roadmap, enabling the business to leverage advanced analytics, ML, and LLM solutions.
• Ensure data pipelines and platforms are optimized for ML and AI workloads, including integration and preparation of datasets for model training and inference.

What we seek in you :

Life at Next :

At our core, we're driven by the mission of tailoring growth for our customers by enabling them to transform their aspirations into tangible outcomes. We're dedicated to empowering them to shape their futures and achieve ambitious goals. To fulfil this commitment, we foster a culture defined by agility, innovation, and an unwavering commitment to progress. Our organizational framework is both streamlined and vibrant, characterized by a hands-on leadership style that prioritizes results and fosters growth.

Perks of working with us :

Who we are?

We enable high growth enterprises build hyper personalized solutions to transform their vision into reality. With a keen eye for detail, we apply creativity, embrace new technology and harness the power of data and AI to co-create solutions tailored made to meet unique needs for our customers.

Join our passionate team and tailor your growth with us!