Talent.com
No longer accepting applications
Immediate Start : Azure Data Lead

Immediate Start : Azure Data Lead

TVS NextChennai, Tamil Nadu, India
13 hours ago
Job description

What you’ll do :

  • Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL).
  • Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) to drive optimal data transformation and organization.
  • Oversee data governance, access control, and lineage using Databricks Unity Catalog; champion best practices for metadata management.
  • Manage and mentor a team of data engineers; provide technical guidance and career development opportunities.
  • Direct the management of data storage solutions using Azure Data Lake Storage (ADLS), ensuring robust access policies.
  • Establish and maintain Delta Lake tables for reliable, scalable ACID transactions and incremental processing across projects.
  • Optimize Spark jobs and Databricks clusters for performance, scalability, and cost efficiency at enterprise scale.
  • Lead ingestion and transformation strategies from diverse sources (APIs, files, databases, cloud platforms).
  • Partner with stakeholders and cross-functional teams to deliver well-governed, reusable data models and analytics solutions.
  • Drive implementation of data quality frameworks, error handling mechanisms, and robust monitoring practices.
  • Enforce data security, governance, and compliance requirements across all Azure and cloud data assets.
  • Utilize Azure Synapse Analytics, Key Vault, and Azure Monitor to build resilient, secure, and observable data platforms.
  • Own CI / CD and deployment best practices using Git and Azure DevOps; establish automation standards and code review processes.
  • Stay ahead of industry trends in big data, ETL, and lakehouse technologies; proactively recommend improvements.
  • Collaborate with data science and AI teams to support machine learning (ML), generative AI, and large language model (LLM) initiatives using enterprise data.
  • Guide data consultation efforts for enterprise digital transformation, advising stakeholders on data architecture modernization and strategic priorities.
  • Develop and articulate an “AI-ready” data roadmap, enabling the business to leverage advanced analytics, ML, and LLM solutions.
  • Ensure data pipelines and platforms are optimized for ML and AI workloads, including integration and preparation of datasets for model training and inference.

What we seek in you :

  • Bachelor’s or Master’s in Computer Science, Engineering, or related field.
  • 8+ years of experience in data engineering, with 2+ years in a technical lead or supervisory role.
  • Advanced expertise in Databricks, PySpark, SQL, Azure cloud data engineering, and related tools.
  • Proven track record architecting and leading end-to-end pipeline solutions leveraging Medallion architecture, Unity Catalog, and Delta Lake.
  • Experience mentoring and scaling data engineering teams; excellent leadership and communication skills.
  • Deep understanding of big data principles, data lakehouse architectures, and cloud ETL orchestration.
  • Hands-on with Azure Data Lake Storage (ADLS), Data Factory (ADF), Synapse Analytics, Key Vault, Sql Server and Azure Monitor.
  • Skilled in CI / CD pipelines, automation with Git and Azure DevOps, and code quality enforcement.
  • Strong analytical mindset with a strategic approach to problem-solving and stakeholder management.
  • Certifications in Azure / Data Engineering (Databricks, Azure) are highly desired.
  • Proven ability to consult on data strategy and architecture for large-scale digital transformation initiatives.
  • Strong knowledge of data preparation, feature engineering, and optimization for ML and AI workloads.
  • Experience collaborating cross-functionally with data science, analytics, and business teams on ML / AI use cases.
  • Life at Next :

    At our core, we're driven by the mission of tailoring growth for our customers by enabling them to transform their aspirations into tangible outcomes. We're dedicated to empowering them to shape their futures and achieve ambitious goals. To fulfil this commitment, we foster a culture defined by agility, innovation, and an unwavering commitment to progress. Our organizational framework is both streamlined and vibrant, characterized by a hands-on leadership style that prioritizes results and fosters growth.

    Perks of working with us :

  • Clear objectives to ensure alignment with our mission, fostering your meaningful contribution.
  • Abundant opportunities for engagement with customers, product managers, and leadership.
  • You'll be guided by progressive paths while receiving insightful guidance from managers through ongoing feedforward sessions.
  • Cultivate and leverage robust connections within diverse communities of interest. Choose your mentor to navigate your current endeavors and steer your future trajectory.
  • Embrace continuous learning and upskilling opportunities through Nexversity.
  • Enjoy the flexibility to explore various functions, develop new skills, and adapt to emerging technologies. Embrace a hybrid work model promoting work-life balance. Access comprehensive family health insurance coverage, prioritizing the well-being of your loved ones.
  • Embark on accelerated career paths to actualize your professional aspirations.
  • Who we are?

    We enable high growth enterprises build hyper personalized solutions to transform their vision into reality. With a keen eye for detail, we apply creativity, embrace new technology and harness the power of data and AI to co-create solutions tailored made to meet unique needs for our customers.

    Join our passionate team and tailor your growth with us!

    Create a job alert for this search

    Immediate Start Lead • Chennai, Tamil Nadu, India

    Related jobs
    • Promoted
    Cloud Data Delivery & Modernization Lead

    Cloud Data Delivery & Modernization Lead

    Pacific Data IntegratorsChennai, IN
    Core Technical & Domain Skills.Extensive hands-on experience with cloud modernization of ETL pipelines.Strong data debugging skills and deep understanding of enterprise analytics stack.Proven track...Show moreLast updated: 24 days ago
    • Promoted
    Azure Databricks Engineer

    Azure Databricks Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Databricks Engineer (Individual Contributor).Required Technical Skill Set • •.Location : Hyd,Kolkata, Noida, Chennai, Bangalore. Desired Competencies (Technical / Behavioral Competency).Responsibility of...Show moreLast updated: 21 days ago
    • Promoted
    Senior Azure / SQL Developer - Big Data / PySpark

    Senior Azure / SQL Developer - Big Data / PySpark

    Lancesoft India Pvt LtdChennai
    Description : Position Overview As a Senior Azure / SQL Developer, you will be responsible for the end-to-end development, deployment, a...Show moreLast updated: 3 days ago
    • Promoted
    Azure Data Lead

    Azure Data Lead

    TVS NextChennai, Tamil Nadu, India
    Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL). Architect and implement Medallion Architecture (Bronze, Si...Show moreLast updated: 1 day ago
    • Promoted
    ▷ Immediate Start : Azure Data Engineer

    ▷ Immediate Start : Azure Data Engineer

    TVS NextChennai, Tamil Nadu, India
    What you’ll be doing? You will be responsible for the development, integration and deployment of software products.Being part of a distributed agile team, you will be expected to code, conduct cod...Show moreLast updated: 30+ days ago
    • Promoted
    Capability Lead - Azure Databricks

    Capability Lead - Azure Databricks

    Mastech DigitalChennai
    Description : - Position : Capability Lead Databricks (Director / Enterprise) - Chennai, Hyderabad, Bangalore or Noida (Hybrid) Show moreLast updated: 30+ days ago
    • Promoted
    Glencore - Senior Data Engineer - Azure Cloud

    Glencore - Senior Data Engineer - Azure Cloud

    Glencore India Pvt LtdChennai
    THE ROLE : As a Senior Data Engineer, you will be part of a team who design, build and maintain scalable, secure, and high-performance data solutions on Microsoft Azure.You wi...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Synapse

    Azure Synapse

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Role - Azure Synapse Analytics.Required Technical Skill Set • •.ADF Synapse ADB Python SQL DevOps Git VStudio ADLS 2 and SSIS and SSRS. Good to have Technical Skill Set.Power Bi architecture and integ...Show moreLast updated: 13 days ago
    • Promoted
    Data Platform Lead Digital : Cloud DevOps

    Data Platform Lead Digital : Cloud DevOps

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Data Platform Lead Digital : Cloud DevOps.Please read Job description before Applying.NOTE : If the skills / profile matches and interested, please reply to this email by attaching your latest updated...Show moreLast updated: 5 days ago
    • Promoted
    Team Lead - AWS / Azure / GCP

    Team Lead - AWS / Azure / GCP

    Soft Suave Technologies Private LimitedChennai
    Job Description : - Lead the development and implementation of secure, scalable, and cost-effective cloud architectures, especially on AWS,...Show moreLast updated: 19 days ago
    • Promoted
    Azure Senior Data Engineer

    Azure Senior Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    We await your innovation at TCS : Hiring |Azure Senior Data Engineers|.Required Experience : 5-10 years.Data Pipeline Development : Design, build, and optimize scalable data pipelines using Azure Data...Show moreLast updated: 6 days ago
    • Promoted
    Lead AWS Data Engineer (12+ Years)

    Lead AWS Data Engineer (12+ Years)

    TVS NextChennai, Tamil Nadu, India
    You will model and mine the data to describe the system behavior and to predict future actions.Build and deploy the infrastructure for ingesting high-volume support data from consumer interactions,...Show moreLast updated: 13 days ago
    • Promoted
    Azure Data Architect

    Azure Data Architect

    HCLTechChennai, Tamil Nadu, India
    Overview of Role / Role Purpose.As an Azure Data Architect you will be a key member of the Global GTS M&A team.This role will be proficient in investigating, decomposing, and combining data of diff...Show moreLast updated: 13 days ago
    • Promoted
    ▷ Immediate Start : Data Engineer

    ▷ Immediate Start : Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Dear Candidate, Greetings from TCS !!! TCS is hiring for GCP data engineer, please find the below JD.Experience range – 6 to 8 years Location - Bengaluru / Chennai / Gurgaon Skills Required - GCP B...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    ▷ Apply in 3 Minutes : Azure Senior Data Engineer

    ▷ Apply in 3 Minutes : Azure Senior Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    We await your innovation at TCS : Hiring |Azure Senior Data Engineers| Greetings from TCS!! Required Experience : 5-10 years Work location : Chennai Key Responsibilities - Data Pipeline Developme...Show moreLast updated: 3 hours ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    TVS NextChennai, Tamil Nadu, India
    You will be responsible for the development, integration and deployment of software products.Being part of a distributed agile team, you will be expected to code, conduct code reviews, and test sof...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    TCS presents an excellent Opportunity For "Azure Data Engineer" Role.Azure Databricks - Basic understanding of ADB.ADF - Basic understanding of pipeline and all the activities associated within pip...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    ▷ Only 24h Left! Azure Data Lead

    ▷ Only 24h Left! Azure Data Lead

    TVS NextChennai, Tamil Nadu, India
    What you’ll do : - Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL). Architect and implement Medallion Archi...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    ▷ Immediate Start : SAP Analytics Cloud Developer- SAC

    ▷ Immediate Start : SAP Analytics Cloud Developer- SAC

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Job Details : - Required Skills : SAP Analytics Cloud Total Experience : 7yrs to 12yrs Work Location : Chennai Only • Notice Period : 60 Days Only • • Mode of Interview : Virtual Must-Have : - Minimum ...Show moreLast updated: 3 hours ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iochennai, India
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 7 days ago