Talent.com
No longer accepting applications
Immediate Start : Azure Data Lead

Immediate Start : Azure Data Lead

TVS NextIndia
19 hours ago
Job description

What you’ll do :

  • Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL).
  • Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) to drive optimal data transformation and organization.
  • Oversee data governance, access control, and lineage using Databricks Unity Catalog; champion best practices for metadata management.
  • Manage and mentor a team of data engineers; provide technical guidance and career development opportunities.
  • Direct the management of data storage solutions using Azure Data Lake Storage (ADLS), ensuring robust access policies.
  • Establish and maintain Delta Lake tables for reliable, scalable ACID transactions and incremental processing across projects.
  • Optimize Spark jobs and Databricks clusters for performance, scalability, and cost efficiency at enterprise scale.
  • Lead ingestion and transformation strategies from diverse sources (APIs, files, databases, cloud platforms).
  • Partner with stakeholders and cross-functional teams to deliver well-governed, reusable data models and analytics solutions.
  • Drive implementation of data quality frameworks, error handling mechanisms, and robust monitoring practices.
  • Enforce data security, governance, and compliance requirements across all Azure and cloud data assets.
  • Utilize Azure Synapse Analytics, Key Vault, and Azure Monitor to build resilient, secure, and observable data platforms.
  • Own CI / CD and deployment best practices using Git and Azure DevOps; establish automation standards and code review processes.
  • Stay ahead of industry trends in big data, ETL, and lakehouse technologies; proactively recommend improvements.
  • Collaborate with data science and AI teams to support machine learning (ML), generative AI, and large language model (LLM) initiatives using enterprise data.
  • Guide data consultation efforts for enterprise digital transformation, advising stakeholders on data architecture modernization and strategic priorities.
  • Develop and articulate an “AI-ready” data roadmap, enabling the business to leverage advanced analytics, ML, and LLM solutions.
  • Ensure data pipelines and platforms are optimized for ML and AI workloads, including integration and preparation of datasets for model training and inference.

What we seek in you :

  • Bachelor’s or Master’s in Computer Science, Engineering, or related field.
  • 8+ years of experience in data engineering, with 2+ years in a technical lead or supervisory role.
  • Advanced expertise in Databricks, PySpark, SQL, Azure cloud data engineering, and related tools.
  • Proven track record architecting and leading end-to-end pipeline solutions leveraging Medallion architecture, Unity Catalog, and Delta Lake.
  • Experience mentoring and scaling data engineering teams; excellent leadership and communication skills.
  • Deep understanding of big data principles, data lakehouse architectures, and cloud ETL orchestration.
  • Hands-on with Azure Data Lake Storage (ADLS), Data Factory (ADF), Synapse Analytics, Key Vault, Sql Server and Azure Monitor.
  • Skilled in CI / CD pipelines, automation with Git and Azure DevOps, and code quality enforcement.
  • Strong analytical mindset with a strategic approach to problem-solving and stakeholder management.
  • Certifications in Azure / Data Engineering (Databricks, Azure) are highly desired.
  • Proven ability to consult on data strategy and architecture for large-scale digital transformation initiatives.
  • Strong knowledge of data preparation, feature engineering, and optimization for ML and AI workloads.
  • Experience collaborating cross-functionally with data science, analytics, and business teams on ML / AI use cases.
  • Life at Next :

    At our core, we're driven by the mission of tailoring growth for our customers by enabling them to transform their aspirations into tangible outcomes. We're dedicated to empowering them to shape their futures and achieve ambitious goals. To fulfil this commitment, we foster a culture defined by agility, innovation, and an unwavering commitment to progress. Our organizational framework is both streamlined and vibrant, characterized by a hands-on leadership style that prioritizes results and fosters growth.

    Perks of working with us :

  • Clear objectives to ensure alignment with our mission, fostering your meaningful contribution.
  • Abundant opportunities for engagement with customers, product managers, and leadership.
  • You'll be guided by progressive paths while receiving insightful guidance from managers through ongoing feedforward sessions.
  • Cultivate and leverage robust connections within diverse communities of interest. Choose your mentor to navigate your current endeavors and steer your future trajectory.
  • Embrace continuous learning and upskilling opportunities through Nexversity.
  • Enjoy the flexibility to explore various functions, develop new skills, and adapt to emerging technologies. Embrace a hybrid work model promoting work-life balance. Access comprehensive family health insurance coverage, prioritizing the well-being of your loved ones.
  • Embark on accelerated career paths to actualize your professional aspirations.
  • Who we are?

    We enable high growth enterprises build hyper personalized solutions to transform their vision into reality. With a keen eye for detail, we apply creativity, embrace new technology and harness the power of data and AI to co-create solutions tailored made to meet unique needs for our customers.

    Join our passionate team and tailor your growth with us!

    Create a job alert for this search

    Immediate Start Lead • India

    Related jobs
    • Promoted
    AI / ML & Data Engineer

    AI / ML & Data Engineer

    Mindfire SolutionsNagpur, IN
    We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 5 days ago
    • Promoted
    STIBO STEP Cloud Consultant

    STIBO STEP Cloud Consultant

    Mastech DigitalNagpur, IN
    LPA (Depending on level of expertise).Only Immediate Joiners / Currently Serving Notice / Notice is less than 30 day.MDM projects covering implementation and production support, including PIM and MDM...Show moreLast updated: 5 days ago
    • Promoted
    Principal Azure Cloud Architect / Principal Engineer

    Principal Azure Cloud Architect / Principal Engineer

    First American (India)Nagpur, IN
    Job Title : Principal Azure Cloud Architect / Principal Engineer (20+ Years Experience).We are seeking a technical visionary Principal Azure Cloud Architect with 20+ years of experience to lead the tr...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Architect

    GCP Data Architect

    Tata Consultancy Servicesnagpur, maharashtra, in
    Design and Implement Data Architectures : Architect and build scalable, end-to-end data solutions on GCP, encompassing data ingestion, transformation, storage, and consumption.Develop Data Pipelines...Show moreLast updated: 14 days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Nagpur, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Nityo InfotechNagpur, IN
    Profile name- Senior Data Infrastructure Engineer - Apache Spark & Kubernetes.Minimum 5 years of experience in Data Engineering or Infrastructure roles. Proven hands-on experience with Apache Spark ...Show moreLast updated: 3 days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsNagpur, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Scientist

    Data Scientist

    Live ConnectionsNagpur, IN
    Required Notice Period - Immediate to 30 dats only.Machine Learning, Deep Learning, and Data Science.Strong programming skills in Python with frameworks like TensorFlow, PyTorch, Scikit-learn, Lang...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer with Snowflake Experience- Contract

    Data Engineer with Snowflake Experience- Contract

    Gravity Infosolutions, Inc.Nagpur, IN
    Data Engineer with Snowflake & Data Vault 2.The project involves setting up a new software tool to meet audit requirements and is therefore critical. Most data to be migrated is already in Snowflake...Show moreLast updated: 3 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGNagpur, IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 3 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncNagpur, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 24 days ago
    • Promoted
    Python Data Engineer

    Python Data Engineer

    iVoyantNagpur, IN
    One of our clients is looking for an experienced Python Data Engineer to join their team.Strong Python Experience (web services, background jobs. we use Fast API).Data processing and reporting usin...Show moreLast updated: 3 days ago
    • Promoted
    Lead Python Developer _ Exp : 6+ Years

    Lead Python Developer _ Exp : 6+ Years

    Atyeti Incnagpur, maharashtra, in
    Design, develop, and maintain applications in Python.Strong hands-on experience in Python.Strong experience on Flask / Django framework. Solid understanding of OOP, REST APIs, and microservices archi...Show moreLast updated: 1 day ago
    • Promoted
    Python AWS Data Engineer

    Python AWS Data Engineer

    Digitrix Software LLPNagpur, IN
    Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Data Delivery & Modernization Lead

    Cloud Data Delivery & Modernization Lead

    Pacific Data IntegratorsNagpur, IN
    Core Technical & Domain Skills.Extensive hands-on experience with cloud modernization of ETL pipelines.Strong data debugging skills and deep understanding of enterprise analytics stack.Proven track...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionNagpur, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Senior Data Engineer – Snowflake & Python (Remote, India or EU)

    Az-Tec TalentNagpur, IN
    Remote
    Senior Data Engineer – Snowflake & Python (Remote, India or EU).ASAP (ideally next week following interview).SQL Server to Snowflake migration project. This is a high-impact role requiring strong ha...Show moreLast updated: 22 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicesnagpur, maharashtra, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 1 day ago