Azure Data Engineering Lead
TVS NextChennai, Republic Of India, IN13 days ago
Job descriptionManage and mentor a team of data engineers; Direct the management of data storage solutions using Azure Data Lake Storage (ADLS), ensuring robust access policies. Establish and maintain Delta Lake tables for reliable, scalable ACID transactions and incremental processing across projects. Optimize Spark jobs and Databricks clusters for performance, scalability, and cost efficiency at enterprise scale. Lead ingestion and transformation strategies from diverse sources (APIs, files, databases, cloud platforms). Partner with stakeholders and cross-functional teams to deliver well-governed, reusable data models and analytics solutions. Drive implementation of data quality frameworks, error handling mechanisms, and robust monitoring practices. Enforce data security, governance, and compliance requirements across all Azure and cloud data assets. Utilize Azure Synapse Analytics, Key Vault, and Azure Monitor to build resilient, secure, and observable data platforms. Own CI / CD and deployment best practices using Git and Azure DevOps; Stay ahead of industry trends in big data, ETL, and lakehouse technologies; Collaborate with data science and AI teams to support machine learning (ML), generative AI, and large language model (LLM) initiatives using enterprise data. Guide data consultation efforts for enterprise digital transformation, advising stakeholders on data architecture modernization and strategic priorities. Develop and articulate an “AI-ready” data roadmap, enabling the business to leverage advanced analytics, ML, and LLM solutions. Ensure data pipelines and platforms are optimized for ML and AI workloads, including integration and preparation of datasets for model training and inference. Bachelor’s or Master’s in Computer Science, Engineering, or related field. 8+ years of experience in data engineering, with 2+ years in a technical lead or supervisory role. Advanced expertise in Databricks, PySpark, SQL, Azure cloud data engineering, and related tools. Proven track record architecting and leading end-to-end pipeline solutions leveraging Medallion architecture, Unity Catalog, and Delta Lake. Experience mentoring and scaling data engineering teams; Deep understanding of big data principles, data lakehouse architectures, and cloud ETL orchestration. Hands-on with Azure Data Lake Storage (ADLS), Data Factory (ADF), Synapse Analytics, Key Vault, Sql Server and Azure Monitor. Skilled in CI / CD pipelines, automation with Git and Azure DevOps, and code quality enforcement. Strong analytical mindset with a strategic approach to problem-solving and stakeholder management. Certifications in Azure / Data Engineering (Databricks, Azure) are highly desired. Proven ability to consult on data strategy and architecture for large-scale digital transformation initiatives. Strong knowledge of data preparation, feature engineering, and optimization for ML and AI workloads. Experience collaborating cross-functionally with data science, analytics, and business teams on ML / AI use cases. Clear objectives to ensure alignment with our mission, fostering your meaningful contribution. Abundant opportunities for engagement with customers, product managers, and leadership. You'll be guided by progressive paths while receiving insightful guidance from managers through ongoing feedforward sessions. Cultivate and leverage robust connections within diverse communities of interest. Choose your mentor to navigate your current endeavors and steer your future trajectory. Embrace continuous learning and upskilling opportunities through Nexversity. Enjoy the flexibility to explore various functions, develop new skills, and adapt to emerging technologies. Embrace a hybrid work model promoting work-life balance. Access comprehensive family health insurance coverage, prioritizing the well-being of your loved ones. Embark on accelerated career paths to actualize your professional aspirations.
What you’ll do :
- Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL).
- Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) to drive optimal data transformation and organization.
- Oversee data governance, access control, and lineage using Databricks Unity Catalog;
champion best practicesfor metadata management.
provide technical guidance and career development opportunities.
establish automation standards and code review processes.
proactively recommend improvements.
What we seek in you :
excellent leadership and communication skills.
Life at Next :
At our core, we're driven by the mission of tailoring growth for our customers by enabling them to transform their aspirations into tangible outcomes. We're dedicated to empowering them to shape their futures and achieve ambitious goals. To fulfil this commitment, we foster a culture defined by agility, innovation, and an unwavering commitment to progress. Our organizational framework is both streamlined and vibrant, characterized by a hands-on leadership style that prioritizes results and fosters growth.
Perks of working with us :
Who we are?
We enable high growth enterprises build hyper personalized solutions to transform their vision into reality. With a keen eye for detail, we apply creativity, embrace new technology and harness the power of data and AI to co-create solutions tailored made to meet unique needs for our customers.
Join our passionate team and tailor your growth with us!
Create a job alert for this search
Data Engineering Lead • Chennai, Republic Of India, IN
Related jobs
The ideal candidate will have a strong foundation in.Job Title : Azure Data Engineer.Work Timings : 5 : 00 PM to 2 : 00 AM IST.
If your expertise is primarily in.Lead the migration of large-scale SQL work...Show moreLast updated: 30+ days ago
For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer.
The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 5 days ago
- Promoted
Lead AI Engineer
BlendNagpur, IN We are looking for an AI Engineer with hands-on experience designing and deploying scalable AI solutions.In this role, you will be part of a cross-functional team working on cutting-edge projects i...Show moreLast updated: 1 day ago
- Promoted
Azure Data Services Engineer - MS Fabric - Contract
Gravity Infosolutions, Inc.Nagpur, IN Position : Azure Data Engineer – Microsoft Fabric.We are looking for an experienced.The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and busi...Show moreLast updated: 5 days ago
- Promoted
Senior Data Engineer
IntelliasNagpur, IN Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines.
Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 5 days ago
- Promoted
Founding Data Engineer
InSiteVerseNagpur, IN We are building a next-generation .Generative AI and advanced ML models.Founding Data Pipeline Engineer.You will work closely with the .
You will also architect and optimize .Azure OLAP services suc...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Guidanz IncNagpur, IN BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 5 days ago
- Promoted
Azure Data Engineer - Remote work
techolutionNagpur, INRemote
- Promoted
Data Engineer
DigitalzoneNagpur, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 5 days ago
- Promoted
Azure Data Lead / Architect
TEKsystems Global Services in IndiaNagpur, IN Notice Period : Immediate to15 Days.Please find the below Azure Data Lead / Architect JD.Azure AI skills, Azure Open AI, AI Foundry.
Excellent communication and interpersonal skills, with the ability t...Show moreLast updated: 5 days ago
- Promoted
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD
All European CareersNagpur, INRemote
- Promoted
Senior Data Engineer with AWS_ Exp : 6+ Years
Atyeti IncNagpur, IN Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 4 days ago
- Promoted
Azure Data Services Engineer – Microsoft Fabric
Gravity Infosolutions, Inc.Nagpur, IN Position : Azure Data Engineer – Microsoft Fabric.We are looking for an experienced.The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and busi...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
RecroNagpur, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
Senior Azure Data Engineer
Programmers.ionagpur, maharashtra, in Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics.
Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
TerraGiGNagpur, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 16 days ago
- Promoted
Data Engineer – Azure & AWS
Yoda TechNagpur, IN We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms.
The ideal candidate will have 2 to 4 years of hands...Show moreLast updated: 14 days ago
- Promoted
Azure Data Engineer
LTIMindtreenagpur, maharashtra, in Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show moreLast updated: 30+ days ago
- Promoted
Engineering Manager - Data Platform
CoinbaseNagpur, IN Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world.
It’s a massive, ambitious opportunity that demands the best of us, ...Show moreLast updated: 19 days ago
- Promoted
Project Manager – Data Engineering & Analytics
BrillioNagpur, IN We are looking for a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics.You will manage cross-functional teams to execute data platform, pipeline, and ...Show moreLast updated: 30+ days ago