Talent.com
This job offer is not available in your country.
Azure Data Engineering Lead

Azure Data Engineering Lead

Trigent Software Private LimitedHyderabad, TS, India
1 day ago
Job type
  • Quick Apply
Job description

Job Title : Azure Data Engineering Lead

Experience : 5+ years

Location : Hyderabad (Hybrid WFO)

Notice Period : Immediate

Role Overview :

We are looking for a highly skilled Azure Data Engineering Lead to design, develop, and optimize scalable data solutions using Azure Databricks and Azure Data Factory (ADF). This role involves collaborating with cross-functional teams to deliver robust data pipelines, enable advanced analytics, and support enterprise data initiatives.

Key Responsibilities :

Data Pipeline Development :

Build and maintain scalable ETL / ELT pipelines using ADF and Databricks notebooks.

Integrate data from diverse sources including Azure Data Lake, SQL DBs, Blob Storage, and external APIs.

Advanced Data Engineering :

Develop distributed data processing workflows using PySpark, Scala, and Delta Lake in Databricks.

Implement data quality checks, error handling, and logging mechanisms.

Automation & DevOps :

Automate deployments using CI / CD pipelines with Azure DevOps and Terraform.

Manage version control and collaborative development using Git.

Performance Optimization :

Monitor and tune pipeline performance for cost-efficiency and scalability.

Troubleshoot and resolve data pipeline failures and bottlenecks.

Collaboration & Documentation :

Work with data scientists, analysts, and business stakeholders to understand data needs.

Document architecture, workflows, and best practices for internal knowledge sharing.

Mandatory Skills : Azure

Azure Databricks

PySpark

Good-to-Have Skills :

Delta Lake

Azure Data Factory / Mapping Data Flows

SQL & Python

Terraform

CI / CD, Git, Agile methodologies

Azure certifications (DP-203, AZ-104)

Create a job alert for this search

Data Engineering Lead • Hyderabad, TS, India

Related jobs
  • Promoted
Azure Data Engineer

Azure Data Engineer

Tata Consultancy ServicesHyderabad, Telangana, India
Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
  • Promoted
  • New!
Lead Data / AI Engineering

Lead Data / AI Engineering

AT&Thyderabad, India
The Chief Data Office (CDO) at AT&T is responsible for leveraging data as a strategic asset to drive business value.The team focuses on data governance, data engineering, artificial intelligence, a...Show moreLast updated: 1 hour ago
  • Promoted
Data Engineer Team Lead

Data Engineer Team Lead

SGIhyderabad, telangana, in
To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 6 days ago
  • Promoted
  • New!
Data Engineering Lead

Data Engineering Lead

Kanerika Software Pvt Ltdhyderabad, India
Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge technologies in...Show moreLast updated: 1 hour ago
  • Promoted
  • New!
Lead Engineer - Enterprise Data Operations

Lead Engineer - Enterprise Data Operations

PepsiCohyderabad, India
As an Analyst, Data Modeling, your focus would be to partner with D&A Data Foundation team members to create data models for Global projects. This would include independently analyzing project data ...Show moreLast updated: 1 hour ago
  • Promoted
Senior Manager - Data Engineering Lead

Senior Manager - Data Engineering Lead

DIAGEO Indiahyderabad, telangana, in
Senior Manager - Data Engineering Lead.Bachelor’s or master’s degree in computer science, Data Engineering, or related field. Experience in data engineering.Proven experience in cloud platforms (AWS...Show moreLast updated: 27 days ago
  • Promoted
Data Analytics Lead

Data Analytics Lead

Talentmaticshyderabad, telangana, in
We are seeking an experienced Data Analytics Lead with strong expertise in NetSuite.Analytics Warehouse (NSAW), Fusion Data Intelligence (FDI), and Oracle Analytics. The candidate will be responsibl...Show moreLast updated: 5 days ago
  • Promoted
Data Engineering Azure databricks

Data Engineering Azure databricks

EXLHyderabad, IN
Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders. Work with stakeholders to unders...Show moreLast updated: 1 day ago
  • Promoted
  • New!
Azure Data Engineers - Site Reliability Engineering

Azure Data Engineers - Site Reliability Engineering

GSPANNhyderabad, India
Description GSPANN is hiring Azure Data Engineers with expertise in Site Reliability Engineering (SRE) to optimize and automate large-scale data applications. The role involves ensuring system relia...Show moreLast updated: 1 hour ago
  • Promoted
  • New!
Tech Lead - AWS Data Engineer Job

Tech Lead - AWS Data Engineer Job

YASH Technologieshyderabad, India
Understanding the current business functionalities of the ETL processes and identifying areas for improvement.Designing and building AWS Glue workflows to replace existing ETL processes.Standardizi...Show moreLast updated: 1 hour ago
  • Promoted
  • New!
Tech Lead - Databricks Job

Tech Lead - Databricks Job

YASH Technologieshyderabad, India
Platform Design & Architecture.Lead the design and deployment of large-scale data solutions on Databricks.Establish best practices for notebook development, job orchestration, and cluster managemen...Show moreLast updated: 1 hour ago
  • Promoted
  • New!
Principal Consultant, Azure Data Engineer

Principal Consultant, Azure Data Engineer

Genpacthyderabad, India
Ready to shape the future of work?.At Genpact, we don’t just adapt to change—we drive it.AI and digital innovation are redefining industries, and we’re leading the charge.Genpact’s AI Gigafactory, ...Show moreLast updated: 1 hour ago
  • Promoted
  • New!
Azure Data Engineer

Azure Data Engineer

Anicalls (Pty) Ltdhyderabad, India
Background in processing and managing large data sets.Strong knowledge of Structured Query Language (SQL).Experience building data pipelines using Azure Databricks and Azure Data Factory.Knowledge ...Show moreLast updated: 1 hour ago
  • Promoted
  • New!
Azure Data Technical Delivery Lead...

Azure Data Technical Delivery Lead...

Anicalls (Pty) Ltdhyderabad, India
Azure DataFactory (ADF) • In - depth SQL.PowerBI • Ability to handle his pressure environments.Show moreLast updated: 1 hour ago
  • Promoted
Lead Azure Data Engineer

Lead Azure Data Engineer

RandomTreesHyderabad, IN
We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 27 days ago
  • Promoted
  • New!
Azure Data Engineering Lead

Azure Data Engineering Lead

Trigent Software Private Limitedhyderabad, India
We are looking for a highly skilled Azure Data Engineering Lead to design, develop, and optimize scalable data solutions using Azure Databricks and Azure Data Factory (ADF).This role involves colla...Show moreLast updated: 1 hour ago
  • Promoted
Lead Data Engineer

Lead Data Engineer

Eucloid Data SolutionsHyderabad, IN
Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 8 days ago
  • Promoted
  • New!
Lead Engineer

Lead Engineer

NTT DATAhyderabad, India
Support Engineer (Data Practice) – Snowflake, Airflow, IICS.We are looking for a Support Engineer in Data Practice with expertise in Snowflake, Apache Airflow, and Informatica IICS (Intelligent Clo...Show moreLast updated: 1 hour ago
  • Promoted
  • New!
Advanced Engineer I, Data & Analytics

Advanced Engineer I, Data & Analytics

OppenheimerFunds Distributor, Inchyderabad, India
Key Responsibilities / Duties : .Design, develop and maintain Invesco’s data platform infrastructure.Administration of various cloud data platforms on Amazon Web Services (AWS), Airflow (MWAA), Snowf...Show moreLast updated: 1 hour ago
  • Promoted
Senior Azure Data Engineer

Senior Azure Data Engineer

Programmers.iosecunderabad, telangana, in
Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago