Azure Data Lead EngineerPersistent Systems • Gandhinagar, IN

Azure Data Lead Engineer

Persistent Systems • Gandhinagar, IN

17 hours ago

Job description

About Position :

We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.

Role : Azure Data Lead Engineer
Location : Pune / Bangalore
Experience : 8 to 10 years
Job Type : Full Time Employment

What You'll Do :

Design and implement complex, scalable data pipelines for ingestion, processing, and transformation using Azure Databricks technologies.

Collaborate with Architects, Data Analysts, and Business Analysts to understand data requirements and develop efficient workflows.

Develop and manage data storage solutions including Azure SQL Database, Data Lake, and Blob Storage.

Leverage Azure Data Factory and other cloud-native tools to build and maintain ETL processes.

Conduct unit testing and ensure quality of data pipelines; mentor junior engineers and review their deliverables.

Monitor pipeline performance, troubleshoot issues, and provide regular status updates.

Optimise data workflows for performance and cost-efficiency; implement automation to reduce manual effort.

Expertise You'll Bring :

Around 8+ years of experience in Databricks and Azure cloud Data migration

Experience on migrating and re-modeling large enterprise data from legacy warehouse to Lakehouse (Delta Lake) on MS Fabric or Databricks.

Strong Data Engineering Skills : Proficiency in data extraction, transformation, and loading (ETL) processes, data modeling, and database management.

Also experience around setting up pipelines in Notebooks and ADF, setting up monitoring and alert notifications.

Experience with Data Lake Technologies : MS Fabric, Azure, Databricks, Python, Orchestration tool like Apache Airflow or Azure Data Factory, Azure Synapse along with stored procedures, Azure data lake storage.

Data Integration Knowledge : Familiarity with data integration techniques, including batch processing, streaming, and real-time data ingestion, auto-loader, change data capture, creation of fact and dimension tables.

Programming Skills : Proficiency in PySQL, SQL, Python, Pyspark for data manipulation and transformation.

Collaboration and Communication : Strong interpersonal skills to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com / careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Create a job alert for this search

Azure Data Engineer • Gandhinagar, IN

Related jobs

Senior Azure Data Engineer

Programmers.io • Gandhinagar, IN

Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 8 Years - 12 years.We are...Show more

Last updated: 30+ days ago • Promoted

Azure Data Engineer

Tata Consultancy Services • Gandhinagar, IN

TCS is hiring for Azure Data Engineer.Designing and implementing data storage solutions on Azure.Azure data engineer is to design and implement data storage solutions on Azure.That includes selecti...Show more

Last updated: 30+ days ago • Promoted

AWS Data Engineer

Atyeti Inc • Ahmedabad, IN

Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show more

Last updated: 17 hours ago • Promoted • New!

Lead Data Engineer

INDI Staffing Services • Ahmedabad, IN

At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more

Last updated: 14 days ago • Promoted

Senior Data Engineer

Veraxion • Ahmedabad, IN

We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex da...Show more

Last updated: 17 hours ago • Promoted • New!

Lead Data Engineer

Cimpress • ahmedabad, gujarat, in

Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show more

Last updated: 14 days ago • Promoted

Azure Data Lead Engineer

Persistent Systems • Ahmedabad, IN

We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Role : Azure Data Lead Engineer.Job Type : Full Time Employment.Design...Show more

Last updated: 17 hours ago • Promoted • New!

Lead Data Engineer

Searce Inc • Gandhinagar, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more

Last updated: 30+ days ago • Promoted

Azure Data Engineer

Wall Street Consulting Services LLC • Gandhinagar, IN

Mode of work : Work from Office.Candidates with 7+ years experience only apply.We are seeking an experienced Data Engineer with strong expertise in P&C Insurance data systems or any Insurance backgr...Show more

Last updated: 6 days ago • Promoted

GenAI Lead Engineer (Investment Data Platforms)

Vichara Technologies • Gandhinagar, IN

We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show more

Last updated: 17 hours ago • Promoted • New!

Azure Databricks

Kumaran Systems • Ahmedabad, IN

We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more

Last updated: 17 hours ago • Promoted • New!

Azure Data Engineer

SystemBender • Ahmedabad, IN

Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show more

Last updated: 8 days ago • Promoted

Data Engineer

Recro • Gandhinagar, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Azure Data Engineer

Rainier Softech Solutions Pvt Ltd • Ahmedabad, IN

We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks.You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable comp...Show more

Last updated: 17 hours ago • Promoted • New!

Lead Data Engineer

Advantmed • Ahmedabad, Gujarat, India

Lead Data Engineer – Azure Cloud.We are looking for an experienced.The ideal candidate will design, develop, and maintain scalable data pipelines, ensure data quality, and leverage cloud technologi...Show more

Last updated: 7 days ago • Promoted

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European Careers • Ahmedabad, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more

Last updated: 17 hours ago • Promoted • New!

Data Engineer Lead

JRD Systems • Ahmedabad, IN

The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more

Last updated: 17 hours ago • Promoted • New!

Azure Data Services Engineer - MS Fabric - Contract

Gravity Infosolutions, Inc. • Gandhinagar, IN

Position : Azure Data Engineer – Microsoft Fabric.We are looking for an experienced.The ideal candidate will design, build, and optimize scalable data solutions, enabling advanced analytics and busi...Show more

Last updated: 14 days ago • Promoted