Sr.Azure Data EngineerPersistent Systems • Pune, India

Sr.Azure Data Engineer

Persistent Systems • Pune, India

5 days ago

Job description

About Position :

We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.

Role : Sr. Azure Data Engineer
Location : Pune / Bangalore
Experience : 5 to 8 years
Job Type : Full Time Employment

What You'll Do :

Design and implement complex, scalable data pipelines for ingestion, processing, and transformation using Azure Databricks technologies.

Collaborate with Architects, Data Analysts, and Business Analysts to understand data requirements and develop efficient workflows.

Develop and manage data storage solutions including Azure SQL Database, Data Lake, and Blob Storage.

Leverage Azure Data Factory and other cloud-native tools to build and maintain ETL processes.

Conduct unit testing and ensure quality of data pipelines; mentor junior engineers and review their deliverables.

Monitor pipeline performance, troubleshoot issues, and provide regular status updates.

Optimise data workflows for performance and cost-efficiency; implement automation to reduce manual effort.

Expertise You'll Bring :

Around 5 to 8 years of experience in Databricks and Azure cloud Data migration

Experience on migrating and re-modeling large enterprise data from legacy warehouse to Lakehouse (Delta lake) on MS Fabric or Databricks.

Strong Data Engineering Skills : Proficiency in data extraction, transformation, and loading (ETL) processes, data modeling, and database management.

Also experience around setting up pipelines in Notebooks and ADF, setting up monitoring and alert notifications.

Experience with Data Lake Technologies : MS Fabric, Azure, Databricks, Python, Orchestration tool like Apache Airflow or Azure Data Factory, Azure Synapse along with stored procedures, Azure data lake storage.

Data Integration Knowledge : Familiarity with data integration techniques, including batch processing, streaming, and real-time data ingestion, auto-loader, change data capture, creation of fact and dimension tables.

Programming Skills : Proficiency in PySQL, SQL, Python, Pyspark for data manipulation and transformation.

Collaboration and Communication : Strong interpersonal skills to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com / careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Create a job alert for this search

Data Engineer • Pune, India

Related jobs

Data Engineer

Recro • Pune, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

DataOrbit AI • Pune, IN

DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more

Last updated: 2 days ago • Promoted

Senior Data Engineer

EXL • pune, maharashtra, in

We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show more

Last updated: 30+ days ago • Promoted

Senior Azure Data Engineer - Fabric Platform

Lancesoft India Pvt Ltd • Pune

Description : Role Overview : You will be responsible for building modern, scalable, and high-performance data architectures on the Azure Cloud....Show more

Last updated: 30+ days ago • Promoted

Azure Data Engineer

Infarsight • Pune, Maharashtra, India

Infarsight helps enterprises scale strategic business transformation through automation,.We streamline operations with platforms like Task Sight, Trip. Sight, and Fleet Sight, turning complexity int...Show more

Last updated: 14 days ago • Promoted

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European Careers • Pune, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more

Last updated: 7 days ago • Promoted

Xebia - Senior Azure Data Engineer

Xebia IT Architects India Pvt Ltd • Pune

Description : - Data Engineer (Azure) - Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Mi...Show more

Last updated: 30+ days ago • Promoted

Sr.Azure Data Engineer

Persistent Systems • Pune, Maharashtra, India

We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team. Job Type : Full Time Employment.Design and implement complex, scalable ...Show more

Last updated: 6 days ago • Promoted

Data Engineer

MyData Insights Pvt Ltd • Pune, Maharashtra, India

Role : Data Engineer Experience : 6–12 years Location : Remote Engagement : Contract (4–6 Months) Work Type : Remote About the Role We are seeking an experienced Data Engineer to support data mo...Show more

Last updated: 4 days ago • Promoted

Data Engineer

System Soft Technologies • Pune, Maharashtra, India

Title : Data Engineer Location : Remote (3–4-hour time zone overlaps with EST if off shore) Duration : 6 months Musts : Python NextFlow Plus : Computer Vision Image Processing Project Overview : Exper...Show more

Last updated: 16 hours ago • Promoted • New!

Sr. Azure Data Engineer

Persistent Systems • Pune, Maharashtra, India

About Position : We're seeking an experienced Snowflake Data Engineer to join our team.As a Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale data wa...Show more

Last updated: 10 days ago • Promoted

Senior Azure Data Engineer - Full remote - contractor in USD

All European Careers • Pune, IN

Remote

Last updated: 5 days ago • Promoted

6221 Azure Data Engineer

EXL • Pune, Maharashtra, India

Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more

Last updated: 6 days ago • Promoted

Senior Snowflake Data Engineer

Luxoft • pune, maharashtra, in

We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more

Last updated: 22 hours ago • Promoted • New!

Senior Data Engineer

Persistent Systems • Pune (district)

We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong backgro...Show more

Last updated: 28 days ago • Promoted

Senior Data Engineer

Mindlance • Pune, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more

Last updated: 5 days ago • Promoted

Sr Data Engineer

Futran Solutions • Pune, Maharashtra, India

Job Title : Senior Data Engineer / Data Engineer Lead.We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms.The ideal candida...Show more

Last updated: 3 days ago • Promoted

AWS Data Engineer

Capgemini Invent • pune, maharashtra, in

At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more

Last updated: 5 days ago • Promoted