Sr.Azure Data EngineerPersistent Systems • Pune (division)

Sr.Azure Data Engineer

Persistent Systems • Pune (division)

7 days ago

Job description

About Position :

We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.

Role : Sr. Azure Data Engineer
Location : Pune / Bangalore
Experience : 5 to 8 years
Job Type : Full Time Employment

What You'll Do :

Design and implement complex, scalable data pipelines for ingestion, processing, and transformation using Azure Databricks technologies.

Collaborate with Architects, Data Analysts, and Business Analysts to understand data requirements and develop efficient workflows.

Develop and manage data storage solutions including Azure SQL Database, Data Lake, and Blob Storage.

Leverage Azure Data Factory and other cloud-native tools to build and maintain ETL processes.

Conduct unit testing and ensure quality of data pipelines; mentor junior engineers and review their deliverables.

Monitor pipeline performance, troubleshoot issues, and provide regular status updates.

Optimise data workflows for performance and cost-efficiency; implement automation to reduce manual effort.

Expertise You'll Bring :

Around 5 to 8 years of experience in Databricks and Azure cloud Data migration

Experience on migrating and re-modeling large enterprise data from legacy warehouse to Lakehouse (Delta lake) on MS Fabric or Databricks.

Strong Data Engineering Skills : Proficiency in data extraction, transformation, and loading (ETL) processes, data modeling, and database management.

Also experience around setting up pipelines in Notebooks and ADF, setting up monitoring and alert notifications.

Experience with Data Lake Technologies : MS Fabric, Azure, Databricks, Python, Orchestration tool like Apache Airflow or Azure Data Factory, Azure Synapse along with stored procedures, Azure data lake storage.

Data Integration Knowledge : Familiarity with data integration techniques, including batch processing, streaming, and real-time data ingestion, auto-loader, change data capture, creation of fact and dimension tables.

Programming Skills : Proficiency in PySQL, SQL, Python, Pyspark for data manipulation and transformation.

Collaboration and Communication : Strong interpersonal skills to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com / careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Create a job alert for this search

Data Engineer • Pune (division)

Related jobs

Data Solution Engineer I II and III

OpenGov Inc. • Pune (division)

OpenGov is the leader in AI and ERP solutions for local and state governments in the U.More than 2,000 cities, counties, state agencies, school districts, and special districts rely on the OpenGov ...Show more

Last updated: 20 days ago • Promoted

Lead Data Engineer

Persistent Systems • Pune (division)

We’re looking for a Lead Technical Engineer who can bridge data engineering depth with FinOps insight.You’ll design and implement scalable data solutions across Databricks and Snowflake, drive perf...Show more

Last updated: 9 days ago • Promoted

AWS Data Platform Engineer

Persistent Systems • Pune (division)

We’re looking for an AWS Data Platform Engineer to help automate and scale our cloud-based analytics environment.You’ll work with our BI and Data Engineering teams to build secure, automated, and r...Show more

Last updated: 14 days ago • Promoted

Azure Data Engineer / Data Visualization Lead (Tableau)

PROADSW3 Relations pvt. ltd. • Pune (division)

Azure Data Engineer / Data Visualization Lead (Tableau) – AM / DM | 5–8 Years | Budget : 1.Mandate : Databricks Experience. We are seeking a highly skilled Azure Data Engineer – Data Visualization Lead ...Show more

Last updated: 1 day ago • Promoted

Data Engineer

Persistent Systems • Pune (division)

We are looking for a Data Engineer with Python AWS experience.Job Type : Full Time Employment.Understand the domain for which the entities are being created. Understand the entity creation process fr...Show more

Last updated: 29 days ago • Promoted

Senior Data Engineer- AWS

InfoCepts • Pune (division)

Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show more

Last updated: 20 days ago • Promoted

Senior Data Engineer

eClerx • Pune (division)

We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep exp...Show more

Last updated: 13 days ago • Promoted

Senior Data Engineer

EXL • Pune (division)

Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more

Last updated: 7 days ago • Promoted

Lead Data Engineer

Searce Inc • Pune (division)

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show more

Last updated: 7 days ago • Promoted

Data Engineer-SAC

Orbia Pune • Pune (division)

If you have strong background in.Note : This is a full time role, 5 Days on-site role based at Orbia Global Capability Center in Pune. A minimum of 6 years' experience in data warehousing, data model...Show more

Last updated: 6 days ago • Promoted

Data Engineer

Trinity Technology Solutions LLC • Pune (division)

Location : Pune preferred / remote.Programming Python, PySpark / Spark.Operating Systems Linux (RedHat).Databases Hive, MSSQL, MySQL, PostgreSQL. Big Data Hadoop ecosystem (HDFS, YARN, Sqoop).Version Co...Show more

Last updated: 7 days ago • Promoted

Senior Data Engineer

SPIRO • Pune (division)

We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies. The ideal candidate will have over five years of hands-on experience designi...Show more

Last updated: 6 days ago • Promoted

Data Engineer AWS ( Full-time at a Fortune 500 tech MNC )

HARP • Pune (division)

Kubernetes (Moderate level knowledge).Technical Skills – Nice to Have.Technical Skills – Ok to Train Later.Monitor the health status of applications using Datadog or similar monitoring tools.Check ...Show more

Last updated: 13 days ago • Promoted

Data Engineer

Synechron • Pune (division)

We have immediate opportunity for.Notice Period : Immediate to 30 Days.At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines cre...Show more

Last updated: 20 days ago • Promoted

AWS Data Engineer

Capgemini Invent • Pune (division)

At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more

Last updated: 6 days ago • Promoted

Senior Data Engineer

Persistent Systems • Pune (division)

We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong backgro...Show more

Last updated: 29 days ago • Promoted

6221 Azure Data Engineer

EXL • Pune (division)

Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more

Last updated: 6 days ago • Promoted

5676 - Data Engineer

EXL • Pune (division)

Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show more

Last updated: 20 days ago • Promoted