Sr.Azure Data EngineerPersistent Systems • Kanpur, IN

Sr.Azure Data Engineer

Persistent Systems • Kanpur, IN

15 hours ago

Job description

About Position :

We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.

Role : Sr. Azure Data Engineer
Location : Pune / Bangalore
Experience : 5 to 8 years
Job Type : Full Time Employment

What You'll Do :

Design and implement complex, scalable data pipelines for ingestion, processing, and transformation using Azure Databricks technologies.

Collaborate with Architects, Data Analysts, and Business Analysts to understand data requirements and develop efficient workflows.

Develop and manage data storage solutions including Azure SQL Database, Data Lake, and Blob Storage.

Leverage Azure Data Factory and other cloud-native tools to build and maintain ETL processes.

Conduct unit testing and ensure quality of data pipelines; mentor junior engineers and review their deliverables.

Monitor pipeline performance, troubleshoot issues, and provide regular status updates.

Optimise data workflows for performance and cost-efficiency; implement automation to reduce manual effort.

Expertise You'll Bring :

Around 5 to 8 years of experience in Databricks and Azure cloud Data migration

Experience on migrating and re-modeling large enterprise data from legacy warehouse to Lakehouse (Delta lake) on MS Fabric or Databricks.

Strong Data Engineering Skills : Proficiency in data extraction, transformation, and loading (ETL) processes, data modeling, and database management.

Also experience around setting up pipelines in Notebooks and ADF, setting up monitoring and alert notifications.

Experience with Data Lake Technologies : MS Fabric, Azure, Databricks, Python, Orchestration tool like Apache Airflow or Azure Data Factory, Azure Synapse along with stored procedures, Azure data lake storage.

Data Integration Knowledge : Familiarity with data integration techniques, including batch processing, streaming, and real-time data ingestion, auto-loader, change data capture, creation of fact and dimension tables.

Programming Skills : Proficiency in PySQL, SQL, Python, Pyspark for data manipulation and transformation.

Collaboration and Communication : Strong interpersonal skills to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.

Benefits :

Competitive salary and benefits package

Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications

Opportunity to work with cutting-edge technologies

Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards

Annual health check-ups

Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment :

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.

Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.

If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com / careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Create a job alert for this search

Data Engineer • Kanpur, IN

Related jobs

Senior Data Engineer

Relevance Lab • Kanpur, IN

Design, build and maintain enterprise data models and data assets on Microsoft Azure to support analytics, reporting, ML / AI and data products. Translate business requirements into robust logical and...Show more

Last updated: 16 hours ago • Promoted • New!

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European Careers • Kanpur, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more

Last updated: 15 hours ago • Promoted • New!

AWS Data Engineer

Atyeti Inc • Kanpur, IN

Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show more

Last updated: 15 hours ago • Promoted • New!

Senior Data Engineer

HealthyMe AI • Kanpur, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Donyati • Kanpur, IN

We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more

Last updated: 16 hours ago • Promoted • New!

Senior Data Engineer (AWS / GCP)

Armakuni • Kanpur, IN

We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show more

Last updated: 16 hours ago • Promoted • New!

Senior AWS Data Engineer

CYAN360 • Kanpur, IN

Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Recro • Kanpur, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Azure Data Engineer

SystemBender • Kanpur, IN

Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show more

Last updated: 8 days ago • Promoted

Sr. Data Engineers (Google Stack)- Remote

Mewar Infotech Limited • Kanpur, IN

Remote

BigQuery, Vertex AI, Pub / Sub, Cloud Functions.Implement transformations using .Collaborate with stakeholders for data modeling, operational support, and performance tuning.Strong hands-on experienc...Show more

Last updated: 8 days ago • Promoted

Data Engineer

Digitalzone • Kanpur, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 14 days ago • Promoted

Cloud Data Engineer

Blue Cloud Softech Solutions Limited • Kanpur, IN

Job Overview – Cloud Data Engineer.We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational effic...Show more

Last updated: 15 hours ago • Promoted • New!

Azure Data Engineer

Rainier Softech Solutions Pvt Ltd • Kanpur, IN

We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks.You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable comp...Show more

Last updated: 15 hours ago • Promoted • New!

Senior Azure Data Engineer

Programmers.io • Kanpur, IN

Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 8 Years - 12 years.We are...Show more

Last updated: 30+ days ago • Promoted

Azure Data Engineer

Tata Consultancy Services • Kanpur, IN

TCS is hiring for Azure Data Engineer.Designing and implementing data storage solutions on Azure.Azure data engineer is to design and implement data storage solutions on Azure.That includes selecti...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

Veraxion • Kanpur, IN

We are looking for a Senior Data Engineer who can design, build, and scale modern data platforms that power analytics, decision-making, and AI across the organization. If you love solving complex da...Show more

Last updated: 16 hours ago • Promoted • New!

Data Engineer Lead

JRD Systems • Kanpur, IN

The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more

Last updated: 15 hours ago • Promoted • New!

Senior Data Engineer

EXL • Kanpur, IN

Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO. Leverage technologies and solutions to innovate with increasingly larg...Show more

Last updated: 30+ days ago • Promoted