Azure Data Lead EngineerPersistent Systems • bhopal, madhya pradesh, in
No longer accepting applications
Azure Data Lead Engineer
Persistent Systems • bhopal, madhya pradesh, in
5 days ago
Job descriptionDesign and implement complex, scalable data pipelines for ingestion, processing, and transformation using Azure Databricks technologies. Collaborate with Architects, Data Analysts, and Business Analysts to understand data requirements and develop efficient workflows. Develop and manage data storage solutions including Azure SQL Database, Data Lake, and Blob Storage. Leverage Azure Data Factory and other cloud-native tools to build and maintain ETL processes. Conduct unit testing and ensure quality of data pipelines; mentor junior engineers and review their deliverables. Monitor pipeline performance, troubleshoot issues, and provide regular status updates. Optimise data workflows for performance and cost-efficiency; implement automation to reduce manual effort. Around 8+ years of experience in Databricks and Azure cloud Data migration Experience on migrating and re-modeling large enterprise data from legacy warehouse to Lakehouse (Delta Lake) on MS Fabric or Databricks. Strong Data Engineering Skills : Proficiency in data extraction, transformation, and loading (ETL) processes, data modeling, and database management. Also experience around setting up pipelines in Notebooks and ADF, setting up monitoring and alert notifications. Experience with Data Lake Technologies : MS Fabric, Azure, Databricks, Python, Orchestration tool like Apache Airflow or Azure Data Factory, Azure Synapse along with stored procedures, Azure data lake storage. Data Integration Knowledge : Familiarity with data integration techniques, including batch processing, streaming, and real-time data ingestion, auto-loader, change data capture, creation of fact and dimension tables. Programming Skills : Proficiency in PySQL, SQL, Python, Pyspark for data manipulation and transformation. Collaboration and Communication : Strong interpersonal skills to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders. Competitive salary and benefits package Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents We support hybrid work and flexible hours to fit diverse lifestyles. Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
About Position :
We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.
- Role : Azure Data Lead Engineer
- Location : Pune / Bangalore
- Experience : 8 to 10 years
- Job Type : Full Time Employment
What You'll Do :
Expertise You'll Bring :
Benefits :
Values-Driven, People-Centric & Inclusive Work Environment :
Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
Let’s unleash your full potential at Persistent - persistent.com / careers
“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”
Create a job alert for this search
Azure Data Engineer • bhopal, madhya pradesh, in
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
Customer Engineer (Data Engineer)
Konecta • bhopal, madhya pradesh, in
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 19 hours ago • Promoted • New!
Data Engineer
Digitalzone • bhopal, madhya pradesh, in
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 20 days ago • Promoted
Sr. Azure Data Architect & Presales Solution
Programmers.io • bhopal, madhya pradesh, in
Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show more
Last updated: 12 days ago • Promoted
Sr. Data Engineer
HNR Tech • bhopal, madhya pradesh, in
We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem.The ideal candidate will have deep expertise in data architecture, pipeline orchestration...Show more
Last updated: 12 days ago • Promoted
Azure Data Engineer
Tata Consultancy Services • bhopal, madhya pradesh, in
TCS is Hiring for Azure Data Engineer.Primary : Azure Data Factory (ADF), Azure Databricks (ADB).Secondary : SSIS (SQL Server Integration Services).
Strong expertise in Azure Data Engineering & ETL Co...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
Xsell Resources • bhopal, madhya pradesh, in
Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show more
Last updated: 18 days ago • Promoted
Databricks Engineer
TTC Group • bhopal, madhya pradesh, in
We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
K&K Talents • bhopal, madhya pradesh, in
This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai.
Tableau | ETL / ELT | SQL | Python | Snow...Show more
Last updated: 19 hours ago • Promoted • New!
Snowflake Data Engineer
Live Connections • bhopal, madhya pradesh, in
Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
Last updated: 9 days ago • Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions Limited • bhopal, madhya pradesh, in
BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
Last updated: 5 days ago • Promoted
Data Engineer
MyData Insights Pvt Ltd • bhopal, madhya pradesh, in
The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
Last updated: 3 days ago • Promoted
Senior Python Data Engineer
iVoyant • bhopal, madhya pradesh, in
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
Last updated: 6 days ago • Promoted
Senior Azure Data Engineer
Tata Consultancy Services • bhopal, madhya pradesh, in
Job Title : Senior Data Engineer (Azure / SSIS).Minimum 6 yrs of experience in building.ETL pipeline using Azure data Factory, Azure Synapse.
Minimum 6 yrs of ETL development using PL / SQL.Exposure in A...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
DataOrbit AI • bhopal, madhya pradesh, in
DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness.
By uniting strategy, data preparation, technology, and execution, w...Show more
Last updated: 19 hours ago • Promoted • New!
ETL & Tableau Data Engineer
Magma Consultancy • bhopal, madhya pradesh, in
ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show more
Last updated: 3 days ago • Promoted
Data Engineer
LanceSoft, Inc. • bhopal, madhya pradesh, in
US working hours (Night Shift form india).This team is looking to hire a motivated Sr.Data Engineer who will be working closely with team of highly motivated data engineers to build a state-of-the-...Show more
Last updated: 4 days ago • Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careers • bhopal, madhya pradesh, in
Remote
Last updated: 5 days ago • Promoted
AWS Data Engineer
Tata Consultancy Services • bhopal, madhya pradesh, in
Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
Last updated: 28 days ago • Promoted