Senior Data EngineerPersistent Systems • Pune (district)
Senior Data Engineer
Persistent Systems • Pune (district)
30+ days ago
Job descriptionDesign, develop, and maintain scalable and robust Delta Live Tables (DLT) pipelines using Lakeflow Declarative Pipelines. Architect and implement solutions based on Databricks Lakehouse Platform and Medallion Architecture. Ingest and process real-time data using Azure Event Hubs and Kafka endpoints. Develop and optimize PySpark code for batch and streaming data pipelines. Write comprehensive unit and integration tests using Pytest / unittest frameworks. Process and transform semi-structured data formats, especially JSON. Manage cloud infrastructure using Terraform for Azure resources. Implement and maintain CI / CD pipelines using GitHub Actions. Collaborate with cross-functional teams to ensure data quality, reliability, and performance. Document technical solutions and maintain best practices across the data engineering lifecycle. Expert-level proficiency in Azure Databricks and Delta Live Tables (DLT). Deep understanding of Databricks Lakehouse Platform and Medallion Architecture. Strong hands-on experience with Azure Event Hubs and Kafka for real-time ingestion. Advanced knowledge of Apache Spark (PySpark) and structured streaming. Proven experience in writing unit / integration tests for data pipelines. Expertise in Python and SQL. Experience in processing semi-structured data (JSON). Strong Infrastructure as Code (IaC) skills using Terraform. Proficiency in CI / CD tools, especially GitHub and GitHub Actions. Competitive salary and benefits package Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents We support hybrid work and flexible hours to fit diverse lifestyles. Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.
About Position :
We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using Terraform. This role demands hands-on experience in real-time data ingestion, structured streaming, and CI / CD practices. Familiarity with the Healthcare domain and Snowflake is a plus.
- Role : Senior Data Engineer
- Location : All Persistent Locations
- Experience : 6+ Years
- Job Type : Full Time Employment
What You'll Do :
Expertise You'll Bring :
Benefits :
Values-Driven, People-Centric & Inclusive Work Environment :
Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
Let’s unleash your full potential at Persistent - persistent.com / careers
“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”
Create a job alert for this search
Senior Data Engineer • Pune (district)
Related jobs
)
Senior Data Engineer
RapidBrains • Pune, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 15 days ago • Promoted
Senior Data Engineer
Arenema • Pune, IN
India (remote – Bangalore / Karnataka area preferred).Full-time contractor / employee.You will be a core member of the team building a data platform that maps economic, advertising and real-estate ac...Show more
Last updated: 1 day ago • Promoted
Senior Azure Data Engineer - Fabric Platform
Lancesoft India Pvt Ltd • Pune
Description : Role Overview : You will be responsible for building modern, scalable, and high-performance data architectures on the Azure Cloud....Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer - Azure Platform
Futran Solutions • Pune
Description : Job Description : We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure ...Show more
Last updated: 7 days ago • Promoted
Infocepts - Senior Data Engineer - Azure Databricks
InfoCepts Technologies Pvt. Ltd. • Pune
Description : Key Responsibilities : Data Pipeline Development : - Design and ...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Persistent Systems • Pune, Maharashtra, India
Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks.
Proven ability to design and optimize high-performance data pipelines,...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Aim Plus Staffing Solutions • Pune
Description : Position : Senior Data Engineer (AWS / GCP) Work Location : Pune <...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Avisoft • Pune
Description : About the Role : We are seeking an experienced Senior Data Engineer to design, devel...Show more
Last updated: 10 days ago • Promoted
Senior Data Engineer ( Palantir)
Lear Corporation • Pune, Maharashtra, India
Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
Last updated: 21 days ago • Promoted
Senior Data Engineer
EXL • Pune, Maharashtra, India
Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show more
Last updated: 24 days ago • Promoted
Senior Data Engineer
SAIVA AI • Pune, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
eClerx • Pune, Maharashtra, India
We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions.
The ideal candidate will have deep exp...Show more
Last updated: 15 days ago • Promoted
Senior Data Engineer
Primesoft Inc • Pune, IN
Primesoft Enterprise IT Services Pvt.APIs, analytics, AI and machine learning at scale.Products team, building and maintaining production-grade pipelines and platform components that power business...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
vConstruct Private Limited • Pune, Maharashtra, India
Construct, a Pune-based Construction Technology company is seeking a Senior Data Engineer for its Data Science and Analytics team, a close-knit group of analysts and engineers supporting all data a...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
VRIZE • Pune, IN
Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database.
Develop and optimize complex SQL queries for data extract...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer
Mindlance • Pune, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 8 days ago • Promoted
Senior Data Engineer - Snowflake / AWS
Resourcetree • Pune
About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS) • Pune, Maharashtra, India
Role : Data Engineering Practice Leader.Data engineering Practice Leader.You'll shape our practice strategy, expand our offerings, and ensure successful delivery of complex data and AI solutions.Thi...Show more
Last updated: 30+ days ago • Promoted