Senior Data EngineerPersistent Systems • Pune, Haveli
Senior Data Engineer
Persistent Systems • Pune, Haveli
29 days ago
Job descriptionDesign, develop, and maintain scalable and robust Delta Live Tables (DLT) pipelines using Lakeflow Declarative Pipelines. Architect and implement solutions based on Databricks Lakehouse Platform and Medallion Architecture. Ingest and process real-time data using Azure Event Hubs and Kafka endpoints. Develop and optimize PySpark code for batch and streaming data pipelines. Write comprehensive unit and integration tests using Pytest / unittest frameworks. Process and transform semi-structured data formats, especially JSON. Manage cloud infrastructure using Terraform for Azure resources. Implement and maintain CI / CD pipelines using GitHub Actions. Collaborate with cross-functional teams to ensure data quality, reliability, and performance. Document technical solutions and maintain best practices across the data engineering lifecycle. Expert-level proficiency in Azure Databricks and Delta Live Tables (DLT). Deep understanding of Databricks Lakehouse Platform and Medallion Architecture. Strong hands-on experience with Azure Event Hubs and Kafka for real-time ingestion. Advanced knowledge of Apache Spark (PySpark) and structured streaming. Proven experience in writing unit / integration tests for data pipelines. Expertise in Python and SQL. Experience in processing semi-structured data (JSON). Strong Infrastructure as Code (IaC) skills using Terraform. Proficiency in CI / CD tools, especially GitHub and GitHub Actions. Competitive salary and benefits package Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents We support hybrid work and flexible hours to fit diverse lifestyles. Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.
About Position :
We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using Terraform. This role demands hands-on experience in real-time data ingestion, structured streaming, and CI / CD practices. Familiarity with the Healthcare domain and Snowflake is a plus.
- Role : Senior Data Engineer
- Location : All Persistent Locations
- Experience : 6+ Years
- Job Type : Full Time Employment
What You'll Do :
Expertise You'll Bring :
Benefits :
Values-Driven, People-Centric & Inclusive Work Environment :
Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
Let’s unleash your full potential at Persistent - persistent.com / careers
“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”
Create a job alert for this search
Senior Data Engineer • Pune, Haveli
Related jobs
Senior Data Engineer
RapidBrains • Pune, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 13 days ago • Promoted
Senior Data Engineer
Donyati • pune, maharashtra, in
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
Last updated: 8 days ago • Promoted
Senior Data Engineer
Syngenta Group • Pune, Maharashtra, India
The Senior Data Engineer plays a pivotal role in driving the design development and optimization of robust scalable and high-performance data products and pipelines on Databricks (Spark / Delta Lake / ...Show more
Last updated: 21 days ago • Promoted
Senior Data Engineer
Mastek • pune, maharashtra, in
We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Persistent Systems • Pune, Maharashtra, India
Data Engineer with extensive experience in leading large-scale data migration projects, specializing in PySpark and Databricks.
Proven ability to design and optimize high-performance data pipelines,...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Innova Solutions • pune, maharashtra, in
We're Hiring : Lead Data Consultant / Senior Data Engineer.Industry : Financial Services & Insurance (FSI).Are you passionate about building scalable, cloud-native data platforms? Join our team to le...Show more
Last updated: 22 days ago • Promoted
Senior Data Engineer
Saras Analytics • pune, maharashtra, in
We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value.
Our suite of work spans extraction, transformatio...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SGS & Co • pune, maharashtra, in
Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show more
Last updated: 22 days ago • Promoted
Senior Data Engineer ( Palantir)
Lear Corporation • Pune, Maharashtra, India
Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
Last updated: 19 days ago • Promoted
Senior Data Engineer
EXL • Pune, Maharashtra, India
Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
Leverage technologies and solutions to innovate with increasingly larg...Show more
Last updated: 22 days ago • Promoted
Senior Data Engineer
SAIVA AI • Pune, Maharashtra, India
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer- AWS
InfoCepts • Pune, Maharashtra, India
Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
Should be able to design comple...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Talentoj • Pune, IN
We are looking for a highly experienced.The role focuses on building scalable ETL pipelines, optimizing data platforms, and enabling advanced analytics and reporting.
Design, build, and maintain rob...Show more
Last updated: 6 hours ago • Promoted • New!
Senior Data Engineer
eClerx • Pune, Maharashtra, India
We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions.
The ideal candidate will have deep exp...Show more
Last updated: 13 days ago • Promoted
Senior Data Engineer
Straive • pune, maharashtra, in
The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Confidential • Pune
Proficiency in programming skills in Python.Experience with data processing frameworks like Apache Spark or Hadoop.Experience working on Snowflake and Databricks.
Familiarity with cloud platforms (A...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
VRIZE • Pune, IN
Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database.
Develop and optimize complex SQL queries for data extract...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
SPIRO • Pune, Maharashtra, India
We are seeking an experienced Senior Data Engineer with a strong background in PySpark, Spark, and Big Data technologies.
The ideal candidate will have over five years of hands-on experience designi...Show more
Last updated: 30+ days ago • Promoted