Senior Data Engineer
Persistent SystemsPune (division)10 days ago
Job descriptionDesign, develop, and maintain scalable and robust Delta Live Tables (DLT) pipelines using Lakeflow Declarative Pipelines. Architect and implement solutions based on Databricks Lakehouse Platform and Medallion Architecture. Ingest and process real-time data using Azure Event Hubs and Kafka endpoints. Develop and optimize PySpark code for batch and streaming data pipelines. Write comprehensive unit and integration tests using Pytest / unittest frameworks. Process and transform semi-structured data formats, especially JSON. Manage cloud infrastructure using Terraform for Azure resources. Implement and maintain CI / CD pipelines using GitHub Actions. Collaborate with cross-functional teams to ensure data quality, reliability, and performance. Document technical solutions and maintain best practices across the data engineering lifecycle. Expert-level proficiency in Azure Databricks and Delta Live Tables (DLT). Deep understanding of Databricks Lakehouse Platform and Medallion Architecture. Strong hands-on experience with Azure Event Hubs and Kafka for real-time ingestion. Advanced knowledge of Apache Spark (PySpark) and structured streaming. Proven experience in writing unit / integration tests for data pipelines. Expertise in Python and SQL. Experience in processing semi-structured data (JSON). Strong Infrastructure as Code (IaC) skills using Terraform. Proficiency in CI / CD tools, especially GitHub and GitHub Actions. Competitive salary and benefits package Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents We support hybrid work and flexible hours to fit diverse lifestyles. Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
About Position :
We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using Terraform. This role demands hands-on experience in real-time data ingestion, structured streaming, and CI / CD practices. Familiarity with the Healthcare domain and Snowflake is a plus.
- Role : Senior Data Engineer
- Location : All Persistent Locations
- Experience : 6+ Years
- Job Type : Full Time Employment
What You'll Do :
Expertise You'll Bring :
Benefits :
Values-Driven, People-Centric & Inclusive Work Environment :
Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
Let’s unleash your full potential at Persistent - persistent.com / careers
“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”
Create a job alert for this search
Senior Data Engineer • Pune (division)
Related jobs
- Promoted
Data Engineer
Enterprise Minds, IncPune (division) As a data engineer, you will be responsible for delivering data intelligence solutions to our customers all around the globe, based on an innovative product, which provides insights into the perfor...Show moreLast updated: 1 day ago
- Promoted
Data Solution Engineer I II and III
OpenGov Inc.Pune (division) OpenGov is the leader in AI and ERP solutions for local and state governments in the U.More than 2,000 cities, counties, state agencies, school districts, and special districts rely on the OpenGov ...Show moreLast updated: 1 day ago
- Promoted
- New!
Software Engineer
Alp Consulting Ltd.Pune (division) Years of in Big Data & Data related technology experience.Expert level understanding of distributed computing principles.
Expert level knowledge and experience in Apache Spark.Hands on programming w...Show moreLast updated: 21 hours ago
- Promoted
Data Engineer
Persistent SystemsPune (division) We are looking for Strong Data engineers to join the Data Integration team and become part of our successful group.Location : All Persistent Locations.
Job Type : Full Time Employment.Design, code, te...Show moreLast updated: 10 days ago
- Promoted
Senior Data Engineer- AWS
InfoCeptsPune (division) Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements.
Should be able to design comple...Show moreLast updated: 1 day ago
- Promoted
Cloud Data Engineer
Persistent SystemsPune (division) We are seeking cloud data engineers with hands on experience in azure data bricks, data factory, SQL, etc.Job Location : All Persistent Locations.
Job Type : Full Time Employment.Collaborate with prod...Show moreLast updated: 10 days ago
- Promoted
GCP Data Engineer
Persistent SystemsPune (division) We are seeking the GCP Data Engineer with hands on experience in data engineering, python, jaba, etc.Job Type : Full Time Employment.
Design, build, and manage data pipelines on Google Cloud Platform...Show moreLast updated: 10 days ago
- Promoted
5447 | Senior Data Engineer
EXLPune (division) We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
SynechronPune (division) We have immediate opportunity for.Notice Period : Immediate to 30 Days.At Synechron, we believe in the power of digital to transform businesses for the better.
Our global consulting firm combines cre...Show moreLast updated: 1 day ago
- Promoted
Data Engineer
Bits In GlassPune (division) Senior Data Engineer / ETL Engineer.As a Senior Data Engineer / ETL Engineer, you will be instrumental in designing, developing, and optimizing data processing systems that support our organization...Show moreLast updated: 10 days ago
- Promoted
- Promoted
Senior Azure Data Engineer Exp - Interviewing Today - Urgent Needs
Accion LabsPune (division) Microsoft Fabric, Azure Data Factory (ADF), Databricks (Python, PySpark, Spark SQL), Delta Lake, Power BI (DAX), Azure Storage, Lakehouse, Warehouse.
Client-facing, hands-on, design-to-delivery.Any ...Show moreLast updated: 1 day ago
- Promoted
Data Engineer (PySpark)
RSquareSoft TechnologiesPune (division) Design, develop, and maintain scalable.Work with large datasets using.S3, Glue, Lambda, and Redshift.Collaborate with cross-functional teams to define data requirements and optimize data flows.Ensu...Show moreLast updated: 1 day ago
- Promoted
5676 - Data Engineer
EXLPune (division) Location - Pune, Bangalore, Noida, Gurgaon, Hyderabad.The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driv...Show moreLast updated: 1 day ago
- Promoted
GenAI Engineer
Persistent SystemsPune (division) This position focuses on developing and maintaining advanced Generative AI solutions, including model lifecycle management, Natural Language to SQL agents, and chatbot systems.The role involves wor...Show moreLast updated: 1 day ago
- Promoted
2917 - Data Engineer
EXLPune (division) The Data Engineer is responsible for designing, building, and optimizing data systems that power analytics, reporting, and machine learning across the organization.
The role involves developing scal...Show moreLast updated: 1 day ago
- Promoted
- New!
Senior Database Engineer
mthreePune (division) Multinational Investment Bank and Financial Services Company.Advanced hands-on experience in configuring, patching, upgrading, and optimizing database software and related products.Advanced experie...Show moreLast updated: 21 hours ago
- Promoted
Senior System Engineer
Resonating Mindz Pvt LtdPune (division) Best Opportunity for Automation Engineers to Build a Rewarding Career in the IIoT Domain!.Are you an Industrial Automation Engineer who wants to take on new challenges in the emerging field of.Indu...Show moreLast updated: 1 day ago