Senior Lakehouse ArchitectPersistent Systems • Pune, Republic Of India, IN
Senior Lakehouse Architect
Persistent Systems • Pune, Republic Of India, IN
30+ days ago
Job descriptionDesign, develop, and maintain scalable and robust Delta Live Tables (DLT) pipelines using Lakeflow Declarative Pipelines. Architect and implement solutions based on Databricks Lakehouse Platform and Medallion Architecture. Ingest and process real-time data using Azure Event Hubs and Kafka endpoints. Develop and optimize PySpark code for batch and streaming data pipelines. Write comprehensive unit and integration tests using Pytest / unittest frameworks. Process and transform semi-structured data formats, especially JSON. Manage cloud infrastructure using Terraform for Azure resources. Implement and maintain CI / CD pipelines using GitHub Actions. Collaborate with cross-functional teams to ensure data quality, reliability, and performance. Document technical solutions and maintain best practices across the data engineering lifecycle. Expert-level proficiency in Azure Databricks and Delta Live Tables (DLT). Deep understanding of Databricks Lakehouse Platform and Medallion Architecture. Strong hands-on experience with Azure Event Hubs and Kafka for real-time ingestion. Advanced knowledge of Apache Spark (PySpark) and structured streaming. Proven experience in writing unit / integration tests for data pipelines. Expertise in Python and SQL. Experience in processing semi-structured data (JSON). Strong Infrastructure as Code (IaC) skills using Terraform. Proficiency in CI / CD tools, especially GitHub and GitHub Actions. Competitive salary and benefits package Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications Opportunity to work with cutting-edge technologies Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards Annual health check-ups Insurance coverage : group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents We support hybrid work and flexible hours to fit diverse lifestyles. Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.
About Position :
We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using Terraform. This role demands hands-on experience in real-time data ingestion, structured streaming, and CI / CD practices. Familiarity with the Healthcare domain and Snowflake is a plus.
- Role : Senior Data Engineer
- Location : All Persistent Locations
- Experience : 6+ Years
- Job Type : Full Time Employment
What You'll Do :
Expertise You'll Bring :
Benefits :
Values-Driven, People-Centric & Inclusive Work Environment :
Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
Let’s unleash your full potential at Persistent - persistent.Com / careers
“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”
Create a job alert for this search
Senior Architect • Pune, Republic Of India, IN
Related jobs)
Senior IAM Architect
First American (India) • India, India
First American (India) is a GCC (Global Capability Center) of the First American Financial Corporation (NYSE : FAF) family of companies, a proud member of the FORTUNE 500 companies and was named one...Show more
Last updated: 30+ days ago • Promoted
Lead Solutions Architect
Chargebee • Chennai, Republic Of India, IN
Chargebee is looking for an inspirational Senior Staff Engineer / Senior Technical Architect for driving the Next Generation of Subscription to create a revolutionary subscriptions experience for its...Show more
Last updated: 30+ days ago • Promoted
Senior Architect
Designo Architects • Republic Of India, IN
Job Profile - Senior Architect.Navi Mumbai / Mumbai or Nearby.Designo Architects is a leading architectural firm based in Navi Mumbai, recognized for its innovative and context-driven designs.With ...Show more
Last updated: 30+ days ago • Promoted
Senior Architect
Midori Architects • India
Urgent Hiring : Architect (3 - 4 Years Experience).Review team drawings and ensure.MEP, structural, and project management.
Ensure all deliverables comply with.Support BOQ preparation and material sp...Show more
Last updated: 1 day ago • Promoted
Senior Project Architect
APS Property Solutions Pvt. Ltd. • India
APS Property Solutions is a dynamic 20-year real estate solutions company.Brokerage, Advisory, Interior Design & Build, and Construction services.
With a mission to deliver tailor-made real estate s...Show more
Last updated: 2 days ago • Promoted
Senior Project Architect
Ileseum Clubs • Pune, Republic Of India, IN
Minimum 3 years of experience required in the relevant field.Ileseum Clubs is seeking a highly skilled and experienced Architect to join our dynamic team.
The ideal candidate will have minimum 3 yea...Show more
Last updated: 21 days ago • Promoted
Senior Architect - Data
Quantiphi • India
Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quanti...Show more
Last updated: 2 days ago • Promoted
Senior Architect
Mount Talent Consulting Pvt Ltd. • Republic Of India, IN
As a Senior Architect - Data Modeler, you will play a pivotal role in shaping the data architecture of our enterprise systems.
This role demands a seasoned professional with deep expertise in Oracle...Show more
Last updated: 11 days ago • Promoted
Architect / Senior Architect
Valeo • India
Participate and lead in the software architecture design of the software platform for both embedded software & development environment.
Strong programming experience : C++, design patterns, DOORS, Ca...Show more
Last updated: 2 days ago • Promoted
Architect
Latinem Private Limited • India
In-depth knowledge of US building codes, regulations, and industry standards.Shift Timings : 3 PM - 12 AM Shift.The Senior Architect for the US Back Office.
Working remotely or in a back-office capac...Show more
Last updated: 2 days ago • Promoted
Senior Solutions Architect
TELUS Digital • Republic Of India, IN
TELUS Digital focuses on the value of human connection to design, build and deliver high-tech, high-touch customer experiences powered by next-gen digital solutions.
With over 70,000 team members an...Show more
Last updated: 5 days ago • Promoted
Senior Architect
Total Environment Building Systems Pvt Ltd • Republic Of India, IN
We are looking for Senior Architects with 8+ years experience in Residential / Commercial Architectural Design experience.
Quality Assurance – design and implement checklists and a Quality Assurance...Show more
Last updated: 5 days ago • Promoted
Lead Solutions Architect
CoffeeBeans • Republic Of India, IN
CoffeeBeans Consulting is a tech consulting firm focused on making organizations.We are looking for a Principal Engineer who can design and implement complex solutions that are scalable, future-pro...Show more
Last updated: 30+ days ago • Promoted
Senior Architect
Indovance Inc • India
Experience : 2 - 3 Years (US Projects).Strong knowledge of international building codes, construction and architectural standards.
Ability to work under pressure and meet tight deadlines with accurac...Show more
Last updated: 2 days ago • Promoted
Senior Architect
Nyati Group • Pune, Republic Of India, IN
At Nyati Group, customer is the central focus of all our ventures.We put an earnest effort in understanding the aspirations of our buyers with the objective of meeting all their expectations.We bel...Show more
Last updated: 30+ days ago • Promoted
Senior SAC Solutions Architect
RED Global • Republic Of India, IN
We are looking for an experienced.SAP Analytics Cloud (SAC) Consultant.If you’re passionate about building high-impact dashboards, leading teams, and delivering end-to-end SAC solutions, we’d love ...Show more
Last updated: 8 days ago • Promoted
Senior Technical Architect
Chargebee • Chennai, Republic Of India, IN
Chargebee is looking for an inspirational Senior Staff Engineer / Senior Technical Architect for driving the Next Generation of Subscription to create a revolutionary subscriptions experience for its...Show more
Last updated: 30+ days ago • Promoted
Data Lakehouse Architect
HARP • Republic Of India, IN
Lead the architecture, design, and implementation of data lakehouse solutions leveraging Databricks, Delta Lake, Unity Catalog, and Apache Spark.
Define and enforce architectural best practices for ...Show more
Last updated: 1 day ago • Promoted