Crafting High-Volume Ingestion Pipelines

Senior Data Engineer

About the Role :

We're seeking a seasoned data engineer to join our team and take ownership of Microsoft Fabric Mirroring from SQL Server and other sources into OneLake / Lakehouse. As a senior data engineer, you will be responsible for designing high-volume ingestion pipelines for throughput, resiliency, and backpressure. Your expertise in Azure data platforms and hands-on experience with Microsoft Fabric skills will play a crucial role in shaping our data practice.

Key Responsibilities :

• Setting up and tuning Fabric Mirroring to land data into OneLake / Lakehouse
• Detecting, evolving, and communicating schema changes safely
• Designing high-volume ingestion pipelines for throughput, resiliency, and backpressure
• Buidling notebooks / ingestion frameworks for advanced scenarios and data quality checks

Requirements :

Benefits :

This is an exciting opportunity to work on mission-critical healthcare projects impacting providers and patients globally. Our expert team crafts bespoke web, mobile, cloud applications, data platforms, and AI solutions. We're expanding our data practice to stand up Microsoft Fabric for a US health insurer. You'll own fast, reliable Bronze-layer ingestion.