Data Ingestion Specialist

Unlocking data potential is a key goal in today's fast-paced technology landscape.

Job Overview

We're seeking an experienced professional to set up Microsoft Fabric for a US health insurer, ensuring seamless and reliable Bronze-layer ingestion.

Key Responsibilities

• Configure Fabric Mirroring from SQL Server into OneLake, managing schedules, snapshots, retention, and throughput effectively.
• Design Lakehouse folder structures and partitioning for optimized fast and organized Bronze ingestion processes.
• Implement Change Data Capture (CDC) strategies, including soft / hard deletes, late-arriving data, and backfills to ensure data integrity.
• Develop resilient pipelines using Fabric Data Factory and / or notebooks, guaranteeing smooth data flow.
• Automate schema drift detection and evolution, publishing change notes and guardrails to maintain data consistency.