No longer accepting applications

Fabric Data Engineer

Thinkgrid LabsAnantapur, Andhra Pradesh, India

16 days ago

Job description

Thinkgrid Labs is at the forefront of innovation and technology. Our expert team of software engineers, architects, and UI / UX designers specialises in crafting bespoke web, mobile, cloud applications, data platforms along with AI solutions and intelligent bots. Thinkgrid Labs is expanding our data practice to stand up Microsoft Fabric for a US health insurer. This role unlocks fast, reliable Bronze-layer ingestion. You'll own Fabric Mirroring from SQL Server and other sources into OneLake, manage CDC and schema drift at scale, and design resilient, high-volume ingestion pipelines that teams can trust.

Job Title : Fabric Data Engineer

Location : Remote

Working Hours : 2 PM IST to 11 PM IST

Experience Required : 6–10 years in data engineering; 2+ years on Azure data platforms with hands-on Microsoft Fabric (Mirroring / Lakehouse / Warehouse)

Education : Bachelor's or Master's degree in Computer Science, Health Informatics, or Business

Preferred certifications : DP-600, DP-203, DP-500

Who are you?

SQL & CDC Pro : Strong SQL Server / T-SQL; hands-on CDC or replication patterns for initial snapshot + incremental syncs, including delete handling.
Fabric Mirroring Practitioner : You've set up and tuned Fabric Mirroring to land data into OneLake / Lakehouse; comfortable with OneLake shortcuts and workspace / domain organisation.
Schema-Drift Aware : You detect, evolve, and communicate schema changes safely (contracts, tests, alerts), minimising downstream breakage.
High-Volume Ingestion Mindset : You design for throughput, resiliency, and backpressure—retries, idempotency, partitioning, and efficient file sizing.
Python / Scala / Spark Capable : You can build notebooks / ingestion frameworks for advanced scenarios and data quality checks.
Operationally Excellent : You add observability (logging / metrics / alerts), document runbooks, and partner well with platform, security, and analytics teams.
Data Security Conscious : You respect PII / PHI, apply least privilege, and align with RLS / CLS patterns and governance guardrails.

What you will be doing?

Stand Up Mirroring : Configure Fabric Mirroring from SQL Server (and other relational sources) into OneLake; tune schedules, snapshots, retention, and throughput.

Land to Bronze Cleanly : Define Lakehouse folder structures, naming / tagging conventions, and partitioning for fast, organised Bronze ingestion.

Handle Change at Scale : Implement CDC—including soft / hard deletes, late-arriving data, and backfills—using reliable watermarking and reconciliation checks.

Design Resilient Pipelines : Build ingestion with Fabric Data Factory and / or notebooks; add retries, dead-lettering, and circuit-breaker patterns for fault tolerance.

Manage Schema Drift : Automate drift detection and schema evolution; publish change notes and guardrails so downstream consumers aren't surprised.

Performance & Cost Tuning : Optimise batch sizes, file counts, partitions, parallelism, and capacity usage to balance speed, reliability, and spend.

Observability & Quality : Instrument lineage, logs, metrics, and DQ tests (nulls, ranges, uniqueness); set up alerts and simple SLOs for ingestion health.

Collaboration & Documentation : Partner with the Fabric Platform Architect on domains, security, and workspaces; document pipelines, SLAs, and runbooks.

Must-have skills

SQL Server, T-SQL; CDC / replication fundamentals

Microsoft Fabric Mirroring; OneLake / Lakehouse; OneLake shortcuts

Schema drift detection / management and data contracts

Familiarity with large, complex relational databases

Python / Scala / Spark for ingestion and validation

Git-based workflow; basic CI / CD (Fabric deployment pipelines or Azure DevOps)

Benefits

5 day work week

100% remote setup with flexible work culture and international exposure

Opportunity to work on mission-critical healthcare projects impacting providers and patients globally

Create a job alert for this search

Data Engineer • Anantapur, Andhra Pradesh, India

Related jobs

Promoted

Python AWS Data Engineer

Digitrix Software LLPAnantapur, IN

Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

AAA GlobalAnantapur, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 15 days ago

Promoted

Senior Data Engineer

HealthyMe AIAnantapur, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 24 days ago

Promoted

Senior Data Platform Engineer

Black Dog LabsAnantapur, IN

Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago

Promoted

Freelance Data Engineer

upGradAnantapur, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 13 days ago

Promoted

Data Engineer

Kline + CompanyAnantapur, IN

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgeAnantapur, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Randstad EnterpriseAnantapur, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

Sr Data Engineer

Mitchell Martin Inc.Anantapur, IN

Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 7 days ago

Promoted

Senior Data Engineer

SAIVA AIAnantapur, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Fabric Platform Data Architect (Remote)

Thinkgrid LabsAnantapur, IN

Remote

Promoted

Data Engineer

Sikich IndiaAnantapur, IN

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RevXAnantapur, IN

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

VeraxionAnantapur, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 5 days ago

Promoted

AI / ML & Data Engineer

Mindfire SolutionsAnantapur, IN

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 6 days ago

Promoted

Fashion Data Annotator

hotsourcedAnantapur, IN

We are a fully-female founded Fashion-Tech start-up that’s on a mission to change the way people search and shop online forever. In order to do this we need to create a large library of images of fa...Show moreLast updated: 30+ days ago

Promoted