Senior Azure Data Engineer Exp - Interviewing Today - Urgent NeedsAccion Labs • Pune, Maharashtra, India
Senior Azure Data Engineer Exp - Interviewing Today - Urgent Needs
Accion Labs • Pune, Maharashtra, India
16 days ago
Job descriptionEnd-to-End Engineering Design, implement, and deliver batch & streaming data pipelines into Fabric Lakehouse / Warehouse using ADF and Databricks with Delta Lake . Data Architecture Understanding Strong grasp of Bronze–Silver–Gold layering , incremental ingestion , watermarking , and best practices for scalable pipelines. Medallion Architecture Apply Bronze / Silver / Gold patterns , enforce schema evolution , handle late / dirty data , and implement SCD (Type 1 / 2) and late-arriving dimensions . Fabric Platform & Security Build solutions on Microsoft Fabric (OneLake, Lakehouse, Warehouse, Pipelines, Dataflows Gen2, Notebooks) . Implement security layers : workspace & item permissions, RLS / OLS in Warehouse / Lakehouse SQL endpoints, credentialed connections / shortcuts to external storage, environments & capacities alignment. ADF Orchestration & Reusability Create parameterized, template-driven pipelines with reusable activities (ForEach, Lookup, Mapping Data Flows). Ensure robust dependency management with retry / alert patterns. Databricks Engineering Excellence Author complex & nested notebooks (via %run / dbutils.notebook.run) in Python, PySpark, and Spark SQL for ETL / ELT. Debug & troubleshoot jobs and clusters; resolve skew, shuffle spills, checkpoint failures, schema drift, streaming backlogs . Apply performance optimizations : partitioning & clustering, Z-ORDER, OPTIMIZE / VACUUM, file size tuning, AQE, broadcast joins, caching, checkpoint & trigger strategies for Structured Streaming. Data Quality, Observability & Reliability Implement data quality checks (validations, expectations), idempotency, exactly-once / at-least-once semantics, and dead-letter flows . Set up monitoring & logging (Azure Monitor / Log Analytics, Databricks system tables, Fabric monitoring), with alerting & dashboards. SQL Strong understanding of MS SQL concepts ; hands-on experience in writing functions and stored procedures , along with DDL / DML operations . Design, Documentation & Governance Contribute to data models (star / snowflake), semantic layers, dimensional design, and documentation (solution design docs, runbooks). CI / CD & ADO Versioning Management Implement branching strategy (Git / ADO) , perform PR reviews , manage environment promotion (Dev / Test / Prod), and support Fabric CI / CD process . Leadership & Client Engagement Mentor junior engineers; enforce reusable & scalable patterns . Run client demos and brainstorming discussions . Be self-driven and innovative in solution delivery. Microsoft Fabric (2024+) OneLake, Lakehouse, Warehouse, Pipelines, Dataflows Gen2, Notebooks, capacities, workspace & item security, RLS / OLS. Azure Data Factory (ADF) Reusable, parameterized pipelines; high-level orchestration; robust scheduling, logging, retries, and alerts. Databricks (5+ years on Azure) Python, PySpark, Spark SQL : complex transformations, joins, window functions, UDFs / UDAs. Complex & nested notebooks; modular code with %run / dbutils.notebook.run. Structured Streaming : watermarks, triggers, checkpointing, foreachBatch, schema evolution. Delta Lake : Z-ORDER, OPTIMIZE / VACUUM, MERGE for SCD, Auto Optimize, compaction, time travel. Performance tuning : partitioning, file sizing, broadcast hints, caching, Photon (where available), cluster sizing / pools. Medallion Architecture Bronze / Silver / Gold patterns, SCD (Type 1 / 2), handling late-arriving dimensions. Azure Storage ADLS Gen2 (hierarchical namespace), tiering (Hot / Cool / Archive), lifecycle & cost optimization, shortcuts into OneLake. Data Warehousing Dimensional modeling, fact / aggregate design, query performance tuning in Fabric Warehouse & Lakehouse SQL endpoint. SQL Excellent SQL development; advanced joins, windowing, CTEs, performance tuning / indexing where applicable. Power BI (DAX) Awareness of Power BI and DAX; RLS alignment with Warehouse / Lakehouse. Security & Compliance RBAC, item-level permissions, credentials for data sources, RLS / OLS, secret management (Key Vault), PII handling. ETL / ELT Methodologies Robust, testable pipelines; idempotency; error handling; data quality gates. Ways of Working Agile delivery, client-facing communication, crisp demos, documentation, and best-practice advocacy.
Role Snapshot
- Title : Senior Azure Data Engineer
- Experience : 6–8+ years in Data Engineering ( minimum 4+ years on Azure , and ( Or ) 6 months to 1+ year with Microsoft Fabric )
- Tech Focus : Microsoft Fabric, Azure Data Factory (ADF), Databricks (Python, PySpark, Spark SQL), Delta Lake, Power BI (DAX), Azure Storage, Lakehouse, Warehouse
- Engagement : Client-facing, hands-on, design-to-delivery
- Location : Any Accion Labs offices in India - Bangalore, Pune (Preferred), Mumbai, Hyderabad, Indore, Noida - THIS IS A HYBRID Work Model , NOT Remote.
- Notice period : Preferred Immediate joiners or candidates who can join within 20 days are needed
Core Responsibilities
Must-Have Skills (Strong, Hands-On)
If interested or know anyone, Kindly write to me at shruti.saboo@accionlabs.com along with your latest CV.
Thank You,
Shruti Saboo
Create a job alert for this search
Azure Data Engineer • Pune, Maharashtra, India
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more 
Senior Data Engineer
EXL • Pune, Maharashtra, India
Summary : We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging...Show more
Last updated: 30+ days ago • Promoted
Azure Data Lead Engineer
Persistent Systems • Pune, Maharashtra, India
About Position : We are looking for Lead Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.
Role : Azure Data Lead Engineer - Location : Pune / Ba...Show more
Last updated: 3 days ago • Promoted
Azure Data Engineer
Tata Consultancy Services • Pune, India
Greetings from Tata Consultancy Services!!.We are hiring for Data Engineer.Python, Pyspark, Azure Function.Python, Pyspark, Azure Function, Data Bricks.
Location : Azure, ADF, Databricks, Python.Exp...Show more
Last updated: 30+ days ago • Promoted
Azure Data Engineer
Tech Mahindra • Pune, IN
Expertise in CI-CD, Pyspark, SQL.Expertise in ADF, ADLS & ADB (Mandatory).Experience in "Azure Services / Key Vault".Experience in "GIT / Jenkins / Azure DevOps".Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer - Azure Platform
Futran Solutions • Pune
Description : Job Description : We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure ...Show more
Last updated: 4 hours ago • Promoted • New!
Senior AWS Data Engineer
CYAN360 • Pune, IN
Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show more
Last updated: 30+ days ago • Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careers • Pune, IN
Remote
Last updated: 3 days ago • Promoted
Senior Data Engineer
Persistent Systems • Pune, Maharashtra, India
Data Engineer with Pyspark, SQL, ETL Data Engineer.Job Type : Full Time Employment.Candidate should have 5+ years of experience in Data Engineering.
Must have experience in Pyspark, SQL, ETL, data pi...Show more
Last updated: 30+ days ago • Promoted
Sr.Azure Data Engineer
Persistent Systems • Pune, Maharashtra, India
About Position : We are looking for Sr Azure Data engineer who have experience in Azure data bricks, Data factory, to join our development team.
Azure Data Engineer - Location : Pune / Bangalore - Expe...Show more
Last updated: 3 days ago • Promoted
Senior Data Engineer - Azure SQL
Futran Solutions • Pune
Description : Title : Senior Data Engineer / Data Engineer Lead.Job Description : We are seeking a highly skilled and experienced Senior ...Show more
Last updated: 24 days ago • Promoted
Senior Data Engineer
SAIVA AI • Pune, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
Senior Azure Data Engineer - Full remote - contractor in USD
All European Careers • Pune, IN
Remote
Last updated: 1 day ago • Promoted
Azure Data Engineer
SystemBender • Pune, IN
Responsible for designing and maintaining scalable data pipelines on Microsoft Fabric and Azure.Focus includes ingesting structured, semi-structured, and unstructured data, managing OneLake / Delta L...Show more
Last updated: 11 days ago • Promoted
Senior Data Engineer ( Palantir)
Lear Corporation • Pune, Maharashtra, India
Lear, a global automotive technology leader in Seating and E-Systems, is Making every drive better by delivering intelligent in-vehicle experiences for customers around the world.With over 100 year...Show more
Last updated: 14 days ago • Promoted
Opportunity for Data Engineer
Hinduja Tech Limited • Pune, Maharashtra, India
Strong hands-on experience with.Experience working in multiple file formats like.Knowledge of Kafka or similar streaming technologies for real-time data ingestion.
Experience with data governance an...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
eClerx • Pune, Maharashtra, India
About the Role : We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions.The ideal candidate wi...Show more
Last updated: 30+ days ago • Promoted
6221 Azure Data Engineer
EXL • Pune, Maharashtra, India
Key Role and Responsibilities : .Design and develop ETL / ELT pipelines using Azure Data Factory, Snowflake, and DBT.Build and maintain data integration workflows from various data sources to Snowflake...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Mindlance • Pune, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 1 day ago • Promoted