Senior Azure Databricks Engineer

We’re Hiring : Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer

Location : Baner, Pune (Onsite Only)

Work Mode : Full-time | Office-based

⏳ Availability : Immediate Joiners / Notice Period ≤ 15 Days

⚠️ Note : Only local Pune candidates may apply.

• L2 interviews will be conducted in person — apply only if you are open to face-to-face interviews.

About Newscape Consulting

Newscape is a fast-growing digital services company specializing in healthcare technology and data engineering . We help healthcare organizations modernize legacy systems, integrate cloud-native platforms, and drive digital transformation through data.

If you’re passionate about solving complex data challenges and contributing to meaningful innovation in healthcare, this is the place for you.

Position Summary

We are looking for a Senior Databricks Engineer / Azure Data Engineer who will be responsible for designing and implementing high-performance, scalable, and secure data pipelines using Databricks, Spark, Delta Lake, and cloud platforms (Azure)

You’ll collaborate with data architects, scientists, and business stakeholders to transform raw data into powerful insights that drive business impact.

Key Responsibilities

Design, build, and maintain scalable data pipelines using Databricks, PySpark, and Spark SQL .

Work with Databricks components such as Workspace, Jobs, Delta Live Tables (DLT), Repos, and Unity Catalog .

Implement Delta Lake and Lakehouse (Medallion) architectures for optimized data storage and performance.

Integrate CI / CD pipelines using Azure DevOps, GitHub Actions , or equivalent tools for Databricks deployments.

Ensure data quality, lineage, and governance using Unity Catalog or Azure Purview .

Use Airflow, Azure Data Factory, or Databricks Workflows for scheduling and orchestration.

Apply strong SQL, data modeling, and ETL / ELT concepts in solution design.

Collaborate with cross-functional teams to translate business requirements into technical deliverables.

Required Skills & Qualifications

✅ 10+ years of experience in Data Engineering , with a strong focus on Databricks .

✅ Expertise in PySpark , Spark SQL , and optionally Scala .

✅ Hands-on experience with Databricks components : Workspace, Jobs, DLT, Repos, Unity Catalog.

✅ Strong understanding of Delta Lake and Lakehouse architectures .

✅ Cloud proficiency in Azure (preferred), AWS , or GCP .

✅ Experience in CI / CD pipeline automation for Databricks deployments.

✅ Familiarity with orchestration tools ( ADF, Airflow, Databricks Workflows ).

✅ Strong grasp of data governance, metadata management, and lineage .

✅ Excellent communication and stakeholder management skills.

Preferred Qualifications (Bonus Points)

⭐ Experience in healthcare data systems or regulated data environments.

⭐ Knowledge of SQL Server, Synapse, or Power BI integration.

⭐ Exposure to event-driven architecture (Kafka, Redpanda) .

⭐ Azure certifications (e.g., DP-203 , Databricks Certified Data Engineer Associate / Professional ).

Why Join Us

Work on cutting-edge Azure & Databricks projects in the healthcare domain.

Collaborative, innovation-driven work culture.

Opportunity to grow in a fast-scaling data engineering practice .

Competitive compensation and long-term career opportunities.

Ready to make an impact?

Apply now or DM us if you’re a Pune-based data enthusiast ready for your next big challenge!

How to Apply :

Send your resume to swapnil.supe@newscapeconsulting.com

Subject Line : Application – Azure Databricks Developer