Talent.com
Senior Azure Databricks Engineer

Senior Azure Databricks Engineer

Newscape ConsultingPrayagraj(Allahabad), IN
5 hours ago
Job description

🚀 We’re Hiring : Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer

📍 Location : Baner, Pune (Onsite Only)

🏢 Work Mode : Full-time | Office-based

⏳ Availability : Immediate Joiners / Notice Period ≤ 15 Days

⚠️ Note : Only local Pune candidates may apply.

  • 🧭 L2 interviews will be conducted in person — apply only if you are open to face-to-face interviews.

🌟 About Newscape Consulting

Newscape is a fast-growing digital services company specializing in healthcare technology and data engineering . We help healthcare organizations modernize legacy systems, integrate cloud-native platforms, and drive digital transformation through data.

If you’re passionate about solving complex data challenges and contributing to meaningful innovation in healthcare, this is the place for you.

💼 Position Summary

We are looking for a Senior Databricks Engineer / Azure Data Engineer who will be responsible for designing and implementing high-performance, scalable, and secure data pipelines using Databricks, Spark, Delta Lake, and cloud platforms (Azure)

You’ll collaborate with data architects, scientists, and business stakeholders to transform raw data into powerful insights that drive business impact.

🧠 Key Responsibilities

  • Design, build, and maintain scalable data pipelines using Databricks, PySpark, and Spark SQL .
  • Work with Databricks components such as Workspace, Jobs, Delta Live Tables (DLT), Repos, and Unity Catalog .
  • Implement Delta Lake and Lakehouse (Medallion) architectures for optimized data storage and performance.
  • Integrate CI / CD pipelines using Azure DevOps, GitHub Actions , or equivalent tools for Databricks deployments.
  • Ensure data quality, lineage, and governance using Unity Catalog or Azure Purview .
  • Use Airflow, Azure Data Factory, or Databricks Workflows for scheduling and orchestration.
  • Apply strong SQL, data modeling, and ETL / ELT concepts in solution design.
  • Collaborate with cross-functional teams to translate business requirements into technical deliverables.
  • 🧩 Required Skills & Qualifications

    ✅ 10+ years of experience in Data Engineering , with a strong focus on Databricks .

    ✅ Expertise in PySpark , Spark SQL , and optionally Scala .

    ✅ Hands-on experience with Databricks components : Workspace, Jobs, DLT, Repos, Unity Catalog.

    ✅ Strong understanding of Delta Lake and Lakehouse architectures .

    ✅ Cloud proficiency in Azure (preferred), AWS , or GCP .

    ✅ Experience in CI / CD pipeline automation for Databricks deployments.

    ✅ Familiarity with orchestration tools ( ADF, Airflow, Databricks Workflows ).

    ✅ Strong grasp of data governance, metadata management, and lineage .

    ✅ Excellent communication and stakeholder management skills.

    💡 Preferred Qualifications (Bonus Points)

    ⭐ Experience in healthcare data systems or regulated data environments.

    ⭐ Knowledge of SQL Server, Synapse, or Power BI integration.

    ⭐ Exposure to event-driven architecture (Kafka, Redpanda) .

    ⭐ Azure certifications (e.g., DP-203 , Databricks Certified Data Engineer Associate / Professional ).

    🎯 Why Join Us

    🌱 Work on cutting-edge Azure & Databricks projects in the healthcare domain.

    🤝 Collaborative, innovation-driven work culture.

    🚀 Opportunity to grow in a fast-scaling data engineering practice .

    🏆 Competitive compensation and long-term career opportunities.

    📨 Ready to make an impact?

    Apply now or DM us if you’re a Pune-based data enthusiast ready for your next big challenge!

    📩 How to Apply :

    Send your resume to 👉 swapnil.supe@newscapeconsulting.com

    📌 Subject Line : Application – Azure Databricks Developer

    📞 +91 8233829595

    Create a job alert for this search

    Senior Engineer Azure • Prayagraj(Allahabad), IN

    Related jobs
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Prayagraj(Allahabad), IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGPrayagraj(Allahabad), IN
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    FinastraPrayagraj(Allahabad), IN
    Finastra’s Global Data Office is responsible for the strategy, governance, and enablement of data assets across 130+ countries globally to unlock innovation for our business units and 8000+ custome...Show moreLast updated: 5 hours ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Black Dog LabsPrayagraj(Allahabad), IN
    Remote (collaboration across time zones), India or LATAM preferred.Proficient English communication.Data Engineering / Backend Engineering / DevOps. We’re looking for a hands-on Senior Data Platform...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    SystemBenderPrayagraj(Allahabad), IN
    Advance SQL Azure Data Factory (ADF) Databricks with PySpark Azure Synapse (added advantage).Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and know...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Azure Data Engineer

    Azure Data Engineer

    Techmax TechnologiesPrayagraj(Allahabad), IN
    At Techmax Technologies, we’re transforming the automotive industry through cutting-edge data analytics, customer experience innovations, and digital solutions. Since 2020, we’ve partnered with deal...Show moreLast updated: 5 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Live ConnectionsPrayagraj(Allahabad), IN
    Databricks Engineer, Azure Databricks, SQL, Pyspark.Databricks Engineer, Azure Databricks, SQL.Job Title : Senior Data Engineer. Design, build, and maintain scalable data pipelines and ETL processes....Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Azure data engineer

    Azure data engineer

    StratusPrayagraj(Allahabad), IN
    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks. Experience with Agile development methodologies and tools, such as Jira, t...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    GCP Senior Data Engineers

    GCP Senior Data Engineers

    Tata Consultancy ServicesPrayagraj(Allahabad), IN
    TCS presents an excellent Opportunity For "GCP Senior Data Engineers" Role.Chennai, Kochi, Bangalore, Hyderabad, Pune, Kolkata, Delhi & Bhubaneswar. Data Integration, orchestration mechanism, abilit...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    AWS Data Governance Engineer

    AWS Data Governance Engineer

    Atomic NorthPrayagraj(Allahabad), IN
    Hiring : AWS Data Governance Engineer.Bengaluru, Bhopal, Gurgaon, Hyderabad, Jaipur, Mumbai, Pune , Chennai.We are looking for an experienced. This role ensures data integrity, security, and complian...Show moreLast updated: 5 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Futran SolutionsPrayagraj(Allahabad), IN
    We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record of designing, imp...Show moreLast updated: 17 days ago
    • Promoted
    • New!
    Cloud Lead Engineer- Azure

    Cloud Lead Engineer- Azure

    DailoqaPrayagraj(Allahabad), IN
    AI solutions, ensuring scalable, secure, and efficient deployment across infrastructure.You will work closely with data scientists, ML engineers, and business stakeholders to build and maintain rob...Show moreLast updated: 5 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IntelliasPrayagraj(Allahabad), IN
    Apache Flink / Apache Spark (Streaming).Data Engineer or similar role, with hands-on expertise in large-scale, production-grade data pipelines. Kafka + Flink / Spark Streaming).Python for data engin...Show moreLast updated: 6 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy ServicesPrayagraj(Allahabad), IN
    Job Title : Azure Data Engineer With Databricks.Required Skillset : Azure Databricks, SQL, Python, Spark.Location : HYD, Chennai, BLR, Noida, Pune, Kolkata. Design, develop, and deploy data processing ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Databricks

    Azure Databricks

    Tata Consultancy ServicesPrayagraj(Allahabad), IN
    TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of ...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Databricks+Pyspark

    Azure Databricks+Pyspark

    Tata Consultancy ServicesPrayagraj(Allahabad), IN
    TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad. Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show moreLast updated: 6 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPrayagraj(Allahabad), IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Databricks + Mongo DB ( Full-time at a Fortune 500 tech MNC )

    AWS Databricks + Mongo DB ( Full-time at a Fortune 500 tech MNC )

    HARPPrayagraj(Allahabad), IN
    The ideal candidate will have strong hands-on experience in.Knowledge of DevOps practices and containerization tools is a plus. Develop and maintain scalable data pipelines for large-scale data proc...Show moreLast updated: 4 days ago