Architect, configure, and optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment.
Set up and manage Azure infrastructure components including Databricks Workspaces, Azure Containers (AKS / ACI), Storage Accounts, and Networking.
Design and implement a monitoring and observability framework using tools like Azure Monitor, Log Analytics, and Prometheus / Grafana.
Collaborate with platform and data engineering teams to enable microservices-based architecture for scalable and modular data solutions.
Drive automation and CI / CD practices using Terraform, ARM templates, and GitHub Actions / Azure DevOps.
Required Skills & Experience :
Strong hands-on experience with Azure Databricks, Delta Lake, and Apache Spark.
Deep understanding of Azure services : Resource Manager, AKS, ACR, Key Vault, and Networking.
Proven experience in microservices architecture and container orchestration.
Expertise in infrastructure-as-code, scripting (Python, Bash), and DevOps tooling.
Familiarity with data governance, security, and cost optimization in cloud environments.
Bonus :
Experience with event-driven architectures (Kafka / Event Grid).
Knowledge of data mesh principles and distributed data ownership.
(ref : hirist.tech)
Create a job alert for this search
Azure Data Engineer • Delhi, IN
Related jobs
Promoted
Lead Data Engineer
Eucloid Data SolutionsDelhi, IN
Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
Promoted
Senior Data Engineer
EXLDelhi, IN
We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 25 days ago
Promoted
New!
Data Engineering Azure databricks
EXLDelhi, IN
Data Engineer (DE) Consultant is responsible for designing, developing, and maintaining data assets and data related products by liaising with multiple stakeholders.
Work with stakeholders to unders...Show moreLast updated: less than 1 hour ago
Promoted
Data Engineer
EveriseDelhi, IN
Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 6 days ago
Promoted
Senior Data Engineer
SAIVA AIDelhi, IN
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 7 days ago
Promoted
Lead Azure Data Engineer
RandomTreesGhaziabad, IN
We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.
If you're passionate about building r...Show moreLast updated: 25 days ago
Promoted
Data Engineer
Kumaran SystemsDelhi, IN
Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
Promoted
Data Engineer
Insight GlobalDelhi, IN
Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume.
Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
IntraEdgeDelhi, IN
Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Manuh TechnologiesDelhi, IN
Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing.
Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
Promoted
Senior Data Engineer
DeltacubesDelhi, IN
Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
Promoted
Senior Data Engineer
DexianDelhi, IN
We seek a Senior Data Engineer colleague to join our world-class client, one of the.Employment / Contract Type : Contract.
Duration : 1 year (with potential to be extended).Hours per Week : 40 (Full-time...Show moreLast updated: 25 days ago
Promoted
Data Engineer
Otomeyt AIDelhi, IN
We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Bahwan CyberTekDelhi, IN
Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
Promoted
Senior Data Engineer
InfogainDelhi, IN
Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers.
You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Innodata Inc.Ghaziabad, IN
CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
Promoted
Data Engineer
HISH IT SERVICESDelhi, IN
Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 6 days ago
Promoted
New!
Data Engineer
Kline + CompanyDelhi, IN
Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: less than 1 hour ago
Promoted
Senior Data Engineer
Otomeyt AIDelhi, IN
We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 17 days ago
Promoted
Data Engineer
AceolutionDelhi, IN
We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 7 days ago