Your Role and Impact
We are seeking a highly skilled Senior Consultant - Data Engineer with expertise in Azure Data Factory (ADF), Databricks, and Azure Cloud to design, build, and optimize scalable data solutions. The ideal candidate will have hands-on experience in implementing modern data pipelines, ETL / ELT processes, and data integration strategies to support analytics and business intelligence initiatives.
Your Contribution
Data Engineering & Architecture
- Design, develop, and deploy high-performance data pipelines using Azure Data Factory (ADF), Databricks, and PySpark / Scala.
- Implement batch and real-time data processing solutions on Azure Synapse, Delta Lake, and Azure SQL DB.
- Optimize Spark jobs for performance tuning, partitioning, and cost efficiency in Databricks.
- Architect medallion (bronze, silver, gold) data lakehouse frameworks for structured and unstructured data.
- Develop data ingestion, transformation, and orchestration workflows using ADF, Databricks Notebooks, and Azure Functions.
Collaboration & Leadership
Work closely with data scientists, analysts, and business stakeholders to deliver scalable data solutions.Mentor junior engineers and provide technical guidance on best practices.Lead proof-of-concepts (POCs) and evaluate new data technologies.Document architecture, data flows, and best practices for knowledge sharing.Show more
Show less
Skills Required
Azure Synapse, Azure Functions, Azure Cloud, Pyspark, Scala, Databricks