We are seeking a highly skilled and experienced Lead Data Engineer to join our team.
The ideal candidate will be a hands-on expert in Microsoft Fabric and the broader Azure data stack, with a proven track record of designing, building, and managing robust data pipelines and analytics solutions.
This role requires a strong leader who can architect scalable data platforms and guide a team to deliver high-quality data products.
Key Responsibilities :
- Lead the design, development, and maintenance of scalable and reliable data pipelines using Microsoft Fabric and Azure Data Factory (ADF).
- Architect and manage a modern data platform, including data ingestion, transformation, and storage within a Data Lake and Lakehouse environment.
- Collaborate with data scientists, business analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Ensure data quality, integrity, and security across the data platform.
- Develop and implement strategies for data governance and compliance.
- Optimize data processing jobs and data storage for performance and cost efficiency.
- Mentor junior data engineers, providing technical guidance and fostering a culture of best practices.
- Create and maintain comprehensive documentation for data pipelines and system architecture.
Technical Skills : Mandatory Skills :
Microsoft Fabric : 6 months to 2 years of hands-on, practical experience is highly mandatory.Azure Stack :
Expertise with Azure Data Factory (ADF) for ETL / ELT processes.Strong experience with Azure Data Lake Storage and its integration with other services.In-depth knowledge of Azure Lakehouse architecture and implementation.Proficiency with Power BI for data visualization and reporting.Additional Skills :
Strong programming skills in languages such as Python or Scala.Experience with other Azure services like Azure Databricks, Synapse Analytics, or Azure Functions.Knowledge of SQL and experience with various database systems (e.g., SQL Server, PostgreSQL, Cosmos DB).Familiarity with version control systems, especially Git.Understanding of data modeling, data warehousing, and distributed computing concepts.Experience and Education :
Experience : A minimum of 8+ years of total experience in a data engineering role.
Education : Bachelor's degree in Computer Science, Information Technology, or a related field
(ref : hirist.tech)