Description : About the Role
We are seeking a highly skilled Senior ETL / Data Engineer with strong expertise in the Microsoft Data Platform to design, build, and optimize data pipelines and integration solutions.
The ideal candidate will have deep technical knowledge of SQL Server, SSIS, Azure Data Factory (ADF), Synapse, and Power BI integration, along with a solid understanding of data modeling, data governance, and performance tuning.
You will work closely with business analysts, data scientists, and application developers to ensure robust, secure, and scalable data solutions that support advanced analytics and reporting initiatives.
Key Responsibilities :
1. ETL Development & Data Integration :
- Design, develop, and maintain ETL processes using SQL Server Integration Services (SSIS) and / or Azure Data Factory (ADF).
- Build data ingestion and transformation pipelines for structured and unstructured data from multiple sources (databases, APIs, flat files, etc.
- Implement data extraction, cleansing, validation, and transformation logic to ensure high data quality.
- Develop incremental load and delta processing solutions for efficient data refreshes.
Data Modeling & Architecture :
Design and maintain data warehouse / data lake architectures following best practices (Kimball, Inmon, or Data Vault methodologies).Create and optimize star / snowflake schemas, fact / dimension tables, and metadata-driven architectures.Work with data architects to define data standards, governance, and documentation.Azure Data Engineering (Cloud-Focused) :
Develop and manage cloud-based data pipelines using Azure Synapse Analytics, ADF, Databricks, and Azure SQL Database.Utilize Azure Data Lake Storage (ADLS) for scalable and secure data storage.Implement CI / CD pipelines for data integration workflows using Azure DevOps.Ensure performance, scalability, and cost optimization in cloud environments.Performance Optimization & Monitoring :
Conduct performance tuning of SQL queries, ETL jobs, and data models.Monitor ETL processes for efficiency and reliability, implementing proactive alerting and logging.Troubleshoot and resolve data issues, ensuring data integrity and consistency across systems.Collaboration & Stakeholder Management :
Partner with business teams to understand data requirements and translate them into technical solutions.Collaborate with data analysts and Power BI developers to provide clean, curated data models for reporting.Document data flows, mappings, and operational procedures.Mentor junior data engineers and contribute to process improvement initiatives.Required Technical Skills :
SSIS, Azure Data Factory (ADF)Microsoft SQL Server, Azure SQL Database, Azure Synapse AnalyticsAdvanced SQL, T-SQL, and basic Python (for automation or data transformation)Star / Snowflake schemas, Kimball or Inmon methodologiesAzure Data Lake, Synapse, ADF, Databricks, Azure FunctionsAzure DevOps, GitSQL Server Agent, ADF triggers, or equivalent tools(ref : hirist.tech)