Blue Cloud Softech - Senior Data Integration Engineer - Azure Data Factory

Job Summary :

We are seeking a highly motivated and customer-focused Senior Data Integration Engineer with up to 6 years of experience in modern data integration technologies.

The ideal candidate should have strong expertise in Azure Data Factory (ADF), Striim, and Microsoft Fabric, along with excellent ETL debugging and troubleshooting capabilities.

This role requires leading a small team of engineers while working closely with customer stakeholders to deliver high-quality data integration and analytics solutions.

Key Responsibilities :

- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).

- Develop and support real-time data integration solutions using Striim.

- Build and maintain data engineering solutions using Microsoft Fabric, including Data Factory, Lakehouse, Pipelines, and Warehouses.

- Perform root cause analysis and resolve complex ETL failures, data quality issues, and production incidents.

- Monitor, optimize, and troubleshoot data pipelines to ensure high availability and performance.

- Lead a team of 3 Data Engineers, providing technical guidance, mentoring, and code reviews.

- Participate in architecture discussions and recommend best practices for data integration and modernization.

- Collaborate with business users, architects, and customer stakeholders to understand requirements and deliver effective solutions.

- Drive incident resolution and support production environments with a focus on service excellence.

- Prepare technical documentation, solution designs, and operational runbooks.

- Ensure adherence to coding standards, governance, and security best practices.

Technical Skills :

- Data Integration : Azure Data Factory (ADF), Striim, Microsoft Fabric, ETL/ELT Development, Data Pipeline Design, Data Migration, Data Transformation.

- Technical Skills : ETL debugging, performance tuning, SQL, data validation, error handling, Azure Data Platform, REST API integrations.

- Leadership : Team management, task planning, mentoring, code reviews, Agile/Scrum.

Preferred Qualifications :

- Experience with Microsoft Azure cloud services.

- Knowledge of CI/CD pipelines for data engineering.

- Exposure to Data Warehousing and Lakehouse architectures.

- Experience with monitoring and observability tools.

- Microsoft Azure or Microsoft Fabric certifications are a plus.

Education :

- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

(ref:hirist.tech)