MRF00997 - ADF - Data Engineer

MRF No

Overall

SPOC

Primary Skills

Secondary

MRF00997

Open

Shital

ADF

Job Description

Job Responsibilities

Knowledge Technical

Knowledge Competency

The resource would be responsible for understanding the domain, technical flow of the application and accomplish the tasks / new features under agile methodology. Also should be responsible for writing code using SSRS, SSIS and SQL required by the business

Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.

Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.

Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.

Improve the scalability, efficiency, and cost-effectiveness of data pipelines.

Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.

Experience with SSIS, SSRS and SQL Server (should be very strong on database area). Experience with Azure Data Factory, Azure SQL Data warehouse and Azure SQL Database

Knowledge in Visualization tool like Power BI Knowledge in Azure Storage like Blob and Data Lake Knowledge with Datawarehouse Concepts