Azure Senior Data Engineer

As an Azure Data Engineer, you will be responsible for designing, building, and maintaining data pipelines to support business and analytics needs. You will work closely with data analysts and business stakeholders to understand their needs and develop solutions to meet those needs.

• 6+ Years of Experience in Azure with Data Engineering.
• 4+ Hands on experience in Azure technologies such as Azure Data Factory, Azure Databricks and Azure Synapse Analytics, Azure Data Lake
• Design, develop, manage data flows that integrate information from various sources into a common data lake using Microsoft Azure data Factory.
• Extract, transform and load data from variety of sources, including on-premises databases, cloud-based data stores and API calls.
• 6+ years of working with SQL, implement data processing and transformation logic using SQL, handling complex windowing functions and joins.
• Optimize and tune data pipelines for performance, scalability, and cost-efficiency, leveraging best practices and automation tools.
• Ensure data quality, integrity, and security throughout the data lifecycle, implementing data governance policies and compliance standards.
• Collaborate with data analysts and business stakeholders to understand their data needs and develop data models and solutions to meet those needs.
• Monitor and troubleshoot data pipelines, identifying and resolving issues in a timely manner to minimize impact on business operations.

Competencies & Experience Required / Desired

To summarize :  Experience working on ETL, Microsoft Azure SQL Data Warehouse, SQL Scripting, with exposure to other services on the Azure landscape, API Data Extraction

Motivational / Cultural Fit

As a data engineer, must be driven by the challenge of turning raw data into valuable insights. With expertise in optimizing data pipelines and a passion for innovation, must be committed to powering informed decisions, and driving success for the organization

Skills Required

Api, Sql, Etl