Azure Data Engineer

Role – Azure Data Engineer

Relevant Experience – 6 to 8 Years

Job Description – We are seeking a highly skilled and experienced Azure Data Engineer with expertise in Azure Data Platforms to join our dynamic and innovative technology team. As a Data Engineer, you will play a pivotal role in designing, developing, and implementing robust and scalable solutions using Azure Data Platforms, Data Lakes, Blob Storage, Power BI and Databricks.

You will collaborate with cross-functional teams, including software engineers, data scientists, and business stakeholders, to ensure the successful delivery of projects. The ideal candidate will have a deep understanding of Cloud Computing, Azure Data Services such as Data Lake Gen 2, Azure Storage (Blob Storage, File Storage and Disk Storage), Azure Key Vaults, Synapse Analytics, SQL & NO-SQL DBs (Azure SQL DB & Cosmos DB), Data Factory, Logic Apps, Azure Functions, Power BI, Databricks to drive business outcomes.

Desired Skills –

• Bachelor’s degree in computer science, Information Technology, or a related field. A master's degree is preferred.
• 6 to 8 years minimum working as a Data Engineer, preferably in a cloud-based environment, Microsoft Azure Preferred.
• Extensive hands-on development experience using Azure services, Power BI and Databricks Strong knowledge and experience with Data Engineering, data visualization platforms such as Power BI, Tableau.
• Proficient in writing Stored Procedures, Batch Jobs (know how knowledge of Unix Scripting), SQL, strong scripting knowledge in PL-SQL, T-SQL, complex transformations in any ETL / ELT in Data Warehousing systems. Vast knowledge of RDBMS databases such as Oracle, IBM DB2, MS SQL, MySQL etc. Data warehousing in cloud tools such as Azure Data Factory, Azure Databricks, Azure Synapse will be an added advantage.
• Strong experience in building data pipelines, Integration Runtimes, Linked Services, Mapping Data Flow, Triggers, monitoring Azure Services.
• Ability to connect to various data sources and bring data as well as documents into Azure Data Lake / Blob Storage.
• Must be able to do document cataloguing for a very large stack of documents, should be able to build the logic to implement document indices.
• In-depth hands-on experience in creating Data Models in Power BI, creation of Database Views, Setting up Data Sources in Power BI / Tableau (Live Connection, Direct Query and Extracts).
• Strong understanding of Power Pivot, Power Query, DAX functions, various filters such as Drill Down, Cross Drill, URL Filters, building custom visuals.
• Solid understanding of software development principles and experience working with modern software development methodologies (Agile, DevOps, CI / CD).
• Excellent problem-solving and analytical skills with a strong attention to detail.
• Effective communication skills, both written and verbal, with the ability to articulate complex technical concepts to non-technical stakeholders.

Certifications - In Azure Data Platform, Power BI and Databricks would be an added advantage