Senior Azure Databricks Engineer

Company Description

MLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.

Offices in US(ohio)

,Singapore

(PTE), Malaysia , India

and Australia(MEL)

Domain expertise : - FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial Transactions

Role Description

This is a full-time on-site role for a Senior Databricks Engineer located in Mumbai.

As a Data Engineer, you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure SQL DW and other Big Data related technologies). In addition to building the next generation of application data platforms (not infrastructure) and / or improving recent implementations. Note : This is a data engineer from the application side. Must be able to analyze data and develop strategies for populating data lakes. This is not an infrastructure position. This person may be called upon to do complex coding using U-SQL, Scala or Python and T-SQL.

Skills / Qualifications

Expertise in Any ETL tool i.e. (SSIS, Informatica, Data Stage)

Expertise to Implementing Data warehousing Solutions

experience as Data Engineer in Azure Big Data Environment

Programming experience in Scala or Python, SQL

Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)  Mandatory

Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW

Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale

Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment

Good Understanding of Modern Data Warehouse / Lambda Architecture, Data warehousing concepts

Proficient in a source code control system such as GIT

Knowledge of C#

Ability to code

Ability to use word to create required technical documentation

Soft Skills

Excellent written and verbal skills (English)

Flexible

Self-Starter

Team Player or individual contributor