Data Engineer

Responsibilities : Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services

End to end development lifecycle of complex large-scale and multi-user applications

Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios

Big Data ETL considering enterprise data management for data lakes and data warehouses

Data Orchestration -Data Transformation and Data integration using MS Azure services

Develop batch processing, streaming and integration solutions

Automate Azure Data Factory pipelines

Manage and enforce data policies and standards

Monitor databases and data processing for a specified scenario

Implement big data real-time processing and integration solutions

Manage Azure DevOps pipelines

Basic Qualifications :

Education : B.E. / M.Sc. / M.E. / M. Tech.

Minimum 2 Years in Azure Data Engineering

Knowledge & Skills :

Very strong @ SQL-PL SQL-Spark SQL Scala PySpark

Interaction with No SQL Databases

Interaction with Event Hub, IoT Hub Databases

Files Processing – XML, CSV, Excel, Jason, etc. Formats

Structured and Non-Structured Data processing

Data ETL Capabilities

Knowledge of Distributed Big Data Processing

Data Warehouse and Data Lake Implementation experience in past

Interaction with REST APIs , Web Services

Required Competencies :

Customer Focus

Good verbal & written English communication

Ability to work with globally diverse teams

Readiness to work in flexible work timings

Abstract & Analytical Thinking

An interpersonal savvy. A very good team player

Nimble learning. Willingness to explore and adapt

Certifications :

MS Azure Data Engineer (MS Certified) is preferred