This job offer is not available in your country.

Azure Data Engineer

LiveconnectionChennai

13 days ago

Job description

Primary skills :

Strong in Azure and ADF, Azure Data brick or Fabrics & Data pipeline
Relevant 3 yrs of experience in Azure Data Brick.

JD : Role Overview :

We are looking for an experienced Data Engineer to join our Azure Data Platform team. The ideal candidate will have a deep understanding of Azure's data engineering and cloud technology stack. This role is pivotal in driving data-driven decision-making, operational analytics, and advanced manufacturing intelligence initiatives.

Key Responsibilities :

Lead the design and implementation of data architectures that support operational analytics and advanced manufacturing intelligence, ensuring scalability and flexibility to handle increasing data volumes.

Design, implement, and maintain scalable data and analytics platforms using Microsoft Azure services, such as Azure Data Factory (ADF), Azure Data Lake Storage Gen2, and Azure Synapse Analytics.

Develop and manage ETL processes, data pipelines, and batch jobs to ensure efficient data flow and transformation, optimizing pipeline runs and monitoring compute and storage usage.

Implement metadata management solutions to ensure data quality and governance, leading to consistent data quality and integrity.

Integrate data from key sources such as SAP, SQL Server, and cloud databases, IoT and other live streaming data into centralized data structures to support analytics and decision-making.

Provide expertise on data ingestion (SAP, SQL), data transformation, and the automation of data pipelines in a manufacturing context.

Ensure the data platform supports dashboarding and advanced analytics, enabling business users to independently create and evolve dashboards.

Implement manufacturing-specific analytics solutions, including leadership and operational dashboards, and other analytics solutions across our value chain leveraging Azure's comprehensive toolset.

Define and monitor KPIs, ensuring data quality and the accuracy of insights delivered to business stakeholders.

Identify and manage project risks related to data security, system integration, and scalability.

Independently maintain the data platform, ensuring its reliability and performance, and implementing best practices for data security and compliance.

Advise the Data Platform project manager and leadership team on best practices for data management and scaling needs, providing guidance on integrating data from IoT and other SaaS platforms, as well as newer systems as they come into the digital landscape.

Work closely with data scientists to ensure data is available in the required format for their analyses and collaborate with Power BI developers to support dashboarding and reporting needs.

Create data marts for business users to facilitate self-service analytics.

Mentor and train junior engineers, fostering their professional growth and development, and providing guidance and support on best practices and technical challenges.

Qualifications & Experience :

Education :

Bachelor's degree in Engineering, Computer Science, or a related field.

Experience :

8-10 years of experience, with a minimum of 5 years working on core data engineering responsibilities on a cloud platform. Project Management experience is a big plus.

Proven track record of implementing data-driven solutions in areas such as plant automation, operational analytics, quality control, supply chain optimization.

Technical Proficiency :

Expertise in cloud-based data platforms, particularly within the Azure ecosystem (Azure Data Factory, Synapse Analytics, Databricks).

Familiarity with SAP as a data source.

Proficiency in programming languages such as SQL, Python, and R for analytics and reporting.

Soft Skills :

Strong analytical mindset with the ability to translate manufacturing challenges into data-driven insights and solutions.

Excellent communication and organizational skills.

ref : hirist.tech)

Create a job alert for this search

Azure Data Engineer • Chennai