This job offer is not available in your country.

Data Engineer - ETL / Data Pipeline

Anlage Infotech (India) Pvt LtdMumbai

30+ days ago

Job description

Job Description : Location : Mumbai

Experience : 5 to 10 years

Role and Responsibilities :

Design and implement scalable data pipelines for ingesting, transforming, and loading data from various tools and sources.
Design data models to support data analysis and reporting.
Automate data engineering tasks using scripting languages and tools.
Collaborate with engineers, process managers, data scientists to understand their needs and design solutions.
Act as a bridge between the engineering and the business team in all areas related to Data.
Automate monitoring and alerting mechanism on data pipelines, products and Dashboards and troubleshoot any issues. On call requirements.
SQL creation and optimization - including modularization and optimization which might need views, table creation in the sources etc.
Defining best practices for data validation and automating as much as possible; aligning with the enterprise standards.
QA environment data management - e.g Test Data Management etc.

Qualifications :

3+ years of experience as a Data engineer or related role.

Experience with Agile engineering practices.

Strong experience in writing queries for RDBMS, cloud-based data warehousing solutions like Snowflake and Redshift.

Experience with SQL and NoSQL databases.

Ability to work independently or as part of a team.

Experience with cloud platforms, preferably AWS.

Strong experience with data warehousing and data lake technologies (Snowflake)

Expertise in data modelling.

Experience with ETL / LT tools and methodologies.

5+ years of experience in application development including Python, SQL, Scala, or Java.

Experience working on real-time Data Streaming and Data Streaming platform.

ref : hirist.tech)

Data Engineer • Mumbai