Talent.com
This job offer is not available in your country.
Data Engineer - ETL / Data Pipeline

Data Engineer - ETL / Data Pipeline

Anlage Infotech (India) Pvt LtdMumbai
26 days ago
Job description

Job Description : Location : Mumbai

Experience : 5 to 10 years

Role and Responsibilities :

  • Design and implement scalable data pipelines for ingesting, transforming, and loading data from various tools and sources.
  • Design data models to support data analysis and reporting.
  • Automate data engineering tasks using scripting languages and tools.
  • Collaborate with engineers, process managers, data scientists to understand their needs and design solutions.
  • Act as a bridge between the engineering and the business team in all areas related to Data.
  • Automate monitoring and alerting mechanism on data pipelines, products and Dashboards and troubleshoot any issues. On call requirements.
  • SQL creation and optimization - including modularization and optimization which might need views, table creation in the sources etc.
  • Defining best practices for data validation and automating as much as possible; aligning with the enterprise standards.
  • QA environment data management - e.g Test Data Management etc.

Qualifications :

  • 3+ years of experience as a Data engineer or related role.
  • Experience with Agile engineering practices.
  • Strong experience in writing queries for RDBMS, cloud-based data warehousing solutions like Snowflake and Redshift.
  • Experience with SQL and NoSQL databases.
  • Ability to work independently or as part of a team.
  • Experience with cloud platforms, preferably AWS.
  • Strong experience with data warehousing and data lake technologies (Snowflake)
  • Expertise in data modelling.
  • Experience with ETL / LT tools and methodologies.
  • 5+ years of experience in application development including Python, SQL, Scala, or Java.
  • Experience working on real-time Data Streaming and Data Streaming platform.
  • ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Mumbai