Job Description : Location : Mumbai
Experience : 5 to 10 years
Role and Responsibilities :
- Design and implement scalable data pipelines for ingesting, transforming, and loading data from various tools and sources.
- Design data models to support data analysis and reporting.
- Automate data engineering tasks using scripting languages and tools.
- Collaborate with engineers, process managers, data scientists to understand their needs and design solutions.
- Act as a bridge between the engineering and the business team in all areas related to Data.
- Automate monitoring and alerting mechanism on data pipelines, products and Dashboards and troubleshoot any issues. On call requirements.
- SQL creation and optimization - including modularization and optimization which might need views, table creation in the sources etc.
- Defining best practices for data validation and automating as much as possible; aligning with the enterprise standards.
- QA environment data management - e.g Test Data Management etc.
Qualifications :
3+ years of experience as a Data engineer or related role.Experience with Agile engineering practices.Strong experience in writing queries for RDBMS, cloud-based data warehousing solutions like Snowflake and Redshift.Experience with SQL and NoSQL databases.Ability to work independently or as part of a team.Experience with cloud platforms, preferably AWS.Strong experience with data warehousing and data lake technologies (Snowflake)Expertise in data modelling.Experience with ETL / LT tools and methodologies.5+ years of experience in application development including Python, SQL, Scala, or Java.Experience working on real-time Data Streaming and Data Streaming platform.ref : hirist.tech)