Job description
About The Role
- As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions / reports / dashboard..
- We are heavily dependent on BigQuery / Snowflake, Airflow, Stitch / Fivetran, dbt , Tableau / Looker for our business intelligence and embrace AWS with some GCP.
As a Data Engineer You'll Be
Developing end to end ETL / ELT Pipeline working with Data Analysts of business Function.Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architectureMentoring Fother Junior Engineers in the TeamBe a 'go-to' expert for data technologies and solutionsAbility to provide on the ground troubleshooting and diagnosis to architecture and design challengesTroubleshooting and resolving technical issues as they ariseLooking for ways of improving both what and how data pipelines are delivered by the departmentTranslating business requirements into technical requirements, such as entities that need to be modelled, DBT models that need to be build, timings, tests and reportsOwning the delivery of data models and reports end to endPerform exploratory data analysis in order to identify data quality issues early in the process and implement tests to ensure prevent them in the futureWorking with Data Analysts to ensure that all data feeds are optimised and available at the required times. This can include Change Capture, Change Data Control and other 'delta loading' approachesDiscovering, transforming, testing, deploying and documenting data sourcesApplying, help defining, and championing data warehouse governance : data quality, testing, coding best practices, and peer reviewBuilding Looker Dashboard for use cases if requiredWhat We Are Looking For
You have 4+ years of extensive development experience using snowflake or similar data warehouse technologyYou have working experience with dbt and other technologies of the modern data stack, such as Snowflake, Apache Airflow, Fivetran, AWS, git ,LookerYou have experience in agile processes, such as SCRUMYou have extensive experience in writing advanced SQL statements and performance tuning themYou have experience in Data Ingestion techniques using custom or SAAS tool like fivetranYou have experience in data modelling and can optimise existing / new data modelsYou have experience in data mining, data warehouse solutions, and ETL, and using databases in a business environment with large-scale, complex datasetsYou have experience architecting analytical databases (in Data Mesh architecture) is added advantageYou have experience working in agile cross-functional delivery teamYou have high development standards, especially for code quality, code reviews, unit testing, continuous integration and deploymentYou have strong technical documentation skills and the ability to be clear and precise with business usersYou have business-level of English and good communication skillsYou have basic understanding of various systems across the AWS platform ( Good to have )Preferably, you have worked in a digitally native company, ideally fintechExperience with python, governance tool (e.g. Atlan, Alation, Collibra) or data quality tool (e.g. Great Expectations, Monte Carlo, Soda) will be added advantageOur Tech Stack
DBTSnowflakeAirflowFivetranSQLLookerWhat You'll Get In Return
Make work, work for you! We are embracing new ways of working and support flexible working arrangements. With our Working Out of Office (WOO) policy our colleagues can work remotely from home or anywhere in their assigned Indian state. Additionally, you can work from a different country or Indian state for 90 days of the year. Plus, you'll get :Competitive salarySelf & Family Health InsuranceTerm & Life InsuranceOPD BenefitsMental wellbeing through PlummLearning & Development BudgetWFH Setup allowance15 days of Privilege leaves12 days of Casual leaves12 days of Sick leaves3 paid days off for volunteering or L&D activitiesStock OptionsTidean Ways Of Working
At Tide, we champion a flexible workplace model that supports both in-person and remote work to cater to the specific needs of our different teams.While remote work is supported, we believe in the power of face-to-face interactions to foster team spirit and collaboration. Our offices are designed as hubs for innovation and team-building, where we encourage regular in-person gatherings to foster a strong sense of community.Skills Required
dbt, Sql, Aws