Primary Roles and Responsibilities :
- Good expertise in SQL,Snowflake.
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW / BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussions with client architect and team members
- Orchestrate the data pipelines in the scheduler via Airflow
Skills and Qualifications :
Bachelor's and / or masters degree in computer science or equivalent experience.Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse / ETL projects.Expertise in Snowflake security, Snowflake SQL and designing / implementing other Snowflake objects.Hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight and Snowflake connectors.Deep understanding of Star and Snowflake dimensional modeling.Strong knowledge of Data Management principlesGood understanding of Databricks Data & AI platform and Databricks Delta Lake ArchitectureShould have hands-on experience in SQL and Spark (PySpark)Experience in building ETL / data warehouse transformation processesExperience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)Experience working with structured and unstructured data including imaging & geospatial data.Experience working in a Dev / Ops environment with tools such as Terraform, CircleCI, GIT.Proficiency in RDBMS, complex SQL, PL / SQL, Unix Shell Scripting, performance tuning, troubleshooting and Query Optimization.Databricks Certified Data Engineer Associate / Professional Certification (Desirable).Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projectsShould have experience working in Agile methodologyStrong verbal and written communication skills.Strong analytical and problem-solving skills with a high attention to detail.ref : hirist.tech)