Senior Data Engineer

ConfidentialBhubaneswar

30+ days ago

Job description

We are actively seeking a highly skilled and experienced Senior Data Engineer to join our client's team through Acme Services . This pivotal role requires extensive expertise in Big Data and Snowflake , particularly with data migration from on-prem to cloud or from other traditional databases . The ideal candidate will possess a deep understanding of Snowflake's advanced features, including resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero-copy clone, and time travel . You will be adept at building Proof of Concepts, analyzing large historical datasets, and optimizing data models for performance. Strong proficiency in RDBMS, complex SQL, PL / SQL, and Python is essential.

Key Responsibilities

Snowflake & Big Data Migration : Lead and execute data migration from on-premise or traditional databases to Snowflake within a Big Data environment, addressing challenges related to scalability, data storage formats, concurrency requests, and streaming data ingestion .
Proof of Concept Development : Demonstrate the ability to build quick Proof of Concepts (POCs) as per evolving requirements, validating technical feasibility and business value.
Data Lake & Data Management : Conduct comprehensive analysis on large amounts of historical data , determining its suitability for Data Lake and Delta Lake setup . This includes expertise in data clean-up, data management, filtering, and efficient loading into Snowflake .
Data Model Experimentation & Optimization : Conduct experiments with different types of data models , meticulously analyzing performance to identify and implement the most effective approaches.
Advanced Snowflake Utilization : Leverage expertise in Snowflake advanced concepts by effectively setting up resource monitors, RBAC controls, virtual warehouse sizing, performing query performance tuning, utilizing zero-copy clone, and time travel features .
Database & Scripting Proficiency : Apply strong proficiency in RDBMS, complex SQL, PL / SQL, and Python for data manipulation, scripting, and pipeline development.

Skills

Must have experience in Big Data and Snowflake .

Proven experience with Snowflake data migration (from on-prem to cloud or traditional DBs).

Expertise in scalability, data storage formats, concurrency requests, and streaming data ingestion .

Ability to build quick Proof of Concepts .

Strong analytical skills for large amounts of historical data , including suitability for Data Lake, Delta Lake setup, data clean-up, data management, and filtering .

Experience in conducting experiments with different types of data models and analyzing performance.

Expertise in Snowflake advanced concepts (resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero-copy clone, time travel).

Strong Proficiency in RDBMS, complex SQL, PL / SQL, and Python .

Qualifications

Proven experience as a Data Engineer with a focus on Big Data and Cloud Data Warehousing, specifically Snowflake.

Demonstrable track record of leading data migration projects and optimizing data solutions.

Strong problem-solving abilities and a deep understanding of data architecture best practices.

Skills Required

snowflake , Big Data, Rdbms, Sql, Pl / sql, Python Programming

Create a job alert for this search

Senior Data Engineer • Bhubaneswar