GCP Data Engineer

We are actively hiring for Skilled GCP Data Engineers for a global banking client.

Years of experience : 4+ years (relevant)

Location : Bengaluru - Bellandur(Hybrid)

• Looking for immediate joiners

Responsibilities :

Onboard new data sources - negotiate, agree, define, and document effective IT data contracts with source data providers (security, formats, schemas, extraction and load schedules, SLAs, data validation rules, error scenarios, retry mechanisms and etc).

Design, build, test and deploy performant and effective Cloud data ingest pipelines (GCP DataFusion, Spark etc.) via API / SFTP / etc. into GCP Warehouse

Develop, test and deploy GCP Data Fusion custom plugins.

Build automated tests to validate ETL pipelines.

Handle incremental and full data loading strategies for structured and semi-structured data with medium-to-high volume, velocity, variety.

Perform data enrichment, standardization, cleanse, aggregation in DataFusion ensuring data integrity, consistency and compliance with Business and overall organizations standards, data governance and sovereignty.

Develop procedures and scripts for data migration, back-population, and feed-to-warehouse initialization.

Carrying Data Ops required activities ensuring pipelines health, performance and data in time delivery for the consumers.

Protect the solution data Masking and Lineage capabilities as needed.

Review and refine, interpret and implement business and technical requirements.

Interested? Please share your CV on akarlekar@teksystems.com.