Senior Cloud Data Fusion

Migration from DataStage to Cloud Data Fusion

Design

data ingestion, transformation, and loading logic

using Cloud Data Fusion pipelines.

Document the

technical design

(data flow diagrams, field-level mappings, dependencies).

Build

batch and streaming pipelines

in Cloud Data Fusion using the

Visual Studio (Wrangler, Joiner, GroupBy, Aggregator, etc.)

or the

code-driven approach

(Python / Java plugins).

Develop

reusable pipelines and templates

for recurring ETL patterns.

Perform

data profiling and anomaly detection

to identify data inconsistencies.

Develop

validation rules

and checks within the pipelines (row counts, checksum, null handling).

Compare results between source and target (output from DataStage).