Senior Cloud Data Fusion

Migration from DataStage to Cloud Data Fusion

Design data ingestion, transformation, and loading logic using Cloud Data Fusion pipelines.

Document the technical design (data flow diagrams, field-level mappings, dependencies).

Build batch and streaming pipelines in Cloud Data Fusion using the Visual Studio (Wrangler, Joiner, GroupBy, Aggregator, etc.) or the code-driven approach (Python / Java plugins).

Develop reusable pipelines and templates for recurring ETL patterns.

Perform data profiling and anomaly detection to identify data inconsistencies.

Develop validation rules and checks within the pipelines (row counts, checksum, null handling).

Compare results between source and target (output from DataStage).