Data Engineer

Job Description – ETL Migration Specialist (Informatica to Databricks)

Position Overview

We are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark). The ideal candidate will be responsible for analysing and reverse engineering existing Informatica mappings / workflows, understanding the business logic implemented, and refactoring these pipelines into scalable, efficient data processing workflows on Databricks.

This role requires strong analytical skills, hands-on experience in ETL development, and the ability to collaborate with both business and technical teams to ensure seamless migration.

________________________________________

Key Responsibilities

• Reverse Engineering : Analyze existing Informatica mappings, workflows, sessions, and variables to understand data flow, transformations, joins, filters, lookups, and aggregations.
• ETL Refactoring : Translate Informatica logic into PySpark / Databricks workflows, ensuring accuracy and performance.
• Data Modeling & Transformation : Design and implement transformation logic in Databricks aligned with business rules.
• Performance Optimization : Refactor ETL logic for scalability and performance tuning in Databricks.
• Documentation : Create detailed documentation for the converted pipelines, capturing both technical logic and business rules.
• Testing & Validation : Collaborate with QA / Business teams to validate data correctness between Informatica outputs and Databricks outputs.
• Best Practices : Ensure adherence to Databricks and cloud data engineering best practices, including modular coding, error handling, and reusability.
• Collaboration : Work with stakeholders, data architects, and business SMEs to clarify requirements and resolve discrepancies.

________________________________________

Must Have Informatica Expertise

o Mappings, Mapplets, Workflows, Worklets, Sessions

o Lookup, Joiner, Router, Aggregator, Expression, Sequence Generator, Filter, Stored Procedure, Update Strategy, etc.

o Mapping variables and parameters

o Workflow variables

o Session parameters

o Parameter files and variable scoping

________________________________________

Required Skills & Experience

________________________________________

Good to Have