Data Engineer

Data Engineer

• Responsibilities
• Design and build ETL pipelines for migration of party and relationship data
• Implement data transformations, mapping, and validation aligned with the enterprise data model
• Define data contracts and schemas; ensure CDC (change data capture) or dual-write consistency during phased cutover.
• Develop and optimize ingestion processes using APIs, streaming (Kafka), or batch frameworks to ensure performance and idempotency
• Collaborate closely with data architects and business analysts to align data pipelines with business logic.
• Execute data quality, reconciliation, and audit processes to ensure accuracy and regulatory compliance.
• Technical Skills
• Proficiency in MongoDB, SQL (Oracle / MySQL / PostgreSQL), and Python / Java / Scala.
• Experience with data migration, ETL tools (AWS Glue, Spark), and API-based integration
• Familiar with Kafka, Git, Jenkins / CICD, and JSON data modeling.
• Strong grasp of data lineage, data quality frameworks, and governance adherence.
• Experience :
• 4–7 years in data engineering, with at least 2+ years in MongoDB or NoSQL migrations in an enterprise context.
• Experience in migration or integration within banking customer systems (CRM / CDM / FCR).