Highly Experienced Data Infrastructure Developer

Job Overview :

We are seeking a highly skilled Data Platform Engineer to join our organization. The ideal candidate will be responsible for building additional platform capabilities, optimizing, and maintaining robust data pipelines and platforms that empower data-driven decision-making across the organization.

Key Responsibilities :

• Collaborate with stakeholders during requirements clarification and sprint planning sessions to ensure alignment with business objectives.
• Design and implement technical solutions, including ETL pipelines, leveraging PySpark to extract, transform, and load data efficiently.
• Build solutions to integrate the two main data platforms.
• Integrate the data platforms with other platforms, incident & monitoring tools, identity management, data observability.
• Optimize existing ETL processes for improved performance, scalability, and reliability.
• Develop and maintain unit and integration tests to ensure quality and resilience.
• Provide support to QA teammates during the acceptance process.
• Resolve production incidents as a third-line engineer, ensuring system stability and uptime.

Required Skills and Qualifications :

Technical Expertise :