Data Engineering Tech Lead

Key performance indicators :

• Achieve high level of quality and timeliness of delivering preclinical pipeline deliverables as assessed by the Preclinical pipeline lead
• Ensure that technical documentation and pipeline management are aligned with standards and effectively maintained
• Collaboration with other data42 product teams and product technical leads
• Ability and effectiveness in training, mentoring and coordinating internal and external analysts assigned to the same project as assessed by the functional / operational manager.

Job Dimensions :

The role involves close collaboration with the Preclinical pipeline lead to define the roadmap and delivery plans. Work with the team to ensure timely execution of deliverables, maintain technical documentation, and manage release communications to end users.

Minimum Requirements :

Education : Bachelor s / Masters degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field; equivalent of the same in working experience may also be accepted

Work Experience :

• 8+ years IT experience, with 6+ years in Data Engineering on Big Data platforms.
• Ability to work and lead cross-functional team in a matrix organization. Led and mentored technical teams for 2+ years.
• Must have experience managing pipeline development activities, with strong project management skills.
• Strong communication skills with the ability to effectively collaborate with cross functional teams and stakeholders.
• Proficient in working with Git workflow for project execution; a strong understanding of DevOps (CI / CD framework) is essential.
• Had actively participated in agile work practices and coordinated with team members to ensure smooth project execution.
• Expertise in Python, PySpark and Spark.
• Hands-on experience with JIRA and Confluence for technical documentation. Responsible for technical documentation, audit readiness, and release management.
• Strong Analytical thinking and problem-solving skills.
• Expertise on Palantir Foundry Platform using Code Repository, Code Workbook, Data Connection, etc. components to develop data pipelines.
• Strong knowledge of AI / ML concepts with hands-on experience.
• Knowledge of preclinical in-vivo study data e.g. CDSIC SEND standard will be desirable.

Skills Required

Devops, Project Management, Communication, Python, pipeline development