Data Processing Principal Engineer

Lead architecture, design, and implementation of next-generation data processing engine built to exploit accelerated computing.

The developer will have the following specific responsibilities in achieving these objectives.

Responsibilities

• Work with cross-functional teams to advance the architecture at the core of Datapelago's parallel and distributed execution engine based on accelerated computing
• Lead the execution engine team in the design, implementation, and rollout of enterprise grade, highly reliable acceleration engine for data processing
• Design, implement, test, and maintain major components of the execution engine
• Analyze and identify areas for differentiation and improvements in the execution engine
• Collaborate with other teams and team members to drive code reviews, design reviews,

performance and reliability reviews, and development process and to drive continuous improvement in all of these

Qualifications

Skills Required

Rust, C, Linux, Apache Spark