Cognite - Senior Data Platform Engineer

Job Description :

Function : Software Engineering Backend Development

SparkSpark Streaming

Cognite is revolutionising industrial data management through our flagship product, Cognite Data Fusion - a state-of-the-art SaaS platform that transforms how industrial companies leverage their data. We're seeking a Senior Data Platform Engineer who excels at building high-performance distributed systems and thrives in a fast-paced startup environment. You'll be working on cutting-edge data infrastructure challenges that directly impact how Fortune 500 industrial companies manage their most critical operational data.

Responsibilities :

• High-Performance Data Systems : Design and implement robust data processing pipelines using Apache Spark, Flink, and Kafka for terabyte-scale industrial datasets.
• Build efficient APIs and services that serve thousands of concurrent users with sub-second response times.
• Optimise data storage and retrieval patterns for time-series, sensor, and operational data.
• Implement advanced caching strategies using Redis and in-memory data structures.

Distributed Processing Excellence :

Technical Innovation :

Requirements :

Distributed Systems Experience (4-6 years) :

Data Platform Foundations (3+ years) :

Infrastructure and Operations :

Technical Depth Indicators :

(ref : hirist.tech)