Distributed Data Platform Engineer

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role :

The Senior Distributed Systems Engineer position focuses on working with distributed systems technologies including Apache Ozone, Apache Spark, and Apache Kafka to build enterprise-grade platforms designed for massive scale. This role involves architecting and implementing resilient solutions for distributed data processing, storage, and messaging systems that handle petabytes of data across thousands of nodes while contributing to open-source communities.

Key responsibilities :

• Designing and implementing core features for distributed systems including Apache Ozone, Apache Spark, and Apache Kafka.
• Contributing code and design documentation to Apache open-source communities.
• Supporting enterprise customers running large-scale big data analytics and ML / AI pipelines.
• Partnering with engineering leadership, product managers, and cross-functional groups to understand requirements and turning them into solid design and implementation.
• Architecting resilient and scalable solutions for distributed data processing at massive scale.
• Developing advanced monitoring, debugging, and performance analysis tools for large-scale distributed systems.
• Providing technical leadership for development of streaming messaging products and related technologies.
• Leading and mentoring talented groups of engineers working on distributed systems features.

Requirements :

OR Master's degree with4+ years of experience.

Additional skills preferred :

What to expect from us :

If you are interested in being part of a team composed of the best professionals and working 100% goal-oriented in an innovative environment, do not hesitate to apply!