Principal Engineer, Data Platform

What you will be doing

• Building next generation data pipelines to provide near real-time ingestion of security insights and intelligence data
• Architecting highly scalable data pipelines and solve real-time stream processing challenges at scale
• Partnering with industry experts in security and big data, product and engineering teams to conceptualize, design and build innovative solutions for hard problems on behalf of our customers.
• Evaluating open source technologies to find the best fit for our needs and also contributing to some of them!
• Helping other teams architect their systems on top of the data platform and influencing their system design.
• This is a great opportunity to work with smart people in a fun and collaborative environment.

Required skills and experience

• 15+ years of industry experience building highly scalable distributed Data systems
• Programming experience in Python, Java or Golang
• Excellent data structure and algorithm skills
• Proven good development practices like automated testing, measuring code coverage.
• Experience building real-time stream processing systems using engines like Flink, Spark or similar
• Experience with distributed datastores like Druid, Mongo, Cassandra, BigQuery or similar
• Excellent written and verbal communication skills
• Bonus points for contributions to the open source community

Education

• BSCS or equivalent required, MSCS or equivalent strongly preferred

Skills Required

Cloud Computing, Cloud Security, Cassandra, Data Security, Python