Sr. Spark / Cassandra Developer

Candidate should be able to :

Analyze, design, program, debug, and modify software enhancements and / or new products used in local, networked, or Internet-related computer programs, primarily for end-users

Write code and complete programming by using current programming languages and technologies

Interact with users to define system requirements and / or necessary modifications

Complete documentation and procedures for installation and maintenance

Typically interact with high-level individual contributors, managers, and program core teams

Collaborate with peers, junior engineers, technicians, and external design partners

Effectively communicate product architectures, design proposals and negotiate options at management levels

Perform testing and debugging of applications

Evaluating forms and processes for software systems testing and methodology, including writing and execution of test plans, debugging, and testing scripts and tools.

Design and integrate software systems running on multiple platform types into the overall architecture.

Lead a project requiring software applications development

Candidate should have :

Extensive experience with multiple software systems design tools and languages.

Excellent written and verbal communication skills; mastery of English. Ability to effectively communicate product architectures, design proposals, and negotiate options.

Experience in the overall architecture of software systems for products and solutions.

Excellent analytical and problem-solving skills.

Expert skills in programming Spark RDDs joins and data frames

Understanding of Mesos-based Spark deployment

Solid grasp of Cassandra internals - read / write paths, indexes, tombstones

Experience with Spark / Cassandra connector, SBT

Typically 6-10 years experience.

Strong Scala programming skills, Akka, DSL design, concepts of functional programming in Scala

Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent

Cassandra administration skills - compaction, repairs, backup and restore

Cassandra data modeling, a solid understanding of consistency levels, partitioning

Cassandra performance monitoring and troubleshooting, JVM and garbage collection tuning