Senior Software Engineer - Data

Desired Characteristics

• Minimum 5-10 years of software engineering experience.
• Proven long term experience and enthusiasm for distributed data processing at scale, eagerness to learn new things.
• Expertise in designing and architecting distributed low latency and scalable solutions in either cloud and on-premises environment.
• Exposure to the whole software development lifecycle from inception to production and monitoring
• Fluency in Python or solid experience in Scala, Java
• Proficient with relational databases and Advanced SQL
• Expert in usage of services like Spark and Hive
• Experience with web frameworks such as Flask, Django
• Experience in adequate usage of any scheduler such as Apache Airflow, Apache Luigi, Chronos etc.
• Experience in Kafka or any other stream message processing solutions.
• Experience in adequate usage of cloud services (AWS) at scale
• Experience in agile software development processes
• Excellent interpersonal and communication skills

Nice To Have

• Experience with large scale / multi-tenant distributed systems
• Experience with columnar / NoSQL databases – Vertica, Snowflake, HBase, Scylla, Couchbase
• Experience in real team streaming frameworks – Flink, Storm
• Experience in open table formats such as Iceberg, Hudi or Deltalake

Skills Required
Flask, Py Spark, Sql, Apache Airflow, Django