Big Data Engineer

Job Title : - Data Engineer - Pyspark

Experience : 5 to 8 Years

Location : Pune / Hyderabad

Job Description

Required Skills :

5+ years of experience in Big data and pyspark

Must-Have

Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL

Good-to-Have

Good Spark, Pyspark,Big Data experience

Spark UI / Optimization / debugging techniques

Good python scripting skills

Intermediate SQL exposure – Subquery, Joins, CTE’s

Database technologies

AWS EMR, S3, IAM, Lambda, SNS, SQS

Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL

Experience working on Data Engineering projects

Good Understanding of SQL

Good understanding of Unix and HDFS commands

Communication

Experience working on Data Analytics and Pyspark

Thanks & Regards ,

Manasi Prava Natha