This job offer is not available in your country.

Big Data Engineer (Spark, SparkSQL)

Anicalls (Pty) Ltdhyderabad, India

6 hours ago

Job description

2 to 5 years hands-on Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform

Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume)

Should be able to understand the complex transformation logic and translate them to Spark-SQL queries.

Unix Shell Scripting and setting up CRON

Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)

Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller).

Prior Experience in Consumer Banking Domain is an advantage.

Prior Experience in the agile delivery method is an advantage.

Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions

Core Java skillset is an added advantage. Airflow is an added advantage.

Good Knowledge and Experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus.

Big Data Engineer • hyderabad, India