Talent.com
This job offer is not available in your country.
Senior Data Analyst - Apache Spark

Senior Data Analyst - Apache Spark

Ivy comptechHyderabad
30+ days ago
Job type
  • Permanent
Job description

About The Role

As Senior Data Analyst will contribute to various phases and activities of the software development process or software testing. Candidate must be willing to work in a fast-paced, multi-tasking, team environment, the engineer works with tech Lead, software engineers, internal partners, and stakeholders.

Key Responsibilities :  Strong understanding on Apache Druid and Apache Hadoop Architecture.

Ability to learn new tools, languages and operating systems.

Firm understanding of database systems - data modelling, SQL and transactional processing.

Hands-on experience with Kafka for batch and streaming data ingestion to pull data from different RDBMS sources into the HDFS

Preferred experience in Spark / Druid Stream processing.

Experience in writing SQL queries.

Experience in working with relational databases and integrating with Hadoop infrastructure.

  • Skills Required :  3 to 5~ years of strong hands on real time big data development experience in Hadoop, Hive, Kafka, Druid.

Experience in managing and setting up Production scale  Druid and Hadoop clusters  with HA.

Experience in working with relational databases and integrating with Hadoop infrastructure.

Good understanding in Data Modeling and SQL.

Hands-on experience with Sqoop / Kafka for batch and streaming data ingestion to pull data from different RDBMS sources into the HDFS.

Preferred experience in Druid Stream processing.

Hands on experience with Distributed messaging system Apache Kafka.

Explore various big data technologies to design new product architectures and POC's for same.

  • Experience with data systems, analytics(Apache Hadoop, Spark,Hive), streaming (Apache Flink, Spark, Kafka) distributed query engines and databases(Apache Druid).
  • Primary Skills :
  • Hadoop, Druid, Kafka, SQL

    Qualifications : Any Graduate

    Location Hyderabad, India

    Additional Information Not Specified