Talent.com
This job offer is not available in your country.
Senior Data Engineer

Senior Data Engineer

DautomKolhapur, IN
4 days ago
Job description

Key Responsibilities :

  • Lead and manage a backend / distributed systems team and third-party resources
  • Build and optimize Java, MapReduce, Hive, and Spark jobs
  • Work with a wide range of Hadoop tools : HDFS, Pig, Hive, HBase, Sqoop, Flume
  • Implement and manage real-time stream processing using Spark Streaming, Storm
  • Develop dimensional data models and perform advanced SQL tuning
  • Analyze source data integrity and ensure accurate data ingestion
  • Build dashboards and BI solutions using best practices
  • Collaborate with internal teams and vendors to prioritize and deliver data initiatives
  • Deploy, monitor, and audit big data models and workflows

Technical Skills :

  • Strong hands-on with Hadoop (Cloudera), Hive, Pig, Impala, Spark
  • Programming in Java, Python, Scala , and scripting (Linux, Ruby, PHP)
  • Experience with NoSQL and SQL databases : Cassandra, Postgres
  • Familiarity with cloud services (Azure preferred)
  • Exposure to machine learning / data science tools is a plus
  • Create a job alert for this search

    Senior Data Engineer • Kolhapur, IN