Talent.com
Search jobs
Search salary
Tax calculator
For employers
Sign in
Find jobs
This job offer is not available in your country.
Senior Data Engineer
Dautom
Kolhapur, IN
4 days ago
Job description
Key Responsibilities :
Lead and manage a backend / distributed systems team and third-party resources
Build and optimize Java, MapReduce, Hive, and Spark jobs
Work with a wide range of Hadoop tools : HDFS, Pig, Hive, HBase, Sqoop, Flume
Implement and manage real-time stream processing using Spark Streaming, Storm
Develop dimensional data models and perform advanced SQL tuning
Analyze source data integrity and ensure accurate data ingestion
Build dashboards and BI solutions using best practices
Collaborate with internal teams and vendors to prioritize and deliver data initiatives
Deploy, monitor, and audit big data models and workflows
Technical Skills :
Strong hands-on with Hadoop (Cloudera), Hive, Pig, Impala, Spark
Programming in Java, Python, Scala , and scripting (Linux, Ruby, PHP)
Experience with NoSQL and SQL databases : Cassandra, Postgres
Familiarity with cloud services (Azure preferred)
Exposure to machine learning / data science tools is a plus
Create a job alert for this search
Senior Data Engineer • Kolhapur, IN
Create