This job offer is not available in your country.
Senior Data Engineer
DautomKolhapur, IN5 days ago
Job descriptionStrong hands-on with Hadoop (Cloudera), Hive, Pig, Impala, Spark Programming in Java, Python, Scala , and scripting (Linux, Ruby, PHP) Experience with NoSQL and SQL databases : Cassandra, Postgres Familiarity with cloud services (Azure preferred) Exposure to machine learning / data science tools is a plus
Key Responsibilities :
- Lead and manage a backend / distributed systems team and third-party resources
- Build and optimize Java, MapReduce, Hive, and Spark jobs
- Work with a wide range of Hadoop tools : HDFS, Pig, Hive, HBase, Sqoop, Flume
- Implement and manage real-time stream processing using Spark Streaming, Storm
- Develop dimensional data models and perform advanced SQL tuning
- Analyze source data integrity and ensure accurate data ingestion
- Build dashboards and BI solutions using best practices
- Collaborate with internal teams and vendors to prioritize and deliver data initiatives
- Deploy, monitor, and audit big data models and workflows
Technical Skills :
Create a job alert for this search
Senior Data Engineer • Kolhapur, IN