Key Responsibilities :
- Hadoop Cluster Management : Install and configure Hadoop clusters, including components like HDFS , MapReduce , Hive , Pig , HBase , and other related tools.
- Cluster Monitoring & Optimization : Manage and monitor Hadoop clusters to ensure high availability and performance. Identify performance bottlenecks and proactively optimize resource utilization.
- Backup & Disaster Recovery : Plan and implement data backup and disaster recovery strategies for Hadoop clusters to ensure data integrity and availability.
- Performance Tuning : Monitor Hadoop cluster performance and tune settings to optimize system performance and prevent bottlenecks.
- Technical Support : Provide technical support to developers and end-users, troubleshoot issues, and resolve incidents related to Hadoop infrastructure.
- Stay Current : Stay up-to-date with the latest Hadoop technologies, trends, and best practices to keep the infrastructure current and efficient.
- Collaboration : Collaborate with cross-functional teams and stakeholders to ensure smooth data operations and provide necessary infrastructure support.
Skills Required
Sdlc, Agile, hdfs , Mapreduce, Hbase, Yarn