Hadoop Administrator - Red Hat / CentOS

Job Summary :

We are looking for an experienced Hadoop Administrator with 4+ years of hands-on experience in managing and supporting Hadoop ecosystems. The ideal candidate will have deep expertise in Unix-based system administration, Cloudera and Hortonworks distributions, and configuring secure and highly available Hadoop clusters in both on-premise and cloud environments. You will be responsible for ensuring the reliability, security, and performance of big data platforms while collaborating with cross-functional teams to support enterprise-level data initiatives.

Roles & Responsibilities :

• Deploy, configure, and manage Hadoop ecosystems (Cloudera CDP / CDH, Hortonworks HDP) across on-premises and cloud environments.
• Perform system administration tasks on Linux-based platforms (RedHat, CentOS, Ubuntu).
• Set up and configure Hadoop services such as HDFS, YARN, Zookeeper, Hive, Spark, HBase, etc.
• Implement and manage Kerberos-based authentication and data-at-rest encryption for Hadoop clusters.
• Manage and troubleshoot data replication peers and policies across environments.
• Set up and maintain security frameworks such as Ranger, Atlas, and SSL configurations.
• Monitor and audit Hadoop environments and ensure data integrity, availability, and compliance.
• Utilize shell scripting, bash, and Python for automation, cluster configuration, and monitoring.
• Support the platform deployment using AWS cloud-native services.
• Participate in a 24x7 rotating support model, including weekends and public holidays.
• Collaborate with infrastructure, networking, and development teams for platform maintenance and upgrades.
• Use Hadoop CLI for routine cluster operations and troubleshooting tasks.

Key Skills Required :

(ref : hirist.tech)