Software Cloud Engineer II - Hadoop Administrator.

Careers that Change Lives

We are seeking a skilled Big Data Cloud Administrator to join our PCS Software Solutions team. This individual will be responsible for the management, maintenance, and optimization of our Big Data infrastructure, which leverages HBase on Hortonworks and Cloudera Data Platform (CDP). The ideal candidate will have extensive experience in cloud-based Big Data environments, strong problem-solving abilities, and the capability to work collaboratively with cross-functional teams to ensure the seamless operation of our data platforms.

A Day in the Life

KEY RESPONSIBILITIES :

1. Cluster Management

You will manage and administer Hadoop clusters running on Hortonworks and Cloudera Data Platform. Ensure high availability and performance of HBase clusters. Perform regular upgrades, patches, and configuration changes to maintain cluster health and security.

2. Monitoring and Troubleshooting :

You will monitor cluster performance and implement measures to ensure optimal operation. Troubleshoot complex issues related to HBase and Hadoop ecosystems. Perform root cause analysis for service disruptions and implement corrective measures.

3. Data Management :

You will oversee data ingestion, transformation, and extraction processes. Ensure data integrity and security across the Big Data infrastructure. Implement and maintain backup and recovery procedures.

4. Automation and Scripting :

You will develop and maintain scripts for automation of routine tasks such as monitoring, maintenance, and data processing. Leverage tools like Ansible, Puppet, or similar for configuration management and automation.

5. Security and Compliance :

You will implement security best practices for Big Data environments. Ensure compliance with relevant data protection regulations and corporate policies. Manage access controls and monitor for unauthorized access attempts.

6. Collaboration and Documentation :

You will work closely with data engineering, analytics, and DevOps teams to support data-driven initiatives. Document processes, configurations, and best practices. Provide guidance and support to junior administrators and other team members.

Must Have

Job Respobsibilities

1. Hands-on experience with HBase administration and optimization.

2. Proficiency with Hortonworks Data Platform (HDP) and Cloudera Data Platform (CDP).

3. Experience with cluster monitoring and management tools.

4. Expertise in security best practices and compliance for Big Data environments.

5. Excellent problem-solving skills and the ability to perform root cause analysis.

Minimum Qualifications :

1. Bachelor’s degree in Computer Science, Information Technology, or a related field.

2. 5+ years of system administration experience with 3+ years in Big Data administration.

3. Extensive experience with HBase, Hadoop, Hortonworks, and Cloudera Data Platform.

4. Strong understanding of cloud infrastructure services and management.

5. Proficiency in Linux system administration and scripting languages such as Python, Shell, or Perl.

Principal Working Relationship

1. Reports to the Engineering Supervisor / Engineering Manager

2. Collaborates with Data Engineers, Data Scientists, DevOps, and Cloud Governance teams.

3. Interacts with internal stakeholders to gather requirements and provide updates.

4. Coordinates with vendors and external support teams for technical assistance and upgrades.

Nice to Haves

1. Experience with cloud platforms such as AWS, Azure, or Google Cloud.

2. Familiarity with containerization and orchestration tools like Docker and Kubernetes.

3. Knowledge of other Big Data technologies such as Spark, Hive, or Kafka.

4. Experience in a regulated industry or with healthcare data.

5. Certification in Big Data or Cloud technologies (e.g., Cloudera Certified Administrator, AWS Certified Solutions Architect).

Your Answer