Capco - Hadoop Administrator

Position : Hadoop Admin

Experience : 5 - 10 Years

Location : Bangalore, India

Work Model : Hybrid

Job Summary :

We're looking for an experienced Hadoop Admin with 5 -10 years of experience to join our Big Data team. The ideal candidate will be a skilled professional responsible for managing and engineering our Hadoop platforms, with a strong focus on improving performance, reliability, and efficiency. This role requires a blend of hands-on Hadoop administration expertise, DevOps skills, and a knack for automation. You will be working during India Standard Time (IST) hours in a hybrid role.

Key Responsibilities Administration & Engineering :

• Perform administrative and engineering activities on multiple open-source platforms, including Hadoop, Kafka, HBase, and Spark.
• Plan and execute capacity expansions and upgrades to prevent scaling issues and & DevOps :
• Develop and implement automation for repetitive tasks using tools and languages like Ansible, Shell scripting, or Python scripting to reduce manual effort and human error.
• Leverage DevOps tools and principles, including Incident, Problem, and Change Management, in day-to-day & Reliability :
• Focus on enhancing the performance, reliability, and efficiency of Big Data platforms.
• Tune alerting systems and set up observability to proactively identify issues and performance problems.
• Identify and implement high-availability solutions for services with single points of & Documentation :
• Possess strong troubleshooting and debugging skills to effectively perform root cause analysis for major production incidents.
• Create standard operating procedure documents and guidelines for effective platform & Compliance :
• Ensure the Hadoop platform meets performance and service level agreement requirements.
• Perform security remediation, automation, and self-healing as :
• Work closely with Level-3 teams to review new use cases and cluster hardening techniques.
• Create reports and automation to minimize manual effort and improve operational Skills & Qualifications :

Core Experience : 5 -10 years of hands-on experience in Hadoop Proficiency :

understanding of DevOps Attributes :

(ref : hirist.tech)