Talent.com
This job offer is not available in your country.
Hadoop Administrator - Big Data

Hadoop Administrator - Big Data

Tehno RightBangalore
30+ days ago
Job description

Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFO

Job description : What is your Role ?

  • You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms.
  • You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems, and designing assessment tools for storage and visualization applications.
  • They must be able to design, build, and maintain systems in both cloud and physical environments.
  • Big Data Engineers must also be able to collaborate with other IT professionals, including software engineers, system administrators, and development teams.
  • You will be able to implement, monitor and maintain Hadoop systems in both cloud and physical environments.
  • You will be deputed at customer premises to assist customers with issues related to Hadoop Infrastructure, Software Infrastructure and Application Software (Products) deployed.
  • Need to work as a developer in Cloudera Hadoop.
  • Work on Hadoop, Python, PySpark, Hive SQLs, Bigdata Eco System Tools.
  • Experience in working with teams in a complex organization involving multiple reporting lines.
  • The candidate should have strong functional and technical knowledge to deliver what is required and he / she should be well acquainted with Banking terminologies.
  • The candidate should have strong DevOps and Agile Development Framework knowledge.
  • Create Python / PySpark jobs for data transformation and aggregation.
  • Experience with stream-processing systems like Spark-Streaming.

What will you do ?

  • Deploying a Hadoop cluster, maintaining and administration of a Hadoop cluster, adding and removing nodes using cluster monitoring.
  • Performance monitoring of Hadoop components and optimization.
  • Create and manage VMs, installation of VM tools, custom virtual hardware provisioning as per guest OS.
  • Design automates scripts to improve efficiency, operational stability and operational integrity using PowerShell and Ansible.
  • Monitor system performance, identify issues, and perform troubleshooting activities.
  • Ensure the system documentation is up to date.
  • Collaborate with IT professionals in other departments.
  • Participate in system design, code reviews, and other development activities.
  • Maintain and improve system availability, scalability, and reliability.
  • Research, evaluate, and recommend new technologies.
  • Stay updated with industry developments and emerging technologies.

    • Technical skills required :

  • Technical Domain : Linux, Big Data, Apache Hadoop, Virtualization, KVM, OLVM, Vmware, Ansible, System Administration.

    • ref : hirist.tech)

    Create a job alert for this search

    Hadoop Administrator • Bangalore