Talent.com
Hadoop Admin Manager - CDP
Hadoop Admin Manager - CDPSmart Analytica • India
No longer accepting applications
Hadoop Admin Manager - CDP

Hadoop Admin Manager - CDP

Smart Analytica • India
3 days ago
Job description

Role : Hadoop Admin Manager - CDP

Years of Experience : 10-15 Yrs

Location : Mumbai (Kurla)

Shifts : 24

  • 7 (Rotational Shift)

Mode : Onsite

Experience : 10+ yrs of experience in IT, with At least 7+ years of experience with cloud and system administration. At least 5 years of experience with and strong understanding of ‘big data’ technologies in Hadoop ecosystem – Hive, HDFS, Map / Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc.

Company : Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PB’s in a single implementation, delivering many successful data and AI projects across major industries, including retail, finance, telecom, manufacturing, insurance, and capital markets.

We are leaders in Big Data, Cloud and Analytics projects with super specialization in very large Data Platforms.

Your Digital Transformation with Data Modernization and AI

Job Overview : Smartavya Analytica Private Limited is seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments.

Key Responsibilities :

  • Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.
  • Monitor and manage Hadoop cluster performance, capacity, and security.
  • Perform routine maintenance tasks such as upgrades, patching, and backups.
  • Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka.
  • Ensure high availability and disaster recovery of Hadoop clusters.
  • Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions.
  • Troubleshoot and resolve issues related to the Hadoop ecosystem.
  • Maintain documentation of Hadoop environment configurations, processes, and procedures.
  • Requirement :

  • Experience in Installing, configuring and tuning Hadoop distributions.
  • Hands on experience in Cloudera.
  • Understanding of Hadoop design principals and factors that affect distributed system performance, including hardware and network considerations.
  • Provide Infrastructure Recommendations, Capacity Planning, work load management.
  • Develop utilities to monitor cluster better Ganglia, Nagios etc.
  • Manage large clusters with huge volumes of data
  • Perform Cluster maintenance tasks
  • Create and removal of nodes, cluster monitoring and troubleshooting
  • Manage and review Hadoop log files
  • Install and implement security for Hadoop clusters
  • Install Hadoop Updates, patches and version upgrades. Automate the same through scripts
  • Point of Contact for Vendor escalation. Work with Hortonworks in resolving issues
  • Should have Conceptual / working knowledge of basic data management concepts like ETL, Ref / Master data, Data quality, RDBMS
  • Working knowledge of any scripting language like Shell, Python, Perl
  • Should have experience in Orchestration & Deployment tools.
  • Academic Qualification :

    BE / B.Tech in Computer Science or equivalent along with hands-on experience in dealing with large data sets

    and distributed computing in data warehousing and business intelligence systems using Hadoop.

    Create a job alert for this search

    Hadoop Admin • India

    Related jobs
    Delivery Manager

    Delivery Manager

    Persistent Systems • India
    We are seeking a highly experienced and skilled Delivery Manager and manage our Design, configure, and manage disaster recovery solutions utilizing AWS ERS and Zerto for critical applications and i...Show more
    Last updated: 11 hours ago • Promoted • New!
    Automation and Cloud Solutions Manager

    Automation and Cloud Solutions Manager

    WorkGeek Services • Republic Of India, IN
    The purpose of this job is to define and own the overall cloud infrastructure as well as the devops.This includes designing, deploying, and maintaining cloud-based systems.Job Context & Major Chall...Show more
    Last updated: 19 days ago • Promoted
    Kafka Admin

    Kafka Admin

    Apptad • India
    Standing up and administer on premise Kafka cluster.Ability to architect and create reference architecture for kafka Implementation standards. Provide expertise in Kafka brokers, zookeepers, Kafka c...Show more
    Last updated: 2 days ago • Promoted
    Devops Manager

    Devops Manager

    NAV India • Jaipur, Republic Of India, IN
    We are looking for an experienced.DevOps workflows across cloud and on-prem environments.The role involves expertise in CI / CD, containerization, orchestration, monitoring, messaging systems, databa...Show more
    Last updated: 7 days ago • Promoted
    Hadoop Admin

    Hadoop Admin

    Confidential • India
    Job Location : Bangalore, Hyderabad, Chennai, Mumbai, Pune.Notice Period : Immediate to 15 days.Please do not apply Notice Period with more than 15 days of Notice Period. Mandatory Skills : Build Cloud...Show more
    Last updated: 5 days ago • Promoted
    Dynatrace Admin

    Dynatrace Admin

    QualityKiosk Technologies • Republic Of India, IN
    Job Title : Level 2 Engineer – Dynatrace Configuration & Administration.Navi Mumbai (Work from Office / Client Location – No Hybrid). Years in Dynatrace Administration.The Level 2 Dynatrace Engineer ...Show more
    Last updated: 30+ days ago • Promoted
    OpenShift Admin

    OpenShift Admin

    Tata Consultancy Services • India
    Expertise in RedHat Linux administration.Experience with AWS cloud PAAS / IAAS technologies.Experience in installing, maintaining and operating OpenShift clusters in 4. Experience in administration an...Show more
    Last updated: 2 days ago • Promoted
    Openshift Admin

    Openshift Admin

    Tata Consultancy Services • Chennai, Republic Of India, IN
    Expertise in RedHat Linux administration.Experience with AWS cloud PAAS / IAAS technologies.Experience in installing, maintaining and operating OpenShift clusters in 4. Experience in administration an...Show more
    Last updated: 30+ days ago • Promoted
    Kafka Admin

    Kafka Admin

    Confidential • India
    Perform Admin functions, Setting Kafka cluster and responsible for cluster migration.Monitoring activities (Support team) and Hands on Monitoring tool Confluent Control Centre, Cloudera Manager Dep...Show more
    Last updated: 16 days ago • Promoted
    DevOps Manager

    DevOps Manager

    EXL • India
    We need senior DevOps SMEs who can embed in development teams to drive cultural change, educate advanced DevOps, and perform highly technical work on CI / CD adoption to the Market Stone CI / CD pipeli...Show more
    Last updated: 3 days ago • Promoted
    Devops Manager

    Devops Manager

    WorkGeek Services • Republic Of India, IN
    The purpose of this job is to define and own the overall cloud infrastructure as well as the devops.This includes designing, deploying, and maintaining cloud-based systems.Job Context & Major Chall...Show more
    Last updated: 19 days ago • Promoted
    DevOps Manager

    DevOps Manager

    WorkGeek Services • India
    The purpose of this job is to define and own the overall cloud infrastructure as well as the devops.This includes designing, deploying, and maintaining cloud-based systems.Job Context & Major Chall...Show more
    Last updated: 3 days ago • Promoted
    Manager - K8s (CRD)+ GO

    Manager - K8s (CRD)+ GO

    Tata Communications • India
    Technical Lead / Manager – Cloud & Kubernetes Platforms.Lead and mentor engineering teams to deliver scalable, cloud-native solutions. Drive architecture and development of Kubernetes platforms (OCI,...Show more
    Last updated: 1 day ago • Promoted
    Openshift And Ansible Admin

    Openshift And Ansible Admin

    Tata Consultancy Services • Republic Of India, IN
    Location : Hyderabad, Chennai, Pune, Bangalore.RedHat OpenShift Platform Administrator.In this role, you will primarily focus on administering and supporting the OpenShift Container Platform ecosyst...Show more
    Last updated: 22 days ago • Promoted
    Hadoop Admin

    Hadoop Admin

    LTIMindtree • India
    Job Location : Bangalore, Hyderabad, Chennai, Mumbai, Pune.Notice Period : Immediate to 15 days.Please do not apply Notice Period with more than 15 days of Notice Period. Mandatory Skills : Build Cloud...Show more
    Last updated: 3 days ago • Promoted
    Openshift and Ansible Admin

    Openshift and Ansible Admin

    Tata Consultancy Services • India
    Location : Hyderabad, Chennai, Pune, Bangalore.RedHat OpenShift Platform Administrator.In this role, you will primarily focus on administering and supporting the OpenShift Container Platform ecosyst...Show more
    Last updated: 3 days ago • Promoted
    Hyperion Admin

    Hyperion Admin

    HCLTech • India
    Installation & Configuration Hyperion components, Patching, Performance Tuning, scripting, LCM migrations, Security / SSL setup, Monitoring & Troubleshooting. Hyperion Admin – Primary Skills.Server & ...Show more
    Last updated: 2 days ago • Promoted
    Devops Manager

    Devops Manager

    EXL • Pune, Republic Of India, IN
    We need senior DevOps SMEs who can embed in development teams to drive cultural change, educate advanced DevOps, and perform highly technical work on CI / CD adoption to the Market Stone CI / CD pipeli...Show more
    Last updated: 22 days ago • Promoted