Talent.com
This job offer is not available in your country.
Sr Technology Engineer - Hadoop

Sr Technology Engineer - Hadoop

GSSTech GroupBengaluru, KA, IN
30+ days ago
Job type
  • Quick Apply
Job description

About the Role :

We are hiring a Senior Technology Engineer with strong expertise in Hadoop-based Big Data ecosystems , automation, and DevOps tools. The role is pivotal in designing and implementing scalable, secure, and high-availability infrastructure, driving banking client’s data strategy by transforming data management and analytics platforms.

Key Responsibilities :

  • Hadoop Ecosystem Implementation :

Architect and manage big data solutions using Hadoop , Spark , Kafka , Hive , and related components.

  • Infrastructure as Code & Automation :

    • Build and maintain IaC using Terraform or Ansible . Ensure 100% automated deployment pipelines.

  • DevOps and CI / CD :

    • Design CI / CD pipelines using Jenkins , GitOps , and integrate with containerized environments (Docker / Kubernetes / OpenShift).

  • Security & Governance :

    • Implement enterprise-grade security mechanisms (e.g., Kerberos , LDAP , TLS ) and align with Data Governance best practices.

  • Monitoring and Optimization :

    • Set up observability tools (Prometheus, Grafana, ELK) and performance optimization processes.

  • Collaboration :

    • Work closely with cross-functional teams including architects, developers, and business analysts to translate requirements into reliable solutions.

    Required Qualifications :

  • Education :

    • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

  • Experience :

    • 8+ years in IT, with at least 3+ years in Big Data platforms and architecture.

    Proven experience in the banking or financial services domain .

    Technical Skills :

  • Deep expertise in the Cloudera Hadoop (CDP) stack, including versions 7.1.7 to 7.1.9.
  • Experience with Kerberos , LDAP / AD integration , and TLS security .
  • Hands-on with CI / CD , Jenkins , Git , Linux CLI , Bash / Python scripting .
  • Strong understanding of Distributed Data Architecture , Data Quality , Metadata Management , and Data Governance .
  • Experience with BI tools like Power BI and Tableau is a plus.

    • Soft Skills :

  • Excellent problem-solving, communication, and stakeholder management.
  • Ability to work in fast-paced, matrixed environments.
  • Self-driven, organized, and adaptable with mentoring capabilities.

    • Preferred Certifications (Nice to Have) :

  • Hadoop / Big Data Certifications
  • Kubernetes / OpenShift / Cloud certifications
  • DevOps tools certifications
    • Create a job alert for this search

    Sr Engineer • Bengaluru, KA, IN