Principal Apache Hadoop Engineer

ConfidentialBengaluru / Bangalore, India

2 days ago

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Principal Apache Hadoop Engineer at BairesDev

We are seeking a Principal Apache Hadoop Engineer with deep expertise in big data ecosystem, HDFS architecture, MapReduce paradigm, and YARN resource management. The technology stack includes popular open source big data technologies - Apache Hadoop, and related ecosystem tools. Thus, there is ample scope for collaboration and contribution to open source. The ideal candidate will lead the design and optimization of large-scale distributed data processing systems, drive architectural decisions, and mentor engineering teams while delivering cutting-edge solutions for complex big data challenges.

What You'll Do :

Contribute actively to Apache Hadoop and related open source projects as a core contributor, spending 20% of your time on upstream development.
Design and optimize big data ecosystem architectures for large-scale data processing.
Architect advanced HDFS components to ensure highly reliable distributed data storage.
Lead MapReduce paradigm implementation for complex scalable data processing workflows.
Drive YARN resource management optimization for maximum cluster efficiency and performance.
Mentor engineering teams and provide technical leadership across projects.

What we are looking for :

10+ years of experience in software development.

Strong expertise in big data ecosystem and distributed data processing systems.

Deep understanding of advanced HDFS architecture and distributed file system concepts.

Proficiency in MapReduce paradigm and complex parallel processing techniques.

Proven experience with YARN resource management and large-scale cluster orchestration.

Core contributions to Apache open source projects (Hadoop, HDFS, Spark, or similar).

Advanced level of English.

How we make your work (and your life) easier :

Excellent compensation in USD or your local currency if preferred.

Paid parental leave, vacation, & national holidays.

Innovative and multicultural work environment.

Collaborate and learn from the global Top 1% of talent in each area.

Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!

Apply now!

Skills Required

Apache Hadoop, hdfs , Yarn, Mapreduce

Create a job alert for this search

Principal Engineer • Bengaluru / Bangalore, India