Hadoop Developer - Big Data Technologies

Job Title : Hadoop Developer (Python / PySpark / Scala / Advanced SQL)

Experience : 5 to 8 Years

Notice Period : Immediate to 15 Days

Location : Any Brillio Location Bangalore, Pune, Hyderabad, Chennai, Gurugram

Role Overview :

We are looking for an experienced Hadoop Developer with strong programming skills and a deep understanding of Big Data ecosystems. The ideal candidate will be proficient in Python, Java, or Scala, have hands-on experience with Spark and Hadoop, and be highly skilled in advanced SQL.

This role involves developing and maintaining large-scale data processing pipelines, collaborating with multiple stakeholders, and ensuring data quality, performance, and compliance.

Key Responsibilities :

• Develop, maintain, and enhance Big Data ETL pipelines using Hadoop ecosystem tools.
• Perform data analysis, profiling, and quality checks to support business and analytics teams.
• Collaborate with data scientists, business analysts, and cross-functional teams to align engineering solutions with business goals.
• Automate data ingestion, transformation, and validation workflows to improve efficiency.
• Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability.
• Ensure data security, governance, and compliance with Mastercard and industry standards.

Must-Have Skills :

Good-to-Have Skills :

Qualifications :

(ref : hirist.tech)