Job Title : Senior Data Engineer Hadoop
Location : Bangalore
Employment Type : Full-time | Onsite
Experience : 8+ Years
Notice Period : Immediate to 15 Days Preferred
Job Overview :
We are looking for a highly skilled Senior Data Engineer with strong hands-on expertise in the Hadoop ecosystem and PySpark for large-scale data processing. The ideal candidate should have deep technical proficiency in distributed data systems and Python-based automation, with a focus on performance and scalability.
Key Responsibilities :
- Design, build, and maintain data pipelines using Hadoop, Spark, and Hive.
- Develop and optimize large-scale ETL / ELT workflows for structured and unstructured data.
- Implement PySpark applications for distributed data processing.
- Automate data ingestion, transformation, and validation using Python.
- Collaborate with data architects, analysts, and business teams to enable analytics and reporting.
- Ensure data reliability, performance tuning, and monitoring across data infrastructure.
Required Skills :
Strong experience (8+ years) in Data Engineering or Big Data Development.Expertise in the Hadoop ecosystem (HDFS, Hive, Spark mandatory).Proven experience with PySpark for scalable data processing.Solid programming skills in Python for data manipulation and automation.Strong understanding of data modeling, performance optimization, and version control (Git).(ref : hirist.tech)