Job Title : Hadoop Solution Architect.
Experience : 10-18 years in Analytics and Big Data with at least the last 3-4 years in CDP Hadoop solution Architect role.
Location : Mumbai, India.
Department : Big Data, Analytics and Cloud.
Company : Smartavya Analytica Private limited is niche Data and AI company.
Experience : 12-18 years of experience in Analytics and Big Data, with at least the last 6 years or more in a senior role specifically focusing on Hadoop architecture and administration.
Key Responsibilities :
- Lead the end-to-end architecture, design, and implementation of Hadoop-based Cloudera CDP on-prem data solutions.
- Ensure data availability, scalability, and reliability across Hadoop clusters.
- Collaborate with data engineers, data scientists, and business stakeholders to gather requirements and deliver tailored big data solutions.
- Optimize and tune Hadoop systems for performance and scalability.
- Maintain and document Hadoop environments to ensure reproducibility and reliability of data processes.
- Oversee the integration of Hadoop with other data systems and tools.
- Implement and manage data security, privacy, and governance frameworks within Hadoop ecosystems.
- Mentor and guide junior team members, fostering a culture of continuous learning and improvement.
- Drive continuous improvement initiatives to enhance Hadoop capabilities and operational efficiency.
- Communicate complex technical concepts and solutions to non-technical stakeholders effectively.
Requirements :
Extensive proficiency in Hadoop ecosystems, including HDFS, Ozone, Kudu, Spark Streaming, YARN, Hive, and Spark.Excellent Performance tuning skills is a must.Strong leadership and project management skills, with a demonstrated ability to manage large-scale data projects.Client Engagement and Presentation skills are mandatory.Experience with Hadoop administration and optimization on various operating environments.Excellent problem-solving skills and the ability to manage failures in a production setting.Familiarity with Reporting tools, Data Integration Tools and ETL processes.Strong communication and collaboration skills to work effectively with business users and cross-functional teams.Ability to work in high-pressure situations and handle multiple priorities.Academic Qualifications :
Bachelors degree in computer science, Information Technology, or a related field.Relevant certifications (e.g., Cloudera Certified Architect, Hortonworks Data Platform Certified) are a plus.(ref : hirist.tech)