Job Title : Big Data Architect
Experience : 8+ Years
Location : Nagpur / Pune (Onsite 5 Days Working)
Notice Period : 0 to 30 days max
About the Role :
We are looking for a highly skilled Big Data Architect to design and deliver scalable, production-grade big data solutions integrating Hadoop ecosystems with cloud platforms. The ideal candidate will have hands-on experience in architecting, optimizing, and deploying complex data pipelines while ensuring performance, cost efficiency, and best practices in data engineering.
Key Responsibilities :
- Deliver reference architecture for Hadoop + Cloud integration tailored to enterprise-scale environments.
- Deploy production-grade pipelines using HDFS, Spark, and Kafka for batch and real-time data processing.
- Set up best practices and implement CI / CD frameworks for data engineering workflows.
- Lead data performance optimization and cost-reduction strategies across the big data stack.
- Collaborate with cross-functional teams (data engineers, data scientists, DevOps) to ensure robust, scalable solutions.
- Provide technical leadership and mentor junior engineers in big data technologies.
Required Skills & Qualifications :
8+ years of experience in Big Data architecture and engineering.Expertise in the Hadoop ecosystem : HDFS, Hive, Sqoop, Oozie, Pig, Impala.Strong knowledge of real-time processing frameworks : Kafka, Spark Streaming, Flink.Hands-on experience with cloud platforms (AWS, GCP, or Azure) EMR, Dataproc, .HDInsight.Proficiency in Python, Scala, or Java for big data solutions.Experience with orchestration tools like Airflow or Prefect.Familiarity with Lakehouse technologies : Delta Lake, Apache Iceberg.Strong understanding of data modeling, data security, and governance best practices.Excellent problem-solving, communication, and collaboration skills.Preferred Qualifications :
Experience in cost-optimization strategies for large-scale data platforms.Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).Familiarity with CI / CD tools like Jenkins, GitLab CI / CD.Prior experience mentoring and leading engineering teams.(ref : hirist.tech)