Talent.com
This job offer is not available in your country.
Big Data Engineer - Hadoop / Spark / Hive

Big Data Engineer - Hadoop / Spark / Hive

True TalentsPune
8 days ago
Job description

Job Title : Big Data Engineer

Location : Bangalore / Pune

Employment Type : Full Time

Experience : 4 to 8 years

Notice Period : 15 days

About the Role :

We are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data processing systems. The ideal candidate will have hands-on experience with big data technologies and a strong ability to build scalable and high-performance data pipelines.

Key Responsibilities :

  • Design and implement big data pipelines and ETL processes using Hadoop, Spark, Hive, and Kafka.
  • Develop and maintain data ingestion, processing, and storage frameworks for high-volume datasets.
  • Optimize and tune big data applications for performance and scalability.
  • Work closely with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions.
  • Ensure data quality, security, and compliance with industry best practices.
  • Monitor, troubleshoot, and resolve issues in production big data environments.

Required Skills & Qualifications :

  • 4 to 8 years of experience in big data engineering or related roles.
  • Strong expertise in Hadoop ecosystem : HDFS, YARN, MapReduce.
  • Hands-on experience with Apache Spark, Hive, and Kafka.
  • Proficiency in SQL and at least one programming language (Java / Scala / Python).
  • Good understanding of data modeling, distributed computing, and performance tuning.
  • Experience with real-time data streaming and batch processing.
  • Strong problem-solving skills and ability to work in a fast-paced environment.

    • Good to Have :

  • Experience with cloud platforms (AWS, Azure, or GCP) and big data services.
  • Knowledge of data lake architectures, NoSQL databases (HBase, Cassandra, etc.).
  • Familiarity with containerization (Docker, Kubernetes).

    • Why Join Us :

  • Opportunity to work on cutting-edge big data technologies and large-scale projects.
  • Collaborative work culture and exposure to challenging data engineering problems.
  • Competitive salary and growth opportunities in a rapidly evolving data-driven industry.

    • (ref : hirist.tech)

    Create a job alert for this search

    Big Data Engineer • Pune