Talent.com
Data Engineer - Spark / Scala

Data Engineer - Spark / Scala

Coders Brain Technology Private LimitedGurugram
27 days ago
Job description

Summary :

Seeking a passionate Data Engineer (2-3 years' experience) to build scalable data solutions. Must have expertise in Spark (Scala), Java, AWS EMR, and AWS Glue, with end-to-end data pipeline exposure. Oracle ERP migration experience is a plus.

Key Responsibilities :

Required Skills & Experience : Design, build, and optimize scalable data pipelines on AWS EMR and AWS Glue.

  • Develop high-performance data processing solutions using Apache Spark (Scala) and Java.
  • Manage structured and unstructured data, ensuring quality, consistency, and reliability. Collaborate with teams for data integration from source to target repositories.
  • Support data migration activities (Oracle ERP migration experience a plus).
  • Write efficient SQL queries and work with SQL & NoSQL databases.
  • Contribute to ETL design, development, and automation for reporting and analytics.
  • Ensure security, performance, and scalability of data solutions.
  • 2-3 years of hands-on Data Engineering experience.
  • Strong expertise in Apache Spark (Scala) and Java.
  • AWS EMR and AWS Glue experience (must-have).
  • Proficiency in SQL and working knowledge of NoSQL databases.
  • Strong understanding of ETL pipelines and data warehousing.
  • Good to have : Oracle ERP migration experience.
  • Exposure to AWS cloud ecosystem and related data services.

Skill Category Skills / Technologies Candidate years' Experience :

  • Programming - Apache Spark (Scala), Java
  • Cloud - (AWS) AWS EMR, AWS Glue
  • Data Processing- ETL pipeline design & development
  • Databases - SQL (proficient), NoSQL (working knowledge)
  • Data Warehousing - Data integration, pipeline optimization
  • (ref : hirist.tech)

    Create a job alert for this search

    Data Engineer • Gurugram