Summary :
Seeking a passionate Data Engineer (2-3 years' experience) to build scalable data solutions. Must have expertise in Spark (Scala), Java, AWS EMR, and AWS Glue, with end-to-end data pipeline exposure. Oracle ERP migration experience is a plus.
Key Responsibilities :
Required Skills & Experience : Design, build, and optimize scalable data pipelines on AWS EMR and AWS Glue.
- Develop high-performance data processing solutions using Apache Spark (Scala) and Java.
- Manage structured and unstructured data, ensuring quality, consistency, and reliability. Collaborate with teams for data integration from source to target repositories.
- Support data migration activities (Oracle ERP migration experience a plus).
- Write efficient SQL queries and work with SQL & NoSQL databases.
- Contribute to ETL design, development, and automation for reporting and analytics.
- Ensure security, performance, and scalability of data solutions.
- 2-3 years of hands-on Data Engineering experience.
- Strong expertise in Apache Spark (Scala) and Java.
- AWS EMR and AWS Glue experience (must-have).
- Proficiency in SQL and working knowledge of NoSQL databases.
- Strong understanding of ETL pipelines and data warehousing.
- Good to have : Oracle ERP migration experience.
- Exposure to AWS cloud ecosystem and related data services.
Skill Category Skills / Technologies Candidate years' Experience :
Programming - Apache Spark (Scala), JavaCloud - (AWS) AWS EMR, AWS GlueData Processing- ETL pipeline design & developmentDatabases - SQL (proficient), NoSQL (working knowledge)Data Warehousing - Data integration, pipeline optimization(ref : hirist.tech)