Job Description :
Big Data Engineer We are looking for a highly skilled Big Data Engineer to join our team. In this role, you will contribute to building and optimizing scalable data solutions that empower businesses to optimize promotional activities and maximize return on investment. You will work on data collection, validation, and analysis, while designing robust pipelines and implementing advanced machine learning techniques to improve decision-making Responsibilities :
- Build and optimize data pipelines using Databricks, SQL, and Apache Spark.
- Design and implement scalable and efficient data processing systems.
- Manage, monitor, and optimize data pipelines to ensure reliability and performance.
- Implement ETL processes and ensure high-quality data flows.
- Collaborate with cross-functional teams to clarify requirements and deliver effective Skills & Qualification :
- Strong expertise in big data technologies : Databricks, SQL, and Apache Spark.
- Very strong SQL skills with proven hands-on experience.
- Solid understanding of data modeling and ETL processes.
- Familiarity with AWS (ECS, S3) and cloud-based environments.
- Experience with Python for data Skills :
- Strong problem-solving mindset over reliance on past experience.
- Ability to clarify requirements with stakeholders effectively.
- Openness to pair programming and collaboration with team members.
- Excellent communication skills in English (Upper-Intermediate)
(ref : hirist.tech)