Responsibilities :
We are looking for a software developer with a strong background in Data engineering and
data management technologies. You will be responsible for the following :
- Development of our client's data engineering pipelines and data lakes
- Work closely with product owners and developers to collaboratively refine functional requirements and build infrastructure to deliver on those requirements
- Collaborate with other developers and architects to build out scalable data architectures
- Maintain high-quality code
- Expand and improve test automation, continuous integration, and continuous delivery within the pipelines
Qualifications :
BS or MS in Computer Science or related technical field3 to 6 years of software development experience in Python, Airflow or any similar ETL technologies3 to 6 years of experience working on Redshift or similar data warehouses, Spark, either via PySpark or ScalaKnowledge of techniques used to optimise web and backend service performanceExperience with JavaScript, HTML, CSS, and JQuery and programming languages like PHP or Go is a plusTeam player with Agile development experienceExperience with CI / CD using Jenkins is a plusA strong background in algorithms is preferableExperience with data science and machine learning is a plusExperience with Cloud providers like AWS, Google or Azure is a plus