AWS Data Engineer (PySpark)

Technical Skills

Must Have Skills :

Proficient with Python, PySpark and Airflow

Strong understanding of Object-Oriented Programming and Functional Programming paradigm

Must have experience working with Spark and its architecture

Knowledge of Software Engineering best practices

Advanced SQL knowledge (preferably Oracle)

Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.

Good to Have Skills :

Knowledge of ‘Data’ related AWS Services

Knowledge of GitHub and Jenkins

Automated testing