Aws Developer

Key Responsibilities :

• Develop ingestion pipelines (batch & stream) to move data to S3.
• Convert HiveQL to SparkSQL / PySpark.
• Orchestrate workflows using MWAA (Airflow).
• Build and manage Iceberg tables with proper partitioning and metadata.
• Perform job validation and implement unit testing.

Required Skills :

Skills Required

S3, Pyspark, Hiveql, Sparksql