Key Responsibilities
- Design target architecture using AWS native services for Non-PROD, PROD, and DR environments.
- Understand existing Airflow-Astronomer implementation and design the target reference architecture.
- Evaluate licensing requirements and models (BYOL, SPLA, subscription) for AWS migration using AWS License Manager, AWS Migration Evaluator, and third-party tools (Flexera, ServiceNow).
- Gather non-functional requirements based on the current platform.
- Ensure systems comply with internal security policies and regulatory requirements using AWS native security services.
- Configure and manage AWS EKS deployments and clusters.
- Provision AWS infrastructure using Terraform and implement automated infrastructure provisioning.
- Configure optimal monitoring and alerts for AWS-hosted Airflow setups.
- Integrate AWS services with Airflow deployments effectively.
- Configure AWS VPC endpoints and manage networking optimizations.
- Continuously optimize system performance and resource utilization.
- Design and implement Backup and DR solutions as per RTO / RPO requirements, perform DR setup, and test failover scenarios.
- Manage AWS IAM roles, policies, and federated access.
- Work with Postgres SQL RDS and perform database migrations using AWS DMS & SCM.
Skills Required
Automation, Terraform, Migration, Postgres Sql, Cloud Infrastructure