Roles and Responsibilities
- Design, develop, test, deploy, and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions, etc.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop high-quality code in Java or Python for data processing tasks.
- Troubleshoot issues related to pipeline failures or errors by analyzing logs, debugging techniques, and collaborating with team members.
- Ensure compliance with security best practices when working on sensitive customer data.
Desired Candidate Profile
Strong understanding of Java or Python programming languages for developing custom logic.Experience with containerization using Docker / Kubernetes is an added advantage.Familiarity with cloud-based technologies like Azure / GCP is a plus.