Job Title : Senior Data Engineer AWS Redshift & Airflow
Location : Hyderabad
Employment Type : Full-Time / Contract (Both options available)
Experience Required : 4- 8 years
Key Responsibilities :
- Design, develop, and maintain scalable, high-performance data pipelines on AWS.
- Leverage AWS services such as IAM, S3, API Gateway, Lambda, Glue, Lake Formation, Redshift, DynamoDB, and RDS for data engineering solutions.
- Build and orchestrate analytics workflows using Apache Airflow.
- Develop automation scripts and manage infrastructure using Terraform or CloudFormation.
- Ensure data quality, security, profiling, and compliance across data pipelines.
- Integrate and optimize data warehousing solutions using AWS Redshift.
- Collaborate with BI teams and business stakeholders to deliver actionable insights.
- Manage source code, CI / CD, and DevOps practices using GitLab, Bitbucket, or similar tools.
- Support existing ETL solutions and migrate workloads to modern cloud-based data platforms.
- Research, evaluate, and adopt new tools and technologies to improve data engineering capabilities.
- Provide mentorship and technical guidance to junior engineers.
Core Skills & Requirements :
5+ years of experience working with AWS platform and data engineering solutions.Strong proficiency in Python for building and optimizing data pipelines.2+ years of hands-on experience with Apache Airflow for orchestration.Experience with IaC tools such as Terraform or AWS CloudFormation.Solid knowledge of data warehousing concepts, BI solutions, and performance tuning.Familiarity with traditional ETL tools such as Talend, Informatica, or Pentaho.Understanding of data security best practices and compliance frameworks.Exposure to AWS EKS and Kubernetes cluster setup / management (preferred).(ref : hirist.tech)