Job Description Senior Data Engineer (8+ Yrs) with deep expertise in AWS cloud Data services, particularly AWS Glue, to design, build, and optimize scalable data solutions.
The ideal candidate will drive end-to-end data engineering initiatives from ingestion to consumption with a strong focus on data warehousing, performance optimization, self-service enablement, and data security.
The candidate needs to have experience in doing consulting and troubleshooting exercise to design best-fit Responsibilities :
- Consult with business and technology stakeholders to understand data requirements, troubleshoot and advise on best-fit AWS data solutions.
- Design and implement scalable ETL pipelines using AWS Glue, handling structured and semi-structured data.
- Architect and manage modern cloud data warehouses (e.g., Amazon Redshift, Snowflake, or equivalent).
- Optimize data pipelines and queries for performance, cost-efficiency, and scalability.
- Develop solutions that enable self-service analytics for business and data science teams.
- Implement data security, governance, and access controls.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs.
- Monitor, troubleshoot, and improve existing data solutions, ensuring high availability and Skills & Experience :
- 8+ years of experience in data engineering in AWS platform.
- Strong hands-on experience with AWS Glue, Lambda, S3, Athena, Redshift, IAM.
- Proven expertise in data modelling, data warehousing concepts, and SQL optimization.
- Experience designing self-service data platforms for business users.
- Solid understanding of data security, encryption, and access management.
- Proficiency in Python.
- Familiarity with DevOps practices & CI / CD.
- Strong problem-solving.
- Exposure to BI tools (e.g., QuickSight, Power BI, Tableau) for self-service Qualifications :
- AWS Certified Data Analytics Specialty or Solutions Architect Associate.
ref : hirist.tech)