What awaits you / Job Profile
- Design and develop scalable data pipelines using AWS services.
- Integrate diverse data sources and ensure data consistency and reliability.
- Collaborate with data scientists and other stakeholders to understand data requirements.
- Implement data security measures and maintain data integrity.
- Monitor and troubleshoot data pipelines to ensure optimal performance.
- Optimize and maintain data warehouse and data lake architectures.
- Create and maintain comprehensive documentation for data engineering processes.
What should you bring along
Proven experience with Snowflake and SQL.Expert-level proficiency in building and managing data pipelines with Python.Strong experience in AWS cloud services, including Lambda, S3, Glue, and other data-focused services.Exposure Terraform for provisioning and managing infrastructure-as-code on AWS.Proficiency in SQL for querying and modeling large-scale datasets.Hands-on experience with Git for version control and managing collaborative workflows.Familiarity with ETL / ELT processes and tools for data transformation.Strong understanding of data architecture, data modeling, and data lifecycle management.Excellent problem-solving and debugging skills.Strong communication and collaboration skills to work effectively in a global, distributed team environment.Must have technical skill
Good understanding of Architecting the data and solution.Data Quality, Governance, Data Security and Data Modelling concepts.Data Modelling, Mapping and Compliance to BaDM.Solutioning on Cloud (AWS) with cloud tools, with good Understanding Snowflake.Defining CI / CD config for GitHub and AWS Terraform for deployment config.Ensuring Architecture evolution with latest technology.Guiding and mentoring team, reviewing code and ensuring development to standards.Good to have Technical skills
Strong understanding of ETL Concepts, design patterns, industry best practices.Experience with ETL testingSnowflake Certification.AWS Certification.Skills Required
Terraform, Git, Data Transformation, Data Architecture, Data Modeling