We are looking for an experienced Lead Data Engineer with strong expertise in Python Matillion and Snowflake to design develop and optimize scalable data pipelines and cloud-based data warehouse solutions. The ideal candidate should have hands-on experience in ETL/ELT development data modeling and cloud data engineering while working in an agile environment.
Key Responsibilities
- Design develop and maintain scalable ETL/ELT pipelines using Matillion.
- Build and optimize data warehouse solutions on Snowflake.
- Develop robust data processing frameworks and automation scripts using Python.
- Create and maintain data models transformations and workflows to support business analytics.
- Optimize Snowflake performance including query tuning clustering and warehouse management.
- Integrate data from multiple structured and unstructured sources.
- Collaborate with business stakeholders analysts and cross-functional engineering teams to deliver high-quality data solutions.
- Implement data quality validation monitoring and error-handling mechanisms.
- Participate in code reviews testing deployment and production support activities.
- Follow best practices for security governance and documentation.
Qualifications :
- 6 years of experience in Data Engineering.
- Strong hands-on experience with Python Matillion and Snowflake.
- Experience building ETL/ELT pipelines and data integration solutions.
- Strong SQL skills with experience in query optimization.
- Good understanding of data warehousing concepts and dimensional data modeling.
- Experience working with cloud platforms such as AWS Azure or GCP.
- Knowledge of Git CI/CD pipelines and Agile methodologies.
- Strong analytical troubleshooting and problem-solving s
Additional Information :
- Experience with orchestration tools such as Airflow.
- Exposure to DBT is an added advantage.
- Knowledge of REST APIs and data integration techniques.
- Familiarity with data governance and security best practices.
Remote Work :
No
Employment Type :
Full-time
Experience: years
Vacancy: 1