we are hiring for Data Engineer
Exp : 6 to 10 years
Location : Hyderabad
Job Description :
- Design, develop, and maintain
- ETL / ELT data pipelines
- to ingest data from various sources, including databases and flat files, into our data warehouse.
- Utilize AWS services such as
- AWS Lambda
- AWS DMS
- , and
- AWS Glue
- for data ingestion and transformation processes.
- Develop and optimize
- Snowflake stored procedures
- to implement complex business logic and data transformations.
- Manage and monitor scheduled data workflows using
- Apache Airflow
- Work closely with stakeholders to understand project requirements and translate them into technical solutions, ensuring seamless integration with existing data pipelines.
- Implement and maintain robust
- data quality checks
- to ensure accuracy and reliability of all delivered datasets and reports.
- Adhere to the full project delivery lifecycle, including requirements gathering, design, implementation, documentation, and obtaining user acceptance testing (UAT) approvals.
- Deliver data sets to other AWS accounts and support the creation of Power BI reports.
Roles and Responsibilities : :
Proven experience as a Data Engineer or in a similar role.Strong proficiency inSQLscripting.Proficiency inPythonfor data manipulation and automation.Experience withApache Airflowfor workflow orchestration.Hands-on experience withAWS Cloud services, including Lambda, DMS, and Glue.Solid understanding of data warehousing concepts, with practical experience usingSnowflakeExcellent problem-solving skills and the ability to design and implement solutions based on business requirements.Experience with the full software development lifecycle (SDLC) and project documentation.Familiarity with data quality best practices.Strong communication and collaboration skills.Interested can share cv to nalini.kongara@valuelabs.com