Senior Data Engineer - Python

Description :

• With a focus on automating testing and DevOps, use Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting.
• Working experience of Python.
• Automate the running of unit and integration tests on all created code Create and run unit and integration tests throughout the development lifecycle.
• Support and Troubleshooting Assist the Operations Team with any environmental issues that arise during application deployment in the Development, QA, Staging, and Production environments.
• If necessary, create prototypes to validate proposed ideas and solicit input from stakeholders.
• Excellent grasp of and expertise with test-driven development and continuous integration processes.
• Analysis and Design Converts high-level design to low-level design and implements it.
• Collaborate with Team Leads to define / clarify business requirements, estimate development costs, and finalize work plans.
• Benchmark application code proactively to prevent performance and scalability concerns.
• Collaborate with the Quality Assurance Team on issue reporting, resolution, and change management.
• Assist other teams in resolving issues that may develop as a result of applications or the integration of multiple components

(ref : hirist.tech)