Senior Data Engineer

Job Description :

We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record of designing, implementing, and managing large-scale data solutions using Azure technologies. This role requires a deep understanding of data engineering best practices, cloud architecture, and the ability to work collaboratively with cross-functional teams.

The Sr. Data Engineer will design, implement, and maintain data integration projects focused primarily on the use of Azure SQL, Azure Databricks, Data Factory, Logic Apps, APIs, and Blob storage. This individual will work with business and technical staff to understand integration requirements and develop agile user stories to resolve them. They will also resolve customer complaints and respond to suggestions for improvements and enhancements. They will act as team leader for all data integration projects; coordinating the work of co-located and distributed team members, including vendor resources.

Essential Duties and Responsibilities :

• Lead the design, implementation, testing, and maintenance of complex system integration processes focused primarily on the use of Azure SQL, Azure Databricks, Data Factory, Logic Apps, APIs, and Blob storage.
• Coordinate the work of other systems integration technical resources, both onshore and offshore
• Become an expert on Microsoft data integration and reporting products
• Participate in requirement analysis and definition
• Create technical specifications and system integration test plans
• Document data flows using data dictionaries and other data governance tools
• Collaborate with different technical teams on best practices
• Work as part of an Agile development team to solve problems and develop projects in a fast-paced environment
• Follow pre-established guidelines as well as create new guidelines to perform the functions of the job
• Demonstrate a high degree of creativity and problem-solving skills
• Mature the software development life cycle within your area of responsibility
• Support applications using software development methodologies including structured programming, documentation, design, and code review and ensure consistent use of Azure DevOps to manage the full lifecycle
• Collaborate with database resources to ensure robust and complete data access and manipulation
• Collaborate with IT Operations to ensure hardware and software are aligned to deliver business requirements
• Mentor junior and other new developers
• Stay up to date with the latest Azure data services and best practices to continuously improve our data infrastructure.

Education, Experience and Knowledge :

Preferred