Data Engineer III / IV -G (R-21564)

Data Engineer III / IV - IN (Operation / Supports) Work Location -  Remote Work From Home Shift : Rotation Shifts (24 / 7) Experience : 7-12 years Job Description Summary The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI / Tableau . The engineer will work closely with the customer and team to manage and operate cloud data platform.

Job Description

• Leads Level 4 operational coverage : Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects.
• Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiving Customer acceptance of fix.
• Cost / Performance optimization and Audit / Security including any associated infrastructure changes
• Troubleshooting incident / problem, includes collecting logs, cross-checking against known issues, investigate common root causes (for example failed batches, infra related items such as connectivity to source, network issues etc.)
• Knowledge Management : Create / update runbooks as needed .
• Governance : Watch all the configuration changes to batches and infrastructure (cloud platform) along with mapping it with proper documentation and aligning resources.
• Communication : Lead and act as a POC for customer from off-site, handling communication, escalation, isolating issues and coordinating with off-site resources while level setting expectation across stakeholders
• Change Management : Align resources for on-demand changes and coordinate with stakeholders as required
• Request Management : Handle user requests – if the request is not runbook-based create a new KB or update runbook accordingly
• Incident Management and Problem Management, Root cause Analysis, coming up with preventive measures and recommendations such as enhancing monitoring or systematic changes as needed.

Skill

Experience / Education

JOb Complexity