Data Engineer (Databricks Admin)

Position: Data Engineer (Databricks Admin)

Location: Nagpur, Pune

Type of Employment: Full-Time

Purpose of the Position:

Design, develop, support, and drive comprehensive data engineering solutions using Databricks

InfoCepts is a global leader of end-to-end data and analytics solutions with nearly 20 years' experience enabling customers to derive value from a variety of data-driven capabilities. Unique among its peers, InfoCepts operates with the scale of a global consulting firm, yet the expertise of a niche partner.

Key Result Areas and Activities:

• Implement enhancements, monitor performance, troubleshoot issues, and deliver continuous support for Databricks jobs in the production environment and perform access management, cluster management for the same
• Conduct unit testing, integration testing, and troubleshooting of ETL processes to ensure data accuracy and reliability
• Manage deployment of Databricks ETL processes from development to production
• Respond to incidents reported by users or monitoring tools, ensuring swift resolution to minimize downtime
• Maintain detailed logs of incidents, resolutions, and troubleshooting steps for knowledge sharing and future reference
• Candidate needs to work in rotational shifts (including on-call, morning, afternoon, night and weekends shift) proving round the clock support for keeping the environments running and performing at optimal levels

Skills Required
Integration Testing, Unit Testing, cluster management , Troubleshooting, Access Management, Databricks