Databricks Lead - Python Frameworks

Skill : Python + Databricks Lead

Exp : 8 to 12 years

Loc : Pune (Preferred), Hyderabad, Chennai, Mumbai, Bangalore, Noida, Kolkata

NP : Immediate Joiners to 30 days

Work Mode : Hybrid

Job Description :

- Lead and support the development and enhancement of data pipelines & Stored Procedures using Python.

- Provide support for existing data pipelines, ensuring smooth data flow and timely issue resolution.

- Develop and implement enhancements to data pipelines using Python to improve performance and scalability.

- Collaborate with cross-functional teams to gather requirements and design efficient data processing solutions.

- Monitor pipeline performance and troubleshoot any data-related issues proactively.

- Lead the team by providing technical guidance, mentoring, and coordinating tasks to meet project deadlines.

Roles and Responsibilities :

- Lead and manage a team of data engineers focused on pipeline development and support.

- Oversee the design, development, and deployment of robust data pipelines using Python.

- Ensure data quality, integrity, and security throughout the pipeline processes.

- Collaborate with stakeholders to understand business needs and translate them into technical solutions.

- Conduct code reviews, provide constructive feedback, and enforce best practices.

- Drive continuous improvement initiatives to optimize pipeline efficiency and reliability.

- Facilitate communication within the team and across departments to ensure alignment and successful project delivery.

(ref:hirist.tech)