Company Name : Our client a new GCC in Bangalore.
Role : Data engineering Leader
Location : Bangalore (Work from Office)
Key Responsibilities
- Lead a technical team effectively while fostering collaboration across onshore and offshore teams.
- Maintain a hands-on approach by actively writing and reviewing code daily.
- Ensure team adherence to established data governance policies and standards.
- Oversee the design, development, and maintenance of new and existing data pipelines.
- Conduct regular code reviews and provide mentorship to the data engineering team.
- Collaborate with the Head of Engineering to align with platform strategy and roadmap.
- Support the Head of Engineering in managing software engineers as needed.
Qualifications and Skills
Bachelor's, Master's, or Ph.D. in Computer Science or a related discipline.A minimum of 8 years of experience in data engineering or related fields.Proven expertise in working with Databricks.Advanced knowledge of Azure Data Lake, Parquet, and Delta tables.Strong experience with structured and semi-structured datasets.Comprehensive understanding of ELT / ETL processes and their implementation in data pipelines.Proficiency in developing, implementing, and integrating notebooks within data pipelines.Expertise in configuring and managing data ingestion pipelines using Azure Data Factory or Databricks.Extensive experience in programming languages such as Python, R, and SQL.Familiarity with consuming and processing data from secure REST APIs.Experience with data visualization tools like Power BI or Spotfire.Knowledge of Azure DevOps (or similar tools) and CI / CD methodologies.Strong communication skills with the ability to propose and discuss solutions effectively with both technical and business stakeholders.Capability to present project updates and metrics to senior management.