Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent leadership, technical, and problem-solving skills.
Key Responsibilities
Leadership : Lead and mentor a team of data engineers, ensuring project deliverables are met with high quality and on time.
Architecture and Design : Design and implement scalable, secure, and efficient data solutions using Azure services.
Development : Build, monitor, and optimize complex data pipelines and workflows using Azure Data Factory and Azure Databricks.
Data Modeling : Design robust data models to support analytical and operational needs.
Programming : Write and optimize SQL queries and utilize PySpark for large-scale data processing and transformation.
Data Governance : Implement data security and governance frameworks using Unity Catalog and ensure compliance with organizational standards.
Collaboration : Work closely with business stakeholders, data scientists, and analysts to understand requirements and translate them into technical solutions.
Problem-Solving : Troubleshoot and resolve data-related issues to ensure seamless operations and data availability.
Process Improvement : Advocate and implement best practices in data engineering, coding standards, and Agile methodologies.
Qualifications and Skills
Experience :
12+ years of professional experience in data engineering and analytics.
7+ years of hands-on expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog.
Leadership : Proven experience in leading and managing engineering teams, with the ability to inspire and guide team members effectively.
Technical Expertise :
Deep understanding of Azure cloud services and data ecosystems.
Strong knowledge of ETL / ELT processes and big data architectures.
Proficient in Python and SQL for data manipulation and analysis.
Soft Skills :
Excellent communication and collaboration abilities in a remote environment.
Problem-solving mindset with a focus on innovation and continuous improvement.
Ability to manage multiple priorities and meet tight deadlines.
Preferred : Familiarity with Agile and DevOps practices.
Interested candidates kindly share their updated profile at- hr@adminlooks.com
Azure Data Engineer • Pune, Maharashtra, India