Key Skills
Title - Python Azure Lead
Python, Flask, Azure functions, Team handling
We are looking for
- 10+ years relevant data engineering hands on work experience- data ingestion, processing, exploratory analysis to build solutions that deliver value through data as an asset.
- Data engineer build ,test and deploy data pipelines efficiently and reliably move data across systems and should be top of latest architectural trends on AZURE cloud.
- Folks who understand parallel and distributed processing, storage, concurrency, fault tolerant systems.
- Folks who thrive on new technologies, able to adapt and learn easily to meet the needs of next generation engineering challenges.
Technical Skills (Must-Have)
Applied experience with distributed data processing frameworks - Spark , Databricks with Python and SQLMust have worked at least 2 end-end data analytics projects with Databricks Configuration , Unity Catalog, Delta Sharing and medallion architecture.Applied experience with Azure Data services ADLS , Delta Lake , Delta Live Tables , Azure Storage, RBACApplied experience with Unit Testing and System Integration Testing using Python framework.Applied experience with Devops to design and deploy CI / CD pipelines using Jenkins.AZURE Data Engineering(DP203) or DATABRICKS certificationPrior working experience with high performance agile team - Scrum , JIRA ,JFrog and ConfluenceSkills Required
Python, Flask, Azure Functions, Team Handling