IN_Manager_Azure Data Engineer_Data and Analytics_Advisory_Gurugram

Description

: Key Responsibilities :

• Designs, implements and maintains reliable and scalable data infrastructure on Azure
• Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data
• Develops, and delivers large-scale data ingestion, data processing, and data transformation projects on the Azure cloud
• Mentors and shares knowledge with the team to provide design reviews, discussions and prototypes
• Works with customers to deploy, manage, and audit standard processes for cloud products
• Adheres to and advocates for software & data engineering standard processes (e.g. Data Engineering pipelines, unit testing, monitoring, alerting, source control, code review & documentation)
• Deploys secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI / CD pipeline
• Part of a cross-disciplinary team working closely with other data engineers, Architects, software engineers, data scientists, data managers and business partners in a Scrum / Agile setup Job Requirements : Education : Bachelor or higher degree in computer science, Engineering, Information Systems or other quantitative fields Experience : 1) Years of experience : 3to 12 years relevant experience 2) Deep and hands-on experience building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments 3) Hands on experience with : b) Configuring Delta Lake on Azure Databricks – good to have c) Languages : SQL, pyspark, python - must d) Cloud platforms : Azure - must e) Azure Data Factory (must) , Azure Data Lake (must), Azure SQL DB (must), Synapse (must), SQL Pools (must), Databricks (good to have) f) Building data solutions in Azure incl. data distributions and partitions, scalability, cost-management, disaster recovery and high availability

g) Azure Devops (or similar tools) for source control & building CI / CD pipelines – good to have 4) Experience in implementing large-scale distributed systems 5) Customer management and front-ending and ability to lead large organizations through influence Desirable Criteria :

Mandatory skill sets :

‘Must have’ knowledge, skills and experiences Azure data lake, ADF, spark, SQL, pyspark, spark-SQL,

Preferred skill sets :

‘Good to have’ knowledge, skills and experiences Cosmos DB, Data modeling, Databricks,. Depth : Candidate should have in-depth hands-on experience w.r.t end to end solution designing in Azure data lake, ADF pipeline development and debugging, various file formats, Synapse and Databricks with excellent coding skills in PySpark and SQL with logic building capabilities. He / she should have sound knowledge of optimizing workloads.

Years of experience required :

3 to 12 years relevant experience

Education qualification :

o BE, B.Tech, ME, M,Tech, MBA, MCA (60% above)

Education

Degrees / Field of Study required : Master of Business Administration, Master of Engineering, Bachelor of EngineeringDegrees / Field of Study preferred :

Certifications

Required Skills

Microsoft Azure

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Analytical Thinking, Apache Airflow, Apache Hadoop, Azure Data Factory, Coaching and Feedback, Communication, Creativity, Data Anonymization, Data Architecture, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Databricks Unified Data Analytics Platform, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling {+ 32 more}

Desired Languages

Travel Requirements

Not Specified

Available for Work Visa Sponsorship?

No

Government Clearance Required?

No

Job Posting End Date