Azure Data Engineer –100 Remote

Job Title: Azure Data Engineer - HCSC

Experience:5 Years

Location:Remote

Contract Tenure:6 Months

Rate:80-90KPM

Mandatory Skills

• Azure Data Engineering
• Azure Databricks
• Python
• PySpark
• Hive
• Sqoop
• Hadoop
• Unix Shell Scripting
• CI/CD (Azure DevOps or similar)
• Performance Tuning in Databricks
• ETL Pipeline Development
• Excellent Communication Skills

Responsibilities

• Design develop and maintain scalable data pipelines using Azure Databricks Python and PySpark.
• Build and optimize ETL processes for large-scale data processing.
• Perform performance tuning and optimization of Databricks workloads handling high-volume data.
• Develop and maintain Unix shell scripts for automation and operational tasks.
• Work with Big Data technologies including Hive Sqoop and Hadoop.
• Implement and manage CI/CD pipelines for ETL deployments using DevOps tools.
• Schedule and monitor batch jobs using tools such as Ctrl-M.
• Collaborate with client stakeholders to understand business requirements and deliver high-quality data solutions.
• Troubleshoot production issues and ensure timely resolution.
• Work independently while maintaining effective communication with client and project teams.

Required Skills:

Azure data engineerAzure databricks

Employment Type : Full Time
Experience: years
Vacancy: 1