Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance.
As the undisputed leader in professional services, Our Client is where you will find unrivaled opportunities to succeed and realize your full potential.
We are seeking highly skilled Databricks Data Engineers to join our data modernization team. You will play a pivotal role in designing, developing, and maintaining robust data solutions on the Databricks platform. Your experience in data engineering, along with a deep understanding of Databricks, will be instrumental in building solutions to drive data-driven decision-making across a variety of customers.
Mandatory Skills : Databricks, Spark, Python / SQL
Requirements
Responsibilities
- Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake.
- Build and maintain scalable and efficient data processing workflows using Spark (PySpark or Spark SQL) by following coding standards and best practices.
- Collaborate with technical and business stakeholders to understand data requirements and translate them into technical solutions.
- Develop data models and schemas to support reporting and analytics needs.
- Ensure data quality, integrity, and security by implementing appropriate checks and controls.
- Monitor and optimize data processing performance, identifying, and resolving bottlenecks.
- Stay up to date with the latest advancements in data engineering and Databricks technologies.
Qualifications
Bachelor’s or master’s degree in any field2-6 years of experience in designing, implementing, and maintaining data solutions on DatabricksExperience with at least one of the popular cloud platforms – Azure, AWS or GCP.Experience with ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes.Knowledge of data warehousing and data modelling conceptsExperience with Python or SQLExperience with Delta LakeUnderstanding of DevOps principles and practicesExcellent problem-solving and troubleshooting skills.Strong communication and teamwork skillsBenefits
Work with one of the Big 4's in India
Healthy work Environment
Work Life Balance