Data Engineer - Spark / Azure Databricks

Position Name : Data Engineer

Location : Bangalore

Experience Range : 3+ Years

Mandatory Requirement :

Our client is seeking a skilled Data Engineer with a strong foundation in Spark, Databricks, and Data Factory to join their dynamic team.

The ideal candidate will have a proven track record in building and maintaining data pipelines, working with large datasets, and utilizing Azure cloud services.

Key requirements include :

• Proficiency in Spark, with intermediate to expert level expertise.
• Strong hands-on experience with Databricks, ranging from intermediate to expert level.
• Familiarity with Azure Data Factory (ADF), with skills ranging from beginner to intermediate.
• Ability to utilize Pyspark and work with Data Bricks for efficient data processing and analysis.
• Understanding of various data storage concepts including Bronze, Silver, and Gold layers.
• Experience with Delta Tables, Delta Live Tables, and Delta Sharing for data management.
• Knowledge of medallion architecture and cluster management for optimal performance.
• Familiarity with Python, Pandas, and Scala for data manipulation and transformation.
• Proficiency in utilizing dbutils for streamlined operations within Databricks environment.

About the Client :

Our client is an esteemed industry leader dedicated to protecting the rights of residential and commercial property owners from unforeseen legal and financial claims post-property transactions.

With expertise spanning across states and localities, they stand out for their ability to handle diverse challenges.

The client has consistently garnered recognition from highly respected organizations, earning accolades including :

(ref : hirist.tech)