This job offer is not available in your country.

DataBricks Engineer

Talent MaxBangalore

30+ days ago

Job description

Overview

DataBricks Engineer

Experience : 4-7 Years

Location : Bhilai, Indore, Bangalore

Job Description :

We are seeking a skilled DataBricks Engineer to join our team. In this role, you will be

responsible for engineering reliable data pipelines for sourcing, processing, distributing, and

storing data in various ways using cloud data platform infrastructure. Your primary focus will

be on developing data engineering techniques to automate manual processes and solve

complex business problems. Additionally, you will ensure the highest level of data quality

and validation checks within enterprise data lakes.

Roles and Responsibilities :

Design and engineer reliable data pipelines for sourcing, processing, distributing, and

storing data using cloud data platform infrastructure.

Develop data engineering techniques to automate manual processes and address

challenging business problems.

Implement and maintain data quality and validation checks within enterprise data

lakes.

Collaborate with cross-functional teams to understand data requirements and deliver

scalable solutions.

Qualifications :

Bachelor’s degree in Computer Science, Engineering, or a related field.

4+ years of experience working with Big Data Technologies such as Apache Spark,

Kafka, and Data Lakes.

2+ years of experience with Databricks capabilities related to data engineering

Legacy Migration, Delta Lake, Pipeline modernization).

Proficiency in writing code in either Python or Scala, with strong skills in SQL (stored

procs & triggers, dynamic SQL, query optimization).

Hands-on experience with at least one of the leading public cloud data platforms

Azure / AWS / GCP).

Familiarity with data validation and quality frameworks, as well as data lineage

frameworks.

Preferred : Databricks Certified Data Engineer Associate / Professional Certification.

Engineer • Bangalore