No longer accepting applications

Data Engineer with Databricks Expertise

Hello World Tech Consultingthane, India

7 days ago

Job description

Job Summary

We are seeking a highly skilled Data Engineer with Databricks certifications and

extensive practical experience working with the Databricks Lakehouse platform and its

supporting capabilities. The ideal candidate will possess a robust understanding of AWS

services relevant to data engineering and demonstrate proficiency in data pipeline

development, programming, data modeling, and governance.

Key Responsibilities

Design and implement data pipelines using AWS and Databricks.
Manage and orchestrate data workflows, ensuring eEicient data ingestion

processes.

Utilize Delta Lake for data storage and management, ensuring secure data

sharing across platforms with Delta Sharing.

Implement data governance and access control using Unity Catalog.

Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.

Develop and manage ETL pipelines using AWS Glue.

Leverage Amazon S3 for data storage and management.

Utilize AWS Lambda and Step Functions for serverless computing in data

processing.

Apply data warehousing solutions and best practices in data transformation.

Monitor and implement data quality checks and governance practices.

Collaborate with data scientists, analysts, and other stakeholders in an Agile

environment.

Deliver large-scale data processing and analytics projects within cloud

environments.

Required Skills and Qualifications

Databricks certifications with practical experience in the Databricks Lakehouse

platform.

Proficient in AWS services : Glue, S3, Lambda, Step Functions, and data

warehousing solutions.

Strong programming skills in Python, Scala, or Java.

Proficient in SQL for querying and manipulating data.

Experience in data modeling for Lakehouse architecture.

Knowledge of ETL best practices and data transformation techniques.

Understanding of data governance frameworks and practices.

Proven track record of delivering data engineering projects, particularly in cloud

environments.

Experience with large-scale data processing and analytics projects.

Ability to work in Agile teams and collaborate eEectively with various

stakeholders.

Preferred Qualifications

Advanced AWS certifications.

Experience with additional cloud platforms (e.g., Azure).

Familiarity with other data engineering tools and frameworks.

Create a job alert for this search

Data Engineer • thane, India

Related jobs

Promoted

Data Engineer

RecroThane, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Tata Consultancy ServicesThane, IN

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show moreLast updated: 30+ days ago

Promoted

Alteryx Data Engineer

CollinsonMumbai, Maharashtra, India

Location - Mumbai Purpose of the job.Collinson, Working within the Transformation Team, you will be responsible for delivering key elements of our transformation programme.You will create new, and ...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SGS & Codombivli, maharashtra, in

Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 17 days ago

Promoted

Data Engineer

EnvuThane, Maharashtra, India

At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

MindlanceMumbai, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago

Promoted

Data Engineer

MyData Insights Pvt LtdKalyan-Dombivli, IN

The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show moreLast updated: 1 day ago

Promoted

Data Engineer

IntraEdgeMumbai, IN

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

ACL DigitalMumbai, Maharashtra, India

Hello connections! We have urgent openings for AWS Data Engineer.Job Description : We are seeking an experienced Data Engineer to join our team and contribute to the building, development, and sup...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Insight GlobalKalyan-Dombivli, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

AceolutionThane, IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago

Promoted
New!

AWS Data Engineer

COVET IT INCMumbai, IN

Please go through the below requirements and let me know your interest and forward your resume along with your contact information to raja@covetitinc. We are seeking a highly skilled AWS Data Engine...Show moreLast updated: 2 hours ago

Promoted

Data Engineer

ModulrMumbai, Maharashtra, India

The Data Engineer is a vital role within Modulr and this role will support the continuous improvement and innovation of our data platform, ensuring processes are robust, efficient and scalable.Extr...Show moreLast updated: 8 days ago

Promoted

AWS Data Engineer

Tata Consultancy Servicesmumbai city, maharashtra, in

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 26 days ago

Promoted

Databricks Engineer

TTC GroupMumbai, IN

We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago

Promoted

Data Engineer

Persistent SystemsMumbai, Maharashtra, India

About Position : As a Data Engineer, you will design and manage robust data pipelines using Azure Databricks, Spark, and Kafka. You'll process large-scale datasets and implement CDC pipelines to pow...Show moreLast updated: 7 days ago

Promoted

Data Engineer

DigitalzoneMumbai, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago

Promoted

GCP Data Engineer

AdastraKalyan-Dombivli, IN

We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show moreLast updated: 4 days ago