No longer accepting applications

Data Engineer with Databricks Expertise

Hello World Tech ConsultingKakinada, IN

9 days ago

Job description

Job Summary

We are seeking a highly skilled Data Engineer with Databricks certifications and

extensive practical experience working with the Databricks Lakehouse platform and its

supporting capabilities. The ideal candidate will possess a robust understanding of AWS

services relevant to data engineering and demonstrate proficiency in data pipeline

development, programming, data modeling, and governance.

Key Responsibilities

Design and implement data pipelines using AWS and Databricks.
Manage and orchestrate data workflows, ensuring eEicient data ingestion

processes.

Utilize Delta Lake for data storage and management, ensuring secure data

sharing across platforms with Delta Sharing.

Implement data governance and access control using Unity Catalog.

Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.

Develop and manage ETL pipelines using AWS Glue.

Leverage Amazon S3 for data storage and management.

Utilize AWS Lambda and Step Functions for serverless computing in data

processing.

Apply data warehousing solutions and best practices in data transformation.

Monitor and implement data quality checks and governance practices.

Collaborate with data scientists, analysts, and other stakeholders in an Agile

environment.

Deliver large-scale data processing and analytics projects within cloud

environments.

Required Skills and Qualifications

Databricks certifications with practical experience in the Databricks Lakehouse

platform.

Proficient in AWS services : Glue, S3, Lambda, Step Functions, and data

warehousing solutions.

Strong programming skills in Python, Scala, or Java.

Proficient in SQL for querying and manipulating data.

Experience in data modeling for Lakehouse architecture.

Knowledge of ETL best practices and data transformation techniques.

Understanding of data governance frameworks and practices.

Proven track record of delivering data engineering projects, particularly in cloud

environments.

Experience with large-scale data processing and analytics projects.

Ability to work in Agile teams and collaborate eEectively with various

stakeholders.

Preferred Qualifications

Advanced AWS certifications.

Experience with additional cloud platforms (e.g., Azure).

Familiarity with other data engineering tools and frameworks.

Create a job alert for this search

Data Engineer • Kakinada, IN

Related jobs

Promoted

Data Engineer

HCLTechKakinada, IN

We’re Expanding Our Digital & Data Talent Pool.Are you a professional ready to take on enterprise-scale transformation journey? We are on a mass hiring drive and looking for experts who can bring i...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

OWOWKakinada, IN

Data Engineer – AI-Powered Marketing Personalization Platform.AI-powered marketing personalization platform (V2.You’ll design and implement a robust multi-database infrastructure that enables real-...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

K&K Talents - IndiaKakinada, IN

This position is with one of our clients in.Location : Chennai ,Bangalore , Hyderabad , Gurgaon , Bhopal, Pune,Jaipur.Experience in data engineering, with a focus on data architecture and pipeline d...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

JIT Global Infosystems Pvt. Ltd.Kakinada, IN

Applications, Analytics, and Consulting services to clients worldwide.By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance.Our ex...Show moreLast updated: 1 day ago

Promoted

Data Engineer

Insight GlobalKakinada, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Ubique SystemsKakinada, IN

Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

IntraEdgeKakinada, IN

Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show moreLast updated: 30+ days ago

Promoted

Databricks Engineer

TTC GroupKakinada, IN

We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 1 day ago

Promoted

Data Engineer

AceolutionKakinada, IN

Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

RecroKakinada, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

MindlanceKakinada, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 1 day ago

Promoted

Data Engineer (Remote)

QAAgility TechnologiesKakinada, IN

Remote

The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines that support key business functions across the supply chain domain.This role requires strong...Show moreLast updated: 1 day ago

Promoted

Data Engineer

NexionPro ServicesKakinada, IN

PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show moreLast updated: 1 day ago

Promoted

Data Engineer

Randstad EnterpriseKakinada, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Alp Consulting Ltd.Kakinada, IN

Architect and maintain our Amazon Redshift Serverless data warehouse.Design and implement ETL pipelines from operational Redshift to staging (DSA), landing (DLA), and TDW layers.Model data using st...Show moreLast updated: 30+ days ago

Promoted

Data Engineer (GCP)

HISH IT SERVICESKakinada, IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show moreLast updated: 9 days ago

Promoted

Data Engineer

DigitalzoneKakinada, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 17 days ago

Promoted

Data Engineer | Bangalore | Leading Big 4 Consulting Firm

Acme ServicesKakinada, IN

Design, develop, and maintain scalable and robust data pipelines (ETL / ELT) using PySpark on the Databricks platform.Implement data ingestion strategies to load data from various sources (e.APIs, da...Show moreLast updated: 1 day ago