Talent.com
Data Engineer with Databricks Expertise
Data Engineer with Databricks ExpertiseHello World Tech Consulting • baddi, India
Data Engineer with Databricks Expertise

Data Engineer with Databricks Expertise

Hello World Tech Consulting • baddi, India
13 hours ago
Job description

Job Summary

We are seeking a highly skilled Data Engineer with Databricks certifications and

extensive practical experience working with the Databricks Lakehouse platform and its

supporting capabilities. The ideal candidate will possess a robust understanding of AWS

services relevant to data engineering and demonstrate proficiency in data pipeline

development, programming, data modeling, and governance.

Key Responsibilities

  • Design and implement data pipelines using AWS and Databricks.
  • Manage and orchestrate data workflows, ensuring eEicient data ingestion

processes.

  • Utilize Delta Lake for data storage and management, ensuring secure data
  • sharing across platforms with Delta Sharing.

  • Implement data governance and access control using Unity Catalog.
  • Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.
  • Develop and manage ETL pipelines using AWS Glue.
  • Leverage Amazon S3 for data storage and management.
  • Utilize AWS Lambda and Step Functions for serverless computing in data
  • processing.

  • Apply data warehousing solutions and best practices in data transformation.
  • Monitor and implement data quality checks and governance practices.
  • Collaborate with data scientists, analysts, and other stakeholders in an Agile
  • environment.

  • Deliver large-scale data processing and analytics projects within cloud
  • environments.

    Required Skills and Qualifications

  • Databricks certifications with practical experience in the Databricks Lakehouse
  • platform.

  • Proficient in AWS services : Glue, S3, Lambda, Step Functions, and data
  • warehousing solutions.

  • Strong programming skills in Python, Scala, or Java.
  • Proficient in SQL for querying and manipulating data.
  • Experience in data modeling for Lakehouse architecture.
  • Knowledge of ETL best practices and data transformation techniques.
  • Understanding of data governance frameworks and practices.
  • Proven track record of delivering data engineering projects, particularly in cloud
  • environments.

  • Experience with large-scale data processing and analytics projects.
  • Ability to work in Agile teams and collaborate eEectively with various
  • stakeholders.

    Preferred Qualifications

  • Advanced AWS certifications.
  • Experience with additional cloud platforms (e.g., Azure).
  • Familiarity with other data engineering tools and frameworks.
  • Create a job alert for this search

    Data Engineer • baddi, India

    Related jobs
    Data Engineer

    Data Engineer

    Recro • panchkula, haryana, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    thinkbridge • baddi, himachal pradesh, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtree • baddi, himachal pradesh, in
    Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer with Databricks Expertise

    Data Engineer with Databricks Expertise

    Hello World Tech Consulting • baddi, himachal pradesh, in
    We are seeking a highly skilled Data Engineer with Databricks certifications and.Databricks Lakehouse platform and its.The ideal candidate will possess a robust understanding of AWS.Design and impl...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • baddi, himachal pradesh, in
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • panchkula, haryana, in
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Veraxion • panchkula, haryana, in
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more
    Last updated: 21 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • panchkula, haryana, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 19 days ago • Promoted
    Data Engineer

    Data Engineer

    Sapphire Software Solutions Inc • baddi, himachal pradesh, in
    A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Dexian India • baddi, himachal pradesh, in
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show more
    Last updated: 11 days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • baddi, himachal pradesh, in
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    K&K Talents - India • panchkula, haryana, in
    This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent. We are seeking an experienced Data Engineer with strong...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • panchkula, haryana, in
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • baddi, himachal pradesh, in
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • baddi, himachal pradesh, in
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 11 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Insight Global • panchkula, haryana, in
    The Senior Data Engineer is responsible for building and optimizing ETL / ELT pipelines that process terabytes of data daily across 186 data assets, implementing BigQuery datasets with enterprise-sca...Show more
    Last updated: 2 days ago • Promoted
    Google Looker Data Engineer

    Google Looker Data Engineer

    Insight Global • baddi, himachal pradesh, in
    We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • baddi, himachal pradesh, in
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted