Talent.com
Data Engineer with Databricks Expertise
Data Engineer with Databricks ExpertiseHello World Tech Consulting • Nagpur, IN
Data Engineer with Databricks Expertise

Data Engineer with Databricks Expertise

Hello World Tech Consulting • Nagpur, IN
1 day ago
Job description

Job Summary

We are seeking a highly skilled Data Engineer with Databricks certifications and

extensive practical experience working with the Databricks Lakehouse platform and its

supporting capabilities. The ideal candidate will possess a robust understanding of AWS

services relevant to data engineering and demonstrate proficiency in data pipeline

development, programming, data modeling, and governance.

Key Responsibilities

  • Design and implement data pipelines using AWS and Databricks.
  • Manage and orchestrate data workflows, ensuring eEicient data ingestion

processes.

  • Utilize Delta Lake for data storage and management, ensuring secure data
  • sharing across platforms with Delta Sharing.

  • Implement data governance and access control using Unity Catalog.
  • Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.
  • Develop and manage ETL pipelines using AWS Glue.
  • Leverage Amazon S3 for data storage and management.
  • Utilize AWS Lambda and Step Functions for serverless computing in data
  • processing.

  • Apply data warehousing solutions and best practices in data transformation.
  • Monitor and implement data quality checks and governance practices.
  • Collaborate with data scientists, analysts, and other stakeholders in an Agile
  • environment.

  • Deliver large-scale data processing and analytics projects within cloud
  • environments.

    Required Skills and Qualifications

  • Databricks certifications with practical experience in the Databricks Lakehouse
  • platform.

  • Proficient in AWS services : Glue, S3, Lambda, Step Functions, and data
  • warehousing solutions.

  • Strong programming skills in Python, Scala, or Java.
  • Proficient in SQL for querying and manipulating data.
  • Experience in data modeling for Lakehouse architecture.
  • Knowledge of ETL best practices and data transformation techniques.
  • Understanding of data governance frameworks and practices.
  • Proven track record of delivering data engineering projects, particularly in cloud
  • environments.

  • Experience with large-scale data processing and analytics projects.
  • Ability to work in Agile teams and collaborate eEectively with various
  • stakeholders.

    Preferred Qualifications

  • Advanced AWS certifications.
  • Experience with additional cloud platforms (e.g., Azure).
  • Familiarity with other data engineering tools and frameworks.
  • Create a job alert for this search

    Data Engineer • Nagpur, IN

    Related jobs
    Data Engineer

    Data Engineer

    Randstad Enterprise • Nagpur, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Nagpur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    INDI Staffing Services • Nagpur, IN
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 9 days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • India, India
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 10 days ago • Promoted
    Google Looker Data Engineer

    Google Looker Data Engineer

    Insight Global • Nagpur, IN
    We’re seeking a skilled Data Engineer to support a major reporting migration from Tableau to Google Looker.This role focuses on designing and building scalable data models, data marts, and ETL / ELT ...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Sapphire Software Solutions Inc • Nagpur, IN
    A global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is looking to build out a data lake to encompass both internal and...Show more
    Last updated: 18 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    Dexian India • Nagpur, IN
    Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from vari...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Nagpur, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Nagpur, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Nagpur, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • Nagpur, IN
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Veraxion • Nagpur, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Nagpur, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 1 day ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    K&K Talents - India • Nagpur, IN
    This position is with one of our.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.Employment Type : Full-time Permanent. We are seeking an experienced Data Engineer with strong...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Nagpur, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data & Analytics Engineer

    Data & Analytics Engineer

    APPIT Software Inc • Nagpur, IN
    Data Engineer : Snowflake -Mandatory – Hands -on Experience.ETL Tool -Informatica [IVS version],BDT.GCP : Big query – Mandatory -handson experience. Data Modelling & Data Warehouse -Mandatory -Hands...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Nagpur, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    RapidBrains • Nagpur, IN
    Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
    Last updated: 18 hours ago • Promoted • New!