Talent.com
Data Engineer with Databricks Expertise
Data Engineer with Databricks ExpertiseHello World Tech Consulting • Kottayam, IN
No longer accepting applications
Data Engineer with Databricks Expertise

Data Engineer with Databricks Expertise

Hello World Tech Consulting • Kottayam, IN
12 days ago
Job description

Job Summary

We are seeking a highly skilled Data Engineer with Databricks certifications and

extensive practical experience working with the Databricks Lakehouse platform and its

supporting capabilities. The ideal candidate will possess a robust understanding of AWS

services relevant to data engineering and demonstrate proficiency in data pipeline

development, programming, data modeling, and governance.

Key Responsibilities

  • Design and implement data pipelines using AWS and Databricks.
  • Manage and orchestrate data workflows, ensuring eEicient data ingestion

processes.

  • Utilize Delta Lake for data storage and management, ensuring secure data
  • sharing across platforms with Delta Sharing.

  • Implement data governance and access control using Unity Catalog.
  • Apply the Medallion architecture (Bronze, Silver, Gold layers) to projects.
  • Develop and manage ETL pipelines using AWS Glue.
  • Leverage Amazon S3 for data storage and management.
  • Utilize AWS Lambda and Step Functions for serverless computing in data
  • processing.

  • Apply data warehousing solutions and best practices in data transformation.
  • Monitor and implement data quality checks and governance practices.
  • Collaborate with data scientists, analysts, and other stakeholders in an Agile
  • environment.

  • Deliver large-scale data processing and analytics projects within cloud
  • environments.

    Required Skills and Qualifications

  • Databricks certifications with practical experience in the Databricks Lakehouse
  • platform.

  • Proficient in AWS services : Glue, S3, Lambda, Step Functions, and data
  • warehousing solutions.

  • Strong programming skills in Python, Scala, or Java.
  • Proficient in SQL for querying and manipulating data.
  • Experience in data modeling for Lakehouse architecture.
  • Knowledge of ETL best practices and data transformation techniques.
  • Understanding of data governance frameworks and practices.
  • Proven track record of delivering data engineering projects, particularly in cloud
  • environments.

  • Experience with large-scale data processing and analytics projects.
  • Ability to work in Agile teams and collaborate eEectively with various
  • stakeholders.

    Preferred Qualifications

  • Advanced AWS certifications.
  • Experience with additional cloud platforms (e.g., Azure).
  • Familiarity with other data engineering tools and frameworks.
  • Create a job alert for this search

    Data Engineer • Kottayam, IN

    Related jobs
    Data Engineer

    Data Engineer

    Randstad Enterprise • Kottayam, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    System Soft Technologies • Kottayam, IN
    Location : Remote (3–4-hour time zone overlaps with EST if off shore).Experience with next flow is required, as the consultant will make targeted enhancements to existing workflows and pipelines.Whi...Show more
    Last updated: 16 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Kottayam, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Kochi, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Alappuzha, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Kottayam, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Alappuzha, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    BayOne Solutions • Kochi, IN
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Alappuzha, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 12 days ago • Promoted
    Data Engineer

    Data Engineer

    Sikich India • Kottayam, IN
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Kochi, Kerala, India
    TCS present an excellent opportunity for Data Engineer.Experience required : 7- 12 yrs.Skills : Python, Pyspark, SQL, GCP. Walk in Interview Date : 22-Nov-25 (Saturday).Address : TCS Center, Infopark Ko...Show more
    Last updated: 7 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Alappuzha, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 7 days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • Alappuzha, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 4 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Kochi, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 6 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    K&K Talents • Kottayam, IN
    This position is with one of our.Role : Senior Data Engineer (Tableau + Real Estate Domain).Pune | Bangalore | Hyderabad | Gurgaon | Chennai | Noida | Mumbai. Tableau | ETL / ELT | SQL | Python | Snow...Show more
    Last updated: 1 day ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Kochi, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 20 days ago • Promoted
    Databricks Engineer

    Databricks Engineer

    DataE2E Technologies • Alappuzha, IN
    We are looking for an experienced.The ideal candidate has hands-on experience in Databricks production environments, along with. You will collaborate with cross-functional teams to create robust dat...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Aceolution • Alappuzha, IN
    Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
    Last updated: 30+ days ago • Promoted