Talent.com
This job offer is not available in your country.
Data Engineer - Databricks Expert

Data Engineer - Databricks Expert

Nebula Tech Solutionsmalappuram, kerala, in
13 hours ago
Job description

Data Engineer – Databricks Expert

📍 Remote (India-based) | 🕒 Full-time | 🎯 Immediate Joiners Preferred

Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a seasoned Data Engineer to join our team and work on high-impact data products for a leading global client.

🔧 Tech Stack & Skills

  • 5+ years in Python (incl. Pytest for testing)
  • 7+ years of SQL & Query Optimization
  • 3+ years of API development
  • Hands-on with Databricks CLI , DLT Pipelines , Unity Catalog , and Delta Lake
  • Strong grasp of Apache Spark , Structured Streaming , Medallion Architecture
  • Familiarity with Databricks Workflows , Asset Bundles , and REST APIs
  • Solid understanding of CDC (Debezium preferred)
  • Exposure to AWS , DevOps , CI / CD , and Git
  • Experience with SQL Server , Data Warehousing , Semi-Structured Data , and MS SSIS

📌 Key Responsibilities

  • Develop and deploy robust DLT pipelines , workflows, and ingestion tasks
  • Maintain production streaming and batch jobs with tight SLAs
  • Monitor pipelines daily, troubleshoot failures, and document resolutions
  • Analyze data lineage using codebase and Databricks tools
  • Collaborate to automate data quality checks
  • Write clean code, conduct PRs, testing, and deployments
  • Communicate clearly on incidents, blockers, and task progress
  • 💼 What You Bring

  • Strong problem-solving mindset
  • Passion for clean, scalable, and well-documented code
  • Ability to work independently and in a fast-paced environment
  • Comfortable collaborating across time zones
  • Create a job alert for this search

    Data Engineer • malappuram, kerala, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainMalappuram, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaThrissur, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Digivance SolutionsThrissur, IN
    Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR.Collaborate with business and technology stakeholders to understand current and future data requirements. Design, build, and maintain reliable,...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KPG99 INCThrissur, IN
    Duration- 12+ months with Extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Proficiency in SQL for data querying, tra...Show moreLast updated: 4 days ago
    • Promoted
    SAP Data Engineer (Datasphere)

    SAP Data Engineer (Datasphere)

    KPG99 INCMalappuram, IN
    Duration : 12-month contract with extensions.Candidates' Core Skillset Must Be : .SAP ABAP, HANA / AMDP / CDS, SOAP / OData / Rest API’s etc.Show moreLast updated: 2 days ago
    • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIGKozhikode, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer - Scala

    Data Engineer - Scala

    Idyllic ServicesKozhikode, IN
    Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 3 days ago
    • Promoted
    Contract role -Databricks Engineer

    Contract role -Databricks Engineer

    KPG99 INCMalappuram, IN
    Duration : 12 months with extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Python for data manipulation and automatio...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisMalappuram, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 4 days ago
    • Promoted
    Databricks Data Engineer

    Databricks Data Engineer

    Insight GlobalMalappuram, IN
    Insight Global is seeking a Databricks Data Engineer in India with with 3–5 years of experience to support data engineering initiatives in the pharmaceutical domain. The ideal candidate will have ha...Show moreLast updated: 3 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseKozhikode, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 26 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    OWOWThrissur, IN
    Data Architecture & Infrastructure (40%) .Design and implement a multi-database architecture (MongoDB, Redis, Milvus, Neo4j, BigQuery) . Build scalable data pipelines for real-time conversation proc...Show moreLast updated: 3 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncMalappuram, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 14 days ago
    • Promoted
    SAP Data Engineer (DataSphere / BW / HANA / Data Modeling)

    SAP Data Engineer (DataSphere / BW / HANA / Data Modeling)

    KPG99 INCThrissur, IN
    Role : SAP Data Engineer (DataSphere / BW / HANA / Data Modeling).Duration : 12-month contract with extensions.Provide state-of-the-art technical support for the SAP Datasphere, BW4 Systems maintenance and...Show moreLast updated: 2 days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    KPG99 INCKozhikode, IN
    REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development.Proficiency in SQL for data querying, transformation, and troubleshooting.Soli...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKozhikode, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeThrissur, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyKozhikode, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Databricks Engineer

    Databricks Engineer

    Sapphire Software Solutions IncMalappuram, IN
    Duration : 12 months with extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Proficiency in SQL for data querying, tran...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalThrissur, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 4 days ago