Talent.com
This job offer is not available in your country.
Data Engineer - Databricks Expert

Data Engineer - Databricks Expert

Nebula Tech Solutionskolkata, west bengal, in
3 days ago
Job description

Data Engineer – Databricks Expert

📍 Remote (India-based) | 🕒 Full-time | 🎯 Immediate Joiners Preferred

Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a seasoned Data Engineer to join our team and work on high-impact data products for a leading global client.

🔧 Tech Stack & Skills

  • 5+ years in Python (incl. Pytest for testing)
  • 7+ years of SQL & Query Optimization
  • 3+ years of API development
  • Hands-on with Databricks CLI , DLT Pipelines , Unity Catalog , and Delta Lake
  • Strong grasp of Apache Spark , Structured Streaming , Medallion Architecture
  • Familiarity with Databricks Workflows , Asset Bundles , and REST APIs
  • Solid understanding of CDC (Debezium preferred)
  • Exposure to AWS , DevOps , CI / CD , and Git
  • Experience with SQL Server , Data Warehousing , Semi-Structured Data , and MS SSIS

📌 Key Responsibilities

  • Develop and deploy robust DLT pipelines , workflows, and ingestion tasks
  • Maintain production streaming and batch jobs with tight SLAs
  • Monitor pipelines daily, troubleshoot failures, and document resolutions
  • Analyze data lineage using codebase and Databricks tools
  • Collaborate to automate data quality checks
  • Write clean code, conduct PRs, testing, and deployments
  • Communicate clearly on incidents, blockers, and task progress
  • 💼 What You Bring

  • Strong problem-solving mindset
  • Passion for clean, scalable, and well-documented code
  • Ability to work independently and in a fast-paced environment
  • Comfortable collaborating across time zones
  • Create a job alert for this search

    Data Engineer • kolkata, west bengal, in

    Related jobs
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladekolkata, west bengal, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 17 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDkolkata, west bengal, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 17 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncKolkata, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceskolkata, west bengal, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHkolkata, west bengal, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKolkata, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softkolkata, west bengal, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyKolkata, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    KPG99 INCKolkata, IN
    Duration- 12+ months with Extensions.REQUIRED SKILLS AND EXPERIENCE.Strong hands-on experience with Databricks for data processing and pipeline development. Proficiency in SQL for data querying, tra...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Digivance SolutionsKolkata, IN
    Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR.Collaborate with business and technology stakeholders to understand current and future data requirements. Design, build, and maintain reliable,...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Mastekkolkata, west bengal, in
    Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background).We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team.The ideal ...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesKolkata, IN
    Google Cloud Data Engineering services.Proficiency in designing and maintaining.Apache Airflow, Talend, or Informatica.Git for collaborative development.Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaKolkata, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadykolkata, west bengal, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisKolkata, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseKolkata, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKolkata, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalKolkata, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 7 days ago