Talent.com
Databricks Engineer
Databricks EngineerTTC Group • India, India
No longer accepting applications
Databricks Engineer

Databricks Engineer

TTC Group • India, India
2 days ago
Job description

Role : Databricks Engineer

Position : Remote

Type : Contract

Duration : 3 - 6 months (extendable)

Role Overview

We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing, designing Delta Lake architectures, implementing CI / CD for data workloads, and optimizing Spark jobs for performance and reliability.

Required Skills

  • Strong hands-on experience in building data pipeline using scripting language includes Python, PySpark and SQL
  • Strong working experience with Databricks (Unity Catalog is plus) and Azure Data Factory (ADF)
  • Hands-on working experience with Azure DevOps Repo and CI / CD
  • Strong understanding of modern Data Architecture, Data Warehousing concepts, Data Modelling and ETL / ELT processes
  • Understanding of Agile ways of working
  • Any experience working in DBT is a plus
  • Working with Retail Domain is a plus

Platform Engineering & Operations

  • Configure and optimize Databricks clusters, including autoscaling, cluster sizing, and runtime selection.
  • Manage databases, schemas, and Delta Lake tables, including vacuuming, Z-ordering, partitioning, and optimization.
  • Work with catalogs, Unity Catalog (UC), and access controls for secure data governance.
  • Monitor and troubleshoot performance issues across jobs, clusters, and workflows.
  • CI / CD & DevOps

  • Implement CI / CD pipelines for Databricks workflows using GitHub Actions / Azure DevOps / GitLab.
  • Work with Databricks Repos and Git workflows (branching, PRs, code reviews).
  • Version and promote data pipelines across environments.
  • Cloud & Integration

  • Integrate Databricks with cloud services such as :
  • Azure : ADLS Gen2, Key Vault, ADF, Event Hub, Synapse
  • AWS : S3, Glue, IAM, Lambda, Kinesis (depending on cloud environment)
  • Work with data ingestion frameworks, messaging systems, and event-driven architectures.
  • Quality, Testing & Documentation

  • Implement unit tests and integration tests using pytest, SQL tests, or dbx testing frameworks.
  • Maintain pipeline documentation, data dictionaries, and technical design artifacts.
  • Ensure high data quality, reliability, and observability.
  • Create a job alert for this search

    Engineer • India, India

    Related jobs
    Azure Databricks

    Azure Databricks

    Kumaran Systems • Nagpur, IN
    We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more
    Last updated: 6 days ago • Promoted
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • Nagpur, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 6 days ago • Promoted
    GCP Data Engineer

    GCP Data Engineer

    Xsell Resources • nagpur, maharashtra, in
    Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more
    Last updated: 19 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • India, India
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer

    Data Engineer

    Digitalzone • Nagpur, IN
    As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • India, India
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • Nagpur, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 4 days ago • Promoted
    Databricks Engineer

    Databricks Engineer

    DataE2E Technologies • India, India
    We are looking for an experienced.The ideal candidate has hands-on experience in Databricks production environments, along with. You will collaborate with cross-functional teams to create robust dat...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Nagpur, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer - Palantir Foundry

    Data Engineer - Palantir Foundry

    NP Group • Nagpur, IN
    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript.Long Term (initially 6 months) full time contract.We have an immediate requirement for an experienced Data Engineer to join the glob...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Nagpur, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Nagpur, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Recro • Nagpur, IN
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more
    Last updated: 30+ days ago • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European Careers • Nagpur, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Nagpur, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Nagpur, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 6 days ago • Promoted
    Azure Databricks+Pyspark

    Azure Databricks+Pyspark

    Tata Consultancy Services • Nagpur, IN
    TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad. Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show more
    Last updated: 20 days ago • Promoted
    Data Engineer (GCP)

    Data Engineer (GCP)

    HISH IT SERVICES • Nagpur, IN
    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more
    Last updated: 12 days ago • Promoted