Databricks EngineerTTC Group • rajkot, gujarat, in

No longer accepting applications

Databricks Engineer

TTC Group • rajkot, gujarat, in

5 days ago

Job description

Role : Databricks Engineer

Position : Remote

Type : Contract

Duration : 3 - 6 months (extendable)

Role Overview

We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing, designing Delta Lake architectures, implementing CI / CD for data workloads, and optimizing Spark jobs for performance and reliability.

Required Skills

Strong hands-on experience in building data pipeline using scripting language includes Python, PySpark and SQL
Strong working experience with Databricks (Unity Catalog is plus) and Azure Data Factory (ADF)
Hands-on working experience with Azure DevOps Repo and CI / CD
Strong understanding of modern Data Architecture, Data Warehousing concepts, Data Modelling and ETL / ELT processes
Understanding of Agile ways of working
Any experience working in DBT is a plus
Working with Retail Domain is a plus

Platform Engineering & Operations

Configure and optimize Databricks clusters, including autoscaling, cluster sizing, and runtime selection.

Manage databases, schemas, and Delta Lake tables, including vacuuming, Z-ordering, partitioning, and optimization.

Work with catalogs, Unity Catalog (UC), and access controls for secure data governance.

Monitor and troubleshoot performance issues across jobs, clusters, and workflows.

CI / CD & DevOps

Implement CI / CD pipelines for Databricks workflows using GitHub Actions / Azure DevOps / GitLab.

Work with Databricks Repos and Git workflows (branching, PRs, code reviews).

Version and promote data pipelines across environments.

Cloud & Integration

Integrate Databricks with cloud services such as :

Azure : ADLS Gen2, Key Vault, ADF, Event Hub, Synapse

AWS : S3, Glue, IAM, Lambda, Kinesis (depending on cloud environment)

Work with data ingestion frameworks, messaging systems, and event-driven architectures.

Quality, Testing & Documentation

Implement unit tests and integration tests using pytest, SQL tests, or dbx testing frameworks.

Maintain pipeline documentation, data dictionaries, and technical design artifacts.

Ensure high data quality, reliability, and observability.

Create a job alert for this search

Engineer • rajkot, gujarat, in

Related jobs

Data Engineer

Digitalzone • Rajkot, IN

As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Develop and maintain scalable ETL / ELT pipelines using Py...Show more

Last updated: 21 days ago • Promoted

Data Engineer

Insight Global • Rajkot, IN

GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Randstad Enterprise • Rajkot, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Recro • Rajkot, IN

Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show more

Last updated: 30+ days ago • Promoted

Data Engineer

Net2Source (N2S) • Rajkot, IN

Join a Global Leader in Workforce Solutions – Net2Source Inc.Operating in 32 countries | 5,500+ Employees.Job Type : Contract – 6 months ext. Databricks hands-on experience and.Strong Python and SQL ...Show more

Last updated: 16 hours ago • Promoted • New!

(Senior) Azure Data Engineer - Full remote - contractor in USD

All European Careers • Rajkot, IN

Remote

For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more

Last updated: 7 days ago • Promoted

Databricks Engineer

DataE2E Technologies • Rajkot, IN

We are looking for an experienced.The ideal candidate has hands-on experience in Databricks production environments, along with. You will collaborate with cross-functional teams to create robust dat...Show more

Last updated: 30+ days ago • Promoted

Senior Data Engineer

VRIZE • Rajkot, IN

Design, architect, administer, and manage large database systems, particularly on Microsoft platforms such as SQL Server and Azure Database. Develop and optimize complex SQL queries for data extract...Show more

Last updated: 16 hours ago • Promoted • New!

GCP Data Engineer

Xsell Resources • rajkot, gujarat, in

Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days. GCP Google Cloud Professional Data Engineer Certi...Show more

Last updated: 20 days ago • Promoted

Azure Databricks+Pyspark

Tata Consultancy Services • Rajkot, IN

TCS is conducting Virtual Drive for Azure Data Engineer + Pyspark.Years of Experience : 6 to 10yrs.Location : Bangalore & Hyderabad. Kindly apply if there is a skill match with 6+yrs of experience.Ove...Show more

Last updated: 21 days ago • Promoted

AWS Data Engineer

Vista Applied Solutions Group Inc • Rajkot, IN

Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more

Last updated: 7 days ago • Promoted

Data Engineer

Tata Consultancy Services • Rajkot, IN

TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more

Last updated: 30+ days ago • Promoted

Data Engineer (Telecommunications Domain)

Net2Source (N2S) • Rajkot, IN

Join a Global Leader in Workforce Solutions – Net2Source Inc.Operating in 32 countries | 5,500+ Employees.Job Title : Senior Data Engineer (Telecommunications Domain). We are seeking an experienced S...Show more

Last updated: 16 hours ago • Promoted • New!

Data Support Engineer ( Azure, Databricks )

Kumaran Systems • Rajkot, IN

We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more

Last updated: 16 hours ago • Promoted • New!

Data Engineer

MyData Insights Pvt Ltd • Rajkot, IN

The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more

Last updated: 5 days ago • Promoted

Data Engineer (GCP)

HISH IT SERVICES • Rajkot, IN

We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely wit...Show more

Last updated: 13 days ago • Promoted

Azure Databricks

Kumaran Systems • Rajkot, IN

We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault. The candidate should be proficient in Dat...Show more

Last updated: 7 days ago • Promoted

Senior Data Engineer

Mindlance • Rajkot, IN

We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more

Last updated: 5 days ago • Promoted