Databricks Engineer
TTC Groupsecunderabad, telangana, in13 hours ago
Job descriptionConfigure and optimize Databricks clusters, including autoscaling, cluster sizing, and runtime selection. Manage databases, schemas, and Delta Lake tables, including vacuuming, Z-ordering, partitioning, and optimization. Work with catalogs, Unity Catalog (UC), and access controls for secure data governance. Monitor and troubleshoot performance issues across jobs, clusters, and workflows. Implement CI / CD pipelines for Databricks workflows using GitHub Actions / Azure DevOps / GitLab. Work with Databricks Repos and Git workflows (branching, PRs, code reviews). Version and promote data pipelines across environments. Integrate Databricks with cloud services such as : Azure : ADLS Gen2, Key Vault, ADF, Event Hub, Synapse AWS : S3, Glue, IAM, Lambda, Kinesis (depending on cloud environment) Work with data ingestion frameworks, messaging systems, and event-driven architectures. Implement unit tests and integration tests using pytest, SQL tests, or dbx testing frameworks. Maintain pipeline documentation, data dictionaries, and technical design artifacts. Ensure high data quality, reliability, and observability.
Role : Databricks Engineer
Position : Remote
Type : Contract
Duration : 3 - 6 months (extendable)
Role Overview
We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing, designing Delta Lake architectures, implementing CI / CD for data workloads, and optimizing Spark jobs for performance and reliability.
Required Skills
- Strong hands-on experience in building data pipeline using scripting language includes Python, PySpark and SQL
- Strong working experience with Databricks (Unity Catalog is plus) and Azure Data Factory (ADF)
- Hands-on working experience with Azure DevOps Repo and CI / CD
- Strong understanding of modern Data Architecture, Data Warehousing concepts, Data Modelling and ETL / ELT processes
- Understanding of Agile ways of working
- Any experience working in DBT is a plus
- Working with Retail Domain is a plus
Platform Engineering & Operations
CI / CD & DevOps
Cloud & Integration
Quality, Testing & Documentation
Create a job alert for this search
Engineer • secunderabad, telangana, in
Related jobs
- Promoted
Data Engineer – Databricks Platform
Amicon Hub ServicesHyderabad, Telangana, India Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar).Excellent problem-solving skills and the ability to work in a fast-paced environment.Familiar wi...Show moreLast updated: 27 days ago
- Promoted
Data Engineer
DigitalzoneHyderabad, IN As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
RecroHyderabad, IN Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
- Promoted
- New!
Snowflake + DBT Engineer
MindBrainsecunderabad, telangana, in Location : Pune — Remote / Hybrid.We are looking for a highly experienced Snowflake + DBT Engineer to architect, build, and optimize modern cloud data platforms.
The ideal candidate should have deep ex...Show moreLast updated: 13 hours ago
- Promoted
Data Engineer
HCLTechHyderabad, Telangana, India Currently Hiring for "Azure Data Engineer”.Chennai / Hyderabad / Bangalore / Pune / Noida.Interested candidate please share below details along with update resume.
Interested candidate please drop mail t...Show moreLast updated: 14 days ago
- Promoted
Data Engineer - Snowflake
Prudent Technologies and Consulting, Inc.hyderabad, telangana, in We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show moreLast updated: 3 days ago
- Promoted
Cloud Data Engineer (Databricks Focus)
Amicon Hub ServicesHyderabad, Republic Of India, IN Delta Lake, Spark, PySpark, SQL).SQL Server, MongoDB, InfluxDB).Kafka, Azure Event Hubs, or similar).Excellent problem-solving skills and the ability to work in a fast-paced environment.Familiar wi...Show moreLast updated: 27 days ago
- Promoted
Data Platform Engineer
Tata Consultancy ServicesHyderabad, Republic Of India, IN Location - Bangalore, Chennai, Delhi, Mumbai, Pune, Hyderabad.Architecture of Azure Databricks, differentiating between the control plane and data plane.
Describe the role of Databricks Workspaces, ...Show moreLast updated: 14 days ago
- Promoted
- New!
Databricks Engineer
TTC GroupHyderabad, IN We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 19 hours ago
- Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions LimitedHyderabad, IN BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 2 days ago
- Promoted
- New!
Senior DataOps Engineer (AWS)
MSBC GroupHyderabad, IN Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 19 hours ago
- Promoted
Azure Databricks Engineer
Tata Consultancy ServicesHyderabad, Republic Of India, IN Location - Bangalore, Chennai, Delhi, Mumbai, Pune, Hyderabad.Architecture of Azure Databricks, differentiating between the control plane and data plane.
Describe the role of Databricks Workspaces, ...Show moreLast updated: 30+ days ago
- Promoted
Azure Databricks
Tata Consultancy ServicesHyderabad, India TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of ...Show moreLast updated: 16 days ago
- Promoted
Azure Databricks Platform Engineer
Tata Consultancy ServicesHyderabad, Republic Of India, IN TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of ...Show moreLast updated: 10 days ago
- Promoted
Databricks System Engineer
NexionPro ServicesHyderabad, Republic Of India, IN Bangalore / Chennai / Hyderabad.Databricks platform across multiple environments.The ideal candidate will have a strong background in.
Databricks and related Azure / AWS ecosystems.Databricks Platform...Show moreLast updated: 7 days ago
- Promoted
- New!
Azure Databricks Specialist
KPI PartnersHyderabad, IN KPI Partners are seeking highly skilled and experienced Senior Data Engineers to join our dynamic team at KPI, working on challenging and multi-year data transformation projects for our clients.Thi...Show moreLast updated: 14 hours ago
- Promoted
AWS Data Engineer
Tata Consultancy Serviceshyderabad, telangana, in Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Tata Consultancy ServicesHyderabad, Telangana, India Location - Bangalore, Chennai, Delhi, Mumbai, Pune, Hyderabad.Architecture of Azure Databricks, differentiating between the control plane and data plane.
Describe the role of Databricks Workspaces, ...Show moreLast updated: 30+ days ago