Databricks Engineer
TTC Grouppanchkula, haryana, in7 hours ago
Job descriptionConfigure and optimize Databricks clusters, including autoscaling, cluster sizing, and runtime selection. Manage databases, schemas, and Delta Lake tables, including vacuuming, Z-ordering, partitioning, and optimization. Work with catalogs, Unity Catalog (UC), and access controls for secure data governance. Monitor and troubleshoot performance issues across jobs, clusters, and workflows. Implement CI / CD pipelines for Databricks workflows using GitHub Actions / Azure DevOps / GitLab. Work with Databricks Repos and Git workflows (branching, PRs, code reviews). Version and promote data pipelines across environments. Integrate Databricks with cloud services such as : Azure : ADLS Gen2, Key Vault, ADF, Event Hub, Synapse AWS : S3, Glue, IAM, Lambda, Kinesis (depending on cloud environment) Work with data ingestion frameworks, messaging systems, and event-driven architectures. Implement unit tests and integration tests using pytest, SQL tests, or dbx testing frameworks. Maintain pipeline documentation, data dictionaries, and technical design artifacts. Ensure high data quality, reliability, and observability.
Role : Databricks Engineer
Position : Remote
Type : Contract
Duration : 3 - 6 months (extendable)
Role Overview
We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing, designing Delta Lake architectures, implementing CI / CD for data workloads, and optimizing Spark jobs for performance and reliability.
Required Skills
- Strong hands-on experience in building data pipeline using scripting language includes Python, PySpark and SQL
- Strong working experience with Databricks (Unity Catalog is plus) and Azure Data Factory (ADF)
- Hands-on working experience with Azure DevOps Repo and CI / CD
- Strong understanding of modern Data Architecture, Data Warehousing concepts, Data Modelling and ETL / ELT processes
- Understanding of Agile ways of working
- Any experience working in DBT is a plus
- Working with Retail Domain is a plus
Platform Engineering & Operations
CI / CD & DevOps
Cloud & Integration
Quality, Testing & Documentation
Create a job alert for this search
Engineer • panchkula, haryana, in
Related jobs
The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines that support key business functions across the supply chain domain.This role requires strong...Show moreLast updated: 7 hours ago
- Promoted
- New!
Senior Data Engineer
Mindlancepanchkula, haryana, in We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show moreLast updated: 7 hours ago
- Promoted
- New!
Snowflake + DBT Engineer
MindBrainpanchkula, haryana, in Location : Pune — Remote / Hybrid.We are looking for a highly experienced Snowflake + DBT Engineer to architect, build, and optimize modern cloud data platforms.
The ideal candidate should have deep ex...Show moreLast updated: 7 hours ago
- Promoted
Senior Data Engineer
SGS & Copanchkula, haryana, in Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in.
The ideal candidate will play a ke...Show moreLast updated: 16 days ago
- Promoted
AWS Data Engineer
Tata Consultancy Servicespanchkula, haryana, in TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show moreLast updated: 25 days ago
- Promoted
- New!
Data Engineer (Remote)
QAAgility Technologiespanchkula, haryana, inRemote
- Promoted
Senior AWS Data Engineer_Exp : 5+ Years
Atyeti Incbaddi, himachal pradesh, in Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 16 days ago
- Promoted
- New!
Data Engineer
JIT Global Infosystems Pvt. Ltd.baddi, himachal pradesh, in Applications, Analytics, and Consulting services to clients worldwide.By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance.Our ex...Show moreLast updated: 7 hours ago
- Promoted
Data Engineer
Sourcebaepanchkula, haryana, in Join Our Data Engineering Team in Mumbai! (5-8 Yrs Exp.We're looking for an experienced and driven.If you are passionate about building scalable, high-performance data platforms and mentoring the n...Show moreLast updated: 16 days ago
- Promoted
Data Engineer AWS ( Full-time at a Fortune 500 tech MNC )
HARPbaddi, himachal pradesh, in Kubernetes (Moderate level knowledge).Technical Skills – Nice to Have.Technical Skills – Ok to Train Later.Monitor the health status of applications using Datadog or similar monitoring tools.Check ...Show moreLast updated: 9 days ago
- Promoted
GCP Data Engineer
Xsell Resourcespanchkula, haryana, in Seeking a GCP Certified Data Engineer to work remotely from India for our Fortune 5 healthcare client in the US.No notice periods more than 15 days.
GCP Google Cloud Professional Data Engineer Certi...Show moreLast updated: 15 days ago
- Promoted
- New!
Azure Databricks Specialist
KPI Partnersbaddi, himachal pradesh, in KPI Partners are seeking highly skilled and experienced Senior Data Engineers to join our dynamic team at KPI, working on challenging and multi-year data transformation projects for our clients.Thi...Show moreLast updated: 7 hours ago
- Promoted
- New!
Databricks Engineer
TTC Groupbaddi, himachal pradesh, in We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show moreLast updated: 7 hours ago
- Promoted
Databricks Data Engineer Lead – Sustainability Project
Blue Cloud Softech Solutions Limitedpanchkula, haryana, in BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show moreLast updated: 2 days ago
- Promoted
- New!
Senior DataOps Engineer (AWS)
MSBC Groupbaddi, himachal pradesh, in Join us as a Senior DataOps Engineer (AWS)—Drive High-Performance Data Systems for Financial Services.Lead the E-Comms data pipeline within Compass’s Application Simplification workstream : design, ...Show moreLast updated: 7 hours ago
- Promoted
- New!
Senior Data Engineer / Architect - Snowflake
Aezion, Incbaddi, himachal pradesh, in We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling.
The ideal candidate will design ...Show moreLast updated: 7 hours ago
- Promoted
Senior Data Engineer (Snowflake+ DBT)
Anblickspanchkula, haryana, in Senior Data Engineer (Snowflake + dbt).Hyderabad / Ahmedabad (Hybrid).Great Place to Work® Certified | Snowflake Elite Partner.
We are looking for a highly skilled.ELT pipelines and analytical data ...Show moreLast updated: 3 days ago
- Promoted
- New!
ETL & Tableau Data Engineer
Magma Consultancypanchkula, haryana, in ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show moreLast updated: 7 hours ago
- Promoted
- New!
Data Engineer
NexionPro Servicesbaddi, himachal pradesh, in PySpark-based data processing workflows.Collaborate with data architects, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.Optimi...Show moreLast updated: 7 hours ago