Databricks EngineerTTC Group • Thane, IN
Databricks Engineer
TTC Group • Thane, IN
3 days ago
Job descriptionConfigure and optimize Databricks clusters, including autoscaling, cluster sizing, and runtime selection. Manage databases, schemas, and Delta Lake tables, including vacuuming, Z-ordering, partitioning, and optimization. Work with catalogs, Unity Catalog (UC), and access controls for secure data governance. Monitor and troubleshoot performance issues across jobs, clusters, and workflows. Implement CI / CD pipelines for Databricks workflows using GitHub Actions / Azure DevOps / GitLab. Work with Databricks Repos and Git workflows (branching, PRs, code reviews). Version and promote data pipelines across environments. Integrate Databricks with cloud services such as : Azure : ADLS Gen2, Key Vault, ADF, Event Hub, Synapse AWS : S3, Glue, IAM, Lambda, Kinesis (depending on cloud environment) Work with data ingestion frameworks, messaging systems, and event-driven architectures. Implement unit tests and integration tests using pytest, SQL tests, or dbx testing frameworks. Maintain pipeline documentation, data dictionaries, and technical design artifacts. Ensure high data quality, reliability, and observability.
Role : Databricks Engineer
Position : Remote
Type : Contract
Duration : 3 - 6 months (extendable)
Role Overview
We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform. The ideal candidate will be comfortable working with distributed data processing, designing Delta Lake architectures, implementing CI / CD for data workloads, and optimizing Spark jobs for performance and reliability.
Required Skills
- Strong hands-on experience in building data pipeline using scripting language includes Python, PySpark and SQL
- Strong working experience with Databricks (Unity Catalog is plus) and Azure Data Factory (ADF)
- Hands-on working experience with Azure DevOps Repo and CI / CD
- Strong understanding of modern Data Architecture, Data Warehousing concepts, Data Modelling and ETL / ELT processes
- Understanding of Agile ways of working
- Any experience working in DBT is a plus
- Working with Retail Domain is a plus
Platform Engineering & Operations
CI / CD & DevOps
Cloud & Integration
Quality, Testing & Documentation
Create a job alert for this search
Engineer • Thane, IN
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
Azure + Databricks
PwC India • Mumbai, Maharashtra, India
Job Title : Azure Data Engineer.As a Manager in the Data Engineering practice, you will lead teams and client engagements to design, architect, and deliver enterprise-grade data platforms.You’ll dri...Show more
Last updated: 4 days ago • Promoted
Azure Databricks
Kumaran Systems • Mumbai, IN
We are seeking a skilled Azure Databricks with strong hands-on experience in Microsoft Azure services such as Data Factory, Storage, Synapse, and Key Vault.
The candidate should be proficient in Dat...Show more
Last updated: 5 days ago • Promoted
Alteryx Data Engineer
Collinson • Mumbai, Maharashtra, India
Location - Mumbai Purpose of the job.Collinson, Working within the Transformation Team, you will be responsible for delivering key elements of our transformation programme.You will create new, and ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Synechron • Mumbai Metropolitan Region, India
We have immediate opportunity for Data Engineer – 3-7 Years.We began life in 2001 as a small, self-funded team of technology specialists.
Since then, we’ve grown our organization to 14,500+ people, ...Show more
Last updated: 1 day ago • Promoted
ETL & Tableau Data Engineer
Magma Consultancy • Thane, IN
ETL & Tableau Data Engineer (Remote | Full-Time | Join in 2 Weeks).We are a forward-thinking technology and data consulting firm dedicated to helping organizations unlock the full potential of thei...Show more
Last updated: 3 days ago • Promoted
Data Engineer
Tata Consultancy Services • Thane, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
Databricks Engineer
Tata Consultancy Services • Mumbai, Maharashtra, India
Greetings from TCS!! Job Title : Databricks Engineer Job location : Hyderabad, Noida, Chennai, Mumbai Experience range : 5-10 years Job Description : Experience working on Azure Databricks using ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
MyData Insights Pvt Ltd • Thane, IN
The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
Last updated: 3 days ago • Promoted
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careers • Thane, IN
Remote
Last updated: 5 days ago • Promoted
Data Engineer
Recro • Kalyan-Dombivli, IN
Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
AI Data Enablement : Collaborate wi...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Mindlance • Mumbai, IN
We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
Last updated: 3 days ago • Promoted
Data Engineer
IntraEdge • Mumbai, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
ACL Digital • Mumbai, Maharashtra, India
Hello connections! We have urgent openings for AWS Data Engineer.Job Description : We are seeking an experienced Data Engineer to join our team and contribute to the building, development, and sup...Show more
Last updated: 7 days ago • Promoted
Data Engineer
Insight Global • Mumbai, IN
GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts.
Proficiency in ETL / ELT pipeline development...Show more
Last updated: 30+ days ago • Promoted
Databricks(Mumbai,Bhubaneswar)
Tata Consultancy Services • Mumbai, Maharashtra, India
Skill : Databricks Range : 8 to 10 Location : Mumbai,Bhubaneswar Must Have - 8-10 years of hands-on experience in development.
Development experience in - Azure – cloud technology – Function Apps, API...Show more
Last updated: 1 hour ago • Promoted • New!
Databricks Engineer
TTC Group • Mumbai, IN
We are seeking a Mid-Level Databricks Engineer with strong data engineering fundamentals and hands-on experience building scalable data pipelines on the Databricks platform.The ideal candidate will...Show more
Last updated: 3 days ago • Promoted
AWS Data Engineer
Vista Applied Solutions Group Inc • Thane, IN
Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions).
Hands-on with AWS : Glue, Lambda, Redshif...Show more
Last updated: 5 days ago • Promoted
Data Engineer
Digitalzone • Mumbai, IN
As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.
Develop and maintain scalable ETL / ELT pipelines using Py...Show more
Last updated: 19 days ago • Promoted