Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.
Design, develop, and optimize AWS pipeline as applicable.
Implement and manage GitHub asset bundles for version control, CI / CD workflows, and collaborative development.
Leverage Databricks capabilities including Delta Lake, MLflow, and notebooks to build robust data solutions.
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality, production-ready datasets.
Ensure data quality, integrity, and security across all stages of the pipeline.
Monitor and troubleshoot performance issues in Spark jobs and Databricks clusters.
Document technical designs, workflows, and best practices.
Required Qualifications
Minimum 5+ years of hands-on experience with Spark in a production environment.
Strong proficiency in Databricks platform and ecosystem.
Solid understanding of GitHub asset bundle management, including branching strategies, pull requests, and release workflows.
Proficient in Python, Scala, or SQL for data engineering tasks.
Experience with Delta Lake, Structured Streaming, and Databricks Workflows.
Familiarity with cloud platform (AWS) and AWS data services.
Excellent problem-solving and communication skills.
Create a job alert for this search
Data Engineer • Dombivali, Maharashtra, India
Related jobs
Promoted
Data Engineer
Otomeyt AIKalyan-Dombivli, IN
We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Innodata Inc.Thane, IN
CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago
Promoted
Data Engineer
ACL Digitalthane, maharashtra, in
Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable.
Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Kanerika Incdombivli, maharashtra, in
Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders.
Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 20 days ago
Promoted
Data Engineer
Kumaran SystemsKalyan-Dombivli, IN
Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 9 days ago
Promoted
Data Engineer
Envuthane, maharashtra, in
At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world.
We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago
Promoted
AWS Certified Data Engineer
CodeVyasaMumbai, Maharashtra, India
AWS Certified Data Engineer| Mumbai.The candidate should have a minimum of.CodeVyasa is a mid-sized product engineering company that works with top-tier product / solutions companies such as.McKinsey...Show moreLast updated: 18 days ago
Promoted
Data Engineer
SolarSquareMumbai, Maharashtra, India
Job Description : Data Engineer.As a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure.Your work will transform raw, messy data into clean,.
You’ll collaborate cross-fun...Show moreLast updated: 5 days ago
Promoted
Data Engineer
Kline + CompanyThane, IN
Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 2 days ago
Promoted
Data Engineer
IntraEdgeMumbai, IN
Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
AceolutionKalyan-Dombivli, IN
We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 9 days ago
Promoted
Data Engineer
INFEC Servicesdombivli, maharashtra, in
Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 6 days ago
Promoted
Data Engineer
RevXMumbai, IN
RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
Promoted
Lead Data Engineer
Eucloid Data SolutionsMumbai, IN
Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 9 days ago
Promoted
Data Engineer
XebiaKalyan-Dombivli, IN
We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early.
Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 7 days ago
Promoted
Data Engineer
Insight GlobalKalyan-Dombivli, IN
Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume.
Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
Promoted
Data Engineer
Bahwan CyberTekKalyan-Dombivli, IN
Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 19 days ago
Promoted
Data Engineer
HISH IT SERVICESKalyan-Dombivli, IN
Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 8 days ago
Promoted
Data Engineer
EveriseMumbai, IN
Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 8 days ago
Promoted
Data Engineer
Randstad EnterpriseKalyan-Dombivli, IN
Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant only ( this is a Junior position with us ).GCP - 2 years minimum working Experience.
Worked with global stakeholders.Randstad Sourc...Show moreLast updated: 30+ days ago