Data Engineer – Databricks + GCP (5+ yrs)MindBrain • surat, India
No longer accepting applications
Data Engineer – Databricks + GCP (5+ yrs)
MindBrain • surat, India
1 day ago
Job descriptionDesign, build, and maintain robust ETL / ELT pipelines using PySpark on Databricks . Manage and administer Delta Lake tables — including schema evolution, partitioning, ACID-compliant data storage, versioning, and data retention. Ingest data from diverse sources (relational databases, flat files, APIs, streaming systems) — structured, semi-structured, and unstructured — and transform them into analytics-ready datasets. Implement data integrations across systems and platforms — including cloud storage (e.g., AWS S3 / Azure Data Lake), data warehouses / lakehouses, and data catalogs. Optimize data-processing workflows for performance and cost — tuning Spark jobs, optimizing partitioning, caching, query patterns, and resource utilization. Build pipelines for both batch and streaming data workflows; implement data quality checks, validation, error handling, logging, and monitoring. Collaborate with data analysts, data scientists, and business stakeholders to translate analytical requirements into scalable data solutions. Maintain metadata, documentation, version control; work with DevOps / CI-CD pipelines for deployment and orchestration of workflows (e.g., via Databricks Workflows, Git, Airflow, etc.)
Data Engineer – Databricks + GCP (5+ yrs )
Remote
Contract
Skills : PySpark, Databricks, Delta Lake, SQL
- Build ETL pipelines
- Manage Delta Lake
- Data integrations
- Improve performance
Key Responsibilities
Create a job alert for this search
Gcp Data Engineer • surat, India
Similar jobs
Senior Data Engineer
Donyati • surat, gujarat, in
We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
Last updated: 23 days ago • Promoted
Senior Python Data Engineer
iVoyant • mohali, gujarat, in
Join a dynamic engineering team working on a high-impact tax reporting platform for the 2025 fiscal season.The core goal is to modernize and significantly accelerate the generation of Excel-based r...Show more
Last updated: 24 days ago • Promoted
Data Engineer
Remotohire • Surat, IN
Data Engineer – Full Time (3 to 8 Years Experience, Remote).We’re looking for a Data Engineer who can connect our entire financial + operational ecosystem into one clean, trusted data platform.You’...Show more
Last updated: 16 hours ago • Promoted • New!
Data Support Engineer ( Azure, Databricks )
Kumaran Systems • Surat, IN
We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
Last updated: 2 days ago • Promoted
Data Engineer / Data Modeler
Salt • mohali, gujarat, in
I am looking for Data Engineers to work on a short 10 week contract for one of my clients in Abu Dhabi.This role is fully remote and may extend beyond the end of the contract.Job Title – Data Engin...Show more
Last updated: 2 days ago • Promoted
Data Engineer
IntraEdge • Surat, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 2 days ago • Promoted
Data Engineer
TerraGiG • Surat, IN
Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
Last updated: 2 days ago • Promoted
Data Engineer
Insight Global • Surat, IN
Insight Global is seeking a Senior Data Engineer to design, build, and scale robust data solutions on Microsoft Azure.You’ll own modern data pipelines and models that power analytics and reporting ...Show more
Last updated: 2 days ago • Promoted
Customer Engineer (Data Engineer)
Konecta • Surat, IN
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 2 days ago • Promoted
Senior Data Engineer
Emeritus • Surat, IN
At Emeritus, we're committed to teaching you the skills of the future by making.We achieve this by collaborating with more than 80 top-tier universities across the United States, Europe, Latin Amer...Show more
Last updated: 1 day ago • Promoted
Data Engineer
Ignisov Consulting Services • mohali, gujarat, in
Data Engineer – HR Data Conversion.Develop and maintain ETL pipelines using Python and Airflow.Work with SQL, GCP BigQuery, and cloud-based data workflows.
Build scalable solutions using Spark, Hive...Show more
Last updated: 2 days ago • Promoted
GCP Data Engineer
PamTen Inc • Surat, IN
You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
Last updated: 2 days ago • Promoted
Data Engineer
BayOne Solutions • Surat, IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 2 days ago • Promoted
Snowflake Data Engineer
Live Connections • surat, gujarat, in
Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
Last updated: 27 days ago • Promoted
GCP Data Engineer
HCLTech • Surat, IN
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
Last updated: 2 days ago • Promoted
Data Engineer
EXL • Surat, IN
The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
Last updated: 2 days ago • Promoted
Data Engineer (AWS / GCP)
Armakuni • Surat, Gujarat, India
We are looking for a Sr Data Engineer who is passionate about managing large volumes of data, eager to learn and take on challenges, and committed to delivering exceptional results.If you are a tea...Show more
Last updated: 15 hours ago • Promoted • New!
Data Engineer
Senovo IT Ltd • Surat, IN
GST registration required! B2B contract.Design, implement, and manage large-scale cloud infrastructure on.Ensure cloud environments follow best practices for.
Automate deployment, configuration, and...Show more
Last updated: 2 days ago • Promoted