Data Engineer – Databricks + GCP (5+ yrs)MindBrain • surat, India
No longer accepting applications
Data Engineer – Databricks + GCP (5+ yrs)
MindBrain • surat, India
23 hours ago
Job descriptionDesign, build, and maintain robust ETL / ELT pipelines using PySpark on Databricks . Manage and administer Delta Lake tables — including schema evolution, partitioning, ACID-compliant data storage, versioning, and data retention. Ingest data from diverse sources (relational databases, flat files, APIs, streaming systems) — structured, semi-structured, and unstructured — and transform them into analytics-ready datasets. Implement data integrations across systems and platforms — including cloud storage (e.g., AWS S3 / Azure Data Lake), data warehouses / lakehouses, and data catalogs. Optimize data-processing workflows for performance and cost — tuning Spark jobs, optimizing partitioning, caching, query patterns, and resource utilization. Build pipelines for both batch and streaming data workflows; implement data quality checks, validation, error handling, logging, and monitoring. Collaborate with data analysts, data scientists, and business stakeholders to translate analytical requirements into scalable data solutions. Maintain metadata, documentation, version control; work with DevOps / CI-CD pipelines for deployment and orchestration of workflows (e.g., via Databricks Workflows, Git, Airflow, etc.)
Data Engineer – Databricks + GCP (5+ yrs )
Remote
Contract
Skills : PySpark, Databricks, Delta Lake, SQL
- Build ETL pipelines
- Manage Delta Lake
- Data integrations
- Improve performance
Key Responsibilities
Create a job alert for this search
Gcp Data Engineer • surat, India
Similar jobs
These fully remote, long-term freelance roles are ideal for engineers who can build scalable data pipelines, work with modern cloud-native data stacks, and support large-scale enterprise data initi...Show more
Data Support Engineer ( Azure, Databricks )
Kumaran Systems • Surat, IN
We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
Last updated: 1 day ago • Promoted
Immediate Opening for Data Engineer (Databricks & D365)
GyanSys Inc. • Surat, IN
Need to have databricks experience as well as experience with handling D365 data.Need strong SQL skills, strong analytical skills.Show more
Last updated: 1 day ago • Promoted
Data Engineer
Straive • mohali, gujarat, in
Years of Experience- 6-9 years.Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains.Data Ana...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
IntraEdge • Surat, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 1 day ago • Promoted
Data Engineer
TerraGiG • Surat, IN
Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
Last updated: 1 day ago • Promoted
Data Engineer
Insight Global • Surat, IN
Insight Global is seeking a Senior Data Engineer to design, build, and scale robust data solutions on Microsoft Azure.You’ll own modern data pipelines and models that power analytics and reporting ...Show more
Last updated: 1 day ago • Promoted
Data Engineer
Mandéva HR Shared Services • Surat, IN
We are looking for a highly motivated Junior Dev Cloud Engineer.The ideal candidate will have strong hands-on experience in Java 17+, Apache Beam, and Airflow / Cloud Composer, with exposure to GCP B...Show more
Last updated: 1 day ago • Promoted
Data Engineer - Fully Remote (Global Data Platform & Analytics Projects)
SkillsCapital • Surat, IN
Remote
Last updated: 1 day ago • Promoted
Customer Engineer (Data Engineer)
Konecta • Surat, IN
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer
Emeritus • Surat, IN
At Emeritus, we're committed to teaching you the skills of the future by making.We achieve this by collaborating with more than 80 top-tier universities across the United States, Europe, Latin Amer...Show more
Last updated: 16 hours ago • Promoted • New!
Data Engineer
Ignisov Consulting Services • mohali, gujarat, in
Data Engineer – HR Data Conversion.Develop and maintain ETL pipelines using Python and Airflow.Work with SQL, GCP BigQuery, and cloud-based data workflows.
Build scalable solutions using Spark, Hive...Show more
Last updated: 1 day ago • Promoted
Snowflake Data Engineer
Live Connections • mohali, gujarat, in
Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
Last updated: 26 days ago • Promoted
GCP Data Engineer
PamTen Inc • Surat, IN
You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
Last updated: 1 day ago • Promoted
Data Engineer
BayOne Solutions • Surat, IN
We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
Last updated: 1 day ago • Promoted
Senior Data Engineer (Databricks + GCP)
MindBrain • Surat, IN
Job Title : Data Engineer (Databricks + GCP).We are looking for a Data Engineer with strong experience in Databricks and Google Cloud Platform (GCP) to design, build, and optimize scalable data pipe...Show more
Last updated: 1 day ago • Promoted
GCP Data Engineer
HCLTech • Surat, IN
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
Last updated: 1 day ago • Promoted
Data Engineer
EXL • Surat, IN
The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
Last updated: 1 day ago • Promoted
Data Engineer
Datastruct • surat, gujarat, in
Datastruct accelerates third-party data.We help companies discover, test, and productionalize external (third-party) data - quickly, reliably, and safely.
We’re a lean, high-performance company buil...Show more
Last updated: 10 hours ago • Promoted • New!