Data Engineer – Databricks + GCP (5+ yrs)MindBrain • Bareilly, IN
Data Engineer – Databricks + GCP (5+ yrs)
MindBrain • Bareilly, IN
4 hours ago
Job descriptionDesign, build, and maintain robust ETL / ELT pipelines using PySpark on Databricks . Manage and administer Delta Lake tables — including schema evolution, partitioning, ACID-compliant data storage, versioning, and data retention. Ingest data from diverse sources (relational databases, flat files, APIs, streaming systems) — structured, semi-structured, and unstructured — and transform them into analytics-ready datasets. Implement data integrations across systems and platforms — including cloud storage (e.g., AWS S3 / Azure Data Lake), data warehouses / lakehouses, and data catalogs. Optimize data-processing workflows for performance and cost — tuning Spark jobs, optimizing partitioning, caching, query patterns, and resource utilization. Build pipelines for both batch and streaming data workflows; implement data quality checks, validation, error handling, logging, and monitoring. Collaborate with data analysts, data scientists, and business stakeholders to translate analytical requirements into scalable data solutions. Maintain metadata, documentation, version control; work with DevOps / CI-CD pipelines for deployment and orchestration of workflows (e.g., via Databricks Workflows, Git, Airflow, etc.)
Data Engineer – Databricks + GCP (5+ yrs )
Remote
Contract
Skills : PySpark, Databricks, Delta Lake, SQL
- Build ETL pipelines
- Manage Delta Lake
- Data integrations
- Improve performance
Key Responsibilities
Create a job alert for this search
Gcp Data Engineer • Bareilly, IN
Related jobs
Gcp Data Engineer
Adastra • Bareilly, Republic Of India, IN
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 22 days ago • Promoted
Data Engineer
Tata Consultancy Services • Bareilly, IN
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 4 hours ago • Promoted • New!
Senior Data Engineer (Databricks + GCP)
MindBrain • Bareilly, IN
Job Title : Data Engineer (Databricks + GCP).We are looking for a Data Engineer with strong experience in Databricks and Google Cloud Platform (GCP) to design, build, and optimize scalable data pipe...Show more
Last updated: 3 hours ago • Promoted • New!
GCP Data Engineer
PamTen Inc • Bareilly, IN
You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
Last updated: 4 hours ago • Promoted • New!
Snowflake Data Engineer
Live Connections • bareilly, uttar pradesh, in
Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
Last updated: 25 days ago • Promoted
Data Engineer
Aceolution • Bareilly, IN
Data Engineer – Python Expert(Freelance Role).We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) developmen...Show more
Last updated: 4 hours ago • Promoted • New!
Gcp Data Engineer
PamTen Inc • Bareilly, Republic Of India, IN
You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
Last updated: 27 days ago • Promoted
GCP Data Engineer
HCLTech • Bareilly, IN
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
Last updated: 4 hours ago • Promoted • New!
Data Engineer
Senovo IT Ltd • Bareilly, IN
GST registration required! B2B contract.Design, implement, and manage large-scale cloud infrastructure on.Ensure cloud environments follow best practices for.
Automate deployment, configuration, and...Show more
Last updated: 4 hours ago • Promoted • New!
Immediate Opening for Data Engineer (Databricks & D365)
GyanSys Inc. • Bareilly, IN
Need to have databricks experience as well as experience with handling D365 data.Need strong SQL skills, strong analytical skills.Show more
Last updated: 4 hours ago • Promoted • New!
Data Engineer (GCP)
HISH IT SERVICES • Bareilly, IN
We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery).
This role requires a hands-on developer who can collaborate closely wit...Show more
Last updated: 4 hours ago • Promoted • New!
Data Engineer
IntraEdge • Bareilly, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 4 hours ago • Promoted • New!
Senior Data Engineer
Ironbook AI • bareilly, uttar pradesh, in
The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks.
Design, develop, and maintain s...Show more
Last updated: 5 days ago • Promoted
Data Engineer – Databricks + Gcp (5+ Yrs)
MindBrain • Bareilly, Republic Of India, IN
Data Engineer – Databricks + GCP (5+ yrs ).Skills : PySpark, Databricks, Delta Lake, SQL.Design, build, and maintain robust.
ACID-compliant data storage, versioning, and data retention.Ingest data fr...Show more
Last updated: 4 hours ago • Promoted • New!
GCP Data Engineer
Adastra • Bareilly, IN
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 4 hours ago • Promoted • New!
Data Engineer
TerraGiG • Bareilly, IN
Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
Last updated: 4 hours ago • Promoted • New!
Gcp Data Engineer
HCLTech • Bareilly, Republic Of India, IN
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
MindBrain • Bareilly, Republic Of India, IN
Job Title : Data Engineer (Databricks + GCP).We are looking for a Data Engineer with strong experience in Databricks and Google Cloud Platform (GCP) to design, build, and optimize scalable data pipe...Show more
Last updated: 4 hours ago • Promoted • New!