Data Engineer – Databricks + GCP (5+ yrs)MindBrain • baddi, himachal pradesh, in
Data Engineer – Databricks + GCP (5+ yrs)
MindBrain • baddi, himachal pradesh, in
8 hours ago
Job descriptionDesign, build, and maintain robust ETL / ELT pipelines using PySpark on Databricks . Manage and administer Delta Lake tables — including schema evolution, partitioning, ACID-compliant data storage, versioning, and data retention. Ingest data from diverse sources (relational databases, flat files, APIs, streaming systems) — structured, semi-structured, and unstructured — and transform them into analytics-ready datasets. Implement data integrations across systems and platforms — including cloud storage (e.g., AWS S3 / Azure Data Lake), data warehouses / lakehouses, and data catalogs. Optimize data-processing workflows for performance and cost — tuning Spark jobs, optimizing partitioning, caching, query patterns, and resource utilization. Build pipelines for both batch and streaming data workflows; implement data quality checks, validation, error handling, logging, and monitoring. Collaborate with data analysts, data scientists, and business stakeholders to translate analytical requirements into scalable data solutions. Maintain metadata, documentation, version control; work with DevOps / CI-CD pipelines for deployment and orchestration of workflows (e.g., via Databricks Workflows, Git, Airflow, etc.)
Data Engineer – Databricks + GCP (5+ yrs )
Remote
Contract
Skills : PySpark, Databricks, Delta Lake, SQL
- Build ETL pipelines
- Manage Delta Lake
- Data integrations
- Improve performance
Key Responsibilities
Create a job alert for this search
Gcp Data Engineer • baddi, himachal pradesh, in
Related jobs
Data Engineer
TerraGiG • baddi, himachal pradesh, in
Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
SAIVA AI • baddi, himachal pradesh, in
We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
Last updated: 30+ days ago • Promoted
GCP Data Engineer
Adastra • baddi, himachal pradesh, in
We are looking for a proactive and solution-oriented GCP Data Engineer to join our team.This role requires hands-on experience in Google Cloud Platform (GCP), especially with BigQuery and Airflow, ...Show more
Last updated: 22 days ago • Promoted
Data Engineer
Senovo IT Ltd • baddi, himachal pradesh, in
GST registration required! B2B contract.Design, implement, and manage large-scale cloud infrastructure on.Ensure cloud environments follow best practices for.
Automate deployment, configuration, and...Show more
Last updated: 8 hours ago • Promoted • New!
Data Engineer
Ignisov Consulting Services • baddi, himachal pradesh, in
Data Engineer – HR Data Conversion.Develop and maintain ETL pipelines using Python and Airflow.Work with SQL, GCP BigQuery, and cloud-based data workflows.
Build scalable solutions using Spark, Hive...Show more
Last updated: 12 hours ago • Promoted • New!
Data Engineer
Straive • baddi, himachal pradesh, in
Years of Experience- 6-9 years.Straive is a market leading Content and Data Technology company providing data services, subject matter expertise, & technology solutions to multiple domains.Data Ana...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer (Databricks + GCP)
MindBrain • baddi, himachal pradesh, in
Job Title : Data Engineer (Databricks + GCP).We are looking for a Data Engineer with strong experience in Databricks and Google Cloud Platform (GCP) to design, build, and optimize scalable data pipe...Show more
Last updated: 8 hours ago • Promoted • New!
Snowflake Data Engineer
Live Connections • baddi, himachal pradesh, in
Role - Snowflake Data Engineer.Required Notice Period - Immediate Joiner.To apply, connect with Abhishek via abhishek.Show more
Last updated: 25 days ago • Promoted
Senior Snowflake Data Engineer
Luxoft • baddi, himachal pradesh, in
We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
Last updated: 15 days ago • Promoted
Senior Data Engineer - Data Acquisition
InfoBeans • baddi, himachal pradesh, in
We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
Last updated: 28 days ago • Promoted
Data Support Engineer ( Azure, Databricks )
Kumaran Systems • baddi, himachal pradesh, in
We’re looking for a skilled Data Support Engineer with.The ideal candidate will serve as the escalation point for data ingestion, pipeline, and consumption issues while ensuring high system stabili...Show more
Last updated: 14 days ago • Promoted
GCP Data Engineer
HCLTech • baddi, himachal pradesh, in
Looking for 5+ Years of experience.Storage Classes, Dataflow, Big query, Pyspark / Python, Airflow.Show more
Last updated: 30+ days ago • Promoted
Data Engineer
IntraEdge • baddi, himachal pradesh, in
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Ironbook AI • baddi, himachal pradesh, in
The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks.
Design, develop, and maintain s...Show more
Last updated: 5 days ago • Promoted
Customer Engineer (Data Engineer)
Konecta • baddi, himachal pradesh, in
In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
Last updated: 16 days ago • Promoted
GCP Data Engineer
PamTen Inc • baddi, himachal pradesh, in
You will work ongoing support activities and support project efforts as needed.You triage identified issues across Account source platforms, integrations and Customer Data Hub.You will analyze and ...Show more
Last updated: 28 days ago • Promoted
Data Engineer
Tata Consultancy Services • baddi, himachal pradesh, in
TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
EXL • baddi, himachal pradesh, in
The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
Last updated: 30+ days ago • Promoted