No longer accepting applications
Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only
Blue Cloud Softech Solutions LimitedVadodara, IN8 days ago
Job descriptionExperience using BigQuery, improving performance and reducing query costs through partitioning and clustering. Automated workflows using Cloud Functions to handle event-based data transformations and notifications. Integrated real-time streaming data through Pub / Sub, enabling near real-time analytics pipelines. Languages : Python, SQL, Spark SQL Tools : Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc Concepts : Data Modeling (Kimball, Data Vault), ETL / ELT, CI / CD, Data Governance, Security, Performance Optimization Led migration of on-prem ETL workflows to Microsoft Fabric Built an end-to-end analytics solution combining BigQuery with Power BI Designed a CI / CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation. Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL. Implemented Fabric security model to support row-level access and data masking across multiple business domains. Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust. Bachelor’s degree in Computer Science (or related field)
Role- Data Engineer
Work Mode- Remote
Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.
Profile Summary
Data Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams.
Core Skills
Microsoft Fabric
- Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.
- Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations.
- Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports.
- Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards.
- Built and optimized Direct Lake models for low-latency Power BI reporting.
- Developed advanced DAX measures and tabular models to support complex analytical dashboards.
Google Cloud Platform (GCP)
Technical Skills
Experience Highlights
Education
Create a job alert for this search
Data Engineer • Vadodara, IN
Related jobs
Hiring : Databricks Data Engineer | 6-Month Contract (Extendable) | Remote – India | Immediate Start | German Shift.Months (extendable based on performance).
Contract | BGV Clearance Mandatory.The id...Show moreLast updated: 5 hours ago
- Promoted
Data Engineer - Scala
Idyllic ServicesAnand, IN Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 6 days ago
- Promoted
Data Engineer - Databricks Expert
Nebula Tech Solutionsvadodara, gujarat, in Data Engineer – Databricks Expert.Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a....Show moreLast updated: 4 days ago
- Promoted
Data Engineer
AAA GlobalVadodara, IN Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 8 days ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticsnadiad, gujarat, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 16 days ago
- Promoted
- New!
Databricks Data Engineer | 6-Month Contract (Extendable) | Remote – India | Immediate Start | German Shift
InfoSpruce Technologies Private LimitedVadodara, INRemote
- Promoted
- New!
Data Engineer
GEMRAJ TECHNOLOGIES LIMITEDVadodara, IN We are currently seeking a Data Engineer to join our technology team.In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure.The ideal candidate i...Show moreLast updated: 5 hours ago
- Promoted
Data Engineer
XebiaVadodara, IN We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early.
Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 28 days ago
- Promoted
Data Engineer_Immediate Joiners
VXI Global SolutionsVadodara, IN VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
TalogyAnand, IN This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Digivance SolutionsVadodara, IN Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR.Collaborate with business and technology stakeholders to understand current and future data requirements.
Design, build, and maintain reliable,...Show moreLast updated: 27 days ago
- Promoted
Data Engineer
V2Softanand, gujarat, in Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala.
Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 8 days ago
- Promoted
Lead Data Engineer
Searce IncVadodara, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
Sikich IndiaVadodara, IN Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
- Promoted
Principal Data Engineer
K&K Talents - IndiaVadodara, IN This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune.
Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
Mastekanand, gujarat, in Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background).We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team.The ideal ...Show moreLast updated: 8 days ago
- Promoted
Senior Data Engineer
SAIVA AIVadodara, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Jaipur RugsVadodara, IN Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets.
It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 4 days ago
- Promoted
Sr. Software Engineer
IntraEdgeVadodara, IN Senior Data Engineer – Pyspark | AWS Lambda | AWS Glue | Snowflake.The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring seamless data integration a...Show moreLast updated: 22 days ago
- Promoted
Senior Data Engineer
Straivevadodara, gujarat, in The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 27 days ago
- Promoted
Data Engineer
Response Informaticsnadiad, gujarat, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 18 days ago