No longer accepting applications
Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only
Blue Cloud Softech Solutions LimitedMalappuram, IN16 days ago
Job descriptionExperience using BigQuery, improving performance and reducing query costs through partitioning and clustering. Automated workflows using Cloud Functions to handle event-based data transformations and notifications. Integrated real-time streaming data through Pub / Sub, enabling near real-time analytics pipelines. Languages : Python, SQL, Spark SQL Tools : Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc Concepts : Data Modeling (Kimball, Data Vault), ETL / ELT, CI / CD, Data Governance, Security, Performance Optimization Led migration of on-prem ETL workflows to Microsoft Fabric Built an end-to-end analytics solution combining BigQuery with Power BI Designed a CI / CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation. Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL. Implemented Fabric security model to support row-level access and data masking across multiple business domains. Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust. Bachelor’s degree in Computer Science (or related field)
Role- Data Engineer
Work Mode- Remote
Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.
Profile Summary
Data Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams.
Core Skills
Microsoft Fabric
- Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.
- Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations.
- Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports.
- Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards.
- Built and optimized Direct Lake models for low-latency Power BI reporting.
- Developed advanced DAX measures and tabular models to support complex analytical dashboards.
Google Cloud Platform (GCP)
Technical Skills
Experience Highlights
Education
Create a job alert for this search
Data Engineer • Malappuram, IN
Related jobs
- Promoted
Data Engineer
VeraxionMalappuram, IN Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions.
Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
Sikich IndiaThrissur, IN Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
- Promoted
Sr Data Engineer
Mitchell Martin Inc.Thrissur, IN Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer to design, build, and optimize data pipelines and systems that power our analytics, reporting, and data-driven decision-mak...Show moreLast updated: 8 days ago
- Promoted
Freelance Data Engineer
upGradKozhikode, IN We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 15 days ago
- Promoted
Senior Data Engineer
USEReadyThrissur, IN Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment.
In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer_Immediate Joiners
VXI Global SolutionsThrissur, IN VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 16 days ago
- Promoted
Senior AWS Data Engineer
CYAN360Kozhikode, IN Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •.
Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
- Promoted
AWS Data Engineer
TerraGiGMalappuram, IN Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.
Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
AAA GlobalMalappuram, IN Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team.
In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 16 days ago
- Promoted
Python AWS Data Engineer
Digitrix Software LLPMalappuram, IN Mandatory skills - python , pyspark, who can write codes , any cloud exp - aws / gcp / azure.Python, AWS Python (core language skill) Backend, Pandas, PySpark (DataFrame API), interacting with AW...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Searce IncKozhikode, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 26 days ago
- Promoted
Senior Data Engineer
HealthyMe AIMalappuram, IN We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 25 days ago
- Promoted
Senior Data Engineer
SAIVA AIMalappuram, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
RevXThrissur, IN RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Jaipur RugsKozhikode, IN Jaipur Rugs is a social enterprise that connects rural craftsmanship with global markets through its luxurious handmade carpets.
It is a family-run business that offers an exclusive range of hand-kn...Show moreLast updated: 13 days ago
- Promoted
GCP Data Engineer
EXLMalappuram, IN Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 16 days ago
- Promoted
Data Engineer
IntraEdgeThrissur, IN The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Randstad EnterpriseMalappuram, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ).
GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago