This job offer is not available in your country.
Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only
Blue Cloud Softech Solutions Limitedhosur, tamil nadu, in2 days ago
Job descriptionExperience using BigQuery, improving performance and reducing query costs through partitioning and clustering. Automated workflows using Cloud Functions to handle event-based data transformations and notifications. Integrated real-time streaming data through Pub / Sub, enabling near real-time analytics pipelines. Languages : Python, SQL, Spark SQL Tools : Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc Concepts : Data Modeling (Kimball, Data Vault), ETL / ELT, CI / CD, Data Governance, Security, Performance Optimization Led migration of on-prem ETL workflows to Microsoft Fabric Built an end-to-end analytics solution combining BigQuery with Power BI Designed a CI / CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation. Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL. Implemented Fabric security model to support row-level access and data masking across multiple business domains. Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust. Bachelor’s degree in Computer Science (or related field)
Role- Data Engineer
Work Mode- Remote
Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.
Profile Summary
Data Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams.
Core Skills
Microsoft Fabric
- Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.
- Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations.
- Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports.
- Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards.
- Built and optimized Direct Lake models for low-latency Power BI reporting.
- Developed advanced DAX measures and tabular models to support complex analytical dashboards.
Google Cloud Platform (GCP)
Technical Skills
Experience Highlights
Education
Create a job alert for this search
Data Engineer • hosur, tamil nadu, in
Related jobs
- Promoted
Data Engineer – Databricks & PySpark
Capgemini EngineeringBengaluru, Karnataka, India Data Engineer – Databricks & PySpark.Choosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagi...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
MastekBengaluru, Karnataka, India Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background).We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team.The ideal ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Sapaadhosur, tamil nadu, in Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries.
Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer(Azure / AWS, Python / Pyspark, SQL)
Sail Analyticshosur, tamil nadu, in Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift).
Bachelor's degree or equivalent...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
People Tech Group IncBengaluru, Karnataka, India We are Hiring - Data Engineer Bengaluru!.We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects.The ideal candida...Show moreLast updated: 10 days ago
- Promoted
Senior Data Engineer
Straivebangalore district, karnataka, in The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 21 days ago
- Promoted
Data Engineer | Azure + Databricks
XebiaBengaluru, Karnataka, India Job Opportunity – Data Engineer | Azure + Databricks 🔹.Bangalore (Whitefield) | Hybrid (3 days office / week).Immediate to 2 weeks – only apply if you can join early.
The ideal candidate will have st...Show moreLast updated: 25 days ago
- Promoted
Data Engineer
Xiaomi IndiaBengaluru, Karnataka, India As a Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure to support our rapidly growing business needs.
The ideal candidate will have expertis...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer (Spark Scala)
Tata Consultancy ServicesBengaluru, Karnataka, India Greetings from TATA Consultancy Services.Location- Chennai / Pune / Bangalore / Hyderabad / Delhi.Pls find the Job Description below.
Big Data Hadoop - Hive and Spark / Scala solid experience.SQL advance kn...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
V2Softhosur, tamil nadu, in Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala.
Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 2 days ago
- Promoted
Spark / Scala Data Engineer
Tata Consultancy ServicesBengaluru, Karnataka, India Role - Spark / Scala Data Engineer.Location - Bangalore / Chennai / Hyderabad / Delhi / Pune.Must Have- Big Data Hadoop - Hive and Spark / Scala solid experience- SQL advance knowledge - Been able to test ch...Show moreLast updated: 12 days ago
- Promoted
Data Engineer
SynechronBangalore Urban, Karnataka, India We have immediate opportunity for.Data Engineer (Python, Spark / Scala).Data Engineer (Python, Spark / Scala).Notice Period : Immediate joiner only.
At Synechron, we believe in the power of digital to tr...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
One Tapp ConsultingBengaluru, Karnataka, India Design and Development : Design, build, and maintain robust, scalable, and optimized ETL / ELT data.Python and standard data warehousing principles.
Data Platform Management : Implement and manage data ...Show moreLast updated: 2 days ago
- Promoted
Senior Data Engineer
USEReadyhosur, tamil nadu, in Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 12 days ago
- Promoted
Azure Data Engineer
Tekskills Inc.Bengaluru, Karnataka, India Location : Gurgaon / Pune & Bengaluru.We’re looking for a Data Engineer who can design, build, and maintain data pipelines and ETL processes on Azure Cloud, with strong hands-on expertise in Databri...Show moreLast updated: 2 days ago
- Promoted
Big Data Engineer
Tata Consultancy Servicesbangalore, karnataka, in Job Title : - Data Engineer - Pyspark.Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL.
Good Spark, Pyspark,Big Data experience.Spark UI / Optimization / debugging ...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Talogyhosur, tamil nadu, in This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
Saransh Inchosur, tamil nadu, in Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled.
The ideal candidate will be hands-on, detail-o...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
Vriba Solutionshosur, tamil nadu, in Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show moreLast updated: 12 days ago
- Promoted
Data Engineer
Response Informaticshosur, tamil nadu, in We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals.
If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 12 days ago