Talent.com
No longer accepting applications
Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Blue Cloud Softech Solutions LimitedMumbai, IN
8 days ago
Job description

Role- Data Engineer

Work Mode- Remote

Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.

Profile Summary

Data Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams.

Core Skills

Microsoft Fabric

  • Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.
  • Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations.
  • Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports.
  • Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards.
  • Built and optimized Direct Lake models for low-latency Power BI reporting.
  • Developed advanced DAX measures and tabular models to support complex analytical dashboards.

Google Cloud Platform (GCP)

  • Experience using BigQuery, improving performance and reducing query costs through partitioning and clustering.
  • Automated workflows using Cloud Functions to handle event-based data transformations and notifications.
  • Integrated real-time streaming data through Pub / Sub, enabling near real-time analytics pipelines.
  • Technical Skills

  • Languages : Python, SQL, Spark SQL
  • Tools : Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc
  • Concepts : Data Modeling (Kimball, Data Vault), ETL / ELT, CI / CD, Data Governance, Security, Performance Optimization
  • Experience Highlights

  • Led migration of on-prem ETL workflows to Microsoft Fabric
  • Built an end-to-end analytics solution combining BigQuery with Power BI
  • Designed a CI / CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation.
  • Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL.
  • Implemented Fabric security model to support row-level access and data masking across multiple business domains.
  • Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust.
  • Education

  • Bachelor’s degree in Computer Science (or related field)
  • Create a job alert for this search

    Data Engineer • Mumbai, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Incnavi mumbai, maharashtra, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 8 days ago
    • Promoted
    Big Data Engineer - Scala / Spark / Python

    Big Data Engineer - Scala / Spark / Python

    Idyllic Services Pvt LtdMumbai
    Job Title : Big Data Engineer - Scala Experience : 7 to 10Years (Minimum 3+ years in Scala) Notice Period : ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Impetusthane, maharashtra, in
    Strong ability to write clean and efficient code.Good understanding of Spark SQL for distributed data processing.Experience with large datasets and structured data manipulation.Ability to write que...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softmumbai, maharashtra, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsmumbai city, maharashtra, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekThane, Maharashtra, India
    Role Overview We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services.The ideal candidate will...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyKalyan-Dombivli, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Spark / Scala

    Big Data Engineer - Spark / Scala

    Strategic HR SolutionsMumbai
    Spark Scala Developer Location : Bengaluru, Mumbai Employment Type : Full-time What Were Looking...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Masteknavi mumbai, maharashtra, in
    Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background).We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team.The ideal ...Show moreLast updated: 8 days ago
    • Promoted
    Morningstar - Senior Data Engineer - SQL / Python

    Morningstar - Senior Data Engineer - SQL / Python

    Morning StarThane
    Job Description : As a member of the Enterprise Data Platform team and Enterprise Technology organization within Technology & Engineeri...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Scala

    Data Engineer - Scala

    Idyllic ServicesThane, IN
    Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 7 days ago
    • Promoted
    Snowflake Data Engineer (Snowflake+DBT+SQL+Python) Only Immediate Joiners- PAN India

    Snowflake Data Engineer (Snowflake+DBT+SQL+Python) Only Immediate Joiners- PAN India

    Mount Talent Consulting Pvt Ltd.Navi Mumbai, Maharashtra, India
    As a Snowflake Lead with experience, and additional expertise in ETL tools and DBT, youwill be entrusted with a pivotal role in designing, implementing, and managing Snowflake solutions to driveeff...Show moreLast updated: 17 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivemumbai city, maharashtra, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Randstad EnterpriseMumbai, Maharashtra, India
    Role : Data Engineer Location : Remote Shift Timing : 2 : 00 Pm - 11 : 00 Pm Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ) Must have skillset : GCP - 2 years m...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer_Immediate Joiners

    Data Engineer_Immediate Joiners

    VXI Global SolutionsKalyan-Dombivli, IN
    VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions.Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, As...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    StraiveMumbai, Maharashtra, India
    Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Databricks Expert

    Data Engineer - Databricks Expert

    Nebula Tech SolutionsMumbai, Maharashtra, India
    Data Engineer – Databricks Expert Remote (India-based) | Full-time | Immediate Joiners Preferred Are you passionate about building scalable data pipelines and optimizing performance with cuttin...Show moreLast updated: 30+ days ago
    • Promoted
    Big Data Engineer - Spark / Hadoop

    Big Data Engineer - Spark / Hadoop

    Novo Tree Minds ConsultingMumbai
    Proven experience in SQL, Spark, Hadoop ecosystem - Have worked on multiple TBs of data volume from ingestion to consumption. Work with business stakeholders ...Show moreLast updated: 24 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadythane, India
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsmumbai, India
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 1 day ago