Talent.com
This job offer is not available in your country.
Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Blue Cloud Softech Solutions LimitedJunagadh, IN
20 hours ago
Job description

Role- Data Engineer

Work Mode- Remote

Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.

Profile Summary

Data Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams.

Core Skills

Microsoft Fabric

  • Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.
  • Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations.
  • Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports.
  • Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards.
  • Built and optimized Direct Lake models for low-latency Power BI reporting.
  • Developed advanced DAX measures and tabular models to support complex analytical dashboards.

Google Cloud Platform (GCP)

  • Experience using BigQuery, improving performance and reducing query costs through partitioning and clustering.
  • Automated workflows using Cloud Functions to handle event-based data transformations and notifications.
  • Integrated real-time streaming data through Pub / Sub, enabling near real-time analytics pipelines.
  • Technical Skills

  • Languages : Python, SQL, Spark SQL
  • Tools : Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc
  • Concepts : Data Modeling (Kimball, Data Vault), ETL / ELT, CI / CD, Data Governance, Security, Performance Optimization
  • Experience Highlights

  • Led migration of on-prem ETL workflows to Microsoft Fabric
  • Built an end-to-end analytics solution combining BigQuery with Power BI
  • Designed a CI / CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation.
  • Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL.
  • Implemented Fabric security model to support row-level access and data masking across multiple business domains.
  • Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust.
  • Education

  • Bachelor’s degree in Computer Science (or related field)
  • Create a job alert for this search

    Data Engineer • Junagadh, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labsjunagadh, gujarat, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeJunagadh, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NuVision Auto GlassJunagadh, IN
    NuVision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield repl...Show moreLast updated: 20 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Sikich IndiaJunagadh, IN
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainJunagadh, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straivejunagadh, gujarat, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHjunagadh, gujarat, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer - Web Scraping

    Data Engineer - Web Scraping

    Alternative PathJunagadh, IN
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyjunagadh, gujarat, in
    Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tekshiras Software Services Private Limitedjunagadh, gujarat, in
    We’re Hiring – Senior Data Engineer (10+ Years Experience).We are looking for a seasoned professional with strong expertise in Data Engineering, Data Analysis, SQL and ML / Gen AI.The ideal candidate...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXJunagadh, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Snowflake Data Engineer

    Snowflake Data Engineer

    DNA Technology Servicesjunagadh, gujarat, in
    We are looking for an experienced.The ideal candidate will have strong expertise in Snowflake, cloud platforms (AWS / Azure), and modern data engineering practices, with the ability to design and imp...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaJunagadh, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseJunagadh, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIJunagadh, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 23 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIJunagadh, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyJunagadh, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    The Mastermind GroupJunagadh, IN
    Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG). Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Forage AIjunagadh, gujarat, in
    Experience Level : Data Engineer- 3- 7 years of relevant experience in data engineering.Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructu...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    PASO Cojunagadh, gujarat, in
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 19 hours ago