Talent.com
This job offer is not available in your country.
Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Blue Cloud Softech Solutions LimitedDelhi, IN
13 hours ago
Job description

Role- Data Engineer

Work Mode- Remote

Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.

Profile Summary

Data Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams.

Core Skills

Microsoft Fabric

  • Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.
  • Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations.
  • Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports.
  • Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards.
  • Built and optimized Direct Lake models for low-latency Power BI reporting.
  • Developed advanced DAX measures and tabular models to support complex analytical dashboards.

Google Cloud Platform (GCP)

  • Experience using BigQuery, improving performance and reducing query costs through partitioning and clustering.
  • Automated workflows using Cloud Functions to handle event-based data transformations and notifications.
  • Integrated real-time streaming data through Pub / Sub, enabling near real-time analytics pipelines.
  • Technical Skills

  • Languages : Python, SQL, Spark SQL
  • Tools : Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc
  • Concepts : Data Modeling (Kimball, Data Vault), ETL / ELT, CI / CD, Data Governance, Security, Performance Optimization
  • Experience Highlights

  • Led migration of on-prem ETL workflows to Microsoft Fabric
  • Built an end-to-end analytics solution combining BigQuery with Power BI
  • Designed a CI / CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation.
  • Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL.
  • Implemented Fabric security model to support row-level access and data masking across multiple business domains.
  • Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust.
  • Education

  • Bachelor’s degree in Computer Science (or related field)
  • Create a job alert for this search

    Data Engineer • Delhi, IN

    Related jobs
    • Promoted
    Senior Lead Data Engineer

    Senior Lead Data Engineer

    TerraFinn TechnologiesGhaziabad, IN
    TerraFinn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally. The company focuses on providing expert employees to he...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsGhaziabad, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 10 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseDelhi, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadDelhi, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    PASO CoDelhi, IN
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 13 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    DeloitteNarela, Delhi, India
    India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organisations ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    NuVision Auto GlassDelhi, IN
    NuVision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield repl...Show moreLast updated: 13 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    KPG99 INCDelhi, IN
    Essential Skills and requirements.Advanced proficiency in SQL including stored procedures, views and functions.Solid knowledge of data warehousing principles. Experience working with large data ware...Show moreLast updated: 13 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaDelhi, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 20 days ago
    • Promoted
    Spark / Scala Data Engineer

    Spark / Scala Data Engineer

    Tata Consultancy ServicesDelhi, India, India
    Role - Spark / Scala Data Engineer.Location - Bangalore / Chennai / Hyderabad / Delhi / Pune.Must Have- Big Data Hadoop - Hive and Spark / Scala solid experience- SQL advance knowledge - Been able to test ch...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    IGT SolutionsDelhi, IN
    Interested candidate please share resume on Kalyani.Design, develop, and maintain scalable data pipelines using Python and PySpark. Work with SQL and MongoDB to manage and query large datasets.Devel...Show moreLast updated: 7 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Sikich IndiaDelhi, IN
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Full stack Developer(Dot net+ Angular +SQL)

    Senior Full stack Developer(Dot net+ Angular +SQL)

    Programmers.ioDelhi, IN
    We are looking for a passionate and experienced Senior.NET Core 6, SQL Server, and Selenium-based test automation.The ideal candidate will be responsible for designing, developing, and maintaining ...Show moreLast updated: 30+ days ago
    • Promoted
    Business Intelligence Analyst

    Business Intelligence Analyst

    PeoplefyDelhi, IN
    Hiring for Analyst -Business Intelligence - Night shift.Strong experience in Data visualization tools (Power bi / Tableau). Shift - US shift (6 : 30 pm- 3 : 30 am).Interested candidate can drop your resu...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIGhaziabad, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyDelhi, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Baazi GamesNarela, Delhi, India
    As a Data Engineer at Baazi Games, you will be focused on delivering data-driven insights to various functional teams enabling them to make strategic decisions that add value to the top or bottom l...Show moreLast updated: 2 hours ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Response InformaticsDelhi, IN
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 13 hours ago
    • Promoted
    Data Engineer - Web Scraping

    Data Engineer - Web Scraping

    Alternative PathDelhi, IN
    Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm.In this role, you will collaborate with individuals across various company de...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXDelhi, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago