Talent.com
This job offer is not available in your country.
Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Blue Cloud Softech Solutions LimitedKolhapur, IN
1 day ago
Job description

Role- Data Engineer

Work Mode- Remote

Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.

Profile Summary

Data Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams.

Core Skills

Microsoft Fabric

  • Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.
  • Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations.
  • Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports.
  • Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards.
  • Built and optimized Direct Lake models for low-latency Power BI reporting.
  • Developed advanced DAX measures and tabular models to support complex analytical dashboards.

Google Cloud Platform (GCP)

  • Experience using BigQuery, improving performance and reducing query costs through partitioning and clustering.
  • Automated workflows using Cloud Functions to handle event-based data transformations and notifications.
  • Integrated real-time streaming data through Pub / Sub, enabling near real-time analytics pipelines.
  • Technical Skills

  • Languages : Python, SQL, Spark SQL
  • Tools : Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc
  • Concepts : Data Modeling (Kimball, Data Vault), ETL / ELT, CI / CD, Data Governance, Security, Performance Optimization
  • Experience Highlights

  • Led migration of on-prem ETL workflows to Microsoft Fabric
  • Built an end-to-end analytics solution combining BigQuery with Power BI
  • Designed a CI / CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation.
  • Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL.
  • Implemented Fabric security model to support row-level access and data masking across multiple business domains.
  • Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust.
  • Education

  • Bachelor’s degree in Computer Science (or related field)
  • Create a job alert for this search

    Data Engineer • Kolhapur, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsKolhapur, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    NOQKolhapur, IN
    Senior Data & Reporting Developer (Remote | India | Contract Role).NOQ Group is a technology-driven organization dedicated to delivering innovative data solutions for businesses in the food and bev...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadKolhapur, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsKolhapur, IN
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 1 day ago
    • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIGKolhapur, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    NuVision Auto GlassKolhapur, IN
    NuVision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield repl...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyKolhapur, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaKolhapur, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Forage AIKolhapur, IN
    Experience Level : Data Engineer- 3- 7 years of relevant experience in data engineering.Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructu...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKolhapur, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KPG99 INCKolhapur, IN
    Essential Skills and requirements.Advanced proficiency in SQL including stored procedures, views and functions.Solid knowledge of data warehousing principles. Experience working with large data ware...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    PASO CoKolhapur, IN
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKolhapur, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesKolhapur, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseKolhapur, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    KeasisKolhapur, IN
    We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    Senior Access & SQL Specialist

    Senior Access & SQL Specialist

    ResearchFox Consultingkolhapur, maharashtra, in
    Title : Senior Access & SQL Specialist.Team : AI Strategy & Transformation team.We are looking for highly versatile, pragmatic individual to join our AI Strategy & Transformation team as a hands-on en...Show moreLast updated: 4 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    The Transformation GroupKolhapur, IN
    The ideal candidate should possess experience with ETL, data and reporting; and contributing code to deliver new features and functionality. Day-to-day you will collaborate with engineers, product m...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Jade Business Services (JBS)Kolhapur, IN
    Data Engineer (AI Knowledge Base Platform).The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generatio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalKolhapur, IN
    Insight Global is looking for a skilled senior level Data Engineer in Hyderabad or remote India for a large AAA gaming company on a contract for 3 months with possibility of extension or conversion...Show moreLast updated: 30+ days ago