Talent.com
This job offer is not available in your country.
Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Data Engineer - BigQuery, Spark SQL, Microsoft Fabric - 10+ Years - Immediate joiners only

Blue Cloud Softech Solutions LimitedTiruchirappalli, IN
1 day ago
Job description

Role- Data Engineer

Work Mode- Remote

Mandatory Skills - BigQuery, Spark SQL, Microsoft Fabric and who have worked on Big Data as this is a complex project.

Profile Summary

Data Engineer with over 10 years of experience designing and building large-scale data platforms across cloud and on-prem ecosystems. Proven track record of developing high performance ETL pipelines, optimizing data infrastructure, and enabling analytics teams through reliable, well-structured, and secure data systems. Deep expertise in Microsoft Fabric and GCP, with hands-on experience across data ingestion, transformation, modeling, and delivery. Comfortable working in fast-moving environments that require ownership, adaptability, and strong collaboration with analytics and product teams.

Core Skills

Microsoft Fabric

  • Designed and implemented pipelines and dataflows (Gen2) to orchestrate data ingestion from multiple structured and semi-structured sources.
  • Developed notebooks using Python and Spark SQL for data wrangling, feature engineering, and model-ready transformations.
  • Experience in Fabric & Azure DevOps for automated deployment of pipelines, datasets, and reports.
  • Defined security and access control strategies in Fabric, ensuring compliance with enterprise data governance standards.
  • Built and optimized Direct Lake models for low-latency Power BI reporting.
  • Developed advanced DAX measures and tabular models to support complex analytical dashboards.

Google Cloud Platform (GCP)

  • Experience using BigQuery, improving performance and reducing query costs through partitioning and clustering.
  • Automated workflows using Cloud Functions to handle event-based data transformations and notifications.
  • Integrated real-time streaming data through Pub / Sub, enabling near real-time analytics pipelines.
  • Technical Skills

  • Languages : Python, SQL, Spark SQL
  • Tools : Microsoft Fabric, Power BI, Azure DevOps, Git, GCP Console, Dataflow, Dataproc
  • Concepts : Data Modeling (Kimball, Data Vault), ETL / ELT, CI / CD, Data Governance, Security, Performance Optimization
  • Experience Highlights

  • Led migration of on-prem ETL workflows to Microsoft Fabric
  • Built an end-to-end analytics solution combining BigQuery with Power BI
  • Designed a CI / CD pipeline in Fabric, automating dataset promotion from dev to production with integrated testing and validation.
  • Partnered with data scientists to deliver feature stores and ML-ready datasets using Fabric Notebooks and Spark SQL.
  • Implemented Fabric security model to support row-level access and data masking across multiple business domains.
  • Created a unified metadata catalog and data quality monitoring framework, improving data discoverability and trust.
  • Education

  • Bachelor’s degree in Computer Science (or related field)
  • Create a job alert for this search

    Data Engineer • Tiruchirappalli, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    NuVision Auto GlassTiruchirappalli, IN
    NuVision Auto Glass is a leading auto glass service provider in the USA, serving customers across Arizona, Florida, South Carolina, and Colorado. Known for delivering reliable mobile windshield repl...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Jade Business Services (JBS)Tiruchirappalli, IN
    Data Engineer (AI Knowledge Base Platform).The engineer will be responsible for ensuring reliable, scalable, and secure data movement across multiple sources, powering Retrieval-Augmented Generatio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    AAA GlobalTiruchirappalli, IN
    Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalTiruchirappalli, IN
    Insight Global is looking for a skilled senior level Data Engineer in Hyderabad or remote India for a large AAA gaming company on a contract for 3 months with possibility of extension or conversion...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Sikich IndiaTiruchirappalli, IN
    Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Access & SQL Specialist

    Senior Access & SQL Specialist

    ResearchFox Consultingtiruchirappalli, tamil nadu, in
    Title : Senior Access & SQL Specialist.Team : AI Strategy & Transformation team.We are looking for highly versatile, pragmatic individual to join our AI Strategy & Transformation team as a hands-on en...Show moreLast updated: 8 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    V2Softtiruchirappalli, tamil nadu, in
    Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala. Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTektiruchirappalli, tamil nadu, in
    We are seeking a skilled and motivated Data Engineer with 5–8 years of experience in building scalable data pipelines using Python, PySpark, and AWS services. The ideal candidate will have hands-on ...Show moreLast updated: 30+ days ago
    • Promoted
    PySpark Data Engineer

    PySpark Data Engineer

    EXTRAGIGTiruchirappalli, IN
    Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role. Execute creative software and data solutions, including des...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    SapaadTiruchirappalli, IN
    Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering.F&B businesses across 40+ countries. Driven by a passionate team of developers, designers, a...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsTiruchirappalli, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 11 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AITiruchirappalli, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeTiruchirappalli, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    NOQTiruchirappalli, IN
    Senior Data & Reporting Developer (Remote | India | Contract Role).NOQ Group is a technology-driven organization dedicated to delivering innovative data solutions for businesses in the food and bev...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseTiruchirappalli, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    XebiaTiruchirappalli, IN
    We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early. Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AITiruchirappalli, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 9 days ago
    • Promoted
    OAC+OBIEE Developer

    OAC+OBIEE Developer

    PwC IndiaTamil Nadu, India, India
    Development experience on OAS, OAC(DVCS and BICS), OBIA or FAW knowledge will be added advantage.Experience on lift & shift of OBIEE to OAC. Should have excellent debugging and troubleshooting skill...Show moreLast updated: 23 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyTiruchirappalli, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsTiruchirappalli, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 23 days ago