Talent.com
No longer accepting applications
Azure + Microsoft Fabric + PySpark

Azure + Microsoft Fabric + PySpark

PwC IndiaKolkata, West Bengal, India
30+ days ago
Job description

Job Title : Azure + Microsoft Fabric + PySpark

Experience : 4 to 8 years

Notice Period : Immediate joiners to 30 days, Serving notice period

Job Description (JD) Azure Data Engineering role focused on Microsoft Fabric (good to have), Azure Databricks with PySpark (must have) capabilities and strong emphasis on Python, SQL, Data Lake, and Data Warehouse :

Job Title : Data Engineer – Microsoft Fabric, Azure (Databricks & ADF), PySpark

Experience : 4–8 Years

Location : Kolkata / Bangalore

Employment Type : Full-Time

Job Summary :

We are looking for a skilled and experienced Data Engineer with 5-8 years of experience in building scalable data solutions on the Microsoft Azure ecosystem. The ideal candidate must have strong hands-on experience with Microsoft Fabric, Azure Databricks along with strong PySpark, Python and SQL expertise. Familiarity with Data Lake, Data Warehouse concepts, and end-to-end data pipelines is essential.

Key Responsibilities :

  • Requirement gathering and analysis
  • Experience with different databases like Synapse, SQL DB, Snowflake etc.
  • Design and implement data pipelines using Microsoft Fabric & Databricks
  • Extract, transform, and load (ETL) data from various sources into Azure Data Lake Storage
  • Implement data security and governance measures
  • Monitor and optimize data pipelines for performance and efficiency
  • Troubleshoot and resolve data engineering issues
  • Provide optimized solution for any problem related to data engineering
  • Ability to work with a variety of sources like Relational DB, API, File System, Realtime streams, CDC etc.
  • Strong knowledge on Databricks, Delta tables

Required Skills :

  • 5–8 years of experience in Data Engineering or related roles.
  • Hands-on experience in Microsoft Fabric
  • Hands-on experience in Azure Databricks
  • Proficiency in PySpark for data processing and scripting.
  • Strong command over Python & SQL – writing complex queries, performance tuning, etc.
  • Experience working with Azure Data Lake Storage and Data Warehouse concepts (e.g., dimensional modeling, star / snowflake schemas).
  • Hands on experience in performance tuning & optimization on Databricks & MS Fabric.
  • Ensure alignment with overall system architecture and data flow.
  • Understanding CI / CD practices in a data engineering context.
  • Excellent problem-solving and communication skills.
  • Exposure to BI tools like Power BI, Tableau, or Looker.
  • Good to Have :

  • Experienced in Azure DevOps.
  • Knowledge of Scala or other distributed processing frameworks.
  • Familiarity with data security and compliance in the cloud.
  • Experience in leading a development team.
  • Create a job alert for this search

    Microsoft Azure • Kolkata, West Bengal, India

    Related jobs
    • Promoted
    SDE II (Fullstack)

    SDE II (Fullstack)

    NxtWaveKolkata, IN
    NxtWave is one of India’s fastest-growing edtech startups, transforming the way students learn and build careers in tech. With a strong community of learners across the country, we’re building cutti...Show moreLast updated: 30+ days ago
    • Promoted
    Microsoft Dynamics 365 F&O Developer

    Microsoft Dynamics 365 F&O Developer

    CESkolkata, west bengal, in
    Microsoft Dynamics 365 Finance & Operations (F&O) Developer.This role demands strong technical expertise in.You’ll collaborate closely with business and functional teams to deliver seamless, high-q...Show moreLast updated: 10 days ago
    • Promoted
    Principal Azure Cloud Architect / Principal Engineer

    Principal Azure Cloud Architect / Principal Engineer

    First American (India)Kolkata, IN
    Job Title : Principal Azure Cloud Architect / Principal Engineer (20+ Years Experience).We are seeking a technical visionary Principal Azure Cloud Architect with 20+ years of experience to lead the tr...Show moreLast updated: 30+ days ago
    • Promoted
    Mongo DBA

    Mongo DBA

    Tata Consultancy ServicesKolkata, IN
    Location : Gurgaon, Noida, Bangalore, Bhubaneswar, Hyderabad, kochi, Pune.As an individual contributor, will be involved with Development and Operations of a framework that caters to automating Mon...Show moreLast updated: 19 days ago
    • Promoted
    Azure Devops Engineer

    Azure Devops Engineer

    USTkolkata, west bengal, in
    Agentic AI solutions for CI / CD.Azure DevOps pipelines to GitHub Actions.Show moreLast updated: 10 days ago
    • Promoted
    Azure-ETL Engineer

    Azure-ETL Engineer

    Coforgekolkata, west bengal, in
    The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs. Design, implement, and maintain d...Show moreLast updated: 8 days ago
    • Promoted
    IFS Architect

    IFS Architect

    Numeric TechnologiesKolkata, IN
    Shift Timing : 2 : 00 PM - 10 : 00 PM IST / Remote.This is a cross-functional leadership role responsible for solution architecture, integration strategy, and governance across modules like Supply Chain...Show moreLast updated: 10 days ago
    • Promoted
    Workforce Software Senior Consultant / Solution Architect

    Workforce Software Senior Consultant / Solution Architect

    MPOWER PLUS INDIA PRIVATE LIMITEDKolkata, IN
    Job Title : Workforce Software Senior Consultant / Solution Architect.Exp : 8+yrs (Relevant to WFS 5yrs).Salary - 3,00,000 -3,40,000 / month(gross). Workforce Software implementation.Deep expertise in T...Show moreLast updated: 17 days ago
    • Promoted
    Snowflake Architect

    Snowflake Architect

    Bahwan CyberTekKolkata, IN
    Job Title : Snowflake Architect.Location : [Chennai / Bengaluru / Pune / Mumbai or Remote].Experience Required : 10+ Years. We are seeking a highly skilled Snowflake Architect to design and implement s...Show moreLast updated: 8 days ago
    • Promoted
    Salesforce nCino Technical Architect (Banking Specialist)

    Salesforce nCino Technical Architect (Banking Specialist)

    Kaygen, Inc.Kolkata, IN
    Job Title : Salesforce nCino Technical Architect (Banking Specialist).Experience : 10+ years (5+ years in nCino / Salesforce Financial Services). We seek a hands-on nCino Technical Architect to design a...Show moreLast updated: 19 days ago
    • Promoted
    SAP Basis Cloud architect Advisory

    SAP Basis Cloud architect Advisory

    HCLTechKolkata, IN
    CAA (Cloud Architect Advisory).This is SAP Cloud Architect position which is elevated role as per career progression / path for SAP Basis consultant. Architect’s primary role / responsibility is to pl...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Solutions Architect

    Azure Solutions Architect

    Delphi Consulting Middle EastKolkata, IN
    Join Delphi - Where Innovation meets transformation.At Delphi, we believe in creating an environment where our people thrive. We are committed to supporting your personal goals, family, and overall ...Show moreLast updated: 11 days ago
    • Promoted
    Senior Software Engineer - Python

    Senior Software Engineer - Python

    PICWA IndiaKolkata, IN
    For an Australian ASX listed MedTech company.We're looking for a Python Engineer with 10+ years of experience and expertise in Flask. Years of Python, particularly Flask Framework experience .Servic...Show moreLast updated: 8 days ago
    • Promoted
    Azure & Microsoft 365 Support Engineer L3 / L4 (Fixed Night shifts)

    Azure & Microsoft 365 Support Engineer L3 / L4 (Fixed Night shifts)

    World Wide TechnologyKolkata, IN
    At World Wide Technology, we work together to make a new world happen.Our important work benefits our clients and partners as much as it does our people and communities across the globe.WWT is dedi...Show moreLast updated: 19 days ago
    • Promoted
    Full Stack Engineer

    Full Stack Engineer

    Diligente TechnologiesKolkata, IN
    Two rounds ( each ~ 30 to 45 mins, also includes coding ).On daily basis, 4 : 30 PM-1 : 30 AM IST.May get extended in case of prod issues. Big Data : Scala, Databricks, Spark SQL, Spark Streaming, Python...Show moreLast updated: 30+ days ago
    • Promoted
    IBMi developer (US Shift)

    IBMi developer (US Shift)

    Programmers.ioKolkata, IN
    IO is actively seeking talented individuals who are skilled in IBMi.If you're looking for a flexible work environment that allows you to contribute from anywhere, we want to hear from you.US Based ...Show moreLast updated: 30+ days ago
    • Promoted
    Python AWS

    Python AWS

    Tata Consultancy ServicesGreater Kolkata Area, India
    TCS present an excellent opportunity for Python AWS.Experience required : 6-12 yrs.Virtual Interview Date : 25-Oct-25 (Saturday). Experience with advanced Java / Python concepts like concurrency, async...Show moreLast updated: 8 days ago
    • Promoted
    Azure Architect (Data Engineering)

    Azure Architect (Data Engineering)

    Polestar AnalyticsKolkata, West Bengal, India
    Job Title : Azure Architect – Analytics & Data Services.Location : Noida / Kolkata / Bengaluru.Lead end-to-end architecture design for data and analytics solutions on Azure. Define and implement Azure-bas...Show moreLast updated: 8 days ago