Talent.com
This job offer is not available in your country.
Data Engineer(Azure)

Data Engineer(Azure)

PwC IndiaBengaluru, Karnataka, India
1 day ago
Job description

Skill : Azure Data Engineer

Total Experience Required : 4 to 8 years

Location : Mumbai / Pune / Bangalore / Gurgaon

Overview :

We are seeking a highly skilled and motivated Data Engineer to join our growing data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data lake solutions using Azure Data Services, Apache Spark, and Big Data technologies. This role requires strong hands-on experience in data integration, transformation, and storage using tools such as Azure Synapse, Azure Data Factory, Databricks, SQL Server, and PySpark. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure the availability, quality, and reliability of data assets for analytics and AI workloads.

Responsibilities :

  • Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Synapse, and Databricks.
  • Develop and optimize large-scale data processing jobs using PySpark and Spark SQL on Azure Databricks or Synapse Spark pools.
  • Manage and work with large datasets stored in data lakes (ADLS Gen2) and integrate with enterprise data warehouses (e.g., SQL Server, Synapse).
  • Implement robust data transformation, cleansing, and aggregation logic to support analytics and reporting use cases.
  • Collaborate with BI developers, analysts, and data scientists to provision clean, reliable, and timely datasets.
  • Optimize data flows for performance and cost efficiency on Azure cloud platforms.
  • Implement data governance, lineage, and security practices across the data architecture.
  • Troubleshoot and resolve data pipeline failures and ensure high availability and fault-tolerant design.
  • Participate in code reviews, adhere to version control practices, and maintain high coding standards.

Mandatory Skill-sets :

  • Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks
  • Apache Spark, PySpark
  • SQL Server / T-SQL / Synapse SQL
  • Azure Data Lake Storage Gen2
  • Big Data ecosystem knowledge (Parquet, Delta Lake, etc.)
  • Git, DevOps pipelines for data engineering
  • Performance tuning of Spark jobs and SQL queries
  • Preferred Skill-sets :

  • Python for data engineering workflows
  • Azure Monitor, Log Analytics for pipeline observability
  • Power BI (data modeling, DAX)
  • Delta Lake
  • Experience with CI / CD for data pipelines (YAML pipelines, ADF integration)
  • Knowledge of data quality tools and frameworks
  • Create a job alert for this search

    Data • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Networth CorpBengaluru, Karnataka, India
    Working along with architects for planning, designing, integrating, and implementing complex solutions in Azure Cloud computing services. End to end development lifecycle of complex large-scale and ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 26 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesBengaluru, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 27 days ago
    • Promoted
    Azure Data Engineer Lead

    Azure Data Engineer Lead

    Creative Synergies GroupBengaluru, Karnataka, India
    Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 1 day ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    Engineer

    Engineer

    Alp Consulting Ltd.hosur, tamil nadu, in
    As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on. You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer(Azure)

    Data Engineer(Azure)

    PwC IndiaBengaluru, Karnataka, India
    We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data lake solutions using Azure Data Ser...Show moreLast updated: 1 day ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    TEKsystemsBengaluru, Karnataka, India
    Your skills & Your Experience Experience.Analytics and Data Warehousing.Experience in building end-to-end solutions with the Big data platform, Spark or scala programming.Solid experience in ETL pi...Show moreLast updated: 7 days ago
    • Promoted
    Azure Purview Data Engineer

    Azure Purview Data Engineer

    LTIMindtreeBengaluru, Karnataka, India
    LTIMindtree is proud to be an equal opportunity employer.We are committed to equal employment opportunity regardless of race, ethnicity, nationality, gender, gender-identity, gender expression, lan...Show moreLast updated: 15 days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Sun LifeBengaluru, Karnataka, India
    To do this, we offer a broad range of protection and wealth products and services to individuals, businesses, and institutions, including : . Life, health, wellness, disability, critical illness, stop...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Xebiabangalore, karnataka, in
    We’re Hiring | Azure Data Engineer | Bangalore (Hybrid).Bangalore (Hybrid, 3 days office / week).Immediate to 2 weeks – only apply if you can join early. Azure Data Factory (ADF), Databricks (ADB), Da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Wissen InfotechBengaluru, Karnataka, India
    Azure Data Engineer Know anyone who is interested!! Share your resumes to.Wissen Infotech is hiring for Bangalore.Job Title : Azure Data Engineer. Years of Experience : 8 plus years.Location : Bangalor...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European Careersbangalore, karnataka, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote SeniorAzure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databrick...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceshosur, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incbangalore, karnataka, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 20 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iohosur, tamil nadu, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data Solutionshosur, tamil nadu, in
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran Systemshosur, tamil nadu, in
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 9 days ago