Talent.com
This job offer is not available in your country.
Data Engineer(Azure)

Data Engineer(Azure)

PwC Indiabangalore, karnataka, in
20 hours ago
Job description

Skill : Azure Data Engineer

Total Experience Required : 4 to 8 years

Location : Mumbai / Pune / Bangalore / Gurgaon

Overview :

We are seeking a highly skilled and motivated Data Engineer to join our growing data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data lake solutions using Azure Data Services, Apache Spark, and Big Data technologies. This role requires strong hands-on experience in data integration, transformation, and storage using tools such as Azure Synapse, Azure Data Factory, Databricks, SQL Server, and PySpark. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure the availability, quality, and reliability of data assets for analytics and AI workloads.

Responsibilities :

  • Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Synapse, and Databricks.
  • Develop and optimize large-scale data processing jobs using PySpark and Spark SQL on Azure Databricks or Synapse Spark pools.
  • Manage and work with large datasets stored in data lakes (ADLS Gen2) and integrate with enterprise data warehouses (e.g., SQL Server, Synapse).
  • Implement robust data transformation, cleansing, and aggregation logic to support analytics and reporting use cases.
  • Collaborate with BI developers, analysts, and data scientists to provision clean, reliable, and timely datasets.
  • Optimize data flows for performance and cost efficiency on Azure cloud platforms.
  • Implement data governance, lineage, and security practices across the data architecture.
  • Troubleshoot and resolve data pipeline failures and ensure high availability and fault-tolerant design.
  • Participate in code reviews, adhere to version control practices, and maintain high coding standards.

Mandatory Skill-sets :

  • Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks
  • Apache Spark, PySpark
  • SQL Server / T-SQL / Synapse SQL
  • Azure Data Lake Storage Gen2
  • Big Data ecosystem knowledge (Parquet, Delta Lake, etc.)
  • Git, DevOps pipelines for data engineering
  • Performance tuning of Spark jobs and SQL queries
  • Preferred Skill-sets :

  • Python for data engineering workflows
  • Azure Monitor, Log Analytics for pipeline observability
  • Power BI (data modeling, DAX)
  • Delta Lake
  • Experience with CI / CD for data pipelines (YAML pipelines, ADF integration)
  • Knowledge of data quality tools and frameworks
  • Create a job alert for this search

    Data • bangalore, karnataka, in

    Related jobs
    • Promoted
    Azure Data Engineer Lead

    Azure Data Engineer Lead

    Creative Synergies GroupBengaluru, Karnataka, India
    Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 23 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLhosur, tamil nadu, in
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 26 days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    Veltrishosur, tamil nadu, in
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Serviceshosur, tamil nadu, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekhosur, tamil nadu, in
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 18 days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    Kline + Companyhosur, tamil nadu, in
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 20 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXhosur, tamil nadu, in
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Prudent Technologies and Consulting, Inc.hosur, tamil nadu, in
    Snowflake Instance Management : Set up, configure, and manage between three to four new Snowflake data warehouse instances per quarter, tailored to support emerging products and analytics requiremen...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European Careersbangalore, karnataka, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote SeniorAzure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databrick...Show moreLast updated: 8 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalhosur, tamil nadu, in
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on LinkedIn with resume. Design, develop, and maintai...Show moreLast updated: 30+ days ago
    • Promoted
    Data Platform Engineer

    Data Platform Engineer

    Intuitive.Cloudhosur, tamil nadu, in
    With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization. Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 5 days ago
    • Promoted
    Cloud Data Engineer

    Cloud Data Engineer

    Lemongrasshosur, tamil nadu, in
    Lemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers.Our customers span multip...Show moreLast updated: 21 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIhosur, tamil nadu, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 8 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesBangalore, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Evolenthosur, tamil nadu, in
    Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 24 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iohosur, tamil nadu, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 26 days ago