Talent.com
This job offer is not available in your country.
Data Engineer(Azure)

Data Engineer(Azure)

PwC IndiaBengaluru, Karnataka, India
1 day ago
Job description

Skill : Azure Data Engineer

Total Experience Required : 4 to 8 years

Location : Mumbai / Pune / Bangalore / Gurgaon

Overview :

We are seeking a highly skilled and motivated Data Engineer to join our growing data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data lake solutions using Azure Data Services, Apache Spark, and Big Data technologies. This role requires strong hands-on experience in data integration, transformation, and storage using tools such as Azure Synapse, Azure Data Factory, Databricks, SQL Server, and PySpark. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure the availability, quality, and reliability of data assets for analytics and AI workloads.

Responsibilities :

  • Design, build, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Synapse, and Databricks.
  • Develop and optimize large-scale data processing jobs using PySpark and Spark SQL on Azure Databricks or Synapse Spark pools.
  • Manage and work with large datasets stored in data lakes (ADLS Gen2) and integrate with enterprise data warehouses (e.g., SQL Server, Synapse).
  • Implement robust data transformation, cleansing, and aggregation logic to support analytics and reporting use cases.
  • Collaborate with BI developers, analysts, and data scientists to provision clean, reliable, and timely datasets.
  • Optimize data flows for performance and cost efficiency on Azure cloud platforms.
  • Implement data governance, lineage, and security practices across the data architecture.
  • Troubleshoot and resolve data pipeline failures and ensure high availability and fault-tolerant design.
  • Participate in code reviews, adhere to version control practices, and maintain high coding standards.

Mandatory Skill-sets :

  • Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks
  • Apache Spark, PySpark
  • SQL Server / T-SQL / Synapse SQL
  • Azure Data Lake Storage Gen2
  • Big Data ecosystem knowledge (Parquet, Delta Lake, etc.)
  • Git, DevOps pipelines for data engineering
  • Performance tuning of Spark jobs and SQL queries
  • Preferred Skill-sets :

  • Python for data engineering workflows
  • Azure Monitor, Log Analytics for pipeline observability
  • Power BI (data modeling, DAX)
  • Delta Lake
  • Experience with CI / CD for data pipelines (YAML pipelines, ADF integration)
  • Knowledge of data quality tools and frameworks
  • Create a job alert for this search

    Data • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    Azure Data Engineer Lead

    Azure Data Engineer Lead

    Creative Synergies GroupBengaluru, Karnataka, India
    Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 2 days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesBengaluru, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 27 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Servicesbangalore, karnataka, in
    Job Title : Azure Data Engineer.Required Skillset : Azure Databricks(Strong),scala(strong), Pyspark(Good to have).Azure Databricks using Scala, PySpark. Software Development Life Cycle experience.Work...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLhosur, tamil nadu, in
    We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh Technologieshosur, tamil nadu, in
    Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing. Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Deltacubeshosur, tamil nadu, in
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 16 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekhosur, tamil nadu, in
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 19 days ago
    • Promoted
    Azure Purview Data Engineer

    Azure Purview Data Engineer

    LTIMindtreeBengaluru, Karnataka, India
    LTIMindtree is proud to be an equal opportunity employer.We are committed to equal employment opportunity regardless of race, ethnicity, nationality, gender, gender-identity, gender expression, lan...Show moreLast updated: 15 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Xebiabangalore, karnataka, in
    We’re Hiring | Azure Data Engineer | Bangalore (Hybrid).Bangalore (Hybrid, 3 days office / week).Immediate to 2 weeks – only apply if you can join early. Azure Data Factory (ADF), Databricks (ADB), Da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Wissen InfotechBengaluru, Karnataka, India
    Azure Data Engineer Know anyone who is interested!! Share your resumes to.Wissen Infotech is hiring for Bangalore.Job Title : Azure Data Engineer. Years of Experience : 8 plus years.Location : Bangalor...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iobangalore district, karnataka, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. We are seeking a highly skilled and experie...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceshosur, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 6 days ago
    • Promoted
    Senior Azure Data Engineer - Full remote - contractor in USD

    Senior Azure Data Engineer - Full remote - contractor in USD

    All European Careersbangalore district, karnataka, in
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote SeniorAzure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databrick...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incbangalore district, karnataka, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Everisehosur, tamil nadu, in
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Net Zero Insightshosur, tamil nadu, in
    Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide.Our cuttin...Show moreLast updated: 1 day ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    TEKsystemsBengaluru, Karnataka, India
    Your skills & Your Experience Experience.Analytics and Data Warehousing.Experience in building end-to-end solutions with the Big data platform, Spark or scala programming.Solid experience in ETL pi...Show moreLast updated: 7 days ago