Talent.com
Azure Data Engineer
Azure Data EngineerEkfrazo Technologies Private Limited • Bengaluru, Karnataka, India
No longer accepting applications
Azure Data Engineer

Azure Data Engineer

Ekfrazo Technologies Private Limited • Bengaluru, Karnataka, India
1 day ago
Job description

Role : Data Engineer

Exp : 5 Years+

Location : Remote / Hybrid

Work Timing : 2 PM - 10 PM UK Time Zone

Immediate Joiners

Key Skills : Python, Pyspark, Azure Cloud, Azure Functions for Data Extraction from different APIs , Azure Synapse, Data Bricks , JSON, SQL

We are looking for an experienced Data Engineer (5+ years) who has strong hands-on expertise in building scalable data pipelines, API integrations, cloud-native solutions, and big data processing . The ideal candidate must have deep experience with Python , PySpark , Azure Data Platform (ADLS, ADF, Functions, Synapse, Databricks) , and SQL-based data modeling .

🔷 Key Responsibilities

1. Data Pipeline Development

  • Design, develop, and maintain end-to-end ETL / ELT pipelines using Azure Data Factory, Databricks, and PySpark.
  • Build scalable data ingestion workflows from various sources including REST APIs, databases, cloud storage, and streaming systems .
  • Implement incremental load, CDC (Change Data Capture) , and high-volume data ingestion frameworks.

2. API Data Extraction & Azure Functions

  • Develop Azure Functions (Python) to extract data from REST / SOAP APIs , handle pagination, throttling, and authentication (OAuth2, JWT, API keys).
  • Implement retry logic, monitoring, error handling, and logging in API ingestion pipelines.
  • Parse and transform complex JSON / XML structures.
  • 3. Big Data Processing (PySpark / Databricks)

  • Write optimized PySpark jobs for data processing, cleansing, aggregation, and transformations.
  • Work with Delta Lake for ACID transactions, schema evolution, and time-travel queries.
  • Optimize Spark jobs using partitioning, caching, broadcast joins, and AQE.
  • 4. Azure Cloud Data Platform

  • Utilize Azure services such as :
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics (SQL Pool / Serverless SQL)
  • Azure Databricks
  • Azure Key Vault
  • Azure Functions
  • Deploy and manage solutions using CI / CD pipelines with Azure DevOps.
  • 5. Data Modeling & SQL

  • Design and develop data warehouse models (Star Schema, Snowflake).
  • Write advanced SQL queries for transformations, validation, performance tuning.
  • Create and manage tables, partitions, stored procedures, and views in Azure Synapse / SQL Server .
  • 6. Data Quality & Governance

  • Implement data validation, profiling, and quality checks.
  • Maintain metadata, lineage, and documentation using appropriate tools.
  • Ensure compliance with security policies, encryption, and access management.
  • 🔷 Required Technical Skills

    Core Skills

  • Python (5+ years)
  • PySpark / Spark SQL
  • Azure Cloud (ADF, ADLS, Functions, Synapse, Databricks)
  • REST API integration
  • JSON, XML Parsing
  • SQL (T-SQL / Spark SQL / Synapse SQL)
  • ETL / ELT development
  • Delta Lake
  • Create a job alert for this search

    Azure Data Engineer • Bengaluru, Karnataka, India

    Related jobs
    Azure Data Engineer

    Azure Data Engineer

    Talent Worx • Bengaluru, KA, IN
    Quick Apply
    Global consulting firm seeking an Azure Data Engineer to join our dynamic team.As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows ...Show more
    Last updated: 30+ days ago
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    IQVIA • bangalore, karnataka, in
    Data Engineering, Python, Azure Databricks, Database, People management experience.Manages a team of professional-level employees. Develops and communicates plans and priorities to meet team perform...Show more
    Last updated: 14 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    TCS is Hiring for Azure Data Engineer • •.Desired Experience : 4- 8 Years.Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure...Show more
    Last updated: 30+ days ago • Promoted
    Azure data engineer

    Azure data engineer

    Stratus • bangalore, karnataka, in
    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks. Experience with Agile development methodologies and tools, such as Jira, t...Show more
    Last updated: 15 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Stratus • Bengaluru, Republic Of India, IN
    Lead a team of data engineers to develop data analytic solutions such as data warehouse and data marts on Azure Databricks. Experience with Agile development methodologies and tools, such as Jira, t...Show more
    Last updated: 15 days ago • Promoted
    Azure Data Solutions Engineer

    Azure Data Solutions Engineer

    Sigmoid • Bengaluru, Republic Of India, IN
    We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.You will be responsible for designing, implementing, and maintaining data pipelines to support our organization'...Show more
    Last updated: 16 days ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Confidential • Bengaluru, Republic Of India, IN
    We are seeking a skilled and motivated Azure Data Architect with 8-12 years of relevant experience.Candidate will play a pivotal role in designing, implementing, and optimizing large-scale data sol...Show more
    Last updated: 14 days ago • Promoted
    Azure Data Engineer - Synapse Analytics / Apache Airflow

    Azure Data Engineer - Synapse Analytics / Apache Airflow

    Nazztec Private Limited • Bangalore
    Job Title : Azure data engineer Location : Bangalore Experience : 6- 8 years ...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    Sigmoid • bangalore, karnataka, in
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show more
    Last updated: 5 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Capgemini Invent • Bengaluru, Karnataka, India
    At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
    Last updated: 4 days ago • Promoted
    Azure Data Engineer - Databricks

    Azure Data Engineer - Databricks

    Confidential • Bengaluru / Bangalore
    Role- Azure Data Engineer - Databricks.Build the solution for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure data ingestion and transformati...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Confidential • Bengaluru / Bangalore
    Azure Data Engineering Stack (Data Factory, Databricks, Synapse, Event Hub, Cosmos DB, ADLS Gen2, Function app).Good understanding of other Azure services. Good understanding of Data Warehouse Archi...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Trigent Software Private Limited • Bengaluru, Karnataka, India
    AZure Python SQL Factory (ADF) : For orchestrating and automating data movement and transformation.Databricks / Apache Spark : For big data processing and large-scale ETL / ELT.Synapse Analytics : For da...Show more
    Last updated: 30+ days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Ekfrazo Technologies Private Limited • Bengaluru, India
    Work Timing : 2 PM - 10 PM UK Time Zone.Key Skills : Python, Pyspark, Azure Cloud, Azure Functions for Data Extraction from different APIs , Azure Synapse, Data Bricks , JSON, SQL.We are looking for ...Show more
    Last updated: 1 day ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Rainier Softech Solutions Pvt Ltd • bangalore, India
    We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks.You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable comp...Show more
    Last updated: 7 days ago • Promoted
    Azure Data Engineer ( Azure Databricks)

    Azure Data Engineer ( Azure Databricks)

    Confidential • Bengaluru / Bangalore
    Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse.Implement data lake solutions and work with structured and unstructured datase...Show more
    Last updated: 25 days ago • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Tata Consultancy Services • Bengaluru, Karnataka, India
    Greetings from TCS! Job Title : Senior Data Engineer (Azure / SSIS) Location : PAN INDIA Experience Range : 7-14 years.Required Skillset : - Minimum 6 yrs of experience in building ETL pipeline using...Show more
    Last updated: 5 days ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    LTIMindtree • Bengaluru, Karnataka, India
    Seeking an experienced Senior Specialist with 7 to 11 years of expertise in Azure Data Factory and Azure SQL to design and manage scalable data integration solutions. Design develop and maintain sca...Show more
    Last updated: 30+ days ago • Promoted