Talent.com
Azure Data Engineer
Azure Data EngineerEkfrazo Technologies Private Limited • Karnataka, India
Azure Data Engineer

Azure Data Engineer

Ekfrazo Technologies Private Limited • Karnataka, India
1 day ago
Job description

Role : Data Engineer

Exp : 5 Years+

Location : Remote / Hybrid

Work Timing : 2 PM - 10 PM UK Time Zone

Immediate Joiners

Key Skills : Python, Pyspark, Azure Cloud, Azure Functions for Data Extraction from different APIs , Azure Synapse, Data Bricks , JSON, SQL

We are looking for an experienced Data Engineer (5+ years) who has strong hands-on expertise in building scalable data pipelines, API integrations, cloud-native solutions, and big data processing . The ideal candidate must have deep experience with Python , PySpark , Azure Data Platform (ADLS, ADF, Functions, Synapse, Databricks) , and SQL-based data modeling .

🔷 Key Responsibilities

1. Data Pipeline Development

  • Design, develop, and maintain end-to-end ETL / ELT pipelines using Azure Data Factory, Databricks, and PySpark.
  • Build scalable data ingestion workflows from various sources including REST APIs, databases, cloud storage, and streaming systems .
  • Implement incremental load, CDC (Change Data Capture) , and high-volume data ingestion frameworks.

2. API Data Extraction & Azure Functions

  • Develop Azure Functions (Python) to extract data from REST / SOAP APIs , handle pagination, throttling, and authentication (OAuth2, JWT, API keys).
  • Implement retry logic, monitoring, error handling, and logging in API ingestion pipelines.
  • Parse and transform complex JSON / XML structures.
  • 3. Big Data Processing (PySpark / Databricks)

  • Write optimized PySpark jobs for data processing, cleansing, aggregation, and transformations.
  • Work with Delta Lake for ACID transactions, schema evolution, and time-travel queries.
  • Optimize Spark jobs using partitioning, caching, broadcast joins, and AQE.
  • 4. Azure Cloud Data Platform

  • Utilize Azure services such as :
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics (SQL Pool / Serverless SQL)
  • Azure Databricks
  • Azure Key Vault
  • Azure Functions
  • Deploy and manage solutions using CI / CD pipelines with Azure DevOps.
  • 5. Data Modeling & SQL

  • Design and develop data warehouse models (Star Schema, Snowflake).
  • Write advanced SQL queries for transformations, validation, performance tuning.
  • Create and manage tables, partitions, stored procedures, and views in Azure Synapse / SQL Server .
  • 6. Data Quality & Governance

  • Implement data validation, profiling, and quality checks.
  • Maintain metadata, lineage, and documentation using appropriate tools.
  • Ensure compliance with security policies, encryption, and access management.
  • 🔷 Required Technical Skills

    Core Skills

  • Python (5+ years)
  • PySpark / Spark SQL
  • Azure Cloud (ADF, ADLS, Functions, Synapse, Databricks)
  • REST API integration
  • JSON, XML Parsing
  • SQL (T-SQL / Spark SQL / Synapse SQL)
  • ETL / ELT development
  • Delta Lake
  • Create a job alert for this search

    Azure Data Engineer • Karnataka, India

    Related jobs
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Karnataka, India, India
    Locations : Hyderabad, Kolkata, Noida, Chennai, Bangalore.Designing and building Databricks data pipelines is required.Experience in transforming the data using Azure Databricks & Delta lake.Hands-o...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer

    Data Engineer

    VIDA Digital Identity • Karnataka, India
    At VIDA we’re building the future of digital identity.As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling.You’ll help us moderniz...Show more
    Last updated: 3 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Truecaller • Karnataka, India
    Hello, Truecaller is calling you from Bangalore, India! Ready to pick up?.Our goal is to make communication smarter, safer, and more efficient, while building trust across the world.With our roots ...Show more
    Last updated: 8 days ago • Promoted
    Data Engineer - Python / SQL

    Data Engineer - Python / SQL

    Tehno Right • Karnataka
    Job profile and Role : Data Engineer Job description : - Strong experience with Postgres and SQL and experience working with, supporting and maintaining re...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Atyeti Inc • Karnataka, India
    Looking for Data Engineer who will be responsible for design, build and maintenance of data pipelines running on Airflow, Spark on the AWS Cloud platform. Build and maintain all facets of Data Pipel...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer I

    Data Engineer I

    Licious • Karnataka, India
    SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform. Data Platform Engineering team at.In this role, you’ll design, bui...Show more
    Last updated: 13 hours ago • Promoted • New!
    Palantir Foundry Data Engineer - 5+ Yrs - Bangalore

    Palantir Foundry Data Engineer - 5+ Yrs - Bangalore

    UST • Karnataka, India
    CCTC | ECTC | Notice Period | Location Preference.Act fast for immediate attention! ⏳📩.Strong hands-on experience with.Ability to design, build and optimize large-scale data pipelines.Familiarity ...Show more
    Last updated: 8 days ago • Promoted
    Azure Data Engineer-Technical Lead

    Azure Data Engineer-Technical Lead

    Sigmoid • Karnataka, India
    Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience. We are looking for a detailed oriented self-starter to assist our eng...Show more
    Last updated: 3 days ago • Promoted
    Data Engineer

    Data Engineer

    Flexton Inc. • Karnataka, India
    San Jose, CA with development centers in India at multiple locations.We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital a...Show more
    Last updated: 17 days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Ignisov Consulting Services • Karnataka, India
    Job Location : Bangalore (Work from Office).AWS Snowflake, Python, Pyspark.Support pipeline buildout, implementation, and RFC deployments for new business use cases. Assignment group / project repo seg...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Quess IT Staffing • Karnataka, India
    We are looking for a highly skilled.The ideal candidate should have deep expertise in.Snowflake, PySpark, SQL, DBT, Airflow.Show more
    Last updated: 6 days ago • Promoted
    Aws Databricks Engineer

    Aws Databricks Engineer

    People Prime Worldwide • Karnataka, India
    Experience : 5–12 Years (STRICTLY).Notice Period : Immediate Joiners / ≤ 30 Days Only.Our client is a global leader in digital transformation and IT services across 50+ countries.They specialize in c...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer / Architect - Snowflake

    Senior Data Engineer / Architect - Snowflake

    Aezion, Inc • Karnataka, India
    We are seeking a highly skilled Snowflake Data Engineer with expertise in DBT, Airbyte, and Airflow, combined with strong experience in Kimball dimensional modeling. The ideal candidate will design ...Show more
    Last updated: 3 days ago • Promoted
    Azure Cloud Engineer

    Azure Cloud Engineer

    Ashra Technologies Private Limited • KA, India
    Quick Apply
    Azure Operations Engineer (Data Platform / Databricks / DevOps) Job Description : We are seeking a...Show more
    Last updated: 14 days ago
    Data Engineer

    Data Engineer

    PwC India • Karnataka, India
    We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. You’ll play a key role in building secure, scalab...Show more
    Last updated: 3 days ago • Promoted
    Azure Databricks

    Azure Databricks

    Tata Consultancy Services • Are Telagadde, Karnataka, India
    Job title : Azure Data Engineer Job Location : Kolkata, Pune, Bangalore, New Delhi Experience : 4-13 years Virtual Interview : 28th Nov (Friday) Build the solution for optimal extraction, transform...Show more
    Last updated: 23 hours ago • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Ashra Technologies Private Limited • KA, India
    Quick Apply
    Job Description : We are looking for a skilled Operations Engineer to support our Azure-based Data Engineering platform powered by Databricks. This role blends DevOps practice...Show more
    Last updated: 1 day ago
    Data Engineer

    Data Engineer

    Ubique Systems • Karnataka, India
    Primary skills : Python, SQL, data lakes, azure.Pipeline Development & Automation.Design, build, and maintain CI / CD pipelines to automate deployment of DQ rules and data services across environments...Show more
    Last updated: 3 days ago • Promoted