Azure Data EngineerEkfrazo Technologies Private Limited • Bengaluru, Karnataka, India
Azure Data Engineer
Ekfrazo Technologies Private Limited • Bengaluru, Karnataka, India
6 hours ago
Job descriptionDevelop Azure Functions (Python) to extract data from REST / SOAP APIs , handle pagination, throttling, and authentication (OAuth2, JWT, API keys). Implement retry logic, monitoring, error handling, and logging in API ingestion pipelines. Parse and transform complex JSON / XML structures. Write optimized PySpark jobs for data processing, cleansing, aggregation, and transformations. Work with Delta Lake for ACID transactions, schema evolution, and time-travel queries. Optimize Spark jobs using partitioning, caching, broadcast joins, and AQE. Utilize Azure services such as : Azure Data Lake Storage (ADLS Gen2) Azure Data Factory (ADF) Azure Synapse Analytics (SQL Pool / Serverless SQL) Azure Databricks Azure Key Vault Azure Functions Deploy and manage solutions using CI / CD pipelines with Azure DevOps. Design and develop data warehouse models (Star Schema, Snowflake). Write advanced SQL queries for transformations, validation, performance tuning. Create and manage tables, partitions, stored procedures, and views in Azure Synapse / SQL Server . Implement data validation, profiling, and quality checks. Maintain metadata, lineage, and documentation using appropriate tools. Ensure compliance with security policies, encryption, and access management. Python (5+ years) PySpark / Spark SQL Azure Cloud (ADF, ADLS, Functions, Synapse, Databricks) REST API integration JSON, XML Parsing SQL (T-SQL / Spark SQL / Synapse SQL) ETL / ELT development Delta Lake
Role : Data Engineer
Exp : 5 Years+
Location : Remote / Hybrid
Work Timing : 2 PM - 10 PM UK Time Zone
Immediate Joiners
Key Skills : Python, Pyspark, Azure Cloud, Azure Functions for Data Extraction from different APIs , Azure Synapse, Data Bricks , JSON, SQL
We are looking for an experienced Data Engineer (5+ years) who has strong hands-on expertise in building scalable data pipelines, API integrations, cloud-native solutions, and big data processing . The ideal candidate must have deep experience with Python , PySpark , Azure Data Platform (ADLS, ADF, Functions, Synapse, Databricks) , and SQL-based data modeling .
🔷 Key Responsibilities
1. Data Pipeline Development
- Design, develop, and maintain end-to-end ETL / ELT pipelines using Azure Data Factory, Databricks, and PySpark.
- Build scalable data ingestion workflows from various sources including REST APIs, databases, cloud storage, and streaming systems .
- Implement incremental load, CDC (Change Data Capture) , and high-volume data ingestion frameworks.
2. API Data Extraction & Azure Functions
3. Big Data Processing (PySpark / Databricks)
4. Azure Cloud Data Platform
5. Data Modeling & SQL
6. Data Quality & Governance
🔷 Required Technical Skills
Core Skills
Create a job alert for this search
Azure Data Engineer • Bengaluru, Karnataka, India
Related jobs
For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
Azure Data Engineer-Technical Lead
Sigmoid • Bengaluru, Karnataka, India
Kindly find the Job Description Below.Job Title : Technical Lead-Azure Data Engineer.Years of Experience : 10+ years of experience.
We are looking for a detailed oriented self-starter to assist our eng...Show more
Last updated: 2 days ago • Promoted
Data engineer - AWS - Inperson drive
Live Connections • Greater Bengaluru Area, India
Show more
Last updated: 2 days ago • Promoted
Azure-ETL Engineer
Coforge • hosur, tamil nadu, in
The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs.
Design, implement, and maintain d...Show more
Last updated: 30+ days ago • Promoted
Azure Data Engineer
Tata Consultancy Services • Bangalore, IN
Role : Azure Data Engineer – Databricks, DBT.Required Technical Skill Set : Data Lake architecture, Azure Services – ADLS, ADF, Azure Databricks, Synapse.
Build the solution for optimal extraction, ...Show more
Last updated: 30+ days ago • Promoted
Senior Azure Data Engineer
Wissen Infotech • Bengaluru, Karnataka, India
Azure Data Engineer Know anyone who is interested!! Share your resumes to adilakshmi.Wissen Infotech is hiring for Bangalore.
Job Title : Azure Data Engineer.Years of Experience : 8 plus years.Locatio...Show more
Last updated: 30+ days ago • Promoted
Data Engineer I
Licious • Greater Bengaluru Area, India
SDE 1 – Data Platform Engineer.We are looking for a passionate and motivated.Software Development Engineer (SDE 1) – Data Platform.
Data Platform Engineering team at.In this role, you’ll design, bui...Show more
Last updated: 2 days ago • Promoted
Lead Azure Data Engineer
IQVIA • Bengaluru, Karnataka, India
Data Engineering, Python, Azure Databricks, Database, People management experience.Manages a team of professional-level employees.
Develops and communicates plans and priorities to meet team perform...Show more
Last updated: 13 days ago • Promoted
Azure Data Engineer
Capgemini Invent • Bengaluru, Karnataka, India
At Capgemini Invent, we believe difference drives change.As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to...Show more
Last updated: 2 days ago • Promoted
Snowflake Azure Data Engineer- (ADF +Snowflake)
Tredence Inc. • bangalore, karnataka, in
Job Location- Kolkata, Chennai, Pune, Bangalore, Gurugram.Primary Roles and Responsibilities : .Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.Ability to provide solut...Show more
Last updated: 30+ days ago • Promoted
AWS Data Engineer
Tata Consultancy Services • hosur, tamil nadu, in
TCS is Hiring AWS Data Engineer Bangalore location.Strong hands-on experience in Python programming and PySpark.Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda).Experience working w...Show more
Last updated: 28 days ago • Promoted
Azure Data Engineer
Rainier Softech Solutions Pvt Ltd • Bengaluru, Karnataka, India
We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks.You’ll turn requirements into production-grade ELT / ETL jobs, Delta Lake tables, and reusable comp...Show more
Last updated: 5 days ago • Promoted
Senior Azure Data Engineer
Tata Consultancy Services • Greater Bengaluru Area, India
Job Title : Senior Azure Data Engineer.Required Skillset : Azure data factory, data bricks, data lake, automation and performance optimization of ETL.
Good Knowledge of Data Brick lakehouse and Azure ...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Tata Consultancy Services • Greater Bengaluru Area, India
Previous experience as a data engineer or in a similar role.Must have experience with MS Azure services such as Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Syn...Show more
Last updated: 2 days ago • Promoted
Azure Data Engineer
Teamware Solutions • Bangalore, IN
We’re Hiring – Azure Data Engineer | 6–8 Years Experience 🚀.We are looking for a highly skilled.Azure Data Factory, PySpark, and Databricks.
Chennai / Bangalore / Pune / Hyderabad.Immediate to 15 D...Show more
Last updated: 6 hours ago • Promoted • New!
(Senior) Azure Data Engineer - Full remote - contractor in USD
All European Careers • Bangalore, IN
Remote
Last updated: 6 days ago • Promoted
Azure Data Engineer
LTIMindtree • Bengaluru, Karnataka, India
Role Senior Data Engineer 8 years of experience.Build reusable utilities templates and automation pipelines.Design scalable data engineering frameworks standards and best practices.Provide architec...Show more
Last updated: 30+ days ago • Promoted
Azure data engineer
Tata Consultancy Services • Bengaluru, Karnataka, India
We await your innovation at TCS : Hiring |.Greetings from TCS!! We are Hiring for Azure Data Engineer.Required Experience : 8-12 years.
Work location : Chennai, Bangalore.Required technical Skills : Azu...Show more
Last updated: 19 days ago • Promoted
Data Engineer Technical Lead(Azure)
Sigmoid • Greater Bengaluru Area, India
Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting.
We collaborate with some of the world’s leading data-rich organizations ...Show more
Last updated: 2 days ago • Promoted