Data Engineer

Integrated Personnel Services LimitedHyderabad, Hyderabad (district)

3 days ago

Job description

Role : Data Engineer

Location : Hyderabad

Key Responsibilities

Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory .
Work closely with business stakeholders, analysts, and data scientists to understand data requirements and deliver reliable solutions.
Optimize ETL workflows for performance, scalability, and reliability.
Implement best practices for data ingestion, transformation, and integration across multiple sources.
Ensure data quality, governance, and security across the data lifecycle.
Troubleshoot and resolve issues related to data pipelines, storage, and performance.

Required Skills & Qualifications

5+ years of total experience , with 3+ years relevant in PySpark, Azure Data Factory, and Python .

Strong experience in building large-scale data pipelines and ETL workflows.

Hands-on expertise in PySpark for data processing and transformation.

Proficiency in Azure Data Factory (ADF) for orchestrating and automating workflows.

Solid understanding of Python for scripting, data handling, and automation.

Strong SQL skills and ability to work with relational and non-relational databases.

Good knowledge of data warehousing concepts and performance optimization.

Exposure to Azure ecosystem (Data Lake, Databricks, Synapse Analytics, etc.) preferred.

Excellent problem-solving, analytical, and communication skills.

Nice to Have (Optional)

Experience with CI / CD pipelines for data solutions.

Knowledge of data governance, security, and compliance frameworks .

Familiarity with real-time data streaming technologies (Kafka, Event Hubs, etc.).

Additional Details

Cloud Preference : Azure only (AWS experience not required).

Contract / Full-Time : Full-Time

Create a job alert for this search

Data Engineer • Hyderabad, Hyderabad (district)

Related jobs

Promoted

Data Engineer

OptumHyderabad, Telangana, India

Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions. Utilize knowledge of variou...Show moreLast updated: 17 days ago

Promoted

Data Engineer

Trantorsecunderabad, India

We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS. Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 10 days ago

Promoted

Data Engineer

RevXHyderabad, IN

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Tanla Platforms LimitedHyderabad, Telangana, India

We are seeking a skilled Data Engineer with 5–10 years of experience to join our dynamic Data Engineering team.The ideal candidate will design, build, and optimize large-scale data pipelines and wa...Show moreLast updated: 30+ days ago

Promoted

Softobiz - Data Engineer - Synapse Analytics

Softobiz Technologies Pvt ltdHyderabad

Description : Job Title : Data Engineer.Career-defining role available with Tier 1 Blue Chip Australian Client.As a Data Engineer, you will be involved in all phases...Show moreLast updated: 23 days ago

Promoted

Data Engineer

People Tech Group IncHyderabad, Telangana, India

Job Title : Data Engineer Location : Hyderabad Experience : 5+Years.Job Summary : We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

thinkbridgehyderabad, India

We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 8 days ago

Promoted

Data Engineer

Randstad EnterpriseHyderabad, IN

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India

Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 27 days ago

Promoted

Senior Data Engineer

EXLHyderabad, Telangana, India

The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML, and business intelligence use cases.AWS (S...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Response InformaticsHyderabad, Telangana, India

Cloud & Infrastructure • AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows. Snowflake : Moderate understanding of Snowflake architecture.C...Show moreLast updated: 27 days ago

Promoted

Data Engineer – Databricks Platform

Amicon Hub ServicesHyderabad, Telangana, India

Proven experience in Databricks (Delta Lake, Spark, PySpark, SQL).Strong expertise in data integration from multiple sources (SQL Server, MongoDB, InfluxDB). Hands-on experience with ETL / ELT pipelin...Show moreLast updated: 7 days ago

Promoted

Data Engineer

RecroHyderabad, Telangana, India

Configure, deploy, and maintain.Design, implement, and optimize.Collaborate with cross-functional teams to ensure.Troubleshoot and resolve issues related to. Required Skills & Qualifications : .Strong...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

VeraxionHyderabad, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 7 days ago

Promoted

Data Engineer

AAA GlobalHyderabad, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 17 days ago

Promoted

Data Engineer- Snowflake

Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India

We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show moreLast updated: 30+ days ago

Promoted

Snowflake Data Engineer - DBT

BPMLinksHyderabad, Telangana, India

Design, develop, and optimize ETL processes, with a focus on Snowflake integration.Collaborate with stakeholders to gather and analyze requirements, translating them into technical specifications.A...Show moreLast updated: 26 days ago

Promoted

Data Engineer

DivamiHyderabad, India

At Divami Design Labs , we are passionate about crafting world-class UX / UI solutions for global clients.Being a bootstrapped and growing company , every team member plays a critical role in sha...Show moreLast updated: 30+ days ago