Data Engineer - ETL/PySparkINTEGRATED PERSONNEL SERVICES LIMITED • Hyderabad
Data Engineer - ETL / PySpark
INTEGRATED PERSONNEL SERVICES LIMITED • Hyderabad
29 days ago
Job description5+ years of total experience, with 3+ years relevant in PySpark, Azure Data Factory, and Python. Strong experience in building large-scale data pipelines and ETL workflows. Hands-on expertise in PySpark for data processing and transformation. Proficiency in Azure Data Factory (ADF) for orchestrating and automating workflows. Solid understanding of Python for scripting, data handling, and automation. Strong SQL skills and ability to work with relational and non-relational databases. Good knowledge of data warehousing concepts and performance optimization. Exposure to Azure ecosystem (Data Lake, Databricks, Synapse Analytics, etc.) preferred. Excellent problem-solving, analytical, and communication skills. Experience with CI / CD pipelines for data solutions. Knowledge of data governance, security, and compliance frameworks. Familiarity with real-time data streaming technologies (Kafka, Event Hubs, etc. Cloud Preference : Azure only (AWS experience not required). Contract / Full-Time : Full-Time.
Description :
Role : Data Engineer.
Location : Hyderabad.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory.
- Work closely with business stakeholders, analysts, and data scientists to understand data requirements and deliver reliable solutions.
- Optimize ETL workflows for performance, scalability, and reliability.
- Implement best practices for data ingestion, transformation, and integration across multiple sources.
- Ensure data quality, governance, and security across the data lifecycle.
- Troubleshoot and resolve issues related to data pipelines, storage, and performance.
Required Skills & Qualifications :
Nice to Have (Optional) :
Additional Details :
(ref : hirist.tech)
Create a job alert for this search
Data Engineer • Hyderabad
Related jobs
Data Engineer - ETL / Spark
Insight Global, LLC • Hyderabad
Description : Role : Data Engineer (AWS) We are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain...Show more
Last updated: 9 days ago • Promoted
AI Engineer (Data Pipelines & RAG)
BeGig • Hyderabad, IN
Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
Last updated: 9 days ago • Promoted
ETL Engineer
Radiant Digital • Hyderabad, Republic Of India, IN
As a Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and storage solutions in a complex, enterprise-scale data warehouse environment.You will contrib...Show more
Last updated: 1 day ago • Promoted
Data Engineer
IntraEdge • Hyderabad, IN
Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
Last updated: 30+ days ago • Promoted
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAP • Hyderabad, IN
Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT.
IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
Last updated: 3 days ago • Promoted
Data Engineer - Snowflake
Prudent Technologies and Consulting, Inc. • hyderabad, telangana, in
We are seeking a skilled Data Engineer with strong experience in Python, Snowflake, and AWS.The ideal candidate will be responsible for building and optimizing scalable data pipelines, integrating ...Show more
Last updated: 9 days ago • Promoted
ETL Data Engineer
BPMLinks • Hyderabad, Telangana, India
In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show more
Last updated: 30+ days ago • Promoted
Lead Data Engineer
People Prime Worldwide • Hyderabad, India
Design, develop, test, and maintain scalable ETL data pipelines using Python.Work extensively on Google Cloud Platform (GCP) services such as : .
Dataflow for real-time and batch data processing.Cloud...Show more
Last updated: 30+ days ago • Promoted
Senior ETL Engineer
Adaptive Technology Insights • Hyderabad, Republic Of India, IN
We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show more
Last updated: 9 days ago • Promoted
Senior ETL / ELT Engineer
Straive • Hyderabad, Republic Of India, IN
The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
Last updated: 30+ days ago • Promoted
ETL Pipeline Engineer
LTIMindtree • Hyderabad, Republic Of India, IN
Extract transform and load ETL data from multiple sources ERP logistics compliance tools etc.Develop reusable data pipelines to automate data ingestion and transformation.Ensure data harmonization ...Show more
Last updated: 20 days ago • Promoted
PySpark & ETL Data Engineer
Confidential • Hyderabad / Secunderabad, Telangana, India
Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation.
Our mission is to co-create success with our custome...Show more
Last updated: 26 days ago • Promoted
PySpark Data Engineer
EXTRAGIG • Hyderabad, IN
Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role.
Execute creative software and data solutions, including des...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Straive • Hyderabad, India
We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines.
The ideal candidate is a strong software engineer with hands-on...Show more
Last updated: 30+ days ago • Promoted
Data Solutions Engineer
Straive • Hyderabad, Republic Of India, IN
Design, build and maintain scalable.Implement core ETL / ELT logic in Scala and Python;.Write and optimize complex SQL for ingestion, transformation and consumption layers.
Tune Spark jobs for perform...Show more
Last updated: 9 days ago • Promoted
Data Engineer
Straive • Hyderabad, Telangana, India
Design, build and maintain scalable.Implement core ETL / ELT logic in Scala and Python; author efficient Spark DataFrame / Dataset jobs.
Write and optimize complex SQL for ingestion, transformation and ...Show more
Last updated: 9 days ago • Promoted
Senior Data Engineer
RapidBrains • Hyderabad, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 13 days ago • Promoted
ETL Developer
Tata Consultancy Services • Hyderabad, Republic Of India, IN
Required Technical Skill Set : .Informatica Powercenter, Oracle, Unix.Knowledge of Unix shell scripting and CA7.Responsibility of / Expectations from the Role.
Production support of mappings / transfo...Show more
Last updated: 30+ days ago • Promoted