Data Engineer - ETL/PySparkINTEGRATED PERSONNEL SERVICES LIMITED • Hyderabad
Data Engineer - ETL / PySpark
INTEGRATED PERSONNEL SERVICES LIMITED • Hyderabad
30+ days ago
Job description5+ years of total experience, with 3+ years relevant in PySpark, Azure Data Factory, and Python. Strong experience in building large-scale data pipelines and ETL workflows. Hands-on expertise in PySpark for data processing and transformation. Proficiency in Azure Data Factory (ADF) for orchestrating and automating workflows. Solid understanding of Python for scripting, data handling, and automation. Strong SQL skills and ability to work with relational and non-relational databases. Good knowledge of data warehousing concepts and performance optimization. Exposure to Azure ecosystem (Data Lake, Databricks, Synapse Analytics, etc.) preferred. Excellent problem-solving, analytical, and communication skills. Experience with CI / CD pipelines for data solutions. Knowledge of data governance, security, and compliance frameworks. Familiarity with real-time data streaming technologies (Kafka, Event Hubs, etc. Cloud Preference : Azure only (AWS experience not required). Contract / Full-Time : Full-Time.
Description :
Role : Data Engineer.
Location : Hyderabad.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory.
- Work closely with business stakeholders, analysts, and data scientists to understand data requirements and deliver reliable solutions.
- Optimize ETL workflows for performance, scalability, and reliability.
- Implement best practices for data ingestion, transformation, and integration across multiple sources.
- Ensure data quality, governance, and security across the data lifecycle.
- Troubleshoot and resolve issues related to data pipelines, storage, and performance.
Required Skills & Qualifications :
Nice to Have (Optional) :
Additional Details :
(ref : hirist.tech)
Create a job alert for this search
Data Engineer • Hyderabad
Related jobs
Data Engineer - ETL / Spark
Insight Global, LLC • Hyderabad
Description : Role : Data Engineer (AWS) We are seeking a highly skilled AWS Data Engineer to join our team and help design, build, and maintain...Show more
Last updated: 10 days ago • Promoted
Senior Data Engineer
Talentoj • Hyderabad, Telangana, India
We are looking for a highly experienced.The role focuses on building scalable ETL pipelines, optimizing data platforms, and enabling advanced analytics and reporting.
Design, build, and maintain rob...Show more
Last updated: 7 hours ago • Promoted • New!
ETL Engineer
Radiant Digital • Hyderabad, Republic Of India, IN
As a Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and storage solutions in a complex, enterprise-scale data warehouse environment.You will contrib...Show more
Last updated: 1 day ago • Promoted
ETL Engineer
ADP • Hyderabad, Republic Of India, IN
Position : Data Engineer with 3 to 10 Years experience in PySpark and Data bricks.In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data so...Show more
Last updated: 12 hours ago • Promoted • New!
Data Engineer
IntraEdge • Hyderabad, IN
We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team.
You will be responsible for building scalable and reli...Show more
Last updated: 30+ days ago • Promoted
Senior Python Data Engineer – ETL & Pipeline Development (5 to 12 yrs)
AIMLEAP • Hyderabad, IN
Senior Python Data Engineer – ETL & Pipeline Development.Remote (WFH) / Bangalore / India.Tech / MCA / Computer Science / IT.
IT / Data / AI / LegalTech / Enterprise Solutions.ETL pipelines and data...Show more
Last updated: 3 days ago • Promoted
ETL Data Engineer
BPMLinks • Hyderabad, Telangana, India
In the digital age, harnessing the power of data is crucial for business success.We offer a holistic approach that encompasses various aspects of data strategy, roadmap development, and data analyt...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Quadrant Technologies • Hyderabad, Telangana, India
Senior Data Engineer (10+ Years).Location : Chennai, Bengaluru, Hyderabad.Drive end-to-end cloud data migration, architecture design (Fabric, Synapse, Databricks), and solution delivery.Build and op...Show more
Last updated: 30+ days ago • Promoted
Senior ETL Engineer
Adaptive Technology Insights • Hyderabad, Republic Of India, IN
We are looking for an experienced.You will be responsible for designing, building, and optimizing data pipelines and architecture to support analytics, reporting, and data-driven decision-making ac...Show more
Last updated: 9 days ago • Promoted
Senior ETL / ELT Engineer
Straive • Hyderabad, Republic Of India, IN
The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
Last updated: 30+ days ago • Promoted
PySpark & ETL Data Engineer
Confidential • Hyderabad / Secunderabad, Telangana, India
Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation.
Our mission is to co-create success with our custome...Show more
Last updated: 26 days ago • Promoted
Senior Data Engineer
Adaptive Technology Insights • Hyderabad, India
We are looking for an experienced Data Engineer with strong expertise in Google Cloud Platform (GCP) and BigQuery to join our growing data team.
You will be responsible for designing, building, and ...Show more
Last updated: 8 days ago • Promoted
PySpark Data Engineer
EXTRAGIG • Hyderabad, IN
Contract Assistant – Data Engineer Support (Remote, EST Hours).PySpark Data Engineer with daily activities.This is a remote contract role.
Execute creative software and data solutions, including des...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
ADP • Hyderabad, Telangana, India
Position : Data Engineer with 3 to 10 Years experience in PySpark and Data bricks.In this role candidate will be responsible for understanding complex data sets, managing multiple disparate data so...Show more
Last updated: 30+ days ago • Promoted
Senior Data Engineer
Straive • Hyderabad, India
We're looking for a Senior Data Engineer with 5-8 years of experience to build and maintain scalable, production-grade data pipelines.
The ideal candidate is a strong software engineer with hands-on...Show more
Last updated: 30+ days ago • Promoted
Data Engineer
Straive • Hyderabad, Telangana, India
Design, build and maintain scalable.Implement core ETL / ELT logic in Scala and Python; author efficient Spark DataFrame / Dataset jobs.
Write and optimize complex SQL for ingestion, transformation and ...Show more
Last updated: 9 days ago • Promoted
Senior Data Engineer
RapidBrains • Hyderabad, IN
Job Title : Senior Data Engineer.We are looking for a Senior Data Engineer with deep expertise in Azure Data Engineering to design, build, and optimize large-scale data pipelines.The ideal candidate...Show more
Last updated: 13 days ago • Promoted
ETL Developer
Tata Consultancy Services • Hyderabad, Republic Of India, IN
Locations : Chennai, Kolkata, Hyderabad, bangalore,Pune, Delhi.Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python and PySpark to ensure the ...Show more
Last updated: 30+ days ago • Promoted