Data Engineer - ETL / PySpark
INTEGRATED PERSONNEL SERVICES LIMITEDHyderabad6 days ago
Job description5+ years of total experience, with 3+ years relevant in PySpark, Azure Data Factory, and Python. Strong experience in building large-scale data pipelines and ETL workflows. Hands-on expertise in PySpark for data processing and transformation. Proficiency in Azure Data Factory (ADF) for orchestrating and automating workflows. Solid understanding of Python for scripting, data handling, and automation. Strong SQL skills and ability to work with relational and non-relational databases. Good knowledge of data warehousing concepts and performance optimization. Exposure to Azure ecosystem (Data Lake, Databricks, Synapse Analytics, etc.) preferred. Excellent problem-solving, analytical, and communication skills. Experience with CI / CD pipelines for data solutions. Knowledge of data governance, security, and compliance frameworks. Familiarity with real-time data streaming technologies (Kafka, Event Hubs, etc. Cloud Preference : Azure only (AWS experience not required). Contract / Full-Time : Full-Time.
Description :
Role : Data Engineer.
Location : Hyderabad.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory.
- Work closely with business stakeholders, analysts, and data scientists to understand data requirements and deliver reliable solutions.
- Optimize ETL workflows for performance, scalability, and reliability.
- Implement best practices for data ingestion, transformation, and integration across multiple sources.
- Ensure data quality, governance, and security across the data lifecycle.
- Troubleshoot and resolve issues related to data pipelines, storage, and performance.
Required Skills & Qualifications :
Nice to Have (Optional) :
Additional Details :
(ref : hirist.tech)
Create a job alert for this search
Data Engineer • Hyderabad
Related jobs
![Data Engineer III [T500-19720]](https://cdn-logos.talent.com/v1/logo/image?feedcode=attb-in&company_name=McDonald's)
![Engineer, Data [T500-20281]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobtraffic-in&company_name=TMUS%20Global%20Solutions)
- Promoted
Big Data Engineer - Scala / PySpark
Sheryl strategic solutions Pvt. LTD.Hyderabad Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duratio...Show moreLast updated: 28 days ago
- Promoted
ETL / DataStage SQL Engineer
MyHashtagssHyderabad Description : Job Title : ETL / DataStage SQL Engineer Key Responsibilities : - A...Show moreLast updated: 28 days ago
- Promoted
Estuate - GCP Data Engineer - Big Data
Estuate Software Pvt LtdHyderabad Job Title : Data Engineer / Integration Engineer Job Summary : We are seeking a highly skilled Data Engineer / Integration Engineer to join our team.The i...Show moreLast updated: 30+ days ago
- Promoted
EverestDX - Lead Data Engineer - ETL / Data Warehousing
EverestDXHyderabad Description : We are seeking a highly skilled Lead Data Engineer to design, build, and scale robust data platforms and pipelines that empower business decisi...Show moreLast updated: 12 days ago
- Promoted
Data Engineer III [T500-19720]
McDonald'sHyderabad, Telangana, India About McDonald’s : One of the world’s largest employers with locations in more than 100 countries, McDonald’s Corporation has corporate opportunities in Hyderabad.
Our global offices serve as dynamic...Show moreLast updated: 20 days ago
- Promoted
Lead Data Engineer - ETL / Data Warehousing
Sciens TechnologiesHyderabad Position : Lead Data Engineer Location : Pune, Hyderabad, Gurgaon (Hybrid) Experience : 7-10 years About Clairvoyant : Show moreLast updated: 29 days ago
- Promoted
Engineer, Data [T500-20281]
TMUS Global SolutionsHyderabad, Telangana, India NASDAQ : TMUS), headquartered in Bellevue, Washington, is America’s supercharged Un-carrier, connecting millions through its strong nationwide network and flagship brands, T-Mobile and Metro by T-Mo...Show moreLast updated: 24 days ago
- Promoted
Tableau Consultant / Developer - Aurora CosmoDB
Jigya Software ServicesHyderabad Job Title : Mid-level Tableau Consultant Location : Hyderabad(Onsite) Job Description : Show moreLast updated: 30+ days ago
- Promoted
Nomiso - Data Engineer - Big Data Technologies
NOMISO INDIA PRIVATE LIMITEDHyderabad Roles and Responsibilities : - Create and maintain efficient and scalable data models as per business needs ...Show moreLast updated: 30+ days ago
- Promoted
IBM Datacap Developer
Tata Consultancy ServicesHyderabad, Telangana, India Role : IBM Datacap Engineer Desired Experience Range : 4 to 10 yrs.Work Location : Chennai, Kolkata, Hyderabad, Pune.Must Have : - IBM Datacap Expertise : Strong experience with IBM Datacap versions ...Show moreLast updated: 14 days ago
- Promoted
Unify Technologies - MLOps Engineer - Data Modeling
UNIFY TECHNOLOGIES PVT LTDHyderabad Job Description : We are seeking a highly skilled MLOps Engineer to support the development and operation of automation tools and dashboards within ...Show moreLast updated: 30+ days ago
- Promoted
Engineer, Data [T500-20293]
TMUS Global SolutionsHyderabad, Telangana, India NASDAQ : TMUS), headquartered in Bellevue, Washington, is America’s supercharged Un-carrier, connecting millions through its strong nationwide network and flagship brands, T-Mobile and Metro by T-Mo...Show moreLast updated: 24 days ago
- Promoted
Softility - Big Data Engineer - Apache Spark
SoftilityHyderabad Big Data Engineer : - Design, build, and optimize robust and scalable data pipelines for both batch and real-time data i...Show moreLast updated: 30+ days ago
- Promoted
Softpath Technologies - Senior Big Data Engineer - Hive & Unix Scripting
Softpath Technologies LLCHyderabad Description : Job Title : Senior Big Data Engineer Hive & Unix Scripting Location : P...Show moreLast updated: 4 days ago
- Promoted
Data Engineer II - ETL
SystechcorpHyderabad Responsibilities : - Develop, optimize, and maintain ETL processes using Teradata.Write and troubleshoot complex Teradata SQL and BTEQ scripts for data extract...Show moreLast updated: 17 days ago
- Promoted
Data Engineer II
AmazonHyderabad, Telangana, India This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community.
Please do not contact the recruiter directly.DESCRIPTION : Join...Show moreLast updated: 7 days ago
- Promoted
Senior Data Engineer - ETL / Big Data / Streaming
Zensar TechnologiesHyderabad Position : Senior Data Engineer (ETL / Big Data / Streaming) Experience : 810 years Location : Onsite - Hyderab...Show moreLast updated: 30+ days ago
- Promoted
HYPR4 - Data Lead Engineer - ETL / Data Warehousing
HYPR4 Cloud TechHyderabad Description : 7+ Years Location : Hyderabad Job Type : Full-Time Responsibilities : ...Show moreLast updated: 20 days ago