This job offer is not available in your country.
eSoftLabs - PySpark Developer
ENTERPRISE SOFTLABS PRIVATE LINITEDHyderabad30+ days ago
Job descriptionDevelop and maintain large-scale data pipelines using PySpark and Databricks. Optimize and troubleshoot Spark applications using Spark UI and performance tuning techniques. Work with large datasets and implement best practices for partitioning, caching, join optimization, and cluster resource management. Build efficient data ingestion, transformation, and aggregation logic from multiple sources using Kafka and other streaming technologies. Leverage AWS services such as S3, EMR, Lambda, Glue, Redshift, etc., for cloud-based data processing and orchestration. Implement workflows using tools such as Airflow or Databricks Workflows.
Job Title : Pyspark Developer
Location : Hyderabad
Experience Required : 4- 8
Keywords : AWS, Pyspark, Databricks
Skills and experiences required :
- 3- 6 years of hands-on development in PySpark.
- Experience with Databricks and performance tuning using Spark UI.
- Strong understanding of AWS services, Kafka, and distributed data processing.
- Proficient in partitioning, caching, join optimization, and resource configuration.
- Familiarity with data formats like Parquet, Avro, and OyC.
- Exposure to orchestration tools (Airflow, Databricks Workflows).
- Scala experience is a strong plus
Key Roles and Responsibilities :
(ref : hirist.tech)
Create a job alert for this search
Pyspark Developer • Hyderabad
Related jobs
- Promoted
Azure Databricks / PySpark Developer - ETL
JRD Systems Private LtdHyderabad Key Responsibilities : - Design, develop, and maintain scalable data pipelines and ETL / ELT processes using PySpark, SQL, and Python.Build and manag...Show moreLast updated: 30+ days ago
- Promoted
Scala Developer - Spark Applications
Grackle Business Solutions Pvt LtdHyderabad Key Responsibilities : - Develop and maintain data processing applications using Spark and Scala.Collaborate with cross-functional teams to underst...Show moreLast updated: 4 days ago
- Promoted
Senior Scala / Spark Developer
Cyanous Software Private LimitedHyderabad Key Responsibilities : - Design, develop, and maintain data processing applications using Scala and Apache Spark.Collaborate with cross-functional ...Show moreLast updated: 4 days ago
- Promoted
PySpark Developer
Corpxcel ConsultingHyderabad Location : Chennai / Bangalore / Hyderabad / Coimbatore / Pune WFO : 3 days Mandatory from the above-mentioned locations.Role Summary : We are...Show moreLast updated: 30+ days ago
- Promoted
Unify Technologies - Spark / Scala Developer - Data Analytics
UNIFY TECHNOLOGIES PVT LTDHyderabad Job Description : We are looking for a candidate with strong experience into Spark with Scala with M...Show moreLast updated: 25 days ago
- Promoted
DigiHelic Solutions - Snowflake Developer - ETL Tools
Digihelic Solutions Private LimitedHyderabad Job Role - Snowflake Developer Experience - 5-7 Years Location - Model - Hybrid Mandatory Skills - Snowflake, PySpark Show moreLast updated: 30+ days ago
- Promoted
Fircosoft
Tata Consultancy Serviceshyderabad, telangana, in TCS has been a great pioneer in feeding the fire of young Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of ...Show moreLast updated: 8 days ago
- Promoted
eSoftLabs - Mulesoft Developer - Anypoint Platform
Enterprise Softlabs Pvt LtdHyderabad About eSoftLabs : eSoftLabs was established with a clear mission - to deliver high-impact IT solutions through a lean operational model that prioritizes talent and performance ...Show moreLast updated: 30+ days ago
- Promoted
Big Data Developer - PySpark / Scala
Prorsum TechnologiesHyderabad Key Responsibilities : - Data Development : Design, develop, and maintain big data processing jobs using PySpark or Scala / Java.
AWS Integration : Work extensively wit...Show moreLast updated: 30+ days ago
- Promoted
Spark / Scala Developer
Cyanous Software Private LimitedHyderabad Detailed JD (Roles and Responsibilities) : - At least 8+ years of experience and strong knowledge in Scala programming language.Able to write clean, ...Show moreLast updated: 30+ days ago
- Promoted
SDE 3 (Python)
LearnTube.aihyderabad, telangana, in In 2024, Google selected LearnTube for its AI First Accelerator, further fueling our growth.Alongside investment from funds of visionaries like Reid Hoffman and Naval Ravikant, we set out on a miss...Show moreLast updated: 6 days ago
- Promoted
Azure Databricks Engineer - Spark / Python
Armour Corporate ServicesHyderabad Job Overview : Position Title : Databricks Engineer Location : Noida / Hyderabad P&L Responsibi...Show moreLast updated: 30+ days ago
- Promoted
Spark & Scala Developer
Dinoxo IT ConsultingHyderabad Responsibilities : - At least 8+ years of experience and strong knowledge in Scala programming language.Able to write cl...Show moreLast updated: 30+ days ago
- Promoted
Senior Software Developer - Python
VARITE Inc.Hyderabad Essential Job Functions : - Designs, codes, tests, debugs and documents software according to systems quality standards, policies and procedures.Anal...Show moreLast updated: 30+ days ago
- Promoted
PySpark Developer - Data Platform
NPG ConsultantsHyderabad We are seeking a highly skilled PySpark Developer with 7+ years of experience and expertise in Reltio MDM to join our data engineering team.
You will design and implement scalable data processing so...Show moreLast updated: 30+ days ago
- Promoted
Unify Technologies - Spark / Scala Developer - Data Engineering
UNIFY TECHNOLOGIES PVT LTDHyderabad Spark Core / Streaming with programming language Scala also in Machine Learing OR AI, Good Understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, Optimization mechanism / te...Show moreLast updated: 30+ days ago
- Promoted
Senior Developer
Tata Consultancy Serviceshyderabad, telangana, in Thank you for expressing your interest in exploring a career possibility with the TCS Family.Jenkins, Gitlab, Github Actions.
AWS, Azure or GCP) and services like Sagemaker, AzureML, Vertex AI.Nice ...Show moreLast updated: 17 days ago
- Promoted
Python Developer - PySpark
PamTen Software Solutions Private LimitedHyderabad Role : Python Developer Location : Hyderabad Experience : 5+ years - Develop clean,...Show moreLast updated: 5 days ago