PySpark Developer

Location : Chennai / Bangalore / Hyderabad / Coimbatore / Pune

WFO : 3 days Mandatory from the above-mentioned locations.

Role Summary :

We are seeking a highly skilled PySpark Developer with hands-on experience in Databricks to join Companies IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data frameworks, distributed computing, and cloud platforms, with a deep understanding of Databricks architecture. This is an excellent opportunity to work with cutting-edge technologies in a dynamic, fast-paced environment.

Role Responsibilities :

Data Engineering and Processing :

• Develop and manage data pipelines using PySpark on Databricks.
• Implement ETL / ELT processes to process structured and unstructured data at scale.
• Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks.

Databricks Platform Expertise :

Cloud Platforms and Deployment :

CI / CD and Testing :

Collaboration and Documentation :

Technical Qualifications :

Experience :

Databricks Expertise :

Cloud Platforms :

Database Knowledge :

General Qualifications :

Education Requirements :

(ref : hirist.tech)