Senior Python and Pyspark developer_Chennai

Mandatory Skills Description :

• 8+ years of experience in data intensive python development.
• Proven experience as a core Python and Pyspark developer.
• Experience developing Classes, OOPS, exception handling, parallel processing .
• Strong knowledge of DB connectivity, data loading , transformation, calculation.
• Extensive experience in Pandas / Numpy dataframes, slicing, data wrangling, aggregations.
• Lambda Functions, Decorators.
• Vector operations on Pandas dataframes / series.
• Application of applymap, apply, map functions.
• Concurrency and error handling data pipeline batch of size [1-10 gb].
• Ability to understand business requirements and translate them into technical requirements.
• Ability to design architecture of data pipeline for concurrent data processing.
• Familiar with creating / designing RESTful services and APIs.
• Familiar with application unit tests.
• Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.
• Debugging application.

Nice-to-Have Skills :

Languages :

English : C2 Proficient