Sr. Python Developer

Job Description : Software Data Engineer

As a Software Engineer specializing in Telecom Products, you will be a vital member of our R&D team, contributing to the development of cutting-edge telecommunications solutions. Your role will involve leveraging your extensive experience to design and implement robust software solutions for scalable telecom products and features

Position Summary

We are seeking a skilled Big Data Engineer with deep expertise in PySpark, Python, MySQL, Hadoop and Linux. The ideal candidate should have extensive experience deploying and managing these tools within on-premises environments (no public cloud). Proficiency in cluster management, performance optimization, and monitoring is essential for this role.

Key Responsibilities :

• Develop and implement data ingestion pipelines and ETL processes using PySpark and Python capable of managing and processing large volumes of data, ranging in the millions of records.
• Design and develop APIs using Python to facilitate data integration and processing.
• Deploy, configure, and maintain Hadoop ecosystem components including HDFS , YARN, Hive, and HBase in on-premises environments.
• Optimize the performance of Big Data applications and queries, ensuring efficient resource utilization.
• Manage and monitor cluster health , including tuning and troubleshooting performance issues.
• Ensure data security , integrity , and availability within the Big Data infrastructure.
• Collaborate with cross-functional teams to integrate data analytics solutions and support business requirements.

Required Skills and Qualifications :

Preferred Skills :

Application Process

Interested candidates should submit their resume and a cover letter outlining their qualifications and experience in Big Data engineering and on-premises cluster management and include details of at least one relevant project involving the handling of large data volumes (in millions of records), you have worked on, including a brief description of the project, your role and the technologies used. This is mandatory requirement for our screening process .