Role Overview :
We are looking for an experienced Senior Python & Spark Developer with strong expertise in Python (Django, Flask) and PySpark for large-scale data processing. The ideal candidate will be a self-starter who can independently own and deliver end-to-end tasks, while also guiding junior team members.
Key Responsibilities :
- Design, develop, and maintain scalable data-driven and event-driven applications.
- Develop backend services using Python (Django, Flask) and integrate them with distributed data processing pipelines using PySpark.
- Work independently on assigned tasks and take complete ownership from design to deployment.
- Collaborate with cross-functional teams for requirements gathering, design discussions, and delivery planning.
- Guide and mentor junior resources in coding best practices and Work with RDBMS and NoSQL databases to design and optimize storage solutions.
- Integrate applications with messaging services like Kafka and MQ for event-driven architectures.
- Ensure smooth deployments through CI / CD pipelines using Jenkins and Docker.
Core Skills & Technologies :
Languages : Python 3Frameworks : Apache Spark (PySpark), Django, FlaskDatabases : PostgreSQL (RDBMS), Cassandra, MongoDB (NoSQL)Messaging : Kafka, MQArchitecture : Event-Driven, Data-DrivenCI / CD Tools : Jenkins, DockerMonitoring tools : ELK, Prometheus, Grafana(ref : hirist.tech)