Job Title : Senior Python ETL Developer / Lead
Job Type : 6 Months + Extendable
Experience : 5 to 6 years
Job Description :
We are seeking an experienced Senior ETL Developer / Lead to join our team. The ideal candidate will have a strong background in developing ETL processes using Python and open-source tools / libraries, including PySpark and Apache Airflow. This position requires a hands-on developer who can design, implement, and maintain robust ETL solutions and lead a team of developers.
Key Responsibilities :
- Design, develop, and maintain ETL processes to support data integration and data warehousing.
- Lead a team of ETL developers, providing technical guidance and mentoring.
- Collaborate with data architects, business analysts, and other stakeholders to gather requirements and design solutions.
- Utilize open-source tools and libraries, including PySpark, to enhance ETL processes.
- Optimize and troubleshoot ETL processes to ensure timely and accurate data load.
- Develop and implement best practices for ETL development and data management.
- Perform data quality checks and validations to ensure data integrity.
- Create and maintain comprehensive ETL documentation.
- Stay updated with the latest trends and advancements in ETL and data integration technologies.
- Contribute to continuous process improvement initiatives.
Requirements :
Bachelor's or Master's degree in Computer Science, Information Technology, or related field.5+ years of experience in ETL development using Python.Experience with open-source ETL tools and libraries such as Apache Airflow, PySpark, and Pandas.Experience in development of database processes using Oracle SQL, PL / SQLUNIX and / or Windows environmentsScripting such as Shell, PerlObject Oriented Analysis and Design (OOAD)Service Oriented Architecture (SOA)Strong understanding of data warehousing concepts, data modeling, and data integration.Excellent problem-solving skills and attention to detail.Ability to lead and mentor a team of developers.Strong communication and collaboration skills.Preferred Qualifications :
Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).Familiarity with version control systems (e.g., Git).Experience in Agile / Scrum development methodologies.