We are seeking an experienced Senior Python Developer who specializes in building and maintaining high-performance ETL and data integration pipelines .
This ideal candidate will be working with data from diverse sources, transforming it efficiently, and ensuring seamless downstream delivery to analytics and reporting systems.
You will work with a global delivery team to design scalable, modular, and automated data workflows using modern tools such as Airflow , Git , and Azure Cloud Services .
Key Responsibilities
- Design, develop, and maintain Python-based ETL pipelines to extract data from multiple sources such as APIs, SFTP, and web services.
- Perform data transformation, cleaning, and validation using Python (especially pandas) for analytics and reporting consumption.
- Maintain and extend existing Python codebases - ensuring modularity, reusability, and consistent coding standards.
- Implement workflow orchestration and scheduling using Apache Airflow, including DAG creation, monitoring, and error handling.
- Collaborate with data engineers, operations, and QA teams to ensure pipeline reliability and scalability.
- Use Git for version control and actively participate in peer code reviews, documentation, and repository management.
- Apply best practices in logging, exception handling, and testing for production-ready code.
Required Skills & Experience
Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.6–12 years of professional experience in software development with strong Python expertise.Minimum 4+ years in ETL / Data Engineering using Python and pandas.Solid understanding of API integrations, SFTP data ingestion, and web data extraction.Proficiency in modular programming, OOP concepts, and abstraction-based design.Experience with Airflow for workflow management - creating, scheduling, and monitoring DAGs.Strong understanding of Git-based workflows, branching strategies, and CI / CD collaboration.Nice to Have Skills
Experience with Azure Cloud Services such as Azure Data Factory, Azure Storage, and Azure Key Vault.Familiarity with CI / CD pipelines and DevOps practices.Experience in data automation or data engineering environments.Basic working knowledge of SQL or relational database systems.Exposure to PowerShell scripting or similar automation tools.Soft Skills
Strong analytical and problem-solving mindset.Excellent attention to detail and focus on clean, maintainable code.Good communication and collaboration skills for distributed team environments.Self-driven, proactive, and comfortable in fast-paced, dynamic projects.