Job Title : Senior Python Pyspark Data Engineer
Experience : 8+ Years
Employment Type : Full-Time, Permanent
About the Role : -
We are looking for a Senior Python PySpark Data Engineer to design, develop, and maintain
scalable data pipelines and applications in a fast-paced, cloud-first environment. You will
build end-to-end data solutions using Python, PySpark, and Azure cloud services,
contributing to architecture, performance optimization, and code quality.
This role offers an opportunity to work on modern data platforms including Databricks and
Azure Data Factory (ADF), collaborating with cross-functional teams to deliver
high-performance, production-grade data solutions.
Key Responsibilities : -
- Design, develop, and maintain robust, scalable data pipelines using Python and
PySpark.
Build end-to-end data solutions from scratch with modular, maintainable, andreusable code.
Write and optimize complex SQL queries for large-scale data processing andvalidation.
Develop dynamic, reusable frameworks and implement design patterns for scalabilityand performance.
Refactor legacy codebases to improve performance, reliability, and maintainability.Collaborate with data engineers, analysts, and business stakeholders to translaterequirements into technical solutions.
Orchestrate workflows and automate pipelines using Databricks and Azure DataFactory (ADF).
Drive best practices in code reviews, deployment automation, and performancetuning.
Stay current with emerging tools and contribute to continuous improvementinitiatives.
Must-Have Skills & Qualifications : -
Hands-on experience in software / data engineering.Strong expertise in Core Python and PySpark development.Proficient in SQL, with experience handling large datasets.Hands-on experience with Azure Cloud Data Services.Experience with Databricks and Azure Data Factory (ADF).Solid understanding of data structures, design patterns, and scalable architectures.Expertise in performance optimization, debugging, and automation.Exposure to other cloud platforms (AWS / GCP) is a plus.Bachelor’s degree in Computer Science, Engineering, or related field.Strong problem-solving mindset with ability to deliver end-to-end solutions.Why You’ll Love This Role : -
Freedom to build scalable data systems from the ground up.Work with modern cloud technologies : Azure, Databricks, ADF.Collaborate with a team that values innovation, clean engineering, andproblem-solving.
Influence architecture and design decisions for enterprise-level solutions.Fast-paced, learning-driven environment where your ideas are implemented.If Intrested. Please submit your CV to Khushboo@Sourcebae.com or share it via WhatsApp at 8827565832
Stay updated with our latest job opportunities and company news by following us on LinkedIn : : https : / / www.linkedin.com / company / sourcebae