We are seeking a highly skilled Senior Data Engineer with extensive experience in PySpark, Python, and SQL, and hands-on expertise in Databricks. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and data processing systems.
Experience Required : 6 years
Offered Salary-15 LPA Max
Key Responsibilities :
- Develop and maintain robust data pipelines using PySpark and Python to handle large volumes of data.
- Design and implement SQL queries for data extraction, transformation, and analysis.
- Utilize Databricks for data engineering tasks, including cluster management, job orchestration, and performance optimization.
- Collaborate with cross-functional teams to understand data requirements and provide data solutions.
- Monitor and troubleshoot data workflows to ensure data integrity and performance.
- Optimize and refactor existing data processes for improved efficiency and scalability.
Required Skills :
Proven experience with PySpark for large-scale data processing.Proficiency in Python programming for data manipulation and automation.Strong SQL skills for querying and managing relational databases.Hands-on experience with Databricks, including workspace management and cluster optimization.Solid understanding of data modeling, ETL processes, and data warehousing concepts.Excellent problem-solving skills and the ability to work independently and as part of a team.Education :
Bachelor’s degree in Computer Science, Engineering, or a related field. Advanced degrees or certifications in data engineering are a plus.If you meet the above qualifications and are excited about contributing to a cutting-edge data environment, we encourage you to apply