Databricks + Pyspark

Job Summary

Location : AIA Group - Bhubaneswar

We are seeking a highly skilled Sr. Developer with 6 to 9 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Live Pipelines Python Databricks SQL Databricks Workflows and PySpark. This hybrid role involves working on cutting-edge projects that drive innovation and efficiency. The position is based on a day shift schedule with no travel requirements.

Responsibilities

• Develop and implement robust data solutions using Delta Live Pipelines to enhance data processing capabilities.
• Collaborate with cross-functional teams to design and optimize Databricks SQL queries for improved performance.
• Utilize Python to automate data workflows and streamline processes ensuring high-quality data management.
• Oversee the deployment and maintenance of Databricks Workflows to support seamless data integration.
• Leverage PySpark to process large datasets efficiently contributing to data-driven decision-making.
• Ensure data accuracy and integrity by implementing best practices in data engineering and management.
• Provide technical guidance and support to junior developers fostering a collaborative team environment.
• Conduct regular code reviews to maintain high standards of code quality and performance.
• Identify and resolve technical issues promptly to minimize disruptions in data operations.
• Stay updated with the latest industry trends and technologies to continuously improve data solutions.
• Document processes and solutions to facilitate knowledge sharing and team collaboration.
• Engage in continuous learning to enhance skills and contribute to innovative solutions.
• Drive the implementation of data solutions that align with the companys strategic goals and societal impact.

Qualifications

Certifications Required

Databricks Certified Data Engineer Associate Python Certification

Skills Required

Pyspark, Python