Databricks Data Engineer

JD :

• Proficient in Databricks Data Engg.
• Knowledge in ETL concepts.
• Proficient in writing SQL  queries, performance tuning.
• Knowledge in python script writing.
• Good Communication skill.

Required Qualifications :

1. Bachelor’s degree in Computer Science, Information Technology, or a related field.

2. 4 to 7 years of experience as a Data Engineer with a focus on Databricks.

3. Proven experience in building ETL pipelines and working with large datasets.

4. Strong analytical and problem-solving skills.

5. Excellent communication and collaboration abilities to work effectively in a team environment.

Key Responsibilities :

1. Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.

2. Implement ETL workflows and ensure efficient data ingestion from various sources.

3. Collaborate with data scientists to prepare and transform data for analytics and machine learning projects.

4. Optimize data storage and processing performance within Databricks.

5. Ensure data quality and reliability through automated testing and validation processes.

6. Document data processing standards and workflows for team reference.

7. Troubleshoot data pipeline issues and provide timely solutions.

8. Stay updated with the latest features and best practices of Databricks and related technologies.