Data engineer

Key Responsibilities

• Data Pipeline Development : Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs.
• Data Integration : Integrate data from multiple sources and ensure data quality and consistency.
• Data Modelling : Build and optimize data models using Spark to support complex data transformations and analysis.
• SQL Development : Write efficient SQL queries to extract, transform, and load data into data warehouses and other storage solutions.
• Big Data Processing : Utilize big data technologies, especially Apache Spark, to process and analyze large datasets.
• Cloud Services : Implement and manage data solutions on cloud platforms such as Azure, AWS, or GCP.
• Problem Solving : Analyze and resolve data-related issues, ensuring data accuracy and reliability.
• Collaboration : Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

Required Skills and Qualifications

Preferred Qualifications