Job Title : Data Engineer - Data Fabric / Bricks
Location : Remote
Job Summary :
We are seeking an experienced Data Engineer to join our team as contractor.
The ideal candidate will have a strong background in designing, implementing, and managing large-scale data platforms using Data Fabric or Data Bricks. The candidate should have experience working with both structured and unstructured data and have successfully implemented at least one full lifecycle of a data platform.
Key Responsibilities :
- Design, develop, and deploy large-scale data platforms using Data Fabric or Data Bricks
- Work with cross-functional teams to identify and prioritize data requirements
- Develop and maintain data pipelines for structured and unstructured data
- Implement data governance and quality control measures
- Collaborate with data scientists and analysts to integrate data into analytics workflows
- Optimize data platform performance, scalability, and reliability
- Develop and maintain technical documentation for data platforms
Requirements :
5-6 years of experience in data engineering, with a focus on Data Fabric or Data BricksExperience with at least one full lifecycle of data platform implementationStrong knowledge of data architecture, data modeling, and data governanceExperience working with both structured and unstructured dataProficiency in Scala, Python, and SQLExperience with Apache Spark, data processing frameworks, and data governance toolsStrong understanding of data security, compliance, and regulatory requirementsExcellent communication and collaboration skillsExperience with cloud-based data platforms such as Azure or AWS-Nice to Have :
Knowledge of machine learning and deep learning frameworksExperience with data visualization tools such as Tableau, Power BI, or D3.jsCertification in Data Engineering or related fieldref : hirist.tech)