Big Data Engineer

Description

Primary Tech skills – AZURE ,Databricks ,Pyspark,SQL Secondary Tech skills – ADF, Synapse Roles :

• Experience in Pyspark, SQL, Cloud data warehouse like Azure Synapse, databricks
• Experience working with structured and unstructured data
• Extensive knowledge of Data Warehousing concepts, strategies, methodologies
• Experience in ETL / Pipeline Development using tools such as Azure Databricks and Azure Data Factory with development expertise on batch and real-time data integration
• Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements
• Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server
• Experience with Orchestration tools, Azure DevOps, and GitHub
• Must be team oriented with strong communication, collaboration, prioritization, and adaptability skill