Job Summary :
We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have strong hands-on expertise in Python, PySpark, and SQL Server, along with exposure to modern data platforms. You will play a critical role in building, optimizing, and maintaining data pipelines that support business insights and decision-making.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using Python and PySpark
- Write efficient and optimized SQL queries for data extraction and reporting
- Collaborate with data analysts, scientists, and other stakeholders to understand requirements and deliver solutions
- Troubleshoot and resolve data pipeline and ETL issues
- Ensure data quality and consistency across platforms
Required Skills :
5+ years of hands-on experience in Python and PySparkStrong proficiency in SQL Server for querying and data manipulationAbility to work in a fast-paced, agile development environmentGood to Have :
Experience with SnowflakeKnowledge of Azure Data Factory (ADF)Familiarity with Databricks and cloud-based data workflowsSkills Required :
Experience in Python / Pyspark,Strong in SQL ServerGood to have : ADF (Azure Data factory), DataBricks (or) Snowflake
ref : hirist.tech)