Job Title : Data Engineer
Experience : 3-6 yrs
Location : Pune
Requisites :
- Databricks and using Spark for data processing
- Configuring Delta Lake on Azure Databricks
- Languages : Python, Scala, SQL
- Azure Data Factory, Azure Data Lake, Azure SQL DB, Synapse, and Cosmos DB
- Data Management Gateway, Azure Storage Options, Stream Analytics and Event Hubs
- Designing data solutions in Azure incl. data distributions and partitions, scalability, disaster recovery and high availability
- Data modeling with relational or data-warehouse systems
- Azure Devops (or similar tools) for source control & building CI / CD pipelines
- Understanding Data Structures & Algorithms & their performance
- Experience designing and implementing large-scale distributed systems
- Experienced in designing, deploying, and maintaining reliable, scalable data infrastructure and products in complex environments.
- Experienced in object-oriented programming using languages like Python, Go, Java, or C++.
Key Responsibilities :
Designs, develops, and maintains software for data integration, management, and quality assurance.Fosters inclusion and engagement through effective collaboration with teams and stakeholders.Effectively works with cross-disciplinary collaborators and stakeholders across multiple business entities.Architects and designs reliable and scalable data infrastructure.Drives adherence to engineering best practices and promotes high-quality standards.Deploys secure, well-tested software aligned with privacy and compliance standards.Ensures service reliability by following SRE best practices, managing on-call duties, and maintaining SLAs.Actively contributes to improve developer velocity.Explore more on the opportunity
Contact : /