Azure / SQL / Application - Data Engineer
Job description :
- Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc.,
- Responsible for user access management on data upload and download
- Working with functional team to manage the required data in a structured manner
- Make use of Azure services like Data Factory, Data Lake, Machine Learning, SQL Warehouse, Data Bricks for data extraction.
- Building real-time data pipelines from on-prem SAP DB to cloud along with required API.
- Python model development and continuous improvement through containerization. Conduct basic exploratory analytics for insights.
- Working with Azure SQL databases and NoSQL Databases (Azure Cosmos DB) for data management
Desired candidate education and experience :
A minimum of 2-3 years of experience in Data engineering and migrationGraduation / Post graduation or equivalent. BE CS / B. Tech IT / MCA preferredSQL knowledge to create complex queries.Experience in working with relational databases, Time-series Database as well as working familiarity with a variety of databases (structured & Unstructured).Good experience in object-oriented programming in python and using python tools such as PySpark, NumPY, TensorFlow and Jupyter etc.Experience in API creation.Performance Monitoring & Troubleshooting Azure data pipeline performance, identify bottlenecks, and troubleshoot complex issues in production environments.Hands on Experience in working on Kafka.Knowledge on continuous integration / continuous deployment.Experience of data migration and deployment from On-Prem to Cloud environment and vice-versa.Ability to identify problems, mediate issues, develop solutions, and implement appropriate courses of action.Good oral and written English communication skillsRole : Data Engineer
Department : Digital Technology
Employment Type : Full Time