References & Citations
Computer Science > Machine Learning
Title: Improving the Accuracy of Early Exits in Multi-Exit Architectures via Curriculum Learning
(Submitted on 21 Apr 2021 (v1), last revised 22 Apr 2021 (this version, v2))
Abstract: Deploying deep learning services for time-sensitive and resource-constrained settings such as IoT using edge computing systems is a challenging task that requires dynamic adjustment of inference time. Multi-exit architectures allow deep neural networks to terminate their execution early in order to adhere to tight deadlines at the cost of accuracy. To mitigate this cost, in this paper we introduce a novel method called Multi-Exit Curriculum Learning that utilizes curriculum learning, a training strategy for neural networks that imitates human learning by sorting the training samples based on their difficulty and gradually introducing them to the network. Experiments on CIFAR-10 and CIFAR-100 datasets and various configurations of multi-exit architectures show that our method consistently improves the accuracy of early exits compared to the standard training approach.
Submission history
From: Arian Bakhtiarnia [view email][v1] Wed, 21 Apr 2021 11:12:35 GMT (2192kb,D)
[v2] Thu, 22 Apr 2021 07:45:31 GMT (2192kb,D)
Link back to: arXiv, form interface, contact.