References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Neural Architecture Design for GPU-Efficient Networks
(Submitted on 24 Jun 2020 (v1), last revised 11 Aug 2020 (this version, v4))
Abstract: Many mission-critical systems are based on GPU for inference. It requires not only high recognition accuracy but also low latency in responding time. Although many studies are devoted to optimizing the structure of deep models for efficient inference, most of them do not leverage the architecture of \textbf{modern GPU} for fast inference, leading to suboptimal performance. To address this issue, we propose a general principle for designing GPU-efficient networks based on extensive empirical studies. This design principle enables us to search for GPU-efficient network structures effectively by a simple and lightweight method as opposed to most Neural Architecture Search (NAS) methods that are complicated and computationally expensive. Based on the proposed framework, we design a family of GPU-Efficient Networks, or GENets in short. We did extensive evaluations on multiple GPU platforms and inference engines. While achieving $\geq 81.3\%$ top-1 accuracy on ImageNet, GENet is up to $6.4$ times faster than EfficienNet on GPU. It also outperforms most state-of-the-art models that are more efficient than EfficientNet in high precision regimes. Our source code and pre-trained models are available from \url{this https URL}.
Submission history
From: Ming Lin [view email][v1] Wed, 24 Jun 2020 22:42:18 GMT (876kb,D)
[v2] Wed, 8 Jul 2020 18:11:08 GMT (876kb,D)
[v3] Sun, 12 Jul 2020 05:11:21 GMT (1752kb,D)
[v4] Tue, 11 Aug 2020 22:54:26 GMT (876kb,D)
Link back to: arXiv, form interface, contact.