References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: 1xN Pattern for Pruning Convolutional Neural Networks
(Submitted on 31 May 2021 (v1), last revised 16 Oct 2022 (this version, v6))
Abstract: Though network pruning receives popularity in reducing the complexity of convolutional neural networks (CNNs), it remains an open issue to concurrently maintain model accuracy as well as achieve significant speedups on general CPUs. In this paper, we propose a novel 1xN pruning pattern to break this limitation. In particular, consecutive N output kernels with the same input channel index are grouped into one block, which serves as a basic pruning granularity of our pruning pattern. Our 1xN pattern prunes these blocks considered unimportant. We also provide a workflow of filter rearrangement that first rearranges the weight matrix in the output channel dimension to derive more influential blocks for accuracy improvements and then applies similar rearrangement to the next-layer weights in the input channel dimension to ensure correct convolutional operations. Moreover, the output computation after our 1xN pruning can be realized via a parallelized block-wise vectorized operation, leading to significant speedups on general CPUs. The efficacy of our pruning pattern is proved with experiments on ILSVRC-2012. For example, given the pruning rate of 50% and N=4, our pattern obtains about 3.0% improvements over filter pruning in the top-1 accuracy of MobileNet-V2. Meanwhile, it obtains 56.04ms inference savings on Cortex-A7 CPU over weight pruning. Our project is made available at this https URL
Submission history
From: Mingbao Lin [view email][v1] Mon, 31 May 2021 05:50:33 GMT (1157kb,D)
[v2] Tue, 1 Jun 2021 11:59:07 GMT (1159kb,D)
[v3] Tue, 15 Jun 2021 08:09:24 GMT (1163kb,D)
[v4] Mon, 8 Nov 2021 03:45:26 GMT (1159kb,D)
[v5] Wed, 17 Nov 2021 08:38:44 GMT (3422kb,D)
[v6] Sun, 16 Oct 2022 01:34:36 GMT (5652kb,D)
Link back to: arXiv, form interface, contact.