Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Structured Sparsity Learning for Efficient Video Super-Resolution
(Submitted on 15 Jun 2022 (v1), last revised 25 Mar 2023 (this version, v3))
Abstract: The high computational costs of video super-resolution (VSR) models hinder their deployment on resource-limited devices, (e.g., smartphones and drones). Existing VSR models contain considerable redundant filters, which drag down the inference efficiency. To prune these unimportant filters, we develop a structured pruning scheme called Structured Sparsity Learning (SSL) according to the properties of VSR. In SSL, we design pruning schemes for several key components in VSR models, including residual blocks, recurrent networks, and upsampling networks. Specifically, we develop a Residual Sparsity Connection (RSC) scheme for residual blocks of recurrent networks to liberate pruning restrictions and preserve the restoration information. For upsampling networks, we design a pixel-shuffle pruning scheme to guarantee the accuracy of feature channel-space conversion. In addition, we observe that pruning error would be amplified as the hidden states propagate along with recurrent networks. To alleviate the issue, we design Temporal Finetuning (TF). Extensive experiments show that SSL can significantly outperform recent methods quantitatively and qualitatively.
Submission history
From: Bin Xia [view email][v1] Wed, 15 Jun 2022 17:36:04 GMT (9511kb,D)
[v2] Mon, 21 Nov 2022 07:43:22 GMT (8599kb,D)
[v3] Sat, 25 Mar 2023 13:28:14 GMT (8646kb,D)
Link back to: arXiv, form interface, contact.