Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Learning Multiscale Convolutional Dictionaries for Image Reconstruction
(Submitted on 25 Nov 2020 (v1), last revised 19 May 2022 (this version, v3))
Abstract: Convolutional neural networks (CNNs) have been tremendously successful in solving imaging inverse problems. To understand their success, an effective strategy is to construct simpler and mathematically more tractable convolutional sparse coding (CSC) models that share essential ingredients with CNNs. Existing CSC methods, however, underperform leading CNNs in challenging inverse problems. We hypothesize that the performance gap may be attributed in part to how they process images at different spatial scales: While many CNNs use multiscale feature representations, existing CSC models mostly rely on single-scale dictionaries. To close the performance gap, we thus propose a multiscale convolutional dictionary structure. The proposed dictionary structure is derived from the U-Net, arguably the most versatile and widely used CNN for image-to-image learning problems. We show that incorporating the proposed multiscale dictionary in an otherwise standard CSC framework yields performance competitive with state-of-the-art CNNs across a range of challenging inverse problems including CT and MRI reconstruction. Our work thus demonstrates the effectiveness and scalability of the multiscale CSC approach in solving challenging inverse problems.
Submission history
From: Tianlin Liu [view email][v1] Wed, 25 Nov 2020 15:18:00 GMT (5372kb,D)
[v2] Thu, 19 Aug 2021 08:48:13 GMT (5240kb,D)
[v3] Thu, 19 May 2022 08:06:59 GMT (13724kb,D)
Link back to: arXiv, form interface, contact.