We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems

Abstract: Recently, deep learning approaches with various network architectures have achieved significant performance improvement over existing iterative reconstruction methods in various imaging problems. However, it is still unclear why these deep learning architectures work for specific inverse problems. To address these issues, here we show that the long-searched-for missing link is the convolution framelets for representing a signal by convolving local and non-local bases. The convolution framelets was originally developed to generalize the theory of low-rank Hankel matrix approaches for inverse problems, and this paper further extends the idea so that we can obtain a deep neural network using multilayer convolution framelets with perfect reconstruction (PR) under rectilinear linear unit nonlinearity (ReLU). Our analysis also shows that the popular deep network components such as residual block, redundant filter channels, and concatenated ReLU (CReLU) do indeed help to achieve the PR, while the pooling and unpooling layers should be augmented with high-pass branches to meet the PR condition. Moreover, by changing the number of filter channels and bias, we can control the shrinkage behaviors of the neural network. This discovery leads us to propose a novel theory for deep convolutional framelets neural network. Using numerical experiments with various inverse problems, we demonstrated that our deep convolution framelets network shows consistent improvement over existing deep architectures.This discovery suggests that the success of deep learning is not from a magical power of a black-box, but rather comes from the power of a novel signal representation using non-local basis combined with data-driven local basis, which is indeed a natural extension of classical signal processing theory.
Comments: This will appear in SIAM Journal on Imaging Sciences
Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG)
Cite as: arXiv:1707.00372 [stat.ML]
  (or arXiv:1707.00372v5 [stat.ML] for this version)

Submission history

From: Jong Chul Ye [view email]
[v1] Mon, 3 Jul 2017 00:16:04 GMT (2767kb,D)
[v2] Thu, 20 Jul 2017 08:20:27 GMT (3072kb,D)
[v3] Wed, 2 Aug 2017 13:27:07 GMT (2710kb,D)
[v4] Thu, 30 Nov 2017 07:12:01 GMT (6771kb,D)
[v5] Thu, 25 Jan 2018 09:37:10 GMT (7421kb,D)

Link back to: arXiv, form interface, contact.