We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Numerical Analysis

Title: To be or not to be stable, that is the question: understanding neural networks for inverse problems

Abstract: The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem, since the ill-conditioning amplifies the noise on the data. Recently introduced deep-learning based algorithms overwhelm the more traditional model-based approaches but they typically suffer from instability with respect to data perturbation. In this paper, we theoretically analyse the trade-off between neural networks stability and accuracy in the solution of linear inverse problems. Moreover, we propose different supervised and unsupervised solutions, to increase network stability by maintaining good accuracy, by inheriting, in the network training, regularization from a model-based iterative scheme. Extensive numerical experiments on image deblurring confirm the theoretical results and the effectiveness of the proposed networks in solving inverse problems with stability with respect to noise.
Comments: 26 pages, 9 figures, divided in 4 blocks of figures in the LaTeX code. Paper will be sent for publication on a journal soon. This is a preliminary version, updated versions will be uploaded on ArXiv
Subjects: Numerical Analysis (math.NA); Machine Learning (cs.LG)
Cite as: arXiv:2211.13692 [math.NA]
  (or arXiv:2211.13692v1 [math.NA] for this version)

Submission history

From: Davide Evangelista [view email]
[v1] Thu, 24 Nov 2022 16:16:40 GMT (2764kb,D)
[v2] Wed, 25 Jan 2023 14:55:32 GMT (11633kb,D)

Link back to: arXiv, form interface, contact.