We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Bayesian imaging using Plug & Play priors: when Langevin meets Tweedie

Abstract: Since the seminal work of Venkatakrishnan et al. (2013), Plug & Play (PnP) methods have become ubiquitous in Bayesian imaging. These methods derive Minimum Mean Square Error (MMSE) or Maximum A Posteriori (MAP) estimators for inverse problems in imaging by combining an explicit likelihood function with a prior that is implicitly defined by an image denoising algorithm. The PnP algorithms proposed in the literature mainly differ in the iterative schemes they use for optimisation or for sampling. In the case of optimisation schemes, some recent works guarantee the convergence to a fixed point, albeit not necessarily a MAP estimate. In the case of sampling schemes, to the best of our knowledge, there is no known proof of convergence. There also remain important open questions regarding whether the underlying Bayesian models and estimators are well defined, well-posed, and have the basic regularity properties required to support these numerical schemes. To address these limitations, this paper develops theory, methods, and provably convergent algorithms for performing Bayesian inference with PnP priors. We introduce two algorithms: 1) PnP-ULA (Unadjusted Langevin Algorithm) for Monte Carlo sampling and MMSE inference; and 2) PnP-SGD (Stochastic Gradient Descent) for MAP inference. Using recent results on the quantitative convergence of Markov chains, we establish detailed convergence guarantees for these two algorithms under realistic assumptions on the denoising operators used, with special attention to denoisers based on deep neural networks. We also show that these algorithms approximately target a decision-theoretically optimal Bayesian model that is well-posed. The proposed algorithms are demonstrated on several canonical problems such as image deblurring, inpainting, and denoising, where they are used for point estimation as well as for uncertainty visualisation and quantification.
Subjects: Methodology (stat.ME); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV); Statistics Theory (math.ST); Machine Learning (stat.ML)
MSC classes: 65K10, 65K05, 65D18, 62F15, 62C10, 68Q25, 68U10, 90C26
Cite as: arXiv:2103.04715 [stat.ME]
  (or arXiv:2103.04715v4 [stat.ME] for this version)

Submission history

From: Remi Laumont [view email]
[v1] Mon, 8 Mar 2021 12:46:53 GMT (4050kb,D)
[v2] Tue, 9 Mar 2021 15:01:21 GMT (4050kb,D)
[v3] Wed, 17 Mar 2021 16:24:03 GMT (4052kb,D)
[v4] Fri, 19 Mar 2021 12:11:36 GMT (4052kb,D)

Link back to: arXiv, form interface, contact.