Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Rectified Gaussian Scale Mixtures and the Sparse Non-Negative Least Squares Problem
(Submitted on 22 Jan 2016 (v1), last revised 27 Mar 2018 (this version, v6))
Abstract: In this paper, we develop a Bayesian evidence maximization framework to solve the sparse non-negative least squares (S-NNLS) problem. We introduce a family of probability densities referred to as the Rectified Gaussian Scale Mixture (R- GSM) to model the sparsity enforcing prior distribution for the solution. The R-GSM prior encompasses a variety of heavy-tailed densities such as the rectified Laplacian and rectified Student- t distributions with a proper choice of the mixing density. We utilize the hierarchical representation induced by the R-GSM prior and develop an evidence maximization framework based on the Expectation-Maximization (EM) algorithm. Using the EM based method, we estimate the hyper-parameters and obtain a point estimate for the solution. We refer to the proposed method as rectified sparse Bayesian learning (R-SBL). We provide four R- SBL variants that offer a range of options for computational complexity and the quality of the E-step computation. These methods include the Markov chain Monte Carlo EM, linear minimum mean-square-error estimation, approximate message passing and a diagonal approximation. Using numerical experiments, we show that the proposed R-SBL method outperforms existing S-NNLS solvers in terms of both signal and support recovery performance, and is also very robust against the structure of the design matrix.
Submission history
From: Alican Nalci [view email][v1] Fri, 22 Jan 2016 23:47:36 GMT (865kb)
[v2] Tue, 8 Mar 2016 10:14:35 GMT (905kb)
[v3] Wed, 9 Mar 2016 02:38:23 GMT (840kb)
[v4] Sun, 19 Mar 2017 00:03:43 GMT (536kb,D)
[v5] Fri, 16 Feb 2018 21:27:34 GMT (1557kb,D)
[v6] Tue, 27 Mar 2018 18:36:04 GMT (1698kb,D)
Link back to: arXiv, form interface, contact.