We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: A Unified Framework for Sparse Non-Negative Least Squares using Multiplicative Updates and the Non-Negative Matrix Factorization Problem

Abstract: We study the sparse non-negative least squares (S-NNLS) problem. S-NNLS occurs naturally in a wide variety of applications where an unknown, non-negative quantity must be recovered from linear measurements. We present a unified framework for S-NNLS based on a rectified power exponential scale mixture prior on the sparse codes. We show that the proposed framework encompasses a large class of S-NNLS algorithms and provide a computationally efficient inference procedure based on multiplicative update rules. Such update rules are convenient for solving large sets of S-NNLS problems simultaneously, which is required in contexts like sparse non-negative matrix factorization (S-NMF). We provide theoretical justification for the proposed approach by showing that the local minima of the objective function being optimized are sparse and the S-NNLS algorithms presented are guaranteed to converge to a set of stationary points of the objective function. We then extend our framework to S-NMF, showing that our framework leads to many well known S-NMF algorithms under specific choices of prior and providing a guarantee that a popular subclass of the proposed algorithms converges to a set of stationary points of the objective function. Finally, we study the performance of the proposed approaches on synthetic and real-world data.
Comments: To appear in Signal Processing
Subjects: Machine Learning (stat.ML)
Cite as: arXiv:1604.02181 [stat.ML]
  (or arXiv:1604.02181v6 [stat.ML] for this version)

Submission history

From: Igor Fedorov [view email]
[v1] Thu, 7 Apr 2016 21:35:42 GMT (370kb,D)
[v2] Tue, 12 Apr 2016 01:32:38 GMT (354kb,D)
[v3] Thu, 2 Mar 2017 07:18:28 GMT (326kb,D)
[v4] Sat, 22 Jul 2017 19:07:19 GMT (402kb,D)
[v5] Wed, 11 Oct 2017 18:26:07 GMT (810kb)
[v6] Tue, 2 Jan 2018 17:18:55 GMT (1038kb)

Link back to: arXiv, form interface, contact.