Current browse context:
cs.IT
Change to browse by:
References & Citations
Computer Science > Information Theory
Title: Optimal Shrinkage of Singular Values Under Random Data Contamination
(Submitted on 26 Oct 2017 (v1), last revised 18 Nov 2017 (this version, v2))
Abstract: A low rank matrix X has been contaminated by uniformly distributed noise, missing values, outliers and corrupt entries. Reconstruction of X from the singular values and singular vectors of the contaminated matrix Y is a key problem in machine learning, computer vision and data science. In this paper we show that common contamination models (including arbitrary combinations of uniform noise,missing values, outliers and corrupt entries) can be described efficiently using a single framework. We develop an asymptotically optimal algorithm that estimates X by manipulation of the singular values of Y , which applies to any of the contamination models considered. Finally, we find an explicit signal-to-noise cutoff, below which estimation of X from the singular value decomposition of Y must fail, in a well-defined sense.
Submission history
From: Danny Barash [view email][v1] Thu, 26 Oct 2017 16:17:36 GMT (1019kb)
[v2] Sat, 18 Nov 2017 21:07:43 GMT (1015kb)
Link back to: arXiv, form interface, contact.