Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: Maximum entropy low-rank matrix recovery
(Submitted on 8 Dec 2017 (this version), latest version 21 Nov 2018 (v6))
Abstract: We propose a novel, information-theoretic method, called MaxEnt, for efficient data requisition for low-rank matrix recovery. This proposed method has important applications to a wide range of problems in image processing, text document indexing and system identification, and is particularly effective when the desired matrix $\mathbf{X}$ is high-dimensional, and measurements from $\mathbf{X}$ are expensive to obtain. Fundamental to this design approach is the so-called maximum entropy principle, which states that the measurement masks which maximize the entropy of observations also maximize the information gain on the unknown matrix $\mathbf{X}$. Coupled with a low-rank stochastic model for $\mathbf{X}$, such a principle (i) reveals several insightful connections between information-theoretic sampling, compressive sensing and coding theory, and (ii) yields efficient algorithms for constructing initial and adaptive masks for recovering $\mathbf{X}$, which significantly outperforms random measurements. We illustrate the effectiveness of MaxEnt using several simulation experiments, and demonstrate its usefulness in two real-world applications on image recovery and text document indexing.
Submission history
From: Simon Mak [view email][v1] Fri, 8 Dec 2017 23:08:12 GMT (7300kb,D)
[v2] Tue, 24 Apr 2018 03:01:30 GMT (6889kb,D)
[v3] Wed, 30 May 2018 20:06:03 GMT (4670kb,D)
[v4] Wed, 25 Jul 2018 19:30:16 GMT (2538kb,D)
[v5] Mon, 10 Sep 2018 06:45:07 GMT (2592kb,D)
[v6] Wed, 21 Nov 2018 05:11:51 GMT (2594kb,D)
Link back to: arXiv, form interface, contact.