Current browse context:
eess
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Unique sparse decomposition of low rank matrices
(Submitted on 14 Jun 2021 (v1), last revised 7 Dec 2022 (this version, v5))
Abstract: The problem of finding the unique low dimensional decomposition of a given matrix has been a fundamental and recurrent problem in many areas. In this paper, we study the problem of seeking a unique decomposition of a low rank matrix $Y\in \mathbb{R}^{p\times n}$ that admits a sparse representation. Specifically, we consider $Y = A X\in \mathbb{R}^{p\times n}$ where the matrix $A\in \mathbb{R}^{p\times r}$ has full column rank, with $r < \min\{n,p\}$, and the matrix $X\in \mathbb{R}^{r\times n}$ is element-wise sparse. We prove that this sparse decomposition of $Y$ can be uniquely identified, up to some intrinsic signed permutation. Our approach relies on solving a nonconvex optimization problem constrained over the unit sphere. Our geometric analysis for the nonconvex optimization landscape shows that any {\em strict} local solution is close to the ground truth solution, and can be recovered by a simple data-driven initialization followed with any second order descent algorithm. At last, we corroborate these theoretical results with numerical experiments.
Submission history
From: Dian Jin [view email][v1] Mon, 14 Jun 2021 20:05:59 GMT (98kb)
[v2] Sat, 14 Aug 2021 20:40:38 GMT (98kb)
[v3] Mon, 1 Nov 2021 01:55:39 GMT (242kb)
[v4] Tue, 21 Dec 2021 03:08:01 GMT (242kb)
[v5] Wed, 7 Dec 2022 03:47:43 GMT (323kb)
Link back to: arXiv, form interface, contact.