References & Citations
Statistics > Machine Learning
Title: Provable Sparse Tensor Decomposition
(Submitted on 5 Feb 2015 (v1), last revised 2 May 2016 (this version, v3))
Abstract: We propose a novel sparse tensor decomposition method, namely Tensor Truncated Power (TTP) method, that incorporates variable selection into the estimation of decomposition components. The sparsity is achieved via an efficient truncation step embedded in the tensor power iteration. Our method applies to a broad family of high dimensional latent variable models, including high dimensional Gaussian mixture and mixtures of sparse regressions. A thorough theoretical investigation is further conducted. In particular, we show that the final decomposition estimator is guaranteed to achieve a local statistical rate, and further strengthen it to the global statistical rate by introducing a proper initialization procedure. In high dimensional regimes, the obtained statistical rate significantly improves those shown in the existing non-sparse decomposition methods. The empirical advantages of TTP are confirmed in extensive simulated results and two real applications of click-through rate prediction and high-dimensional gene clustering.
Submission history
From: Guang Cheng [view email][v1] Thu, 5 Feb 2015 03:37:40 GMT (921kb,D)
[v2] Fri, 25 Dec 2015 09:47:23 GMT (957kb,D)
[v3] Mon, 2 May 2016 23:46:16 GMT (1356kb,D)
Link back to: arXiv, form interface, contact.