Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: Effective Tensor Sketching via Sparsification
(Submitted on 31 Oct 2017 (v1), last revised 16 Nov 2017 (this version, v3))
Abstract: In this paper, we investigate effective sketching schemes via sparsification for high dimensional multilinear arrays or tensors. More specifically, we propose a novel tensor sparsification algorithm that retains a subset of the entries of a tensor in a judicious way, and prove that it can attain a given level of approximation accuracy in terms of tensor spectral norm with a much smaller sample complexity when compared with existing approaches. In particular, we show that for a $k$th order $d\times\cdots\times d$ cubic tensor of {\it stable rank} $r_s$, the sample size requirement for achieving a relative error $\varepsilon$ is, up to a logarithmic factor, of the order $r_s^{1/2} d^{k/2} /\varepsilon$ when $\varepsilon$ is relatively large, and $r_s d /\varepsilon^2$ and essentially optimal when $\varepsilon$ is sufficiently small. It is especially noteworthy that the sample size requirement for achieving a high accuracy is of an order independent of $k$. To further demonstrate the utility of our techniques, we also study how higher order singular value decomposition (HOSVD) of large tensors can be efficiently approximated via sparsification.
Submission history
From: Dong Xia [view email][v1] Tue, 31 Oct 2017 02:04:39 GMT (92kb)
[v2] Wed, 15 Nov 2017 15:31:16 GMT (0kb,I)
[v3] Thu, 16 Nov 2017 14:20:51 GMT (49kb)
Link back to: arXiv, form interface, contact.