We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Learning from Binary Multiway Data: Probabilistic Tensor Decomposition and its Statistical Optimality

Abstract: We consider the problem of decomposing a higher-order tensor with binary entries. Such data problems arise frequently in applications such as neuroimaging, recommendation system, topic modeling, and sensor network localization. We propose a multilinear Bernoulli model, develop a rank-constrained likelihood-based estimation method, and obtain the theoretical accuracy guarantees. In contrast to continuous-valued problems, the binary tensor problem exhibits an interesting phase transition phenomenon according to the signal-to-noise ratio. The error bound for the parameter tensor estimation is established, and we show that the obtained rate is minimax optimal under the considered model. Furthermore, we develop an alternating optimization algorithm with convergence guarantees. The efficacy of our approach is demonstrated through both simulations and analyses of multiple data sets on the tasks of tensor completion and clustering.
Comments: 35 pages, 7 figures, 4 tables
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)
MSC classes: 62H25, 65F35, 62F12
Journal reference: Journal of Machine Learning Research, 21(154): 1-38, 2020
Cite as: arXiv:1811.05076 [stat.ML]
  (or arXiv:1811.05076v3 [stat.ML] for this version)

Submission history

From: Miaoyan Wang [view email]
[v1] Tue, 13 Nov 2018 02:49:17 GMT (1343kb,D)
[v2] Tue, 17 Sep 2019 04:48:47 GMT (1553kb,D)
[v3] Sun, 20 Sep 2020 04:05:02 GMT (1527kb,D)

Link back to: arXiv, form interface, contact.