We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: Tensor Clustering with Planted Structures: Statistical Optimality and Computational Limits

Abstract: This paper studies the statistical and computational limits of high-order clustering with planted structures. We focus on two clustering models, constant high-order clustering (CHC) and rank-one higher-order clustering (ROHC), and study the methods and theory for testing whether a cluster exists (detection) and identifying the support of cluster (recovery).
Specifically, we identify the sharp boundaries of signal-to-noise ratio for which CHC and ROHC detection/recovery are statistically possible. We also develop the tight computational thresholds: when the signal-to-noise ratio is below these thresholds, we prove that polynomial-time algorithms cannot solve these problems under the computational hardness conjectures of hypergraphic planted clique (HPC) detection and hypergraphic planted dense subgraph (HPDS) recovery. We also propose polynomial-time tensor algorithms that achieve reliable detection and recovery when the signal-to-noise ratio is above these thresholds. Both sparsity and tensor structures yield the computational barriers in high-order tensor clustering. The interplay between them results in significant differences between high-order tensor clustering and matrix clustering in literature in aspects of statistical and computational phase transition diagrams, algorithmic approaches, hardness conjecture, and proof techniques. To our best knowledge, we are the first to give a thorough characterization of the statistical and computational trade-off for such a double computational-barrier problem. Finally, we provide evidence for the computational hardness conjectures of HPC detection (via low-degree polynomial and Metropolis methods) and HPDS recovery (via low-degree polynomial method).
Comments: Done a few clarifications and added low-degree polynomial based evidence for HPDS recovery conjecture 2
Subjects: Statistics Theory (math.ST); Computational Complexity (cs.CC); Machine Learning (cs.LG); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2005.10743 [math.ST]
  (or arXiv:2005.10743v3 [math.ST] for this version)

Submission history

From: Yuetian Luo [view email]
[v1] Thu, 21 May 2020 15:53:44 GMT (464kb,D)
[v2] Sat, 29 Aug 2020 01:57:19 GMT (354kb,D)
[v3] Mon, 2 Aug 2021 14:10:08 GMT (1876kb,D)

Link back to: arXiv, form interface, contact.