We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: The Mathematics Behind Spectral Clustering And The Equivalence To PCA

Authors: T Shen
Abstract: Spectral clustering is a popular algorithm that clusters points using the eigenvalues and eigenvectors of Laplacian matrices derived from the data. For years, spectral clustering has been working mysteriously. This paper explains spectral clustering by dividing it into two categories based on whether the graph Laplacian is fully connected or not. For a fully connected graph, this paper demonstrates the dimension reduction part by offering an objective function: the covariance between the original data points' similarities and the mapped data points' similarities. For a multi-connected graph, this paper proves that with a proper $k$, the first $k$ eigenvectors are the indicators of the connected components. This paper also proves there is an equivalence between spectral embedding and PCA.
Comments: 6 pages
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:2103.00733 [stat.ML]
  (or arXiv:2103.00733v1 [stat.ML] for this version)

Submission history

From: T Shen [view email]
[v1] Mon, 1 Mar 2021 03:42:38 GMT (8kb)

Link back to: arXiv, form interface, contact.