We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: A statistical interpretation of spectral embedding: the generalised random dot product graph

Abstract: Spectral embedding is a procedure which can be used to obtain vector representations of the nodes of a graph. This paper proposes a generalisation of the latent position network model known as the random dot product graph, to allow interpretation of those vector representations as latent position estimates. The generalisation is needed to model heterophilic connectivity (e.g., `opposites attract') and to cope with negative eigenvalues more generally. We show that, whether the adjacency or normalised Laplacian matrix is used, spectral embedding produces uniformly consistent latent position estimates with asymptotically Gaussian error (up to identifiability). The standard and mixed membership stochastic block models are special cases in which the latent positions take only $K$ distinct vector values, representing communities, or live in the $(K-1)$-simplex with those vertices, respectively. Under the stochastic block model, our theory suggests spectral clustering using a Gaussian mixture model (rather than $K$-means) and, under mixed membership, fitting the minimum volume enclosing simplex, existing recommendations previously only supported under non-negative-definite assumptions. Empirical improvements in link prediction (over the random dot product graph), and the potential to uncover richer latent structure (than posited under the standard or mixed membership stochastic block models) are demonstrated in a cyber-security example.
Comments: 34 pages; 12 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
MSC classes: 62H30, 62H12, 62E20,
Cite as: arXiv:1709.05506 [stat.ML]
  (or arXiv:1709.05506v5 [stat.ML] for this version)

Submission history

From: Patrick Rubin-Delanchy Dr [view email]
[v1] Sat, 16 Sep 2017 12:30:40 GMT (198kb,D)
[v2] Thu, 21 Sep 2017 12:58:52 GMT (199kb,D)
[v3] Sun, 29 Jul 2018 19:02:30 GMT (646kb,D)
[v4] Wed, 8 Jan 2020 16:27:46 GMT (1017kb,D)
[v5] Tue, 16 Nov 2021 11:17:52 GMT (3035kb,D)

Link back to: arXiv, form interface, contact.