Current browse context:
cs.SI
Change to browse by:
References & Citations
Computer Science > Social and Information Networks
Title: Distributed Estimation of Graph 4-Profiles
(Submitted on 8 Oct 2015 (v1), last revised 4 Apr 2016 (this version, v2))
Abstract: We present a novel distributed algorithm for counting all four-node induced subgraphs in a big graph. These counts, called the $4$-profile, describe a graph's connectivity properties and have found several uses ranging from bioinformatics to spam detection. We also study the more complicated problem of estimating the local $4$-profiles centered at each vertex of the graph. The local $4$-profile embeds every vertex in an $11$-dimensional space that characterizes the local geometry of its neighborhood: vertices that connect different clusters will have different local $4$-profiles compared to those that are only part of one dense cluster.
Our algorithm is a local, distributed message-passing scheme on the graph and computes all the local $4$-profiles in parallel. We rely on two novel theoretical contributions: we show that local $4$-profiles can be calculated using compressed two-hop information and also establish novel concentration results that show that graphs can be substantially sparsified and still retain good approximation quality for the global $4$-profile.
We empirically evaluate our algorithm using a distributed GraphLab implementation that we scaled up to $640$ cores. We show that our algorithm can compute global and local $4$-profiles of graphs with millions of edges in a few minutes, significantly improving upon the previous state of the art.
Submission history
From: Ethan R. Elenberg [view email][v1] Thu, 8 Oct 2015 07:49:23 GMT (301kb,D)
[v2] Mon, 4 Apr 2016 08:49:33 GMT (925kb,D)
Link back to: arXiv, form interface, contact.