We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.DS

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Data Structures and Algorithms

Title: On Greedy Approaches to Hierarchical Aggregation

Abstract: We analyze greedy algorithms for the Hierarchical Aggregation (HAG) problem, a strategy introduced in [Jia et al., KDD 2020] for speeding up learning on Graph Neural Networks (GNNs). The idea of HAG is to identify and remove redundancies in computations performed when training GNNs. The associated optimization problem is to identify and remove the most redundancies.
Previous work introduced a greedy approach for the HAG problem and claimed a 1-1/e approximation factor. We show by example that this is not correct, and one cannot hope for better than a 1/2 approximation factor. We prove that this greedy algorithm does satisfy some (weaker) approximation guarantee, by showing a new connection between the HAG problem and maximum matching problems in hypergraphs. We also introduce a second greedy algorithm which can out-perform the first one, and we show how to implement it efficiently in some parameter regimes. Finally, we introduce some greedy heuristics that are much faster than the above greedy algorithms, and we demonstrate that they perform well on real-world graphs.
Comments: Example figures replaced
Subjects: Data Structures and Algorithms (cs.DS)
Cite as: arXiv:2102.01730 [cs.DS]
  (or arXiv:2102.01730v3 [cs.DS] for this version)

Submission history

From: Alexandra Porter [view email]
[v1] Tue, 2 Feb 2021 19:59:10 GMT (1130kb,D)
[v2] Thu, 4 Feb 2021 01:34:03 GMT (1348kb,D)
[v3] Fri, 5 Feb 2021 21:11:51 GMT (1403kb,D)

Link back to: arXiv, form interface, contact.