We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:


References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Optimizing Memory Efficiency of Graph Neural Networks on Edge Computing Platforms

Abstract: Graph neural networks (GNN) have achieved state-of-the-art performance on various industrial tasks. However, the poor efficiency of GNN inference and frequent Out-Of-Memory (OOM) problem limit the successful application of GNN on edge computing platforms. To tackle these problems, a feature decomposition approach is proposed for memory efficiency optimization of GNN inference. The proposed approach could achieve outstanding optimization on various GNN models, covering a wide range of datasets, which speeds up the inference by up to 3x. Furthermore, the proposed feature decomposition could significantly reduce the peak memory usage (up to 5x in memory efficiency improvement) and mitigate OOM problems during GNN inference.
Comments: This paper has been accepted by RTAS 2021(brief industry track), with link to publicly available code
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2104.03058 [cs.LG]
  (or arXiv:2104.03058v2 [cs.LG] for this version)

Submission history

From: Jianlei Yang [view email]
[v1] Wed, 7 Apr 2021 11:15:12 GMT (537kb,D)
[v2] Mon, 12 Apr 2021 11:02:19 GMT (537kb,D)

Link back to: arXiv, form interface, contact.