References & Citations
Computer Science > Distributed, Parallel, and Cluster Computing
Title: Legion: Automatically Pushing the Envelope of Multi-GPU System for Billion-Scale GNN Training
(Submitted on 26 May 2023 (v1), last revised 12 Jun 2023 (this version, v2))
Abstract: Graph neural network(GNN) has been widely applied in real-world applications, such as product recommendation in e-commerce platforms and risk control in financial management systems. Several cache-based GNN systems have been built to accelerate GNN training in a single machine with multiple GPUs. However, these systems fail to train billion-scale graphs efficiently, which is a common challenge in the industry. In this work, we propose Legion, a system that automatically pushes the envelope of multi-GPU systems for accelerating billion-scale GNN training. First, we design a hierarchical graph partitioning mechanism that significantly improves the multi-GPU cache performance. Second, we build a unified multi-GPU cache that helps to minimize the PCIe traffic incurred by caching both graph topology and features with the highest hotness. Third, we develop an automatic caching management mechanism that adapts the multi-GPU cache plan according to the hardware specifications and various graphs to maximize the overall training throughput. Evaluations on various GNN models and multiple datasets show that Legion supports training billion-scale GNNs in a single machine and significantly outperforms the state-of-the-art cache-based systems on small graphs.
Submission history
From: Jie Sun [view email][v1] Fri, 26 May 2023 02:30:38 GMT (2737kb,D)
[v2] Mon, 12 Jun 2023 08:25:09 GMT (7825kb,D)
Link back to: arXiv, form interface, contact.