Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning Heuristics over Large Graphs via Deep Reinforcement Learning
(Submitted on 8 Mar 2019 (v1), last revised 3 Dec 2020 (this version, v5))
Abstract: There has been an increased interest in discovering heuristics for combinatorial problems on graphs through machine learning. While existing techniques have primarily focused on obtaining high-quality solutions, scalability to billion-sized graphs has not been adequately addressed. In addition, the impact of budget-constraint, which is necessary for many practical scenarios, remains to be studied. In this paper, we propose a framework called GCOMB to bridge these gaps. GCOMB trains a Graph Convolutional Network (GCN) using a novel probabilistic greedy mechanism to predict the quality of a node. To further facilitate the combinatorial nature of the problem, GCOMB utilizes a Q-learning framework, which is made efficient through importance sampling. We perform extensive experiments on real graphs to benchmark the efficiency and efficacy of GCOMB. Our results establish that GCOMB is 100 times faster and marginally better in quality than state-of-the-art algorithms for learning combinatorial algorithms. Additionally, a case-study on the practical combinatorial problem of Influence Maximization (IM) shows GCOMB is 150 times faster than the specialized IM algorithm IMM with similar quality.
Submission history
From: Sourav Medya [view email][v1] Fri, 8 Mar 2019 09:23:08 GMT (479kb,D)
[v2] Tue, 24 Sep 2019 03:31:07 GMT (459kb,D)
[v3] Mon, 29 Jun 2020 08:01:08 GMT (642kb,D)
[v4] Wed, 2 Dec 2020 12:17:04 GMT (1194kb,D)
[v5] Thu, 3 Dec 2020 05:51:59 GMT (1194kb,D)
Link back to: arXiv, form interface, contact.