Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Decentralized Multi-Armed Bandit Can Outperform Classic Upper Confidence Bound: A Homogeneous Case over Strongly Connected Graphs
(Submitted on 22 Nov 2021 (v1), last revised 23 Mar 2024 (this version, v3))
Abstract: This paper studies a homogeneous decentralized multi-armed bandit problem, in which a network of multiple agents faces the same set of arms, and each agent aims to minimize its own regret. A fully decentralized upper confidence bound (UCB) algorithm is proposed for a multi-agent network whose neighbor relations are described by a directed graph. It is shown that the decentralized algorithm guarantees each agent to achieve a lower logarithmic asymptotic regret compared to the classic UCB algorithm, provided the neighbor graph is strongly connected. The improved asymptotic regret upper bound is reciprocally related to the maximal size of a local neighborhood within the network. The roles of graph connectivity, maximum local degree, and network size are analytically elucidated in the expression of regret.
Submission history
From: Jingxuan Zhu [view email][v1] Mon, 22 Nov 2021 01:05:52 GMT (151kb)
[v2] Fri, 6 Oct 2023 02:46:01 GMT (14745kb,D)
[v3] Sat, 23 Mar 2024 03:41:10 GMT (302kb,D)
Link back to: arXiv, form interface, contact.