References & Citations
Computer Science > Machine Learning
Title: A Communication-Efficient Adaptive Algorithm for Federated Learning under Cumulative Regret
(Submitted on 21 Jan 2023 (v1), last revised 5 Jun 2023 (this version, v2))
Abstract: We consider the problem of online stochastic optimization in a distributed setting with $M$ clients connected through a central server. We develop a distributed online learning algorithm that achieves order-optimal cumulative regret with low communication cost measured in the total number of bits transmitted over the entire learning horizon. This is in contrast to existing studies which focus on the offline measure of simple regret for learning efficiency. The holistic measure for communication cost also departs from the prevailing approach that \emph{separately} tackles the communication frequency and the number of bits in each communication round.
Submission history
From: Sudeep Salgia [view email][v1] Sat, 21 Jan 2023 03:08:18 GMT (26kb)
[v2] Mon, 5 Jun 2023 18:23:06 GMT (519kb,D)
Link back to: arXiv, form interface, contact.