We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Local Exact-Diffusion for Decentralized Optimization and Learning

Abstract: Distributed optimization methods with local updates have recently received a lot of attention due to their potential to reduce the communication cost of distributed methods. In these algorithms, a collection of nodes performs several local updates based on their local data and then communicates with each other to exchange estimate information. While there have been many studies on distributed local methods with centralized network connections, there has been less work on decentralized networks.
In this work, we propose and investigate a locally updated decentralized method called Local Exact-Diffusion (LED). We establish the convergence of LED in both convex and nonconvex settings for the stochastic online setting. Our convergence rate bounds improves over the bounds of existing decentralized methods. When we specialize the network to the centralized case, we recover the state-of-the-art bound for centralized methods. We also link LED to several other distributed methods that have been studied independently, including Scaffnew, FedGate, and VRL-SGD. We also numerically investigate the benefits of local updates for decentralized networks and demonstrate the effectiveness of the proposed method.
Subjects: Optimization and Control (math.OC)
Cite as: arXiv:2302.00620 [math.OC]
  (or arXiv:2302.00620v1 [math.OC] for this version)

Submission history

From: Sulaiman Alghunaim [view email]
[v1] Wed, 1 Feb 2023 17:37:32 GMT (3489kb,D)

Link back to: arXiv, form interface, contact.