We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: PMGT-VR: A decentralized proximal-gradient algorithmic framework with variance reduction

Abstract: This paper considers the decentralized composite optimization problem. We propose a novel decentralized variance-reduction proximal-gradient algorithmic framework, called PMGT-VR, which is based on a combination of several techniques including multi-consensus, gradient tracking, and variance reduction. The proposed framework relies on an imitation of centralized algorithms and we demonstrate that algorithms under this framework achieve convergence rates similar to that of their centralized counterparts. We also describe and analyze two representative algorithms, PMGT-SAGA and PMGT-LSVRG, and compare them to existing state-of-the-art proximal algorithms. To the best of our knowledge, PMGT-VR is the first linearly convergent decentralized stochastic algorithm that can solve decentralized composite optimization problems. Numerical experiments are provided to demonstrate the effectiveness of the proposed algorithms.
Comments: 16 pages, 4 figures
Subjects: Optimization and Control (math.OC); Artificial Intelligence (cs.AI)
Cite as: arXiv:2012.15010 [math.OC]
  (or arXiv:2012.15010v2 [math.OC] for this version)

Submission history

From: Wei Xiong [view email]
[v1] Wed, 30 Dec 2020 02:49:37 GMT (489kb,D)
[v2] Sat, 5 Jun 2021 07:00:53 GMT (285kb)

Link back to: arXiv, form interface, contact.