We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks

Abstract: In this paper, we propose two communication efficient decentralized optimization algorithms over a general directed multi-agent network. The first algorithm, termed Compressed Push-Pull (CPP), combines the gradient tracking Push-Pull method with communication compression. We show that CPP is applicable to a general class of unbiased compression operators and achieves linear convergence rate for strongly convex and smooth objective functions. The second algorithm is a broadcast-like version of CPP (B-CPP), and it also achieves linear convergence rate under the same conditions on the objective functions. B-CPP can be applied in an asynchronous broadcast setting and further reduce communication costs compared to CPP. Numerical experiments complement the theoretical analysis and confirm the effectiveness of the proposed methods.
Subjects: Optimization and Control (math.OC); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Signal Processing (eess.SP)
Journal reference: IEEE Transactions on Signal Processing, 70(2022), 1775-1787
DOI: 10.1109/TSP.2022.3160238
Cite as: arXiv:2106.07243 [math.OC]
  (or arXiv:2106.07243v3 [math.OC] for this version)

Submission history

From: Zhuoqing Song [view email]
[v1] Mon, 14 Jun 2021 08:53:30 GMT (377kb)
[v2] Sat, 12 Feb 2022 08:22:03 GMT (1324kb)
[v3] Tue, 26 Apr 2022 15:08:32 GMT (1317kb)

Link back to: arXiv, form interface, contact.