Current browse context:
math
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Optimal Algorithms for Distributed Optimization
(Submitted on 1 Dec 2017 (v1), last revised 14 Nov 2018 (this version, v3))
Abstract: In this paper, we study the optimal convergence rate for distributed convex optimization problems in networks. We model the communication restrictions imposed by the network as a set of affine constraints and provide optimal complexity bounds for four different setups, namely: the function $F(\xb) \triangleq \sum_{i=1}^{m}f_i(\xb)$ is strongly convex and smooth, either strongly convex or smooth or just convex. Our results show that Nesterov's accelerated gradient descent on the dual problem can be executed in a distributed manner and obtains the same optimal rates as in the centralized version of the problem (up to constant or logarithmic factors) with an additional cost related to the spectral gap of the interaction matrix. Finally, we discuss some extensions to the proposed setup such as proximal friendly functions, time-varying graphs, improvement of the condition numbers.
Submission history
From: Cesar A. Uribe [view email][v1] Fri, 1 Dec 2017 08:41:28 GMT (41kb)
[v2] Wed, 5 Sep 2018 15:55:45 GMT (299kb)
[v3] Wed, 14 Nov 2018 20:17:30 GMT (299kb)
Link back to: arXiv, form interface, contact.