We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Optimal Algorithms for Distributed Optimization

Abstract: In this paper, we study the optimal convergence rate for distributed convex optimization problems in networks. We model the communication restrictions imposed by the network as a set of affine constraints and provide optimal complexity bounds for four different setups, namely: the function $F(\xb) \triangleq \sum_{i=1}^{m}f_i(\xb)$ is strongly convex and smooth, either strongly convex or smooth or just convex. Our results show that Nesterov's accelerated gradient descent on the dual problem can be executed in a distributed manner and obtains the same optimal rates as in the centralized version of the problem (up to constant or logarithmic factors) with an additional cost related to the spectral gap of the interaction matrix. Finally, we discuss some extensions to the proposed setup such as proximal friendly functions, time-varying graphs, improvement of the condition numbers.
Subjects: Optimization and Control (math.OC); Computational Complexity (cs.CC); Multiagent Systems (cs.MA); Systems and Control (eess.SY); Machine Learning (stat.ML)
Cite as: arXiv:1712.00232 [math.OC]
  (or arXiv:1712.00232v3 [math.OC] for this version)

Submission history

From: Cesar A. Uribe [view email]
[v1] Fri, 1 Dec 2017 08:41:28 GMT (41kb)
[v2] Wed, 5 Sep 2018 15:55:45 GMT (299kb)
[v3] Wed, 14 Nov 2018 20:17:30 GMT (299kb)

Link back to: arXiv, form interface, contact.