References & Citations
Mathematics > Optimization and Control
Title: Linear Convergence of Primal-Dual Gradient Methods and their Performance in Distributed Optimization
(Submitted on 2 Apr 2019 (this version), latest version 16 Jan 2020 (v2))
Abstract: In this work, we revisit a discrete implementation of the primal-descent dual-ascent gradient method applied to saddle-point optimization problems. Through a short proof, we establish linear (exponential) convergence of the algorithm for strongly-convex cost functions with Lipschitz continuous gradients. Unlike previous studies, we provide explicit upper bounds on the step-size parameters for stable behavior and on the resulting convergence rate and highlight the importance of having two different primal and dual step-sizes. We also explain the effect of the augmented Lagrangian penalty term on the algorithm stability and performance for the distributed minimization of aggregate cost functions over multi-agent networks.
Submission history
From: Sulaiman Alghunaim Mr. [view email][v1] Tue, 2 Apr 2019 03:42:27 GMT (2205kb,D)
[v2] Thu, 16 Jan 2020 10:43:06 GMT (603kb,D)
Link back to: arXiv, form interface, contact.