Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Optimal Methods for Convex Risk Averse Distributed Optimization
(Submitted on 10 Mar 2022 (v1), last revised 7 Mar 2023 (this version, v4))
Abstract: This paper studies the communication complexity of convex risk-averse optimization over a network. The problem generalizes the well-studied risk-neutral finite-sum distributed optimization problem and its importance stems from the need to handle risk in an uncertain environment. For algorithms in the literature, there exists a gap in communication complexities for solving risk-averse and risk-neutral problems. We propose two distributed algorithms, namely the distributed risk averse optimization (DRAO) method and the distributed risk averse optimization with sliding (DRAO-S) method, to close the gap. Specifically, the DRAO method achieves the optimal communication complexity by assuming a certain saddle point subproblem can be easily solved in the server node. The DRAO-S method removes the strong assumption by introducing a novel saddle point sliding subroutine which only requires the projection over the ambiguity set $P$. We observe that the number of $P$-projections performed by DRAO-S is optimal. Moreover, we develop matching lower complexity bounds to show the communication complexities of both DRAO and DRAO-S to be improvable. Numerical experiments are conducted to demonstrate the encouraging empirical performance of the DRAO-S method.
Submission history
From: Zhe Zhang [view email][v1] Thu, 10 Mar 2022 02:27:45 GMT (261kb,D)
[v2] Thu, 17 Mar 2022 01:43:28 GMT (259kb,D)
[v3] Thu, 10 Nov 2022 03:14:03 GMT (278kb,D)
[v4] Tue, 7 Mar 2023 16:15:11 GMT (270kb,D)
Link back to: arXiv, form interface, contact.