Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Stochastic Extragradient: General Analysis and Improved Rates
(Submitted on 16 Nov 2021 (v1), last revised 22 Feb 2022 (this version, v3))
Abstract: The Stochastic Extragradient (SEG) method is one of the most popular algorithms for solving min-max optimization and variational inequalities problems (VIP) appearing in various machine learning tasks. However, several important questions regarding the convergence properties of SEG are still open, including the sampling of stochastic gradients, mini-batching, convergence guarantees for the monotone finite-sum variational inequalities with possibly non-monotone terms, and others. To address these questions, in this paper, we develop a novel theoretical framework that allows us to analyze several variants of SEG in a unified manner. Besides standard setups, like Same-Sample SEG under Lipschitzness and monotonicity or Independent-Samples SEG under uniformly bounded variance, our approach allows us to analyze variants of SEG that were never explicitly considered in the literature before. Notably, we analyze SEG with arbitrary sampling which includes importance sampling and various mini-batching strategies as special cases. Our rates for the new variants of SEG outperform the current state-of-the-art convergence guarantees and rely on less restrictive assumptions.
Submission history
From: Eduard Gorbunov [view email][v1] Tue, 16 Nov 2021 16:49:31 GMT (930kb,D)
[v2] Mon, 27 Dec 2021 18:24:16 GMT (2522kb,D)
[v3] Tue, 22 Feb 2022 11:17:08 GMT (2534kb,D)
Link back to: arXiv, form interface, contact.