We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: On the Convergence of Stochastic Extragradient for Bilinear Games with Restarted Iteration Averaging

Abstract: We study the stochastic bilinear minimax optimization problem, presenting an analysis of the same-sample Stochastic ExtraGradient (SEG) method with constant step size, and presenting variations of the method that yield favorable convergence. In sharp contrasts with the basic SEG method whose last iterate only contracts to a fixed neighborhood of the Nash equilibrium, SEG augmented with iteration averaging provably converges to the Nash equilibrium under the same standard settings, and such a rate is further improved by incorporating a scheduled restarting procedure. In the interpolation setting where noise vanishes at the Nash equilibrium, we achieve an optimal convergence rate up to tight constants. We present numerical experiments that validate our theoretical findings and demonstrate the effectiveness of the SEG method when equipped with iteration averaging and restarting.
Comments: Accepted at NeurIPS OPT 2021 Workshop
Subjects: Optimization and Control (math.OC); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)
Cite as: arXiv:2107.00464 [math.OC]
  (or arXiv:2107.00464v2 [math.OC] for this version)

Submission history

From: Junchi Li [view email]
[v1] Wed, 30 Jun 2021 17:51:36 GMT (6167kb,D)
[v2] Mon, 20 Dec 2021 23:41:09 GMT (4849kb,D)

Link back to: arXiv, form interface, contact.