Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Competitive Gradient Descent
(Submitted on 28 May 2019 (v1), last revised 1 Jul 2020 (this version, v3))
Abstract: We introduce a new algorithm for the numerical computation of Nash equilibria of competitive two-player games. Our method is a natural generalization of gradient descent to the two-player setting where the update is given by the Nash equilibrium of a regularized bilinear local approximation of the underlying game. It avoids oscillatory and divergent behaviors seen in alternating gradient descent. Using numerical experiments and rigorous analysis, we provide a detailed comparison to methods based on \emph{optimism} and \emph{consensus} and show that our method avoids making any unnecessary changes to the gradient dynamics while achieving exponential (local) convergence for (locally) convex-concave zero sum games. Convergence and stability properties of our method are robust to strong interactions between the players, without adapting the stepsize, which is not the case with previous methods. In our numerical experiments on non-convex-concave problems, existing methods are prone to divergence and instability due to their sensitivity to interactions among the players, whereas we never observe divergence of our algorithm. The ability to choose larger stepsizes furthermore allows our algorithm to achieve faster convergence, as measured by the number of model evaluations.
Submission history
From: Florian Schäfer [view email][v1] Tue, 28 May 2019 21:42:33 GMT (1084kb,D)
[v2] Thu, 10 Oct 2019 15:54:35 GMT (1086kb,D)
[v3] Wed, 1 Jul 2020 01:48:46 GMT (1093kb,D)
Link back to: arXiv, form interface, contact.