Current browse context:
cs.LG
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Second-Order Mirror Descent: Convergence in Games Beyond Averaging and Discounting
(Submitted on 18 Nov 2021 (v1), last revised 30 Jun 2023 (this version, v4))
Abstract: In this paper, we propose a second-order extension of the continuous-time game-theoretic mirror descent (MD) dynamics, referred to as MD2, which provably converges to mere (but not necessarily strict) variationally stable states (VSS) without using common auxiliary techniques such as time-averaging or discounting. We show that MD2 enjoys no-regret as well as an exponential rate of convergence towards strong VSS upon a slight modification. MD2 can also be used to derive many novel continuous-time primal-space dynamics. We then use stochastic approximation techniques to provide a convergence guarantee of discrete-time MD2 with noisy observations towards interior mere VSS. Selected simulations are provided to illustrate our results.
Submission history
From: Bolin Gao [view email][v1] Thu, 18 Nov 2021 23:51:38 GMT (4780kb,D)
[v2] Sat, 25 Jun 2022 02:44:47 GMT (3624kb,D)
[v3] Thu, 12 Jan 2023 04:23:59 GMT (3684kb,D)
[v4] Fri, 30 Jun 2023 20:18:52 GMT (3685kb,D)
Link back to: arXiv, form interface, contact.