We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Provably Efficient Policy Gradient Methods for Two-Player Zero-Sum Markov Games

Abstract: Policy gradient methods are widely used in solving two-player zero-sum games to achieve superhuman performance in practice. However, it remains elusive when they can provably find a near-optimal solution and how many samples and iterations are needed. The current paper studies natural extensions of Natural Policy Gradient algorithm for solving two-player zero-sum games where function approximation is used for generalization across states. We thoroughly characterize the algorithms' performance in terms of the number of samples, number of iterations, concentrability coefficients, and approximation error. To our knowledge, this is the first quantitative analysis of policy gradient methods with function approximation for two-player zero-sum Markov games.
Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Optimization and Control (math.OC); Machine Learning (stat.ML)
Cite as: arXiv:2102.08903 [cs.LG]
  (or arXiv:2102.08903v1 [cs.LG] for this version)

Submission history

From: Yulai Zhao [view email]
[v1] Wed, 17 Feb 2021 17:49:57 GMT (57kb)
[v2] Sat, 26 Feb 2022 06:03:22 GMT (59kb)

Link back to: arXiv, form interface, contact.