We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Artificial Intelligence

Title: Student of Games: A unified learning algorithm for both perfect and imperfect information games

Abstract: Games have a long history as benchmarks for progress in artificial intelligence. Approaches using search and learning produced strong performance across many perfect information games, and approaches using game-theoretic reasoning and learning demonstrated strong performance for specific imperfect information poker variants. We introduce Student of Games, a general-purpose algorithm that unifies previous approaches, combining guided search, self-play learning, and game-theoretic reasoning. Student of Games achieves strong empirical performance in large perfect and imperfect information games -- an important step towards truly general algorithms for arbitrary environments. We prove that Student of Games is sound, converging to perfect play as available computation and approximation capacity increases. Student of Games reaches strong performance in chess and Go, beats the strongest openly available agent in heads-up no-limit Texas hold'em poker, and defeats the state-of-the-art agent in Scotland Yard, an imperfect information game that illustrates the value of guided search, learning, and game-theoretic reasoning.
Comments: Published in Science Advances
Subjects: Artificial Intelligence (cs.AI); Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG)
Journal reference: Science Advances 9, eadg3256 (2023)
DOI: 10.1126/sciadv.adg3256
Cite as: arXiv:2112.03178 [cs.AI]
  (or arXiv:2112.03178v2 [cs.AI] for this version)

Submission history

From: Nolan Bard [view email]
[v1] Mon, 6 Dec 2021 17:16:24 GMT (7469kb,D)
[v2] Wed, 15 Nov 2023 19:12:12 GMT (2252kb,D)

Link back to: arXiv, form interface, contact.