We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.GT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computer Science and Game Theory

Title: Efficient Deviation Types and Learning for Hindsight Rationality in Extensive-Form Games

Abstract: Hindsight rationality is an approach to playing multi-agent, general-sum games that prescribes no-regret learning dynamics and describes jointly rational behavior with mediated equilibria. We explore the space of deviation types in extensive-form games (EFGs) and discover powerful types that are efficient to compute in games with moderate lengths. Specifically, we identify four new types of deviations that subsume previously studied types within a broader class we call partial sequence deviations. Integrating the idea of time selection regret minimization into counterfactual regret minimization (CFR), we introduce the extensive-form regret minimization (EFR) algorithm that is hindsight rational for a general and natural class of deviations in EFGs. We provide instantiations and regret bounds for EFR that correspond to each partial sequence deviation type. In addition, we present a thorough empirical analysis of EFR's performance with different deviation types in common benchmark games. As theory suggests, instantiating EFR with stronger deviations leads to behavior that tends to outperform that of weaker deviations.
Comments: 32 pages, 6 figures
Subjects: Computer Science and Game Theory (cs.GT); Artificial Intelligence (cs.AI)
Cite as: arXiv:2102.06973 [cs.GT]
  (or arXiv:2102.06973v1 [cs.GT] for this version)

Submission history

From: Dustin Morrill [view email]
[v1] Sat, 13 Feb 2021 18:12:53 GMT (1834kb,D)
[v2] Sat, 12 Jun 2021 03:42:10 GMT (3315kb,D)
[v3] Sat, 5 Mar 2022 21:06:53 GMT (3315kb,D)
[v4] Sun, 29 May 2022 16:54:40 GMT (3320kb,D)
[v5] Wed, 1 Jun 2022 23:28:39 GMT (3320kb,D)
[v6] Fri, 17 Jun 2022 22:16:20 GMT (3320kb,D)
[v7] Wed, 22 Jun 2022 23:16:01 GMT (3320kb,D)

Link back to: arXiv, form interface, contact.