Computer Science and Game Theory

New submissions

• New submissions
• Cross-lists
• Replacements

New submissions for Fri, 21 Feb 20

[1]  arXiv:2002.08414 [pdf, other]

Title: Risk-Averse Equilibrium for Games

Authors: Ali Yekkehkhany, Timothy Murray, Rakesh Nagi

Subjects: Computer Science and Game Theory (cs.GT)

The term rational has become synonymous with maximizing expected payoff in the definition of the best response in Nash setting. In this work, we consider stochastic games in which players engage only once, or at most a limited number of times. In such games, it may not be rational for players to maximize their expected payoff as they cannot wait for the Law of Large Numbers to take effect. We instead define a new notion of a risk-averse best response, that results in a risk-averse equilibrium (RAE) in which players choose to play the strategy that maximizes the probability of them being rewarded the most in a single round of the game rather than maximizing the expected received reward, subject to the actions of other players. We prove the risk-averse equilibrium to exist in all finite games and numerically compare its performance to Nash equilibrium in finite-time stochastic games.

[2]  arXiv:2002.08456 [pdf, other]

Title: From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via Regularization

Authors: Julien Perolat, Remi Munos, Jean-Baptiste Lespiau, Shayegan Omidshafiei, Mark Rowland, Pedro Ortega, Neil Burch, Thomas Anthony, David Balduzzi, Bart De Vylder, Georgios Piliouras, Marc Lanctot, Karl Tuyls

Comments: 43 pages

Subjects: Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Machine Learning (stat.ML)

In this paper we investigate the Follow the Regularized Leader dynamics in sequential imperfect information games (IIG). We generalize existing results of Poincar\'e recurrence from normal-form games to zero-sum two-player imperfect information games and other sequential game settings. We then investigate how adapting the reward (by adding a regularization term) of the game can give strong convergence guarantees in monotone games. We continue by showing how this reward adaptation technique can be leveraged to build algorithms that converge exactly to the Nash equilibrium. Finally, we show how these insights can be directly used to build state-of-the-art model-free algorithms for zero-sum two-player Imperfect Information Games (IIG).

[3]  arXiv:2002.08493 [pdf, other]

Title: Stochastic Regret Minimization in Extensive-Form Games

Authors: Gabriele Farina, Christian Kroer, Tuomas Sandholm

Subjects: Computer Science and Game Theory (cs.GT); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

Monte-Carlo counterfactual regret minimization (MCCFR) is the state-of-the-art algorithm for solving sequential games that are too large for full tree traversals. It works by using gradient estimates that can be computed via sampling. However, stochastic methods for sequential games have not been investigated extensively beyond MCCFR. In this paper we develop a new framework for developing stochastic regret minimization methods. This framework allows us to use any regret-minimization algorithm, coupled with any gradient estimator. The MCCFR algorithm can be analyzed as a special case of our framework, and this analysis leads to significantly-stronger theoretical on convergence, while simultaneously yielding a simplified proof. Our framework allows us to instantiate several new stochastic methods for solving sequential games. We show extensive experiments on three games, where some variants of our methods outperform MCCFR.

Cross-lists for Fri, 21 Feb 20

[4]  arXiv:2002.08837 (cross-list from cs.LG) [pdf, other]

Title: No-Regret and Incentive-Compatible Online Learning

Authors: Rupert Freeman, David M. Pennock, Chara Podimata, Jennifer Wortman Vaughan

Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Machine Learning (stat.ML)

We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold. First, we want the learning algorithm to be no-regret with respect to the best fixed expert in hindsight. Second, we want incentive compatibility, a guarantee that each expert's best strategy is to report his true beliefs about the realization of each event. To achieve this goal, we build on the literature on wagering mechanisms, a type of multi-agent scoring rule. We provide algorithms that achieve no regret and incentive compatibility for myopic experts for both the full and partial information settings. In experiments on datasets from FiveThirtyEight, our algorithms have regret comparable to classic no-regret algorithms, which are not incentive-compatible. Finally, we identify an incentive-compatible algorithm for forward-looking strategic agents that exhibits diminishing regret in practice.

Replacements for Fri, 21 Feb 20

[5]  arXiv:1707.03551 (replaced) [pdf, other]

Title: The efficiency of resource allocation mechanisms for budget-constrained users

Authors: Ioannis Caragiannis, Alexandros A. Voudouris

Subjects: Computer Science and Game Theory (cs.GT)

[6]  arXiv:1801.03483 (replaced) [pdf, other]

Title: On Rational Choice and the Representation of Decision Problems

Authors: Paulo Oliva, Philipp Zahn

Subjects: Computer Science and Game Theory (cs.GT)

[7]  arXiv:1903.10646 (replaced) [pdf, other]

Title: Increasing Iterate Averaging for Solving Saddle-Point Problems

Authors: Yuan Gao, Christian Kroer, Donald Goldfarb

Subjects: Machine Learning (cs.LG); Computer Science and Game Theory (cs.GT); Optimization and Control (math.OC); Machine Learning (stat.ML)

• New submissions
• Cross-lists
• Replacements