Title: Maximin equilibrium

Abstract: We introduce a new theory of games which extends von Neumann's theory of zero-sum games to nonzero-sum games by incorporating common knowledge of individual and collective rationality of the players. Maximin equilibrium, extending Nash's value approach, is based on the evaluation of the strategic uncertainty of the whole game. We show that maximin equilibrium is invariant under strictly increasing transformations of the payoffs. Notably, every finite game possesses a maximin equilibrium in pure strategies. Considering the games in von Neumann-Morgenstern mixed extension, we demonstrate that the maximin equilibrium value is precisely the maximin (minimax) value and it coincides with the maximin strategies in two-player zero-sum games. We also show that for every Nash equilibrium that is not a maximin equilibrium there exists a maximin equilibrium that Pareto dominates it. In addition, a maximin equilibrium is never Pareto dominated by a Nash equilibrium. Finally, we discuss maximin equilibrium predictions in several games including the traveler's dilemma.