Project Leader / Primary Investigator

J. Doyne Farmer


Equilibrium analysis underpins most of modern economic theory. Individuals are assumed to coordinate to equilibria where their actions and beliefs are mutually consistent. This assumption has profound consequences in terms of policy, from the idea of laissez-faire to the characterisation of the business cycle as an essentially exogenous phenomenon. But if major economic downturns such as the 2008 crisis are rather caused by endogenous forces, this opens up the possibility for early-warning signals and targeted interventions. So, when is the equilibrium assumption reasonable?

This project starts answering this question in the context of game theory, which is a transparent framework to study interdependent choices. For instance, the game Rock-Paper-Scissors can be represented as a 3x3 matrix, in which the cell where the first row and the second column meet (corresponding to the first player choosing Rock and the second player choosing Paper), contains the information that the second player wins.

The players are often assumed to coordinate on a Nash Equilibrium (NE), a state in which no player has an incentive to deviate from their current position. In Rock-Paper-Scissors, the only NE is the state where both players choose all three options with equal probability. If the first player would deviate and choose Rock with a higher probability, the second player would simply choose Paper with higher probability and win.

One seemingly convincing justification for convergence to an equilibrium is learning: the participants of the game learn the NE. We show that this is not necessarily the case: both in simple and complicated games the learning dynamics may be complex, even chaotic.


Key findings:

  • We find that when the game is competitive, as the number of actions increases and the number of players gets larger, chaos tends to dominate. This is true in particular for ‘best-response dynamics’, where a player keeps choosing the action yielding the highest payoff.
  • In multiplayer games where players use best-response dynamics, the order in which players update their action crucially determines whether the game converges to a Nash equilibrium.
  • The dynamics of more complicated learning rules closely follow the dynamics of (clockwork) best-response dynamics.

External collaborators:

Tobias Galla, Bassel Tarbush, Alex Scott


Funders:

Baillie Gifford, James S McDonnell Foundation, Foundation of German Business


Recent Publications

Jun 2023
Journal
Best-response dynamics, playing sequences, and convergence to equilibrium in random games
in International Journal of Game Theory
Torsten Heinrich ,  Yoojin Yang ,  Luca Mungo ,  Marco Pangallo ,  Alex Scott ,  Bassel Tarbush ,  Samuel Wiese
Dec 2021
Journal
Towards a taxonomy of learning dynamics in 2 × 2 games
in Games and Economic Behavior
Marco Pangallo ,  James BT Sanders ,  Tobias Galla ,  J. Doyne Farmer
Oct 2021
Journal
The Frequency of Convergent Games under Best-Response Dynamics
in Dynamic Games and Applications
Samuel C. Wiese ,  Torsten Heinrich
Feb 2019
Journal
Best reply structure and equilibrium convergence in generic games
in Science Advances
Marco Pangallo ,  Torsten Heinrich ,  J. Doyne Farmer
Mar 2018
Paper
The Prevalence Of Chaotic Dynamics In Games With Many Players
J. Doyne Farmer ,  Tobias Galla ,  James B. T. Sanders