๐”– Bobbio Scriptorium
โœฆ   LIBER   โœฆ

Are There Really No Evolutionarily Stable Strategies in the Iterated Prisoner's Dilemma?

โœ Scribed by JEFFREY P. LORBERBAUM; DARYL E. BOHNING; ANANDA SHASTRI; LAUREN E. SINE


Publisher
Elsevier Science
Year
2002
Tongue
English
Weight
291 KB
Volume
214
Category
Article
ISSN
0022-5193

No coin nor oath required. For personal study only.

โœฆ Synopsis


The evolutionary form of the iterated prisoner's dilemma (IPD) is a repeated game where players strategically choose whether to cooperate with or exploit opponents and reproduce in proportion to game success. It has been widely used to study the evolution of cooperation among sel"sh agents. In the past 15 years, researchers proved over a series of papers that there is no evolutionarily stable strategy (ESS) in the IPD when players maintain long-term relationships. This makes it di$cult to make predictions about what strategies can actually persist as prevalent in a population over time. Here, we show that this no ESS "nding may be a mathematical technicality, relying on implausible players who are &&too perfect'' in that their probability of cooperating on any move is arbitrarily close to either 0 or 1. Speci"cally, in the no ESS proof, all strategies were allowed, meaning that after a strategy X experiences any history H, X cooperates with an unrestricted probability p(X, H) where 0)p(X, H))1.

Here, we restrict strategies to the set S in which X is a member of X if after any H, X cooperates with a restricted probability p(X, H) where e)p(X, H))1!e and 0(e( . The variables e and 1!e may be thought of as the biological limits to how perfect (pure) a strategy can be. In S, we "rst prove that an ESS must be a Nash equilibrium and boundary strategy of S where a boundary strategy has allowable probabilities of cooperating of e or 1!e after any history. We then prove that X is an ESS in S if and only if X is a Nash equilibrium in the set consisting of only S's boundary strategies. Thus, in searching for ESSs in S, we only need to consider what happens when boundary strategies interact with one another. This greatly simpli"es the search for ESSs. Using these results, we "nally show that when e is su$ciently small, exactly three one-move memory ESSs exist in S:

(1) Pavlov-e which generally cooperates (i.e. cooperates with maximum probability 1!e) after both players either simultaneously cooperated or simultaneously defected; otherwise, Pavlov-e generally defects (i.e. cooperates with minimum probability e).

(2) Grudge-e which generally cooperates after both players simultaneously cooperated; otherwise, Grudge-e generally defects.

(3) ALLD-e which generally defects after all histories.


๐Ÿ“œ SIMILAR VOLUMES


Evolutionarily Stable Strategy Distribut
โœ Miranda Mowbray ๐Ÿ“‚ Article ๐Ÿ“… 1997 ๐Ÿ› Elsevier Science ๐ŸŒ English โš– 186 KB

This paper introduces the idea of an evolutionarily stable strategy distribution, which generalizes the idea of an evolutionarily stable strategy; roughly speaking, an evolutionarily stable strategy distribution is a finite set of symbiotic strategies which is unaffected by low levels of mutation. T

Evolution of Strategies in the three-per
โœ Masanao Matsushima; Takashi Ikegami ๐Ÿ“‚ Article ๐Ÿ“… 1998 ๐Ÿ› Elsevier Science ๐ŸŒ English โš– 287 KB

A three-person iterated prisoner's dilemma (3p-IPD) game is studied. The present simulation uses a lattice model of finite state automata. In particular, the similarity between a noisy 2pand a noiseless 3p-IPD game is discussed. It is known that, due to the noise, Tit for Tat loses its robustness an