1
|
Champagne-Ruel A, Zakaib-Bernier S, Charbonneau P. Diffusion and pattern formation in spatial games. Phys Rev E 2024; 110:014301. [PMID: 39160963 DOI: 10.1103/physreve.110.014301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Accepted: 06/12/2024] [Indexed: 08/21/2024]
Abstract
Diffusion plays an important role in a wide variety of phenomena, from bacterial quorum sensing to the dynamics of traffic flow. While it generally tends to level out gradients and inhomogeneities, diffusion has nonetheless been shown to promote pattern formation in certain classes of systems. Formation of stable structures often serves as a key factor in promoting the emergence and persistence of cooperative behavior in otherwise competitive environments, however, an in-depth analysis on the impact of diffusion on such systems is lacking. We therefore investigate the effects of diffusion on cooperative behavior using a cellular automaton (CA) model of the noisy spatial iterated prisoner's dilemma (IPD), physical extension, and stochasticity being unavoidable characteristics of several natural phenomena. We further derive a mean-field (MF) model that captures the three-species predation dynamics from the CA model and highlight how pattern formation arises in this new model, then characterize how including diffusion by interchange similarly enables the emergence of large scale structures in the CA model as well. We investigate how these emerging patterns favors cooperative behavior for parameter space regions where IPD error rates classically forbid such dynamics. We thus demonstrate how the coupling of diffusion with nonlinear dynamics can, counterintuitively, promote large-scale structure formation and in return establish new grounds for cooperation to take hold in stochastic spatial systems.
Collapse
|
2
|
Barfuss W, Meylahn JM. Intrinsic fluctuations of reinforcement learning promote cooperation. Sci Rep 2023; 13:1309. [PMID: 36693872 PMCID: PMC9873645 DOI: 10.1038/s41598-023-27672-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 01/05/2023] [Indexed: 01/26/2023] Open
Abstract
In this work, we ask for and answer what makes classical temporal-difference reinforcement learning with [Formula: see text]-greedy strategies cooperative. Cooperating in social dilemma situations is vital for animals, humans, and machines. While evolutionary theory revealed a range of mechanisms promoting cooperation, the conditions under which agents learn to cooperate are contested. Here, we demonstrate which and how individual elements of the multi-agent learning setting lead to cooperation. We use the iterated Prisoner's dilemma with one-period memory as a testbed. Each of the two learning agents learns a strategy that conditions the following action choices on both agents' action choices of the last round. We find that next to a high caring for future rewards, a low exploration rate, and a small learning rate, it is primarily intrinsic stochastic fluctuations of the reinforcement learning process which double the final rate of cooperation to up to 80%. Thus, inherent noise is not a necessary evil of the iterative learning process. It is a critical asset for the learning of cooperation. However, we also point out the trade-off between a high likelihood of cooperative behavior and achieving this in a reasonable amount of time. Our findings are relevant for purposefully designing cooperative algorithms and regulating undesired collusive effects.
Collapse
Affiliation(s)
- Wolfram Barfuss
- Tübingen AI Center, University of Tübingen, Tübingen, Germany
| | - Janusz M Meylahn
- Department of Applied Mathematics, University of Twente, Enschede, The Netherlands. .,Dutch Institute of Emergent Phenomena, University of Amsterdam, Amsterdam, The Netherlands.
| |
Collapse
|
3
|
Zhou X, Belloum A, Lees MH, van Engers T, de Laat C. Costly incentives design from an institutional perspective: cooperation, sustainability and affluence. Proc Math Phys Eng Sci 2022. [DOI: 10.1098/rspa.2022.0393] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Incentives are usually introduced by the regulator entity (third-party), to promote cooperation in a market. The implementation of incentives is always costly and thus might fail to be enforced sustainably. This work aims at exploring the effects of incentives from an institutional perspective, while coping with the scenario where the third-party is part of the system but not composed by players. The evolutionary game theory (EGT) framework is applied to identify the incentives that lead to pure cooperation. In contrast to traditional EGT, this paper introduces an elimination mechanism that can reduce the market size. The incentives identified in the EGT analysis are further examined in simulation experiments which measure the market size, affluence and sustainability. The findings show: (1) light punishment leads to a reduction of the market size, yet heavier punishment is beneficial to the market size and wealth; (2) mixed incentives will generally lead to different wealth of the third party and of the participants. While under moderate strength, the wealth of both parties is the same and their overall wealth is maximal; (3) for sustainability, pure punishment (resp. reward) is sustainable (resp. unsustainable), the sustainability of mixed incentives depends on both their strength and agents’ rationality level.
Collapse
Affiliation(s)
- Xin Zhou
- Informatics Institute, University of Amsterdam, Amsterdam,The Netherlands
| | - Adam Belloum
- Informatics Institute, University of Amsterdam, Amsterdam,The Netherlands
| | - Michael H. Lees
- Informatics Institute, University of Amsterdam, Amsterdam,The Netherlands
| | - Tom van Engers
- Faculty of Law, University of Amsterdam, Amsterdam,The Netherlands
| | - Cees de Laat
- Informatics Institute, University of Amsterdam, Amsterdam,The Netherlands
| |
Collapse
|
4
|
Pi B, Zeng Z, Feng M, Kurths J. Evolutionary multigame with conformists and profiteers based on dynamic complex networks. CHAOS (WOODBURY, N.Y.) 2022; 32:023117. [PMID: 35232054 DOI: 10.1063/5.0081954] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2021] [Accepted: 01/25/2022] [Indexed: 06/14/2023]
Abstract
Evolutionary game on complex networks provides a new research framework for analyzing and predicting group decision-making behavior in an interactive environment, in which most researchers assumed players as profiteers. However, current studies have shown that players are sometimes conformists rather than profit-seeking in society, but most research has been discussed on a simple game without considering the impact of multiple games. In this paper, we study the influence of conformists and profiteers on the evolution of cooperation in multiple games and illustrate two different strategy-updating rules based on these conformists and profiteers. Different from previous studies, we introduce a similarity between players into strategy-updating rules and explore the evolutionary game process, including the strategy updating, the transformation of players' type, and the dynamic evolution of the network structure. In the simulation, we implement our model on scale-free and regular networks and provide some explanations from the perspective of strategy transition, type transition, and network topology properties to prove the validity of our model.
Collapse
Affiliation(s)
- Bin Pi
- College of Artificial Intelligence, Southwest University, Chongqing 400715, People's Republic of China
| | - Ziyan Zeng
- College of Artificial Intelligence, Southwest University, Chongqing 400715, People's Republic of China
| | - Minyu Feng
- College of Artificial Intelligence, Southwest University, Chongqing 400715, People's Republic of China
| | - Jürgen Kurths
- Potsdam Institute for Climate Impact Research, 14437 Potsdam, Germany and Institute for Complex System and Mathematical Biology, University of Aberdeen, Aberdeen AB24 3UE, United Kingdom
| |
Collapse
|
5
|
Czárán T, Scheuring I. Weak selection helps cheap but harms expensive cooperation in spatial threshold dilemmas. J Theor Biol 2021; 536:110995. [PMID: 34979105 DOI: 10.1016/j.jtbi.2021.110995] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 12/17/2021] [Accepted: 12/21/2021] [Indexed: 11/30/2022]
Abstract
Public Goods Games (PGGs) are n-person games with dependence of individual fitness benefits on the collective investment by the players. We have studied a simple PGG scenario played out by cooperating (C) and defecting (D) agents, applying the highly nonlinear threshold benefit function in an individual-based lattice model. A semi-analytical approximation of the lattice model has been developed and shown to describe the dynamics fairly well in the vicinity of the steady state. Besides the expected outcomes (i.e., the negative effect on cooperator persistence of higher cooperation costs and/or more intensive mixing of the population) we have found a surprising, counter-intuitive effect of the strength of selection on the steady state of the model. The effect is different at low and high cooperation costs, and it shows up only in the lattice model, suggesting that stochastic effects and higher order spatial correlations due to the emergent spatial clustering of cooperators (not taken into account in the semi-analytical approximation) must be responsible for the unexpected results for which we propose an intuitive explanation, present a tentative demonstration, and shortly discuss their biological relevance.
Collapse
Affiliation(s)
- Tamás Czárán
- Centre for Ecological Research, Institute of Evolution, 1121 Budapest, Konkoly-Thege Miklós út 29-33, Hungary; MTA-ELTE Theoretical Biology and Evolutionary Ecology Research Group, 1117 Budapest, Pázmány P. sétány 1/c, Hungary
| | - István Scheuring
- Centre for Ecological Research, Institute of Evolution, 1121 Budapest, Konkoly-Thege Miklós út 29-33, Hungary; MTA-ELTE Theoretical Biology and Evolutionary Ecology Research Group, 1117 Budapest, Pázmány P. sétány 1/c, Hungary.
| |
Collapse
|
6
|
Conditions for the existence of zero-determinant strategies under observation errors in repeated games. J Theor Biol 2021; 526:110810. [PMID: 34119498 DOI: 10.1016/j.jtbi.2021.110810] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2021] [Revised: 06/04/2021] [Accepted: 06/07/2021] [Indexed: 11/24/2022]
Abstract
Repeated games are useful models to analyze long term interactions of living species and complex social phenomena. Zero-determinant (ZD) strategies in repeated games discovered by Press and Dyson in 2012 enforce a linear payoff relationship between a focal player and the opponent. This linear relationship can be set arbitrarily by a ZD player. Hence, a subclass of ZD strategies can fix the opponent's expected payoff and another subclass of the strategies can exceed the opponent for the expected payoff. Since this discovery, theories for ZD strategies are extended to cope with various natural situations. It is especially important to consider the theory of ZD strategies for repeated games with a discount factor and observation errors because it allows the theory to be applicable in the real world. Recent studies revealed their existence of ZD strategies even in repeated games with both factors. However, the conditions for the existence has not been sufficiently analyzed. Here, we mathematically analyzed the conditions in repeated games with both factors. First, we derived the thresholds of a discount factor and observation errors which ensure the existence of Equalizer and positively correlated ZD (pcZD) strategies, which are well-known subclasses of ZD strategies. We found that ZD strategies exist only when a discount factor remains high as the error rates increase. Next, we derived the conditions for the expected payoff of the opponent enforced by Equalizer as well as the conditions for the slope and base line payoff of linear lines enforced by pcZD. As a result, we found that, as error rates increase or a discount factor decreases, the conditions for the linear line that Equalizer or pcZD can enforce become strict.
Collapse
|
7
|
Pinheiro FL, Pacheco JM, Santos FC. Stable leaders pave the way for cooperation under time-dependent exploration rates. ROYAL SOCIETY OPEN SCIENCE 2021; 8:200910. [PMID: 33972841 PMCID: PMC8074787 DOI: 10.1098/rsos.200910] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Accepted: 01/12/2021] [Indexed: 06/12/2023]
Abstract
The exploration of different behaviours is part of the adaptation repertoire of individuals to new environments. Here, we explore how the evolution of cooperative behaviour is affected by the interplay between exploration dynamics and social learning, in particular when individuals engage on prisoner's dilemma along the edges of a social network. We show that when the population undergoes a transition from strong to weak exploration rates a decline in the overall levels of cooperation is observed. However, if the rate of decay is lower in highly connected individuals (Leaders) than for the less connected individuals (Followers) then the population is able to achieve higher levels of cooperation. Finally, we show that minor differences in selection intensities (the degree of determinism in social learning) and individual exploration rates, can translate into major differences in the observed collective dynamics.
Collapse
Affiliation(s)
- Flávio L. Pinheiro
- NOVA Information Management School (NOVA IMS), Universidade Nova de Lisboa, Campus de Campolide, 1070-312 Lisboa, Portugal
- ATP-group, 2744-016 Porto Salvo, Portugal
| | - Jorge M. Pacheco
- Centro de Biologia Molecular e Ambiental, Universidade do Minho, 4710-057 Braga, Portugal
- Departamento de Matemática e Aplicações, Universidade do Minho, 4710-057 Braga, Portugal
- ATP-group, 2744-016 Porto Salvo, Portugal
| | - Francisco C. Santos
- INESC-ID and Instituto Superior Técnico, Universidade de Lisboa, 2744-016 Porto Salvo, Portugal
- ATP-group, 2744-016 Porto Salvo, Portugal
| |
Collapse
|
8
|
Cremer J, Melbinger A, Wienand K, Henriquez T, Jung H, Frey E. Cooperation in Microbial Populations: Theory and Experimental Model Systems. J Mol Biol 2019; 431:4599-4644. [PMID: 31634468 DOI: 10.1016/j.jmb.2019.09.023] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2019] [Revised: 09/25/2019] [Accepted: 09/26/2019] [Indexed: 01/07/2023]
Abstract
Cooperative behavior, the costly provision of benefits to others, is common across all domains of life. This review article discusses cooperative behavior in the microbial world, mediated by the exchange of extracellular products called public goods. We focus on model species for which the production of a public good and the related growth disadvantage for the producing cells are well described. To unveil the biological and ecological factors promoting the emergence and stability of cooperative traits we take an interdisciplinary perspective and review insights gained from both mathematical models and well-controlled experimental model systems. Ecologically, we include crucial aspects of the microbial life cycle into our analysis and particularly consider population structures where ensembles of local communities (subpopulations) continuously emerge, grow, and disappear again. Biologically, we explicitly consider the synthesis and regulation of public good production. The discussion of the theoretical approaches includes general evolutionary concepts, population dynamics, and evolutionary game theory. As a specific but generic biological example, we consider populations of Pseudomonas putida and its regulation and use of pyoverdines, iron scavenging molecules, as public goods. The review closes with an overview on cooperation in spatially extended systems and also provides a critical assessment of the insights gained from the experimental and theoretical studies discussed. Current challenges and important new research opportunities are discussed, including the biochemical regulation of public goods, more realistic ecological scenarios resembling native environments, cell-to-cell signaling, and multispecies communities.
Collapse
Affiliation(s)
- J Cremer
- Department of Molecular Immunology and Microbiology, Groningen Biomolecular Sciences and Biotechnology Institute, University of Groningen, 9747 AG Groningen, the Netherlands
| | - A Melbinger
- Arnold-Sommerfeld-Center for Theoretical Physics and Center for Nanoscience, Ludwig-Maximilians-Universität München, Theresienstrasse 37, D-80333 Munich, Germany
| | - K Wienand
- Arnold-Sommerfeld-Center for Theoretical Physics and Center for Nanoscience, Ludwig-Maximilians-Universität München, Theresienstrasse 37, D-80333 Munich, Germany
| | - T Henriquez
- Microbiology, Department of Biology I, Ludwig-Maximilians-Universität München, Grosshaderner Strasse 2-4, Martinsried, Germany
| | - H Jung
- Microbiology, Department of Biology I, Ludwig-Maximilians-Universität München, Grosshaderner Strasse 2-4, Martinsried, Germany.
| | - E Frey
- Arnold-Sommerfeld-Center for Theoretical Physics and Center for Nanoscience, Ludwig-Maximilians-Universität München, Theresienstrasse 37, D-80333 Munich, Germany.
| |
Collapse
|
9
|
Coevolution of teaching ability and cooperation in spatial evolutionary games. Sci Rep 2018; 8:14097. [PMID: 30237479 PMCID: PMC6148002 DOI: 10.1038/s41598-018-32292-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2018] [Accepted: 09/04/2018] [Indexed: 11/26/2022] Open
Abstract
Individuals with higher reputation are able to spread their social strategies easily. At the same time, one’s reputation is changing according to his previous behaviors, which leads to completely different teaching abilities for players. To explore the effect of the teaching ability influenced by reputation, we consider a coevolutionary model in which the reputation score affects the updating rule in spatial evolutionary games. More precisely, the updating probability becomes bigger if his/her partner has a positive reputation. Otherwise, the updating probability becomes smaller. This simple design describes the influence of teaching ability on strategy adoption effectively. Numerical results focus on the proportion of cooperation under different levels of the amplitude of change of reputation and the range of reputation. For this dynamics, the fraction of cooperators presents a growth trend within a wide range of parameters. In addition, to validate the generality of this mechanism, we also employ the snowdrift game. Moreover, the evolution of cooperation on Erdős-Rényi random graph is studied for the prisoner’s dilemma game. Our results may be conducive to understanding the emergence and sustainability of cooperation during the strategy adoptions in reality.
Collapse
|
10
|
Szolnoki A, Chen X. Alliance formation with exclusion in the spatial public goods game. Phys Rev E 2017; 95:052316. [PMID: 28618594 DOI: 10.1103/physreve.95.052316] [Citation(s) in RCA: 55] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2017] [Indexed: 11/07/2022]
Abstract
Detecting defection and alarming partners about the possible danger could be essential to avoid being exploited. This act, however, may require a huge individual effort from those who take this job, hence such a strategy seems to be unfavorable. But structured populations can provide an opportunity where a largely unselfish excluder strategy can form an effective alliance with other cooperative strategies, hence they can sweep out defection. Interestingly, this alliance is functioning even at the extremely high cost of exclusion where the sole application of an exclusion strategy would be harmful otherwise. These results may explain why the emergence of extreme selfless behavior is not necessarily against individual selection but could be the result of an evolutionary process.
Collapse
Affiliation(s)
- Attila Szolnoki
- Institute of Technical Physics and Materials Science, Centre for Energy Research, Hungarian Academy of Sciences, P.O. Box 49, H-1525 Budapest, Hungary
| | - Xiaojie Chen
- School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu 611731, China
| |
Collapse
|
11
|
Armano G, Javarone MA. The Beneficial Role of Mobility for the Emergence of Innovation. Sci Rep 2017; 7:1781. [PMID: 28496113 PMCID: PMC5431937 DOI: 10.1038/s41598-017-01955-2] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2017] [Accepted: 04/05/2017] [Indexed: 11/29/2022] Open
Abstract
Innovation is a key ingredient for the evolution of several systems, including social and biological ones. Focused investigations and lateral thinking may lead to innovation, as well as serendipity and other random discovery processes. Some individuals are talented at proposing innovation (say innovators), while others at deeply exploring proposed novelties, at getting further insights on a theory, or at developing products, services, and so on (say developers). This separation in terms of innovators and developers raises an issue of paramount importance: under which conditions a system is able to maintain innovators? According to a simple model, this work investigates the evolutionary dynamics that characterize the emergence of innovation. In particular, we consider a population of innovators and developers, in which agents form small groups whose composition is crucial for their payoff. The latter depends on the heterogeneity of the formed groups, on the amount of innovators they include, and on an award-factor that represents the policy of the system for promoting innovation. Under the hypothesis that a "mobility" effect may support the emergence of innovation, we compare the equilibria reached by our population in different cases. Results confirm the beneficial role of "mobility", and the emergence of further interesting phenomena.
Collapse
Affiliation(s)
- Giuliano Armano
- Department of Electronics and Computer Engineering, University of Cagliari, Cagliari, 09123, Italy
| | - Marco Alberto Javarone
- Department of Mathematics and Computer Science, University of Cagliari, Cagliari, 09123, Italy.
| |
Collapse
|
12
|
Chu C, Liu J, Shen C, Jin J, Shi L. Win-stay-lose-learn promotes cooperation in the prisoner's dilemma game with voluntary participation. PLoS One 2017; 12:e0171680. [PMID: 28182707 PMCID: PMC5300200 DOI: 10.1371/journal.pone.0171680] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Accepted: 01/24/2017] [Indexed: 11/19/2022] Open
Abstract
Voluntary participation, demonstrated to be a simple yet effective mechanism to promote persistent cooperative behavior, has been extensively studied. It has also been verified that the aspiration-based win-stay-lose-learn strategy updating rule promotes the evolution of cooperation. Inspired by this well-known fact, we combine the Win-Stay-Lose-Learn updating rule with voluntary participation: Players maintain their strategies when they are satisfied, or players attempt to imitate the strategy of one randomly chosen neighbor. We find that this mechanism maintains persistent cooperative behavior, even further promotes the evolution of cooperation under certain conditions.
Collapse
Affiliation(s)
- Chen Chu
- School of Statistics and Mathematics, Yunnan University of Finance and Economics, Kunming, Yunnan, China
| | - Jinzhuo Liu
- School of Software, Yunnan University, Kunming, Yunnan, China
| | - Chen Shen
- School of Statistics and Mathematics, Yunnan University of Finance and Economics, Kunming, Yunnan, China
| | - Jiahua Jin
- School of Statistics and Mathematics, Yunnan University of Finance and Economics, Kunming, Yunnan, China
- Library of Yunnan Normal University, Kunming, Yunnan, China
| | - Lei Shi
- School of Statistics and Mathematics, Yunnan University of Finance and Economics, Kunming, Yunnan, China
- * E-mail:
| |
Collapse
|
13
|
Co-action provides rational basis for the evolutionary success of Pavlovian strategies. Sci Rep 2016; 6:30831. [PMID: 27476604 PMCID: PMC4967866 DOI: 10.1038/srep30831] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2016] [Accepted: 07/11/2016] [Indexed: 11/08/2022] Open
Abstract
Strategies incorporating direct reciprocity, e.g., Tit-for-Tat and Pavlov, have been shown to be successful for playing the Iterated Prisoners Dilemma (IPD), a paradigmatic problem for studying the evolution of cooperation among non-kin individuals. However it is an open question whether such reciprocal strategies can emerge as the rational outcome of repeated interactions between selfish agents. Here we show that adopting a co-action perspective, which takes into account the symmetry between agents - a relevant consideration in biological and social contexts - naturally leads to such a strategy. For a 2-player IPD, we show that the co-action solution corresponds to the Pavlov strategy, thereby providing a rational basis for it. For an IPD involving many players, an instance of the Public Goods game where cooperation is generally considered to be harder to achieve, we show that the cooperators always outnumber defectors in the co-action equilibrium. This can be seen as a generalization of Pavlov to contests involving many players. In general, repeated interactions allow rational agents to become aware of the inherent symmetry of their situation, enabling them to achieve robust cooperation through co-action strategies - which, in the case of IPD, is a reciprocal Pavlovian one.
Collapse
|
14
|
Liu X, He M, Kang Y, Pan Q. Aspiration promotes cooperation in the prisoner's dilemma game with the imitation rule. Phys Rev E 2016; 94:012124. [PMID: 27575094 DOI: 10.1103/physreve.94.012124] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2015] [Indexed: 11/07/2022]
Abstract
A model of stochastic evolutionary game dynamics with finite population of size N+M was built. Among these individuals, N individuals update strategies with aspiration updating, while the other M individuals update strategies with imitation updating. In the proposed model, we obtain the expression of the mean fraction of cooperators and analyze some concrete cases. Compared with the standard imitation dynamics, there is always a positive probability to support the formation of cooperation in the system with the aspiration and imitation rules. Moreover, the numerical results indicate that more aspiration-driven individuals lead to a higher mean fraction of imitation-driven cooperators, which means the invasion of the aspiration-driven individuals is conducive to promoting the cooperation of the imitation-driven individuals.
Collapse
Affiliation(s)
- Xuesong Liu
- School of Mathematical Science, Dalian University of Technology, Dalian 116024, China
| | - Mingfeng He
- School of Mathematical Science, Dalian University of Technology, Dalian 116024, China
| | - Yibin Kang
- School of Mathematical Science, Dalian University of Technology, Dalian 116024, China
| | - Qiuhui Pan
- School of Mathematical Science, Dalian University of Technology, Dalian 116024, China.,School of Innovation and Entrepreneurship, Dalian University of Technology, Dalian 116024, China
| |
Collapse
|
15
|
Amaral MA, Wardil L, Perc M, da Silva JKL. Evolutionary mixed games in structured populations: Cooperation and the benefits of heterogeneity. Phys Rev E 2016; 93:042304. [PMID: 27176309 DOI: 10.1103/physreve.93.042304] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2016] [Indexed: 06/05/2023]
Abstract
Evolutionary games on networks traditionally involve the same game at each interaction. Here we depart from this assumption by considering mixed games, where the game played at each interaction is drawn uniformly at random from a set of two different games. While in well-mixed populations the random mixture of the two games is always equivalent to the average single game, in structured populations this is not always the case. We show that the outcome is, in fact, strongly dependent on the distance of separation of the two games in the parameter space. Effectively, this distance introduces payoff heterogeneity, and the average game is returned only if the heterogeneity is small. For higher levels of heterogeneity the distance to the average game grows, which often involves the promotion of cooperation. The presented results support preceding research that highlights the favorable role of heterogeneity regardless of its origin, and they also emphasize the importance of the population structure in amplifying facilitators of cooperation.
Collapse
Affiliation(s)
- Marco A Amaral
- Departamento de Física, Universidade Federal de Minas Gerais, Caixa Postal 702, CEP 30161-970, Belo Horizonte-MG, Brazil
| | - Lucas Wardil
- Departamento de Fisica, Universidade Federal de Ouro Preto, Ouro Preto, 35400-000, MG, Brazil
| | - Matjaž Perc
- Faculty of Natural Sciences and Mathematics, University of Maribor, Koroška cesta 160, SI-2000 Maribor, Slovenia
- CAMTP-Center for Applied Mathematics and Theoretical Physics, University of Maribor, Krekova 2, SI-2000 Maribor, Slovenia
| | - Jafferson K L da Silva
- Departamento de Física, Universidade Federal de Minas Gerais, Caixa Postal 702, CEP 30161-970, Belo Horizonte-MG, Brazil
| |
Collapse
|
16
|
Liu X, Pan Q, Kang Y, He M. Fixation times in evolutionary games with the Moran and Fermi processes. J Theor Biol 2015; 387:214-20. [DOI: 10.1016/j.jtbi.2015.09.016] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2015] [Revised: 09/07/2015] [Accepted: 09/08/2015] [Indexed: 11/29/2022]
|
17
|
Kasthurirathna D, Piraveenan M. Emergence of scale-free characteristics in socio-ecological systems with bounded rationality. Sci Rep 2015; 5:10448. [PMID: 26065713 PMCID: PMC4464151 DOI: 10.1038/srep10448] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2014] [Accepted: 04/14/2015] [Indexed: 11/28/2022] Open
Abstract
Socio-ecological systems are increasingly modelled by games played on complex networks. While the concept of Nash equilibrium assumes perfect rationality, in reality players display heterogeneous bounded rationality. Here we present a topological model of bounded rationality in socio-ecological systems, using the rationality parameter of the Quantal Response Equilibrium. We argue that system rationality could be measured by the average Kullback--Leibler divergence between Nash and Quantal Response Equilibria, and that the convergence towards Nash equilibria on average corresponds to increased system rationality. Using this model, we show that when a randomly connected socio-ecological system is topologically optimised to converge towards Nash equilibria, scale-free and small world features emerge. Therefore, optimising system rationality is an evolutionary reason for the emergence of scale-free and small-world features in socio-ecological systems. Further, we show that in games where multiple equilibria are possible, the correlation between the scale-freeness of the system and the fraction of links with multiple equilibria goes through a rapid transition when the average system rationality increases. Our results explain the influence of the topological structure of socio-ecological systems in shaping their collective cognitive behaviour, and provide an explanation for the prevalence of scale-free and small-world characteristics in such systems.
Collapse
Affiliation(s)
- Dharshana Kasthurirathna
- Centre for Complex Systems Research, Faculty of Engineering and IT, The University of Sydney, NSW 2006, Australia
| | - Mahendra Piraveenan
- Centre for Complex Systems Research, Faculty of Engineering and IT, The University of Sydney, NSW 2006, Australia
| |
Collapse
|
18
|
Abstract
In this paper, I investigate the co-evolution of fast and slow strategy spread and game strategies in populations of spatially distributed agents engaged in a one off evolutionary dilemma game. Agents are characterized by a pair of traits, a game strategy (cooperate or defect) and a binary ‘advertising’ strategy (advertise or don’t advertise). Advertising, which comes at a cost , allows investment into faster propagation of the agents’ traits to adjacent individuals. Importantly, game strategy and advertising strategy are subject to the same evolutionary mechanism. Via analytical reasoning and numerical simulations I demonstrate that a range of advertising costs exists, such that the prevalence of cooperation is significantly enhanced through co-evolution. Linking costly replication to the success of cooperators exposes a novel co-evolutionary mechanism that might contribute towards a better understanding of the origins of cooperation-supporting heterogeneity in agent populations.
Collapse
Affiliation(s)
- Markus Brede
- Department of Electronics and Computer Science, University of Southampton, Southampton, Hampshire, United Kingdom.
| |
Collapse
|
19
|
Li Q, Iqbal A, Perc M, Chen M, Abbott D. Coevolution of quantum and classical strategies on evolving random networks. PLoS One 2013; 8:e68423. [PMID: 23874622 PMCID: PMC3709921 DOI: 10.1371/journal.pone.0068423] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2013] [Accepted: 05/29/2013] [Indexed: 11/23/2022] Open
Abstract
We study the coevolution of quantum and classical strategies on weighted and directed random networks in the realm of the prisoner's dilemma game. During the evolution, agents can break and rewire their links with the aim of maximizing payoffs, and they can also adjust the weights to indicate preferences, either positive or negative, towards their neighbors. The network structure itself is thus also subject to evolution. Importantly, the directionality of links does not affect the accumulation of payoffs nor the strategy transfers, but serves only to designate the owner of each particular link and with it the right to adjust the link as needed. We show that quantum strategies outperform classical strategies, and that the critical temptation to defect at which cooperative behavior can be maintained rises, if the network structure is updated frequently. Punishing neighbors by reducing the weights of their links also plays an important role in maintaining cooperation under adverse conditions. We find that the self-organization of the initially random network structure, driven by the evolutionary competition between quantum and classical strategies, leads to the spontaneous emergence of small average path length and a large clustering coefficient.
Collapse
Affiliation(s)
- Qiang Li
- State Key Laboratory of Power Transmission Equipment and System Security and New Technology, College of Electrical Engineering, Chongqing University, Chongqing, China
- School of Electrical and Electronic Engineering, University of Adelaide, Adelaide, Australia
| | - Azhar Iqbal
- School of Electrical and Electronic Engineering, University of Adelaide, Adelaide, Australia
- Department of Mathematics and Statistics, King Fahd University of Petroleum and Minerals, Dhahran, Kingdom of Saudi Arabia
| | - Matjaž Perc
- Department of Physics, Faculty of Natural Sciences and Mathematics, University of Maribor, Maribor, Slovenia
| | - Minyou Chen
- State Key Laboratory of Power Transmission Equipment and System Security and New Technology, College of Electrical Engineering, Chongqing University, Chongqing, China
| | - Derek Abbott
- School of Electrical and Electronic Engineering, University of Adelaide, Adelaide, Australia
| |
Collapse
|
20
|
Li C, Zhang B, Cressman R, Tao Y. Evolution of cooperation in a heterogeneous graph: fixation probabilities under weak selection. PLoS One 2013; 8:e66560. [PMID: 23818942 PMCID: PMC3688584 DOI: 10.1371/journal.pone.0066560] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2012] [Accepted: 05/09/2013] [Indexed: 11/18/2022] Open
Abstract
It has been shown that natural selection favors cooperation in a homogenous graph if the benefit-to-cost ratio exceeds the degree of the graph. However, most graphs related to interactions in real populations are heterogeneous, in which some individuals have many more neighbors than others. In this paper, we introduce a new state variable to measure the time evolution of cooperation in a heterogeneous graph. Based on the diffusion approximation, we find that the fixation probability of a single cooperator depends crucially on the number of its neighbors. Under weak selection, a cooperator with more neighbors has a larger probability of fixation in the population. We then investigate the average fixation probability of a randomly chosen cooperator. If a cooperator pays a cost for each of its neighbors (the so called fixed cost per game case), natural selection favors cooperation if the benefit-to-cost ratio is larger than the average degree. In contrast, if a cooperator pays a fixed cost and all its neighbors share the benefit (the fixed cost per individual case), cooperation is favored if the benefit-to-cost ratio is larger than the harmonic mean of the degree distribution. Moreover, increasing the graph heterogeneity will reduce the effect of natural selection.
Collapse
Affiliation(s)
- Cong Li
- Key Lab of Animal Ecology and Conservational Biology, Institute of Zoology, Chinese Academy of Sciences, Beijing, P.R. China
| | - Boyu Zhang
- School of Mathematical Sciences, Beijing Normal University, Beijing, P.R. China
- * E-mail: (BZ); (RC)
| | - Ross Cressman
- Department of Mathematics, Wilfrid Laurier University, Waterloo, Ontario, Canada
- * E-mail: (BZ); (RC)
| | - Yi Tao
- Key Lab of Animal Ecology and Conservational Biology, Institute of Zoology, Chinese Academy of Sciences, Beijing, P.R. China
| |
Collapse
|
21
|
Gelimson A, Cremer J, Frey E. Mobility, fitness collection, and the breakdown of cooperation. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2013; 87:042711. [PMID: 23679453 DOI: 10.1103/physreve.87.042711] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/22/2012] [Revised: 02/02/2013] [Indexed: 06/02/2023]
Abstract
The spatial arrangement of individuals is thought to overcome the dilemma of cooperation: When cooperators engage in clusters, they might share the benefit of cooperation while being more protected against noncooperating individuals, who benefit from cooperation but save the cost of cooperation. This is paradigmatically shown by the spatial prisoner's dilemma model. Here, we study this model in one and two spatial dimensions, but explicitly take into account that in biological setups, fitness collection and selection are separated processes occurring mostly on vastly different time scales. This separation is particularly important to understand the impact of mobility on the evolution of cooperation. We find that even small diffusive mobility strongly restricts cooperation since it enables noncooperative individuals to invade cooperative clusters. Thus, in most biological scenarios, where the mobility of competing individuals is an irrefutable fact, the spatial prisoner's dilemma alone cannot explain stable cooperation, but additional mechanisms are necessary for spatial structure to promote the evolution of cooperation. The breakdown of cooperation is analyzed in detail. We confirm the existence of a phase transition, here controlled by mobility and costs, which distinguishes between purely cooperative and noncooperative absorbing states. While in one dimension the model is in the class of the voter model, it belongs to the directed percolation universality class in two dimensions.
Collapse
Affiliation(s)
- Anatolij Gelimson
- Arnold Sommerfeld Center for Theoretical Physics and Center for NanoScience, Department of Physics, Ludwig-Maximilians-Universität München, Theresienstrasse 37, D-80333 München, Germany
| | | | | |
Collapse
|
22
|
Brede M. Short versus long term benefits and the evolution of cooperation in the prisoner's dilemma game. PLoS One 2013; 8:e56016. [PMID: 23409114 PMCID: PMC3569424 DOI: 10.1371/journal.pone.0056016] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2012] [Accepted: 01/09/2013] [Indexed: 11/25/2022] Open
Abstract
In this paper I investigate the evolution of cooperation in the prisoner's dilemma when individuals change their strategies subject to performance evaluation of their neighbours over variable time horizons. In the monochrome setting, in which all agents per default share the same performance evaluation rule, weighing past events strongly dramatically enhances the prevalence of cooperators. For co-evolutionary models, in which evaluation time horizons and strategies can co-evolve, I demonstrate that cooperation naturally associates with long-term evaluation of others while defection is typically paired with very short time horizons. Moreover, considering the continuous spectrum in between enhanced and discounted weights of past performance, cooperation is optimally supported when cooperators neither give enhanced weight to past nor more recent events, but simply average payoffs. Payoff averaging is also found to emerge as the dominant strategy for cooperators in co-evolutionary models, thus proposing a natural route to the evolution of cooperation in viscous populations.
Collapse
Affiliation(s)
- Markus Brede
- Department of Electronics and Computer Science, University of Southampton, Southampton, Hampshire, United Kingdom
- * E-mail:
| |
Collapse
|
23
|
Adaptive and bounded investment returns promote cooperation in spatial public goods games. PLoS One 2012; 7:e36895. [PMID: 22615836 PMCID: PMC3353963 DOI: 10.1371/journal.pone.0036895] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2012] [Accepted: 04/09/2012] [Indexed: 11/26/2022] Open
Abstract
The public goods game is one of the most famous models for studying the evolution of cooperation in sizable groups. The multiplication factor in this game can characterize the investment return from the public good, which may be variable depending on the interactive environment in realistic situations. Instead of using the same universal value, here we consider that the multiplication factor in each group is updated based on the differences between the local and global interactive environments in the spatial public goods game, but meanwhile limited to within a certain range. We find that the adaptive and bounded investment returns can significantly promote cooperation. In particular, full cooperation can be achieved for high feedback strength when appropriate limitation is set for the investment return. Also, we show that the fraction of cooperators in the whole population can become larger if the lower and upper limits of the multiplication factor are increased. Furthermore, in comparison to the traditionally spatial public goods game where the multiplication factor in each group is identical and fixed, we find that cooperation can be better promoted if the multiplication factor is constrained to adjust between one and the group size in our model. Our results highlight the importance of the locally adaptive and bounded investment returns for the emergence and dominance of cooperative behavior in structured populations.
Collapse
|
24
|
Chen X, Schick A, Doebeli M, Blachford A, Wang L. Reputation-based conditional interaction supports cooperation in well-mixed prisoner's dilemmas. PLoS One 2012; 7:e36260. [PMID: 22615761 PMCID: PMC3355160 DOI: 10.1371/journal.pone.0036260] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2012] [Accepted: 04/04/2012] [Indexed: 11/18/2022] Open
Abstract
In the well-mixed prisoner's dilemma game, individuals are typically assumed to have no choice about whether to interact with other individuals in the population. In this paper, we instead consider reputation-based conditional interaction and its consequences for the evolution of cooperation. Each individual has a tolerance range, and only interacts with other individuals whose reputation lies within its tolerance range in a chosen sample of the population. Reputation contains information about the number of interaction partners an individual has just cooperated with. We find that the introduction of conditional interaction promotes cooperation in well-mixed populations, and there exist moderate tolerance ranges for which this effect is maximized. For a given tolerance range, there is a critical cost-to-benefit ratio below which cooperation can be promoted. Interestingly, we find that if cooperation evolves, different cooperators' interaction clusters are typically maintained in the population, each around a different reputation level. We further investigate some properties of these cooperators' clusters. Moreover, we examine the effects of the sample number on the evolution of cooperation. Our results highlight the importance of the detailed consideration of modes of interaction for the evolution of cooperation in well-mixed populations.
Collapse
Affiliation(s)
- Xiaojie Chen
- Evolution and Ecology Program, International Institute for Applied Systems Analysis, Laxenburg, Austria.
| | | | | | | | | |
Collapse
|
25
|
Win-stay-lose-learn promotes cooperation in the spatial prisoner's dilemma game. PLoS One 2012; 7:e30689. [PMID: 22363470 PMCID: PMC3281853 DOI: 10.1371/journal.pone.0030689] [Citation(s) in RCA: 54] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2011] [Accepted: 12/21/2011] [Indexed: 11/19/2022] Open
Abstract
Holding on to one's strategy is natural and common if the later warrants success and satisfaction. This goes against widespread simulation practices of evolutionary games, where players frequently consider changing their strategy even though their payoffs may be marginally different than those of the other players. Inspired by this observation, we introduce an aspiration-based win-stay-lose-learn strategy updating rule into the spatial prisoner's dilemma game. The rule is simple and intuitive, foreseeing strategy changes only by dissatisfied players, who then attempt to adopt the strategy of one of their nearest neighbors, while the strategies of satisfied players are not subject to change. We find that the proposed win-stay-lose-learn rule promotes the evolution of cooperation, and it does so very robustly and independently of the initial conditions. In fact, we show that even a minute initial fraction of cooperators may be sufficient to eventually secure a highly cooperative final state. In addition to extensive simulation results that support our conclusions, we also present results obtained by means of the pair approximation of the studied game. Our findings continue the success story of related win-stay strategy updating rules, and by doing so reveal new ways of resolving the prisoner's dilemma.
Collapse
|
26
|
Evolution of interactions and cooperation in the spatial prisoner's dilemma game. PLoS One 2011; 6:e26724. [PMID: 22066006 PMCID: PMC3204981 DOI: 10.1371/journal.pone.0026724] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2011] [Accepted: 10/02/2011] [Indexed: 11/19/2022] Open
Abstract
We study the evolution of cooperation in the spatial prisoner's dilemma game where players are allowed to establish new interactions with others. By employing a simple coevolutionary rule entailing only two crucial parameters, we find that different selection criteria for the new interaction partners as well as their number vitally affect the outcome of the game. The resolution of the social dilemma is most probable if the selection favors more successful players and if their maximally attainable number is restricted. While the preferential selection of the best players promotes cooperation irrespective of game parametrization, the optimal number of new interactions depends somewhat on the temptation to defect. Our findings reveal that the "making of new friends" may be an important activity for the successful evolution of cooperation, but also that partners must be selected carefully and their number limited.
Collapse
|
27
|
Rong Z, Yang HX, Wang WX. Feedback reciprocity mechanism promotes the cooperation of highly clustered scale-free networks. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2010; 82:047101. [PMID: 21230418 DOI: 10.1103/physreve.82.047101] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/29/2009] [Revised: 05/27/2010] [Indexed: 05/30/2023]
Abstract
We study how the clustering coefficient influences the evolution of cooperation in scale-free public goods games. In games played by groups of individuals, triangle loops provide stronger support for mutual cooperation to resist invasion of selfish behavior than that in the absence of such loops, so that diffusion of cooperative behavior is relatively promoted. The feedback reciprocity mechanism of triangle plays a key role in facilitating cooperation in high clustered networks.
Collapse
Affiliation(s)
- Zhihai Rong
- Department of Automation, Donghua University, 201620 Shanghai, China.
| | | | | |
Collapse
|
28
|
Wang Z, Perc M. Aspiring to the fittest and promotion of cooperation in the prisoner's dilemma game. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2010; 82:021115. [PMID: 20866783 DOI: 10.1103/physreve.82.021115] [Citation(s) in RCA: 47] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2010] [Indexed: 05/29/2023]
Abstract
Strategy changes are an essential part of evolutionary games. Here, we introduce a simple rule that, depending on the value of a single parameter w , influences the selection of players that are considered as potential sources of the new strategy. For positive w players with high payoffs will be considered more likely, while for negative w the opposite holds. Setting w equal to zero returns the frequently adopted random selection of the opponent. We find that increasing the probability of adopting the strategy from the fittest player within reach, i.e., setting w positive, promotes the evolution of cooperation. The robustness of this observation is tested against different levels of uncertainty in the strategy adoption process and for different interaction networks. Since the evolution to widespread defection is tightly associated with cooperators having a lower fitness than defectors, the fact that positive values of w facilitate cooperation is quite surprising. We show that the results can be explained by means of a negative feedback effect that increases the vulnerability of defectors although initially increasing their survivability. Moreover, we demonstrate that the introduction of w effectively alters the interaction network and thus also the impact of uncertainty by strategy adoptions on the evolution of cooperation.
Collapse
|