Cooperation in spatial prisoner's dilemma with two types of players for increasing number of neighbors

Dynamic aspiration based on Win-Stay-Lose-Learn rule in spatial prisoner's dilemma game

Prisoner’s dilemma game is the most commonly used model of spatial evolutionary game which is considered as a paradigm to portray competition among selfish individuals. In recent years, Win-Stay-Lose-Learn, a strategy updating rule base on aspiration, has been proved to be an effective model to promote cooperation in spatial prisoner’s dilemma game, which leads aspiration to receive lots of attention. In this paper, according to Expected Value Theory and Achievement Motivation Theory, we propose a dynamic aspiration model based on Win-Stay-Lose-Learn rule in which individual’s aspiration is inspired by its payoff. It is found that dynamic aspiration has a significant impact on the evolution process, and different initial aspirations lead to different results, which are called Stable Coexistence under Low Aspiration, Dependent Coexistence under Moderate aspiration and Defection Explosion under High Aspiration respectively. Furthermore, a deep analysis is performed on the local structures which cause defectors’ re-expansion, the concept of END- and EXP-periods are used to justify the mechanism of network reciprocity in view of time-evolution, typical feature nodes for defectors’ re-expansion called Infectors, Infected nodes and High-risk cooperators respectively are found. Compared to fixed aspiration model, dynamic aspiration introduces a more satisfactory explanation on population evolution laws and can promote deeper comprehension for the principle of prisoner’s dilemma.

Cooperation on Interdependent Networks by Means of Migration and Stochastic Imitation

Evolutionary game theory in the realm of network science appeals to a lot of research communities, as it constitutes a popular theoretical framework for studying the evolution of cooperation in social dilemmas. Recent research has shown that cooperation is markedly more resistant in interdependent networks, where traditional network reciprocity can be further enhanced due to various forms of interdependence between different network layers. However, the role of mobility in interdependent networks is yet to gain its well-deserved attention. Here we consider an interdependent network model, where individuals in each layer follow different evolutionary games, and where each player is considered as a mobile agent that can move locally inside its own layer to improve its fitness. Probabilistically, we also consider an imitation possibility from a neighbor on the other layer. We show that, by considering migration and stochastic imitation, further fascinating gateways to cooperation on interdependent networks can be observed. Notably, cooperation can be promoted on both layers, even if cooperation without interdependence would be improbable on one of the layers due to adverse conditions. Our results provide a rationale for engineering better social systems at the interface of networks and human decision making under testing dilemmas.

Cooperation in Microbial Populations: Theory and Experimental Model Systems

Cooperative behavior, the costly provision of benefits to others, is common across all domains of life. This review article discusses cooperative behavior in the microbial world, mediated by the exchange of extracellular products called public goods. We focus on model species for which the production of a public good and the related growth disadvantage for the producing cells are well described. To unveil the biological and ecological factors promoting the emergence and stability of cooperative traits we take an interdisciplinary perspective and review insights gained from both mathematical models and well-controlled experimental model systems. Ecologically, we include crucial aspects of the microbial life cycle into our analysis and particularly consider population structures where ensembles of local communities (subpopulations) continuously emerge, grow, and disappear again. Biologically, we explicitly consider the synthesis and regulation of public good production. The discussion of the theoretical approaches includes general evolutionary concepts, population dynamics, and evolutionary game theory. As a specific but generic biological example, we consider populations of Pseudomonas putida and its regulation and use of pyoverdines, iron scavenging molecules, as public goods. The review closes with an overview on cooperation in spatially extended systems and also provides a critical assessment of the insights gained from the experimental and theoretical studies discussed. Current challenges and important new research opportunities are discussed, including the biochemical regulation of public goods, more realistic ecological scenarios resembling native environments, cell-to-cell signaling, and multispecies communities.

Heterogeneous cooperative leadership structure emerging from random regular graphs

This paper investigates the evolution of cooperation and the emergence of hierarchical leadership structure in random regular graphs. It is found that there exist different learning patterns between cooperators and defectors, and cooperators are able to attract more followers and hence more likely to become leaders. Hence, the heterogeneous distributions of reputation and leadership can emerge from homogeneous random graphs. The important directed game-learning skeleton is then studied, revealing some important structural properties, such as the heavy-tailed degree distribution and the positive in-in degree correlation.

The effect of asymmetric reproductive ability on the evolution of cooperation on interdependent networks

In this paper, we consider an asymmetric reproductive ability on interdependent networks and investigate how this setting affects the evolution of cooperation. In detail, players decide to update their strategies at each step on main network (network B), while for sub network (network A), players update their strategies with a fixed probability p. Obviously, the system restores the traditional case when p = 1, where cooperation can survive by interdependent network reciprocity. And our asymmetric set-up comes into play when p < 1. Numerical simulation results show that our asymmetric coupling will hinder the overall cooperation level for small p. In detail, the introduction of asymmetric reproductive ability urges the formation of symmetry breaking and further weakens the positive impact by location synchronous effect. And the root cause is entirely distinct situation of utility differences on two networks. These observations further demonstrate a class of phenomena on interdependent networks that it would have catastrophic consequences on one network even if a unrelated change only occurs seemingly on another network.

Stochastic dynamics in the fitness-based process which can be on behalf of the standard Moran, local and Wright-Fisher processes

In this paper, we proposed a frequency dependent fitness-based process, which is an extension of both the standard Moran process and the Wright-Fisher process. Some individuals are selected into a parent's pool and reproduce. Then the offspring is selected to replace individuals in the entire parent generation. We explored the influence of the size of parent pool and the number of offspring on a single cooperator's fixation. The less offspring leads to higher fixation probability of s single cooperator. Meanwhile, the fixation probability decreases with the growth of the local level. In other words, the direction of the number of offspring's impact on fixation probability is in accordance with that of the local level's impact. The less offspring in one generation or the smaller parent's pool contributes to promoting cooperation with the fitness-based updating rule.

Cyclic dominance emerges from the evolution of two inter-linked cooperative behaviours in the social amoeba

Evolution of cooperation has been one of the most important problems in sociobiology, and many researchers have revealed mechanisms that can facilitate the evolution of cooperation. However, most studies deal only with one cooperative behaviour, even though some organisms perform two or more cooperative behaviours. The social amoeba Dictyostelium discoideum performs two cooperative behaviours in starvation: fruiting body formation and macrocyst formation. Here, we constructed a model that couples these two behaviours, and we found that the two behaviours are maintained because of the emergence of cyclic dominance, although cooperation cannot evolve if only either of the two behaviours is performed. The common chemoattractant cyclic adenosine 3',5'-monophosphate (cAMP) is used in both fruiting body formation and macrocyst formation, providing a biological context for this coupling. Cyclic dominance emerges regardless of the existence of mating types or spatial structure in the model. In addition, cooperation can re-emerge in the population even after it goes extinct. These results indicate that the two cooperative behaviours of the social amoeba are maintained because of the common chemical signal that underlies both fruiting body formation and macrocyst formation. We demonstrate the importance of coupling multiple games when the underlying behaviours are associated with one another.

Aspiration-based coevolution of link weight promotes cooperation in the spatial prisoner's dilemma game

In this article, we propose an aspiration-based coevolution of link weight, and explore how this set-up affects the evolution of cooperation in the spatial prisoner's dilemma game. In particular, an individual will increase the weight of its link to its neighbours only if the payoff received via this interaction exceeds a pre-defined aspiration. Conversely, if the received payoff is below this aspiration, the link weight with the corresponding neighbour will decrease. Our results show that an appropriate aspiration level leads to a high-cooperation plateau, whereas too high or too low aspiration will impede the evolution of cooperation. We explain these findings with a comprehensive analysis of transition points and with a systematic analysis of typical configuration patterns. The presented results provide further theoretical insights with regards to the impact of different aspiration levels on cooperation in human societies.

Promotion of cooperation in evolutionary game dynamics with local information

In this paper, we propose a strategy-updating rule driven by local information, which is called Local process. Unlike the standard Moran process, the Local process does not require global information about the strategic environment. By analyzing the dynamical behavior of the system, we explore how the local information influences the fixation of cooperation in two-player evolutionary games. Under weak selection, the decreasing local information leads to an increase of the fixation probability when natural selection does not favor cooperation replacing defection. In the limit of sufficiently large selection, the analytical results indicate that the fixation probability increases with the decrease of the local information, irrespective of the evolutionary games. Furthermore, for the dominance of defection games under weak selection and for coexistence games, the decreasing of local information will lead to a speedup of a single cooperator taking over the population. Overall, to some extent, the local information is conducive to promoting the cooperation.

Coevolution of Vertex Weights Resolves Social Dilemma in Spatial Networks

In realistic social system, the role or influence of each individual varies and adaptively changes in time in the population. Inspired by this fact, we thus consider a new coevolution setup of game strategy and vertex weight on a square lattice. In detail, we model the structured population on a square lattice, on which the role or influence of each individual is depicted by vertex weight, and the prisoner’s dilemma game has been applied to describe the social dilemma of pairwise interactions of players. Through numerical simulation, we conclude that our coevolution setup can promote the evolution of cooperation effectively. Especially, there exists a moderate value of δ for each ε that can warrant an optimal resolution of social dilemma. For a further understanding of these results, we find that intermediate value of δ enables the strongest heterogeneous distribution of vertex weight. We hope our coevolution setup of vertex weight will provide new insight for the future research.

Aspiration promotes cooperation in the prisoner's dilemma game with the imitation rule

A model of stochastic evolutionary game dynamics with finite population of size N+M was built. Among these individuals, N individuals update strategies with aspiration updating, while the other M individuals update strategies with imitation updating. In the proposed model, we obtain the expression of the mean fraction of cooperators and analyze some concrete cases. Compared with the standard imitation dynamics, there is always a positive probability to support the formation of cooperation in the system with the aspiration and imitation rules. Moreover, the numerical results indicate that more aspiration-driven individuals lead to a higher mean fraction of imitation-driven cooperators, which means the invasion of the aspiration-driven individuals is conducive to promoting the cooperation of the imitation-driven individuals.

Heterogeneous Coupling between Interdependent Lattices Promotes the Cooperation in the Prisoner's Dilemma Game

In the research realm of game theory, interdependent networks have extended the content of spatial reciprocity, which needs the suitable coupling between networks. However, thus far, the vast majority of existing works just assume that the coupling strength between networks is symmetric. This hypothesis, to some extent, seems inconsistent with the ubiquitous observation of heterogeneity. Here, we study how the heterogeneous coupling strength, which characterizes the interdependency of utility between corresponding players of both networks, affects the evolution of cooperation in the prisoner's dilemma game with two types of coupling schemes (symmetric and asymmetric ones). Compared with the traditional case, we show that heterogeneous coupling greatly promotes the collective cooperation. The symmetric scheme seems much better than the asymmetric case. Moreover, the role of varying amplitude of coupling strength is also studied on these two interdependent ways. Current findings are helpful for us to understand the evolution of cooperation within many real-world systems, in particular for the interconnected and interrelated systems.

Universal scaling for the dilemma strength in evolutionary games

Why would natural selection favor the prevalence of cooperation within the groups of selfish individuals? A fruitful framework to address this question is evolutionary game theory, the essence of which is captured in the so-called social dilemmas. Such dilemmas have sparked the development of a variety of mathematical approaches to assess the conditions under which cooperation evolves. Furthermore, borrowing from statistical physics and network science, the research of the evolutionary game dynamics has been enriched with phenomena such as pattern formation, equilibrium selection, and self-organization. Numerous advances in understanding the evolution of cooperative behavior over the last few decades have recently been distilled into five reciprocity mechanisms: direct reciprocity, indirect reciprocity, kin selection, group selection, and network reciprocity. However, when social viscosity is introduced into a population via any of the reciprocity mechanisms, the existing scaling parameters for the dilemma strength do not yield a unique answer as to how the evolutionary dynamics should unfold. Motivated by this problem, we review the developments that led to the present state of affairs, highlight the accompanying pitfalls, and propose new universal scaling parameters for the dilemma strength. We prove universality by showing that the conditions for an ESS and the expressions for the internal equilibriums in an infinite, well-mixed population subjected to any of the five reciprocity mechanisms depend only on the new scaling parameters. A similar result is shown to hold for the fixation probability of the different strategies in a finite, well-mixed population. Furthermore, by means of numerical simulations, the same scaling parameters are shown to be effective even if the evolution of cooperation is considered on the spatial networks (with the exception of highly heterogeneous setups). We close the discussion by suggesting promising directions for future research including (i) how to handle the dilemma strength in the context of co-evolution and (ii) where to seek opportunities for applying the game theoretical approach with meaningful impact.

Cooperation in networks where the learning environment differs from the interaction environment

We study the evolution of cooperation in a structured population, combining insights from evolutionary game theory and the study of interaction networks. In earlier studies it has been shown that cooperation is difficult to achieve in homogeneous networks, but that cooperation can get established relatively easily when individuals differ largely concerning the number of their interaction partners, such as in scale-free networks. Most of these studies do, however, assume that individuals change their behaviour in response to information they receive on the payoffs of their interaction partners. In real-world situations, subjects do not only learn from their interaction partners, but also from other individuals (e.g. teachers, parents, or friends). Here we investigate the implications of such incongruences between the ‘interaction network’ and the ‘learning network’ for the evolution of cooperation in two paradigm examples, the Prisoner's Dilemma game (PDG) and the Snowdrift game (SDG). Individual-based simulations and an analysis based on pair approximation both reveal that cooperation will be severely inhibited if the learning network is very different from the interaction network. If the two networks overlap, however, cooperation can get established even in case of considerable incongruence between the networks. The simulations confirm that cooperation gets established much more easily if the interaction network is scale-free rather than random-regular. The structure of the learning network has a similar but much weaker effect. Overall we conclude that the distinction between interaction and learning networks deserves more attention since incongruences between these networks can strongly affect both the course and outcome of the evolution of cooperation.

Social dilemma alleviated by sharing the gains with immediate neighbors

We study the evolution of cooperation in the evolutionary spatial prisoner's dilemma game (PDG) and snowdrift game (SG), within which a fraction α of the payoffs of each player gained from direct game interactions is shared equally by the immediate neighbors. The magnitude of the parameter α therefore characterizes the degree of the relatedness among the neighboring players. By means of extensive Monte Carlo simulations as well as an extended mean-field approximation method, we trace the frequency of cooperation in the stationary state. We find that plugging into relatedness can significantly promote the evolution of cooperation in the context of both studied games. Unexpectedly, cooperation can be more readily established in the spatial PDG than that in the spatial SG, given that the degree of relatedness and the cost-to-benefit ratio of mutual cooperation are properly formulated. The relevance of our model with the stakeholder theory is also briefly discussed.

Mobility, fitness collection, and the breakdown of cooperation

The spatial arrangement of individuals is thought to overcome the dilemma of cooperation: When cooperators engage in clusters, they might share the benefit of cooperation while being more protected against noncooperating individuals, who benefit from cooperation but save the cost of cooperation. This is paradigmatically shown by the spatial prisoner's dilemma model. Here, we study this model in one and two spatial dimensions, but explicitly take into account that in biological setups, fitness collection and selection are separated processes occurring mostly on vastly different time scales. This separation is particularly important to understand the impact of mobility on the evolution of cooperation. We find that even small diffusive mobility strongly restricts cooperation since it enables noncooperative individuals to invade cooperative clusters. Thus, in most biological scenarios, where the mobility of competing individuals is an irrefutable fact, the spatial prisoner's dilemma alone cannot explain stable cooperation, but additional mechanisms are necessary for spatial structure to promote the evolution of cooperation. The breakdown of cooperation is analyzed in detail. We confirm the existence of a phase transition, here controlled by mobility and costs, which distinguishes between purely cooperative and noncooperative absorbing states. While in one dimension the model is in the class of the voter model, it belongs to the directed percolation universality class in two dimensions.

Evolutionary dynamics of group interactions on structured populations: a review

Interactions among living organisms, from bacteria colonies to human societies, are inherently more complex than interactions among particles and non-living matter. Group interactions are a particularly important and widespread class, representative of which is the public goods game. In addition, methods of statistical physics have proved valuable for studying pattern formation, equilibrium selection and self-organization in evolutionary games. Here, we review recent advances in the study of evolutionary dynamics of group interactions on top of structured populations, including lattices, complex networks and coevolutionary models. We also compare these results with those obtained on well-mixed populations. The review particularly highlights that the study of the dynamics of group interactions, like several other important equilibrium and non-equilibrium dynamical processes in biological, economical and social sciences, benefits from the synergy between statistical physics, network science and evolutionary game theory.

Optimizing cooperation on complex networks in the presence of failure

Cooperation has been recognized as a fundamental driving force in many natural, social, and economic systems. We investigate whether, given a complex-networked system in which agents (nodes) interact with one another according to the rules of evolutionary games and are subject to failure or death, cooperation can prevail and be optimized. We articulate a control scheme to maximize cooperation by introducing a time tolerance, a time duration that sustains an agent even if its payoff falls below a threshold. Strikingly, we find that a significant cooperation cluster can emerge when the time tolerance is approximately uniformly distributed over the network. A heuristic theory is derived to understand the optimization mechanism, which emphasizes the role played by medium-degree nodes. Implications for policy making to prevent or mitigate large-scale cascading breakdown are pointed out.

Conditional imitation might promote cooperation under high temptations to defect

In this paper we introduce a conditional imitation rule into an evolutionary game, in which the imitation probabilities of individuals are determined by a function of payoff difference and two crucial parameters μ and σ. The parameter μ characterizes the most adequate goal for individuals and the parameter σ characterizes the tolerance of individuals. By using the pair approximation method and numerical simulations, we find an anomalous cooperation enhancement in which the cooperation level shows a nonmonotonic variation with the increase of temptation. The parameter μ affects the regime of the payoff parameter which supports the anomalous cooperation enhancement, whereas the parameter σ plays a decisive role on the appearance of the nonmonotonic variation of the cooperation level. Furthermore, to give explicit implications for the parameters μ and σ we present an alterative form of the conditional imitation rule based on the benefit and the cost incurred to individuals during strategy updates. In this way, we also provide a phenomenological interpretation for the nonmonotonic behavior of cooperation with the increase of temptation. The results give a clue that a higher cooperation level could be obtained under adverse environments for cooperation by applying the conditional imitation rule, which is possible to be manipulated in real life. More generally, the results in this work might point out an efficient way to maintain cooperation in the risky environments to cooperators.

Network reciprocity by coexisting learning and teaching strategies

We propose a network reciprocity model in which an agent probabilistically adopts learning or teaching strategies. In the learning adaptation mechanism, an agent may copy a neighbor's strategy through Fermi pairwise comparison. The teaching adaptation mechanism involves an agent imposing its strategy on a neighbor. Our simulations reveal that the reciprocity is significantly affected by the frequency with which learning and teaching agents coexist in a network and by the structure of the network itself.

From local to global dilemmas in social networks

Social networks affect in such a fundamental way the dynamics of the population they support that the global, population-wide behavior that one observes often bears no relation to the individual processes it stems from. Up to now, linking the global networked dynamics to such individual mechanisms has remained elusive. Here we study the evolution of cooperation in networked populations and let individuals interact via a 2-person Prisoner's Dilemma – a characteristic defection dominant social dilemma of cooperation. We show how homogeneous networks transform a Prisoner's Dilemma into a population-wide evolutionary dynamics that promotes the coexistence between cooperators and defectors, while heterogeneous networks promote their coordination. To this end, we define a dynamic variable that allows us to track the self-organization of cooperators when co-evolving with defectors in networked populations. Using the same variable, we show how the global dynamics — and effective dilemma — co-evolves with the motifs of cooperators in the population, the overall emergence of cooperation depending sensitively on this co-evolution.

Win-stay-lose-learn promotes cooperation in the spatial prisoner's dilemma game

Holding on to one's strategy is natural and common if the later warrants success and satisfaction. This goes against widespread simulation practices of evolutionary games, where players frequently consider changing their strategy even though their payoffs may be marginally different than those of the other players. Inspired by this observation, we introduce an aspiration-based win-stay-lose-learn strategy updating rule into the spatial prisoner's dilemma game. The rule is simple and intuitive, foreseeing strategy changes only by dissatisfied players, who then attempt to adopt the strategy of one of their nearest neighbors, while the strategies of satisfied players are not subject to change. We find that the proposed win-stay-lose-learn rule promotes the evolution of cooperation, and it does so very robustly and independently of the initial conditions. In fact, we show that even a minute initial fraction of cooperators may be sufficient to eventually secure a highly cooperative final state. In addition to extensive simulation results that support our conclusions, we also present results obtained by means of the pair approximation of the studied game. Our findings continue the success story of related win-stay strategy updating rules, and by doing so reveal new ways of resolving the prisoner's dilemma.

Cooperation and age structure in spatial games

We study the evolution of cooperation in evolutionary spatial games when the payoff correlates with the increasing age of players (the level of correlation is set through a single parameter, α). The demographic heterogeneous age distribution, directly affecting the outcome of the game, is thus shown to be responsible for enhancing the cooperative behavior in the population. In particular, moderate values of α allow cooperators not only to survive but to outcompete defectors, even when the temptation to defect is large and the ageless, standard α=0 model does not sustain cooperation. The interplay between age structure and noise is also considered, and we obtain the conditions for optimal levels of cooperation.

Inertia in strategy switching transforms the strategy evolution

A recent experimental study [Traulsen et al., Proc. Natl. Acad. Sci. 107, 2962 (2010)] shows that human strategy updating involves both direct payoff comparison and the cost of switching strategy, which is equivalent to inertia. However, it remains largely unclear how such a predisposed inertia affects 2 × 2 games in a well-mixed population of finite size. To address this issue, the "inertia bonus" (strategy switching cost) is added to the learner payoff in the Fermi process. We find how inertia quantitatively shapes the stationary distribution and that stochastic stability under inertia exhibits three regimes, with each covering seven regions in the plane spanned by two inertia parameters. We also obtain the extended "1/3" rule with inertia and the speed criterion with inertia; these two findings hold for a population above two. We illustrate the above results in the framework of the Prisoner's Dilemma game. As inertia varies, two intriguing stationary distributions emerge: the probability of coexistence state is maximized, or those of two full states are simultaneously peaked. Our results may provide useful insights into how the inertia of changing status quo acts on the strategy evolution and, in particular, the evolution of cooperation.

Group-size effects on the evolution of cooperation in the spatial public goods game

We study the evolution of cooperation in public goods games on the square lattice, focusing on the effects that are brought about by different sizes of groups where individuals collect their payoffs and search for potential strategy donors. We find that increasing the group size does not necessarily lead to mean-field behavior, as is traditionally observed for games governed by pairwise interactions, but rather that public cooperation may be additionally promoted by means of enhanced spatial reciprocity that sets in for very large groups. Our results highlight that the promotion of cooperation due to spatial interactions is not rooted solely in having restricted connections among players, but also in individuals having the opportunity to collect payoffs separately from their direct opponents. Moreover, in large groups the presence of a small number of defectors is bearable, which makes the mixed-phase region expand with increasing group size. Having a chance of exploiting distant players, however, offers defectors a different way to break the phalanx of cooperators and even to resurrect from small numbers to eventually completely invade the population.

Cascading failures and the emergence of cooperation in evolutionary-game based models of social and economical networks

We study catastrophic behaviors in large networked systems in the paradigm of evolutionary games by incorporating a realistic "death" or "bankruptcy" mechanism. We find that a cascading bankruptcy process can arise when defection strategies exist and individuals are vulnerable to deficit. Strikingly, we observe that, after the catastrophic cascading process terminates, cooperators are the sole survivors, regardless of the game types and of the connection patterns among individuals as determined by the topology of the underlying network. It is necessary that individuals cooperate with each other to survive the catastrophic failures. Cooperation thus becomes the optimal strategy and absolutely outperforms defection in the game evolution with respect to the "death" mechanism. Our results can be useful for understanding large-scale catastrophe in real-world systems and in particular, they may yield insights into significant social and economical phenomena such as large-scale failures of financial institutions and corporations during an economic recession.

Resolution of the stochastic strategy spatial prisoner's dilemma by means of particle swarm optimization

We study the evolution of cooperation among selfish individuals in the stochastic strategy spatial prisoner's dilemma game. We equip players with the particle swarm optimization technique, and find that it may lead to highly cooperative states even if the temptations to defect are strong. The concept of particle swarm optimization was originally introduced within a simple model of social dynamics that can describe the formation of a swarm, i.e., analogous to a swarm of bees searching for a food source. Essentially, particle swarm optimization foresees changes in the velocity profile of each player, such that the best locations are targeted and eventually occupied. In our case, each player keeps track of the highest payoff attained within a local topological neighborhood and its individual highest payoff. Thus, players make use of their own memory that keeps score of the most profitable strategy in previous actions, as well as use of the knowledge gained by the swarm as a whole, to find the best available strategy for themselves and the society. Following extensive simulations of this setup, we find a significant increase in the level of cooperation for a wide range of parameters, and also a full resolution of the prisoner's dilemma. We also demonstrate extreme efficiency of the optimization algorithm when dealing with environments that strongly favor the proliferation of defection, which in turn suggests that swarming could be an important phenomenon by means of which cooperation can be sustained even under highly unfavorable conditions. We thus present an alternative way of understanding the evolution of cooperative behavior and its ubiquitous presence in nature, and we hope that this study will be inspirational for future efforts aimed in this direction.

Crossover between structured and well-mixed networks in an evolutionary prisoner's dilemma game

In a spatial evolutionary prisoner's dilemma game (PDG), individuals interact with their neighbors and update their strategies according to some rules. As is well known, cooperators are destined to become extinct in a well-mixed population, whereas they could emerge and be sustained on a structured network. In this work, we introduce a simple model to investigate the crossover between a structured network and a well-mixed one in an evolutionary PDG. In the model, each link j is designated a rewiring parameter τ(j), which defines the time interval between two successive rewiring events for link j. By adjusting the rewiring parameter τ (the mean time interval for any link in the network), we could change a structured network into a well-mixed one. For the link rewiring events, three situations are considered: one synchronous situation and two asynchronous situations. Simulation results show that there are three regimes of τ: large τ where the density of cooperators ρ(c) rises to ρ(c,∞) (the value of ρ(c) for the case without link rewiring), small τ where the mean-field description for a well-mixed network is applicable, and moderate τ where the crossover between a structured network and a well-mixed one happens.

Coveting thy neighbors fitness as a means to resolve social dilemmas

In spatial evolutionary games the fitness of each individual is traditionally determined by the payoffs it obtains upon playing the game with its neighbors. Since defection yields the highest individual benefits, the outlook for cooperators is gloomy. While network reciprocity promotes collaborative efforts, chances of averting the impending social decline are slim if the temptation to defect is strong. It is, therefore, of interest to identify viable mechanisms that provide additional support for the evolution of cooperation. Inspired by the fact that the environment may be just as important as inheritance for individual development, we introduce a simple switch that allows a player to either keep its original payoff or use the average payoff of all its neighbors. Depending on which payoff is higher, the influence of either option can be tuned by means of a single parameter. We show that, in general, taking into account the environment promotes cooperation. Yet coveting the fitness of one's neighbors too strongly is not optimal. In fact, cooperation thrives best only if the influence of payoffs obtained in the traditional way is equal to that of the average payoff of the neighborhood. We present results for the prisoner's dilemma and the snowdrift game, for different levels of uncertainty governing the strategy adoption process, and for different neighborhood sizes. Our approach outlines a viable route to increased levels of cooperative behavior in structured populations, but one that requires a thoughtful implementation.

Aspiring to the fittest and promotion of cooperation in the prisoner's dilemma game

Strategy changes are an essential part of evolutionary games. Here, we introduce a simple rule that, depending on the value of a single parameter w , influences the selection of players that are considered as potential sources of the new strategy. For positive w players with high payoffs will be considered more likely, while for negative w the opposite holds. Setting w equal to zero returns the frequently adopted random selection of the opponent. We find that increasing the probability of adopting the strategy from the fittest player within reach, i.e., setting w positive, promotes the evolution of cooperation. The robustness of this observation is tested against different levels of uncertainty in the strategy adoption process and for different interaction networks. Since the evolution to widespread defection is tightly associated with cooperators having a lower fitness than defectors, the fact that positive values of w facilitate cooperation is quite surprising. We show that the results can be explained by means of a negative feedback effect that increases the vulnerability of defectors although initially increasing their survivability. Moreover, we demonstrate that the introduction of w effectively alters the interaction network and thus also the impact of uncertainty by strategy adoptions on the evolution of cooperation.

Emergence of cooperation through coevolving time scale in spatial prisoner's dilemma

We study evolutionary prisoner's dilemma game by considering adaptive strategy-selection time scale among individuals according to a "win-slower, lose-faster" rule: if an individual successfully resists the invasion of an opponent, she is prone to hold her strategy for longer time through decreasing her strategy-selection time scale; otherwise, she increases the time scale because of losing. We find that the greater the losers increase their strategy-selection time scales, the better for cooperation. Interestingly, optimal cooperation can be induced by proper adaptive rate in the strategy-selection time scale. Our results may have potential implications in the design of consensus protocol in multiagent systems.

Effective usage of credit records promotes cooperation on weighted networks

The cooperative behaviors of players on weighted networks are investigated by incorporation of trust mechanisms into a well-accepted game model, i.e., the networked prisoner's dilemma game, afterwards some weight-updating schemes are designed according to the credit records. Despite the differences in network topologies and strategy updating protocols, a simple yet significant principle surfaces that, to promote the emergence of cooperation over abundant weighted networks, only the latest credit record of partners is required to be taken into consideration, whereas incorporating more previous records may even deteriorate the cooperation performance. To support such an appealing principle, we have investigated more deeply into the role of credit records so as to give a detailed explanation underlying it. The virtue of this work lies in providing insights into the effective usage of the currently available credit records.

Calculating evolutionary dynamics in structured populations

Evolution is shaping the world around us. At the core of every evolutionary process is a population of reproducing individuals. The outcome of an evolutionary process depends on population structure. Here we provide a general formula for calculating evolutionary dynamics in a wide class of structured populations. This class includes the recently introduced "games in phenotype space" and "evolutionary set theory." There can be local interactions for determining the relative fitness of individuals, but we require global updating, which means all individuals compete uniformly for reproduction. We study the competition of two strategies in the context of an evolutionary game and determine which strategy is favored in the limit of weak selection. We derive an intuitive formula for the structure coefficient, sigma, and provide a method for efficient numerical calculation.

Reducing the heterogeneity of payoffs: an effective way to promote cooperation in the prisoner's dilemma game

In this paper, the accumulated payoff of each agent is regulated so as to reduce the heterogeneity of the distribution of all such payoffs. It is found that there exists an optimal regulation strength at which cooperation in the prisoner's dilemma game is optimally promoted. If the heterogeneity is regulated to be either too weak or too strong, the promotive effect disappears and the evolution of cooperation may even be impaired if compared to the absence of the proposed regulatory mechanism. An explanation of the observed results is provided. In particular, it is found that cooperators on the spatial grid are not isolated but form compact clusters and that the distribution of these clusters is crucial for the promotion of cooperation. Our work provides insights into relations between the distribution of payoffs and the evolution of cooperative behavior in situations constituting a social dilemma.

Effects of strategy-migration direction and noise in the evolutionary spatial prisoner's dilemma

Spatial games are crucial for understanding patterns of cooperation in nature (and to some extent society). They are known to be more sensitive to local symmetries than, e.g., spin models. This paper concerns the evolution of the prisoner's dilemma game on regular lattices with three different types of neighborhoods--the von Neumann, Moore, and kagomé types. We investigate two kinds of dynamics for the players to update their strategies (that can be unconditional cooperator or defector). Depending on the payoff difference, an individual can adopt the strategy of a random neighbor [a voter-model-like dynamics (VMLD)] or impose its strategy on a random neighbor, i.e., invasion-process-like dynamics (IPLD). In particular, we focus on the effects of noise, in combination with the strategy dynamics, on the evolution of cooperation. We find that VMLD, compared to IPLD, better supports the spreading and sustaining of cooperation. We see that noise has nontrivial effects on the evolution of cooperation: maximum cooperation density can be realized either at a medium noise level, in the limit of zero noise or in both these regions. The temptation to defect and the local interaction structure determine the outcome. Especially, in the low noise limit, the local interaction plays a crucial role in determining the fate of cooperators. We elucidate these both by numerical simulations and mean-field cluster approximation methods.