Ordering in spatial evolutionary games for pairwise collective strategy updates

Evolutionary dynamics of cooperation driven by a mixed update rule in structured prisoner's dilemma games

How to understand the evolution of cooperation remains a scientific challenge. Individual strategy update rule plays an important role in the evolution of cooperation in a population. Previous works mainly assume that individuals adopt one single update rule during the evolutionary process. Indeed, individuals may adopt a mixed update rule influenced by different preferences such as payoff-driven and conformity-driven factors. It is still unclear how such mixed update rules influence the evolutionary dynamics of cooperation from a theoretical analysis perspective. In this work, in combination with the pairwise comparison rule and the conformity rule, we consider a mixed updating procedure into the evolutionary prisoner's dilemma game. We assume that individuals adopt the conformity rule for strategy updating with a certain probability in a structured population. By means of the pair approximation and mean-field approaches, we obtain the dynamical equations for the fraction of cooperators in the population. We prove that under weak selection, there exists one unique interior equilibrium point, which is stable, in the system. Accordingly, cooperators can survive with defectors under the mixed update rule in the structured population. In addition, we find that the stationary fraction of cooperators increases as the conformity strength increases, but is independent of the benefit parameter. Furthermore, we perform numerical calculations and computer simulations to confirm our theoretical predictions.

Spontaneous symmetry breaking of cooperation between species

In mutualistic associations, two species cooperate by exchanging goods or services with members of another species for their mutual benefit. At the same time, competition for reproduction primarily continues with members of their own species. In intra-species interactions, the prisoner's dilemma is the leading mathematical metaphor to study the evolution of cooperation. Here we consider inter-species interactions in the spatial prisoner's dilemma, where members of each species reside on one lattice layer. Cooperators provide benefits to neighbouring members of the other species at a cost to themselves. Hence, interactions occur across layers but competition remains within layers. We show that rich and complex dynamics unfold when varying the cost-to-benefit ratio of cooperation, r. Four distinct dynamical domains emerge that are separated by critical phase transitions, each characterized by diverging fluctuations in the frequency of cooperation: (i) for large r cooperation is too costly and defection dominates; (ii) for lower r cooperators survive at equal frequencies in both species; (iii) lowering r further results in an intriguing, spontaneous symmetry breaking of cooperation between species with increasing asymmetry for decreasing r; (iv) finally, for small r, bursts of mutual defection appear that increase in size with decreasing r and eventually drive the populations into absorbing states. Typically, one species is cooperating and the other defecting and hence establish perfect asymmetry. Intriguingly and despite the symmetrical model set-up, natural selection can nevertheless favour the spontaneous emergence of asymmetric evolutionary outcomes where, on average, one species exploits the other in a dynamical equilibrium.

Cooperation transitions in social games induced by aspiration-driven players

Cooperation and defection are social traits whose evolutionary origin is still unresolved. Recent behavioral experiments with humans suggested that strategy changes are driven mainly by the individuals' expectations and not by imitation. This work theoretically analyzes and numerically explores an aspiration-driven strategy updating in a well-mixed population playing games. The payoffs of the game matrix and the aspiration are condensed into just two parameters that allow a comprehensive description of the dynamics. We find continuous and abrupt transitions in the cooperation density with excellent agreement between theory and the Gillespie simulations. Under strong selection, the system can display several levels of steady cooperation or get trapped into absorbing states. These states are still relevant for experiments even when irrational choices are made due to their prolonged relaxation times. Finally, we show that for the particular case of the prisoner dilemma, where defection is the dominant strategy under imitation mechanisms, the self-evaluation update instead favors cooperation nonlinearly with the level of aspiration. Thus, our work provides insights into the distinct role between imitation and self-evaluation with no learning dynamics.

Neighborhood size effects on the evolution of cooperation under myopic dynamics

We study the evolution of cooperation in 2×2 social dilemma games in which players are located on a two-dimensional square lattice. During the evolution, each player modifies her strategy by means of myopic update dynamic to maximize her payoff while composing neighborhoods of different sizes, which are characterized by the corresponding radius, r. An investigation of the sublattice-ordered spatial structure for different values of r reveals that some patterns formed by cooperators and defectors can help the former to survive, even under untoward conditions. In contrast to individuals who resist the invasion of defectors by forming clusters due to network reciprocity, innovators spontaneously organize a socially divisive structure that provides strong support for the evolution of cooperation and advances better social systems.

The dual problems of coordination and anti-coordination on random bipartite graphs

In some scenarios ("anti-coordination games"), individuals are better off choosing different actions than their neighbors while in other scenarios ("coordination games"), it is beneficial for individuals to choose the same strategy as their neighbors. Despite having different incentives and resulting population dynamics, it is largely unknown which collective outcome, anti-coordination or coordination, is easier to achieve. To address this issue, we focus on the distributed graph coloring problem on bipartite graphs. We show that with only two strategies, anti-coordination games (2-colorings) and coordination games (uniform colorings) are dual problems that are equally difficult to solve. To prove this, we construct an isomorphism between the Markov chains arising from the corresponding anti-coordination and coordination games under certain specific individual stochastic decision-making rules. Our results provide novel insights into solving collective action problems on networks.

Swarm intelligence inspired cooperation promotion and symmetry breaking in interdependent networked game

The evolution of a cooperative strategy on multilayer networks is arousing increasing concern. Most of the previous studies assumed that agents can only choose cooperation or defection when interacting with their partners, whereas the actual provisions in real world scenarios might not be discrete, but rather continuous. Furthermore, in evolutionary game, agents often make use of their memory which keeps the most successful strategy in the past, as well as the best current strategy gained by their directed neighbors, to find the best available strategies. Inspired by these observations, we study the impact of the particle swarm optimization (PSO) algorithm on the evolution of cooperation on interdependent networks in the continuous version of spatial prisoner's dilemma games. Following extensive simulations of this setup, we can observe that the introduction of the PSO mechanism on the interdependent networks can promote cooperation strongly, regardless of the network coupling strength. In addition, we find that the increment of coupling strength is more suitable for the propagation of cooperation. More interestingly, we find that when the coupling strength is relatively large, a spontaneous symmetry breaking phenomenon of cooperation occurs between the interdependent networks. To interpret the symmetry breaking phenomenon, we investigate the asynchronous expansion of heterogeneous strategy couples between different networks. Since this work takes cooperation from a more elaborate perspective, we believe that it may provide a deep understanding of the evolution of cooperation in social networks.

The Beneficial Role of Mobility for the Emergence of Innovation

Innovation is a key ingredient for the evolution of several systems, including social and biological ones. Focused investigations and lateral thinking may lead to innovation, as well as serendipity and other random discovery processes. Some individuals are talented at proposing innovation (say innovators), while others at deeply exploring proposed novelties, at getting further insights on a theory, or at developing products, services, and so on (say developers). This separation in terms of innovators and developers raises an issue of paramount importance: under which conditions a system is able to maintain innovators? According to a simple model, this work investigates the evolutionary dynamics that characterize the emergence of innovation. In particular, we consider a population of innovators and developers, in which agents form small groups whose composition is crucial for their payoff. The latter depends on the heterogeneity of the formed groups, on the amount of innovators they include, and on an award-factor that represents the policy of the system for promoting innovation. Under the hypothesis that a "mobility" effect may support the emergence of innovation, we compare the equilibria reached by our population in different cases. Results confirm the beneficial role of "mobility", and the emergence of further interesting phenomena.

Role-separating ordering in social dilemmas controlled by topological frustration

''Three is a crowd" is an old proverb that applies as much to social interactions as it does to frustrated configurations in statistical physics models. Accordingly, social relations within a triangle deserve special attention. With this motivation, we explore the impact of topological frustration on the evolutionary dynamics of the snowdrift game on a triangular lattice. This topology provides an irreconcilable frustration, which prevents anticoordination of competing strategies that would be needed for an optimal outcome of the game. By using different strategy updating protocols, we observe complex spatial patterns in dependence on payoff values that are reminiscent to a honeycomb-like organization, which helps to minimize the negative consequence of the topological frustration. We relate the emergence of these patterns to the microscopic dynamics of the evolutionary process, both by means of mean-field approximations and Monte Carlo simulations. For comparison, we also consider the same evolutionary dynamics on the square lattice, where of course the topological frustration is absent. However, with the deletion of diagonal links of the triangular lattice, we can gradually bridge the gap to the square lattice. Interestingly, in this case the level of cooperation in the system is a direct indicator of the level of topological frustration, thus providing a method to determine frustration levels in an arbitrary interaction network.

Congestion phenomena caused by matching pennies in evolutionary games

Evolutionary social dilemma games are extended by an additional matching-pennies game that modifies the collected payoffs. In a spatial version players are distributed on a square lattice and interact with their neighbors. First, we show that the matching-pennies game can be considered as the microscopic force of the Red Queen effect that breaks the detailed balance and induces eddies in the microscopic probability currents if the strategy update is analogous to the Glauber dynamics for the kinetic Ising models. The resulting loops in probability current breaks symmetry between the chessboardlike arrangements of strategies via a bottleneck effect occurring along the four-edge loops in the microscopic states. The impact of this congestion is analogous to the application of a staggered magnetic field in the Ising model; that is, the order-disorder critical transition is wiped out by noise. It is illustrated that the congestion induced symmetry breaking can be beneficial for the whole community within a certain region of parameters.

Spontaneous symmetry breaking in interdependent networked game

Spatial evolution game has traditionally assumed that players interact with direct neighbors on a single network, which is isolated and not influenced by other systems. However, this is not fully consistent with recent research identification that interactions between networks play a crucial rule for the outcome of evolutionary games taking place on them. In this work, we introduce the simple game model into the interdependent networks composed of two networks. By means of imitation dynamics, we display that when the interdependent factor α is smaller than a threshold value α(C), the symmetry of cooperation can be guaranteed. Interestingly, as interdependent factor exceeds α(C), spontaneous symmetry breaking of fraction of cooperators presents itself between different networks. With respect to the breakage of symmetry, it is induced by asynchronous expansion between heterogeneous strategy couples of both networks, which further enriches the content of spatial reciprocity. Moreover, our results can be well predicted by the strategy-couple pair approximation method.

Coexistence of fraternity and egoism for spatial social dilemmas

We have studied an evolutionary game with spatially arranged players who can choose one of the two strategies (named cooperation and defection for social dilemmas) when playing with their neighbors. In addition to the application of the usual strategies in the present model the players are also characterized by one of the two extreme personal features representing the egoist or fraternal behavior. During the evolution each player can modify both her own strategy and/or personal feature via a myopic update process in order to improve her utility. The results of numerical simulations and stability analysis are summarized in phase diagrams representing a wide scale of spatially ordered distribution of strategies and personal features when varying the payoff parameters. In most of the cases only two of the four possible options prevail and may form sublattice ordered spatial structure. The evolutionary advantage of the fraternal attitude is demonstrated within a large range of payoff parameters including the region of prisoner's dilemma where egoist defectors and fraternal cooperators form a role-separating chessboard like pattern.

Beyond pairwise strategy updating in the prisoner's dilemma game

In spatial games players typically alter their strategy by imitating the most successful or one randomly selected neighbor. Since a single neighbor is taken as reference, the information stemming from other neighbors is neglected, which begets the consideration of alternative, possibly more realistic approaches. Here we show that strategy changes inspired not only by the performance of individual neighbors but rather by entire neighborhoods introduce a qualitatively different evolutionary dynamics that is able to support the stable existence of very small cooperative clusters. This leads to phase diagrams that differ significantly from those obtained by means of pairwise strategy updating. In particular, the survivability of cooperators is possible even by high temptations to defect and over a much wider uncertainty range. We support the simulation results by means of pair approximations and analysis of spatial patterns, which jointly highlight the importance of local information for the resolution of social dilemmas.

If players are sparse social dilemmas are too: Importance of percolation for evolution of cooperation

Spatial reciprocity is a well known tour de force of cooperation promotion. A thorough understanding of the effects of different population densities is therefore crucial. Here we study the evolution of cooperation in social dilemmas on different interaction graphs with a certain fraction of vacant nodes. We find that sparsity may favor the resolution of social dilemmas, especially if the population density is close to the percolation threshold of the underlying graph. Regardless of the type of the governing social dilemma as well as particularities of the interaction graph, we show that under pairwise imitation the percolation threshold is a universal indicator of how dense the occupancy ought to be for cooperation to be optimally promoted. We also demonstrate that myopic updating, due to the lack of efficient spread of information via imitation, renders the reported mechanism dysfunctional, which in turn further strengthens its foundations.

Effect of space in the game "war of attrition"

Spatial dynamics has in many cases been invoked as a mechanism that can promote the evolution of coexistence and cooperation, although the precise conditions for this to occur have not yet been characterised. In an effort to address this question we have analyzed an alternative version of the theoretical game "war of attrition," which exhibits unusual behavior: The well-mixed system exhibits quasistationary coexistence and a relaxation time that scales exponentially with the system size, while the spatial system shows a relaxation time that is considerably smaller and scales with a power α≈1.4 of the system size. Further, the spatial system exhibits a first-order phase transition in the strategy distribution at a consolation prize of k≈1/3. Close to this point the relaxation time diverges with an exponent γ≈1.2. This analysis shows that the effect of space is highly dependent on the type of game considered.

Fixation, transient landscape, and diffusion dilemma in stochastic evolutionary game dynamics

Agent-based stochastic models for finite populations have recently received much attention in the game theory of evolutionary dynamics. Both the ultimate fixation and the pre-fixation transient behavior are important to a full understanding of the dynamics. In this paper, we study the transient dynamics of the well-mixed Moran process through constructing a landscape function. It is shown that the landscape playing a central theoretical "device" that integrates several lines of inquiries: the stable behavior of the replicator dynamics, the long-time fixation, and continuous diffusion approximation associated with asymptotically large population. Several issues relating to the transient dynamics are discussed: (i) multiple time scales phenomenon associated with intra- and inter-attractoral dynamics; (ii) discontinuous transition in stochastically stationary process akin to Maxwell construction in equilibrium statistical physics; and (iii) the dilemma diffusion approximation facing as a continuous approximation of the discrete evolutionary dynamics. It is found that rare events with exponentially small probabilities, corresponding to the uphill movements and barrier crossing in the landscape with multiple wells that are made possible by strong nonlinear dynamics, plays an important role in understanding the origin of the complexity in evolutionary, nonlinear biological systems.