Time scales in evolutionary dynamics

Microbial diversity and ecological complexity emerging from environmental variation and horizontal gene transfer in a simple mathematical model

BACKGROUND

Microbiomes are generally characterized by high diversity of coexisting microbial species and strains, and microbiome composition typically remains stable across a broad range of conditions. However, under fixed conditions, microbial ecology conforms with the exclusion principle under which two populations competing for the same resource within the same niche cannot coexist because the less fit population inevitably goes extinct. Therefore, the long-term persistence of microbiome diversity calls for an explanation.

RESULTS

To explore the conditions for stabilization of microbial diversity, we developed a simple mathematical model consisting of two competing populations that could exchange a single gene allele via horizontal gene transfer (HGT). We found that, although in a fixed environment, with unbiased HGT, the system obeyed the exclusion principle, in an oscillating environment, within large regions of the phase space bounded by the rates of reproduction and HGT, the two populations coexist. Moreover, depending on the parameter combination, all three major types of symbiosis were obtained, namely, pure competition, host-parasite relationship, and mutualism. In each of these regimes, certain parameter combinations provided for synergy, that is, a greater total abundance of both populations compared to the abundance of the winning population in the fixed environment.

CONCLUSIONS

The results of this modeling study show that basic phenomena that are universal in microbial communities, namely, environmental variation and HGT, provide for stabilization and persistence of microbial diversity, and emergence of ecological complexity.

The impact of dynamic linking on cooperation on complex networks

In complex social systems, individual relationships and the surrounding environment are constantly changing, allowing individuals to interact on dynamic networks. This study aims to investigate how individuals in a dynamic network engaged in a prisoner's dilemma game adapt their competitive environment through random edge breaks and reconnections when faced with incomplete information and adverse local conditions, thereby influencing the evolution of cooperative behavior. We find that random edge breaks and reconnections in dynamic networks can disrupt cooperative clusters, significantly hindering the development of cooperation. This negative impact becomes more pronounced over larger time scales. However, we also observe that nodes with higher degrees of connectivity exhibit greater resilience to this cooperation disruption. Our research reveals the profound impact of dynamic network structures on the evolution of cooperation and provides new insights into the mechanisms of cooperation in complex systems.

Evolution of reciprocity with limited payoff memory

Direct reciprocity is a mechanism for the evolution of cooperation in repeated social interactions. According to the literature, individuals naturally learn to adopt conditionally cooperative strategies if they have multiple encounters with their partner. Corresponding models have greatly facilitated our understanding of cooperation, yet they often make strong assumptions on how individuals remember and process payoff information. For example, when strategies are updated through social learning, it is commonly assumed that individuals compare their average payoffs. This would require them to compute (or remember) their payoffs against everyone else in the population. To understand how more realistic constraints influence direct reciprocity, we consider the evolution of conditional behaviours when individuals learn based on more recent experiences. Even in the most extreme case that they only take into account their very last interaction, we find that cooperation can still evolve. However, such individuals adopt less generous strategies, and they cooperate less often than in the classical setup with average payoffs. Interestingly, once individuals remember the payoffs of two or three recent interactions, cooperation rates quickly approach the classical limit. These findings contribute to a literature that explores which kind of cognitive capabilities are required for reciprocal cooperation. While our results suggest that some rudimentary form of payoff memory is necessary, it suffices to remember a few interactions.

Microbial diversity and ecological complexity emerging from environmental variation and horizontal gene transfer in a simple mathematical model

Microbiomes are generally characterized by high diversity of coexisting microbial species and strains that remains stable within a broad range of conditions. However, under fixed conditions, microbial ecology conforms with the exclusion principle under which two populations competing for the same resource within the same niche cannot coexist because the less fit population inevitably goes extinct. To explore the conditions for stabilization of microbial diversity, we developed a simple mathematical model consisting of two competing populations that could exchange a single gene allele via horizontal gene transfer (HGT). We found that, although in a fixed environment, with unbiased HGT, the system obeyed the exclusion principle, in an oscillating environment, within large regions of the phase space bounded by the rates of reproduction and HGT, the two populations coexist. Moreover, depending on the parameter combination, all three major types of symbiosis obtained, namely, pure competition, host-parasite relationship and mutualism. In each of these regimes, certain parameter combinations provided for synergy, that is, a greater total abundance of both populations compared to the abundance of the winning population in the fixed environments. These findings show that basic phenomena that are universal in microbial communities, environmental variation and HGT, provide for stabilization of microbial diversity and ecological complexity.

Enhanced cooperation in multiplayer snowdrift games with random and dynamic groupings

An analytically tractable generalization of the N-person snowdrift (NSG) game that illustrates how cooperation can be enhanced is proposed and studied. The number of players competing within a NSG varies from one time step to another. Exact equations governing the frequency of cooperation f_{c}(r) as a function of the cost-to-benefit ratio r within an imitation strategy updating scheme are presented. For group sizes g uniformly distributed within the range g∈[1,g_{m}], an analytic formula for the critical value r_{c}(g_{m}), below which the system evolves into a totally cooperative (AllC) state, is derived. In contrast, a fixed group size NSG does not support an AllC state. The result r_{c}(g_{m}) requires the presence of sole-player groups and involves the inverse of the harmonic numbers and, more generally, the inverse first moment of the group size distribution. For r>r_{c}(g_{m}), the equation that determines the dynamical mixed states f_{c}(r) is given, with exact solutions existing for g_{m}≤5. The exact treatment allows the study of the phase boundary between the AllC state and the mixed states. The analytic results are checked against simulation results and exact agreements are demonstrated. The analytic form of the critical r_{c}(g_{m}) illustrates the necessity of having groups of a sole player in the evolutionary process. This result is supported by simulations with group sizes excluding the sole groups for which no AllC state emerges. A physically transparent picture of the importance of the sole players in inducing an AllC state is further presented based on the last surviving pattern before the AllC state is attained. The exact expression r_{c}(g_{m}) turns out to remain valid for nonuniform group-size distributions. Our analytical tractable generalization, therefore, sheds light on how a competing environment with variable group sizes could enhance cooperation and induce an AllC state.

Evolutionary multigame with conformists and profiteers based on dynamic complex networks

Evolutionary game on complex networks provides a new research framework for analyzing and predicting group decision-making behavior in an interactive environment, in which most researchers assumed players as profiteers. However, current studies have shown that players are sometimes conformists rather than profit-seeking in society, but most research has been discussed on a simple game without considering the impact of multiple games. In this paper, we study the influence of conformists and profiteers on the evolution of cooperation in multiple games and illustrate two different strategy-updating rules based on these conformists and profiteers. Different from previous studies, we introduce a similarity between players into strategy-updating rules and explore the evolutionary game process, including the strategy updating, the transformation of players' type, and the dynamic evolution of the network structure. In the simulation, we implement our model on scale-free and regular networks and provide some explanations from the perspective of strategy transition, type transition, and network topology properties to prove the validity of our model.

Cooperate or Not Cooperate in Predictable but Periodically Varying Situations? Cooperation in Fast Oscillating Environment

In this work, the cooperation problem between two populations in a periodically varying environment is discussed. In particular, the two-population prisoner's dilemma game with periodically oscillating payoffs is discussed, such that the time-average of these oscillations over the period of environmental variations vanishes. The possible overlaps of these oscillations generate completely new dynamical effects that drastically change the phase space structure of the two-population evolutionary dynamics. Due to these effects, the emergence of some level of cooperators in both populations is possible under certain conditions on the environmental variations. In the domain of stable coexistence the dynamics of cooperators in each population form stable cycles. Thus, the cooperators in each population promote the existence of cooperators in the other population. However, the survival of cooperators in both populations is not guaranteed by a large initial fraction of them.

Evolution of cooperation on temporal networks

Population structure is a key determinant in fostering cooperation among naturally self-interested individuals in microbial populations, social insect groups, and human societies. Traditional research has focused on static structures, and yet most real interactions are finite in duration and changing in time, forming a temporal network. This raises the question of whether cooperation can emerge and persist despite an intrinsically fragmented population structure. Here we develop a framework to study the evolution of cooperation on temporal networks. Surprisingly, we find that network temporality actually enhances the evolution of cooperation relative to comparable static networks, despite the fact that bursty interaction patterns generally impede cooperation. We resolve this tension by proposing a measure to quantify the amount of temporality in a network, revealing an intermediate level that maximally boosts cooperation. Our results open a new avenue for investigating the evolution of cooperation and other emergent behaviours in more realistic structured populations.

Population structure enables emergence of cooperation among individuals, but the impact of the dynamic nature of real interaction networks is not understood. Here, the authors study the evolution of cooperation on temporal networks and find that temporality enhances the evolution of cooperation.

Persistence of cooperation in diffusive public goods games

Diffusive public goods (PG) games are difficult to analyze due to population assortment affecting growth rates of cooperators (producers) and free-riders. We study these growth rates using spectral decomposition of cellular densities and derive a finite cell-size correction of the growth rate advantage which exactly describes the dynamics of a randomly assorted population and approximates the dynamics under limited dispersal. The resulting effective benefit-to-cost ratio relates the physical parameters of PG dynamics to the persistence of cooperation, and our findings provide a powerful tool for the analysis of diffusive PG games, explaining commonly observed patterns of cooperation.

Heterogeneous cooperative leadership structure emerging from random regular graphs

This paper investigates the evolution of cooperation and the emergence of hierarchical leadership structure in random regular graphs. It is found that there exist different learning patterns between cooperators and defectors, and cooperators are able to attract more followers and hence more likely to become leaders. Hence, the heterogeneous distributions of reputation and leadership can emerge from homogeneous random graphs. The important directed game-learning skeleton is then studied, revealing some important structural properties, such as the heavy-tailed degree distribution and the positive in-in degree correlation.

The effect of asymmetric reproductive ability on the evolution of cooperation on interdependent networks

In this paper, we consider an asymmetric reproductive ability on interdependent networks and investigate how this setting affects the evolution of cooperation. In detail, players decide to update their strategies at each step on main network (network B), while for sub network (network A), players update their strategies with a fixed probability p. Obviously, the system restores the traditional case when p = 1, where cooperation can survive by interdependent network reciprocity. And our asymmetric set-up comes into play when p < 1. Numerical simulation results show that our asymmetric coupling will hinder the overall cooperation level for small p. In detail, the introduction of asymmetric reproductive ability urges the formation of symmetry breaking and further weakens the positive impact by location synchronous effect. And the root cause is entirely distinct situation of utility differences on two networks. These observations further demonstrate a class of phenomena on interdependent networks that it would have catastrophic consequences on one network even if a unrelated change only occurs seemingly on another network.

Phenotype affinity mediated interactions can facilitate the evolution of cooperation

We study the coevolutionary dynamics of the diversity of phenotype and the evolution of cooperation in the Prisoner's Dilemma. Rather than pre-assigning zero-or-one interaction rate, we diversify the rate of interaction by associating it with phenotypes. Individuals each carry a set of potentially expressible traits and expresses a number of such traits at a cost proportional to the number. The set of traits expressed constitutes phenotype. Phenotypes and thus the rate of interaction are evolvable over time. Our results show that nonnegligible cost of expressing traits restrains phenotype diversity, and the evolutionary race mainly proceeds on between cooperative strains and defective strains who express a very few traits. It pays for cooperative strains to express a very few traits. Though such a low level of expression weakens reciprocity between cooperative strains, it decelerates the rate of interaction between cooperative strains and defective strains to a larger degree, leading to the predominance of cooperative strains over defective strains. We also find that evolved diversity of phenotype can occasionally destabilize due to the invasion of defective mutants, implying that cooperation and diversity of phenotype can mutually reinforce each other. Our results may help better understand the coevolution of cooperation and the diversity of phenotype.

Multiple scales in metapopulations of public goods producers

Multiple scales in metapopulations can give rise to paradoxical behavior: in a conceptual model for a public goods game, the species associated with a fitness cost due to the public good production can be stabilized in the well-mixed limit due to the mere existence of these scales. The scales in this model involve a length scale corresponding to separate patches, coupled by mobility, and separate time scales for reproduction and interaction with a local environment. Contrary to the well-mixed high mobility limit, we find that for low mobilities, the interaction rate progressively stabilizes this species due to stochastic effects, and that the formation of spatial patterns is not crucial for this stabilization.

Evolution of joint cooperation under phenotypic variations

Effects of phenotypic variation on the species-environment systems and the evolution of cooperation under prescribed phenotypic diversity have been well addressed respectively. Interspecies interactions in the context of evolvable phenotypic diversity remain largely unconsidered. We address the evolutionary dynamics by considering evolvable phenotypic variations under group interactions. Each individual carries a capacitor of phenotypes and pays a cost proportional to its volume. A random phenotype from the capacitor is expressed and the population is thus divided into subpopulations. Group interactions happen in each of these subpopulations, respectively. Competition is global. Results show that phenotypic diversity coevolves with cooperation under a wide range of conditions and that tradeoff between expanding capacitor and rising cost leads to an optimal level of phenotypic diversity best promoting cooperation. We also find that evolved high levels of phenotypic diversity can occasionally collapse due to the invasion of defector mutants, suggesting that cooperation and phenotypic diversity can mutually reinforce each other.

Coevolutionary dynamics of phenotypic diversity and contingent cooperation

Phenotypic diversity is considered beneficial to the evolution of contingent cooperation, in which cooperators channel their help preferentially towards others of similar phenotypes. However, it remains largely unclear how phenotypic variation arises in the first place and thus leads to the construction of phenotypic complexity. Here we propose a mathematical model to study the coevolutionary dynamics of phenotypic diversity and contingent cooperation. Unlike previous models, our model does not assume any prescribed level of phenotypic diversity, but rather lets it be an evolvable trait. Each individual expresses one phenotype at a time and only the phenotypes expressed are visible to others. Moreover, individuals can differ in their potential of phenotypic variation, which is characterized by the number of distinct phenotypes they can randomly switch to. Each individual incurs a cost proportional to the number of potentially expressible phenotypes so as to retain phenotypic variation and expression. Our results show that phenotypic diversity coevolves with contingent cooperation under a wide range of conditions and that there exists an optimal level of phenotypic diversity best promoting contingent cooperation. It pays for contingent cooperators to elevate their potential of phenotypic variation, thereby increasing their opportunities of establishing cooperation via novel phenotypes, as these new phenotypes serve as secret tags that are difficult for defector to discover and chase after. We also find that evolved high levels of phenotypic diversity can occasionally collapse due to the invasion of defector mutants, suggesting that cooperation and phenotypic diversity can mutually reinforce each other. Thus, our results provide new insights into better understanding the coevolution of cooperation and phenotypic diversity.

Phenotypic variation is commonly observed from human cells to the intestinal pathogen Salmonella enterica serovar Typhimurium to the wrinkly-spreader morphs. Such phenotypic diversity proves effective in promoting cooperation, or confers survival advantage against unfavorable environmental changes. Prior studies show that interactions based on phenotypic similarity can promote cooperation. Yet in these models, the level of phenotypic diversity is prescribed such that individuals each possess the same number of available phenotypes, and thereby no evolution of phenotypic diversity per se. We here take into consideration important aspects of the diversity of phenotype and contingent cooperation and show that phenotypic diversity coevolves with cooperation under a variety of conditions. Our work provides a potential mechanism for the evolution of cooperation, and individuals, especially cooperators, endowed with diverse phenotypes constitute the backbone in inducing the coevolution.

Stochastic evolution in populations of ideas

It is known that learning of players who interact in a repeated game can be interpreted as an evolutionary process in a population of ideas. These analogies have so far mostly been established in deterministic models, and memory loss in learning has been seen to act similarly to mutation in evolution. We here propose a representation of reinforcement learning as a stochastic process in finite ‘populations of ideas’. The resulting birth-death dynamics has absorbing states and allows for the extinction or fixation of ideas, marking a key difference to mutation-selection processes in finite populations. We characterize the outcome of evolution in populations of ideas for several classes of symmetric and asymmetric games.

From degree-correlated to payoff-correlated activity for an optimal resolution of social dilemmas

An active participation of players in evolutionary games depends on several factors, ranging from personal stakes to the properties of the interaction network. Diverse activity patterns thus have to be taken into account when studying the evolution of cooperation in social dilemmas. Here we study the weak prisoner's dilemma game, where the activity of each player is determined in a probabilistic manner either by its degree or by its payoff. While degree-correlated activity introduces cascading failures of cooperation that are particularly severe on scale-free networks with frequently inactive hubs, payoff-correlated activity provides a more nuanced activity profile, which ultimately hinders systemic breakdowns of cooperation. To determine optimal conditions for the evolution of cooperation, we introduce an exponential decay to payoff-correlated activity that determines how fast the activity of a player returns to its default state. We show that there exists an intermediate decay rate at which the resolution of the social dilemma is optimal. This can be explained by the emerging activity patterns of players, where the inactivity of hubs is compensated effectively by the increased activity of average-degree players, who through their collective influence in the network sustain a higher level of cooperation. The sudden drops in the fraction of cooperators observed with degree-correlated activity therefore vanish, and so does the need for the lengthy spatiotemporal reorganization of compact cooperative clusters. The absence of such asymmetric dynamic instabilities thus leads to an optimal resolution of social dilemmas, especially when the conditions for the evolution of cooperation are strongly adverse.

Fixation of competing strategies when interacting agents differ in the time scale of strategy updating

A commonly used assumption in evolutionary game theory is that natural selection acts on individuals in the same time scale; e.g., players use the same frequency to update their strategies. Variation in learning rates within populations suggests that evolutionary game theory may not necessarily be restricted to uniform time scales associated with the game interaction and strategy adaption evolution. In this study, we remove this restricting assumption by dividing the population into fast and slow groups according to the players' strategy updating frequencies and investigate how different strategy compositions of one group influence the evolutionary outcome of the other's fixation probabilities of strategies within its own group. Analytical analysis and numerical calculations are performed to study the evolutionary dynamics of strategies in typical classes of two-player games (prisoner's dilemma game, snowdrift game, and stag-hunt game). The introduction of the heterogeneity in strategy-update time scales leads to substantial changes in the evolution dynamics of strategies. We provide an approximation formula for the fixation probability of mutant types in finite populations and study the outcome of strategy evolution under the weak selection. We find that although heterogeneity in time scales makes the collective evolutionary dynamics more complicated, the possible long-run evolutionary outcome can be effectively predicted under technical assumptions when knowing the population composition and payoff parameters.

Replicator dynamics with diffusion on multiplex networks

In this study we present an extension of the dynamics of diffusion in multiplex graphs, which makes the equations compatible with the replicator equation with mutations. We derive an exact formula for the diffusion term, which shows that, while diffusion is linear for numbers of agents, it is necessary to account for nonlinear terms when working with fractions of individuals. We also derive the transition probabilities that give rise to such macroscopic behavior, completing the bottom-up description. Finally, it is shown that the usual assumption of constant population sizes induces a hidden selective pressure due to the diffusive dynamics, which favors the increase of fast diffusing strategies.

Universal scaling for the dilemma strength in evolutionary games

Why would natural selection favor the prevalence of cooperation within the groups of selfish individuals? A fruitful framework to address this question is evolutionary game theory, the essence of which is captured in the so-called social dilemmas. Such dilemmas have sparked the development of a variety of mathematical approaches to assess the conditions under which cooperation evolves. Furthermore, borrowing from statistical physics and network science, the research of the evolutionary game dynamics has been enriched with phenomena such as pattern formation, equilibrium selection, and self-organization. Numerous advances in understanding the evolution of cooperative behavior over the last few decades have recently been distilled into five reciprocity mechanisms: direct reciprocity, indirect reciprocity, kin selection, group selection, and network reciprocity. However, when social viscosity is introduced into a population via any of the reciprocity mechanisms, the existing scaling parameters for the dilemma strength do not yield a unique answer as to how the evolutionary dynamics should unfold. Motivated by this problem, we review the developments that led to the present state of affairs, highlight the accompanying pitfalls, and propose new universal scaling parameters for the dilemma strength. We prove universality by showing that the conditions for an ESS and the expressions for the internal equilibriums in an infinite, well-mixed population subjected to any of the five reciprocity mechanisms depend only on the new scaling parameters. A similar result is shown to hold for the fixation probability of the different strategies in a finite, well-mixed population. Furthermore, by means of numerical simulations, the same scaling parameters are shown to be effective even if the evolution of cooperation is considered on the spatial networks (with the exception of highly heterogeneous setups). We close the discussion by suggesting promising directions for future research including (i) how to handle the dilemma strength in the context of co-evolution and (ii) where to seek opportunities for applying the game theoretical approach with meaningful impact.

Phase transitions in a coevolving snowdrift game with costly rewiring

We propose and study a dissatisfied adaptive snowdrift game with a payoff parameter r that incorporates a cost for rewiring a connection. An agent, facing adverse local environment, may switch action without a cost or rewire an existing link with a cost a so as to attain a better competing environment. Detailed numerical simulations reveal nontrivial and nonmonotonic dependence of the frequency of cooperation and the densities of different types of links on a and r. A theory that treats the cooperative and noncooperative agents separately and accounts for spatial correlation up to neighboring agents is formulated. The theory gives results that are in good agreement with simulations. The frequency of cooperation f_{C} is enhanced (suppressed) at high rewiring cost relative to that at low rewiring cost when r is small (large). For a given value of r, there exists a critical value of the rewiring cost below which the system evolves into a phase of frozen dynamics with isolated noncooperative agents segregated from a cluster of cooperative agents, and above which the system evolves into a connected population of mixed actions with continual dynamics. The phase boundary on the a-r phase space that separates the two phases with distinct structural, population and dynamical properties is mapped out. The phase diagram reveals that, as a general feature, for small r (small a), the disconnected and segregated phase can survive over a wider range of a(r).

Evolutionary dynamics of time-resolved social interactions

Cooperation among unrelated individuals is frequently observed in social groups when their members combine efforts and resources to obtain a shared benefit that is unachievable by an individual alone. However, understanding why cooperation arises despite the natural tendency of individuals toward selfish behavior is still an open problem and represents one of the most fascinating challenges in evolutionary dynamics. Recently, the structural characterization of the networks in which social interactions take place has shed some light on the mechanisms by which cooperative behavior emerges and eventually overcomes the natural temptation to defect. In particular, it has been found that the heterogeneity in the number of social ties and the presence of tightly knit communities lead to a significant increase in cooperation as compared with the unstructured and homogeneous connection patterns considered in classical evolutionary dynamics. Here, we investigate the role of social-ties dynamics for the emergence of cooperation in a family of social dilemmas. Social interactions are in fact intrinsically dynamic, fluctuating, and intermittent over time, and they can be represented by time-varying networks. By considering two experimental data sets of human interactions with detailed time information, we show that the temporal dynamics of social ties has a dramatic impact on the evolution of cooperation: the dynamics of pairwise interactions favors selfish behavior.

Different perceptions of social dilemmas: evolutionary multigames in structured populations

Motivated by the fact that the same social dilemma can be perceived differently by different players, we here study evolutionary multigames in structured populations. While the core game is the weak prisoner's dilemma, a fraction of the population adopts either a positive or a negative value of the sucker's payoff, thus playing either the traditional prisoner's dilemma or the snowdrift game. We show that the higher the fraction of the population adopting a different payoff matrix the more the evolution of cooperation is promoted. The microscopic mechanism responsible for this outcome is unique to structured populations, and it is due to the payoff heterogeneity, which spontaneously introduces strong cooperative leaders that give rise to an asymmetric strategy imitation flow in favor of cooperation. We demonstrate that the reported evolutionary outcomes are robust against variations of the interaction network, and they also remain valid if players are allowed to vary which game they play over time. These results corroborate existing evidence in favor of heterogeneity-enhanced network reciprocity, and they reveal how different perceptions of social dilemmas may contribute to their resolution.

Degree mixing in multilayer networks impedes the evolution of cooperation

Traditionally, the evolution of cooperation has been studied on single, isolated networks. Yet a player, especially in human societies, will typically be a member of many different networks, and those networks will play different roles in the evolutionary process. Multilayer networks are therefore rapidly gaining on popularity as the more apt description of a networked society. With this motivation, we here consider two-layer scale-free networks with all possible combinations of degree mixing, wherein one network layer is used for the accumulation of payoffs and the other is used for strategy updating. We find that breaking the symmetry through assortative mixing in one layer and/or disassortative mixing in the other layer, as well as preserving the symmetry by means of assortative mixing in both layers, impedes the evolution of cooperation. We use degree-dependent distributions of strategies and cluster-size analysis to explain these results, which highlight the importance of hubs and the preservation of symmetry between multilayer networks for the successful resolution of social dilemmas.

Stochastic heterogeneous interaction promotes cooperation in spatial prisoner's dilemma game

Previous studies mostly investigate player's cooperative behavior as affected by game time-scale or individual diversity. In this paper, by involving both time-scale and diversity simultaneously, we explore the effect of stochastic heterogeneous interaction. In our model, the occurrence of game interaction between each pair of linked player obeys a random probability, which is further described by certain distributions. Simulations on a 4-neighbor square lattice show that the cooperation level is remarkably promoted when stochastic heterogeneous interaction is considered. The results are then explained by investigating the mean payoffs, the mean boundary payoffs and the transition probabilities between cooperators and defectors. We also show some typical snapshots and evolution time series of the system. Finally, the 8-neighbor square lattice and BA scale-free network results indicate that the stochastic heterogeneous interaction can be robust against different network topologies. Our work may sharpen the understanding of the joint effect of game time-scale and individual diversity on spatial games.

Moderate intra-group bias maximizes cooperation on interdependent populations

Evolutionary game theory on spatial structures has received increasing attention during the past decades. However, the majority of these achievements focuses on single and static population structures, which is not fully consistent with the fact that real structures are composed of many interactive groups. These groups are interdependent on each other and present dynamical features, in which individuals mimic the strategy of neighbors and switch their partnerships continually. It is however unclear how the dynamical and interdependent interactions among groups affect the evolution of collective behaviors. In this work, we employ the prisoner's dilemma game to investigate how the dynamics of structure influences cooperation on interdependent populations, where populations are represented by group structures. It is found that the more robust the links between cooperators (or the more fragile the links between cooperators and defectors), the more prevalent of cooperation. Furthermore, theoretical analysis shows that the intra-group bias can favor cooperation, which is only possible when individuals are likely to attach neighbors within the same group. Yet, interestingly, cooperation can be even inhibited for large intra-group bias, allowing the moderate intra-group bias maximizes the cooperation level.

Social dilemma alleviated by sharing the gains with immediate neighbors

We study the evolution of cooperation in the evolutionary spatial prisoner's dilemma game (PDG) and snowdrift game (SG), within which a fraction α of the payoffs of each player gained from direct game interactions is shared equally by the immediate neighbors. The magnitude of the parameter α therefore characterizes the degree of the relatedness among the neighboring players. By means of extensive Monte Carlo simulations as well as an extended mean-field approximation method, we trace the frequency of cooperation in the stationary state. We find that plugging into relatedness can significantly promote the evolution of cooperation in the context of both studied games. Unexpectedly, cooperation can be more readily established in the spatial PDG than that in the spatial SG, given that the degree of relatedness and the cost-to-benefit ratio of mutual cooperation are properly formulated. The relevance of our model with the stakeholder theory is also briefly discussed.

Impact of social punishment on cooperative behavior in complex networks

Social punishment is a mechanism by which cooperative individuals spend part of their resources to penalize defectors. In this paper, we study the evolution of cooperation in 2-person evolutionary games on networks when a mechanism for social punishment is introduced. Specifically, we introduce a new kind of role, punisher, which is aimed at reducing the earnings of defectors by applying to them a social fee. Results from numerical simulations show that different equilibria allowing the three strategies to coexist are possible as well as that social punishment further enhance the robustness of cooperation. Our results are confirmed for different network topologies and two evolutionary games. In addition, we analyze the microscopic mechanisms that give rise to the observed macroscopic behaviors in both homogeneous and heterogeneous networks. Our conclusions might provide additional insights for understanding the roots of cooperation in social systems.

Effects of adaptive dynamical linking in networked games

The role of dynamical topologies in the evolution of cooperation has received considerable attention, as some studies have demonstrated that dynamical networks are much better than static networks in terms of boosting cooperation. Here we study a dynamical model of evolution of cooperation on stochastic dynamical networks in which there are no permanent partners to each agent. Whenever a new link is created, its duration is randomly assigned without any bias or preference. We allow the agent to adaptively adjust the duration of each link during the evolution in accordance with the feedback from game interactions. By Monte Carlo simulations, we find that cooperation can be remarkably promoted by this adaptive dynamical linking mechanism both for the game of pairwise interactions, such as the Prisoner's Dilemma game (PDG), and for the game of group interactions, illustrated by the public goods game (PGG). And the faster the adjusting rate, the more successful the evolution of cooperation. We also show that in this context weak selection favors cooperation much more than strong selection does. What is particularly meaningful is that the prosperity of cooperation in this study indicates that the rationality and selfishness of a single agent in adjusting social ties can lead to the progress of altruism of the whole population.

Fence-sitters protect cooperation in complex networks

Evolutionary game theory is one of the key paradigms behind many scientific disciplines from science to engineering. In complex networks, because of the difficulty of formulating the replicator dynamics, most of the previous studies are confined to a numerical level. In this paper, we introduce a vectorial formulation to derive three classes of individuals' payoff analytically. The three classes are pure cooperators, pure defectors, and fence-sitters. Here, fence-sitters are the individuals who change their strategies at least once in the strategy evolutionary process. As a general approach, our vectorial formalization can be applied to all the two-strategy games. To clarify the function of the fence-sitters, we define a parameter, payoff memory, as the number of rounds that the individuals' payoffs are aggregated. We observe that the payoff memory can control the fence-sitters' effects and the level of cooperation efficiently. Our results indicate that the fence-sitters' role is nontrivial in the complex topologies, which protects cooperation in an indirect way. Our results may provide a better understanding of the composition of cooperators in a circumstance where the temptation to defect is larger.

Decelerated invasion and waning-moon patterns in public goods games with delayed distribution

We study the evolution of cooperation in the spatial public goods game, focusing on the effects that are brought about by the delayed distribution of goods that accumulate in groups due to the continuous investments of cooperators. We find that intermediate delays enhance network reciprocity because of a decelerated invasion of defectors, who are unable to reap the same high short-term benefits as they do in the absence of delayed distribution. Long delays, however, introduce a risk because the large accumulated wealth might fall into the wrong hands. Indeed, as soon as the curvature of a cooperative cluster turns negative, the engulfed defectors can collect the heritage of many generations of cooperators and by doing so start a waning-moon pattern that nullifies the benefits of decelerated invasion. Accidental meeting points of growing cooperative clusters may also act as triggers for the waning-moon effect, thus linking the success of cooperators with their propensity to fail in a rather bizarre way. Our results highlight that "investing in the future" is a good idea only if that future is sufficiently near and not likely to be burdened by inflation.

Adaptive tag switching reinforces the coevolution of contingent cooperation and tag diversity

Most of the previous studies concerning the similarity-based interaction have assumed that the change of tags just happens in the imitation stage. Individuals actually can adjust their tags whenever the environments related to these tags grow nasty. We institute a spatial model to investigate the effect of the coevolution of tag and strategy on the evolution of cooperation in the context of the Prisoner's Dilemma game. Interactions just happen between tag-identical neighbors. Individuals exploited by defectors change their current tags at a certain cost. The time-scale ratio controls how fast interaction happens relatively to selection. Results show that whenever individuals have enough chance to adapt to the environment, cooperation is greatly improved even for quite large temptation to defect. Intensive exploration reveals that both little and large costs of tag switching can further favor the establishment of cooperation. Our work may add more into the literature concerning games on adaptive networks.

Influence of opinion dynamics on the evolution of games

Under certain circumstances such as lack of information or bounded rationality, human players can take decisions on which strategy to choose in a game on the basis of simple opinions. These opinions can be modified after each round by observing own or others payoff results but can be also modified after interchanging impressions with other players. In this way, the update of the strategies can become a question that goes beyond simple evolutionary rules based on fitness and become a social issue. In this work, we explore this scenario by coupling a game with an opinion dynamics model. The opinion is represented by a continuous variable that corresponds to the certainty of the agents respect to which strategy is best. The opinions transform into actions by making the selection of an strategy a stochastic event with a probability regulated by the opinion. A certain regard for the previous round payoff is included but the main update rules of the opinion are given by a model inspired in social interchanges. We find that the fixed points of the dynamics of the coupled model are different from those of the evolutionary game or the opinion models alone. Furthermore, new features emerge such as the independence of the fraction of cooperators with respect to the topology of the social interaction network or the presence of a small fraction of extremist players.

The evolution of homophily

Biologists have devoted much attention to assortative mating or homogamy, the tendency for sexual species to mate with similar others. In contrast, there has been little theoretical work on the broader phenomenon of homophily, the tendency for individuals to interact with similar others. Yet this behaviour is also widely observed in nature. Here, we model how natural selection can give rise to homophily when individuals engage in social interaction in a population with multiple observable phenotypes. Payoffs to interactions depend on whether or not individuals have the same or different phenotypes, and each individual has a preference that determines how likely they are to interact with others of their own phenotype (homophily) or of opposite phenotypes (heterophily). The results show that homophily tends to evolve under a wide variety of conditions, helping to explain its ubiquity in nature.

Risk-driven migration and the collective-risk social dilemma

A collective-risk social dilemma implies that personal endowments will be lost if contributions to the common pool within a group are too small. Failure to reach the collective target thus has dire consequences for all group members, independently of their strategies. Wanting to move away from unfavorable locations is therefore anything but surprising. Inspired by these observations, we here propose and study a collective-risk social dilemma where players are allowed to move if the collective failure becomes too probable. More precisely, this so-called risk-driven migration is launched depending on the difference between the actual contributions and the declared target. Mobility therefore becomes an inherent property that is utilized in an entirely self-organizing manner. We show that under these assumptions cooperation is promoted much more effectively than under the action of manually determined migration rates. For the latter, we in fact identify parameter regions where the evolution of cooperation is greatly inhibited. Moreover, we find unexpected spatial patterns where cooperators that do not form compact clusters outperform those that do, and where defectors are able to utilize strikingly different ways of invasion. The presented results support the recently revealed importance of percolation for the successful evolution of public cooperation, while at the same time revealing surprisingly simple methods of self-organization towards socially desirable states.

Expectation-driven migration promotes cooperation by group interactions

"Voting with feet" describes the prominent social phenomenon that people tend to move away from deteriorating neighborhoods and search for and join prosperous groups. To quantify the role this kind of expectation-driven migration plays in the evolution of cooperation, here we study a simple yet effective model of cooperation based on spatial public goods games. The population structure is characterized by a square lattice with some nodes being left empty. Individuals have expectations toward their current habitats. Dissatisfied players, whose expectation is not met after interacting with all directly connected neighbors, tend to abstain from the groups of low quality by moving away and explore the physical niches of avail. How fast interaction happens relatively to selection is regulated by the time-scale ratio of game interaction to natural selection. Under strong selection, simulation results show that cooperation is greatly improved for either low, moderate, or high expectations compared to whenever the expectation-driven migration is absent. Further explorations reveal that neither too high nor too low but rather a combination of moderate expectations and rapid interaction establishes cooperation for a moderate public goods enhancement factor. There exists an optimal interval of expectation level most favoring the evolution of cooperation as the required time-scale ratio is minimized.

Win-stay-lose-learn promotes cooperation in the spatial prisoner's dilemma game

Holding on to one's strategy is natural and common if the later warrants success and satisfaction. This goes against widespread simulation practices of evolutionary games, where players frequently consider changing their strategy even though their payoffs may be marginally different than those of the other players. Inspired by this observation, we introduce an aspiration-based win-stay-lose-learn strategy updating rule into the spatial prisoner's dilemma game. The rule is simple and intuitive, foreseeing strategy changes only by dissatisfied players, who then attempt to adopt the strategy of one of their nearest neighbors, while the strategies of satisfied players are not subject to change. We find that the proposed win-stay-lose-learn rule promotes the evolution of cooperation, and it does so very robustly and independently of the initial conditions. In fact, we show that even a minute initial fraction of cooperators may be sufficient to eventually secure a highly cooperative final state. In addition to extensive simulation results that support our conclusions, we also present results obtained by means of the pair approximation of the studied game. Our findings continue the success story of related win-stay strategy updating rules, and by doing so reveal new ways of resolving the prisoner's dilemma.

Cooperation and age structure in spatial games

We study the evolution of cooperation in evolutionary spatial games when the payoff correlates with the increasing age of players (the level of correlation is set through a single parameter, α). The demographic heterogeneous age distribution, directly affecting the outcome of the game, is thus shown to be responsible for enhancing the cooperative behavior in the population. In particular, moderate values of α allow cooperators not only to survive but to outcompete defectors, even when the temptation to defect is large and the ageless, standard α=0 model does not sustain cooperation. The interplay between age structure and noise is also considered, and we obtain the conditions for optimal levels of cooperation.

Multivariate Moran process with Lotka-Volterra phenomenology

For a population with any given number of types, we construct a new multivariate Moran process with frequency-dependent selection and establish, analytically, a correspondence to equilibrium Lotka-Volterra phenomenology. This correspondence, on the one hand, allows us to infer the phenomenology of our Moran process based on much simpler Lokta-Volterra phenomenology and, on the other, allows us to study Lotka-Volterra dynamics within the finite populations of a Moran process. Applications to community ecology, population genetics, and evolutionary game theory are discussed.

Moving away from nasty encounters enhances cooperation in ecological prisoner's dilemma game

We study the role of migration in the evolution of cooperation. Individuals spatially located on a square lattice play the prisoner's dilemma game. Dissatisfied players, who have been exploited by defectors, tend to terminate interaction with selfish partners by leaving the current habitats, and explore unknown physical niches available surrounding them. The time scale ratio of game interaction to natural selection governs how many game rounds occur before individuals experience strategy updating. Under local migration and strong selection, simulation results demonstrate that cooperation can be stabilized for a wide range of model parameters, and the slower the natural selection, the more favorable for the emergence of cooperation. Besides, how the selection intensity affects cooperators' evolutionary fate is also investigated. We find that increasing it weakens cooperators' viability at different speeds for different time scale ratios. However, cooperation is greatly improved provided that individuals are offered with enough chance to agglomerate, while cooperation can always establish under weak selection but vanishes under very strong selection whenever individuals have less odds to migrate. Whenever the migration range restriction is removed, the parameter area responsible for the emergence of cooperation is, albeit somewhat compressed, still remarkable, validating the effectiveness of collectively migrating in promoting cooperation.

Evolution of interactions and cooperation in the spatial prisoner's dilemma game

We study the evolution of cooperation in the spatial prisoner's dilemma game where players are allowed to establish new interactions with others. By employing a simple coevolutionary rule entailing only two crucial parameters, we find that different selection criteria for the new interaction partners as well as their number vitally affect the outcome of the game. The resolution of the social dilemma is most probable if the selection favors more successful players and if their maximally attainable number is restricted. While the preferential selection of the best players promotes cooperation irrespective of game parametrization, the optimal number of new interactions depends somewhat on the temptation to defect. Our findings reveal that the "making of new friends" may be an important activity for the successful evolution of cooperation, but also that partners must be selected carefully and their number limited.

Evolutionary and population dynamics: a coupled approach

We study the interplay of population growth and evolutionary dynamics using a stochastic model based on birth and death events. In contrast to the common assumption of an independent population size, evolution can be strongly affected by population dynamics in general. Especially for fast reproducing microbes which are subject to selection, both types of dynamics are often closely intertwined. We illustrate this by considering different growth scenarios. Depending on whether microbes die or stop to reproduce (dormancy), qualitatively different behaviors emerge. For cooperating bacteria, a permanent increase of costly cooperation can occur. Even if not permanent, cooperation can still increase transiently due to demographic fluctuations. We validate our analysis via stochastic simulations and analytic calculations. In particular, we derive a condition for an increase in the level of cooperation.

Chaos and unpredictability in evolutionary dynamics in discrete time

A discrete-time version of the replicator equation for two-strategy games is studied. The stationary properties differ from those of continuous time for sufficiently large values of the parameters, where periodic and chaotic behavior replace the usual fixed-point population solutions. We observe the familiar period-doubling and chaotic-band-splitting attractor cascades of unimodal maps but in some cases more elaborate variations appear due to bimodality. Also unphysical stationary solutions can have unusual physical implications, such as the uncertainty of the final population caused by sensitivity to initial conditions and fractality of attractor preimage manifolds.

Emergence of social cohesion in a model society of greedy, mobile individuals

Human wellbeing in modern societies relies on social cohesion, which can be characterized by high levels of cooperation and a large number of social ties. Both features, however, are frequently challenged by individual self-interest. In fact, the stability of social and economic systems can suddenly break down as the recent financial crisis and outbreaks of civil wars illustrate. To understand the conditions for the emergence and robustness of social cohesion, we simulate the creation of public goods among mobile agents, assuming that behavioral changes are determined by individual satisfaction. Specifically, we study a generalized win-stay-lose-shift learning model, which is only based on previous experience and rules out greenbeard effects that would allow individuals to guess future gains. The most noteworthy aspect of this model is that it promotes cooperation in social dilemma situations despite very low information requirements and without assuming imitation, a shadow of the future, reputation effects, signaling, or punishment. We find that moderate greediness favors social cohesion by a coevolution between cooperation and spatial organization, additionally showing that those cooperation-enforcing levels of greediness can be evolutionarily selected. However, a maladaptive trend of increasing greediness, although enhancing individuals' returns in the beginning, eventually causes cooperation and social relationships to fall apart. Our model is, therefore, expected to shed light on the long-standing problem of the emergence and stability of cooperative behavior.

Dynamically generated cyclic dominance in spatial prisoner's dilemma games

We have studied the impact of time-dependent learning capacities of players in the framework of spatial prisoner's dilemma game. In our model, this capacity of players may decrease or increase in time after strategy adoption according to a steplike function. We investigated both possibilities separately and observed significantly different mechanisms that form the stationary pattern of the system. The time decreasing learning activity helps cooperator domains to recover the possible intrude of defectors hence supports cooperation. In the other case the temporary restrained learning activity generates a cyclic dominance between defector and cooperator strategies, which helps to maintain the diversity of strategies via propagating waves. The results are robust and remain valid by changing payoff values, interaction graphs or functions characterizing time dependence of learning activity. Our observations suggest that dynamically generated mechanisms may offer alternative ways to keep cooperators alive even at very larger temptation to defect.

Aspiring to the fittest and promotion of cooperation in the prisoner's dilemma game

Strategy changes are an essential part of evolutionary games. Here, we introduce a simple rule that, depending on the value of a single parameter w , influences the selection of players that are considered as potential sources of the new strategy. For positive w players with high payoffs will be considered more likely, while for negative w the opposite holds. Setting w equal to zero returns the frequently adopted random selection of the opponent. We find that increasing the probability of adopting the strategy from the fittest player within reach, i.e., setting w positive, promotes the evolution of cooperation. The robustness of this observation is tested against different levels of uncertainty in the strategy adoption process and for different interaction networks. Since the evolution to widespread defection is tightly associated with cooperators having a lower fitness than defectors, the fact that positive values of w facilitate cooperation is quite surprising. We show that the results can be explained by means of a negative feedback effect that increases the vulnerability of defectors although initially increasing their survivability. Moreover, we demonstrate that the introduction of w effectively alters the interaction network and thus also the impact of uncertainty by strategy adoptions on the evolution of cooperation.