Coevolutionary games on networks

Temporal interaction and its role in the evolution of cooperation

This research investigates the impact of dynamic, time-varying interactions on cooperative behavior in social dilemmas. Traditional research has focused on deterministic rules governing pairwise interactions, yet the impact of interaction frequency and synchronization in groups on cooperation remains underexplored. Addressing this gap, our work introduces two temporal interaction mechanisms to model the stochastic or periodic participation of individuals in public goods games, acknowledging real-life variances due to exogenous temporal factors and geographical time differences. We consider that the interaction state significantly influences both game payoff calculations and the strategy updating process, offering new insights into the emergence and sustainability of cooperation. Our results indicate that maximum game participation frequency is suboptimal under a stochastic interaction mechanism. Instead, an intermediate activation probability maximizes cooperation, suggesting a vital balance between interaction frequency and inactivity security. Furthermore, local synchronization of interactions within specific areas is shown to be beneficial, as time differences hinder the spread of cross-structures but promote the formation of dense cooperative clusters with smoother boundaries. We also note that stronger clustering in networks, larger group sizes, and lower noise increase cooperation. This research contributes to understanding the role of node-based temporality and probabilistic interactions in social dilemmas, offering insights into fostering cooperation.

Two-stage strategy update rule based on learning cost in weak prisoner's dilemma

When players are dissatisfied with their actual payoffs, they will change the actuality by learning strategy of neighbors. The more effort players put in, the more likely they are to succeed in learning. Inspired by this, this paper proposes a two-stage strategy update rule based on learning cost. The players first decide whether to learn strategy according to the updating willingness. If the players imitate the strategy of neighbors, they need to pay the learning cost. Results show that for the well-mixed population, if the updating willingness is homogeneous and remains unchanged, reducing the updating willingness or increasing the learning cost can extend the life cycle of cooperators. If the updating willingness is heterogeneous and dynamically adjusted based on the difference between the actual payoff and the expected payoff, increasing aspiration value and learning cost promotes cooperation. For the structured population, if the updating willingness is homogeneous and remains unchanged, the moderate learning cost is beneficial for cooperators to resist the temptation of defection, and reducing updating willingness makes the system maintain cooperation within a larger parameter range. If the updating willingness is heterogeneous and dynamically adjusted, the larger learning cost and the appropriate aspiration value promote cooperation. This study highlights the complex dynamics of cooperation in paid strategy learning, contributing to the theory of cooperation in the evolutionary game.

The Polarization of the Coupling Strength of Interdependent Networks Stimulates Cooperation

We introduce a mixed network coupling mechanism and study its effects on how cooperation evolves in interdependent networks. This mechanism allows some players (conservative-driven) to establish a fixed-strength coupling, while other players (radical-driven) adjust their coupling strength through the evolution of strategy. By means of numerical simulation, a hump-like relationship between the level of cooperation and conservative participant density is revealed. Interestingly, interspecies interactions stimulate polarization of the coupling strength of radical-driven players, promoting cooperation between two types of players. We thus demonstrate that a simple mixed network coupling mechanism substantially expands the scope of cooperation among structured populations.

Critical phenomena and strategy ordering with hub centrality approach in the aspiration-based coordination game

We study the coordination game with an aspiration-driven update rule in regular graphs and scale-free networks. We prove that the model coincides exactly with the Ising model and shows a phase transition at the critical selection noise when the aspiration level is zero. It is found that the critical selection noise decreases with clustering in random regular graphs. With a non-zero aspiration level, the model also exhibits a phase transition as long as the aspiration level is smaller than the degree of graphs. We also show that the critical exponents are independent of clustering and aspiration level to confirm that the coordination game belongs to the Ising universality class. As for scale-free networks, the effect of aspiration level on the order parameter at a low selection noise is examined. In model networks (the Barabási-Albert network and the Holme-Kim network), the order parameter abruptly decreases when the aspiration level is the same as the average degree of the network. In contrast, in real-world networks, the order parameter decreases gradually. We explain this difference by proposing the concepts of hub centrality and local hub. The histogram of hub centrality of real-world networks separates into two parts unlike model networks, and local hubs exist only in real-world networks. We conclude that the difference of network structures in model and real-world networks induces qualitatively different behavior in the coordination game.

Modeling and analyzing users’ behavioral strategies with co-evolutionary process

Social networking services (SNSs) are constantly used by a large number of people with various motivations and intentions depending on their social relationships and purposes, and thus, resulting in diverse strategies of posting/consuming content on SNSs. Therefore, it is important to understand the differences of the individual strategies depending on their network locations and surroundings. For this purpose, by using a game-theoretical model of users called agents and proposing a co-evolutionary algorithm called multiple-world genetic algorithm to evolve diverse strategy for each user, we investigated the differences in individual strategies and compared the results in artificial networks and those of the Facebook ego network. From our experiments, we found that agents did not select the free rider strategy, which means that just reading the articles and comments posted by other users, in the Facebook network, although this strategy is usually cost-effective and usually appeared in the artificial networks. We also found that the agents who mainly comment on posted articles/comments and rarely post their own articles appear in the Facebook network but do not appear in the connecting nearest-neighbor networks, although we think that this kind of user actually exists in real-world SNSs. Our experimental simulation also revealed that the number of friends was a crucial factor to identify users’ strategies on SNSs through the analysis of the impact of the differences in the reward for a comment on various ego networks.

A game-theoretical dynamic imitation model on networks

A game-theoretical model is constructed to capture the effect of imitation on the evolution of cooperation. This imitation describes the case where successful individuals are more likely to be imitated by newcomers who will employ their strategies and social networks. Two classical repeated strategies 'always defect (ALLD)' and 'tit-for-tat (TFT)' are adopted. Mathematical analyses are mainly conducted by the method of coalescence theory. Under the assumption of a large population size and weak selection, the results show that the evolution of cooperation is promoted in this dynamic network. As we observed that the critical benefit-to-cost ratio is smaller compared to that in well-mixed populations. The critical benefit-to-cost ratio approaches a specific value which depends on three parameters, the repeated rounds of the game, the effective strategy mutation rate, and the effective link mutation rate. Specifically, for a very high value of the effective link mutation rate, the critical benefit-to-cost ratio approaches 1. Remarkably, for a low value of the effective link mutation rate, by letting the effective strategy mutation is nearly equal to zero, the critical benefit-to-cost ratio approaches [Formula: see text] for the resulting highly connected networks, which allows TFT to be evolutionary stable. It illustrates that dominance of TFTs is associated with more connected networks. This research can enrich the theory of the coevolution of game strategy and network structure with dynamic imitation.

Mixing protocols in the public goods game

If interaction partners in social dilemma games are not selected randomly from the population but are instead determined by a network of contacts, it has far reaching consequences for the evolutionary dynamics. Selecting partners randomly leads to a well-mixed population, where pattern formation is essentially impossible. This rules out important mechanisms that can facilitate cooperation, most notably network reciprocity. In contrast, if interactions are determined by a lattice or a network, then the population is said to be structured, where cooperators can form compact clusters that protect them from invading defectors. Between these two extremes, however, there is ample middle ground that can be brought about by the consideration of temporal networks, mobility, or other coevolutionary processes. The question that we here seek to answer is, when does mixing on a lattice actually lead to well-mixed conditions? To that effect, we use the public goods game on a square lattice, and we consider nearest-neighbor and random mixing with different frequencies, as well as a mix of both mixing protocols. Not surprisingly, we find that nearest-neighbor mixing requires a higher frequency than random mixing to arrive at the well-mixed limit. The differences between the two mixing protocols are most expressed at intermediate mixing frequencies, whilst at very low and very high mixing frequencies the two almost converge. We also find a near universal exponential growth of the average size of cooperator clusters as their fraction increases from zero to one, regardless of whether this increase is due to increasing the multiplication factor of the public goods, decreasing the frequency of mixing, or gradually shifting the mixing from random to nearest neighbors.

Best response dynamics improve sustainability and equity outcomes in common-pool resources problems, compared to imitation dynamics

Shared resource extraction among profit-seeking individuals involves a tension between individual benefit and the collective well-being represented by the persistence of the resource. Many game theoretic models explore this scenario, but these models tend to assume either best response dynamics (where individuals instantly switch to better paying strategies) or imitation dynamics (where individuals copy successful strategies from neighbours), and do not systematically compare predictions under the two assumptions. Here we propose an iterated game on a social network with payoff functions that depend on the state of the resource. Agents harvest the resource, and the strategy composition of the population evolves until an equilibrium is reached. The system is then repeatedly perturbed and allowed to re-equilibrate. We compare model predictions under best response and imitation dynamics. Compared to imitation dynamics, best response dynamics increase sustainability of the system, the persistence of cooperation while decreasing inequality and debt corresponding to the Gini index in the agents' cumulative payoffs. Additionally, for best response dynamics, the number of strategy switches before equilibrium fits a power-law distribution under a subset of the parameter space, suggesting the system is in a state of self-organized criticality. We find little variation in most mean results over different network topologies; however, there is significant variation in the distributions of the raw data, equality of payoff, clustering of like strategies and power-law fit. We suggest the primary mechanisms driving the difference in sustainability between the two strategy update rules to be the clustering of like strategies as well as the time delay imposed by an imitation processes. Given the strikingly different outcomes for best response versus imitation dynamics for common-pool resource systems, our results suggest that modellers should choose strategy update rules that best represent decision-making in their study systems.

DR-SCIR Public Opinion Propagation Model with Direct Immunity and Social Reinforcement Effect

The DR-SCIR network public opinion propagation model was employed to study the characters of S-state users stopping transmitting information for the first time and secondary transmission of immune users. The model takes into account symmetry and complexity such as direct immunization and social reinforcement effect, proposes the probability of direct immunity Psr and the probability of transform from the immune state to the hesitant state Prc, and divides public opinion information into positive public opinion and negative public opinion based on whether the public opinion information is confirmed. Simulation results show that, when direct immunity Psr = 0.5, the density of I-state nodes in the model decreased by 54.12% at the peak index; when the positive social reinforcement effect factor b = 10, the density of I-state nodes in the model increased by 16.67% at the peak index; and when the negative social reinforcement effect factor b = -10, the density of I-state nodes in the model decreased by 55.36% at the peak index. It shows that increasing the positive social reinforcement effect factor b can promote the spread of positive public opinion, reducing the negative social reinforcement effect factor b can control the spread of negative public opinion, and direct immunization can effectively suppress the spread of public opinion. This model can help us better analyze the rules of public opinion on social networks, so as to maintain a healthy and harmonious network and social environment.

Motion, fixation probability and the choice of an evolutionary process

Seemingly minor details of mathematical and computational models of evolution are known to change the effect of population structure on the outcome of evolutionary processes. For example, birth-death dynamics often result in amplification of selection, while death-birth processes have been associated with suppression. In many biological populations the interaction structure is not static. Instead, members of the population are in motion and can interact with different individuals at different times. In this work we study populations embedded in a flowing medium; the interaction network is then time dependent. We use computer simulations to investigate how this dynamic structure affects the success of invading mutants, and compare these effects for different coupled birth and death processes. Specifically, we show how the speed of the motion impacts the fixation probability of an invading mutant. Flows of different speeds interpolate between evolutionary dynamics on fixed heterogeneous graphs and well-stirred populations; this allows us to systematically compare against known results for static structured populations. We find that motion has an active role in amplifying or suppressing selection by fragmenting and reconnecting the interaction graph. While increasing flow speeds suppress selection for most evolutionary models, we identify characteristic responses to flow for the different update rules we test. In particular we find that selection can be maximally enhanced or suppressed at intermediate flow speeds.

Whether a mutation spreads in a population or not is one of the most important questions in biology. The evolution of cancer and antibiotic resistance, for example, are mediated by invading mutants. Recent work has shown that population structure can have important consequences for the outcome of evolution. For instance, a mutant can have a higher or a lower chance of invasion than in unstructured populations. These effects can depend on seemingly minor details of the evolutionary model, such as the order of birth and death events. Many biological populations are in motion, for example due to external stirring. Experimentally this is known to be important; the performance of mutants in E. coli populations, for example, depends on the rate of mixing. Here, we focus on simulations of populations in a flowing medium, and compare the success of a mutant for different flow speeds. We contrast different evolutionary models, and identify what features of the evolutionary model affect mutant success for different speeds of the flow. We find that the chance of mutant invasion can be at its highest (or lowest) at intermediate flow speeds, depending on the order in which birth and death events occur in the evolutionary process.

Cooperation in the spatial prisoner's dilemma game with probabilistic abstention

Research has shown that the addition of abstention as an option transforms social dilemmas to rock-paper-scissor type games, where defectors dominate cooperators, cooperators dominate abstainers (loners), and abstainers (loners), in turn, dominate defectors. In this way, abstention can sustain cooperation even under adverse conditions, although defection also persists due to cyclic dominance. However, to abstain or to act as a loner has, to date, always been considered as an independent, third strategy to complement traditional cooperation and defection. Here we consider probabilistic abstention, where each player is assigned a probability to abstain in a particular instance of the game. In the two limiting cases, the studied game reverts to the prisoner's dilemma game without loners or to the optional prisoner's dilemma game. For intermediate probabilities, we have a new hybrid game, which turns out to be most favorable for the successful evolution of cooperation. We hope this novel hybrid game provides a more realistic view of the dilemma of optional/voluntary participation.

Evolutionary prisoner's dilemma games coevolving on adaptive networks

We study a model for switching strategies in the Prisoner's Dilemma game on adaptive networks of player pairings that coevolve as players attempt to maximize their return. We use a node-based strategy model wherein each player follows one strategy at a time (cooperate or defect) across all of its neighbors, changing that strategy and possibly changing partners in response to local changes in the network of player pairing and in the strategies used by connected partners. We compare and contrast numerical simulations with existing pair approximation differential equations for describing this system, as well as more accurate equations developed here using the framework of approximate master equations. We explore the parameter space of the model, demonstrating the relatively high accuracy of the approximate master equations for describing the system observations made from simulations. We study two variations of this partner-switching model to investigate the system evolution, predict stationary states, and compare the total utilities and other qualitative differences between these two model variants.

From rationality to cooperativeness: The totally mixed Nash equilibrium in Markov strategies in the iterated Prisoner's Dilemma

In this research, the social behavior of the participants in a Prisoner's Dilemma laboratory game is explained on the basis of the quantal response equilibrium concept and the representation of the game in Markov strategies. In previous research, we demonstrated that social interaction during the experiment has a positive influence on cooperation, trust, and gratefulness. This research shows that the quantal response equilibrium concept agrees only with the results of experiments on cooperation in Prisoner’s Dilemma prior to social interaction. However, quantal response equilibrium does not explain of participants’ behavior after social interaction. As an alternative theoretical approach, an examination was conducted of iterated Prisoner's Dilemma game in Markov strategies. We built a totally mixed Nash equilibrium in this game; the equilibrium agrees with the results of the experiments both before and after social interaction.

A remarkable effect of the combination of probabilistic peer-punishment and coevolutionary mechanism on the evolution of cooperation

In the previous studies, the author has proposed the probabilistic peer-punishment based on the difference of payoff, and presented that the proposed peer-punishment utilizes its mechanism for preventing antisocial punishment like retaliation of a defector on a cooperator, effectively enhances the evolution of cooperation, and greatly increases the average payoff of all players in various parameters regarding static three types of topology of connections. Here, this study introduces both activities of breaking and creating connections of every player based on his/her preference to the model of the proposed peer-punishment. Every player will keep connections with his/her preferable players, whereas he/she will frequently break connections with his/her dissatisfied other players. Therefore, the new model of this study is the combination of probabilistic peer-punishment and coevolutionary mechanism that not only strategy of players but also connections between players evolve. This study discovers new knowledge that such combination induces high-level evolution of cooperation and great increase of the average payoff of all players in the condition where cooperation is hard to evolve.

Effects of local network topology on the functional reconstruction of spiking neural network models

The representation of information flow through structural networks, as depicted by functional networks, does not coincide exactly with the anatomical configuration of the networks. Model free correlation methods including transfer entropy (TE) and a Gaussian convolution-based correlation method (CC) detect functional networks, i.e. temporal correlations in spiking activity among neurons, and depict information flow as a graph. The influence of synaptic topology on these functional correlations is not well-understood, though nonrandom features of the resulting functional structure (e.g. small-worldedness, motifs) are believed to play a crucial role in information-processing. We apply TE and CC to simulated networks with prescribed small-world and recurrence properties to obtain functional reconstructions which we compare with the underlying synaptic structure using multiplex networks. In particular, we examine the effects of the surrounding local synaptic circuitry on functional correlations by comparing dyadic and triadic subgraphs within the structural and functional graphs in order to explain recurring patterns of information flow on the level of individual neurons. Statistical significance is demonstrated by employing randomized null models and Z-scores, and results are obtained for functional networks reconstructed across a range of correlation-threshold values. From these results, we observe that certain triadic structural subgraphs have strong influence over functional topology.

Utility Evaluation Based on One-To-N Mapping in the Prisoner's Dilemma Game for Interdependent Networks

In the field of evolutionary game theory, network reciprocity has become an important means to promote the level of promotion within the population system. Recently, the interdependency provides a novel perspective to understand the widespread cooperation behavior in many real-world systems. In previous works, interdependency is often built from the direct or indirect connections between two networks through the one-to-one mapping mode. However, under many realistic scenarios, players may need much more information from many neighboring agents so as to make a more rational decision. Thus, beyond the one-to-one mapping mode, we investigate the cooperation behavior on two interdependent lattices, in which the utility evaluation of a focal player on one lattice may not only concern himself, but also integrate the payoff information of several corresponding players on the other lattice. Large quantities of simulations indicate that the cooperation can be substantially promoted when compared to the traditionally spatial lattices. The cluster formation and phase transition are also analyzed in order to explore the role of interdependent utility coupling in the collective cooperation. Current results are beneficial to deeply understand various mechanisms to foster the cooperation exhibited inside natural, social and engineering systems.

Evolutionary Games of Multiplayer Cooperation on Graphs

There has been much interest in studying evolutionary games in structured populations, often modeled as graphs. However, most analytical results so far have only been obtained for two-player or linear games, while the study of more complex multiplayer games has been usually tackled by computer simulations. Here we investigate evolutionary multiplayer games on graphs updated with a Moran death-Birth process. For cycles, we obtain an exact analytical condition for cooperation to be favored by natural selection, given in terms of the payoffs of the game and a set of structure coefficients. For regular graphs of degree three and larger, we estimate this condition using a combination of pair approximation and diffusion approximation. For a large class of cooperation games, our approximations suggest that graph-structured populations are stronger promoters of cooperation than populations lacking spatial structure. Computer simulations validate our analytical approximations for random regular graphs and cycles, but show systematic differences for graphs with many loops such as lattices. In particular, our simulation results show that these kinds of graphs can even lead to more stringent conditions for the evolution of cooperation than well-mixed populations. Overall, we provide evidence suggesting that the complexity arising from many-player interactions and spatial structure can be captured by pair approximation in the case of random graphs, but that it need to be handled with care for graphs with high clustering.

Cooperation can be defined as the act of providing fitness benefits to other individuals, often at a personal cost. When interactions occur mainly with neighbors, assortment of strategies can favor cooperation but local competition can undermine it. Previous research has shown that a single coefficient can capture this trade-off when cooperative interactions take place between two players. More complicated, but also more realistic, models of cooperative interactions involving multiple players instead require several such coefficients, making it difficult to assess the effects of population structure. Here, we obtain analytical approximations for the coefficients of multiplayer games in graph-structured populations. Computer simulations show that, for particular instances of multiplayer games, these approximate coefficients predict the condition for cooperation to be promoted in random graphs well, but fail to do so in graphs with more structure, such as lattices. Our work extends and generalizes established results on the evolution of cooperation on graphs, but also highlights the importance of explicitly taking into account higher-order statistical associations in order to assess the evolutionary dynamics of cooperation in spatially structured populations.

Fostering cooperation of selfish agents through public goods in relation to the loners

Altruistic behaviors in multiplayer groups have obtained great attention in the context of the public goods game, which poses a riddle from the evolutionary viewpoint. Here we focus on a particular type of public goods game model in which the benefits of cooperation are either discounted or synergistically enhanced at the appearance of multiple cooperators in a group. Moreover, we focus on the three-strategies profile by adding the role of loners, besides the often-used cooperation and defection. Using the replicator dynamic equations, we investigate a range of dynamical portraits that characterizes the properties of the steady state. Analysis results indicate that loners and cooperators both have chances to be the stable equilibrium points in the presence of perturbations, while defectors fail to do so in this three-strategy competition. Moreover, the coexistence state, in which all three strategies exist in equilibrium, can be led by suitable parameters and stabilized for perturbations. These results elucidate the interplay between the characteristics of the public goods game and evolutionary dynamics in well-mixed systems.

Leaders should not be conformists in evolutionary social dilemmas

The most common assumption in evolutionary game theory is that players should adopt a strategy that warrants the highest payoff. However, recent studies indicate that the spatial selection for cooperation is enhanced if an appropriate fraction of the population chooses the most common rather than the most profitable strategy within the interaction range. Such conformity might be due to herding instincts or crowd behavior in humans and social animals. In a heterogeneous population where individuals differ in their degree, collective influence, or other traits, an unanswered question remains who should conform. Selecting conformists randomly is the simplest choice, but it is neither a realistic nor the optimal one. We show that, regardless of the source of heterogeneity and game parametrization, socially the most favorable outcomes emerge if the masses conform. On the other hand, forcing leaders to conform significantly hinders the constructive interplay between heterogeneity and coordination, leading to evolutionary outcomes that are worse still than if conformists were chosen randomly. We conclude that leaders must be able to create a following for network reciprocity to be optimally augmented by conformity. In the opposite case, when leaders are castrated and made to follow, the failure of coordination impairs the evolution of cooperation.

Heterogeneous Coupling between Interdependent Lattices Promotes the Cooperation in the Prisoner's Dilemma Game

In the research realm of game theory, interdependent networks have extended the content of spatial reciprocity, which needs the suitable coupling between networks. However, thus far, the vast majority of existing works just assume that the coupling strength between networks is symmetric. This hypothesis, to some extent, seems inconsistent with the ubiquitous observation of heterogeneity. Here, we study how the heterogeneous coupling strength, which characterizes the interdependency of utility between corresponding players of both networks, affects the evolution of cooperation in the prisoner's dilemma game with two types of coupling schemes (symmetric and asymmetric ones). Compared with the traditional case, we show that heterogeneous coupling greatly promotes the collective cooperation. The symmetric scheme seems much better than the asymmetric case. Moreover, the role of varying amplitude of coupling strength is also studied on these two interdependent ways. Current findings are helpful for us to understand the evolution of cooperation within many real-world systems, in particular for the interconnected and interrelated systems.

Population Fluctuation Promotes Cooperation in Networks

We consider the problem of explaining the emergence and evolution of cooperation in dynamic network-structured populations. Building on seminal work by Poncela et al., which shows how cooperation (in one-shot prisoner's dilemma) is supported in growing populations by an evolutionary preferential attachment (EPA) model, we investigate the effect of fluctuations in the population size. We find that a fluctuating model - based on repeated population growth and truncation - is more robust than Poncela et al.'s in that cooperation flourishes for a wider variety of initial conditions. In terms of both the temptation to defect, and the types of strategies present in the founder network, the fluctuating population is found to lead more securely to cooperation. Further, we find that this model will also support the emergence of cooperation from pre-existing non-cooperative random networks. This model, like Poncela et al.'s, does not require agents to have memory, recognition of other agents, or other cognitive abilities, and so may suggest a more general explanation of the emergence of cooperation in early evolutionary transitions, than mechanisms such as kin selection, direct and indirect reciprocity.

Universal scaling for the dilemma strength in evolutionary games

Why would natural selection favor the prevalence of cooperation within the groups of selfish individuals? A fruitful framework to address this question is evolutionary game theory, the essence of which is captured in the so-called social dilemmas. Such dilemmas have sparked the development of a variety of mathematical approaches to assess the conditions under which cooperation evolves. Furthermore, borrowing from statistical physics and network science, the research of the evolutionary game dynamics has been enriched with phenomena such as pattern formation, equilibrium selection, and self-organization. Numerous advances in understanding the evolution of cooperative behavior over the last few decades have recently been distilled into five reciprocity mechanisms: direct reciprocity, indirect reciprocity, kin selection, group selection, and network reciprocity. However, when social viscosity is introduced into a population via any of the reciprocity mechanisms, the existing scaling parameters for the dilemma strength do not yield a unique answer as to how the evolutionary dynamics should unfold. Motivated by this problem, we review the developments that led to the present state of affairs, highlight the accompanying pitfalls, and propose new universal scaling parameters for the dilemma strength. We prove universality by showing that the conditions for an ESS and the expressions for the internal equilibriums in an infinite, well-mixed population subjected to any of the five reciprocity mechanisms depend only on the new scaling parameters. A similar result is shown to hold for the fixation probability of the different strategies in a finite, well-mixed population. Furthermore, by means of numerical simulations, the same scaling parameters are shown to be effective even if the evolution of cooperation is considered on the spatial networks (with the exception of highly heterogeneous setups). We close the discussion by suggesting promising directions for future research including (i) how to handle the dilemma strength in the context of co-evolution and (ii) where to seek opportunities for applying the game theoretical approach with meaningful impact.

Macroscopic description of complex adaptive networks coevolving with dynamic node states

In many real-world complex systems, the time evolution of the network's structure and the dynamic state of its nodes are closely entangled. Here we study opinion formation and imitation on an adaptive complex network which is dependent on the individual dynamic state of each node and vice versa to model the coevolution of renewable resources with the dynamics of harvesting agents on a social network. The adaptive voter model is coupled to a set of identical logistic growth models and we mainly find that, in such systems, the rate of interactions between nodes as well as the adaptive rewiring probability are crucial parameters for controlling the sustainability of the system's equilibrium state. We derive a macroscopic description of the system in terms of ordinary differential equations which provides a general framework to model and quantify the influence of single node dynamics on the macroscopic state of the network. The thus obtained framework is applicable to many fields of study, such as epidemic spreading, opinion formation, or socioecological modeling.

Dependency links can hinder the evolution of cooperation in the prisoner's dilemma game on lattices and networks

Networks with dependency links are more vulnerable when facing the attacks. Recent research also has demonstrated that the interdependent groups support the spreading of cooperation. We study the prisoner's dilemma games on spatial networks with dependency links, in which a fraction of individual pairs is selected to depend on each other. The dependency individuals can gain an extra payoff whose value is between the payoff of mutual cooperation and the value of temptation to defect. Thus, this mechanism reflects that the dependency relation is stronger than the relation of ordinary mutual cooperation, but it is not large enough to cause the defection of the dependency pair. We show that the dependence of individuals hinders, promotes and never affects the cooperation on regular ring networks, square lattice, random and scale-free networks, respectively. The results for the square lattice and regular ring networks are demonstrated by the pair approximation.

Conformity enhances network reciprocity in evolutionary social dilemmas

The pursuit of highest payoffs in evolutionary social dilemmas is risky and sometimes inferior to conformity. Choosing the most common strategy within the interaction range is safer because it ensures that the payoff of an individual will not be much lower than average. Herding instincts and crowd behaviour in humans and social animals also compel to conformity in their own right. Motivated by these facts, we here study the impact of conformity on the evolution of cooperation in social dilemmas. We show that an appropriate fraction of conformists within the population introduces an effective surface tension around cooperative clusters and ensures smooth interfaces between different strategy domains. Payoff-driven players brake the symmetry in favour of cooperation and enable an expansion of clusters past the boundaries imposed by traditional network reciprocity. This mechanism works even under the most testing conditions, and it is robust against variations of the interaction network as long as degree-normalized payoffs are applied. Conformity may thus be beneficial for the resolution of social dilemmas.

Quality versus quantity of social ties in experimental cooperative networks

Recent studies suggest that allowing individuals to choose their partners can help to maintain cooperation in human social networks; this behaviour can supplement behavioural reciprocity, whereby humans are influenced to cooperate by peer pressure. However, it is unknown how the rate of forming and breaking social ties affects our capacity to cooperate. Here we use a series of online experiments involving 1,529 unique participants embedded in 90 experimental networks, to show that there is a ‘Goldilocks’ effect of network dynamism on cooperation. When the rate of change in social ties is too low, subjects choose to have many ties, even if they attach to defectors. When the rate is too high, cooperators cannot detach from defectors as much as defectors re-attach and, hence, subjects resort to behavioural reciprocity and switch their behaviour to defection. Optimal levels of cooperation are achieved at intermediate levels of change in social ties.

The effect of the rate of forming and breaking social ties on cooperative behaviour is not clear. Here the authors experimentally test the effect of rewiring the connections between individuals, and find that optimal levels of cooperation are achieved at intermediate levels of change in ties.

Degree mixing in multilayer networks impedes the evolution of cooperation

Traditionally, the evolution of cooperation has been studied on single, isolated networks. Yet a player, especially in human societies, will typically be a member of many different networks, and those networks will play different roles in the evolutionary process. Multilayer networks are therefore rapidly gaining on popularity as the more apt description of a networked society. With this motivation, we here consider two-layer scale-free networks with all possible combinations of degree mixing, wherein one network layer is used for the accumulation of payoffs and the other is used for strategy updating. We find that breaking the symmetry through assortative mixing in one layer and/or disassortative mixing in the other layer, as well as preserving the symmetry by means of assortative mixing in both layers, impedes the evolution of cooperation. We use degree-dependent distributions of strategies and cluster-size analysis to explain these results, which highlight the importance of hubs and the preservation of symmetry between multilayer networks for the successful resolution of social dilemmas.

Evolutionary prisoner's dilemma on evolving random networks

In this paper, we investigate the evolution of cooperation in the spatial prisoner's dilemma game by incorporating partner choice into the framework of evolutionary game theory. Our research shows that the introduction of partner choice can notably promote the cooperative behavior in the prisoner's dilemma game. All the players are more likely to play the game with cooperators, which makes it easier for cooperators to form alliances. In particular, the system will be dominated completely by cooperators in a comfortable environment (i.e., with lower survival cost) because the cooperators can get more benefits than the defectors in this case due to their good reputation. In addition, we have found that the sustenance of cooperators improves notably as well in the snowdrift game and the stag-hunt game due to this introduction.

Multiopinion coevolving voter model with infinitely many phase transitions

We consider an idealized model in which individuals' changing opinions and their social network coevolve, with disagreements between neighbors in the network resolved either through one imitating the opinion of the other or by reassignment of the discordant edge. Specifically, an interaction between x and one of its neighbors y leads to x imitating y with probability (1-α) and otherwise (i.e., with probability α) x cutting its tie to y in order to instead connect to a randomly chosen individual. Building on previous work about the two-opinion case, we study the multiple-opinion situation, finding that the model has infinitely many phase transitions (in the large graph limit with infinitely many initial opinions). Moreover, the formulas describing the end states of these processes are remarkably simple when expressed as a function of β=α/(1-α).

Effect of initial fraction of cooperators on cooperative behavior in evolutionary prisoner's dilemma game

We investigate the influence of initial fraction of cooperators on the evolution of cooperation in spatial prisoner's dilemma games. Compared with the results of heterogeneous networks, we find that there is a relatively low initial fraction of cooperators to guarantee higher equilibrium cooperative level. While this interesting phenomenon is contrary to the commonly shared knowledge that higher initial fraction of cooperators can provide better environment for the evolution of cooperation. To support our outcome, we explore the time courses of cooperation and find that the whole course can be divided into two sequent stages: enduring (END) and expanding (EXP) periods. At the end of END period, thought there is a limited number of cooperator clusters left for the case of low initial setup, these clusters can smoothly expand to hold the whole system in the EXP period. However, for high initial fraction of cooperators, superfluous cooperator clusters hinder their effective expansion, which induces many remaining defectors surrounding the cooperator clusters. Moreover, through intensive analysis, we also demonstrate that when the tendency of three cooperation cluster characteristics (cluster size, cluster number and cluster shape) are consistent within END and EXP periods, the state that maximizes cooperation can be favored.

Effects of adaptive degrees of trust on coevolution of quantum strategies on scale-free networks

We study the impact of adaptive degrees of trust on the evolution of cooperation in the quantum prisoner's dilemma game. In addition to the strategies, links between players are also subject to evolution. Starting with a scale-free interaction network, players adjust trust towards their neighbors based on received payoffs. The latter governs the strategy adoption process, while trust governs the rewiring of links. As soon as the degree of trust towards a neighbor drops to zero, the link is rewired to another randomly chosen player within the network. We find that for small temptations to defect cooperators always dominate, while for intermediate and strong temptations a single quantum strategy is able to outperform all other strategies. In general, reciprocal trust remains within close relationships and favors the dominance of a single strategy. Due to coevolution, the power-law degree distributions transform to Poisson distributions.

Coevolution of quantum and classical strategies on evolving random networks

We study the coevolution of quantum and classical strategies on weighted and directed random networks in the realm of the prisoner's dilemma game. During the evolution, agents can break and rewire their links with the aim of maximizing payoffs, and they can also adjust the weights to indicate preferences, either positive or negative, towards their neighbors. The network structure itself is thus also subject to evolution. Importantly, the directionality of links does not affect the accumulation of payoffs nor the strategy transfers, but serves only to designate the owner of each particular link and with it the right to adjust the link as needed. We show that quantum strategies outperform classical strategies, and that the critical temptation to defect at which cooperative behavior can be maintained rises, if the network structure is updated frequently. Punishing neighbors by reducing the weights of their links also plays an important role in maintaining cooperation under adverse conditions. We find that the self-organization of the initially random network structure, driven by the evolutionary competition between quantum and classical strategies, leads to the spontaneous emergence of small average path length and a large clustering coefficient.

Coupled adaptive complex networks

Adaptive networks, which combine topological evolution of the network with dynamics on the network, are ubiquitous across disciplines. Examples include technical distribution networks such as road networks and the internet, natural and biological networks, and social science networks. These networks often interact with or depend upon other networks, resulting in coupled adaptive networks. In this paper we study susceptible-infected-susceptible (SIS) epidemic dynamics on coupled adaptive networks, where susceptible nodes are able to avoid contact with infected nodes by rewiring their intranetwork connections. However, infected nodes can pass the disease through internetwork connections, which do not change with time: The dependencies between the coupled networks remain constant. We develop an analytical formalism for these systems and validate it using extensive numerical simulation. We find that stability is increased by increasing the number of internetwork links, in the sense that the range of parameters over which both endemic and healthy states coexist (both states are reachable depending on the initial conditions) becomes smaller. Finally, we find a new stable state that does not appear in the case of a single adaptive network but only in the case of weakly coupled networks, in which the infection is endemic in one network but neither becomes endemic nor dies out in the other. Instead, it persists only at the nodes that are coupled to nodes in the other network through internetwork links. We speculate on the implications of these findings.

Partner switching promotes cooperation among myopic agents on a geographical plane

We study the coupling dynamics between the evolution of cooperation and the evolution of partnership network on a geographical plane. While agents play networked prisoner's dilemma games, they can dynamically adjust their partnerships based on local information about reputation. We incorporate geographical features into the process of the agent's partner switching and investigate the corresponding effects. At each time step of the coevolution, a random agent can either update his strategy by imitation or adjust his partnership by switching from the lowest reputation partner to the highest reputation one among his neighbors. We differentiate two types of neighbors: geographical neighbors (i.e., the set of agents who are close to the focal agent in terms of geographical distance) and connectivity neighbors (i.e., the set of agents who are close to the focal agent in the partnership network in terms of geodesic distance). We find that switching to either geographical neighbors or connectivity neighbors enhances cooperation greatly in a wide parameter range. Cooperation can be favored in a much stricter condition when agents switch to connectivity neighbors more frequently. However, an increasing tendency of reconnecting to geographical neighbors shortens the geographical distance between a pair of partners on average. When agents consider the cost of geographical distance in adjusting the partnership, they are prone to reconnect to geographical neighbors.

Interdependent network reciprocity in evolutionary games

Besides the structure of interactions within networks, also the interactions between networks are of the outmost importance. We therefore study the outcome of the public goods game on two interdependent networks that are connected by means of a utility function, which determines how payoffs on both networks jointly influence the success of players in each individual network. We show that an unbiased coupling allows the spontaneous emergence of interdependent network reciprocity, which is capable to maintain healthy levels of public cooperation even in extremely adverse conditions. The mechanism, however, requires simultaneous formation of correlated cooperator clusters on both networks. If this does not emerge or if the coordination process is disturbed, network reciprocity fails, resulting in the total collapse of cooperation. Network interdependence can thus be exploited effectively to promote cooperation past the limits imposed by isolated networks, but only if the coordination between the interdependent networks is not disturbed.

Optimal interdependence between networks for the evolution of cooperation

Recent research has identified interactions between networks as crucial for the outcome of evolutionary games taking place on them. While the consensus is that interdependence does promote cooperation by means of organizational complexity and enhanced reciprocity that is out of reach on isolated networks, we here address the question just how much interdependence there should be. Intuitively, one might assume the more the better. However, we show that in fact only an intermediate density of sufficiently strong interactions between networks warrants an optimal resolution of social dilemmas. This is due to an intricate interplay between the heterogeneity that causes an asymmetric strategy flow because of the additional links between the networks, and the independent formation of cooperative patterns on each individual network. Presented results are robust to variations of the strategy updating rule, the topology of interdependent networks, and the governing social dilemma, thus suggesting a high degree of universality.

Adaptive and bounded investment returns promote cooperation in spatial public goods games

The public goods game is one of the most famous models for studying the evolution of cooperation in sizable groups. The multiplication factor in this game can characterize the investment return from the public good, which may be variable depending on the interactive environment in realistic situations. Instead of using the same universal value, here we consider that the multiplication factor in each group is updated based on the differences between the local and global interactive environments in the spatial public goods game, but meanwhile limited to within a certain range. We find that the adaptive and bounded investment returns can significantly promote cooperation. In particular, full cooperation can be achieved for high feedback strength when appropriate limitation is set for the investment return. Also, we show that the fraction of cooperators in the whole population can become larger if the lower and upper limits of the multiplication factor are increased. Furthermore, in comparison to the traditionally spatial public goods game where the multiplication factor in each group is identical and fixed, we find that cooperation can be better promoted if the multiplication factor is constrained to adjust between one and the group size in our model. Our results highlight the importance of the locally adaptive and bounded investment returns for the emergence and dominance of cooperative behavior in structured populations.

Graph fission in an evolving voter model

We consider a simplified model of a social network in which individuals have one of two opinions (called 0 and 1) and their opinions and the network connections coevolve. Edges are picked at random. If the two connected individuals hold different opinions then, with probability 1 - α, one imitates the opinion of the other; otherwise (i.e., with probability α), the link between them is broken and one of them makes a new connection to an individual chosen at random (i) from those with the same opinion or (ii) from the network as a whole. The evolution of the system stops when there are no longer any discordant edges connecting individuals with different opinions. Letting ρ be the fraction of voters holding the minority opinion after the evolution stops, we are interested in how ρ depends on α and the initial fraction u of voters with opinion 1. In case (i), there is a critical value α(c) which does not depend on u, with ρ ≈ u for α > α(c) and ρ ≈ 0 for α < α(c). In case (ii), the transition point α(c)(u) depends on the initial density u. For α > α(c)(u), ρ ≈ u, but for α < α(c)(u), we have ρ(α,u) = ρ(α,1/2). Using simulations and approximate calculations, we explain why these two nearly identical models have such dramatically different phase transitions.

Conditional strategies and the evolution of cooperation in spatial public goods games

The fact that individuals will most likely behave differently in different situations begets the introduction of conditional strategies. Inspired by this, we study the evolution of cooperation in the spatial public goods game, where, besides unconditional cooperators and defectors, also different types of conditional cooperators compete for space. Conditional cooperators will contribute to the public good only if other players within the group are likely to cooperate as well but will withhold their contribution otherwise. Depending on the number of other cooperators that are required to elicit cooperation of a conditional cooperator, the latter can be classified in as many types as there are players within each group. We find that the most cautious cooperators, who require all other players within a group to be conditional cooperators, are the undisputed victors of the evolutionary process, even at very low synergy factors. We show that the remarkable promotion of cooperation is due primarily to the spontaneous emergence of quarantining of defectors, who become surrounded by conditional cooperators and are forced into isolated convex "bubbles" from which they are unable to exploit the public good. This phenomenon can be observed only in structured populations, thus adding to the relevance of pattern formation for the successful evolution of cooperation.

Limited memory can be beneficial for the evolution of cooperation

In this study we analyze the effect of working memory capacity on the evolution of cooperation and show a case in which societies with strongly limited memory achieve higher levels of cooperation than societies with larger memory. Agents in our evolutionary model are arranged on a network and interact in a prisoner's dilemma with their neighbors. They learn from their own experience and that of their neighbors in the network about the past behavior of others and use this information when making their choices. Each agent can only process information from her last h interactions. We show that if memory (h) is too short, cooperation does not emerge in the long run. A slight increase of memory length to around 5-10 periods, though, can lead to largely cooperative societies. Longer memory, on the other hand, is detrimental to cooperation in our model.

Cooperation and age structure in spatial games

We study the evolution of cooperation in evolutionary spatial games when the payoff correlates with the increasing age of players (the level of correlation is set through a single parameter, α). The demographic heterogeneous age distribution, directly affecting the outcome of the game, is thus shown to be responsible for enhancing the cooperative behavior in the population. In particular, moderate values of α allow cooperators not only to survive but to outcompete defectors, even when the temptation to defect is large and the ageless, standard α=0 model does not sustain cooperation. The interplay between age structure and noise is also considered, and we obtain the conditions for optimal levels of cooperation.

Dynamic social networks promote cooperation in experiments with humans

Human populations are both highly cooperative and highly organized. Human interactions are not random but rather are structured in social networks. Importantly, ties in these networks often are dynamic, changing in response to the behavior of one's social partners. This dynamic structure permits an important form of conditional action that has been explored theoretically but has received little empirical attention: People can respond to the cooperation and defection of those around them by making or breaking network links. Here, we present experimental evidence of the power of using strategic link formation and dissolution, and the network modification it entails, to stabilize cooperation in sizable groups. Our experiments explore large-scale cooperation, where subjects' cooperative actions are equally beneficial to all those with whom they interact. Consistent with previous research, we find that cooperation decays over time when social networks are shuffled randomly every round or are fixed across all rounds. We also find that, when networks are dynamic but are updated only infrequently, cooperation again fails. However, when subjects can update their network connections frequently, we see a qualitatively different outcome: Cooperation is maintained at a high level through network rewiring. Subjects preferentially break links with defectors and form new links with cooperators, creating an incentive to cooperate and leading to substantial changes in network structure. Our experiments confirm the predictions of a set of evolutionary game theoretic models and demonstrate the important role that dynamic social networks can play in supporting large-scale human cooperation.

Evolution of interactions and cooperation in the spatial prisoner's dilemma game

We study the evolution of cooperation in the spatial prisoner's dilemma game where players are allowed to establish new interactions with others. By employing a simple coevolutionary rule entailing only two crucial parameters, we find that different selection criteria for the new interaction partners as well as their number vitally affect the outcome of the game. The resolution of the social dilemma is most probable if the selection favors more successful players and if their maximally attainable number is restricted. While the preferential selection of the best players promotes cooperation irrespective of game parametrization, the optimal number of new interactions depends somewhat on the temptation to defect. Our findings reveal that the "making of new friends" may be an important activity for the successful evolution of cooperation, but also that partners must be selected carefully and their number limited.

Stability of strategies in payoff-driven evolutionary games on networks

We consider a network of coupled agents playing the Prisoner's Dilemma game, in which players are allowed to pick a strategy in the interval [0, 1], with 0 corresponding to defection, 1 to cooperation, and intermediate values representing mixed strategies in which each player may act as a cooperator or a defector over a large number of interactions with a certain probability. Our model is payoff-driven, i.e., we assume that the level of accumulated payoff at each node is a relevant parameter in the selection of strategies. Also, we consider that each player chooses his∕her strategy in a context of limited information. We present a deterministic nonlinear model for the evolution of strategies. We show that the final strategies depend on the network structure and on the choice of the parameters of the game. We find that polarized strategies (pure cooperator∕defector states) typically emerge when (i) the network connections are sparse, (ii) the network degree distribution is heterogeneous, (iii) the network is assortative, and surprisingly, (iv) the benefit of cooperation is high.

Success-driven distribution of public goods promotes cooperation but preserves defection

Established already in Biblical times, the Matthew effect refers to the fact that in societies the rich tend to get richer and the potent even more powerful. Here we investigate a game theoretical model describing the evolution of cooperation on structured populations where the distribution of public goods is driven by the reproductive success of individuals. Phase diagrams reveal that cooperation is promoted irrespective of the uncertainty by strategy adoptions and the type of interaction graph, yet the complete dominance of cooperators is elusive due to the spontaneous emergence of superpersistent defectors that owe their survival to extremely rare microscopic patterns. This indicates that success-driven mechanisms are crucial for effectively harvesting benefits from collective actions but that they may also account for the observed persistence of maladaptive behavior.

Role of adaptive migration in promoting cooperation in spatial games

Recent work has revealed that success-driven migration can promote cooperation among selfish individuals in evolutionary games. This migration mechanism relies, however, on nonlocal information about the states of the individuals and their computational capabilities for prediction. We investigate the role of adaptive migration in cooperative behavior in the framework of spatial game by proposing an alternative migration strategy that requires only local information obtainable through game interactions. Our results demonstrate that adaptive migration can be effective in promoting cooperation in two ways. First, there exists an optimal degree of migration associated with the density of empty sites and migration speed, which leads to the highest level of cooperation. Second, adaptive migration can induce an outbreak of cooperation from an environment dominated by defectors. These findings hold for common types of evolutionary games that involve pairwise interactions.