Network reciprocity by coexisting learning and teaching strategies

Memory and target payoff enhance cooperation in evolutionary social dilemmas

We proposed a neighbor selection mechanism based on memory and target payoff, where the target payoff is the maximum value of the group's average expected payoff. According to this mechanism, individuals prioritize selecting neighbors whose average payoffs in the last M rounds are close to the target payoff for strategy learning, aiming to maximize the group's expected payoff. Simulation results on the grid-based Prisoner's Dilemma and Snowdrift games demonstrate that this mechanism can significantly improve the group's payoff and cooperation level. Furthermore, the longer the memory length, the higher the group's payoff and cooperation level. Overall, the combination of memory and target payoff can lead to the emergence and persistence of cooperation in social dilemmas as individuals are motivated to cooperate based on both their past experiences and future goals. This interplay highlights the significance of taking into account numerous variables in comprehending and promoting cooperation within evolutionary frameworks.

Mixing protocols in the public goods game

If interaction partners in social dilemma games are not selected randomly from the population but are instead determined by a network of contacts, it has far reaching consequences for the evolutionary dynamics. Selecting partners randomly leads to a well-mixed population, where pattern formation is essentially impossible. This rules out important mechanisms that can facilitate cooperation, most notably network reciprocity. In contrast, if interactions are determined by a lattice or a network, then the population is said to be structured, where cooperators can form compact clusters that protect them from invading defectors. Between these two extremes, however, there is ample middle ground that can be brought about by the consideration of temporal networks, mobility, or other coevolutionary processes. The question that we here seek to answer is, when does mixing on a lattice actually lead to well-mixed conditions? To that effect, we use the public goods game on a square lattice, and we consider nearest-neighbor and random mixing with different frequencies, as well as a mix of both mixing protocols. Not surprisingly, we find that nearest-neighbor mixing requires a higher frequency than random mixing to arrive at the well-mixed limit. The differences between the two mixing protocols are most expressed at intermediate mixing frequencies, whilst at very low and very high mixing frequencies the two almost converge. We also find a near universal exponential growth of the average size of cooperator clusters as their fraction increases from zero to one, regardless of whether this increase is due to increasing the multiplication factor of the public goods, decreasing the frequency of mixing, or gradually shifting the mixing from random to nearest neighbors.

The evolution of trust and trustworthiness

Trust and trustworthiness form the basis for continued social and economic interactions, and they are also fundamental for cooperation, fairness, honesty, and indeed for many other forms of prosocial and moral behaviour. However, trust entails risks, and building a trustworthy reputation requires effort. So how did trust and trustworthiness evolve, and under which conditions do they thrive? To find answers, we operationalize trust and trustworthiness using the trust game with the trustor's investment and the trustee's return of the investment as the two key parameters. We study this game on different networks, including the complete network, random and scale-free networks, and in the well-mixed limit. We show that in all but one case, the network structure has little effect on the evolution of trust and trustworthiness. Specifically, for well-mixed populations, lattices, random and scale-free networks, we find that trust never evolves, while trustworthiness evolves with some probability depending on the game parameters and the updating dynamics. Only for the scale-free network with degree non-normalized dynamics, we find parameter values for which trust evolves but trustworthiness does not, as well as values for which both trust and trustworthiness evolve. We conclude with a discussion about mechanisms that could lead to the evolution of trust and outline directions for future work.

Cooperation on Interdependent Networks by Means of Migration and Stochastic Imitation

Evolutionary game theory in the realm of network science appeals to a lot of research communities, as it constitutes a popular theoretical framework for studying the evolution of cooperation in social dilemmas. Recent research has shown that cooperation is markedly more resistant in interdependent networks, where traditional network reciprocity can be further enhanced due to various forms of interdependence between different network layers. However, the role of mobility in interdependent networks is yet to gain its well-deserved attention. Here we consider an interdependent network model, where individuals in each layer follow different evolutionary games, and where each player is considered as a mobile agent that can move locally inside its own layer to improve its fitness. Probabilistically, we also consider an imitation possibility from a neighbor on the other layer. We show that, by considering migration and stochastic imitation, further fascinating gateways to cooperation on interdependent networks can be observed. Notably, cooperation can be promoted on both layers, even if cooperation without interdependence would be improbable on one of the layers due to adverse conditions. Our results provide a rationale for engineering better social systems at the interface of networks and human decision making under testing dilemmas.

SDARE: A stacked denoising autoencoder method for game dynamics network structure reconstruction

Complex network is a general model to represent the interactions within technological, social, information, and biological interaction. Often, the direct detection of the interaction relationship is costly. Thus, network structure reconstruction, the inverse problem in complex networked systems, is of utmost importance for understanding many complex systems with unknown interaction structures. In addition, the data collected from real network system is often contaminated by noise, which makes the network structure inference task much more challenging. In this paper, we develop a new framework for the game dynamics network structure reconstruction based on deep learning method. In contrast to the compressive sensing methods that employ computationally complex convex/greedy algorithms to solve the network reconstruction task, we introduce a deep learning framework that can learn a structured representation from nodes data and efficiently reconstruct the game dynamics network structure with few observation data. Specifically, we propose the denoising autoencoders (DAEs) as the unsupervised feature learner to capture statistical dependencies between different nodes. Compared to the compressive sensing based method, the proposed method is a global network structure inference method, which can not only get the state-of-art performance, but also obtain the structure of network directly. Besides, the proposed method is robust to noise in the observation data. Moreover, the proposed method is also effective for the network which is not exactly sparse. Accordingly, the proposed method can extend to a wide scope of network reconstruction task in practice.

Aspiration induced interdependence leads to optimal cooperation level

How to couple different networks is a key issue in interdependent networks, where information sharing and payoff coupling are two frequently used methods. Unlike previous studies, in this paper, we propose a new coupling mode and test its performance in interdependent networks. Specifically, a player tends to seek additional support on another network only if his environment (defined as the proportion of holding different strategies in the neighborhood) is worse enough and exceeds an aspiration level. Conversely, it turns to the traditional version on single network if his environment is pleasing enough (the value of environment is small). Whether to establish additional support will directly influence the range of selecting fittest learning objects. As we can see from numerical results, moderate aspiration introduces diversity into the system and cooperation evolves with the support of network coupling. Besides, we also demonstrate that players with external links on the boundary of cooperative clusters protect internal cooperators and attract more players to cooperate under preferential selection rule.

Identification of influential invaders in evolutionary populations

The identification of the most influential nodes has been a vibrant subject of research across the whole of network science. Here we map this problem to structured evolutionary populations, where strategies and the interaction network are both subject to change over time based on social inheritance. We study cooperative communities, which cheaters can invade because they avoid the cost of contributions that are associated with cooperation. The question that we seek to answer is at which nodes cheaters invade most successfully. We propose the weighted degree decomposition to identify and rank the most influential invaders. More specifically, we distinguish two kinds of ranking based on the weighted degree decomposition. We show that a ranking strategy based on negative-weighted degree allows to successfully identify the most influential invaders in the case of weak selection, while a ranking strategy based on positive-weighted degree performs better when the selection is strong. Our research thus reveals how to identify the most influential invaders based on statistical measures in dynamically evolving cooperative communities.

Cooperation enhanced by the coevolution of teaching activity in evolutionary prisoner's dilemma games with voluntary participation

Voluntary participation, as an additional strategy involved in repeated games, has been proved to be an efficient way to promote the evolution of cooperation theoretically and empirically. Besides, current studies show that the coevolution of teaching activity can promote cooperation. Thus, inspired by aforementioned above, we investigate the effect of coevolution of teaching activity on the evolution of cooperation for prisoner's dilemma game with voluntary participation: when the focal player successfully enforces its strategy on the opponent, his teaching ability will get an increase. Through numerical simulation, we have shown that voluntary participation could effectively promote the fraction of cooperation, which is also affected by the value of increment. Furthermore, we investigate the influence of the increment value on the density of different strategies and find that there exists an optimal increment value that plays an utmost role on the evolutionary dynamics. With regard to this observation, we unveil that an optimal value of increment can lead to strongest heterogeneity in agents' teaching ability, further promoting the evolution of cooperation.

Role-separating ordering in social dilemmas controlled by topological frustration

''Three is a crowd" is an old proverb that applies as much to social interactions as it does to frustrated configurations in statistical physics models. Accordingly, social relations within a triangle deserve special attention. With this motivation, we explore the impact of topological frustration on the evolutionary dynamics of the snowdrift game on a triangular lattice. This topology provides an irreconcilable frustration, which prevents anticoordination of competing strategies that would be needed for an optimal outcome of the game. By using different strategy updating protocols, we observe complex spatial patterns in dependence on payoff values that are reminiscent to a honeycomb-like organization, which helps to minimize the negative consequence of the topological frustration. We relate the emergence of these patterns to the microscopic dynamics of the evolutionary process, both by means of mean-field approximations and Monte Carlo simulations. For comparison, we also consider the same evolutionary dynamics on the square lattice, where of course the topological frustration is absent. However, with the deletion of diagonal links of the triangular lattice, we can gradually bridge the gap to the square lattice. Interestingly, in this case the level of cooperation in the system is a direct indicator of the level of topological frustration, thus providing a method to determine frustration levels in an arbitrary interaction network.

From degree-correlated to payoff-correlated activity for an optimal resolution of social dilemmas

An active participation of players in evolutionary games depends on several factors, ranging from personal stakes to the properties of the interaction network. Diverse activity patterns thus have to be taken into account when studying the evolution of cooperation in social dilemmas. Here we study the weak prisoner's dilemma game, where the activity of each player is determined in a probabilistic manner either by its degree or by its payoff. While degree-correlated activity introduces cascading failures of cooperation that are particularly severe on scale-free networks with frequently inactive hubs, payoff-correlated activity provides a more nuanced activity profile, which ultimately hinders systemic breakdowns of cooperation. To determine optimal conditions for the evolution of cooperation, we introduce an exponential decay to payoff-correlated activity that determines how fast the activity of a player returns to its default state. We show that there exists an intermediate decay rate at which the resolution of the social dilemma is optimal. This can be explained by the emerging activity patterns of players, where the inactivity of hubs is compensated effectively by the increased activity of average-degree players, who through their collective influence in the network sustain a higher level of cooperation. The sudden drops in the fraction of cooperators observed with degree-correlated activity therefore vanish, and so does the need for the lengthy spatiotemporal reorganization of compact cooperative clusters. The absence of such asymmetric dynamic instabilities thus leads to an optimal resolution of social dilemmas, especially when the conditions for the evolution of cooperation are strongly adverse.

Stochastic win-stay-lose-shift strategy with dynamic aspirations in evolutionary social dilemmas

In times of plenty expectations rise, just as in times of crisis they fall. This can be mathematically described as a win-stay-lose-shift strategy with dynamic aspiration levels, where individuals aspire to be as wealthy as their average neighbor. Here we investigate this model in the realm of evolutionary social dilemmas on the square lattice and scale-free networks. By using the master equation and Monte Carlo simulations, we find that cooperators coexist with defectors in the whole phase diagram, even at high temptations to defect. We study the microscopic mechanism that is responsible for the striking persistence of cooperative behavior and find that cooperation spreads through second-order neighbors, rather than by means of network reciprocity that dominates in imitation-based models. For the square lattice the master equation can be solved analytically in the large temperature limit of the Fermi function, while for other cases the resulting differential equations must be solved numerically. Either way, we find good qualitative agreement with the Monte Carlo simulation results. Our analysis also reveals that the evolutionary outcomes are to a large degree independent of the network topology, including the number of neighbors that are considered for payoff determination on lattices, which further corroborates the local character of the microscopic dynamics. Unlike large-scale spatial patterns that typically emerge due to network reciprocity, here local checkerboard-like patterns remain virtually unaffected by differences in the macroscopic properties of the interaction network.

Evolutionary mixed games in structured populations: Cooperation and the benefits of heterogeneity

Evolutionary games on networks traditionally involve the same game at each interaction. Here we depart from this assumption by considering mixed games, where the game played at each interaction is drawn uniformly at random from a set of two different games. While in well-mixed populations the random mixture of the two games is always equivalent to the average single game, in structured populations this is not always the case. We show that the outcome is, in fact, strongly dependent on the distance of separation of the two games in the parameter space. Effectively, this distance introduces payoff heterogeneity, and the average game is returned only if the heterogeneity is small. For higher levels of heterogeneity the distance to the average game grows, which often involves the promotion of cooperation. The presented results support preceding research that highlights the favorable role of heterogeneity regardless of its origin, and they also emphasize the importance of the population structure in amplifying facilitators of cooperation.

Leaders should not be conformists in evolutionary social dilemmas

The most common assumption in evolutionary game theory is that players should adopt a strategy that warrants the highest payoff. However, recent studies indicate that the spatial selection for cooperation is enhanced if an appropriate fraction of the population chooses the most common rather than the most profitable strategy within the interaction range. Such conformity might be due to herding instincts or crowd behavior in humans and social animals. In a heterogeneous population where individuals differ in their degree, collective influence, or other traits, an unanswered question remains who should conform. Selecting conformists randomly is the simplest choice, but it is neither a realistic nor the optimal one. We show that, regardless of the source of heterogeneity and game parametrization, socially the most favorable outcomes emerge if the masses conform. On the other hand, forcing leaders to conform significantly hinders the constructive interplay between heterogeneity and coordination, leading to evolutionary outcomes that are worse still than if conformists were chosen randomly. We conclude that leaders must be able to create a following for network reciprocity to be optimally augmented by conformity. In the opposite case, when leaders are castrated and made to follow, the failure of coordination impairs the evolution of cooperation.

Collective punishment is more effective than collective reward for promoting cooperation

Collective punishment and reward are usually regarded as two potential mechanisms to explain the evolution of cooperation. Both scenarios, however, seem problematic to understand cooperative behavior, because they can raise the second-order free-rider problem and many organisms are not able to discriminate less cooperating individuals. Even though they have been proved to increase cooperation, there has been a debate about which one being more effective. To address this issue, we resort to the N-player evolutionary snowdrift game (NESG), where a collective punishment/reward mechanism is added by allowing some players to display punishment/reward towards all remaining players. By means of numerous simulations and analyses, we find that collective punishment is more effective in promoting cooperation for a relatively high initial frequency of cooperation or for a relatively small group. When the intensity of punishment exceeds a certain threshold, a stable state of full cooperation emerges for both small and large groups. In contrast, such state does not appear for large groups playing a NESG with reward mechanism. In the case of mutualistic interactions, finally, our results show the new payoff with collective punishment/reward can lead to the coexistence of cooperators and defectors when discrimination between these two is not possible.

Conformity enhances network reciprocity in evolutionary social dilemmas

The pursuit of highest payoffs in evolutionary social dilemmas is risky and sometimes inferior to conformity. Choosing the most common strategy within the interaction range is safer because it ensures that the payoff of an individual will not be much lower than average. Herding instincts and crowd behaviour in humans and social animals also compel to conformity in their own right. Motivated by these facts, we here study the impact of conformity on the evolution of cooperation in social dilemmas. We show that an appropriate fraction of conformists within the population introduces an effective surface tension around cooperative clusters and ensures smooth interfaces between different strategy domains. Payoff-driven players brake the symmetry in favour of cooperation and enable an expansion of clusters past the boundaries imposed by traditional network reciprocity. This mechanism works even under the most testing conditions, and it is robust against variations of the interaction network as long as degree-normalized payoffs are applied. Conformity may thus be beneficial for the resolution of social dilemmas.

Different perceptions of social dilemmas: evolutionary multigames in structured populations

Motivated by the fact that the same social dilemma can be perceived differently by different players, we here study evolutionary multigames in structured populations. While the core game is the weak prisoner's dilemma, a fraction of the population adopts either a positive or a negative value of the sucker's payoff, thus playing either the traditional prisoner's dilemma or the snowdrift game. We show that the higher the fraction of the population adopting a different payoff matrix the more the evolution of cooperation is promoted. The microscopic mechanism responsible for this outcome is unique to structured populations, and it is due to the payoff heterogeneity, which spontaneously introduces strong cooperative leaders that give rise to an asymmetric strategy imitation flow in favor of cooperation. We demonstrate that the reported evolutionary outcomes are robust against variations of the interaction network, and they also remain valid if players are allowed to vary which game they play over time. These results corroborate existing evidence in favor of heterogeneity-enhanced network reciprocity, and they reveal how different perceptions of social dilemmas may contribute to their resolution.

Optimal distribution of incentives for public cooperation in heterogeneous interaction environments

In the framework of evolutionary games with institutional reciprocity, limited incentives are at disposal for rewarding cooperators and punishing defectors. In the simplest case, it can be assumed that, depending on their strategies, all players receive equal incentives from the common pool. The question arises, however, what is the optimal distribution of institutional incentives? How should we best reward and punish individuals for cooperation to thrive? We study this problem for the public goods game on a scale-free network. We show that if the synergetic effects of group interactions are weak, the level of cooperation in the population can be maximized simply by adopting the simplest “equal distribution” scheme. If synergetic effects are strong, however, it is best to reward high-degree nodes more than low-degree nodes. These distribution schemes for institutional rewards are independent of payoff normalization. For institutional punishment, however, the same optimization problem is more complex, and its solution depends on whether absolute or degree-normalized payoffs are used. We find that degree-normalized payoffs require high-degree nodes be punished more lenient than low-degree nodes. Conversely, if absolute payoffs count, then high-degree nodes should be punished stronger than low-degree nodes.

Defection and extortion as unexpected catalysts of unconditional cooperation in structured populations

We study the evolution of cooperation in the spatial prisoner's dilemma game, where besides unconditional cooperation and defection, tit-for-tat, win-stay-lose-shift and extortion are the five competing strategies. While pairwise imitation fails to sustain unconditional cooperation and extortion regardless of game parametrization, myopic updating gives rise to the coexistence of all five strategies if the temptation to defect is sufficiently large or if the degree distribution of the interaction network is heterogeneous. This counterintuitive evolutionary outcome emerges as a result of an unexpected chain of strategy invasions. Firstly, defectors emerge and coarsen spontaneously among players adopting win-stay-lose-shift. Secondly, extortioners and players adopting tit-for-tat emerge and spread via neutral drift among the emerged defectors. And lastly, among the extortioners, cooperators become viable too. These recurrent evolutionary invasions yield a five-strategy phase that is stable irrespective of the system size and the structure of the interaction network, and they reveal the most unexpected mechanism that stabilizes extortion and cooperation in an evolutionary setting.

Degree mixing in multilayer networks impedes the evolution of cooperation

Traditionally, the evolution of cooperation has been studied on single, isolated networks. Yet a player, especially in human societies, will typically be a member of many different networks, and those networks will play different roles in the evolutionary process. Multilayer networks are therefore rapidly gaining on popularity as the more apt description of a networked society. With this motivation, we here consider two-layer scale-free networks with all possible combinations of degree mixing, wherein one network layer is used for the accumulation of payoffs and the other is used for strategy updating. We find that breaking the symmetry through assortative mixing in one layer and/or disassortative mixing in the other layer, as well as preserving the symmetry by means of assortative mixing in both layers, impedes the evolution of cooperation. We use degree-dependent distributions of strategies and cluster-size analysis to explain these results, which highlight the importance of hubs and the preservation of symmetry between multilayer networks for the successful resolution of social dilemmas.

Facilitators on networks reveal optimal interplay between information exchange and reciprocity

Reciprocity is firmly established as an important mechanism that promotes cooperation. An efficient information exchange is likewise important, especially on structured populations, where interactions between players are limited. Motivated by these two facts, we explore the role of facilitators in social dilemmas on networks. Facilitators are here mirrors to their neighbors-they cooperate with cooperators and defect with defectors-but they do not participate in the exchange of strategies. As such, in addition to introducing direct reciprocity, they also obstruct information exchange. In well-mixed populations, facilitators favor the replacement and invasion of defection by cooperation as long as their number exceeds a critical value. In structured populations, on the other hand, there exists a delicate balance between the benefits of reciprocity and the deterioration of information exchange. Extensive Monte Carlo simulations of social dilemmas on various interaction networks reveal that there exists an optimal interplay between reciprocity and information exchange, which sets in only when a small number of facilitators occupy the main hubs of the scale-free network. The drawbacks of missing cooperative hubs are more than compensated for by reciprocity and, at the same time, the compromised information exchange is routed via the auxiliary hubs with only marginal losses in effectivity. These results indicate that it is not always optimal for the main hubs to become leaders of the masses, but rather to exploit their highly connected state to promote tit-for-tat-like behavior.

Role of investment heterogeneity in the cooperation on spatial public goods game

Public cooperation plays a significant role in the survival and maintenance of biological species, to elucidate its origin thus becomes an interesting question from various disciplines. Through long-term development, the public goods game has proven to be a useful tool, where cooperator making contribution can beat again the free-rides. Differentiating from the traditional homogeneous investment, individual trend of making contribution is more likely affected by the investment level of his neighborhood. Based on this fact, we here investigate the impact of heterogeneous investment on public cooperation, where the investment sum is mapped to the proportion of cooperators determined by parameter α. Interestingly, we find, irrespective of interaction networks, that the increment of α (increment of heterogeneous investment) is beneficial for promoting cooperation and even guarantees the complete cooperation dominance under weak replication factor. While this promotion effect can be attributed to the formation of more robust cooperator clusters and shortening END period. Moreover, we find that this simple mechanism can change the potential interaction network, which results in the change of phase diagrams. We hope that our work may shed light on the understanding of the cooperative behavior in other social dilemmas.

Spontaneous symmetry breaking in interdependent networked game

Spatial evolution game has traditionally assumed that players interact with direct neighbors on a single network, which is isolated and not influenced by other systems. However, this is not fully consistent with recent research identification that interactions between networks play a crucial rule for the outcome of evolutionary games taking place on them. In this work, we introduce the simple game model into the interdependent networks composed of two networks. By means of imitation dynamics, we display that when the interdependent factor α is smaller than a threshold value α(C), the symmetry of cooperation can be guaranteed. Interestingly, as interdependent factor exceeds α(C), spontaneous symmetry breaking of fraction of cooperators presents itself between different networks. With respect to the breakage of symmetry, it is induced by asynchronous expansion between heterogeneous strategy couples of both networks, which further enriches the content of spatial reciprocity. Moreover, our results can be well predicted by the strategy-couple pair approximation method.

Evolution of extortion in structured populations

Extortion strategies can dominate any opponent in an iterated prisoner's dilemma game. But if players are able to adopt the strategies performing better, extortion becomes widespread and evolutionary unstable. It may sometimes act as a catalyst for the evolution of cooperation, and it can also emerge in interactions between two populations, yet it is not the evolutionarily stable outcome. Here we revisit these results in the realm of spatial games. We find that pairwise imitation and birth-death dynamics return known evolutionary outcomes. Myopic best response strategy updating, on the other hand, reveals counterintuitive solutions. Defectors and extortioners coarsen spontaneously, which allows cooperators to prevail even at prohibitively high temptations to defect. Here extortion strategies play the role of a Trojan horse. They may emerge among defectors by chance, and once they do, cooperators become viable as well. These results are independent of the interaction topology, and they highlight the importance of coarsening, checkerboard ordering, and best response updating in evolutionary games.

Understanding recurrent crime as system-immanent collective behavior

Containing the spreading of crime is a major challenge for society. Yet, since thousands of years, no effective strategy has been found to overcome crime. To the contrary, empirical evidence shows that crime is recurrent, a fact that is not captured well by rational choice theories of crime. According to these, strong enough punishment should prevent crime from happening. To gain a better understanding of the relationship between crime and punishment, we consider that the latter requires prior discovery of illicit behavior and study a spatial version of the inspection game. Simulations reveal the spontaneous emergence of cyclic dominance between "criminals", "inspectors", and "ordinary people" as a consequence of spatial interactions. Such cycles dominate the evolutionary process, in particular when the temptation to commit crime or the cost of inspection are low or moderate. Yet, there are also critical parameter values beyond which cycles cease to exist and the population is dominated either by a stable mixture of criminals and inspectors or one of these two strategies alone. Both continuous and discontinuous phase transitions to different final states are possible, indicating that successful strategies to contain crime can be very much counter-intuitive and complex. Our results demonstrate that spatial interactions are crucial for the evolutionary outcome of the inspection game, and they also reveal why criminal behavior is likely to be recurrent rather than evolving towards an equilibrium with monotonous parameter dependencies.

Costly advertising and the evolution of cooperation

In this paper, I investigate the co-evolution of fast and slow strategy spread and game strategies in populations of spatially distributed agents engaged in a one off evolutionary dilemma game. Agents are characterized by a pair of traits, a game strategy (cooperate or defect) and a binary ‘advertising’ strategy (advertise or don’t advertise). Advertising, which comes at a cost , allows investment into faster propagation of the agents’ traits to adjacent individuals. Importantly, game strategy and advertising strategy are subject to the same evolutionary mechanism. Via analytical reasoning and numerical simulations I demonstrate that a range of advertising costs exists, such that the prevalence of cooperation is significantly enhanced through co-evolution. Linking costly replication to the success of cooperators exposes a novel co-evolutionary mechanism that might contribute towards a better understanding of the origins of cooperation-supporting heterogeneity in agent populations.

Coevolution of quantum and classical strategies on evolving random networks

We study the coevolution of quantum and classical strategies on weighted and directed random networks in the realm of the prisoner's dilemma game. During the evolution, agents can break and rewire their links with the aim of maximizing payoffs, and they can also adjust the weights to indicate preferences, either positive or negative, towards their neighbors. The network structure itself is thus also subject to evolution. Importantly, the directionality of links does not affect the accumulation of payoffs nor the strategy transfers, but serves only to designate the owner of each particular link and with it the right to adjust the link as needed. We show that quantum strategies outperform classical strategies, and that the critical temptation to defect at which cooperative behavior can be maintained rises, if the network structure is updated frequently. Punishing neighbors by reducing the weights of their links also plays an important role in maintaining cooperation under adverse conditions. We find that the self-organization of the initially random network structure, driven by the evolutionary competition between quantum and classical strategies, leads to the spontaneous emergence of small average path length and a large clustering coefficient.

Difference of reciprocity effect in two coevolutionary models of presumed two-player and multiplayer games

Unlike other natural network systems, assortativity can be observed in most human social networks; however, it has been reported that a social dilemma situation represented by a 2×2 prisoner's dilemma game favors dissortativity to enhance cooperation. Our simulations successfully reveal that a public goods game with coevolution for both agents' strategy and network topology encourages assortativity, although it only slightly enhances cooperation as compared to a 2×2 donor and recipient game with a strong dilemma to be solved. This outcome occurs because the network dynamics in a multiplayer game discourages emerging cooperation unlike its beneficial result in a 2×2 prisoner's dilemma game.

Decelerated invasion and waning-moon patterns in public goods games with delayed distribution

We study the evolution of cooperation in the spatial public goods game, focusing on the effects that are brought about by the delayed distribution of goods that accumulate in groups due to the continuous investments of cooperators. We find that intermediate delays enhance network reciprocity because of a decelerated invasion of defectors, who are unable to reap the same high short-term benefits as they do in the absence of delayed distribution. Long delays, however, introduce a risk because the large accumulated wealth might fall into the wrong hands. Indeed, as soon as the curvature of a cooperative cluster turns negative, the engulfed defectors can collect the heritage of many generations of cooperators and by doing so start a waning-moon pattern that nullifies the benefits of decelerated invasion. Accidental meeting points of growing cooperative clusters may also act as triggers for the waning-moon effect, thus linking the success of cooperators with their propensity to fail in a rather bizarre way. Our results highlight that "investing in the future" is a good idea only if that future is sufficiently near and not likely to be burdened by inflation.

Evolution of emotions on networks leads to the evolution of cooperation in social dilemmas

We show that the resolution of social dilemmas in random graphs and scale-free networks is facilitated by imitating not the strategy of better-performing players but, rather, their emotions. We assume sympathy and envy to be the two emotions that determine the strategy of each player in any given interaction, and we define them as the probabilities of cooperating with players having a lower and a higher payoff, respectively. Starting with a population where all possible combinations of the two emotions are available, the evolutionary process leads to a spontaneous fixation to a single emotional profile that is eventually adopted by all players. However, this emotional profile depends not only on the payoffs but also on the heterogeneity of the interaction network. Homogeneous networks, such as lattices and regular random graphs, lead to fixations that are characterized by high sympathy and high envy, while heterogeneous networks lead to low or modest sympathy but also low envy. Our results thus suggest that public emotions and the propensity to cooperate at large depend, and are in fact determined by, the properties of the interaction network.

Short versus long term benefits and the evolution of cooperation in the prisoner's dilemma game

In this paper I investigate the evolution of cooperation in the prisoner's dilemma when individuals change their strategies subject to performance evaluation of their neighbours over variable time horizons. In the monochrome setting, in which all agents per default share the same performance evaluation rule, weighing past events strongly dramatically enhances the prevalence of cooperators. For co-evolutionary models, in which evaluation time horizons and strategies can co-evolve, I demonstrate that cooperation naturally associates with long-term evaluation of others while defection is typically paired with very short time horizons. Moreover, considering the continuous spectrum in between enhanced and discounted weights of past performance, cooperation is optimally supported when cooperators neither give enhanced weight to past nor more recent events, but simply average payoffs. Payoff averaging is also found to emerge as the dominant strategy for cooperators in co-evolutionary models, thus proposing a natural route to the evolution of cooperation in viscous populations.

Spreading of cooperative behaviour across interdependent groups

Recent empirical research has shown that links between groups reinforce individuals within groups to adopt cooperative behaviour. Moreover, links between networks may induce cascading failures, competitive percolation, or contribute to efficient transportation. Here we show that there in fact exists an intermediate fraction of links between groups that is optimal for the evolution of cooperation in the prisoner's dilemma game. We consider individual groups with regular, random, and scale-free topology, and study their different combinations to reveal that an intermediate interdependence optimally facilitates the spreading of cooperative behaviour between groups. Excessive between-group links simply unify the two groups and make them act as one, while too rare between-group links preclude a useful information flow between the two groups. Interestingly, we find that between-group links are more likely to connect two cooperators than in-group links, thus supporting the conclusion that they are of paramount importance.

Optimal interdependence between networks for the evolution of cooperation

Recent research has identified interactions between networks as crucial for the outcome of evolutionary games taking place on them. While the consensus is that interdependence does promote cooperation by means of organizational complexity and enhanced reciprocity that is out of reach on isolated networks, we here address the question just how much interdependence there should be. Intuitively, one might assume the more the better. However, we show that in fact only an intermediate density of sufficiently strong interactions between networks warrants an optimal resolution of social dilemmas. This is due to an intricate interplay between the heterogeneity that causes an asymmetric strategy flow because of the additional links between the networks, and the independent formation of cooperative patterns on each individual network. Presented results are robust to variations of the strategy updating rule, the topology of interdependent networks, and the governing social dilemma, thus suggesting a high degree of universality.

Wisdom of groups promotes cooperation in evolutionary social dilemmas

Whether or not to change strategy depends not only on the personal success of each individual, but also on the success of others. Using this as motivation, we study the evolution of cooperation in games that describe social dilemmas, where the propensity to adopt a different strategy depends both on individual fitness as well as on the strategies of neighbors. Regardless of whether the evolutionary process is governed by pairwise or group interactions, we show that plugging into the “wisdom of groups” strongly promotes cooperative behavior. The more the wider knowledge is taken into account the more the evolution of defectors is impaired. We explain this by revealing a dynamically decelerated invasion process, by means of which interfaces separating different domains remain smooth and defectors therefore become unable to efficiently invade cooperators. This in turn invigorates spatial reciprocity and establishes decentralized decision making as very beneficial for resolving social dilemmas.