Competition of individual and institutional punishments in spatial public goods games

Revisiting institutional punishment in the N-person prisoner's dilemma

The conflict between individual and collective interests makes fostering cooperation in human societies a challenging task, requiring drastic measures such as the establishment of sanctioning institutions. These institutions are costly because they have to be maintained regardless of the presence or absence of offenders. Here, we revisit some improvements to the standard N-person prisoner's dilemma formulation with institutional punishment in a well-mixed population, namely the elimination of overpunishment, the requirement of a minimum number of contributors to establish the sanctioning institution, and the sharing of its maintenance costs once this minimum number is reached. In addition, we focus on large groups or communities for which sanctioning institutions are ubiquitous. Using the replicator equation framework for an infinite population, we find that by sufficiently fining players who fail to contribute either to the public good or to the sanctioning institution, a population of contributors immune to invasion by these free riders can be established, provided that the contributors are sufficiently numerous. In a finite population, we use finite-size scaling to show that, for some parameter settings, demographic noise helps to fixate the strategy that contributes to the public good but not to the sanctioning institution even for infinitely large populations when, somewhat counterintuitively, its proportion in the initial population vanishes with a small power of the population size.

Cooperation in public goods games: Leveraging other-regarding reinforcement learning on hypergraphs

Cooperation is a self-organized collective behavior. It plays a significant role in the evolution of both ecosystems and human society. Reinforcement learning is different from imitation learning, offering a new perspective for exploring cooperation mechanisms. However, most existing studies with the public goods game (PGG) employ a self-regarding setup or are on pairwise interaction networks. Players in the real world, however, optimize their policies based not only on their histories but also on the histories of their coplayers, and the game is played in a group manner. In this work, we investigate the evolution of cooperation in the PGG under the other-regarding reinforcement learning evolutionary game on hypergraph by combining the Q-learning algorithm and evolutionary game framework, where other players' action history is incorporated and the game is played on hypergraphs. Our results show that as the synergy factor r[over ̂] increases, the parameter interval divides into three distinct regions-the absence of cooperation, medium cooperation, and high cooperation-accompanied by two abrupt transitions in the cooperation level near r[over ̂]_{1}^{*} and r[over ̂]_{2}^{*}, respectively. Interestingly, we identify regular and anticoordinated chessboard structures in the spatial pattern that positively contribute to the first cooperation transition but adversely affect the second. Furthermore, we provide a theoretical treatment for the first transition with an approximated r[over ̂]_{1}^{*} and reveal that players with a long-sighted perspective and low exploration rate are more likely to reciprocate kindness with each other, thus facilitating the emergence of cooperation. Our findings contribute to understanding the evolution of human cooperation, where other-regarding information and group interactions are commonplace.

Emergence of cooperation under punishment: A reinforcement learning perspective

Punishment is a common tactic to sustain cooperation and has been extensively studied for a long time. While most of previous game-theoretic work adopt the imitation learning framework where players imitate the strategies of those who are better off, the learning logic in the real world is often much more complex. In this work, we turn to the reinforcement learning paradigm, where individuals make their decisions based upon their experience and long-term returns. Specifically, we investigate the prisoners' dilemma game with a Q-learning algorithm, and cooperators probabilistically pose punishment on defectors in their neighborhood. Unexpectedly, we find that punishment could lead to either continuous or discontinuous cooperation phase transitions, and the nucleation process of cooperation clusters is reminiscent of the liquid-gas transition. The analysis of a Q-table reveals the evolution of the underlying "psychologic" changes, which explains the nucleation process and different levels of cooperation. The uncovered first-order phase transition indicates that great care needs to be taken when implementing the punishment compared to the continuous scenario.

Evolutionary dynamics of any multiplayer game on regular graphs

Multiplayer games on graphs are at the heart of theoretical descriptions of key evolutionary processes that govern vital social and natural systems. However, a comprehensive theoretical framework for solving multiplayer games with an arbitrary number of strategies on graphs is still missing. Here, we solve this by drawing an analogy with the Balls-and-Boxes problem, based on which we show that the local configuration of multiplayer games on graphs is equivalent to distributing k identical co-players among n distinct strategies. We use this to derive the replicator equation for any n-strategy multiplayer game under weak selection, which can be solved in polynomial time. As an example, we revisit the second-order free-riding problem, where costly punishment cannot truly resolve social dilemmas in a well-mixed population. Yet, in structured populations, we derive an accurate threshold for the punishment strength, beyond which punishment can either lead to the extinction of defection or transform the system into a rock-paper-scissors-like cycle. The analytical solution also qualitatively agrees with the phase diagrams that were previously obtained for non-marginal selection strengths. Our framework thus allows an exploration of any multi-strategy multiplayer game on regular graphs.

Antisocial peer exclusion does not eliminate the effectiveness of prosocial peer exclusion in structured populations

While prosocial exclusion has been proposed as a mechanism to maintain cooperation in one-shot social dilemma games, the evolution of prosocial peer exclusion in response to the threat of antisocial peer exclusion, particularly in structured populations, remains insufficiently understood. In this study, we employ an extended spatial public goods game to investigate the evolution of prosocial peer exclusion and its impact on cooperation in the presence of both prosocial and antisocial peer exclusion. Our model encompasses four primary strategies: traditional cooperation and defection, prosocial peer exclusion targeting defectors, and antisocial peer exclusion targeting cooperators. Our findings illuminate that the presence of antisocial peer exclusion significantly disrupts network reciprocity and suppresses cooperation. However, when coexisting with prosocial peer exclusion, it does not undermine the latter's efficacy in upholding cooperation, except in scenarios with low exclusion costs Unlike the cooperation-sustaining cyclic dominance pattern observed in the exclusive presence of prosocial peer exclusion, the co-presence of prosocial and antisocial peer exclusion gives rise to more intricate pathways for maintaining cooperation. These pathways include cyclic dominance involving traditional cooperation, prosocial peer exclusion, and antisocial peer exclusion, or a similar pattern involving traditional defection and the two exclusion strategies, or even cyclic dominance among all four strategies. In essence, our study enhances the theoretical framework concerning the effectiveness of the prosocial exclusion strategy, contributing to a more comprehensive understanding of its dynamics.

Cooperation with dynamic asymmetric evaluation in complex networks from a risk perspective

The choice of strategy exposes individuals to the risk of betrayal. This induces individuals' irrational tendencies in strategy selection, which further influences the emergence of cooperative behavior. However, the underlying mechanisms connecting risk perception and the emergence of cooperation are still not fully understood. To address this, the classic evolutionary game model on complex networks is extended. We depict the interaction between strategy imitation and payoff evaluation from two perspectives: dynamic adjustment and irrational assessment. Specifically, the probability distortion involved in the dynamic selection of imitative reference points, as well as the asymmetric psychological utility associated with reference point dependence, is emphasized. Monte Carlo simulations demonstrate that individual irrational cognition induced by the risk of strategy selection can promote the emergence of cooperative behavior. Among them, the risk sensitivity within psychological utility has the most significant moderating effect. Moreover, the promoting effect of strong heterogeneity and high clustering in the network topology on cooperation under risk scenarios has been clarified. Additionally, the influence of initial states on the emergence of cooperation follows a step-like pattern. This research offers valuable insights for further exploring the cooperation mechanisms among irrational agents, even in scenarios involving the regulation of group cooperation behavior in risky situations.

Self-serving reward and punishment: evidence from the laboratory

Reward for altruism and punishment for selfishness are crucial components for the maintenance of society. Past studies have provided strong evidence that people are willing to incur costs to punish selfish behaviors and to reward altruistic behaviors, but how their willingness to do so depends on their relationship with the individuals conducting the anti-social or pro-social behaviors is much less explored. To probe into this question, we devised a three-stage experiment that combined a revised dictator game and third-party reward or punishment. We employed two payoff frameworks, alignment and conflict, and analyzed how third-party's willingness to reward and punish differed when their interests were either aligned or in conflict with the first-party under observation. We found that due to considerations for personal interests, third-party's reward and punishment levels deviated from what was deemed "legitimate" by society, that is, the level of reward and punishment that enhances society's intrinsic motivations to comply with social norms and act pro-socially. When an anti-social behavior was observed, third-party punished less severely under the alignment framework than under the conflict framework; when a pro-social behavior was observed, third-party demonstrated self-serving reward under the alignment framework, but they rewarded altruistically under the conflict framework. These findings provided evidence for third-party's self-serving reward and punishment.

Emerging solutions from the battle of defensive alliances

Competing strategies in an evolutionary game model, or species in a biosystem, can easily form a larger unit which protects them from the invasion of an external actor. Such a defensive alliance may have two, three, four or even more members. But how effective can be such formation against an alternative group composed by other competitors? To address this question we study a minimal model where a two-member and a four-member alliances fight in a symmetric and balanced way. By presenting representative phase diagrams, we systematically explore the whole parameter range which characterizes the inner dynamics of the alliances and the intensity of their interactions. The group formed by a pair, who can exchange their neighboring positions, prevail in the majority of the parameter region. The rival quartet can only win if their inner cyclic invasion rate is significant while the mixing rate of the pair is extremely low. At specific parameter values, when neither of the alliances is strong enough, new four-member solutions emerge where a rock-paper-scissors-like trio is extended by the other member of the pair. These new solutions coexist hence all six competitors can survive. The evolutionary process is accompanied by serious finite-size effects which can be mitigated by appropriately chosen prepared initial states.

When costly migration helps to improve cooperation

Motion is a typical reaction among animals and humans trying to reach better conditions in a changing world. This aspect has been studied intensively in social dilemmas where competing players' individual and collective interests are in conflict. Starting from the traditional public goods game model, where players are locally fixed and unconditional cooperators or defectors are present, we introduce two additional strategies through which agents can change their positions of dependence on the local cooperation level. More importantly, these so-called sophisticated players should bear an extra cost to maintain their permanent capacity to evaluate their neighborhood and react accordingly. Hence, four strategies compete, and the most successful one can be imitated by its neighbors. Crucially, the introduction of costly movement has a highly biased consequence on the competing main strategies. In the majority of parameter space, it is harmful to defectors and provides a significantly higher cooperation level when the population is rare. At an intermediate population density, which would be otherwise optimal for a system of immobile players, the presence of mobile actors could be detrimental if the interaction pattern changes slightly, thereby blocking the optimal percolation of information flow. In this parameter space, sophisticated cooperators can also show the co-called Moor effect by first avoiding the harmful vicinity of defectors; they subsequently transform into an immobile cooperator state. Hence, paradoxically, the additional cost of movement could be advantageous to reach a higher general income, especially for a rare population when subgroups would be isolated otherwise.

The probabilistic pool punishment proportional to the difference of payoff outperforms previous pool and peer punishment

The public goods game is a multiplayer version of the prisoner’s dilemma game. In the public goods game, punishment on defectors is necessary to encourage cooperation. There are two types of punishment: peer punishment and pool punishment. Comparing pool punishment with peer punishment, pool punishment is disadvantageous in comparison with peer punishment because pool punishment incurs fixed costs especially if second-order free riders (those who invest in public goods but do not punish defectors) are not punished. In order to eliminate such a flaw of pool punishment, this study proposes the probabilistic pool punishment proportional to the difference of payoff. In the proposed pool punishment, each punisher pays the cost to the punishment pool with the probability proportional to the difference of payoff between his/her payoff and the average payoff of his/her opponents. Comparing the proposed pool punishment with previous pool and peer punishment, in pool punishment of previous studies, cooperators who do not punish defectors become dominant instead of pool punishers with fixed costs. However, in the proposed pool punishment, more punishers and less cooperators coexist, and such state is more robust against the invasion of defectors due to mutation than those of previous pool and peer punishment. The average payoff is also comparable to peer punishment of previous studies.

Combination of institutional incentives for cooperative governance of risky commons

Finding appropriate incentives to enforce collaborative efforts for governing the commons in risky situations is a long-lasting challenge. Previous works have demonstrated that both punishing free-riders and rewarding cooperators could be potential tools to reach this goal. Despite weak theoretical foundations, policy makers frequently impose a punishment-reward combination. Here, we consider the emergence of positive and negative incentives and analyze their simultaneous impact on sustaining risky commons. Importantly, we consider institutions with fixed and flexible incentives. We find that a local sanctioning scheme with pure reward is the optimal incentive strategy. It can drive the entire population toward a highly cooperative state in a broad range of parameters, independently of the type of institutions. We show that our finding is also valid for flexible incentives in the global sanctioning scheme, although the local arrangement works more effectively.

•

Pure reward in a local scheme is more effective both for fixed and flexible incentives

•

It can drive the entire population toward a highly cooperative state

•

Increasing the efficiency of the institution can induce the success of pure reward

•

A local scheme promotes group success more effectively than a global scheme

Cooperation and competition between pair and multi-player social games in spatial populations

The conflict between individual and collective interests is in the heart of every social dilemmas established by evolutionary game theory. We cannot avoid these conflicts but sometimes we may choose which interaction framework to use as a battlefield. For instance some people like to be part of a larger group while other persons prefer to interact in a more personalized, individual way. Both attitudes can be formulated via appropriately chosen traditional games. In particular, the prisoner's dilemma game is based on pair interaction while the public goods game represents multi-point interactions of group members. To reveal the possible advantage of a certain attitude we extend these models by allowing players not simply to change their strategies but also let them to vary their attitudes for a higher individual income. We show that both attitudes could be the winner at a specific parameter value. Interestingly, however, the subtle interplay between different states may result in a counterintuitive evolutionary outcome where the increase of the multiplication factor of public goods game drives the population to a fully defector state. We point out that the accompanying pattern formation can only be understood via the multipoint or multi-player interactions of different microscopic states where the vicinity of a particular state may influence the relation of two other competitors.

Egoistic punishment outcompetes altruistic punishment in the spatial public goods game

The evolution of costly punishment is a puzzle due to cooperators’ second-order free-riding. Previous studies have proposed many solutions mainly focused on reducing the punishment cost or punishing second-order free riders directly or indirectly. We attempt to explain this confusion from the perspective of punishment motivation, which is why the punisher is willing to pay the cost. The answer is that the punisher is egoistic. Egoistic punishment aims to protect punishers’ own cooperative benefits shared by the defectors. In such case, egoistic punishers would pay a cost in punishing defectors and retrieve lost payoffs from defectors. Here, we examined the evolution and performance of egoistic punishment and compared it with typical altruistic punishment using classic peer-punishment and pool-punishment modes. Results showed egoistic punishment can evolve and effectively promote cooperation within a large parameter range, whether in a well-mixed or structured population, or through peer-punishment or pool-punishment modes. This result is also robust to different strategy-updating rules. The evolution under the pool-punishment mechanism is more complicated. The influence of parameters is counter-intuitive because of cycle dominance; namely, the cost is the key factor to control the level of cooperation and the fine determines the ratio of the punishers and cooperators. Compared with altruistic punishment, egoistic punishment can promote cooperation in a lower-fine and higher-cost area, especially in the pool punishment mode, and the egoistic punishers have stronger survivability. Egoistic punishers represent the natural fairness in a social system. Results revealed that focusing on individual equity can significantly promote collective cooperation. This study provides another explanation for the evolution of costly punishment.

Evolutionary dynamics of cooperation with the celebrity effect in complex networks

How long-term cooperation is maintained in a society is an important and interesting question. The evolutionary game theory is often used as the basic framework to study this topic. The social status of game participants has an important influence on individual decision-making. Enlightened by this thought, we present a classification imitation model where the mechanisms of the celebrity effect and incomplete egoism are presented. The celebrity effect is reflected in each strategy update process to probe how individual decision-making is dynamically adjusted by comparing the social status of both parties in the game. The incomplete egoism refers to the irrational imitation of celebrities while self-interest is ignored. With this model, the group cooperation decision-making mechanism led by celebrities is revealed. Large-scale Monte Carlo simulations show that the incomplete egoism of individuals cannot stimulate cooperation but guarantee the stable existence of cooperation. Furthermore, the scale-free and community structure of the network enables cooperation to spread widely and maintains long-term survival. Our conclusion might provide practically new insight into the understanding and controlling of cooperation in the complex social systems.

Impacts of preferences on the emergence of cooperation

Behavior decision making, where individuals can efficiently express their preferences for all options, has a great impact on cooperation. Hereby, we institute a minimal model in well-mixed populations where whether and how to sanction defectors are decided by cooperators via different decision-making mechanisms. The results illustrate that whether cooperation can outbreak depends on the cooperators' preferences for sanction and complying with the electoral outcome. We highlight the role of individuals' preferences in the emergence of cooperation and show that there exists an intermediate degree of the cooperators' preference for sanction at which the cooperators' preference for complying with the electoral outcome has a negligible impact on cooperation. We point out whether conformity facilitates the emergence of cooperation depends on the cooperators' preference for sanction. We find, compared with individual decision making, whether collective decision making is more conducive to promoting cooperation crucially depends on cooperators' preferences as well as the consensus required for employing sanction.

Performance of weak species in the simplest generalization of the rock-paper-scissors model to four species

We investigate the problem of the predominance and survival of "weak" species in the context of the simplest generalization of the spatial stochastic rock-paper-scissors model to four species by considering models in which one, two, or three species have a reduced predation probability. We show, using lattice based spatial stochastic simulations with random initial conditions, that if only one of the four species has its probability reduced, then the most abundant species is the prey of the "weakest" (assuming that the simulations are large enough for coexistence to prevail). Also, among the remaining cases, we present examples in which "weak" and "strong" species have similar average abundances and others in which either of them dominates-the most abundant species being always a prey of a weak species with which it maintains a unidirectional predator-prey interaction. However, in contrast to the three-species model, we find no systematic difference in the global performance of weak and strong species, and we conjecture that a similar result will hold if the number of species is further increased. We also determine the probability of single species survival and coexistence as a function of the lattice size, discussing its dependence on initial conditions and on the change to the dynamics of the model which results from the extinction of one of the species.

Evolution of cooperation under punishment

Punishment has been considered as an effective mechanism for promoting and sustaining cooperation. In most existing models, punishment always comes as a third strategy alongside cooperation and defection, and it is commonly assumed to be executed based on individual decision rules rather than collective decision rules. Differently from previous works, we employ a democratic procedure by which cooperators cast votes independently and simultaneously for whether to impose punishment on defectors, and we establish a relationship between the cooperators' willingness to punish defectors (WTPD) and whether the punishment is inflicted on defectors. The results illustrate that the population can evolve to full cooperation under consensual punishment. It is noteworthy that, compared with autonomous punishment, whether consensual punishment is more in favor of cooperation crucially depends on the minimum number of votes required for punishment execution as well as the cooperators' WTPD. Our findings highlight the importance of collective decision making in the evolution of cooperation and may provide a mathematical framework for explaining the prevalence of democracy in modern societies.

Co-Evolution of Complex Network Public Goods Game under the Edges Rules

The reconnection of broken edges is an effective way to avoid drawback for the commons in past studies. Inspired by this, we proposed a public goods game model under the edges rules, where we evaluate the weight of edges by their nodes' payoff. The results proved that the game obtains a larger range of cooperation with a small gain factor by this proposed model by consulting Monte Carlo simulations (MCS) and real experiments. Furthermore, as the following the course of game and discussing the reason of cooperation, in the research, we found that the distribution entropy of the excess average degree is able to embody and predict the presence of cooperation.

Predominance of the weakest species in Lotka-Volterra and May-Leonard formulations of the rock-paper-scissors model

We revisit the problem of the predominance of the "weakest" species in the context of Lotka-Volterra and May-Leonard formulations of a spatial stochastic rock-paper-scissors model in which one of the species has its predation probability reduced by 0<P_{w}<1. We show that, despite the different population dynamics and spatial patterns, these two formulations lead to qualitatively similar results for the late time values of the relative abundances of the three species (as a function of P_{w}), as long as the simulation lattices are sufficiently large for coexistence to prevail-the "weakest" species generally having an advantage over the others (specially over its predator). However, for smaller simulation lattices, we find that the relatively large oscillations at the initial stages of simulations with random initial conditions may result in a significant dependence of the probability of species survival on the lattice size.

The evolution of cooperation in spatial public goods game with conditional peer exclusion

Social exclusion can prevent free riders from participating in social activities and deprive them of sharing cooperative benefits, which is an effective mechanism for the evolution of cooperation. However, traditional peer-exclusion strategies are unconditional, and as long as there are defectors in the group, they will pay a cost to exclude the defectors. In reality, one of the reasons for the complexity of these strategies is that individuals may react differently depending on the environment in which they are located. Based on this consideration, we introduce a kind of conditional peer-exclusion strategy in the spatial public goods game model. Specifically, the behavior of conditional exclusion depends on the number of defectors in the group and can be adjusted by a tolerance parameter. Only if the number of defectors in the group exceeds the tolerance threshold, conditional exclusion can be triggered to exclude defectors. We explore the effects of parameters such as tolerance, exclusion cost, and probability of exclusion success on the evolution of cooperation. Simulation results confirmed that conditional exclusion can greatly reduce the threshold values of the synergy factor above which cooperation can emerge. Especially, when the tolerance is low, very small synergy factors can promote the population to achieve a high level of cooperation. Moreover, even if the probability of exclusion success is low, or the unit exclusion cost is relatively high, conditional exclusion is effective in promoting cooperation. These results allow us to better understand the role of exclusion strategies in the emergence of cooperation.

Benefits of asynchronous exclusion for the evolution of cooperation in stochastic evolutionary optional public goods games

Mechanisms and conditions for the spontaneous emergence of cooperation in multi-player social dilemma games remain an open question. This paper focuses on stochastic evolutionary optional public goods games with different exclusion strategies. We introduce four strategy types in the population, namely, cooperation, defection, loner and exclusion. Synchronous and asynchronous exclusion forms have been compared in finite-sized, well-mixed and structured populations. In addition, we verify that the asynchronous exclusion mechanism is indeed better than the synchronous exclusion mechanism in all cases. The benefits of the asynchronous exclusion are measured by comparing the probability that the system chooses the cooperative states in the two situations. In the well-mixed population cases, only when the investment amplification factor is small and the probability of exclusion success is high will the asynchronous exclusion mechanism have a relatively large advantage in promoting cooperation. However, in the structured population cases, the range of the investment amplification factor, in which the asynchronous exclusion mechanism has relatively large advantages in promoting cooperation, is somewhat different and is mainly in the middle of the interval under our parameters. Our study further corroborated that when non-participation and exclusion strategies exist, a structured population does not necessarily promote cooperation compared with a well-mixed population for some parameter combinations. Thus, we acquire a good understanding of the emergence of cooperation under different exclusion mechanisms.

Reciprocity-based cooperative phalanx maintained by overconfident players

According to the evolutionary game theory principle, a strategy representing a higher payoff can spread among competitors. But there are cases when a player consistently overestimates or underestimates her own payoff, which undermines proper comparison. Interestingly, both underconfident and overconfident individuals are capable of elevating the cooperation level significantly. While former players stimulate a local coordination of strategies, the presence of overconfident individuals enhances the spatial reciprocity mechanism. In both cases the propagations of competing strategies are influenced in a biased way resulting in a cooperation supporting environment. These effects are strongly related to the nonlinear character of invasion probabilities which is a common and frequently observed feature of microscopic dynamics.

Stochastic evolutionary voluntary public goods game with punishment in a Quasi-birth-and-death process

Traditional replication dynamic model and the corresponding concept of evolutionary stable strategy (ESS) only takes into account whether the system can return to the equilibrium after being subjected to a small disturbance. In the real world, due to continuous noise, the ESS of the system may not be stochastically stable. In this paper, a model of voluntary public goods game with punishment is studied in a stochastic situation. Unlike the existing model, we describe the evolutionary process of strategies in the population as a generalized quasi-birth-and-death process. And we investigate the stochastic stable equilibrium (SSE) instead. By numerical experiments, we get all possible SSEs of the system for any combination of parameters, and investigate the influence of parameters on the probabilities of the system to select different equilibriums. It is found that in the stochastic situation, the introduction of the punishment and non-participation strategies can change the evolutionary dynamics of the system and equilibrium of the game. There is a large range of parameters that the system selects the cooperative states as its SSE with a high probability. This result provides us an insight and control method for the evolution of cooperation in the public goods game in stochastic situations.

Punishing second-order free riders before first-order free riders: The effect of pool punishment priority on cooperation

Second-order free riders, who do not owe punishment cost to first-order free riders in public goods games, lead to low cooperation. Previous studies suggest that for stable cooperation, it is critical to have a pool punishment system with second-order punishment, which gathers resources from group members and punishes second-order free riders as well as first-order free riders. In this study, we focus on the priority of punishment. We hypothesize that the pool punishment system that prioritizes second-order punishment is more likely to achieve cooperation than the system that prioritizes first-order punishment, because the former is more likely to obtain sufficient punishment resources. In the experiments, we compare four pool punishment systems: 1To2 (first-order punishment to second-order punishment), 2To1 (second-order punishment to first-order punishment), 1ONLY (first-order punishment only), and 2ONLY (second-order punishment only). We find that the 2To1 and 2ONLY systems can receive more support than the 1To2 and 1ONLY systems and only the 2To1 system can achieve high cooperation. However, the effect of priority of second-order punishment is observed only when the punishment ratio (PR) is low (Experiment 1), not high (Experiment 2), in which the punishment resource is relatively abundant.

Individual mobility promotes punishment in evolutionary public goods games

In explaining the pressing issue in biology and social sciences how cooperation emerges in a population of self-interested individuals, researchers recently pay intensive attentions to the role altruistic punishment plays. However, as higher-order cooperators, survival of punishers is puzzling due to their extra cost in regulating norm violators. Previous works have highlighted the importance of individual mobility in promoting cooperation. Yet its effect on punishers remains to be explored. In this work we incorporate this feature into modeling the behavior of punishers, who are endowed with a choice between leaving current place or staying and punishing defectors. Results indicate that optimal mobility level of punishers is closely related to the cost of punishing. For considerably large cost, there exists medium tendency of migration which favors the survival of punishers. This holds for both the direct competition between punishers and defectors and the case where cooperators are involved, and can also be observed when various types of punishers with different mobility tendencies fight against defectors simultaneously. For cheap punishment, mobility does not provide with punishers more advantage even when they are initially rare. We hope our work provide more insight into understanding the role individual mobility plays in promoting public cooperation.

Alliance formation with exclusion in the spatial public goods game

Detecting defection and alarming partners about the possible danger could be essential to avoid being exploited. This act, however, may require a huge individual effort from those who take this job, hence such a strategy seems to be unfavorable. But structured populations can provide an opportunity where a largely unselfish excluder strategy can form an effective alliance with other cooperative strategies, hence they can sweep out defection. Interestingly, this alliance is functioning even at the extremely high cost of exclusion where the sole application of an exclusion strategy would be harmful otherwise. These results may explain why the emergence of extreme selfless behavior is not necessarily against individual selection but could be the result of an evolutionary process.

Competitions between prosocial exclusions and punishments in finite populations

Prosocial punishment has been proved to be a powerful mean to promote cooperation. Recent studies have found that social exclusion, which indeed can be regarded as a kind of punishment, can also support cooperation. However, if prosocial punishment and exclusion are both present, it is still unclear which strategy is more advantageous to curb free-riders. Here we first study the direct competition between different types of punishment and exclusion. We find that pool (peer) exclusion can always outperform pool (peer) punishment both in the optional and in the compulsory public goods game, no matter whether second-order sanctioning is considered or not. Furthermore, peer exclusion does better than pool exclusion both in the optional and in the compulsory game, but the situation is reversed in the presence of second-order exclusion. Finally, we extend the competition among all possible sanctioning strategies and find that peer exclusion can outperform all other strategies in the absence of second-order exclusion and punishment, while pool exclusion prevails when second-order sanctioning is possible. Our results demonstrate that exclusion is a more powerful strategy than punishment for the resolution of social dilemmas.

Evolution of cooperation by the introduction of the probabilistic peer-punishment based on the difference of payoff

There are two types of costly punishment, i.e. peer-punishment and pool-punishment. While peer-punishment applies direct face to face punishment, pool-punishment is based on multi-point, collective interaction among group members. Regarding those two types of costly punishment, peer-punishment is especially considered to have the flaws that it lowers the average payoff of all players as well as pool-punishment does, and facilitates antisocial behaviour like retaliation of a defector on a cooperator. Here, this study proposes the new peer-punishment that punishment to an opponent player works at high probability when an opponent one is uncooperative, and the difference of payoff between a player and an opponent one becomes large in order to prevent such antisocial behaviour. It is natural to think that players of high payoff do not expect to punish others of lower payoff because they do not have any complaints regarding their economic wealth. The author shows that the introduction of the proposed peer-punishment increases both the number of cooperative players and the average payoff of all players in various types of topology of connections between players.

Benefits of tolerance in public goods games

Leaving the joint enterprise when defection is unveiled is always a viable option to avoid being exploited. Although loner strategy helps the population not to be trapped into the tragedy of the commons state, it could offer only a modest income for nonparticipants. In this paper we demonstrate that showing some tolerance toward defectors could not only save cooperation in harsh environments but in fact results in a surprisingly high average payoff for group members in public goods games. Phase diagrams and the underlying spatial patterns reveal the high complexity of evolving states where cyclic dominant strategies or two-strategy alliances can characterize the final state of evolution. We identify microscopic mechanisms which are responsible for the superiority of global solutions containing tolerant players. This phenomenon is robust and can be observed both in well-mixed and in structured populations highlighting the importance of tolerance in our everyday life.

Competition and cooperation among different punishing strategies in the spatial public goods game

Inspired by the fact that people have diverse propensities to punish wrongdoers, we study a spatial public goods game with defectors and different types of punishing cooperators. During the game, cooperators punish defectors with class-specific probabilities and subsequently share the associated costs of sanctioning. We show that in the presence of different punishing cooperators the highest level of public cooperation is always attainable through a selection mechanism. Interestingly, the selection does not necessarily favor the evolution of punishers who would be able to prevail on their own against the defectors, nor does it always hinder the evolution of punishers who would be unable to prevail on their own. Instead, the evolutionary success of punishing strategies depends sensitively on their invasion velocities, which in turn reveals fascinating examples of both competition and cooperation among them. Furthermore, we show that under favorable conditions, when punishment is not strictly necessary for the maintenance of public cooperation, the less aggressive, mild form of sanctioning is the sole victor of the selection process. Our work reveals that natural strategy selection cannot only promote, but sometimes also hinders competition among prosocial strategies.

Evolutionary dynamics for persistent cooperation in structured populations

The emergence and maintenance of cooperative behavior is a fascinating topic in evolutionary biology and social science. The public goods game (PGG) is a paradigm for exploring cooperative behavior. In PGG, the total resulting payoff is divided equally among all participants. This feature still leads to the dominance of defection without substantially magnifying the public good by a multiplying factor. Much effort has been made to explain the evolution of cooperative strategies, including a recent model in which only a portion of the total benefit is shared by all the players through introducing a new strategy named persistent cooperation. A persistent cooperator is a contributor who is willing to pay a second cost to retrieve the remaining portion of the payoff contributed by themselves. In a previous study, this model was analyzed in the framework of well-mixed populations. This paper focuses on discussing the persistent cooperation in lattice-structured populations. The evolutionary dynamics of the structured populations consisting of three types of competing players (pure cooperators, defectors, and persistent cooperators) are revealed by theoretical analysis and numerical simulations. In particular, the approximate expressions of fixation probabilities for strategies are derived on one-dimensional lattices. The phase diagrams of stationary states, and the evolution of frequencies and spatial patterns for strategies are illustrated on both one-dimensional and square lattices by simulations. Our results are consistent with the general observation that, at least in most situations, a structured population facilitates the evolution of cooperation. Specifically, here we find that the existence of persistent cooperators greatly suppresses the spreading of defectors under more relaxed conditions in structured populations compared to that obtained in well-mixed populations.

Social exclusion in finite populations

Social exclusion, keeping free riders from benefit sharing, plays an important role in sustaining cooperation in our world. Here we propose two different exclusion regimes, namely, peer exclusion and pool exclusion, to investigate the evolution of social exclusion in finite populations. In the peer exclusion regime, each excluder expels all the defectors independently, and thus bears the total cost on his own, while in the pool exclusion regime, excluders spontaneously form an institution to carry out rejection of the free riders, and each excluder shares the cost equally. In a public goods game containing only excluders and defectors, it is found that peer excluders outperform pool excluders if the exclusion costs are small, and the situation is converse once the exclusion costs exceed some critical points, which holds true for all the selection intensities and different update rules. Moreover, excluders can dominate the whole population under a suitable parameters range in the presence of second-order free riders (cooperators), showing that exclusion has prominent advantages over common costly punishment. More importantly, our finding indicates that the group exclusion mechanism helps the cooperative union to survive under unfavorable conditions. Our results may give some insights into better understanding the prevalence of such a strategy in the real world and its significance in sustaining cooperation.

Spatial evolutionary public goods game on complete graph and dense complex networks

We study the spatial evolutionary public goods game (SEPGG) with voluntary or optional participation on a complete graph (CG) and on dense networks. Based on analyses of the SEPGG rate equation on finite CG, we find that SEPGG has two stable states depending on the value of multiplication factor r, illustrating how the "tragedy of the commons" and "an anomalous state without any active participants" occurs in real-life situations. When r is low (<<), the state with only loners is stable, and the state with only defectors is stable when r is high (>>). We also derive the exact scaling relation for r*. All of the results are confirmed by numerical simulation. Furthermore, we find that a cooperator-dominant state emerges when the number of participants or the mean degree, 〈k〉, decreases. We also investigate the scaling dependence of the emergence of cooperation on r and 〈k〉. These results show how "tragedy of the commons" disappears when cooperation between egoistic individuals without any additional socioeconomic punishment increases.

Cyclic dominance in evolutionary games: a review

Rock is wrapped by paper, paper is cut by scissors and scissors are crushed by rock. This simple game is popular among children and adults to decide on trivial disputes that have no obvious winner, but cyclic dominance is also at the heart of predator-prey interactions, the mating strategy of side-blotched lizards, the overgrowth of marine sessile organisms and competition in microbial populations. Cyclical interactions also emerge spontaneously in evolutionary games entailing volunteering, reward, punishment, and in fact are common when the competing strategies are three or more, regardless of the particularities of the game. Here, we review recent advances on the rock-paper-scissors (RPS) and related evolutionary games, focusing, in particular, on pattern formation, the impact of mobility and the spontaneous emergence of cyclic dominance. We also review mean-field and zero-dimensional RPS models and the application of the complex Ginzburg-Landau equation, and we highlight the importance and usefulness of statistical physics for the successful study of large-scale ecological systems. Directions for future research, related, for example, to dynamical effects of coevolutionary rules and invasion reversals owing to multi-point interactions, are also outlined.

Nonequivalence of updating rules in evolutionary games under high mutation rates

Moran processes are often used to model selection in evolutionary simulations. The updating rule in Moran processes is a birth-death process, i. e., selection according to fitness of an individual to give birth, followed by the death of a random individual. For well-mixed populations with only two strategies this updating rule is known to be equivalent to selecting unfit individuals for death and then selecting randomly for procreation (biased death-birth process). It is, however, known that this equivalence does not hold when considering structured populations. Here we study whether changing the updating rule can also have an effect in well-mixed populations in the presence of more than two strategies and high mutation rates. We find, using three models from different areas of evolutionary simulation, that the choice of updating rule can change model results. We show, e. g., that going from the birth-death process to the death-birth process can change a public goods game with punishment from containing mostly defectors to having a majority of cooperative strategies. From the examples given we derive guidelines indicating when the choice of the updating rule can be expected to have an impact on the results of the model.

Optimal distribution of incentives for public cooperation in heterogeneous interaction environments

In the framework of evolutionary games with institutional reciprocity, limited incentives are at disposal for rewarding cooperators and punishing defectors. In the simplest case, it can be assumed that, depending on their strategies, all players receive equal incentives from the common pool. The question arises, however, what is the optimal distribution of institutional incentives? How should we best reward and punish individuals for cooperation to thrive? We study this problem for the public goods game on a scale-free network. We show that if the synergetic effects of group interactions are weak, the level of cooperation in the population can be maximized simply by adopting the simplest “equal distribution” scheme. If synergetic effects are strong, however, it is best to reward high-degree nodes more than low-degree nodes. These distribution schemes for institutional rewards are independent of payoff normalization. For institutional punishment, however, the same optimization problem is more complex, and its solution depends on whether absolute or degree-normalized payoffs are used. We find that degree-normalized payoffs require high-degree nodes be punished more lenient than low-degree nodes. Conversely, if absolute payoffs count, then high-degree nodes should be punished stronger than low-degree nodes.

Aspiration-based partner switching boosts cooperation in social dilemmas

Most previous studies concerning linking dynamics often assumed that links pairing individuals should be identified and treated differently during topology adjusting procedure, in order to promote cooperation. A common assumption was that cooperators were expected to avoid being exploited by quickly breaking up relationships with defectors. Then the so-called prosocial links linking two cooperators (abbreviated as CC links hereafter) would be much favored by evolution, whereby cooperation was promoted. However, we suggest that this is not always necessary. Here, we developed a minimal model in which an aspiration-based partner switching mechanism was embedded to regulate the evolution of cooperation in social dilemmas. Individuals adjusted social ties in a self-questioning manner in line with the learning theory. Less game information was involved during dynamic linking and all links were tackled anonymously irrespective of their types (i.e., CD links, DD links, or CC links). The main results indicate that cooperation flourishes for a broad range of parameters. The denser the underlying network, the more difficult the evolution of cooperation. More importantly, moderate aspirations do much better in promoting the evolution of altruistic behavior and for most cases there exists the optimal aspiration level that most benefits cooperation. Too strong or too weak selection intensity turns out to be pretty conducive to the evolution of cooperation in such a dynamical system.

An evolutionary model of cooperation, fairness and altruistic punishment in public good games

We identify and explain the mechanisms that account for the emergence of fairness preferences and altruistic punishment in voluntary contribution mechanisms by combining an evolutionary perspective together with an expected utility model. We aim at filling a gap between the literature on the theory of evolution applied to cooperation and punishment, and the empirical findings from experimental economics. The approach is motivated by previous findings on other-regarding behavior, the co-evolution of culture, genes and social norms, as well as bounded rationality. Our first result reveals the emergence of two distinct evolutionary regimes that force agents to converge either to a defection state or to a state of coordination, depending on the predominant set of self- or other-regarding preferences. Our second result indicates that subjects in laboratory experiments of public goods games with punishment coordinate and punish defectors as a result of an aversion against disadvantageous inequitable outcomes. Our third finding identifies disadvantageous inequity aversion as evolutionary dominant and stable in a heterogeneous population of agents endowed initially only with purely self-regarding preferences. We validate our model using previously obtained results from three independently conducted experiments of public goods games with punishment.

The Evolution of Cooperation Through Institutional Incentives and Optional Participation

Rewards and penalties are common practical tools that can be used to promote cooperation in social institutions. The evolution of cooperation under reward and punishment incentives in joint enterprises has been formalized and investigated, mostly by using compulsory public good games. Recently, Sasaki et al. (2012, Proc Natl Acad Sci USA 109:1165-1169) considered optional participation as well as institutional incentives and described how the interplay between these mechanisms affects the evolution of cooperation in public good games. Here, we present a full classification of these cases of evolutionary dynamics. Specifically, whenever penalties are large enough to cause the bi-stability of both cooperation and defection in cases in which participation in the public good game is compulsory, these penalties will ultimately result in cooperation if participation in the public good game is optional. The global stability of coercion-based cooperation in this optional case contrasts strikingly with the bi-stability that is observed in the compulsory case. We also argue that optional participation is not as effective under rewards as under punishment.

Diverging fluctuations in a spatial five-species cyclic dominance game

A five-species predator-prey model is studied on a square lattice where each species has two prey and two predators on the analogy to the rock-paper-scissors-lizard-Spock game. The evolution of the spatial distribution of species is governed by site exchange and invasion between the neighboring predator-prey pairs, where the cyclic symmetry can be characterized by two different invasion rates. The mean-field analysis has indicated periodic oscillations in the species densities with a frequency becoming zero for a specific ratio of invasion rates. When varying the ratio of invasion rates, the appearance of this zero-eigenvalue mode is accompanied by neutrality between the species associations. Monte Carlo simulations of the spatial system reveal diverging fluctuations at a specific invasion rate, which can be related to the vanishing dominance between all pairs of species associations.

Evolutionary dynamics of group interactions on structured populations: a review

Interactions among living organisms, from bacteria colonies to human societies, are inherently more complex than interactions among particles and non-living matter. Group interactions are a particularly important and widespread class, representative of which is the public goods game. In addition, methods of statistical physics have proved valuable for studying pattern formation, equilibrium selection and self-organization in evolutionary games. Here, we review recent advances in the study of evolutionary dynamics of group interactions on top of structured populations, including lattices, complex networks and coevolutionary models. We also compare these results with those obtained on well-mixed populations. The review particularly highlights that the study of the dynamics of group interactions, like several other important equilibrium and non-equilibrium dynamical processes in biological, economical and social sciences, benefits from the synergy between statistical physics, network science and evolutionary game theory.

Impact of generalized benefit functions on the evolution of cooperation in spatial public goods games with continuous strategies

Cooperation and defection may be considered to be two extreme responses to a social dilemma. Yet the reality is much less clear-cut. Between the two extremes lies an interval of ambivalent choices, which may be captured theoretically by means of continuous strategies defining the extent of the contributions of each individual player to the common pool. If strategies are chosen from the unit interval, where 0 corresponds to pure defection and 1 corresponds to the maximal contribution, the question is what is the characteristic level of individual investments to the common pool that emerges if the evolution is guided by different benefit functions. Here we consider the steepness and the threshold as two parameters defining an array of generalized benefit functions, and we show that in a structured population there exist intermediate values of both at which the collective contributions are maximal. However, as the cost-to-benefit ratio of cooperation increases, the characteristic threshold decreases while the corresponding steepness increases. Our observations remain valid if more complex sigmoid functions are used, thus reenforcing the importance of carefully adjusted benefits for high levels of public cooperation.

Adaptive and bounded investment returns promote cooperation in spatial public goods games

The public goods game is one of the most famous models for studying the evolution of cooperation in sizable groups. The multiplication factor in this game can characterize the investment return from the public good, which may be variable depending on the interactive environment in realistic situations. Instead of using the same universal value, here we consider that the multiplication factor in each group is updated based on the differences between the local and global interactive environments in the spatial public goods game, but meanwhile limited to within a certain range. We find that the adaptive and bounded investment returns can significantly promote cooperation. In particular, full cooperation can be achieved for high feedback strength when appropriate limitation is set for the investment return. Also, we show that the fraction of cooperators in the whole population can become larger if the lower and upper limits of the multiplication factor are increased. Furthermore, in comparison to the traditionally spatial public goods game where the multiplication factor in each group is identical and fixed, we find that cooperation can be better promoted if the multiplication factor is constrained to adjust between one and the group size in our model. Our results highlight the importance of the locally adaptive and bounded investment returns for the emergence and dominance of cooperative behavior in structured populations.

Sustainable institutionalized punishment requires elimination of second-order free-riders

Although empirical and theoretical studies affirm that punishment can elevate collaborative efforts, its emergence and stability remain elusive. By peer-punishment the sanctioning is something an individual elects to do depending on the strategies in its neighborhood. The consequences of unsustainable efforts are therefore local. By pool-punishment, on the other hand, where resources for sanctioning are committed in advance and at large, the notion of sustainability has greater significance. In a population with free-riders, punishers must be strong in numbers to keep the "punishment pool" from emptying. Failure to do so renders the concept of institutionalized sanctioning futile. We show that pool-punishment in structured populations is sustainable, but only if second-order free-riders are sanctioned as well, and to a such degree that they cannot prevail. A discontinuous phase transition leads to an outbreak of sustainability when punishers subvert second-order free-riders in the competition against defectors.