Social network reciprocity as a phase transition in evolutionary cooperation

Evolution of cooperation in multichannel games on multiplex networks

Humans navigate diverse social relationships and concurrently interact across multiple social contexts. An individual's behavior in one context can influence behavior in other contexts. Different payoffs associated with interactions in the different domains have motivated recent studies of the evolution of cooperation through the analysis of multichannel games where each individual is simultaneously engaged in multiple repeated games. However, previous investigations have ignored the potential role of network structure in each domain and the effect of playing against distinct interacting partners in different domains. Multiplex networks provide a useful framework to represent social interactions between the same set of agents across different social contexts. We investigate the role of multiplex network structure and strategy linking in multichannel games on the spread of cooperative behavior in all layers of the multiplex. We find that multiplex structure along with strategy linking enhances the cooperation rate in all layers of the multiplex compared to a well-mixed population in Prisoners' Dilemma games, provided the network structure is identical across layers. The effectiveness of strategy linking in enhancing cooperation depends on the degree of similarity of the network structure across the layers and perception errors due to imperfect memory. Higher cooperation rates are achieved when the degree of structural overlap of the different layers is sufficiently large, and the probability of perception error is relatively low. Our work reveals how the social network structure in different layers of a multiplex can affect the spread of cooperation by limiting the ability of individuals to link strategies across different social domains.

Deterministic and stochastic cooperation transitions in evolutionary games on networks

Although the cooperative dynamics emerging from a network of interacting players has been exhaustively investigated, it is not yet fully understood when and how network reciprocity drives cooperation transitions. In this work, we investigate the critical behavior of evolutionary social dilemmas on structured populations by using the framework of master equations and Monte Carlo simulations. The developed theory describes the existence of absorbing, quasiabsorbing, and mixed strategy states and the transition nature, continuous or discontinuous, between the states as the parameters of the system change. In particular, when the decision-making process is deterministic, in the limit of zero effective temperature of the Fermi function, we find that the copying probabilities are discontinuous functions of the system's parameters and of the network degrees sequence. This may induce abrupt changes in the final state for any system size, in excellent agreement with the Monte Carlo simulation results. Our analysis also reveals the existence of continuous and discontinuous phase transitions for large systems as the temperature increases, which is explained in the mean-field approximation. Interestingly, for some game parameters, we find optimal "social temperatures" maximizing or minimizing the cooperation frequency or density.

Phase transitions in evolutionary dynamics

Sharp changes in state, such as transitions from survival to extinction, are hallmarks of evolutionary dynamics in biological systems. These transitions can be explored using the techniques of statistical physics and the physics of nonlinear and complex systems. For example, a survival-to-extinction transition can be characterized as a non-equilibrium phase transition to an absorbing state. Here, we review the literature on phase transitions in evolutionary dynamics. We discuss directed percolation transitions in cellular automata and evolutionary models, and models that diverge from the directed percolation universality class. We explore in detail an example of an absorbing phase transition in an agent-based model of evolutionary dynamics, including previously unpublished data demonstrating similarity to, but also divergence from, directed percolation, as well as evidence for phase transition behavior at multiple levels of the model system's evolutionary structure. We discuss phase transition models of the error catastrophe in RNA virus dynamics and phase transition models for transition from chemistry to biochemistry, i.e., the origin of life. We conclude with a review of phase transition dynamics in models of natural selection, discuss the possible role of phase transitions in unraveling fundamental unresolved questions regarding multilevel selection and the major evolutionary transitions, and assess the future outlook for phase transitions in the investigation of evolutionary dynamics.

Census of Twitter users: Scraping and describing the national network of South Korea

Population-level national networks on social media are precious and essential for network science and behavioural science. This study collected a population-level Twitter network, based on both language and geolocation tags. We proposed a set of validation approaches to evaluate the validity of our datasets. Finally, we re-examined classical network and communication propositions (e.g., 80/20 rule, six degrees of separation) on the national network. Our dataset and strategy would flourish the data collection pool of population-level social networks and further develop the research of network analysis in digital media environment.

Sharp thresholds limit the benefit of defector avoidance in cooperation on networks

Consider a cooperation game on a spatial network of habitat patches, where players can relocate between patches if they judge the local conditions to be unfavorable. In time, the relocation events may lead to a homogeneous state where all patches harbor the same relative densities of cooperators and defectors, or they may lead to self-organized patterns, where some patches become safe havens that maintain an elevated cooperator density. Here we analyze the transition between these states mathematically. We show that safe havens form once a certain threshold in connectivity is crossed. This threshold can be analytically linked to the structure of the patch network and specifically to certain network motifs. Surprisingly, a forgiving defector avoidance strategy may be most favorable for cooperators. Our results demonstrate that the analysis of cooperation games in ecological metacommunity models is mathematically tractable and has the potential to link topics such as macroecological patterns, behavioral evolution, and network topology.

From indirect to direct contacts on Facebook: A big-data approach to the making of triadic network closure

The rise of the Big Data paradigm has made it more feasible to track how personal networks evolve on social media, where auto-generated contact records and fine-grained temporal data sequences help capture how and when interpersonal ties and contacts change their roles. Using a sample of matched survey data and social media records, we investigated the mechanisms by which indirect contacts ("degree-2 alters") transform into direct contacts ("degree-1 alters") from a Facebook user's (ego's) point of view. To highlight the temporal sequences, we assigned different roles to the same alters depending on how each of them is connected with ego at different periods of time. Multilevel event history analyses pinpoint several online actions and network features of ego, degree-1 alters, and degree-2 alters, as the key factors that contribute to the transformation from indirect contacts into direct contacts.

Cooperation and competition between pair and multi-player social games in spatial populations

The conflict between individual and collective interests is in the heart of every social dilemmas established by evolutionary game theory. We cannot avoid these conflicts but sometimes we may choose which interaction framework to use as a battlefield. For instance some people like to be part of a larger group while other persons prefer to interact in a more personalized, individual way. Both attitudes can be formulated via appropriately chosen traditional games. In particular, the prisoner's dilemma game is based on pair interaction while the public goods game represents multi-point interactions of group members. To reveal the possible advantage of a certain attitude we extend these models by allowing players not simply to change their strategies but also let them to vary their attitudes for a higher individual income. We show that both attitudes could be the winner at a specific parameter value. Interestingly, however, the subtle interplay between different states may result in a counterintuitive evolutionary outcome where the increase of the multiplication factor of public goods game drives the population to a fully defector state. We point out that the accompanying pattern formation can only be understood via the multipoint or multi-player interactions of different microscopic states where the vicinity of a particular state may influence the relation of two other competitors.

Evolution of Cooperation in Social Dilemmas with Assortative Interactions

Cooperation in social dilemmas plays a pivotal role in the formation of systems at all levels of complexity, from replicating molecules to multi-cellular organisms to human and animal societies. In spite of its ubiquity, the origin and stability of cooperation pose an evolutionary conundrum, since cooperation, though beneficial to others, is costly to the individual cooperator. Thus natural selection would be expected to favor selfish behavior in which individuals reap the benefits of cooperation without bearing the costs of cooperating themselves. Many proximate mechanisms have been proposed to account for the origin and maintenance of cooperation, including kin selection, direct reciprocity, indirect reciprocity, and evolution in structured populations. Despite the apparent diversity of these approaches they all share a unified underlying logic: namely, each mechanism results in assortative interactions in which individuals using the same strategy interact with a higher probability than they would at random. Here we study the evolution of cooperation in both discrete strategy and continuous strategy social dilemmas with assortative interactions. For the sake of tractability, assortativity is modeled by an individual interacting with another of the same type with probability r and interacting with a random individual in the population with probability 1−r, where r is a parameter that characterizes the degree of assortativity in the system. For discrete strategy social dilemmas we use both a generalization of replicator dynamics and individual-based simulations to elucidate the donation, snowdrift, and sculling games with assortative interactions, and determine the analogs of Hamilton’s rule, which govern the evolution of cooperation in these games. For continuous strategy social dilemmas we employ both a generalization of deterministic adaptive dynamics and individual-based simulations to study the donation, snowdrift, and tragedy of the commons games, and determine the effect of assortativity on the emergence and stability of cooperation.

Direct Reciprocity and Model-Predictive Strategy Update Explain the Network Reciprocity Observed in Socioeconomic Networks

Network reciprocity has been successfully put forward (since M. A. Nowak and R. May’s, 1992, influential paper) as the simplest mechanism—requiring no strategical complexity—supporting the evolution of cooperation in biological and socioeconomic systems. The mechanism is actually the network, which makes agents’ interactions localized, while network reciprocity is the property of the underlying evolutionary process to favor cooperation in sparse rather than dense networks. In theoretical models, the property holds under imitative evolutionary processes, whereas cooperation disappears in any network if imitation is replaced by the more rational best-response rule of strategy update. In social experiments, network reciprocity has been observed, although the imitative behavior did not emerge. What did emerge is a form of conditional cooperation based on direct reciprocity—the propensity to cooperate with neighbors who previously cooperated. To resolve this inconsistency, network reciprocity has been recently shown in a model that rationally confronts the two main behaviors emerging in experiments—reciprocal cooperation and unconditional defection—with rationality introduced by extending the best-response rule to a multi-step predictive horizon. However, direct reciprocity was implemented in a non-standard way, by allowing cooperative agents to temporarily cut the interaction with defecting neighbors. Here, we make this result robust to the way cooperators reciprocate, by implementing direct reciprocity with the standard tit-for-tat strategy and deriving similar results.

Direct reciprocity and model-predictive rationality explain network reciprocity over social ties

Since M. A. Nowak & R. May’s (1992) influential paper, limiting each agent’s interactions to a few neighbors in a network of contacts has been proposed as the simplest mechanism to support the evolution of cooperation in biological and socio-economic systems. The network allows cooperative agents to self-assort into clusters, within which they reciprocate cooperation. This (induced) network reciprocity has been observed in several theoreticalmodels and shown to predict the fixation of cooperation under a simple rule: the benefit produced by an act of cooperation must outweigh the cost of cooperating with all neighbors. However, the experimental evidence among humans is controversial: though the rule seems to be confirmed, the underlying modeling assumptions are not. Specifically, models assume that agents update their strategies by imitating better performing neighbors, even though imitation lacks rationality when interactions are far from all-to-all. Indeed, imitation did not emerge in experiments. What did emerge is that humans are conditioned by their own mood and that, when in a cooperative mood, they reciprocate cooperation. To help resolve the controversy, we design a model in which we rationally confront the two main behaviors emerging from experiments—reciprocal cooperation and unconditional defection—in a networked prisoner’s dilemma. Rationality is introduced by means of a predictive rule for strategy update and is bounded by the assumed model society. We show that both reciprocity and a multi-step predictive horizon are necessary to stabilize cooperation, and sufficient for its fixation, provided the game benefit-to-cost ratio is larger than a measure of network connectivity. We hence rediscover the rule of network reciprocity, underpinned however by a different evolutionary mechanism.

Coevolution of Cooperation and Partner Rewiring Range in Spatial Social Networks

In recent years, there has been growing interest in the study of coevolutionary games on networks. Despite much progress, little attention has been paid to spatially embedded networks, where the underlying geographic distance, rather than the graph distance, is an important and relevant aspect of the partner rewiring process. It thus remains largely unclear how individual partner rewiring range preference, local vs. global, emerges and affects cooperation. Here we explicitly address this issue using a coevolutionary model of cooperation and partner rewiring range preference in spatially embedded social networks. In contrast to local rewiring, global rewiring has no distance restriction but incurs a one-time cost upon establishing any long range link. We find that under a wide range of model parameters, global partner switching preference can coevolve with cooperation. Moreover, the resulting partner network is highly degree-heterogeneous with small average shortest path length while maintaining high clustering, thereby possessing small-world properties. We also discover an optimum availability of reputation information for the emergence of global cooperators, who form distant partnerships at a cost to themselves. From the coevolutionary perspective, our work may help explain the ubiquity of small-world topologies arising alongside cooperation in the real world.

Evolution of Cooperation in Social Dilemmas on Complex Networks

Cooperation in social dilemmas is essential for the functioning of systems at multiple levels of complexity, from the simplest biological organisms to the most sophisticated human societies. Cooperation, although widespread, is fundamentally challenging to explain evolutionarily, since natural selection typically favors selfish behavior which is not socially optimal. Here we study the evolution of cooperation in three exemplars of key social dilemmas, representing the prisoner's dilemma, hawk-dove and coordination classes of games, in structured populations defined by complex networks. Using individual-based simulations of the games on model and empirical networks, we give a detailed comparative study of the effects of the structural properties of a network, such as its average degree, variance in degree distribution, clustering coefficient, and assortativity coefficient, on the promotion of cooperative behavior in all three classes of games.

Are We Ready for Mass Fatality Incidents? Preparedness of the US Mass Fatality Infrastructure

Objective

To assess the preparedness of the US mass fatality infrastructure, we developed and tested metrics for 3 components of preparedness: organizational, operational, and resource sharing networks.

Methods

In 2014, data were collected from 5 response sectors: medical examiners and coroners, the death care industry, health departments, faith-based organizations, and offices of emergency management. Scores were calculated within and across sectors and a weighted score was developed for the infrastructure.

Results

A total of 879 respondents reported highly variable organizational capabilities: 15% had responded to a mass fatality incident (MFI); 42% reported staff trained for an MFI, but only 27% for an MFI involving hazardous contaminants. Respondents estimated that 75% of their staff would be willing and able to respond, but only 53% if contaminants were involved. Most perceived their organization as somewhat prepared, but 13% indicated “not at all.” Operational capability scores ranged from 33% (death care industry) to 77% (offices of emergency management). Network capability analysis found that only 42% of possible reciprocal relationships between resource-sharing partners were present. The cross-sector composite score was 51%; that is, half the key capabilities for preparedness were in place.

Conclusions

The sectors in the US mass fatality infrastructure report suboptimal capability to respond. National leadership is needed to ensure sector-specific and infrastructure-wide preparedness for a large-scale MFI. (Disaster Med Public Health Preparedness. 2016;10:87–97)

Universal scaling for the dilemma strength in evolutionary games

Why would natural selection favor the prevalence of cooperation within the groups of selfish individuals? A fruitful framework to address this question is evolutionary game theory, the essence of which is captured in the so-called social dilemmas. Such dilemmas have sparked the development of a variety of mathematical approaches to assess the conditions under which cooperation evolves. Furthermore, borrowing from statistical physics and network science, the research of the evolutionary game dynamics has been enriched with phenomena such as pattern formation, equilibrium selection, and self-organization. Numerous advances in understanding the evolution of cooperative behavior over the last few decades have recently been distilled into five reciprocity mechanisms: direct reciprocity, indirect reciprocity, kin selection, group selection, and network reciprocity. However, when social viscosity is introduced into a population via any of the reciprocity mechanisms, the existing scaling parameters for the dilemma strength do not yield a unique answer as to how the evolutionary dynamics should unfold. Motivated by this problem, we review the developments that led to the present state of affairs, highlight the accompanying pitfalls, and propose new universal scaling parameters for the dilemma strength. We prove universality by showing that the conditions for an ESS and the expressions for the internal equilibriums in an infinite, well-mixed population subjected to any of the five reciprocity mechanisms depend only on the new scaling parameters. A similar result is shown to hold for the fixation probability of the different strategies in a finite, well-mixed population. Furthermore, by means of numerical simulations, the same scaling parameters are shown to be effective even if the evolution of cooperation is considered on the spatial networks (with the exception of highly heterogeneous setups). We close the discussion by suggesting promising directions for future research including (i) how to handle the dilemma strength in the context of co-evolution and (ii) where to seek opportunities for applying the game theoretical approach with meaningful impact.

Intergroup information exchange drives cooperation in the public goods game

In this paper we explore the onset of cooperative traits in the public goods game. This well-known game involves N-agent interactions and thus reproduces a large number of social scenarios in which cooperation appears to be essential. Many studies have recently addressed how the structure of the interaction patterns influences the emergence of cooperation. Here we study how information about the payoffs collected by each individual in the different groups it participates in influences the decisions made by its group partners. Our results point out that cross-information plays a fundamental and positive role in the evolution of cooperation for different versions of the public goods game and different interaction structures.

Optimal distribution of incentives for public cooperation in heterogeneous interaction environments

In the framework of evolutionary games with institutional reciprocity, limited incentives are at disposal for rewarding cooperators and punishing defectors. In the simplest case, it can be assumed that, depending on their strategies, all players receive equal incentives from the common pool. The question arises, however, what is the optimal distribution of institutional incentives? How should we best reward and punish individuals for cooperation to thrive? We study this problem for the public goods game on a scale-free network. We show that if the synergetic effects of group interactions are weak, the level of cooperation in the population can be maximized simply by adopting the simplest “equal distribution” scheme. If synergetic effects are strong, however, it is best to reward high-degree nodes more than low-degree nodes. These distribution schemes for institutional rewards are independent of payoff normalization. For institutional punishment, however, the same optimization problem is more complex, and its solution depends on whether absolute or degree-normalized payoffs are used. We find that degree-normalized payoffs require high-degree nodes be punished more lenient than low-degree nodes. Conversely, if absolute payoffs count, then high-degree nodes should be punished stronger than low-degree nodes.

Facilitators on networks reveal optimal interplay between information exchange and reciprocity

Reciprocity is firmly established as an important mechanism that promotes cooperation. An efficient information exchange is likewise important, especially on structured populations, where interactions between players are limited. Motivated by these two facts, we explore the role of facilitators in social dilemmas on networks. Facilitators are here mirrors to their neighbors-they cooperate with cooperators and defect with defectors-but they do not participate in the exchange of strategies. As such, in addition to introducing direct reciprocity, they also obstruct information exchange. In well-mixed populations, facilitators favor the replacement and invasion of defection by cooperation as long as their number exceeds a critical value. In structured populations, on the other hand, there exists a delicate balance between the benefits of reciprocity and the deterioration of information exchange. Extensive Monte Carlo simulations of social dilemmas on various interaction networks reveal that there exists an optimal interplay between reciprocity and information exchange, which sets in only when a small number of facilitators occupy the main hubs of the scale-free network. The drawbacks of missing cooperative hubs are more than compensated for by reciprocity and, at the same time, the compromised information exchange is routed via the auxiliary hubs with only marginal losses in effectivity. These results indicate that it is not always optimal for the main hubs to become leaders of the masses, but rather to exploit their highly connected state to promote tit-for-tat-like behavior.

Coevolution of quantum and classical strategies on evolving random networks

We study the coevolution of quantum and classical strategies on weighted and directed random networks in the realm of the prisoner's dilemma game. During the evolution, agents can break and rewire their links with the aim of maximizing payoffs, and they can also adjust the weights to indicate preferences, either positive or negative, towards their neighbors. The network structure itself is thus also subject to evolution. Importantly, the directionality of links does not affect the accumulation of payoffs nor the strategy transfers, but serves only to designate the owner of each particular link and with it the right to adjust the link as needed. We show that quantum strategies outperform classical strategies, and that the critical temptation to defect at which cooperative behavior can be maintained rises, if the network structure is updated frequently. Punishing neighbors by reducing the weights of their links also plays an important role in maintaining cooperation under adverse conditions. We find that the self-organization of the initially random network structure, driven by the evolutionary competition between quantum and classical strategies, leads to the spontaneous emergence of small average path length and a large clustering coefficient.

Evolutionary dynamics of group interactions on structured populations: a review

Interactions among living organisms, from bacteria colonies to human societies, are inherently more complex than interactions among particles and non-living matter. Group interactions are a particularly important and widespread class, representative of which is the public goods game. In addition, methods of statistical physics have proved valuable for studying pattern formation, equilibrium selection and self-organization in evolutionary games. Here, we review recent advances in the study of evolutionary dynamics of group interactions on top of structured populations, including lattices, complex networks and coevolutionary models. We also compare these results with those obtained on well-mixed populations. The review particularly highlights that the study of the dynamics of group interactions, like several other important equilibrium and non-equilibrium dynamical processes in biological, economical and social sciences, benefits from the synergy between statistical physics, network science and evolutionary game theory.

Evolutionary dynamics on interdependent populations

Although several mechanisms can promote cooperative behavior, there is no general consensus about why cooperation survives when the most profitable action for an individual is to defect, especially when the population is well mixed. Here we show that when a replicator such as evolutionary game dynamics takes place on interdependent networks, cooperative behavior is fixed on the system. Remarkably, we analytically and numerically show that this is even the case for well-mixed populations. Our results open the path to mechanisms able to sustain cooperation and can provide hints for controlling its rise and fall in a variety of biological and social systems.

Evolution of cooperation in multiplex networks

We study evolutionary game dynamics on structured populations in which individuals take part in several layers of networks of interactions simultaneously. This multiplex of interdependent networks accounts for the different kind of social ties each individual has. By coupling the evolutionary dynamics of a Prisoner's Dilemma game in each of the networks, we show that the resilience of cooperative behaviors for extremely large values of the temptation to defect is enhanced by the multiplex structure. Furthermore, this resilience is intrinsically related to a non-trivial organization of cooperation across the network layers, thus providing a new way out for cooperation to survive in structured populations.

Inferring reputation promotes the evolution of cooperation in spatial social dilemma games

In realistic world individuals with high reputation are more likely to influence the collective behaviors. Due to the cost and error of information dissemination, however, it is unreasonable to assign each individual with a complete cognitive power, which means that not everyone can accurately realize others’ reputation situation. Here we introduce the mechanism of inferring reputation into the selection of potential strategy sources to explore the evolution of cooperation. Before the game each player is assigned with a randomly distributed parameter p denoting his ability to infer the reputation of others. The parameter p of each individual is kept constant during the game. The value of p indicates that the neighbor possessing highest reputation is chosen with the probability p and randomly choosing an opponent is left with the probability 1−p. We find that this novel mechanism can be seen as an universally applicable promoter of cooperation, which works on various interaction networks and in different types of evolutionary game. Of particular interest is the fact that, in the early stages of evolutionary process, cooperators with high reputation who are easily regarded as the potential strategy donors can quickly lead to the formation of extremely robust clusters of cooperators that are impervious to defector attacks. These clusters eventually help cooperators reach their undisputed dominance, which transcends what can be warranted by the spatial reciprocity alone. Moreover, we provide complete phase diagrams to depict the impact of uncertainty in strategy adoptions and conclude that the effective interaction topology structure may be altered under such a mechanism. When the estimation of reputation is extended, we also show that the moderate value of evaluation factor enables cooperation to thrive best. We thus present a viable method of understanding the ubiquitous cooperative behaviors in nature and hope that it will inspire further studies to resolve social dilemmas.

Different reactions to adverse neighborhoods in games of cooperation

In social dilemmas, cooperation among randomly interacting individuals is often difficult to achieve. The situation changes if interactions take place in a network where the network structure jointly evolves with the behavioral strategies of the interacting individuals. In particular, cooperation can be stabilized if individuals tend to cut interaction links when facing adverse neighborhoods. Here we consider two different types of reaction to adverse neighborhoods, and all possible mixtures between these reactions. When faced with a gloomy outlook, players can either choose to cut and rewire some of their links to other individuals, or they can migrate to another location and establish new links in the new local neighborhood. We find that in general local rewiring is more favorable for the evolution of cooperation than emigration from adverse neighborhoods. Rewiring helps to maintain the diversity in the degree distribution of players and favors the spontaneous emergence of cooperative clusters. Both properties are known to favor the evolution of cooperation on networks. Interestingly, a mixture of migration and rewiring is even more favorable for the evolution of cooperation than rewiring on its own. While most models only consider a single type of reaction to adverse neighborhoods, the coexistence of several such reactions may actually be an optimal setting for the evolution of cooperation.

From local to global dilemmas in social networks

Social networks affect in such a fundamental way the dynamics of the population they support that the global, population-wide behavior that one observes often bears no relation to the individual processes it stems from. Up to now, linking the global networked dynamics to such individual mechanisms has remained elusive. Here we study the evolution of cooperation in networked populations and let individuals interact via a 2-person Prisoner's Dilemma – a characteristic defection dominant social dilemma of cooperation. We show how homogeneous networks transform a Prisoner's Dilemma into a population-wide evolutionary dynamics that promotes the coexistence between cooperators and defectors, while heterogeneous networks promote their coordination. To this end, we define a dynamic variable that allows us to track the self-organization of cooperators when co-evolving with defectors in networked populations. Using the same variable, we show how the global dynamics — and effective dilemma — co-evolves with the motifs of cooperators in the population, the overall emergence of cooperation depending sensitively on this co-evolution.

Evolution of interactions and cooperation in the spatial prisoner's dilemma game

We study the evolution of cooperation in the spatial prisoner's dilemma game where players are allowed to establish new interactions with others. By employing a simple coevolutionary rule entailing only two crucial parameters, we find that different selection criteria for the new interaction partners as well as their number vitally affect the outcome of the game. The resolution of the social dilemma is most probable if the selection favors more successful players and if their maximally attainable number is restricted. While the preferential selection of the best players promotes cooperation irrespective of game parametrization, the optimal number of new interactions depends somewhat on the temptation to defect. Our findings reveal that the "making of new friends" may be an important activity for the successful evolution of cooperation, but also that partners must be selected carefully and their number limited.

Chaos and unpredictability in evolutionary dynamics in discrete time

A discrete-time version of the replicator equation for two-strategy games is studied. The stationary properties differ from those of continuous time for sufficiently large values of the parameters, where periodic and chaotic behavior replace the usual fixed-point population solutions. We observe the familiar period-doubling and chaotic-band-splitting attractor cascades of unimodal maps but in some cases more elaborate variations appear due to bimodality. Also unphysical stationary solutions can have unusual physical implications, such as the uncertainty of the final population caused by sensitivity to initial conditions and fractality of attractor preimage manifolds.

Mesoscopic effects in an agent-based bargaining model in regular lattices

The effect of spatial structure has been proved very relevant in repeated games. In this work we propose an agent based model where a fixed finite population of tagged agents play iteratively the Nash demand game in a regular lattice. The model extends the multiagent bargaining model by Axtell, Epstein and Young [1] modifying the assumption of global interaction. Each agent is endowed with a memory and plays the best reply against the opponent's most frequent demand. We focus our analysis on the transient dynamics of the system, studying by computer simulation the set of states in which the system spends a considerable fraction of the time. The results show that all the possible persistent regimes in the global interaction model can also be observed in this spatial version. We also find that the mesoscopic properties of the interaction networks that the spatial distribution induces in the model have a significant impact on the diffusion of strategies, and can lead to new persistent regimes different from those found in previous research. In particular, community structure in the intratype interaction networks may cause that communities reach different persistent regimes as a consequence of the hindering diffusion effect of fluctuating agents at their borders.

Coveting thy neighbors fitness as a means to resolve social dilemmas

In spatial evolutionary games the fitness of each individual is traditionally determined by the payoffs it obtains upon playing the game with its neighbors. Since defection yields the highest individual benefits, the outlook for cooperators is gloomy. While network reciprocity promotes collaborative efforts, chances of averting the impending social decline are slim if the temptation to defect is strong. It is, therefore, of interest to identify viable mechanisms that provide additional support for the evolution of cooperation. Inspired by the fact that the environment may be just as important as inheritance for individual development, we introduce a simple switch that allows a player to either keep its original payoff or use the average payoff of all its neighbors. Depending on which payoff is higher, the influence of either option can be tuned by means of a single parameter. We show that, in general, taking into account the environment promotes cooperation. Yet coveting the fitness of one's neighbors too strongly is not optimal. In fact, cooperation thrives best only if the influence of payoffs obtained in the traditional way is equal to that of the average payoff of the neighborhood. We present results for the prisoner's dilemma and the snowdrift game, for different levels of uncertainty governing the strategy adoption process, and for different neighborhood sizes. Our approach outlines a viable route to increased levels of cooperative behavior in structured populations, but one that requires a thoughtful implementation.

Selection of noise level in strategy adoption for spatial social dilemmas

We studied spatial Prisoner's Dilemma and Stag Hunt games where both the strategy distribution and the players' individual noise level could evolve to reach higher individual payoff. Players are located on the sites of different two-dimensional lattices and gain their payoff from games with their neighbors by choosing unconditional cooperation or defection. The way of strategy adoption can be characterized by a single K (temperaturelike) parameter describing how strongly adoptions depend on the payoff difference. If we start the system from a random strategy distribution with many different player specific K parameters, the simultaneous evolution of strategies and K parameters drives the system to a final stationary state where only one K value remains. In the coexistence phase of cooperator and defector strategies the surviving K parameter is in good agreement with the noise level that ensures the highest cooperation level if uniform K is supposed for all players. In this paper we give a thorough overview about the properties of this evolutionary process.

Coevolutionary games--a mini review

Prevalence of cooperation within groups of selfish individuals is puzzling in that it contradicts with the basic premise of natural selection. Favoring players with higher fitness, the latter is key for understanding the challenges faced by cooperators when competing with defectors. Evolutionary game theory provides a competent theoretical framework for addressing the subtleties of cooperation in such situations, which are known as social dilemmas. Recent advances point towards the fact that the evolution of strategies alone may be insufficient to fully exploit the benefits offered by cooperative behavior. Indeed, while spatial structure and heterogeneity, for example, have been recognized as potent promoters of cooperation, coevolutionary rules can extend the potentials of such entities further, and even more importantly, lead to the understanding of their emergence. The introduction of coevolutionary rules to evolutionary games implies, that besides the evolution of strategies, another property may simultaneously be subject to evolution as well. Coevolutionary rules may affect the interaction network, the reproduction capability of players, their reputation, mobility or age. Here we review recent works on evolutionary games incorporating coevolutionary rules, as well as give a didactic description of potential pitfalls and misconceptions associated with the subject. In addition, we briefly outline directions for future research that we feel are promising, thereby particularly focusing on dynamical effects of coevolutionary rules on the evolution of cooperation, which are still widely open to research and thus hold promise of exciting new discoveries.