The complexity of human cooperation under indirect reciprocity

Computational evolution of social norms in well-mixed and group-structured populations

Models of indirect reciprocity study how social norms promote cooperation. In these models, cooperative individuals build up a positive reputation, which in turn helps them in their future interactions. The exact reputational benefits of cooperation depend on the norm in place, which may change over time. Previous research focused on the stability of social norms. Much less is known about how social norms initially evolve when competing with many others. A comprehensive evolutionary analysis, however, has been difficult. Even among the comparably simple space of so-called third-order norms, there are thousands of possibilities, each one inducing its own reputation dynamics. To address this challenge, we use large-scale computer simulations. We study the reputation dynamics of each third-order norm and all evolutionary transitions between them. In contrast to established work with only a handful of norms, we find that cooperation is hard to maintain in well-mixed populations. However, within group-structured populations, cooperation can emerge. The most successful norm in our simulations is particularly simple. It regards cooperation as universally positive, and defection as usually negative-unless defection takes the form of justified punishment. This research sheds light on the complex interplay of social norms, their induced reputation dynamics, and population structure.

The four stages of neighborhood trust: Classic grounded theory

INTRODUCTION

Neighborhoods are often overlooked as a determinant of health. Among recent research, the focus on "place-based effects," due to prolonged residential environmental exposure, has been of particular interest. These studies' purpose is to identify and examine how a healthy neighborhood is intentionally created to describe a transferable process-driven theory.

METHOD

A classic grounded theory approach was used in these studies. Data sources include individual in-depth interviews, historical documents, and a member-checking focus group, collected over 3-years.

RESULTS

Analysis generated the Four Stages of Neighborhood Trust Model, which is nested within the context of perceived neighborhood safety. The theory outlines a social process of four stages of neighborhood trust: (a) rules-based agreements, (b) shared values, (c) cooperation, and (d) neighborhood belonging.

CONCLUSIONS

We present the development of a process-driven theory that may be useful for public health nurses as they engage neighborhoods in health promotion activities. The stage of trust development will aid the nurse in identifying what is needed to move to the next stage in a healthy neighborhood process.

Adaptations to infer fitness interdependence promote the evolution of cooperation

The evolution of cooperation is a major question in the biological and behavioral sciences. While most theoretical studies model cooperation in the context of an isolated interaction (e.g., a Prisoner's Dilemma), humans live in heterogeneous social environments, characterized by large variations in fitness interdependence-the extent to which one's fitness is affected by others. Theoretical and experimental work indicates that humans can infer, and respond to, variations in interdependence. In a heterogeneous ancestral environment, these psychological mechanisms to infer fitness interdependence could have provided a selective advantage, allowing individuals to maximize their fitness by deciding when and with whom to cooperate. Yet, to date, the link between cognitive inference, variation in fitness interdependence, and cooperation remains unclear. Here we introduce a theoretical framework to study the evolution of inference and cooperation in heterogeneous social environments, where individuals experience interactions with varying levels of corresponding interests. Using a combination of evolutionary game theory and agent-based modeling, we model the evolution of adaptive agents, who incur a cost to infer interdependence, in populations of fixed-behavior agents who always cooperate or defect. Our results indicate that natural selection could promote the evolution of psychological mechanisms to infer fitness interdependence, provided that there is enough variation in fitness interdependence to offset the cost of inference. Under certain conditions, the fixation of adaptive agents results in higher levels of cooperation. This depends crucially on the type of inference performed and the features of the interdependence landscape.

The emergence of division of labour through decentralized social sanctioning

Human ecological success relies on our characteristic ability to flexibly self-organize into cooperative social groups, the most successful of which employ substantial specialization and division of labour. Unlike most other animals, humans learn by trial and error during their lives what role to take on. However, when some critical roles are more attractive than others, and individuals are self-interested, then there is a social dilemma: each individual would prefer others take on the critical but unremunerative roles so they may remain free to take one that pays better. But disaster occurs if all act thus and a critical role goes unfilled. In such situations learning an optimum role distribution may not be possible. Consequently, a fundamental question is: how can division of labour emerge in groups of self-interested lifetime-learning individuals? Here, we show that by introducing a model of social norms, which we regard as emergent patterns of decentralized social sanctioning, it becomes possible for groups of self-interested individuals to learn a productive division of labour involving all critical roles. Such social norms work by redistributing rewards within the population to disincentivize antisocial roles while incentivizing prosocial roles that do not intrinsically pay as well as others.

Shibboleth: An agent-based model of signalling mimicry

Mimicry is an essential strategy for exploiting competitors in competitive co-evolutionary relationships. Protection against mimicry may, furthermore, be a driving force in human linguistic diversity: the potential harm caused by failing to detect mimicked group-identity signals may select for high sensitivity to mimicry of honest group members. Here we describe the results of five agent-based models that simulate multi-generational interactions between two groups of individuals: original members of a group with an honest identity signal, and members of an outsider group who mimic that signal, aiming to pass as members of the in-group. The models correspond to the Biblical story of Shibboleth, where a tribe in conflict with another determines tribe affiliation by asking individuals to pronounce the word, 'Shibboleth.' In the story, failure to reproduce the word phonetically resulted in death. Here, we run five different versions of a 'Shibboleth' model: a first, simple version, which evaluates whether a composite variable of mimicry quality and detection quality is a superior predictor to the model's outcome than is cost of detection. The models thereafter evaluate variations on the simple model, incorporating group-level behaviours such as altruistic punishment. Our results suggest that group members' sensitivity to mimicry of the Shibboleth-signal is a better predictor of whether any signal of group identity goes into fixation in the overall population than is the cost of mimicry detection. Thus, the likelihood of being detected as a mimic may be more important than the costs imposed on mimics who are detected. This suggests that theoretical models in biology should place greater emphasis on the likelihood of detection, which does not explicitly entail costs, rather than on the costs to individuals who are detected. From a language learning perspective, the results suggest that admission to group membership through linguistic signals is powered by the ability to imitate and evade detection as an outsider by existing group members.

Score-mediated mutual consent and indirect reciprocity

Helping strangers at a cost to oneself is a hallmark of many human interactions, but difficult to justify from the viewpoint of natural selection, particularly in anonymous one-shot interactions. Reputational scoring can provide the necessary motivation via "indirect reciprocity," but maintaining reliable scores requires close oversight to prevent cheating. We show that in the absence of such supervision, it is possible that scores might be managed by mutual consent between the agents themselves instead of by third parties. The space of possible strategies for such "consented" score changes is very large but, using a simple cooperation game, we search it, asking what kinds of agreement can i) invade a population from rare and ii) resist invasion once common. We prove mathematically and demonstrate computationally that score mediation by mutual consent does enable cooperation without oversight. Moreover, the most invasive and stable strategies belong to one family and ground the concept of value by incrementing one score at the cost of the other, thus closely resembling the token exchange that underlies money in everyday human transactions. The most successful strategy has the flavor of money except that agents without money can generate new score if they meet. This strategy is evolutionarily stable, and has higher fitness, but is not physically realizable in a decentralized way; when conservation of score is enforced more money-like strategies dominate. The equilibrium distribution of scores under any of this family of strategies is geometric, meaning that agents with score 0 are inherent to money-like strategies.

Evolutionary stability of cooperation in indirect reciprocity under noisy and private assessment

Indirect reciprocity is a mechanism that explains large-scale cooperation in humans. In indirect reciprocity, individuals use reputations to choose whether or not to cooperate with a partner and update others' reputations. A major question is how the rules to choose their actions and the rules to update reputations evolve. In the public reputation case where all individuals share the evaluation of others, social norms called Simple Standing (SS) and Stern Judging (SJ) have been known to maintain cooperation. However, in the case of private assessment where individuals independently evaluate others, the mechanism of maintenance of cooperation is still largely unknown. This study theoretically shows for the first time that cooperation by indirect reciprocity can be evolutionarily stable under private assessment. Specifically, we find that SS can be stable, but SJ can never be. This is intuitive because SS can correct interpersonal discrepancies in reputations through its simplicity. On the other hand, SJ is too complicated to avoid an accumulation of errors, which leads to the collapse of cooperation. We conclude that moderate simplicity is a key to stable cooperation under the private assessment. Our result provides a theoretical basis for the evolution of human cooperation.

Inequality leads to the evolution of intolerance in reputation-based populations

This work studies the impact of economic inequality on the evolution of intolerance through a reputation-based model of indirect reciprocity. Results show that economic inequality is a powerful enhancer of intolerance, inducing the escalation of out-group discrimination even without the presence of new intolerant mutants. It also generates behavior modifications within tolerant disfavored minorities: their members either relax punishments against the uncooperative or prioritize helping the wealthy, even suffering discrimination in return. On the other hand, the redistribution of wealth is proven as a viable solution to avoid the spread of intolerance as long as it increases equality and is implemented before intolerance permeates part of the population.

Reputation structure in indirect reciprocity under noisy and private assessment

Evaluation relationships are pivotal for maintaining a cooperative society. A formation of the evaluation relationships has been discussed in terms of indirect reciprocity, by modeling dynamics of good or bad reputations among individuals. Recently, a situation that individuals independently evaluate others with errors (i.e., noisy and private reputation) is considered, where the reputation structure (from what proportion of individuals in the population each receives good reputations, defined as goodness here) becomes complex, and thus has been studied mainly with numerical simulations. The present study gives a theoretical analysis of such complex reputation structure. We formulate the time change of goodness of individuals caused by updates of reputations among individuals. By considering a large population, we derive dynamics of the frequency distribution of goodnesses. An equilibrium state of the dynamics is approximated by a summation of Gaussian functions. We demonstrate that the theoretical solution well fits the numerical calculation. From the theoretical solution, we obtain a new interpretation of the complex reputation structure. This study provides a novel mathematical basis for cutting-edge studies on indirect reciprocity.

The psychological foundations of reputation-based cooperation

Humans care about having a positive reputation, which may prompt them to help in scenarios where the return benefits are not obvious. Various game-theoretical models support the hypothesis that concern for reputation may stabilize cooperation beyond kin, pairs or small groups. However, such models are not explicit about the underlying psychological mechanisms that support reputation-based cooperation. These models therefore cannot account for the apparent rarity of reputation-based cooperation in other species. Here, we identify the cognitive mechanisms that may support reputation-based cooperation in the absence of language. We argue that a large working memory enhances the ability to delay gratification, to understand others' mental states (which allows for perspective-taking and attribution of intentions) and to create and follow norms, which are key building blocks for increasingly complex reputation-based cooperation. We review the existing evidence for the appearance of these processes during human ontogeny as well as their presence in non-human apes and other vertebrates. Based on this review, we predict that most non-human species are cognitively constrained to show only simple forms of reputation-based cooperation. This article is part of the theme issue 'The language of cooperation: reputation and honest signalling'.

Reputation and punishment sustain cooperation in the optional public goods game

Cooperative behaviour has been extensively studied as a choice between cooperation and defection. However, the possibility to not participate is also frequently available. This type of problem can be studied through the optional public goods game. The introduction of the 'Loner' strategy' allows players to withdraw from the game, which leads to a cooperator-defector-loner cycle. While pro-social punishment can help increase cooperation, anti-social punishment-where defectors punish cooperators-causes its downfall in both experimental and theoretical studies. In this paper, we introduce social norms that allow agents to condition their behaviour to the reputation of their peers. We benchmark this with respect both to the standard optional public goods game and to the variant where all types of punishment are allowed. We find that a social norm imposing a more moderate reputational penalty for opting out than for defecting increases cooperation. When, besides reputation, punishment is also possible, the two mechanisms work synergically under all social norms that do not assign to loners a strictly worse reputation than to defectors. Under this latter set-up, the high levels of cooperation are sustained by conditional strategies, which largely reduce the use of pro-social punishment and almost completely eliminate anti-social punishment. This article is part of the theme issue 'The language of cooperation: reputation and honest signalling'.

Reputation and socio-ecology in humans

Reputation is a fundamental feature of human sociality as it sustains cooperative relationships among unrelated individuals. Research from various disciplines provides insights on how individuals form impressions of others, condition their behaviours based on the reputation of their interacting partners and spread or learn such reputations. However, past research has often neglected the socio-ecological conditions that can shape reputation systems and their effect on cooperation. Here, we outline how social environments, cultural values and institutions come to play a crucial role in how people navigate reputation systems. Moreover, we illustrate how these socio-ecological dimensions affect the interdependence underlying social interactions (e.g. potential recipients of reputational benefits, degree of dependence) and the extent to which reputation systems promote cooperation. To do so, we review the interdisciplinary literature that illustrates how reputation systems are shaped by the variation of prominent ecological features. Finally, we discuss the implications of a socio-ecological approach to the study of reputation and outline potential avenues for future research. This article is part of the theme issue 'The language of cooperation: reputation and honest signalling'.

When does reputation lie? Dynamic feedbacks between costly signals, social capital and social prominence

Performing a dramatic act of religious devotion, creating an art exhibit, or releasing a new product are all examples of public acts that signal quality and contribute to building a reputation. Signalling theory predicts that these public displays can reliably reveal quality. However, data from ethnographic work in South India suggests that more prominent individuals gain more from reputation-building religious acts than more marginalized individuals. To understand this phenomenon, we extend signalling theory to include variation in people's social prominence or social capital, first with an analytical model and then with an agent-based model. We consider two ways in which social prominence/capital may alter signalling: (i) it impacts observers' priors, and (ii) it alters the signallers' pay-offs. These two mechanisms can result in both a 'reputational shield,' where low quality individuals are able to 'pass' as high quality thanks to their greater social prominence/capital, and a 'reputational poverty trap,' where high quality individuals are unable to improve their standing owing to a lack of social prominence/capital. These findings bridge the signalling theory tradition prominent in behavioural ecology, anthropology and economics with the work on status hierarchies in sociology, and shed light on the complex ways in which individuals make inferences about others. This article is part of the theme issue 'The language of cooperation: reputation and honest signalling'.

The language of cooperation: reputation and honest signalling

Large-scale non-kin cooperation is a unique ingredient of human success. This type of cooperation is challenging to explain in a world of self-interested individuals. There is overwhelming empirical evidence from different disciplines that reputation and gossip promote cooperation in humans in different contexts. Despite decades of research, important details of reputation systems are still unclear. Our goal with this theme issue is to promote an interdisciplinary approach that allows us to explore and understand the evolution and maintenance of reputation systems with a special emphasis on gossip and honest signalling. The theme issue is organized around four main questions: What are the necessary conditions for reputation-based systems? What is the content and context of reputation systems? How can reputations promote cooperation? And, what is the role of gossip in maintaining reputation systems and thus cooperation? This article is part of the theme issue 'The language of cooperation: reputation and honest signalling'.