Vicarious neural processing of outcomes during observational learning

Predictive coding for the actions and emotions of others and its deficits in autism spectrum disorders

Traditionally, the neural basis of social perception has been studied by showing participants brief examples of the actions or emotions of others presented in randomized order to prevent participants from anticipating what others do and feel. This approach is optimal to isolate the importance of information flow from lower to higher cortical areas. The degree to which feedback connections and Bayesian hierarchical predictive coding contribute to how mammals process more complex social stimuli has been less explored, and will be the focus of this review. We illustrate paradigms that start to capture how participants predict the actions and emotions of others under more ecological conditions, and discuss the brain activity measurement methods suitable to reveal the importance of feedback connections in these predictions. Together, these efforts draw a richer picture of social cognition in which predictive coding and feedback connections play significant roles. We further discuss how the notion of predicting coding is influencing how we think of autism spectrum disorder.

Transmission of social bias through observational learning

People often rely on social learning-learning by observing others' actions and outcomes-to form preferences in advance of their own direct experiences. Although typically adaptive, we investigated whether social learning may also contribute to the formation and spread of prejudice. In six experiments (n = 1550), we demonstrate that by merely observing interactions between a prejudiced actor and social group members, observers acquired the prejudices of the actor. Moreover, observers were unaware of the actors' bias, misattributing their acquired group preferences to the behavior of group members, despite identical behavior between groups. Computational modeling revealed that this effect was due to value shaping, whereby one's preferences are shaped by another's actions toward a target, in addition to the target's reward feedback. These findings identify social learning as a potent mechanism of prejudice formation that operates implicitly and supports the transmission of intergroup bias.

F = ma. Is the macaque brain Newtonian?

Intuitive Physics, the ability to anticipate how the physical events involving mass objects unfold in time and space, is a central component of intelligent systems. Intuitive physics is a promising tool for gaining insight into mechanisms that generalize across species because both humans and non-human primates are subject to the same physical constraints when engaging with the environment. Physical reasoning abilities are widely present within the animal kingdom, but monkeys, with acute 3D vision and a high level of dexterity, appreciate and manipulate the physical world in much the same way humans do.

Neural representations of vicarious rewards are linked to interoception and prosocial behaviour

Every day we constantly observe other people receiving rewards. Theoretical accounts posit that vicarious reward processing might be linked to people's sensitivity to internal body states (interoception) and facilitates a tendency to act prosocially. However, the neural processes underlying the links between vicarious reward processing, interoception, and prosocial behaviour are poorly understood. Previous research has linked vicarious reward processing to the anterior cingulate gyrus (ACCg) and the anterior insula (AI). Can we predict someone's propensity to be prosocial or to be aware of interoceptive signals from variability in how the ACCg and AI process rewards? Here, participants monitored rewards being delivered to themselves or a stranger during functional magnetic resonance imaging. Later, they performed a task measuring their willingness to exert effort to obtain rewards for others, and a task measuring their propensity to be aware and use interoceptive respiratory signals. Using multivariate similarity analysis, we show that people's willingness to be prosocial is predicted by greater similarity between self and other representations in the ACCg. Moreover, greater dissimilarity in self-other representations in the AI is linked to interoceptive propensity. These findings highlight that vicarious reward is linked to bodily signals in AI, and foster prosocial tendencies through the ACCg.

Systems Thinking in an era of climate change: Does cognitive neuroscience hold the key to improving environmental decision making? A perspective on Climate-Smart Agriculture

Systems Thinking (ST) can be defined as a mental construct that recognises patterns and connections in a particular complex system to make the "best decision" possible. In the field of sustainable agriculture and climate change, higher degrees of ST are assumed to be associated with more successful adaptation strategies under changing conditions, and "better" environmental decision making in a number of environmental and cultural settings. Future climate change scenarios highlight the negative effects on agricultural productivity worldwide, particularly in low-income countries (LICs) situated in the Global South. Alongside this, current measures of ST are limited by their reliance on recall, and are prone to possible measurement errors. Using Climate-Smart Agriculture (CSA), as an example case study, in this article we explore: (i) ST from a social science perspective; (ii) cognitive neuroscience tools that could be used to explore ST abilities in the context of LICs; (iii) an exploration of the possible correlates of systems thinking: observational learning, prospective thinking/memory and the theory of planned behaviour and (iv) a proposed theory of change highlighting the integration of social science frameworks and a cognitive neuroscience perspective. We find, recent advancements in the field of cognitive neuroscience such as Near-Infrared Spectroscopy (NIRS) provide exciting potential to explore previously hidden forms of cognition, especially in a low-income country/field setting; improving our understanding of environmental decision-making and the ability to more accurately test more complex hypotheses where access to laboratory studies is severely limited. We highlight that ST may correlate with other key aspects involved in environmental decision-making and posit motivating farmers via specific brain networks would: (a) enhance understanding of CSA practices (e.g., via the frontoparietal network extending from the dorsolateral prefrontal cortex (DLPFC) to the parietal cortex (PC) a control hub involved in ST and observational learning) such as tailoring training towards developing improved ST abilities among farmers and involving observational learning more explicitly and (b) motivate farmers to use such practices [e.g., via the network between the DLPFC and nucleus accumbens (NAc)] which mediates reward processing and motivation by focussing on a reward/emotion to engage farmers. Finally, our proposed interdisciplinary theory of change can be used as a starting point to encourage discussion and guide future research in this space.

Making Effective Educational Videos for Clinical Teaching

Prerecorded video content in medical education has become more common. Increasingly accessible technology coupled with the COVID-19 pandemic and subsequent need for distanced learning has greatly increased the interest in and need for high-quality video content. The use of short educational videos to augment other teaching methods has been shown to improve learners' experiences, knowledge retention, and understanding of content. Multiple studies have demonstrated that video education can be a highly effective tool for learning, particularly for hard-to-visualize processes and for procedural education. Videos allow learners to view content at their own pace and revisit materials on demand. In addition, well-designed videos can be repurposed by educators, ultimately reducing time needed to create high-quality educational content. Currently available technology allows educators to create high-quality videos at minimal cost and with a modest investment of time. This article details practical tips for creating high-yield educational videos.

Neural responses to facial attractiveness in the judgments of moral goodness and moral beauty

The judgments of moral goodness and moral beauty objectively refer to the perception and evaluation of moral traits, which are generally influenced by facial attractiveness. For centuries, people have equated beauty with the possession of positive qualities, but it is not clear whether the association between beauty and positive qualities exerts a similarly implicit influence on people's responses to moral goodness and moral beauty, how it affects those responses, and what is the neural basis for such an effect. The present study is the first to examine the neural responses to facial attractiveness in the judgments of moral goodness and moral beauty. We found that beautiful faces in both moral judgments activated the left ventral occipitotemporal cortices sensitive to the geometric configuration of the faces, demonstrating that both moral goodness and moral beauty required the automatic visual analysis of geometrical configuration of attractive faces. In addition, compared to beautiful faces during moral goodness judgment, beautiful faces during moral beauty judgment induced unique activity in the ventral medial prefrontal cortex and midline cortical structures involved in the emotional-valenced information about attractive faces. The opposite comparison elicited specific activity in the left superior temporal cortex and premotor area, which play a critical role in the recognition of facial identity. Our results demonstrated that the neural responses to facial attractiveness in the process of higher order moral decision-makings exhibit both task-general and task-specific characteristics. Our findings contribute to the understanding of the essence of the relationship between morality and aesthetics.

Neural Mechanisms of Observational Learning: A Neural Working Model

Humans and some animal species are able to learn stimulus-response (S-R) associations by observing others' behavior. It saves energy and time and avoids the danger of trying the wrong actions. Observational learning (OL) depends on the capability of mapping the actions of others into our own behaviors, processing outcomes, and combining this knowledge to serve our goals. Observational learning plays a central role in the learning of social skills, cultural knowledge, and tool use. Thus, it is one of the fundamental processes in which infants learn about and from adults (Byrne and Russon, 1998). In this paper, we review current methodological approaches employed in observational learning research. We highlight the important role of the prefrontal cortex and cognitive flexibility to support this learning process, develop a new neural working model of observational learning, illustrate how imitation relates to observational learning, and provide directions for future research.

The actions of others act as a pseudo-reward to drive imitation in the context of social reinforcement learning

While there is no doubt that social signals affect human reinforcement learning, there is still no consensus about how this process is computationally implemented. To address this issue, we compared three psychologically plausible hypotheses about the algorithmic implementation of imitation in reinforcement learning. The first hypothesis, decision biasing (DB), postulates that imitation consists in transiently biasing the learner's action selection without affecting their value function. According to the second hypothesis, model-based imitation (MB), the learner infers the demonstrator's value function through inverse reinforcement learning and uses it to bias action selection. Finally, according to the third hypothesis, value shaping (VS), the demonstrator's actions directly affect the learner's value function. We tested these three hypotheses in 2 experiments (N = 24 and N = 44) featuring a new variant of a social reinforcement learning task. We show through model comparison and model simulation that VS provides the best explanation of learner's behavior. Results replicated in a third independent experiment featuring a larger cohort and a different design (N = 302). In our experiments, we also manipulated the quality of the demonstrators' choices and found that learners were able to adapt their imitation rate, so that only skilled demonstrators were imitated. We proposed and tested an efficient meta-learning process to account for this effect, where imitation is regulated by the agreement between the learner and the demonstrator. In sum, our findings provide new insights and perspectives on the computational mechanisms underlying adaptive imitation in human reinforcement learning.

Simulation-based training for early procedural skills acquisition in new anesthesia trainees: a prospective observational study

Background

In a setting in which learning of basic procedural skills commences upon graduation from medical school, and as a first step towards integration of simulation-based learning into the anesthesiology training program, a preparatory course for new anesthesia trainees was designed. Three educational strategies were sequentially combined (e-learning, simulation-based hands on workshops, and on-site observational learning), and performance was assessed in a stepwise approach on five procedural skills considered essential for early anesthetic management (peripheral intravenous cannulation, sterile hand wash and gowning, anesthesia workstation preparation, face-mask ventilation, and orotracheal intubation). The primary aim of this study was to determine if this preparatory training course at the onset of anesthesiology residency is useful to achieve a competent trainee performance in the clinical setting.

Methods

This prospective study was carried out at a university-affiliated hospital in Buenos Aires, Argentina, from 2017 to 2019. The 24 participants, comprising three cohorts of 8 residents each, underwent a preparatory course at the onset of residency. Diverse, consecutive educational strategies, and assessments (three stages: 1, 2, 3) took place using task-specific tools (checklists) and global rating scales for five procedural skills. The primary outcome was achievement of competent scores (85%) in final assessments, and the secondary outcomes were performance improvement between assessment stages and compliance with predefined safety items.

Results

Twenty trainees (83.3%) were found to be globally competent (both assessment tools for all procedures) during final assessments (stage 3). Statistically significant improvement was found for all procedural skills between baseline and after workshop assessment scores (stages 1–2), except for orotracheal intubation in checklists, and for all procedural skills between stages 2 and 3 except for sterile hand wash and gowning in checklists.

Conclusions

In our single-center experience, the gap for competent trainee performance in essential early anesthetic management skills can be effectively covered by conducting an intensive, preparatory course using the combination of three educational strategies (e-learning, simulation-based hands on workshops, and observational learning) at the onset of residency. This course has allowed learning to be generated in a secure environment for both patients and trainees.

Anterior cingulate cortex: A brain system necessary for learning to reward others?

Helping a friend move house, donating to charity, volunteering assistance during a crisis. Humans and other species alike regularly undertake prosocial behaviors—actions that benefit others without necessarily helping ourselves. But how does the brain learn what acts are prosocial? Basile and colleagues show that removal of the anterior cingulate cortex (ACC) prevents monkeys from learning what actions are prosocial but does not stop them carrying out previously learned prosocial behaviors. This highlights that the ability to learn what actions are prosocial and choosing to perform helpful acts may be distinct cognitive processes, with only the former depending on ACC.

How do we learn which actions benefit others? This Primer discusses a recent study showing that removal of the anterior cingulate cortex prevents monkeys from learning new actions that benefit others, but does not stop them from carrying out previously learned prosocial acts.

Evaluating advanced driver-assistance system trainings using driver performance, attention allocation, and neural efficiency measures

There are about 44 million licensed older drivers in the U.S. Older adults have higher crash rates and fatalities as compared to middle-aged and young drivers, which might be associated with degradations in sensory, cognitive, and physical capabilities. Advanced driver-assistance systems (ADAS) have the potential to substantially improve safety by removing some of driver vehicle control responsibilities. However, a critical aspect of providing ADAS is educating drivers on their operational characteristics and continued use. Twenty older adults participated in a driving simulation study assessing the effectiveness of video-based and demonstration-based training protocols in learning ADAS considering gender differences. The findings revealed video-based training to be more effective than demonstration-based training in improving driver performance and reducing off-road visual attention allocation and mental workload. In addition, female drivers required lower investment of mental effort (higher neural efficiency) to maintain the performance relative to males and they were less distracted by ADAS. However, male drivers were faster in activating ADAS as compared to females since they were monitoring the status of ADAS features more frequently while driving. The findings of this study provided an empirical support for using video-based approach for learning ADAS in older adults to improve driver safety and supported previous findings on older adults' learning that as age increases there is a tendency to prefer more passive and observational learning methods.

Learning How to Throw Darts. Effects of Modeling Type and Reflection on Novices' Dart-Throwing Skills

In this study, we investigated the effects of modeling type and reflection on the acquisition of dart-throwing skills, self-efficacy beliefs and self-reaction scores by conceptually replicating a study by Kitsantas, Zimmerman, and Cleary (2000). Participants observing a novice model were expected to surpass participants observing an expert model who in turn were expected to outperform participants who learned without a model. Reflection was hypothesized to have a positive effect. 156 High school and university students were tested three times: in a pretest, after a modeling intervention, and after a practice round. Contrary to what was expected, we found no main effects of modeling type and reflection. No interaction effects were found either. There was an effect of testing moment, indicating that participants improved dart-throwing skills, self-efficacy beliefs, and self-reaction scores over time. With these findings, we are not able to replicate Kitsantas et al. From our study, we conclude that observational learning, irrespective of the model's skill level, combined with physical practice, yields similar results as mere physical practice.

Changes in brain activity following the voluntary control of empathy

In neuroscience, empathy is often conceived as relatively automatic. The voluntary control that people can exert on brain mechanisms that map the emotions of others onto our own emotions has received comparatively less attention. Here, we therefore measured brain activity while participants watched emotional Hollywood movies under two different instructions: to rate the main characters' emotions by empathizing with them, or to do so while keeping a detached perspective. We found that participants yielded highly consistent and similar ratings of emotions under both conditions. Using intersubject correlation-based analyses we found that, when encouraged to empathize, participants' brain activity in limbic (including cingulate and putamen) and somatomotor regions (including premotor, SI and SII) synchronized more during the movie than when encouraged to detach. Using intersubject functional connectivity we found that comparing the empathic and detached perspectives revealed widespread increases in functional connectivity between large scale networks. Our findings contribute to the increasing awareness that we have voluntary control over the neural mechanisms through which we process the emotions of others.

Emotional Theory of Rationality

In recent decades, the existence of a close relationship between emotional phenomena and rational processes has certainly been established, yet there is still no unified definition or effective model to describe them. To advance our understanding of the mechanisms governing the behavior of living beings, we must integrate multiple theories, experiments, and models from both fields. In this article we propose a new theoretical framework that allows integrating and understanding the emotion-cognition duality, from a functional point of view. Based on evolutionary principles, our reasoning adds to the definition and understanding of emotion, justifying its origin, explaining its mission and dynamics, and linking it to higher cognitive processes, mainly with attention, cognition, decision-making, and consciousness. According to our theory, emotions are the mechanism for brain function optimization, aside from the contingency and stimuli prioritization system. As a result of this approach, we have developed a dynamic systems-level model capable of providing plausible explanations for certain psychological and behavioral phenomena and establishing a new framework for the scientific definition of some fundamental psychological terms.

Who cares what parents think or do? Observational learning and experience-based learning through communication in rice farmers' willingness to adopt sustainable agricultural technologies in Hubei Province, China

Sustainable agricultural technologies are of great significance in fully utilizing agricultural resources and promoting agricultural production. However, the adoption rates of these technologies are often characterized as low in rural areas in China. To figure out the potential salient determinants of rice farmers' willingness to adopt sustainable agricultural technologies, this paper, by employing the multivariate probit model and ordered probit model, particularly and firstly explores the roles of observational learning and experience-based learning through communication from parents within the household on rice farmers' willingness to adopt these technologies. Results show that there are strong complementarities and substitutabilities between sustainable agricultural technologies that rice farmers are willing to adopt, and that observational learning and experience-based learning through communication within the household do have pronounced effects on rice farmers' willingness to adopt some sustainable agricultural technologies and on their intensive use intentions. Therefore, while formulating policies to improve the adoption rates and adoption intensity of these technologies, relevant government agencies should take the complementarities and substitutabilities between sustainable agricultural technologies as well as observational learning and experience-based learning through communication from parents into consideration.

Macaque monkeys learn by observation in the ghost display condition in the object-in-place task with differential reward to the observer

Observational learning has been investigated in monkeys mainly using conspecifics or humans as models to observe. Some studies attempted to clarify the social agent’s role and to test whether non-human primates could learn from observation of a non-social agent, usually mentioned as a ‘ghost display’ condition, but they reported conflicting results. To address this question, we trained three rhesus monkeys in an object-in-place task consisting of the presentation of five subsequent problems composed of two objects, one rewarded and one unrewarded, for six times, or runs. Three types of learning conditions were tested. In the individual learning condition, the monkeys performed the first run, learned from it and improved their performance in the following runs. In the social and non-social learning conditions, they observed respectively a human model and a computer performing the first run and learned by the observation of their successes or errors. In all three conditions, the monkeys themselves received the reward after correct choices only. One-trial learning occurred in all three conditions. The monkeys performed over chance in the second run in all conditions, providing evidence of non-social observational learning with differential reward in macaque monkeys using a “ghost display” condition in a cognitive task.

Neural responses when learning spatial and object sequencing tasks via imitation

Humans often learn new things via imitation. Here we draw on studies of imitation in children to characterise the brain system(s) involved in the imitation of different sequence types using functional magnetic resonance imaging. On each trial, healthy adult participants learned one of two rule types governing the sequencing of three pictures: a motor-spatial rule (in the spatial task) or an object-based rule (in the cognitive task). Sequences were learned via one of three demonstration types: a video of a hand selecting items in the sequence using a joystick (Hand condition), a computer display highlighting each item in order (Ghost condition), or a text-based demonstration of the sequence (Text condition). Participants then used a joystick to execute the learned sequence. Patterns of activation during demonstration observation suggest specialisation for object-based imitation in inferior frontal gyrus, specialisation for spatial sequences in anterior intraparietal sulcus (IPS), and a general preference for imitation in middle IPS. Adult behavioural performance contrasted with that of children in previous studies—indicating that they experienced more difficulty with the cognitive task—while neuroimaging results support the engagement of different neural regions when solving these tasks. Further study is needed on whether children’s differential performance is related to delayed IPS maturation.

Agent-specific learning signals for self-other distinction during mentalising

Humans have a remarkable ability to simulate the minds of others. How the brain distinguishes between mental states attributed to self and mental states attributed to someone else is unknown. Here, we investigated how fundamental neural learning signals are selectively attributed to different agents. Specifically, we asked whether learning signals are encoded in agent-specific neural patterns or whether a self–other distinction depends on encoding agent identity separately from this learning signal. To examine this, we tasked subjects to learn continuously 2 models of the same environment, such that one was selectively attributed to self and the other was selectively attributed to another agent. Combining computational modelling with magnetoencephalography (MEG) enabled us to track neural representations of prediction errors (PEs) and beliefs attributed to self, and of simulated PEs and beliefs attributed to another agent. We found that the representational pattern of a PE reliably predicts the identity of the agent to whom the signal is attributed, consistent with a neural self–other distinction implemented via agent-specific learning signals. Strikingly, subjects exhibiting a weaker neural self–other distinction also had a reduced behavioural capacity for self–other distinction and displayed more marked subclinical psychopathological traits. The neural self–other distinction was also modulated by social context, evidenced in a significantly reduced decoding of agent identity in a nonsocial control task. Thus, we show that self–other distinction is realised through an encoding of agent identity intrinsic to fundamental learning signals. The observation that the fidelity of this encoding predicts psychopathological traits is of interest as a potential neurocomputational psychiatric biomarker.

In order for people to have meaningful social interactions, they need to infer each other’s beliefs. Converging evidence from humans and nonhuman primates suggests that a person’s brain can represent a second person’s beliefs by simulating that second person’s brain activity. However, it is not known how the outputs of those simulations are identified as ‘yours and not mine’. This ability to distinguish self from other is required for social cognition, and it may be impaired in mental health disorders with social cognitive deficits. We investigated self–other distinction in healthy adults learning about an environment both from their own point of view and the point of view of another person. We used computationally identified learning variables and then detected how these variables are represented by measuring magnetic fields in the brain. We found that the human brain can distinguish self from other by expressing these signals in dissociable activity patterns. Subjects who showed the largest difference between self signals and other signals were better at distinguishing self from other in the task and also showed fewer traits of mental health disorders.

Role of Anterior Cingulate Cortex in Instrumental Learning: Blockade of Dopamine D1 Receptors Suppresses Overt but Not Covert Learning

HIGHLIGHTS

Blockade of dopamine D1 receptors in ACC suppressed instrumental learning when overt responding was required.

Covert learning through observation was not impaired.

After treatment with a dopamine antagonist, instrumental learning recovered but not the rat's pretreatment level of effort tolerance.

ACC dopamine is not necessary for acquisition of task-relevant cues during learning, but regulates energy expenditure and effort based decision.

Dopamine activity in anterior cingulate cortex (ACC) is essential for various aspects of instrumental behavior, including learning and effort based decision making. To dissociate learning from physical effort, we studied both observational (covert) learning, and trial-and-error (overt) learning. If ACC dopamine activity is required for task acquisition, its blockade should impair both overt and covert learning. If dopamine is not required for task acquisition, but solely for regulating the willingness to expend effort for reward, i.e., effort tolerance, blockade should impair overt learning but spare covert learning. Rats learned to push a lever for food rewards either with or without prior observation of an expert conspecific performing the same task. Before daily testing sessions, the rats received bilateral ACC microinfusions of SCH23390, a dopamine D1 receptor antagonist, or saline-control infusions. We found that dopamine blockade suppressed overt responding selectively, leaving covert task acquisition through observational learning intact. In subsequent testing sessions without dopamine blockade, rats recovered their overt-learning capacity but not their pre-treatment level of effort tolerance. These results suggest that ACC dopamine is not required for the acquisition of conditioned behaviors and that apparent learning impairments could instead reflect a reduced level of willingness to expend effort due to cortical dopamine blockade.

Conflict monitoring in speech processing: An fMRI study of error detection in speech production and perception

To minimize the number of errors in speech, and thereby facilitate communication, speech is monitored before articulation. It is, however, unclear at which level during speech production monitoring takes place, and what mechanisms are used to detect and correct errors. The present study investigated whether internal verbal monitoring takes place through the speech perception system, as proposed by perception-based theories of speech monitoring, or whether mechanisms independent of perception are applied, as proposed by production-based theories of speech monitoring. With the use of fMRI during a tongue twister task we observed that error detection in internal speech during noise-masked overt speech production and error detection in speech perception both recruit the same neural network, which includes pre-supplementary motor area (pre-SMA), dorsal anterior cingulate cortex (dACC), anterior insula (AI), and inferior frontal gyrus (IFG). Although production and perception recruit similar areas, as proposed by perception-based accounts, we did not find activation in superior temporal areas (which are typically associated with speech perception) during internal speech monitoring in speech production as hypothesized by these accounts. On the contrary, results are highly compatible with a domain general approach to speech monitoring, by which internal speech monitoring takes place through detection of conflict between response options, which is subsequently resolved by a domain general executive center (e.g., the ACC).

Coordinated activation of premotor and ventromedial prefrontal cortices during vicarious reward

The vicarious reward we receive from watching likable others obtaining a positive outcome is a pervasive phenomenon, yet its neural correlates are poorly understood. Here, we conducted a series of functional magnetic resonance imaging experiments to test the hypothesis that the brain areas responsible for action observation and reward processing work in a coordinated fashion during vicarious reward. In the first experiment (manipulation phase), the participant was instructed to cheer for a particular player in a two-player competitive game (Rock–Paper–Scissors). This manipulation made participants feel more unity with that player and resulted in unity-related activation in the premotor area during action observation. In the following main experiment, the participant witnessed the previously cheered-for or non-cheered-for player succeed in a new solitary game (a stopwatch game). The ventromedial prefrontal cortex (vmPFC) was activated when the cheered-for player succeeded in the game but not when the other player did. Interestingly, this vmPFC activation was functionally connected with premotor activation only during the cheered-for player’s success. These results suggest that vicarious reward is processed in the vmPFC-premotor network, which is activated specifically by the success of the other person with whom the individual feels unity and closeness.

When your error becomes my error: anterior insula activation in response to observed errors is modulated by agency

Research on error observation has focused predominantly on situations in which individuals are passive observers of errors. In daily life, however, we are often jointly responsible for the mistakes of others. In the current study, we examined how information on agency is integrated in the error observation network. It was found that activation in the anterior insula but not in the posterior medial frontal cortex or lateral prefrontal cortex differentiates between observed errors for which we are partly responsible or not. Interestingly, the activation pattern of the AI was mirrored by feelings of guilt and shame. These results suggest that the anterior insula is crucially involved in evaluating the consequences of our actions for other persons. Consequently, this region may be thought of as critical in guiding social behavior.

Learning by observation in the macaque monkey under high experimental constraints

While neuroscience research has tremendously advanced our knowledge about the neural mechanisms of individual learning, i.e. through trial-and-error, it is only recently that neuroscientists have begun to study observational learning, and thus little is known about its neural mechanisms. One limitation is that observational learning has been addressed under unconstrained experimental conditions, not compatible with neuronal recordings. This study examined observational learning in macaque monkeys under the constraining conditions of behavioral neurophysiology. Two animals sat in primate chairs facing each other, with their head fixed. A touch screen was placed face up between the chairs at arm's reach, and the monkeys were trained on an abstract visuomotor associative task. In one experiment, the monkeys alternated the roles of "actor" and "observer". The actor learned to associate visual cues with reaching targets, while the observer "watched" freely. Then, the observer was given the same cue-target associations just performed by the actor, or had to learn new, not previously observed ones. The results show that learning performance is better after observation. In experiment 2, one monkey learned from a human actor who performed the task with errors only, or with successes only in separate blocks. The monkey's gain in performance was higher after observation of errors than after successes. The findings suggest that observational learning can occur even under highly constraining conditions, and open the way for investigating the neuronal correlates of social learning using the methods of behavioral neurophysiology.

Responsibility modulates pain-matrix activation elicited by the expressions of others in pain

Here we examine whether brain responses to dynamic facial expressions of pain are influenced by our responsibility for the observed pain. Participants played a flanker task with a confederate. Whenever either erred, the confederate was seen to receive a noxious shock. Using functional magnetic resonance imaging, we found that regions of the functionally localized pain-matrix of the participants (the anterior insula in particular) were activated most strongly when seeing the confederate receive a noxious shock when only the participant had erred (and hence had full responsibility). When both or only the confederate had erred (i.e. participant's shared or no responsibility), significantly weaker vicarious pain-matrix activations were measured.

•

Responsibility modulates empathy related brain responses.

•

Being fully responsible for another's pain increases activity in the witness' pain-matrix.

•

Sharing responsibility or not being responsible reduces pain-matrix activity.

An integrative neural model of social perception, action observation, and theory of mind

In the field of social neuroscience, major branches of research have been instrumental in describing independent components of typical and aberrant social information processing, but the field as a whole lacks a comprehensive model that integrates different branches. We review existing research related to the neural basis of three key neural systems underlying social information processing: social perception, action observation, and theory of mind. We propose an integrative model that unites these three processes and highlights the posterior superior temporal sulcus (pSTS), which plays a central role in all three systems. Furthermore, we integrate these neural systems with the dual system account of implicit and explicit social information processing. Large-scale meta-analyses based on Neurosynth confirmed that the pSTS is at the intersection of the three neural systems. Resting-state functional connectivity analysis with 1000 subjects confirmed that the pSTS is connected to all other regions in these systems. The findings presented in this review are specifically relevant for psychiatric research especially disorders characterized by social deficits such as autism spectrum disorder.

Processing of action- but not stimulus-related prediction errors differs between active and observational feedback learning

Learning of stimulus-response-outcome associations is driven by outcome prediction errors (PEs). Previous studies have shown larger PE-dependent activity in the striatum for learning from own as compared to observed actions and the following outcomes despite comparable learning rates. We hypothesised that this finding relates primarily to a stronger integration of action and outcome information in active learners. Using functional magnetic resonance imaging, we investigated brain activations related to action-dependent PEs, reflecting the deviation between action values and obtained outcomes, and action-independent PEs, reflecting the deviation between subjective values of response-preceding cues and obtained outcomes. To this end, 16 active and 15 observational learners engaged in a probabilistic learning card-guessing paradigm. On each trial, active learners saw one out of five cues and pressed either a left or right response button to receive feedback (monetary win or loss). Each observational learner observed exactly those cues, responses and outcomes of one active learner. Learning performance was assessed in active test trials without feedback and did not differ between groups. For both types of PEs, activations were found in the globus pallidus, putamen, cerebellum, and insula in active learners. However, only for action-dependent PEs, activations in these structures and the anterior cingulate were increased in active relative to observational learners. Thus, PE-related activity in the reward system is not generally enhanced in active relative to observational learning but only for action-dependent PEs. For the cerebellum, additional activations were found across groups for cue-related uncertainty, thereby emphasising the cerebellum's role in stimulus-outcome learning.

Hebbian learning and predictive mirror neurons for actions, sensations and emotions

Spike-timing-dependent plasticity is considered the neurophysiological basis of Hebbian learning and has been shown to be sensitive to both contingency and contiguity between pre- and postsynaptic activity. Here, we will examine how applying this Hebbian learning rule to a system of interconnected neurons in the presence of direct or indirect re-afference (e.g. seeing/hearing one's own actions) predicts the emergence of mirror neurons with predictive properties. In this framework, we analyse how mirror neurons become a dynamic system that performs active inferences about the actions of others and allows joint actions despite sensorimotor delays. We explore how this system performs a projection of the self onto others, with egocentric biases to contribute to mind-reading. Finally, we argue that Hebbian learning predicts mirror-like neurons for sensations and emotions and review evidence for the presence of such vicarious activations outside the motor system.

Model-observer similarity, error modeling and social learning in rhesus macaques

Monkeys readily learn to discriminate between rewarded and unrewarded items or actions by observing their conspecifics. However, they do not systematically learn from humans. Understanding what makes human-to-monkey transmission of knowledge work or fail could help identify mediators and moderators of social learning that operate regardless of language or culture, and transcend inter-species differences. Do monkeys fail to learn when human models show a behavior too dissimilar from the animals’ own, or when they show a faultless performance devoid of error? To address this question, six rhesus macaques trained to find which object within a pair concealed a food reward were successively tested with three models: a familiar conspecific, a ‘stimulus-enhancing’ human actively drawing the animal’s attention to one object of the pair without actually performing the task, and a ‘monkey-like’ human performing the task in the same way as the monkey model did. Reward was manipulated to ensure that all models showed equal proportions of errors and successes. The ‘monkey-like’ human model improved the animals’ subsequent object discrimination learning as much as a conspecific did, whereas the ‘stimulus-enhancing’ human model tended on the contrary to retard learning. Modeling errors rather than successes optimized learning from the monkey and ‘monkey-like’ models, while exacerbating the adverse effect of the ‘stimulus-enhancing’ model. These findings identify error modeling as a moderator of social learning in monkeys that amplifies the models’ influence, whether beneficial or detrimental. By contrast, model-observer similarity in behavior emerged as a mediator of social learning, that is, a prerequisite for a model to work in the first place. The latter finding suggests that, as preverbal infants, macaques need to perceive the model as ‘like-me’ and that, once this condition is fulfilled, any agent can become an effective model.