The role of the temporoparietal junction (TPJ) in action observation: Agent detection rather than visuospatial transformation

Awareness of embodiment enhances enjoyment and engages sensorimotor cortices

Whether in performing arts, sporting, or everyday contexts, when we watch others move, we tend to enjoy bodies moving in synchrony. Our enjoyment of body movements is further enhanced by our own prior experience with performing those movements, or our 'embodied experience'. The relationships between movement synchrony and enjoyment, as well as embodied experience and movement enjoyment, are well known. The interaction between enjoyment of movements, synchrony, and embodiment is less well understood, and may be central for developing new approaches for enriching social interaction. To examine the interplay between movement enjoyment, synchrony, and embodiment, we asked participants to copy another person's movements as accurately as possible, thereby gaining embodied experience of movement sequences. Participants then viewed other dyads performing the same or different sequences synchronously, and we assessed participants' recognition of having performed these sequences, as well as their enjoyment of each movement sequence. We used functional near-infrared spectroscopy to measure cortical activation over frontotemporal sensorimotor regions while participants performed and viewed movements. We found that enjoyment was greatest when participants had mirrored the sequence and recognised it, suggesting that awareness of embodiment may be central to enjoyment of synchronous movements. Exploratory analyses of relationships between cortical activation and enjoyment and recognition implicated the sensorimotor cortices, which subserve action observation and aesthetic processing. These findings hold implications for clinical research and therapies seeking to foster successful social interaction.

Dissociative Symptoms and Interoceptive Integration

Dissociative symptoms and disorders of dissociation are characterised by disturbances in the experience of the self and the surrounding world, manifesting as a breakdown in the normal integration of consciousness, memory, identity, emotion, and perception. This paper aims to provide insights into dissociative symptoms from the perspective of interoception, the sense of the body's internal physiological state, adopting a transdiagnostic framework.Dissociative symptoms are associated with a blunting of autonomic reactivity and a reduction in interoceptive precision. In addition to the central function of interoception in homeostasis, afferent visceral signals and their neural and mental representation have been shown to shape emotional feeling states, support memory encoding, and contribute to self-representation. Changes in interoceptive processing and disrupted integration of interoceptive signals into wider cognition may contribute to detachment from the body and the world, blunted emotional experience, and altered subjective recall, as experienced by individuals who suffer from dissociation.A better understanding of the role of altered interoceptive integration across the symptom areas of dissociation could thus provide insights into the neurophysiological mechanisms underlying dissociative disorders. As new therapeutic approaches targeting interoceptive processing emerge, recognising the significance of interoceptive mechanisms in dissociation holds potential implications for future treatment targets.

Beyond visual integration: sensitivity of the temporal-parietal junction for objects, places, and faces

One important role of the TPJ is the contribution to perception of the global gist in hierarchically organized stimuli where individual elements create a global visual percept. However, the link between clinical findings in simultanagnosia and neuroimaging in healthy subjects is missing for real-world global stimuli, like visual scenes. It is well-known that hierarchical, global stimuli activate TPJ regions and that simultanagnosia patients show deficits during the recognition of hierarchical stimuli and real-world visual scenes. However, the role of the TPJ in real-world scene processing is entirely unexplored. In the present study, we first localized TPJ regions significantly responding to the global gist of hierarchical stimuli and then investigated the responses to visual scenes, as well as single objects and faces as control stimuli. All three stimulus classes evoked significantly positive univariate responses in the previously localized TPJ regions. In a multivariate analysis, we were able to demonstrate that voxel patterns of the TPJ were classified significantly above chance level for all three stimulus classes. These results demonstrate a significant involvement of the TPJ in processing of complex visual stimuli that is not restricted to visual scenes and that the TPJ is sensitive to different classes of visual stimuli with a specific signature of neuronal activations.

Exploring the role of mutual prediction in inter-brain synchronization during competitive interactions: an fNIRS hyperscanning investigation

Mutual prediction is crucial for understanding the mediation of bodily actions in social interactions. Despite this importance, limited studies have investigated neurobehavioral patterns under the mutual prediction hypothesis in natural competitive scenarios. To address this gap, our study employed functional near-infrared spectroscopy hyperscanning to examine the dynamics of real-time rock-paper-scissors games using a computerized paradigm with 54 participants. Firstly, our results revealed activations in the right inferior frontal gyrus, bilateral dorsolateral prefrontal cortex, and bilateral frontopolar cortex, each displaying distinct temporal profiles indicative of diverse cognitive processes during the task. Subsequently, a task-related increase in inter-brain synchrony was explicitly identified in the right dorsolateral prefrontal cortex, which supported the mutual prediction hypothesis across the two brains. Moreover, our investigation uncovered a close association between the coherence value in the right dorsolateral prefrontal cortex and the dynamic predictive performances of dyads using inter-subject representational similarity analysis. Finally, heightened inter-brain synchrony values were observed in the right dorsolateral prefrontal cortex before a draw compared to a no-draw scenario in the second block, suggesting that cross-brain signal patterns could be reflected in behavioral responses during competition. In summary, these findings provided initial support for expanding the understanding of cognitive processes underpinning natural competitive engagements.

Functional role of the theory of mind network in integrating mentalistic prior information with action kinematics during action observation

Inferring intentions from verbal and nonverbal human behaviour is critical for everyday social life. Here, we combined Transcranial Magnetic Stimulation (TMS) with a behavioural priming paradigm to test whether key nodes of the Theory of Mind network (ToMn) contribute to understanding others' intentions by integrating prior knowledge about an agent with the observed action kinematics. We used a modified version of the Faked-Action Discrimination Task (FAD), a forced-choice paradigm in which participants watch videos of actors lifting a cube and judge whether the actors are trying to deceive them concerning the weight of the cube. Videos could be preceded or not by verbal description (prior) about the agent's truthful or deceitful intent. We applied single pulse TMS over three key nodes of the ToMn, namely dorsomedial prefrontal cortex (dmPFC), right posterior superior temporal sulcus (pSTS) and right temporo-parietal junction (rTPJ). Sham-TMS served as a control (baseline) condition. Following sham or rTPJ stimulation, we observed no consistent influence of priors on FAD performance. In contrast, following dmPFC stimulation, and to a lesser extent pSTS stimulation, truthful and deceitful actions were perceived as more deceptive only when the prior suggested a dishonest intention. These findings highlight a functional role of dmPFC and pSTS in coupling prior knowledge about deceptive intents with observed action kinematics in order to judge faked actions. Our study provides causal evidence that fronto-temporal nodes of the ToMn are functionally relevant to mental state inference during action observation.

Early and late neural correlates of mentalizing: ALE meta-analyses in adults, children and adolescents

The ability to understand mental states of others is referred to as mentalizing and enabled by our Theory of Mind. This social skill relies on brain regions comprising the mentalizing network as robustly observed in adults but also in a growing number of developmental studies. We summarized and compared neuroimaging evidence in children/adolescents and adults during mentalizing using coordinate-based activation likelihood estimation meta-analyses to inform about brain regions consistently or differentially engaged across age categories. Adults (N = 5286) recruited medial prefrontal and middle/inferior frontal cortices, precuneus, temporoparietal junction and middle temporal gyri during mentalizing, which were functionally connected to bilateral inferior/superior parietal lobule and thalamus/striatum. Conjunction and contrast analyses revealed that children and adolescents (N = 479) recruit similar but fewer regions within core mentalizing regions. Subgroup analyses revealed an early continuous engagement of middle medial prefrontal cortex, precuneus and right temporoparietal junction in younger children (8-11 years) and adolescents (12-18 years). Adolescents additionally recruited the left temporoparietal junction and middle/inferior temporal cortex. Overall, the observed engagement of the medial prefrontal cortex, precuneus and right temporoparietal junction during mentalizing across all ages reflects an early specialization of some key regions of the social brain.

Seeing What I Did (Not): Cerebral and Behavioral Effects of Agency and Perspective on Episodic Memory Re-activation

Intuitively, we assume that we remember episodes better when we actively participated in them and were not mere observers. Independently of this, we can recall episodes from either the first-person perspective (1pp) or the third-person perspective (3pp). In this functional magnetic resonance imaging (fMRI) study, we tested whether agency and perspective modulate neural activity during memory retrieval and subsequently enhance memory performance. Subjects encoded a set of different episodes by either imitating or only observing videos that showed short toy stories. A week later, we conducted fMRI and cued episodic retrieval by presenting the original videos, or slightly modified versions thereof, from 1pp or from 3pp. The hippocampal formation was sensitive to self-performed vs. only observed actions only when there was an episodic mismatch. In a post-fMRI memory test a history of self-performance did not improve behavioral memory performance. However, modified videos were often (falsely) accepted as showing truly experienced episodes when: (i) they were already presented in this modified version during fMRI or (ii) they were presented in their original form during fMRI but from 3pp. While the overall effect of modification was strong, the effects of perspective and agency were more subtle. Together, our findings demonstrate that self-performance and self-perspective modulate the strength of a memory trace in different ways. Even when memory performance remains the same for different agentive states, the brain is capable of detecting mismatching information. Re-experiencing the latter impairs memory performance as well as retrieving encoded episodes from 3pp.

Unimpaired social cognition in adult patients with ADHD: brain volumetric and behavioral results

The present study aimed to investigate whether adult patients with attention deficit hyperactivity disorder (ADHD) show deficits in social cognition and to identify the structural neural correlates of social cognitive skills in ADHD. Twenty-six adult patients with ADHD and 26 matched healthy control participants performed the Movie for the Assessment of Social Cognition and underwent a structural magnetic resonance imaging scan. We compared theory of mind (ToM) performance between ADHD patients and healthy controls. Using voxel-based morphometry, we further compared gray matter volumes in regions that are critical for social cognition between the two groups and examined whether ToM performance was correlated with brain morphometry measures. We did not observe any between-group differences in ToM abilities or regional gray matter volumes. Across both groups, performance on affective aspects of ToM correlated positively with gray matter volumes in the medial part of the superior frontal gyri, which is typically involved in social cognition. This study is the first to relate brain structure to social cognitive abilities in adult patients with ADHD. Although our sample was small and heterogeneous, with half of the patients showing mild-to-moderate psychiatric comorbidities, our results may encourage longitudinal studies that relate social cognitive development in childhood and adolescence to brain maturation of ADHD patients.

Seven computations of the social brain

The social environment presents the human brain with the most complex information processing demands. The computations that the brain must perform occur in parallel, combine social and nonsocial cues, produce verbal and nonverbal signals and involve multiple cognitive systems, including memory, attention, emotion and learning. This occurs dynamically and at timescales ranging from milliseconds to years. Here, we propose that during social interactions, seven core operations interact to underwrite coherent social functioning; these operations accumulate evidence efficiently-from multiple modalities-when inferring what to do next. We deconstruct the social brain and outline the key components entailed for successful human-social interaction. These include (i) social perception; (ii) social inferences, such as mentalizing; (iii) social learning; (iv) social signaling through verbal and nonverbal cues; (v) social drives (e.g. how to increase one's status); (vi) determining the social identity of agents, including oneself and (vii) minimizing uncertainty within the current social context by integrating sensory signals and inferences. We argue that while it is important to examine these distinct aspects of social inference, to understand the true nature of the human social brain, we must also explain how the brain integrates information from the social world.

The multidimensionality of abstract concepts: A systematic review

The neuroscientific study of conceptual representation has largely focused on categories of concrete entities (biological entities, tools…), while abstract knowledge has been less extensively investigated. The possible presence of a categorical organization of abstract knowledge is a debated issue. An embodied cognition framework predicts an organization of the abstract domain into different dimensions, grounded in the brain regions engaged by the corresponding experience. Here we review the types of experience that have been proposed to characterize different categories of abstract concepts, and the evidence supporting a corresponding organization derived from behavioural, neuroimaging (i.e., fMRI, MRI, PET, SPECT), EEG, and neurostimulation (i.e., TMS) studies in healthy and clinical populations. The available data provide substantial converging evidence in favour of the presence of distinct neural representations of social and emotional knowledge, mental states and magnitude concepts, engaging brain systems involved in the corresponding experiences. This evidence is supporting an extension of embodied models of semantic memory organization to several types of abstract knowledge.

Brain mechanisms of visuospatial perspective-taking in relation to object mental rotation and the theory of mind

Visuospatial perspective-taking (VPT) is a process of imagining what can be seen and how a scene looks from a location and orientation in space that differs from one's own. It comprises two levels that are underpinned by distinct neurocognitive processes. Level-2 VPT is often studied in relation to two other cognitive phenomena, object mental rotation (oMR) and theory of mind (ToM). With the aim to describe the broad picture of neurocognitive processes underlying level-2 VPT, here we give an overview of the recent behavioral and neuroscientific findings of level-2 VPT. We discuss its relation to level-1 VPT, which is also referred to as perspective-tracking, and the neighboring topics, oMR and ToM. Neuroscientific research shows that level-2 VPT is a diverse cognitive process, encompassing functionally distinct neural circuits. It shares brain substrates with oMR, especially those parietal brain areas that are specialized in spatial reasoning. However, compared to oMR, level-2 VPT involves additional activations in brain structures that are typically involved in ToM tasks and deal with self/other distinctions. In addition, level-2 VPT has been suggested to engage brain areas coding for internal representations of the body. Thus, the neurocognitive model underpinning level-2 VPT can be understood as a combination of visuospatial processing with social cognition and body schema representations.

Effects of pseudoexperience on the understanding of hemiplegic movements in physical therapists: An fMRI study

Physical therapists (PTs) are required to obtain an accurate understanding of the physical and mental states of their patients through observational assessment. To perform comprehensive observational assessments of patients' movements, PTs likely need to engage their own neural systems involved in action understanding and theory of mind, such as the action observation network (AON) and the right temporoparietal junction (rTPJ). Both systems are modulated by the observer's actual experience with the observed movements. Although, most PTs do not have physical experience with neurological disabilities, they routinely examine hemiplegic movements in stroke patients, and are thus considered to have acquired pseudoexperience with hemiplegia. We hypothesized that the PTs' pseudoexperience with hemiplegia would modulate the neural system associated with the understanding of others to elaborately comprehend the physical and mental states associated with hemiplegia. To investigate our hypothesis, we recruited 19 PTs and 19 naïve participants (NPs) to undergo functional MRI (fMRI) for cortical activity measurement while viewing videos of hemiplegic (HHM) and non-hemiplegic (non-HHM) hand movements. The participants subsequently viewed the same videos again outside the MRI scanner, and evaluated the observed hand movements via a questionnaire. Compared to the NPs, the PTs showed greater activation in the AON and rTPJ while observing HHMs. Psychophysiological interaction analyses revealed increased connectivity between the rTPJ and AON when the PTs viewed the HHMs. Behavioral analyses further indicated that the PTs more accurately assessed feeling states associated with HHMs than did NPs. These findings suggest that the PTs' pseudoexperience modulates the AON and rTPJ, enabling them to better understand hemiplegia-associated feeling states.

Meta-analysis of the moral brain: patterns of neural engagement assessed using multilevel kernel density analysis

The neuroimaging literature in moral cognition has rapidly developed in the last decade with more than 200 publications on the topic. Neuroimaging based models generally agree that limbic regions work with medial prefrontal and temporal regions during moral processing to integrate emotional, social, and cognitive elements into decision-making. However, no quantitative work has been done examining neural response across types of moral cognition tasks. This paper uses Multilevel Kernel Density Analysis (MKDA) to conduct neuroimaging meta-analyses of the moral cognitive literature. MKDA replicated previous findings of the neural correlates of moral cognition: the left amygdala, medial prefrontal cortex, bilateral temporoparietal junction, and posterior cingulate. Random forest algorithms classified neural features as belonging to simple/utilitarian moral dilemmas, explicit/implicit moral tasks, and word/picture moral stimuli tasks; in combination with univariate contrast analyses, these results indicated a distinct pattern of processing for each of the members of these paradigm pairs. Overall, the results emphasize that the task selected for use in a moral cognition neuroimaging study is vital for the elicitation and interpretation of results. It also replicates and re-establishes the neural basis for moral processing, especially important in light of implementation errors in previous meta-analysis.