Seeing your own or someone else's hand moving in accordance with your action: The neural interaction of agency and hand identity

Aberrant preparation of hand movement in schizophrenia spectrum disorder: an fMRI study

Schizophrenia spectrum disorder is linked to impaired self-other distinction and action feedback monitoring, largely stemming from sensory-motor predictive mechanisms. However, the neural correlates of these predictive processes during movement preparation are unknown. Here, we investigated whether patients with schizophrenia spectrum disorder exhibit aberrant sensory-motor predictive processes reflected in neural activation patterns prior to hand movement onset. Functional MRI data from patients with schizophrenia spectrum disorder (n = 20) and healthy controls (n = 20) were acquired during actively performed or passively induced hand movements. The task required participants to detect temporal delays between their movements and video feedback, which either displayed their own (self) or someone else's (other) hand moving in accordance with their own hand movements. Patients compared with healthy controls showed reduced preparatory blood-oxygen-level-dependent activation (active > passive) in clusters comprising the left putamen, left insula, left thalamus and lobule VIII of the right cerebellum. Reduced activation in the left insula and putamen was specific to own-hand feedback. Additionally, patients with schizophrenia spectrum disorder revealed reduced suppression (passive > active) in bilateral and medial parietal (including the right angular gyrus) and occipital areas, the right postcentral gyrus, cerebellum crus I, as well as the left medial superior frontal gyrus. Ego-disturbances were negatively correlated with left insula and putamen activation during active conditions and with right angular gyrus activation patterns during passive conditions when own-hand feedback was presented. These functional MRI findings suggest that group differences are primarily evident during preparatory processes. Our results show that this preparatory neural activation is further linked to symptom severity, supporting the idea that the preparation of upcoming events as internal predictive mechanisms may underlie severe symptoms in patients with schizophrenia spectrum disorder. These findings could improve our understanding of deficits in action planning, self-monitoring and motor dysfunction in various psychiatric, neurological and neurodegenerative disorders.

Predictive neural processing of self-generated hand and tool actions in patients with schizophrenia spectrum disorders and healthy individuals

Schizophrenia spectrum disorders (SSD) have been linked to dysfunctions in the predictive neural suppression of sensory input elicited by one's own actions. Such motor predictions become particularly challenging during tool use and when feedback from multiple sensory modalities is present. In this study, we investigated the neural correlates and potential dysfunctions of action feedback processing in SSD during tool use actions and bimodal sensory feedback presentation. Patients with SSD (NTotal = 42; schizophrenia NF20 = 34; schizoaffective disorder NF25 = 6; other N = 2) and healthy controls (HC, N = 27) performed active or passive hand movements with or without a tool and received unimodal (visual; a video of their hand movement) or bimodal (visual and auditory) feedback with various delays (0, 83, 167, 250, 333, 417 ms). Subjects reported whether they detected a delay. A subgroup (NSSD = 20; NHC = 20) participated in an identical fMRI experiment. Both groups reported fewer delays in active than passive conditions and exhibited neural suppression in all conditions in occipital and temporoparietal regions, cerebellum, and SMA. Group differences emerged in right cuneus, calcarine, and middle occipital gyrus, with reduced active-passive differences in patients during tool use actions and in bimodal trials during actions performed without a tool. These results demonstrate for the first time that, although patients and HC show similarities in neural suppression, higher-level visual processing areas fail to adequately distinguish between self- and externally generated sensory input in patients, particularly in complex action feedback scenarios involving bimodal action feedback and feedback elicited by tool use actions.

The neural network of sensory attenuation: A neuroimaging meta-analysis

Sensory attenuation refers to the reduction in sensory intensity resulting from self-initiated actions compared to stimuli initiated externally. A classic example is scratching oneself without feeling itchy. This phenomenon extends across various sensory modalities, including visual, auditory, somatosensory, and nociceptive stimuli. The internal forward model proposes that during voluntary actions, an efferent copy of the action command is sent out to predict sensory feedback. This predicted sensory feedback is then compared with the actual sensory feedback, leading to the suppression or reduction of sensory stimuli originating from self-initiated actions. To further elucidate the neural mechanisms underlying sensory attenuation effect, we conducted an extensive meta-analysis of functional magnetic resonance imaging (fMRI) and positron emission tomography (PET) studies. Utilizing activation likelihood estimation (ALE) analysis, our results revealed significant activations in a prominent cluster encompassing the right superior temporal gyrus (rSTG), right middle temporal gyrus (rMTG), and right insula when comparing external-generated with self-generated conditions. Additionally, significant activation was observed in the right anterior cerebellum when comparing self-generated to external-generated conditions. Further analysis using meta-analytic connectivity modeling (MACM) unveiled distinct brain networks co-activated with the rMTG and right cerebellum, respectively. Based on these findings, we propose that sensory attenuation arises from the suppression of reflexive inputs elicited by self-initiated actions through the internal forward modeling of a cerebellum-centered action prediction network, enabling the "sensory conflict detection" regions to effectively discriminate between inputs resulting from self-induced actions and those originating externally.

The visuomotor synchronization immersive virtual reality of a depression avatar in a stigma context experience mobilizes the fronto-parietal cortex and anterior insula

Introduction

The gradual synchronization of the movement of one's real hand with a virtual one can effectively induce a sense of embodiment (SoE) with an avatar with depression. Although neuroimaging studies have explored the neural correlates of some SoE subcomponents of visuomotor synchronization, the neural correlates of individual differences in SoE and how humans acquire virtual body representations through SoE subcomponents remain to be investigated.

Methods

Here, we used the right hand of a virtual patient with depression in immersive virtual reality (IVR) to induce SoE in participants and measured whole brain activity using functional magnetic resonance imaging (fMRI). Participants were instructed to listen to the audio recording of the IVR experience and visualize movements during the fMRI scan. fMRI data were acquired before and immediately after the visuomotor synchronization IVR experience (target condition) or an asynchronized video experience (control condition), followed by embodiment measures related to the two types of experiences.

Results

All five subcomponents of SoE (sense of ownership, sense of agency, sense of localization, appearance, and response to stimuli) were significantly increased during the visuomotor synchronization IVR experience compared with the asynchronized video experience. A significant negative effect of the SoE score was identified in the frontoparietal and anterior insula only for the visuomotor synchronization IVR experience of guiding the virtual right hand of the avatar with depression, implicating interoceptive and multisensory integration.

Discussion

We demonstrated that all five subcomponents of the SoE were present, and that decreased activity in the frontoparietal and anterior insula were crucial brain regions for the virtual human body to be perceived as one's own body and promote conscious feelings of embodiment.

Modelling sensory attenuation as Bayesian causal inference across two datasets

INTRODUCTION

To interact with the environment, it is crucial to distinguish between sensory information that is externally generated and inputs that are self-generated. The sensory consequences of one's own movements tend to induce attenuated behavioral- and neural responses compared to externally generated inputs. We propose a computational model of sensory attenuation (SA) based on Bayesian Causal Inference, where SA occurs when an internal cause for sensory information is inferred.

METHODS

Experiment 1investigates sensory attenuation during a stroking movement. Tactile stimuli on the stroking finger were suppressed, especially when they were predictable. Experiment 2 showed impaired delay detection between an arm movement and a video of the movement when participants were moving vs. when their arm was moved passively. We reconsider these results from the perspective of Bayesian Causal Inference (BCI). Using a hierarchical Markov Model (HMM) and variational message passing, we first qualitatively capture patterns of task behavior and sensory attenuation in simulations. Next, we identify participant-specific model parameters for both experiments using optimization.

RESULTS

A sequential BCI model is well equipped to capture empirical patterns of SA across both datasets. Using participant-specific optimized model parameters, we find a good agreement between data and model predictions, with the model capturing both tactile detections in Experiment 1 and delay detections in Experiment 2.

DISCUSSION

BCI is an appropriate framework to model sensory attenuation in humans. Computational models of sensory attenuation may help to bridge the gap across different sensory modalities and experimental paradigms and may contribute towards an improved description and understanding of deficits in specific patient groups (e.g. schizophrenia).

Corticostriatal activity related to performance during continuous de novo motor learning

Corticostriatal regions play a pivotal role in visuomotor learning. However, less research has been done on how fMRI activity in their subregions is related to task performance, which is provided as visual feedback during motor learning. To address this, we conducted an fMRI experiment in which participants acquired a complex de novo motor skill using continuous or binary visual feedback related to performance. We found a highly selective response related to performance in the entire striatum in both conditions and a relatively higher response in the caudate nucleus for the binary feedback condition. However, the ventromedial prefrontal cortex (vmPFC) response was significant only for the continuous feedback condition. Furthermore, we also found functional distinction of the striatal subregions in random versus goal-directed motor control. These findings underscore the substantial effects of the visual feedback indicating performance on distinct corticostriatal responses, thereby elucidating its significance in reinforcement-based motor learning.

Neural correlates of an illusionary sense of agency caused by virtual reality

Sense of agency (SoA) is the sensation that self-actions lead to ensuing perceptual consequences. The prospective mechanism emphasizes that SoA arises from motor prediction and its comparison with actual action outcomes, while the reconstructive mechanism stresses that SoA emerges from retrospective causal processing about the action outcomes. Consistent with the prospective mechanism, motor planning regions were identified by neuroimaging studies using the temporal binding (TB) effect, a behavioral measure often linked to implicit SoA. Yet, TB also occurs during passive observation of another's action, lending support to the reconstructive mechanism, but its neural correlates remain unexplored. Here, we employed virtual reality (VR) to modulate such observation-based SoA and examined it with functional magnetic resonance imaging (fMRI). After manipulating an avatar hand in VR, participants passively observed an avatar's "action" and showed a significant increase in TB. The binding effect was associated with the right angular gyrus and inferior parietal lobule, which are critical nodes for inferential and agency processing. These results suggest that the experience of controlling an avatar may potentiate inferential processing within the right inferior parietal cortex and give rise to the illusionary SoA without voluntary action.

Pre-movement event-related potentials and multivariate pattern of EEG encode action outcome prediction

Self-initiated movements are accompanied by an efference copy, a motor command sent from motor regions to the sensory cortices, containing a prediction of the movement's sensory outcome. Previous studies have proposed pre-motor event-related potentials (ERPs), including the readiness potential (RP) and its lateralized sub-component (LRP), as potential neural markers of action feedback prediction. However, it is not known how specific these neural markers are for voluntary (active) movements as compared to involuntary (passive) movements, which produce much of the same sensory feedback (tactile, proprioceptive) but are not accompanied by an efference copy. The goal of the current study was to investigate how active and passive movements are distinguishable from premotor electroencephalography (EEG), and to examine if this change of neural activity differs when participants engage in tasks that differ in their expectation of sensory outcomes. Participants made active (self-initiated) or passive (finger moved by device) finger movements that led to either visual or auditory stimuli (100 ms delay), or to no immediate contingency effects (control). We investigated the time window before the movement onset by measuring pre-movement ERPs time-locked to the button press. For RP, we observed an interaction between task and movement. This was driven by movement differences in the visual and auditory but not the control conditions. LRP conversely only showed a main effect of movement. We then used multivariate pattern analysis to decode movements (active vs. passive). The results revealed ramping decoding for all tasks from around -800 ms onwards up to an accuracy of approximately 85% at the movement. Importantly, similar to RP, we observed lower decoding accuracies for the control condition than the visual and auditory conditions, but only shortly (from -200 ms) before the button press. We also decoded visual vs. auditory conditions. Here, task is decodable for both active and passive conditions, but the active condition showed increased decoding shortly before the button press. Taken together, our results provide robust evidence that pre-movement EEG activity may represent action-feedback prediction in which information about the subsequent sensory outcome is encoded.

Effect of left temporoparietal transcranial direct current stimulation on self-bias effect and retrospective intentional binding paradigm: A randomised, double-blind, controlled study

BACKGROUND

Self-bias effect is expressed as a preferential selection and accelerated perception of self-related sensory information. Intentional binding (IB) is a related phenomenon where the sensory outcome from a voluntary action and the voluntary action itself are perceived to be closer to each other in time in both predictive (voluntary action predicting sensory consequence) and retrospective (sensory consequence features triggering self-related inference) contexts. Recent evidence indicates that self-related visual stimuli can affect retrospective intentional binding (rIB). We aimed to 1) replicate rIB in the auditory context, and 2) investigate the potential role of left temporoparietal junction (l-TPJ), a crucial node for the self-monitoring process, in self-bias effect and intentional binding effect by manipulating l-TPJ activity with neuromodulation [using High-Definition Transcranial Direct Current Stimulation (HD-tDCS)]. We anticipated self-bias and rIB effects to increase with anodal stimulation of l-TPJ in comparison to cathodal-stimulation of l-TPJ.

METHODS

Fourteen, right-handed, healthy participants performed sound-label matching (matching tones to self-and-other labels) and rIB (estimating time interval between a button press and a self/other labelled tone) tasks. Each participant underwent both anodal and cathodal stimulation of l-TPJ in separate sessions (at least 72 h apart). Assignment of HD-tDCS type was random and counter-balanced across participants. Behavioural data was collected at three time points: once at baseline (no-stimulation), and twice after stimulation with HD-tDCS.

RESULTS

Strong self-bias effect was observed across all experimental conditions. Neuromodulation of l-TPJ affected processing of other-labelled tone in the sound-label matching task. rIB was noted in baseline and anodal-HD-tDCS conditions where participants exhibited stronger binding for self-associated stimuli compared to other-associated stimuli.

CONCLUSION

l-TPJ may potentially play a critical role in self-other distinction. This may have possible implications for disorders of self-disturbances like psychosis.

The neural signature of reality-monitoring: A meta-analysis of functional neuroimaging studies

Distinguishing imagination and thoughts from information we perceived from the environment, a process called reality-monitoring, is important in everyday situations. Although reality monitoring seems to overlap with the concept of self-monitoring, which allows one to distinguish self-generated actions or thoughts from those generated by others, the two concepts remain largely separate cognitive domains and their common brain substrates have received little attention. We investigated the brain regions involved in these two cognitive processes and explored the common brain regions they share. To do this, we conducted two separate coordinate-based meta-analyses of functional magnetic resonance imaging studies assessing the brain regions involved in reality- and self-monitoring. Few brain regions survived threshold-free cluster enhancement family-wise multiple comparison correction (p < .05), likely owing to the small number of studies identified. Using uncorrected statistical thresholds recommended by Signed Differential Mapping with Permutation of Subject Images, the meta-analysis of reality-monitoring studies (k = 9 studies including 172 healthy subjects) revealed clusters in the lobule VI of the cerebellum, the right anterior medial prefrontal cortex and anterior thalamic projections. The meta-analysis of self-monitoring studies (k = 12 studies including 192 healthy subjects) highlighted the involvement of a set of brain regions including the lobule VI of the left cerebellum and fronto-temporo-parietal regions. We showed with a conjunction analysis that the lobule VI of the cerebellum was consistently engaged in both reality- and self-monitoring. The current findings offer new insights into the common brain regions underlying reality-monitoring and self-monitoring, and suggest that the neural signature of the self that may occur during self-production should persist in memories.

Neural correlates of visual and tactile path integration and their task related modulation

Self-motion induces sensory signals that allow to determine travel distance (path integration). For veridical path integration, one must distinguish self-generated from externally induced sensory signals. Predictive coding has been suggested to attenuate self-induced sensory responses, while task relevance can reverse the attenuating effect of prediction. But how is self-motion processing affected by prediction and task demands, and do effects generalize across senses? In this fMRI study, we investigated visual and tactile self-motion processing and its modulation by task demands. Visual stimuli simulated forward self-motion across a ground plane. Tactile self-motion stimuli were delivered by airflow across the subjects' forehead. In one task, subjects replicated a previously observed distance (Reproduction/Active; high behavioral demand) of passive self-displacement (Reproduction/Passive). In a second task, subjects travelled a self-chosen distance (Self/Active; low behavioral demand) which was recorded and played back to them (Self/Passive). For both tasks and sensory modalities, Active as compared to Passive trials showed enhancement in early visual areas and suppression in higher order areas of the inferior parietal lobule (IPL). Contrasting high and low demanding active trials yielded supramodal enhancement in the anterior insula. Suppression in the IPL suggests this area to be a comparator of sensory self-motion signals and predictions thereof.

Neural Substrates of Body Ownership and Agency during Voluntary Movement

Body ownership and the sense of agency are two central aspects of bodily self-consciousness. While multiple neuroimaging studies have investigated the neural correlates of body ownership and agency separately, few studies have investigated the relationship between these two aspects during voluntary movement when such experiences naturally combine. By eliciting the moving rubber hand illusion with active or passive finger movements during functional magnetic resonance imaging, we isolated activations reflecting the sense of body ownership and agency, respectively, as well as their interaction, and assessed their overlap and anatomic segregation. We found that perceived hand ownership was associated with activity in premotor, posterior parietal, and cerebellar regions, whereas the sense of agency over the movements of the hand was related to activity in the dorsal premotor cortex and superior temporal cortex. Moreover, one section of the dorsal premotor cortex showed overlapping activity for ownership and agency, and somatosensory cortical activity reflected the interaction of ownership and agency with higher activity when both agency and ownership were experienced. We further found that activations previously attributed to agency in the left insular cortex and right temporoparietal junction reflected the synchrony or asynchrony of visuoproprioceptive stimuli rather than agency. Collectively, these results reveal the neural bases of agency and ownership during voluntary movement. Although the neural representations of these two experiences are largely distinct, there are interactions and functional neuroanatomical overlap during their combination, which has bearing on theories on bodily self-consciousness.SIGNIFICANCE STATEMENT How does the brain generate the sense of being in control of bodily movement (agency) and the sense that body parts belong to one's body (body ownership)? Using fMRI and a bodily illusion triggered by movement, we found that agency is associated with activity in premotor cortex and temporal cortex, and body ownership with activity in premotor, posterior parietal, and cerebellar regions. The activations reflecting the two sensations were largely distinct, but there was overlap in premotor cortex and an interaction in somatosensory cortex. These findings advance our understanding of the neural bases of and interplay between agency and body ownership during voluntary movement, which has implications for the development of advanced controllable prosthetic limbs that feel like real limbs.

Perception of self-generated and externally-generated visual stimuli: Evidence from EEG and behavior

Efference copy-based forward model mechanisms may help us to distinguish between self-generated and externally-generated sensory consequences. Previous studies have shown that self-initiation modulates neural and perceptual responses to identical stimulation. For example, event-related potentials (ERPs) elicited by tones that follow a button press are reduced in amplitude relative to ERPs elicited by passively attended tones. However, previous EEG studies investigating visual stimuli in this context are rare, provide inconclusive results, and lack adequate control conditions with passive movements. Furthermore, although self-initiation is known to modulate behavioral responses, it is not known whether differences in the amplitude of ERPs also reflect differences in perception of sensory outcomes. In this study, we presented to participants visual stimuli consisting of gray discs following either active button presses, or passive button presses, in which an electromagnet moved the participant's finger. Two discs presented visually 500-1250 ms apart followed each button press, and participants judged which of the two was more intense. Early components of the primary visual response (N1 and P2) over the occipital electrodes were suppressed in the active condition. Interestingly, suppression in the intensity judgment task was only correlated with suppression of the visual P2 component. These data support the notion of efference copy-based forward model predictions in the visual sensory modality, but especially later processes (P2) seem to be perceptually relevant. Taken together, the results challenge the assumption that N1 differences reflect perceptual suppression and emphasize the relevance of the P2 ERP component.

Task-based functional connectivity identifies two segregated networks underlying intentional action

While much of motor behavior is automatic, intentional action is necessary for the selection and initiation of controlled motor acts and is thus an essential part of goal-directed behavior. Neuroimaging studies have shown that self-generated action implicates several dorsal and ventral frontoparietal areas. However, knowledge of the functional coupling between these brain regions during intentional action remains limited. We here studied brain activations and functional connectivity (FC) of thirty right-handed healthy participants performing a finger pressing task instructed to use a specific finger (externally-triggered action) or to select one of four fingers randomly (internally-generated action). Participants performed the task in alternating order either with their dominant right hand or the left hand. Consistent with previous studies, we observed stronger involvement of posterior parietal cortex and premotor regions when contrasting internally-generated with externally-triggered action. Interestingly, this contrast also revealed significant engagement of medial occipitotemporal regions including the left lingual and right fusiform gyrus. Task-based FC analysis identified increased functional coupling among frontoparietal regions as well as increased and decreased coupling between occipitotemporal regions, thus differentiating between two segregated networks. When comparing results of the dominant and nondominant hand we found less activation, but stronger connectivity for the former, suggesting increased neural efficiency when participants use their dominant hand. Taken together, our results reveal that two segregated networks that encompass the frontoparietal and occipitotemporal cortex contribute independently to intentional action.

Virtual occlusion effects on the perception of self-initiated visual stimuli

Virtual reality (VR) has established itself as a useful tool in the study of human perception in the laboratory. A recent study introduced a new approach to examine visual sensory attenuation (SA) effects in VR. Hand movements triggered the appearance of Gabor stimuli, which were either presented behind the participant's hand - not rendered in VR ("virtual occlusion") - or elsewhere on the display. Virtual occlusion led to a rightward shift of the psychometric curve, suggesting that self-generated hand movements reduced the perceived contrast of the stimulus. Since such attenuation effects might provide a window into the predictive processing of the sensory and cognitive apparatus, we sought to better understand the nature of the virtual occlusion effects. In our study, the presentation of test stimuli was either self-initiated, self-initiated with a variable delay, or triggered externally; the test stimuli were occluded or not. In conflict with our hypothesis, we found moderate to strong evidence for an absence of any horizontal shifts between the psychometric curves. However, virtual occlusion was associated with a decrease in the slope of the psychometric function. Our results suggest that virtual occlusion attenuated the relative perceptual sensitivity, so that participants had more difficulty discriminating contrast differences when the test stimulus was presented behind the hand. We tentatively conclude that, in the visual domain, the discriminability of stimulus intensity is modified by internal predictive cues (i.e., proprioception), possibly linked to shifts in covert spatial attention.

Action-based predictions affect visual perception, neural processing, and pupil size, regardless of temporal predictability

Sensory consequences of one's own action are often perceived as less intense, and lead to reduced neural responses, compared to externally generated stimuli. Presumably, such sensory attenuation is due to predictive mechanisms based on the motor command (efference copy). However, sensory attenuation has also been observed outside the context of voluntary action, namely when stimuli are temporally predictable. Here, we aimed at disentangling the effects of motor and temporal predictability-based mechanisms on the attenuation of sensory action consequences. During fMRI data acquisition, participants (N = 25) judged which of two visual stimuli was brighter. In predictable blocks, the stimuli appeared temporally aligned with their button press (active) or aligned with an automatically generated cue (passive). In unpredictable blocks, stimuli were presented with a variable delay after button press/cue, respectively. Eye tracking was performed to investigate pupil-size changes and to ensure proper fixation. Self-generated stimuli were perceived as darker and led to less neural activation in visual areas than their passive counterparts, indicating sensory attenuation for self-generated stimuli independent of temporal predictability. Pupil size was larger during self-generated stimuli, which correlated negatively with the blood oxygenation level dependent (BOLD) response: the larger the pupil, the smaller the BOLD amplitude in visual areas. Our results suggest that sensory attenuation in visual cortex is driven by action-based predictive mechanisms rather than by temporal predictability. This effect may be related to changes in pupil diameter. Altogether, these results emphasize the role of the efference copy in the processing of sensory action consequences.

Sense of agency as synecdoche: Multiple neurobiological mechanisms may underlie the phenomenon summarized as sense of agency

Functional magnetic resonance imaging (fMRI) studies on the sense of agency (SoA) have yielded heterogeneous findings identifying regional brain activity during tasks that probed SoA. In this review, we argue that the reason behind this between-study heterogeneity is a "synecdochic" way the field conceptualizes and studies SoA. Typically, a single feature is experimentally manipulated and then this is interpreted as covering all aspects of SoA. The purpose of this paper is to give an overview of the fMRI studies of SoA and attempt to provide meaningful categories whereby the heterogeneous findings may be classified. This classification is based on a separation of the experimental paradigms (Feedback Manipulations of ongoing movements, Action-Effect, and Sensory Attenuation) and type of report employed (implicit, explicit reports of graded or dichotic nature, and whether these concern self-other distinctions or sense of control). We only find that Feedback Manipulation and Action-Effect share common activation in supplementary motor area, insula and cerebellum in positive SoA and inferior frontal gyrus in the negative SoA, but observe large networks related to SoA only in Feedback Manipulation studies. To illustrate the advantages of this approach, we discuss the findings from an fMRI study which we conducted, within this framework.

Investigation of motor self-monitoring deficits in schizophrenia with passivity experiences using a novel modified joint position matching paradigm

Numerous studies have identified deficits in the self-monitoring system that are associated with schizophrenia. However, the tasks used in the few previous studies generally involved complex cognitive processes and rarely compared between patients with and without passivity experiences (PE). Here, we examined the deficits in internal motor predictive representation in patients with and without PE, and in healthy controls using a novel paradigm which involved minimal cognitive processes. All participants completed a modified joint position matching (mJPM) task, in which they were required to replicate a voluntary, a passive verbally-cued, and a passive tactile-cued movement under blinded conditions. The absolute difference between the target spot and replicated spot was measured and compared. We hypothesised that if there was a failure in the internal motor predictive representation, patients with PEs would replicate less accurately in the voluntary condition, relative to passive conditions while the healthy controls would be more accurate, and, therefore, significant interactions between groups and conditions would be revealed. Both healthy controls and patients without PEs replicated more accurately in the voluntary condition compared with the passive conditions. The patients with PEs were less accurate in the voluntary condition compared with the passive tactile condition. A significant interaction was observed between patients with vs. without PEs × voluntary vs. passive tactile conditions. The findings suggested the relationship between deficits in motor self-monitoring in the prediction process and PEs, thus showing the need to highlight the link between motor performance and PEs.

The Transdiagnostic Relevance of Self-Other Distinction to Psychiatry Spans Emotional, Cognitive and Motor Domains

Self-other distinction refers to the ability to distinguish between our own and other people's physical and mental states (actions, perceptions, emotions etc.). Both the right temporo-parietal junction and brain areas associated with the human mirror neuron system are likely to critically influence self-other distinction, given their respective contributions to theory of mind and embodied empathy. The degree of appropriate self-other distinction will vary according to the exact social situation, and how helpful it is to feel into, or remain detached from, another person's mental state. Indeed, the emotional resonance that we can share with others affords the gift of empathy, but over-sharing may pose a downside, leading to a range of difficulties from personal distress to paranoia, and perhaps even motor tics and compulsions. The aim of this perspective paper is to consider how evidence from behavioral and neurophysiological studies supports a role for problems with self-other distinction in a range of psychiatric symptoms spanning the emotional, cognitive and motor domains. The various signs and symptoms associated with problematic self-other distinction comprise both maladaptive and adaptive (compensatory) responses to dysfunction within a common underlying neuropsychological mechanism, compelling the adoption of more holistic transdiagnostic therapeutic approaches within Psychiatry.

The role of motor memory dynamics in structuring bodily self-consciousness

Bodily self-consciousness has been considered a sensorimotor root of self-consciousness. If this is the case, how does sensorimotor memory, which is important for the prediction of sensory consequences of volitional actions, influence awareness of bodily self-consciousness? This question is essential for understanding the effective acquisition and recovery of self-consciousness following its impairment, but it has remained unexamined. Here, we investigated how body ownership and agency recovered following body schema distortion in a virtual reality environment along with two kinds of motor memories: memories that were rapidly updated and memories that were gradually updated. We found that, although agency and body ownership recovered in parallel, the recovery of body ownership was predicted by fast memories and that of agency was predicted by slow memories. Thus, the bodily self was represented in multiple motor memories with different dynamics. This finding demystifies the controversy about the causal relationship between body ownership and agency.

Spontaneous perception: a framework for task-free, self-paced perception

Flipping through social media feeds, viewing exhibitions in a museum, or walking through the botanical gardens, people consistently choose to engage with and disengage from visual content. Yet, in most laboratory settings, the visual stimuli, their presentation duration, and the task at hand are all controlled by the researcher. Such settings largely overlook the spontaneous nature of human visual experience, in which perception takes place independently from specific task constraints and its time course is determined by the observer as a self-governing agent. Currently, much remains unknown about how spontaneous perceptual experiences unfold in the brain. Are all perceptual categories extracted during spontaneous perception? Does spontaneous perception inherently involve volition? Is spontaneous perception segmented into discrete episodes? How do different neural networks interact over time during spontaneous perception? These questions are imperative to understand our conscious visual experience in daily life. In this article we propose a framework for spontaneous perception. We first define spontaneous perception as a task-free and self-paced experience. We propose that spontaneous perception is guided by four organizing principles that grant it temporal and spatial structures. These principles include coarse-to-fine processing, continuity and segmentation, agency and volition, and associative processing. We provide key suggestions illustrating how these principles may interact with one another in guiding the multifaceted experience of spontaneous perception. We point to testable predictions derived from this framework, including (but not limited to) the roles of the default-mode network and slow cortical potentials in underlying spontaneous perception. We conclude by suggesting several outstanding questions for future research, extending the relevance of this framework to consciousness and spontaneous brain activity. In conclusion, the spontaneous perception framework proposed herein integrates components in human perception and cognition, which have been traditionally studied in isolation, and opens the door to understand how visual perception unfolds in its most natural context.

Action-locked Neural Responses in Auditory Cortex to Self-generated Sounds

Sensory perception is a product of interactions between the internal state of an organism and the physical attributes of a stimulus. It has been shown across the animal kingdom that perception and sensory-evoked physiological responses are modulated depending on whether or not the stimulus is the consequence of voluntary actions. These phenomena are often attributed to motor signals sent to relevant sensory regions that convey information about upcoming sensory consequences. However, the neurophysiological signature of action-locked modulations in sensory cortex, and their relationship with perception, is still unclear. In the current study, we recorded neurophysiological (using Magnetoencephalography) and behavioral responses from 16 healthy subjects performing an auditory detection task of faint tones. Tones were either generated by subjects' voluntary button presses or occurred predictably following a visual cue. By introducing a constant temporal delay between button press/cue and tone delivery, and applying source-level analysis, we decoupled action-locked and auditory-locked activity in auditory cortex. We show action-locked evoked-responses in auditory cortex following sound-triggering actions and preceding sound onset. Such evoked-responses were not found for button-presses that were not coupled with sounds, or sounds delivered following a predictive visual cue. Our results provide evidence for efferent signals in human auditory cortex that are locked to voluntary actions coupled with future auditory consequences.

Explicit and implicit measures of body ownership and agency: affected by the same manipulations and yet independent

People are assumed to represent themselves in terms of body ownership and agency. Studies using the rubber- or virtual-hand illusion have assessed ownership and agency by means of explicit ownership and agency ratings and implicit measures, like proprioceptive drift in the case of ownership. These measures often show similar effects but also some discrepancies, suggesting that they rely on data sources that overlap, but not completely. To systematically assess commonalities and discrepancies, we adopted an immersed virtual hand illusion (VHI) design, in which three independent factors were manipulated: the synchrony between the movement of real and virtual effector, the type of effector, which was a virtual hand or triangle, and the spatial congruency between the real and virtual effector. Commonalities and discrepancies in the effects of these factors were assessed by crossing explicit and implicit measures for ownership and agency. While standard ratings were used as explicit measures, implicit ownership was assessed by means of proprioceptive drift and implicit agency by means of intentional binding. Results showed similar effect patterns for the two agency measures, which, however, were not correlated, different effect patterns for the two ownership measures, and a strong correlation between the two explicit measures. Taken altogether, our findings suggest that explicit and implicit measures of ownership and agency partly rely on shared informational sources, but seem to differ with respect to other sources that are integrated or with respect to the processed dimension (shape vs. time). The findings also suggest that some findings obtained with RHI designs might reflect more the unnatural situation that that design puts individuals into rather than generalizable mechanisms of computing perceived ownership and agency.

Commonalities and differences in predictive neural processing of discrete vs continuous action feedback

Sensory action consequences are highly predictable and thus engage less neural resources compared to externally generated sensory events. While this has frequently been observed to lead to attenuated perceptual sensitivity and suppression of activity in sensory cortices, some studies conversely reported enhanced perceptual sensitivity for action consequences. These divergent findings might be explained by the type of action feedback, i.e., discrete outcomes vs. continuous feedback. Therefore, in the present study we investigated the impact of discrete and continuous action feedback on perceptual and neural processing during action feedback monitoring. During fMRI data acquisition, participants detected temporal delays (0-417 ms) between actively or passively generated wrist movements and visual feedback that was either continuously provided during the movement or that appeared as a discrete outcome. Both feedback types resulted in (1) a neural suppression effect (active<passive) in a largely shared network including bilateral visual and somatosensory cortices, cerebellum and temporoparietal areas. Yet, compared to discrete outcomes, (2) processing continuous feedback led to stronger suppression in right superior temporal gyrus (STG), Heschl´s gyrus, and insula suggesting specific suppression of features linked to continuous feedback. Furthermore, (3) BOLD suppression in visual cortex for discrete outcomes was specifically related to perceptual enhancement. Together, these findings indicate that neural representations of discrete and continuous action feedback are similarly suppressed but might depend on different predictive mechanisms, where reduced activation in visual cortex reflects facilitation specifically for discrete outcomes, and predictive processing in STG, Heschl´s gyrus, and insula is particularly relevant for continuous feedback.

Neural Correlates of Self-other Distinction in Patients with Schizophrenia Spectrum Disorders: The Roles of Agency and Hand Identity

Schizophrenia spectrum disorders (SSD) are characterized by disturbed self-other distinction. While previous studies associate abnormalities in the sense of agency (ie, the feeling that an action and the resulting sensory consequences are produced by oneself) with disturbed processing in the angular gyrus, passive movement conditions to isolate contributions of motor predictions are lacking. Furthermore, the role of body identity (ie, visual features determining whether a seen body part belongs to oneself) in self-other distinction is unclear. In the current study, fMRI was used to assess the roles of agency and hand identity in self-other distinction. Patients with SSD and healthy controls (HC) performed active and passive hand movements (agency manipulation) while seeing their own or someone else's hand moving in accordance with their action (hand identity manipulation). Variable delays (0-417 ms) between movement and feedback had to be detected. Our results showed overall lower delay detection performances during active than passive conditions; however, these differences were reduced in patients when the own hand was displayed. On a neural level, we found that in HC, activation in the right angular gyrus was modulated by agency and hand identity. In contrast, agency and hand identity revealed no overlapping activation in patients, due to reduced effects of agency. Importantly, HC and SSD patients shared similar effects of hand identity in the angular gyrus. Our results suggest that disturbances of self-other distinction in SSD are particularly driven by agency, while self-other distinction based on hand identity might be spared.

Transcranial direct current stimulation improves action-outcome monitoring in schizophrenia spectrum disorder

Patients with schizophrenia spectrum disorder often demonstrate impairments in action-outcome monitoring. Passivity phenomena and hallucinations, in particular, have been related to impairments of efference copy-based predictions which are relevant for the monitoring of outcomes produced by voluntary action. Frontal transcranial direct current stimulation has been shown to improve action-outcome monitoring in healthy subjects. However, whether transcranial direct current stimulation can improve action monitoring in patients with schizophrenia spectrum disorder remains unknown. We investigated whether transcranial direct current stimulation can improve the detection of temporal action-outcome discrepancies in patients with schizophrenia spectrum disorder. On 4 separate days, we applied sham or left cathodal/right anodal transcranial direct current stimulation in a randomized order to frontal (F3/F4), parietal (CP3/CP4) and frontoparietal (F3/CP4) areas of 19 patients with schizophrenia spectrum disorder and 26 healthy control subjects. Action-outcome monitoring was assessed subsequent to 10 min of sham/transcranial direct current stimulation (1.5 mA). After a self-generated (active) or externally generated (passive) key press, subjects were presented with a visual outcome (a dot on the screen), which was presented after various delays (0-417 ms). Participants had to detect delays between the key press and the visual consequence. Symptom subgroups were explored based on the presence or absence of symptoms related to a paranoid-hallucinatory syndrome. In general, delay-detection performance was impaired in the schizophrenia spectrum disorder compared to the healthy control group. Interaction analyses showed group-specific (schizophrenia spectrum disorder versus healthy control group) and symptom-specific (with/without relevant paranoid-hallucinatory symptoms) transcranial direct current stimulation effects. Post hoc tests revealed that frontal transcranial direct current stimulation improved the detection of long delays in active conditions and reduced the proportion of false alarms in undelayed trials of the passive condition in patients. The patients with no or few paranoid-hallucinatory symptoms benefited especially from frontal transcranial direct current stimulation in active conditions, while improvement in the patients with paranoid-hallucinatory symptoms was predominantly reflected in reduced false alarm rates in passive conditions. These data provide some first evidence for the potential utility of transcranial direct current stimulation in improving efference copy mechanisms and action-outcome monitoring in schizophrenia spectrum disorder. Current data indicate that improving efference copy-related processes can be especially effective in patients with no or few positive symptoms, while intersensory matching (i.e. task-relevant in passive conditions) could be more susceptible to improvement in patients with paranoid-hallucinatory symptoms.

Measures of agency

The sense of agency is typically defined as the experience of controlling one’s own actions, and through them, changes in the external environment. It is often assumed that this experience is a single, unified construct that can be experimentally manipulated and measured in a variety of ways. In this article, we challenge this assumption. We argue that we should acknowledge four possible agency-related psychological constructs. Having a clear grasp of the possible constructs is important since experimental procedures are only able to target some but not all the possible constructs. The unacknowledged misalignment of the possible constructs of a sense of agency and the experimental procedures is a major theoretical and methodological obstacle to studying the sense of agency. Only if we recognize the nature of this obstacle will we be able to design the experimental paradigms that would enable us to study the responsible computational mechanisms.

Seeing your own or someone else's hand moving in accordance with your action: The neural interaction of agency and hand identity

Forward models can predict sensory consequences of self-action, which is reflected by less neural processing for actively than passively generated sensory inputs (BOLD suppression effect). However, it remains open whether forward models take the identity of a moving body part into account when predicting the sensory consequences of an action. In the current study, fMRI was used to investigate the neural correlates of active and passive hand movements during which participants saw either an on-line display of their own hand or someone else's hand moving in accordance with their movement. Participants had to detect delays (0-417 ms) between their movement and the displays. Analyses revealed reduced activation in sensory areas and higher delay detection thresholds for active versus passive movements. Furthermore, there was increased activation in the hippocampus, the amygdala, and the middle temporal gyrus when someone else's hand was seen. Most importantly, in posterior parietal (angular gyrus and precuneus), frontal (middle, superior, and medial frontal gyrus), and temporal (middle temporal gyrus) regions, suppression for actively versus passively generated feedback was stronger when participants were viewing their own compared to someone else's hand. Our results suggest that forward models can take hand identity into account when predicting sensory action consequences.