Violation of expectations about movement and goal achievement leads to Sense of Agency reduction

Combined EEG and immersive virtual reality unveil dopaminergic modulation of error monitoring in Parkinson's Disease

Detecting errors in your own and others' actions is associated with discrepancies between intended and expected outcomes. The processing of salient events is associated with dopamine release, the balance of which is altered in Parkinson's disease (PD). Errors in observed actions trigger various electrocortical indices (e.g. mid-frontal theta, error-related delta, and error positivity [oPe]). However, the impact of dopamine depletion to observed errors in the same individual remains unclear. Healthy controls (HCs) and PD patients observed ecological reach-to-grasp-a-glass actions performed by a virtual arm from a first-person perspective. PD patients were tested under their dopaminergic medication (on-condition) and after dopaminergic withdrawal (off-condition). Analyses of oPe, delta, and theta-power increases indicate that while the formers were elicited after incorrect vs. correct actions in all groups, the latter were observed in on-condition but altered in off-condition PD. Therefore, different EEG error signatures may index the activity of distinct mechanisms, and error-related theta power is selectively modulated by dopamine depletion. Our findings may facilitate discovering dopamine-related biomarkers for error-monitoring dysfunctions that may have crucial theoretical and clinical implications.

The performance monitoring system is attuned to others' actions during dyadic motor interactions

Interpersonal motor interactions require the simultaneous monitoring of one's own and one's partner's actions. To characterize how the action monitoring system tracks self and other behavior during synchronous interactions, we combined electroencephalography recordings and immersive virtual reality in two tasks where participants were asked to synchronize their actions with those of a virtual partner (VP). The two tasks differed in the features to be monitored: the Goal task required participants to predict and monitor the VP's reaching goal; the Spatial task required participants to predict and monitor the VP's reaching trajectory. In both tasks, the VP performed unexpected movement changes to which the participant needed to adapt. By extracting the neural activity locked to the detection of unexpected changes in the VP's action (other-monitoring) or to the participants' action-replanning (self-monitoring), we show that the monitoring system is more attuned to others' than to one's own actions. Additionally, distinctive neural responses to VP's unexpected goals and trajectory corrections were found: goal changes were reflected both in early fronto-central and later posterior neural responses while trajectory deviations were reflected only in later posterior responses. Altogether, our results indicate that the monitoring system adopts an inherent social mode to handle interpersonal motor interactions.

Reduced ownership over a virtual body modulates dishonesty

Although studies suggest that even higher-order functions can be embodied, whether body awareness may bias moral decisions toward (dis)honesty remains underinvestigated. Here, we tested if the Sense of body Ownership (SoO) and the magnitude of monetary rewards influence the tendency to act immorally. Through a virtual body, participants played a card game in which they could lie to others to steal high or low amounts of money. To manipulate SoO, the virtual body was seen and controlled from a first-person perspective, with hands attached or detached, or from a third-person perspective. In third-person perspective, SoO was significantly reduced and more egoistic lies were produced in high reward conditions. Thus, SoO reduction and high monetary reward facilitate dishonest behavior, likely by separating the self from the dishonest actions performed through the disowned body. Because most future interactions will likely occur in a digital metaverse, our results may have crucial societal impact.

Midfrontal Theta tACS Facilitates Motor Coordination in Dyadic Human-Avatar Interactions

Synchronous interpersonal motor interactions require moment-to-moment prediction and proactive monitoring of the partner's actions. Neurophysiologically, this is highlighted by an enhancement of midfrontal theta (4-7 Hz) oscillations. In this study, we explored the causal role of midfrontal theta for interpersonal motor interactions using transcranial alternating current stimulation (tACS). We implemented a realistic human-avatar interaction task in immersive virtual reality where participants controlled a virtual arm and hand to press a button synchronously with a virtual partner. Participants completed the task while receiving EEG-informed theta (Experiment 1) or beta (control frequency, Experiment 2) tACS over the frontal midline, as well as sham stimulation as a control. Results showed that midfrontal theta tACS significantly improved behavioral performance (i.e., reduced interpersonal asynchrony) and participants' motor strategies (i.e., increased movement times and reduced RTs), whereas beta tACS had no effect on these measures. These results suggest that theta tACS over frontal areas facilitates action monitoring and motor abilities supporting interpersonal interactions.

A Hierarchical Attractor Network Model of perceptual versus intentional decision updates

Changes of Mind are a striking example of our ability to flexibly reverse decisions and change our own actions. Previous studies largely focused on Changes of Mind in decisions about perceptual information. Here we report reversals of decisions that require integrating multiple classes of information: 1) Perceptual evidence, 2) higher-order, voluntary intentions, and 3) motor costs. In an adapted version of the random-dot motion task, participants moved to a target that matched both the external (exogenous) evidence about dot-motion direction and a preceding internally-generated (endogenous) intention about which colour to paint the dots. Movement trajectories revealed whether and when participants changed their mind about the dot-motion direction, or additionally changed their mind about which colour to choose. Our results show that decision reversals about colour intentions are less frequent in participants with stronger intentions (Exp. 1) and when motor costs of intention pursuit are lower (Exp. 2). We further show that these findings can be explained by a hierarchical, multimodal Attractor Network Model that continuously integrates higher-order voluntary intentions with perceptual evidence and motor costs. Our model thus provides a unifying framework in which voluntary actions emerge from a dynamic combination of internal action tendencies and external environmental factors, each of which can be subject to Change of Mind.

The "embreathment" illusion highlights the role of breathing in corporeal awareness

Recent theories posit that physiological signals contribute to corporeal awareness, the basic feeling that one has a body (body ownership) that acts according to one's will (body agency) and occupies a specific position (body location). Combining physiological recordings with immersive virtual reality, we found that an ecological mapping of real respiratory patterns onto a virtual body illusorily changes corporeal awareness. This new way of inducing a respiratory bodily illusion, called "embreathment," revealed that breathing is almost as important as visual appearance for inducing body ownership and more important than any other cue for body agency. These effects were moderated by individual levels of interoception, as assessed through a standard heartbeat-counting task and a new "pneumoception" task. By showing that respiratory, visual, and spatial signals exert a specific and weighted influence on the fundamental feeling that one is an embodied agent, we pave the way for a comprehensive hierarchical model of corporeal awareness.NEW & NOTEWORTHY Our body is the only object we sense from the inside; however, it is unclear how much inner physiology contributes to the global sensation of having a body and controlling it. We combine respiration recordings with immersive virtual reality and find that making a virtual body breathe like the real body gives an illusory sense of ownership and agency over the avatar, elucidating the role of a key physiological process like breathing in corporeal awareness.

Sense of agency in continuous action is influenced by outcome feedback in one-back trials

Sense of agency (SoA) is a subjective feeling that a person controls his/her own actions and causes changes in the external world. In continuous action such as controlling a dot by keypresses, SoA is influenced by actual actions during the task. Additionally, it is known that even though the actual actions were almost identical, outcome feedback (e.g., success or fail) could modulate SoA, indicating a retrospective modulation of SoA. However, it was unclear whether the SoA modulated by outcome feedback would influence SoA for an up-coming action. Here, we investigated the effects of outcome feedback in one-back trial on SoA in the present trial (i.e., prospective modulation). We conducted three experiments where participants controlled a dot to a target whose color changed unpredictably between white and blue. If the dot reached the target when the color was white (blue), participants received a text feedback of "Success" ("Fail"). However, in fact, we predetermined the outcome feedback to remove the effects of the actual performance of participants on SoA. The results showed that if the outcome feedback of the one-back trial was successful, SoA of the present trial became higher (i.e., prospective modulation) until they received the outcome feedback. Moreover, the prospectively modulated SoA was retrospectively overwritten by the outcome feedback of the present trial and likely converged to a constant level. These findings indicated that SoA was not produced by a mere sum of the prospective and retrospective factors, but rather that these factors independently influenced SoA with differential time courses.

Does delay in feedback diminish sense of agency? A review

Sense of agency refers to the subjective feeling of controlling one's own action, and through it, external events. Action-effect delay is widely used to disrupt this subjective feeling. Numerous studies have shown that self-reported sense of agency decreases along with the increase in delay. I discussed the distinction between body and external agency, and the possible different effects of delay on them. Furthermore, I reviewed literature that examined the influence of delay on self-reported sense of agency, implicit measures of sense of agency, and control-based action selection, and discussed possible reasons of the reported effects. Delay influences the measures of agency via multiple possible processes, such as graded response, task performance, sensory pre-activation, and temporal perceptual sensitivity. However, the causal relation between action and effect at higher-level of judgment may remain intact even for super-second delays. I conclude that the effects of delay on the sense of agency significantly differ between different levels, and researchers willing to use delay to disturb the sense of agency should carefully clarify which process it may affect.

Body ownership increases the interference between observed and executed movements

When we successfully achieve willed actions, the feeling that our moving body parts belong to the self (i.e., body ownership) is barely required. However, how and to what extent the awareness of our own body contributes to the neurocognitive processes subserving actions is still debated. Here we capitalized on immersive virtual reality in order to examine whether and how body ownership influences motor performance (and, secondly, if it modulates the feeling of voluntariness). Healthy participants saw a virtual body either from a first or a third person perspective. In both conditions, they had to draw continuously straight vertical lines while seeing the virtual arm doing the same action (i.e., drawing lines) or deviating from them (i.e., drawing ellipses). Results showed that when there was a mismatch between the intended and the seen movements (i.e., participants had to draw lines but the avatar drew ellipses), motor performance was strongly "attracted" towards the seen (rather than the performed) movement when the avatar's body part was perceived as own (i.e., first person perspective). In support of previous studies, here we provide direct behavioral evidence that the feeling of body ownership modulates the interference of seen movements to the performed movements.

Error, rather than its probability, elicits specific electrocortical signatures: a combined EEG-immersive virtual reality study of action observation

Detecting errors in one’s own actions, and in the actions of others, is a crucial ability for adaptable and flexible behavior. Studies show that specific EEG signatures underpin the monitoring of observed erroneous actions (error-related negativity, error positivity, mid-frontal theta oscillations). However, the majority of studies on action observation used sequences of trials where erroneous actions were less frequent than correct actions. Therefore, it was not possible to disentangle whether the activation of the performance monitoring system was due to an error, as a violation of the intended goal, or to a surprise/novelty effect, associated with a rare and unexpected event. Combining EEG and immersive virtual reality (IVR-CAVE system), we recorded the neural signal of 25 young adults who observed, in first-person perspective, simple reach-to-grasp actions performed by an avatar aiming for a glass. Importantly, the proportion of erroneous actions was higher than correct actions. Results showed that the observation of erroneous actions elicits the typical electrocortical signatures of error monitoring, and therefore the violation of the action goal is still perceived as a salient event. The observation of correct actions elicited stronger alpha suppression. This confirmed the role of the alpha-frequency band in the general orienting response to novel and infrequent stimuli. Our data provide novel evidence that an observed goal error (the action slip) triggers the activity of the performance-monitoring system even when erroneous actions, which are, typically, relevant events, occur more often than correct actions and thus are not salient because of their rarity.

NEW & NOTEWORTHY Activation of the performance-monitoring system (PMS) is typically investigated when errors in a sequence are comparatively rare. However, whether the PMS is activated by errors per se or by their infrequency is not known. Combining EEG-virtual reality techniques, we found that observing frequent (70%) action errors performed by avatars elicits electrocortical error signatures suggesting that deviation from the prediction of how learned actions should correctly deploy, rather than its frequency, is coded in the PMS.