The virtual-hand illusion: effects of impact and threat on perceived ownership and affective resonance

The impact of interoceptive accuracy and stimulation type on the out-of-body experience

People tend to perceive a virtual body standing in front of them as their own if it is either stroked or moving synchronously with their own real body-the out-of-body experience (OBE). We combined synchrony manipulation with two other factors of theoretical interest: the kind of stimulation, visuotactile stimuli or visuomotor correlations, being synchronised and the interoceptive accuracy (IA) of participants, assessed by means of the heartbeat counting task. Results showed that explicit measures of embodiment were systematically affected by synchrony, and this synchrony effect was more pronounced for visuomotor than for visuotactile conditions. The walking drift was affected by IA: In visuotactile conditions, the synchrony effect was pronounced in individuals with low IA, presumably reflecting a stronger impact of the visual information. In visuomotor conditions, however, the synchrony effect was stronger in individuals with high IA, presumably reflecting a stronger impact of re-afferent information generated by the participants' own movements.

Did you hear your action? An ecological approach to the senses of ownership and agency

The Sense of Ownership (SoO) and the Sense of Agency (SoA) are two key components of bodily self-consciousness. In this experiment, we investigated how they are affected by variations in the ecological validity of the moving Rubber Hand Illusion (mRHI) paradigm, which typically include three movement conditions: active congruent, passive congruent, and active incongruent. These conditions were either in a session in which no auditory feedback associated with finger-tapping was eliminated, or in a session in which such a feedback occurred. Since the presence of the auditory feedback more closely corresponds to what individuals experience in daily life when they tap their finger on a surface, sessions with feedback are more ecologically valid, and should thus result in a more marked SoO. Results indicated that in the active movement condition in which the illusion is typically found (congruent), the effect was enhanced when the feedback was present. This advantage emerged on both on objective and subjective measures of SoO. The SoA, on the other hand, is not affected by the auditory feedback.

Evaluating Virtual Hand Illusion through Realistic Appearance and Tactile Feedback

We conducted a virtual reality study to explore virtual hand illusion through three levels of appearance (Appearance dimension: realistic vs. pixelated vs. toon hand appearances) and two levels of tactile feedback (Tactile dimension: no tactile vs. tactile feedback). We instructed our participants to complete a virtual assembly task in this study. Immediately afterward, we asked them to provide self-reported ratings on a survey that captured presence and five embodiment dimensions (hand ownership, touch sensation, agency and motor control, external appearance, and response to external stimuli). The results of our study indicate that (1) tactile feedback generated a stronger sense of presence, touch sensation, and response to external stimuli; (2) the pixelated hand appearance provided the least hand ownership and external appearance; and (3) in the presence of the pixelated hand, prior virtual reality experience of participants impacted their agency and motor control and their response to external stimuli ratings. This paper discusses our findings and provides design considerations for virtual reality applications with respect to the realistic appearance of virtual hands and tactile feedback.

Hypothesis awareness confounds asynchronous control conditions in indirect measures of the rubber hand illusion

Reports of changes in experiences of body location and ownership following synchronous tactile and visual stimulation of fake and real hands (rubber hand (RH) effects) are widely attributed to multisensory integration mechanisms. However, existing control methods for subjective report measures (asynchronous stroking and control statements) are confounded by participant hypothesis awareness; the report may reflect response to demand characteristics. Subjective report is often accompanied by indirect (also called 'objective' or 'implicit') measures. Here, we report tests of expectancies for synchronous 'illusion' and asynchronous 'control' conditions across two pre-registered studies (n = 140 and n = 45) for two indirect measures: proprioceptive drift (a change in perceived hand location) and skin conductance response (a measure of physiological arousal). Expectancies for synchronous condition measures were greater than for asynchronous conditions in both studies. Differences between synchronous and asynchronous control condition measures are therefore confounded by hypothesis awareness. This means indirect measures of RH effects may reflect compliance, bias and phenomenological control in response to demand characteristics, just as for subjective measures. Valid control measures are required to support claims of a role of multisensory integration for both direct and indirect measures of RH effects.

Physical load reduces synchrony effects on agency and ownership in the virtual hand illusion

We used the virtual hand illusion paradigm to investigate the effect of physical load on perceived agency and body ownership. Participants pulled a resistance band that required exerting a force of 1 N, 10 N, or 20 N while operating a virtual hand that moved in synchronous or out of sync with their own hand. Explicit agency and ownership ratings were obtained, in addition to intentional binding and skin conductance as implicit measures of agency and ownership. Physical load increased perceived subjective load but showed no main effect, while synchrony effects were found on all agency and ownership measures. Interestingly, load did interact with synchrony in implicit agency and explicit ownership, by reducing and eliminating synchrony effects as movement synchrony was reduced with higher physical load. Furthermore, consistent with previous claims, implicit agency increased with perceived effort associated with higher physical load.

Contribution of interaction force to the sense of hand ownership and the sense of hand agency

When performing willed actions, we have the unified and coherent experience of owning and controlling our body. Body ownership is believed to emerge from the integration of coherent multisensory signals, while agency is believed to emerge from the coherence between predicted and perceived outcomes of actions. As a consequence, body ownership and agency can both be modulated by multisensory conflicts. The contribution of active movement generation to ownership and agency has not been parametrically explored. Here, we investigated the contribution of interaction force between the agent and the environment to the sense of hand ownership (SO) and the sense of hand agency (SA). By combining robotics and virtual reality, we manipulated the sensorimotor and visual information during immersive scenarios to induce and quantify altered states of SO and SA. First, we demonstrated that SO and SA could be successfully manipulated by our experimental paradigms. Second, we showed that interaction force strongly contributes to SA, but to a lesser extent to SO. Finally, we showed that SO and SA interact beyond their common multisensory basis. Our results, based on two independent studies, provide a direct link between sensorimotor interactions and subjective body experience and demonstrate a new dissociation between SO and SA.

How Action Shapes Body Ownership Momentarily and Throughout the Lifespan

Objects which a human agent controls by efferent activities (such as real or virtual tools) can be perceived by the agent as belonging to his or her body. This suggests that what an agent counts as “body” is plastic, depending on what she or he controls. Yet there are possible limitations for such momentary plasticity. One of these limitations is that sensations stemming from the body (e.g., proprioception) and sensations stemming from objects outside the body (e.g., vision) are not integrated if they do not sufficiently “match”. What “matches” and what does not is conceivably determined by long–term experience with the perceptual changes that body movements typically produce. Children have accumulated less sensorimotor experience than adults have. Consequently, they express higher flexibility to integrate body-internal and body-external signals, independent of their “match” as suggested by rubber hand illusion studies. However, children’s motor performance in tool use is more affected by mismatching body-internal and body-external action effects than that of adults, possibly because of less developed means to overcome such mismatches. We review research on perception-action interactions, multisensory integration, and developmental psychology to build bridges between these research fields. By doing so, we account for the flexibility of the sense of body ownership for actively controlled events and its development through ontogeny. This gives us the opportunity to validate the suggested mechanisms for generating ownership by investigating their effects in still developing and incomplete stages in children. We suggest testable predictions for future studies investigating both body ownership and motor skills throughout the lifespan.

Congruency of Information Rather Than Body Ownership Enhances Motor Performance in Highly Embodied Virtual Reality

In immersive virtual reality, the own body is often visually represented by an avatar. This may induce a feeling of body ownership over the virtual limbs. Importantly, body ownership and the motor system share neural correlates. Yet, evidence on the functionality of this neuroanatomical coupling is still inconclusive. Findings from previous studies may be confounded by the congruent vs. incongruent multisensory stimulation used to modulate body ownership. This study aimed to investigate the effect of body ownership and congruency of information on motor performance in immersive virtual reality. We aimed to modulate body ownership by providing congruent vs. incongruent visuo-tactile stimulation (i.e., participants felt a brush stroking their real fingers while seeing a virtual brush stroking the same vs. different virtual fingers). To control for congruency effects, unimodal stimulation conditions (i.e., only visual or tactile) with hypothesized low body ownership were included. Fifty healthy participants performed a decision-making (pressing a button as fast as possible) and a motor task (following a defined path). Body ownership was assessed subjectively with established questionnaires and objectively with galvanic skin response (GSR) when exposed to a virtual threat. Our results suggest that congruency of information may decrease reaction times and completion time of motor tasks in immersive virtual reality. Moreover, subjective body ownership is associated with faster reaction times, whereas its benefit on motor task performance needs further investigation. Therefore, it might be beneficial to provide congruent information in immersive virtual environments, especially during the training of motor tasks, e.g., in neurorehabilitation interventions.

Sequential motor learning transfers from real to virtual environment

Background

Skill acquisition of motor learning between virtual environments (VEs) and real environments (REs) may be related. Although studies have previously examined the transfer of motor learning in VEs and REs through the same tasks, only a small number of studies have focused on studying the transfer of motor learning in VEs and REs by using different tasks. Thus, detailed effects of the transfer of motor skills between VEs and REs remain controversial. Here, we investigated the transfer of sequential motor learning between VEs and REs conditions.

Methods

Twenty-seven healthy volunteers performed two types of sequential motor learning tasks; a visually cued button-press task in RE (RE task) and a virtual reaching task in VE (VE task). Participants were randomly assigned to two groups in the task order; the first group was RE task followed by VE task and the second group was VE task followed by RE task. Subsequently, the response time in RE task and VE task was compared between the two groups respectively.

Results

The results showed that the sequential reaching task in VEs was facilitated after the sequential finger task in REs.

Conclusions

These findings suggested that the sequential reaching task in VEs can be facilitated by a motor learning task comprising the same sequential finger task in REs, even when a different task is applied.

Development of the bodily self: Effects of visuomotor synchrony and visual appearance on virtual embodiment in children and adults

The sense of a bodily self is thought to depend on adaptive weighting and integration of bodily afferents and prior beliefs. Evidence from studies using paradigms such as the rubber hand illusion and full body illusion suggests changes in the integration of visuotactile bodily signals throughout childhood. Here, we extended this line of research by assessing how bottom-up visuomotor synchrony and expectancy, modulated by visual appearance of virtual avatars, contribute to embodiment in children. We compared responses to a first-person perspective virtual full body illusion from 8- to 12-year-old children and adults while manipulating synchrony of the avatar's movements (synchronous, 0.5-s delay, or 1-s delay compared with the participant's movements) and appearance of the avatar (human or skeleton). We measured embodiment with both subjective questionnaires and objective skin conductance responses to virtual threat. Results showed that children experienced ownership for the virtual avatar in a similar way as adults, which was reduced with increasing asynchrony, and for the skeleton avatar as compared with the human avatar. This modulation of ownership was not reflected in the skin conductance responses, which were equally high in all experimental conditions and only showed a modulation of repetition by age. In contrast, in children the subjective experience of agency was less affected by the dampening effects of visuomotor asynchrony or reduced human likeness and was overall higher. These findings suggest that children can easily embody a virtual avatar but that different aspects of embodiment develop at different rates, which could have important implications for applications of embodied virtual reality.

Cognitive load dissociates explicit and implicit measures of body ownership and agency

It is often claimed that the human self consists of perceived body ownership and agency, which are commonly assessed through explicit ownership and agency judgments and implicit measures, like proprioceptive drift, skin conductance responses, and intentional binding effects. Bottom-up multisensory integration and top-down modulation were predicted to be important for ownership and agency. In previous studies, cognitive load was revealed to affect the sense of agency in a top-down fashion, but its effect on ownership has not been fully investigated, not even its possibly different effect on explicit and implicit measures. Here we used cognitive load (small vs. large sets in a working-memory task) to disentangle explicit and implicit measures of ownership and agency in a task inducing the virtual hand illusion (VHI; stronger perceived ownership and agency over a virtual hand if it moves in synchrony with one's real hand). Results showed similar patterns for ownership and agency - both ownership and agency were affected by cognitive load, and importantly in the explicit measures, higher load increased the effect of synchrony (i.e., the VHI), but in implicit measures, higher load reduced indications of both ownership and agency. Hence, the load manipulation was selective with regard to the explicit versus implicit nature of the measure but not with respect to the measure's content. This provides strong evidence that explicit and implicit measures of both ownership and agency rely on at least partly separable informational sources, while the difference between ownership and agency as such does not seem to play a major role.

Explicit and implicit measures of body ownership and agency: affected by the same manipulations and yet independent

People are assumed to represent themselves in terms of body ownership and agency. Studies using the rubber- or virtual-hand illusion have assessed ownership and agency by means of explicit ownership and agency ratings and implicit measures, like proprioceptive drift in the case of ownership. These measures often show similar effects but also some discrepancies, suggesting that they rely on data sources that overlap, but not completely. To systematically assess commonalities and discrepancies, we adopted an immersed virtual hand illusion (VHI) design, in which three independent factors were manipulated: the synchrony between the movement of real and virtual effector, the type of effector, which was a virtual hand or triangle, and the spatial congruency between the real and virtual effector. Commonalities and discrepancies in the effects of these factors were assessed by crossing explicit and implicit measures for ownership and agency. While standard ratings were used as explicit measures, implicit ownership was assessed by means of proprioceptive drift and implicit agency by means of intentional binding. Results showed similar effect patterns for the two agency measures, which, however, were not correlated, different effect patterns for the two ownership measures, and a strong correlation between the two explicit measures. Taken altogether, our findings suggest that explicit and implicit measures of ownership and agency partly rely on shared informational sources, but seem to differ with respect to other sources that are integrated or with respect to the processed dimension (shape vs. time). The findings also suggest that some findings obtained with RHI designs might reflect more the unnatural situation that that design puts individuals into rather than generalizable mechanisms of computing perceived ownership and agency.

Absence of reliable physiological signature of illusory body ownership revealed by fine-grained autonomic measurement during the rubber hand illusion

The neural representation of a 'biological self' is linked theoretically to the control of bodily physiology. In an influential model, selfhood relates to internal agency and higher-order interoceptive representation, inferred from the predicted impact of efferent autonomic nervous activity on afferent viscerosensory feedback. Here we tested if an altered representation of physical self (illusory embodiment of an artificial hand) is accompanied by sustained shifts in autonomic activity. Participants (N = 37) underwent procedures for induction of the rubber hand illusion (synchronous stroking of own unseen hand and observed stroking of artificial hand) and a control condition (asychronous stroking). We recorded electrocardiography, electrodermal activity, and a non-invasive measure of multiunit skin sympathetic nerve activity (SKNA) from the chest. We compared these autonomic indices between task conditions, and between individuals who did and did not experience the illusion. Bayes factors quantified the strength of evidence for and against null hypotheses. Observed proprioceptive drift and subjective reports confirmed the efficacy of the synchronous (vs asynchronous) condition in inducing illusory hand ownership. Stringent discriminant analysis classified 24/37 individuals as experiencing the rubber hand illusion. Surprisingly, heart rate, heart rate variability, electrodermal activity, and SKNA measures revealed no autonomic differences between synchronous vs asynchronous conditions, nor between individuals who did or did not experience the rubber hand illusion. Bayes factors indicated substantial evidence for no physiological differences. In contrast to earlier reports, our autonomic data show the absence of a reliable change in physiological state during the rubber hand illusion. More encompassing perturbations of self-experience, for example in full body illusions, may nevertheless be coupled to, or facilitated by, changes in efferent autonomic activity and afferent viscerosensory feedback. Our findings suggest that such changes in bodily physiology are not sustained as an obligatory component of the rubber hand illusion.

Enfacing a female reduces the gender-science stereotype in males

The enfacement illusion refers to the illusory perception that features of another face that moves in synchrony with one's own facial movements become part of one's own body. Here, we tested whether males whose facial movements are synchronized with a virtual female face exhibit a less pronounced implicit gender-science stereotype than males whose movements are not synchronized. Results show that illusory ownership and agency of the face with opposite gender was successfully induced, and that synchrony significantly reduced the implicit gender-science stereotype as compared with nonsynchrony. Our findings are in line with previous demonstrations about being synchronized with other individuals facilitates feature migration-that is, the integration of their features into one's self-representation.

Demand Characteristics Confound the Rubber Hand Illusion

Reports of experiences of ownership over a fake hand following simple multisensory stimulation (the ‘rubber hand illusion’) have generated an expansive literature. Because such reports might reflect suggestion effects, demand characteristics are routinely controlled for by contrasting agreement ratings for ‘illusion’ and ‘control’ conditions. However, these methods have never been validated, and recent evidence that response to imaginative suggestion (‘phenomenological control’) predicts illusion report prompts reconsideration of their efficacy. A crucial assumption of the standard approach is that demand characteristics are matched across conditions. Here, a quasi-experiment design was employed to test demand characteristics in rubber hand illusion reports. Participants were provided with information about the rubber hand illusion procedure (text description and video demonstration) and recorded expectancies for standard ‘illusion’ and ‘control’ statements. Expectancies for ‘control’ and ‘illusion’ statements in synchronous and asynchronous conditions were found to differ similarly to published illusion reports. Therefore, rubber hand illusion control methods which have been in use for 22 years are not fit for purpose. Because demand characteristics have not been controlled in illusion report in existing studies, the illusion may be, partially or entirely, a suggestion effect. Methods to develop robust controls are proposed. That confounding demand characteristics have been overlooked for decades may be attributable to a lack of awareness that demand characteristics can drive experience in psychological science.

Toward Enhanced Teleoperation Through Embodiment

Telerobotics aims to transfer human manipulation skills and dexterity over an arbitrary distance and at an arbitrary scale to a remote workplace. A telerobotic system that is transparent enables a natural and intuitive interaction. We postulate that embodiment (with three sub-components: sense of ownership, agency, and self-location) of the robotic system leads to optimal perceptual transparency and increases task performance. However, this has not yet been investigated directly. We reason along four premises and present findings from the literature that substantiate each of them: (1) the brain can embody non-bodily objects (e.g., robotic hands), (2) embodiment can be elicited with mediated sensorimotor interaction, (3) embodiment is robust against inconsistencies between the robotic system and the operator's body, and (4) embodiment positively correlates to dexterous task performance. We use the predictive encoding theory as a framework to interpret and discuss the results reported in the literature. Numerous previous studies have shown that it is possible to induce embodiment over a wide range of virtual and real extracorporeal objects (including artificial limbs, avatars, and android robots) through mediated sensorimotor interaction. Also, embodiment can occur for non-human morphologies including for elongated arms and a tail. In accordance with the predictive encoding theory, none of the sensory modalities is critical in establishing ownership, and discrepancies in multisensory signals do not necessarily lead to loss of embodiment. However, large discrepancies in terms of multisensory synchrony or visual likeness can prohibit embodiment from occurring. The literature provides less extensive support for the link between embodiment and (dexterous) task performance. However, data gathered with prosthetic hands do indicate a positive correlation. We conclude that all four premises are supported by direct or indirect evidence in the literature, suggesting that embodiment of a remote manipulator may improve dexterous performance in telerobotics. This warrants further implementation testing of embodiment in telerobotics. We formulate a first set of guidelines to apply embodiment in telerobotics and identify some important research topics.

Exploring Self-Paced Embodiable Neurofeedback for Post-stroke Motor Rehabilitation

Neurofeedback-guided motor-imagery training (NF-MIT) has been proposed as a promising intervention following upper limb motor impairment. In this intervention, paretic stroke patients receive online feedback about their brain activity while conducting a motor-imagery (MI) task with the paretic limb. Typically, the feedback provided in NF-MIT protocols is an abstract visual signal based on a fixed trial. Here we developed a self-paced NF-MIT paradigm with an embodiable feedback signal (EFS), which was designed to resemble the content of the mental act as closely as possible. To this end, the feedback was delivered via an embodiable, anthropomorphic robotic hand (RH), which was integrated into a closed-looped EEG-based brain-computer interface (BCI). Whenever the BCI identified a new instance of a hand-flexion or hand-extension imagination by the participant, the RH carried out the corresponding movement with minimum delay. Nine stroke patients and nine healthy participants were instructed to control RH movements as accurately as possible, using mental activity alone. We evaluated the general feasibility of our paradigm on electrophysiological, subjective and performance levels. Regarding electrophysiological measures, individuals showed the predicted event-related desynchronization (ERD) patterns over sensorimotor brain areas. On the subjective level, we found that most individuals integrated the RH into their body scheme. With respect to RH control, none of our participants achieved a high level of control, but most managed to control the RH actions to some degree. Importantly, patients and controls achieved similar performance levels. The results support the view that self-paced embodiable NF-MIT is feasible for stroke patients and can complement classical NF-MIT.

Modulation of Body Representation Impacts on Efferent Autonomic Activity

The afferent branch of the autonomic nervous system contributes with interoception to the multimodal sensory correlation continuously needed to update our representation of the body. To test whether the modulation of body representation would have an impact on the efferent branch of the autonomic nervous system, nonspecific skin conductance has been measured in three rubber hand illusion (RHI) experiments, controlled with asynchronous brush-stroking and incongruent fake hand position. Nonspecific skin conductance standard deviation (SCSD) computed along the whole 90 sec of stroking was found to be increased by the illusion and to correlate with all the typical measures of embodiment. Computing SCSD in shorter time windows strongly enhanced the difference between illusion and controls. The highest difference was found in the 10-55 sec window, being the 14-34 sec window as the most informative one. The higher correlations with the validated measures of embodiment (all but the proprioceptive drift) were found for time windows ranging between 35 and 65 sec. The SCSD was no longer significantly higher when the RHI was repeated twice (two trials each iteration), but it was still significantly higher in synchronous stroking even when considering only the second trial. However, after the first iteration of the RHI paradigm, the effect of the embodiment on nonspecific skin conductance response results to be attenuated, suggesting that novelty in presentation of the RHI can contribute to the effect on nonspecific skin conductance response. Results candidate SCSD as a noninvasive, cheap, easy, and objective measure of embodiment, especially sensible to onset and strength of the illusion. Alike the already known enhanced autonomic reaction to a threatening, SCSD does not interfere with the collection of other behavioral measures. Correlations and their dynamics, presence of the effect in the second presentation of the setup but relative low robustness against multiple repetition, suggest that the increased fluctuations of skin conductance caught by SCSD are not just the effect of different presented sensory stimuli but more likely a stronger arousal response to the novelty of the updated perceptual status.

Different level of virtualization of sight and touch produces the uncanny valley of avatar's hand embodiment

Humans increasingly often act through virtual and robotic avatars, which can feed back to their user only virtual sensory information. Since avatar is user's embodiment and body image is mostly based on senses, how virtualization of sensory inputs affects avatar self-attribution is a key question for understanding nowadays human behavior. By manipulating visual and tactile inputs in a series of experiments fashioned after the rubber hand illusion, we assessed the relative weight of the virtualization of sight (Real, Robotic, Virtual) and of touch (Real, Virtual) on artificial hand embodiment. Virtualization decreased embodiment, but unexpectedly lowest embodiment was found when only one sense was virtual. Discordant levels of virtualization of sight and touch elicited revulsion, extending the concept of the uncanny valley to avatar embodiment. Besides timing, spatial constraints and realism of feedback, a matched degree of virtualization of seen and felt stimuli is a further constraint in building the representation of the body.

Heat pain modulation with virtual water during a virtual hand illusion

Immersive virtual reality is a powerful method to modify the environment and thereby influence experience. The present study used a virtual hand illusion and context manipulation in immersive virtual reality to examine top-down modulation of pain. Participants received painful heat stimuli on their forearm and placed an embodied virtual hand (co-located with their real one) under a virtual water tap, which dispensed virtual water under different experimental conditions. We aimed to induce a temperature illusion by a red, blue or white light suggesting warm, cold or no virtual water. In addition, the sense of agency was manipulated by allowing participants to have high or low control over the virtual hand’s movements. Most participants experienced a thermal sensation in response to the virtual water and associated the blue and red light with cool/cold or warm/hot temperatures, respectively. Importantly, the blue light condition reduced and the red light condition increased pain intensity and unpleasantness, both compared to the control condition. The control manipulation influenced the sense of agency, but did not influence pain ratings. The large effects revealed in our study suggest that context effects within an embodied setting in an immersive virtual environment should be considered within VR based pain therapy.

The interplay of predictive and postdictive components of experienced selfhood

Objects that we affect by our body movements can be experienced as being controlled by (agency) and belonging to the own body (ownership). Such impressions of minimal selfhood arise when objects move as predicted prior to the action (predictive component). But they can also arise when otherwise unpredictable object movements turn out to be consistent with (e.g. spatially compatible to) preceding actions (postdictive component). Here we studied how the impact of postdictive components of inferred minimal selfhood in terms of action-object compatibility is shaped by different levels of predictability of these object movements. We found that compatibility between actions and object movements, and to a lesser extent predictability of object movements, affected reported agency while only compatibility affected reported ownership. Importantly, predictive and postdictive factors influenced these measures in an independent manner. We discuss these results against the background of models that assume multiple components of experienced minimal selfhood.

Action effect consistency and body ownership in the avatar-Simon task

Putting oneself in the shoes of a digital alter ego becomes an increasingly relevant part of our everyday experience. In modern day psychology, these interactions can be examined within the frameworks of visual perspective taking and body ownership. Both target similar questions: What does it take, to become one with the avatar? When do we show the same behavior and make the same experiences, as if we were in its place? In this study, we want to address the role of action effect consistency for these concepts. We manipulated the participants’ sense of agency over a task-irrelevant avatar in a Simon task by providing either corresponding or random action effects. These effects could be either embodied and therefore linked to the avatar (Experiment 1) or independent of it (Experiment 2). We used stimulus-response compatibility effects from the avatar’s point of view as a measure for spontaneous visual perspective taking and a questionnaire to measure the perceived body ownership of the avatar. The results showed that corresponding action effects lead to increased spontaneous perspective taking of the avatar, regardless of whether the effect was linked to the avatar or not. Though the avatar compatibility effects were overall more pronounced in the embodied action effect condition. However, significant differences in perceived body ownership were only observed if the effects were linked to the avatar. The results might prove useful to further our understanding of subjective and objective measurements of interactions with avatars.

Can Wearable Haptic Devices Foster the Embodiment of Virtual Limbs?

Increasing presence is one of the primary goals of virtual reality research. A crucial aspect is that users are capable of distinguishing their self from the external virtual world. The hypothesis we investigate is that wearable haptics play an important role in the body experience and could thereby contribute to the immersion of the user in the virtual environment. A within-subject study (n=32) comparing the embodiment of a virtual hand with different implementations of haptic feedback (force feedback, vibrotactile feedback, and no haptic feedback) is presented. Participants wore a glove with haptic feedback devices at thumb and index finger. They were asked to put virtual cubes on a moving virtual target. Touching a virtual object caused vibrotactile-feedback, force-feedback or no feedback depending on the condition. These conditions were provided both synchronously and asynchronously. Embodiment was assessed quantitatively with the proprioceptive drift and subjectively via a questionnaire. Results show that haptic feedback significantly improves the subjective embodiment of a virtual hand and that force feedback leads to stronger responses to certain subscales of subjective embodiment. These outcomes are useful guidelines for wearable haptic designer and represent a basis for further research concerning human body experience, in reality, and in virtual environments.

Active control as evidence in favor of sense of ownership in the moving Virtual Hand Illusion

The sense of ownership, the feeling that our body belongs to ourselves, relies on multiple sources of sensory information. Among these sources, the contribution of visuomotor information is still debated. We tested the effect of active control in the sense of ownership in the moving Virtual Hand Illusion. Participants reported sense of ownership and sense of agency over a virtual arm in which we manipulated the morphological congruence of the hand and the visuomotor information. We found that congruent active control enhanced and maintained the reported sense of ownership over a hand that appeared detached from the body, but not in a morphological congruent limb. Also, incongruent active control, achieved by adding noise to the trajectory of the movement, decreased both reported sense of agency and ownership. Overall, our results are consistent with a framework in which active control acts as evidence for eliciting a sense of ownership.

Affective judgement of social touch on a hand associated with hand embodiment

Social touch constitutes a critical component of human interactions. A gentle tap on the hand, for instance, can sometimes create emotional bonding and reduce interpersonal distance in social interactions. Evidence of tactile empathy suggests that touch can be experienced through both physical sensation and observation, yet vicarious perception of observed touch on an object as a function of the object’s conceptual representation (e.g., Is this object identified as mine? Does this object feel like part of me?) remains less explored. Here we examined the affective judgement of social touch when the illusory sense of ownership over a dummy hand was manipulated through the rubber-hand illusion. When the same social touch was performed on either the real or the dummy hand, we found a similar sense of perceived pleasantness between the felt and observed touch, but only when the dummy hand was embodied; when it was not, the perceived pleasantness of the observed touch was lesser (an “embodiment effect”; Experiment 1). In addition, we found that the embodiment effect associated with the observed touch was insensitive to the way in which embodiment was manipulated (Experiment 2), and that this effect was specific to social but not neutral touch (Experiment 3). Taken together, our findings suggest a role of embodiment in the affective component of observed social touch and contribute to our understanding of tactile empathy for objects.

Context-induced contrast and assimilation effects in explicit and implicit measures of agency

Virtual-hand-illusion studies often use explicit and implicit measures of body ownership but no agreed-on implicit measure of agency exists. We investigated whether the Intentional Binding (IB) effect could serve as such a measure. A pilot study confirmed that current consistency increases both perceived agency and IB. In three experiments, current consistency was 50% but the previously experienced consistency was either 100% or 0%. When previous and present consistency experience were separated by a short break, both explicit judgments and IB showed a contrast effect. Eliminating the break reversed the effect in explicit agency but not in IB; and making the transition between previous and present consistency smoother replicated the effect for explicit agency but reversed the pattern for IB. Our findings suggest that explicit agency and IB rely on different sources of information, presumably including cross-sensory correlations, predictions of expected action-effects, and comparisons between present and previous consistency experiences.

Reversed effect of spatial compatibility when taking avatar’s perspective

If an actor takes the perspective of an avatar, spatial dissociations could arise between the perspective of the actor and the perspective of the avatar. These become particularly interesting when solving spatial compatibility tasks. Effects of spatial compatibility are usually explained by a match or mismatch of automatic behavioural tendencies and intentional mapping processes. The question is whether actors develop such behavioural tendencies for an avatar and thereby are able to neglect their own perspective. In the experiments, actors take the perspective of the avatar and pressed ipsilateral or contralateral left–right keys in response to lateralised coloured discs. Experiments 1 and 2 showed that compatibility effects are tied to the avatar but not to the actor. Experiment 3 revealed that participants could ignore the perspective of the avatar. We concluded that the automatic behavioural tendencies in compatibility experiments are not as automatic as sometimes assumed. It is likely that the present results are not only applicable to the use of avatars but also to other human-controlled robots and drones.

Perceived Ownership of Avatars Influences Visual Perspective Taking

Modern computer-based applications often require the user to interact with avatars. Depending on the task at hand, spatial dissociation between the orientations of the user and the avatars might arise. As a consequence, the user has to adopt the avatar's perspective and identify herself/himself with the avatar, possibly changing the user's self-representation in the process. The present study aims to identify the conditions that benefit this change of perspective with objective performance measures and subjective self-estimations by integrating the idea of avatar-ownership into the cognitive phenomenon of spatial compatibility. Two different instructions were used to manipulate a user's perceived ownership of an avatar in otherwise identical situations. Users with the high-ownership instruction reported higher levels of perceived ownership of the avatar and showed larger spatial compatibility effects from the avatar's point of view in comparison to the low ownership instruction. This supports the hypothesis that perceived ownership benefits perspective taking.

The Senses of Agency and Ownership: A Review

Usually, we do not question that we possess a body and act upon the world. This pre-reflective awareness of being a bodily and agentive self can, however, be disrupted by different clinical conditions. Whereas sense of ownership (SoO) describes the feeling of mineness toward one's own body parts, feelings or thoughts, sense of agency (SoA) refers to the experience of initiating and controlling an action. Although SoA and SoO naturally coincide, both experiences can also be made in isolation. By using many different experimental paradigms, both experiences have been extensively studied over the last years. This review introduces both concepts, with a special focus also onto their interplay. First, current experimental paradigms, results and neurocognitive theories about both concepts will be presented and then their clinical and therapeutic relevance is discussed.

The roles of consistency and exclusivity in perceiving body ownership and agency

Previous rubber/virtual hand illusion studies have established important constraints for the illusion that an artificial effector becomes part of one's own body (perceived ownership), and that its actions are being caused by oneself (perceived agency). We can take these observed constraints to establish two of three Wegner's (Trends Cogn Sci 7:65-69; Wegner, Trends in Cognitive Sciences 7:65-69, 2003) criteria for the perception of personal agency: priority and consistency, but not Wegner's third criterion-exclusivity. In this study we tested with virtual hand illusion, whether exclusivity (participant is certain who was controlling the virtual effector) can also be established. We manipulated two factors: exclusivity and consistency. Our results show that on both ownership and agency judgments, consistency and exclusivity produced main effects, and the two effects interacted in an underadditive fashion. Taken together, these findings provide support for our suggestion to extend Wegner's agency theory to explain perceived body ownership, which in turn provides an integrative framework for interpreting constraints on ownership and agency illusions.

Metacontrol and body ownership: divergent thinking increases the virtual hand illusion

The virtual hand illusion (VHI) paradigm demonstrates that people tend to perceive agency and bodily ownership for a virtual hand that moves in synchrony with their own movements. Given that this kind of effect can be taken to reflect self–other integration (i.e., the integration of some external, novel event into the representation of oneself), and given that self–other integration has been previously shown to be affected by metacontrol states (biases of information processing towards persistence/selectivity or flexibility/integration), we tested whether the VHI varies in size depending on the metacontrol bias. Persistence and flexibility biases were induced by having participants carry out a convergent thinking (Remote Associates) task or divergent-thinking (Alternate Uses) task, respectively, while experiencing a virtual hand moving synchronously or asynchronously with their real hand. Synchrony-induced agency and ownership effects were more pronounced in the context of divergent thinking than in the context of convergent thinking, suggesting that a metacontrol bias towards flexibility promotes self–other integration.

The Bodily Illusion in Adverse Conditions: Virtual Arm Ownership During Visuomotor Mismatch

Classically, body ownership illusions are triggered by cross-modal synchronous stimulations, and hampered by multisensory inconsistencies. Nonetheless, the boundaries of such illusions have been proven to be highly plastic. In this immersive virtual reality study, we explored whether it is possible to induce a sense of body ownership over a virtual body part during visuomotor inconsistencies, with or without the aid of concomitant visuo-tactile stimulations. From a first-person perspective, participants watched a virtual tube moving or an avatar's arm moving, with or without concomitant synchronous visuo-tactile stimulations on their hand. Three different virtual arm/tube speeds were also investigated, while all participants kept their real arms still. The subjective reports show that synchronous visuo-tactile stimulations effectively counteract the effect of visuomotor inconsistencies, but at slow arm movements, a feeling of body ownership might be successfully induced even without concomitant multisensory correspondences. Possible therapeutical implications of these findings are discussed.

How disentangled sense of agency and sense of ownership can interact with different emotional events on stress feelings

We used the virtual hand illusion paradigm to study how sense of agency and sense of (body) ownership can interact with different emotional events on stress feelings. Converging evidence for at least the partial independence of agency and ownership was found. For instance, sense of agency was a better predictor of individual anxiety levels than sense of ownership and males showed stronger effects related to agency-presumably due to gender-specific attribution styles and empathy skills. Moreover, agency and ownership also interacted with emotional events and led to different anxiety levels. Taken together, our findings suggest that the disentangled sense of agency and sense of ownership can interact with different emotional events and influenced stress feelings more in threatening situations than awarding ones.

The Onset Time of the Ownership Sensation in the Moving Rubber Hand Illusion

The rubber hand illusion (RHI) is a perceptual illusion whereby a model hand is perceived as part of one's own body. This illusion has been extensively studied, but little is known about the temporal evolution of this perceptual phenomenon, i.e., how long it takes until participants start to experience ownership over the model hand. In the present study, we investigated a version of the rubber hand experiment based on finger movements and measured the average onset time in active and passive movement conditions. This comparison enabled us to further explore the possible role of intentions and motor control processes that are only present in the active movement condition. The results from a large group of healthy participants (n = 117) showed that the illusion of ownership took approximately 23 s to emerge (active: 22.8; passive: 23.2). The 90th percentile occurs in both conditions within approximately 50 s (active: 50; passive: 50.6); therefore, most participants experience the illusion within the first minute. We found indirect evidence of a facilitatory effect of active movements compared to passive movements, and we discuss these results in the context of our current understanding of the processes underlying the moving RHI.

Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation

Studies investigating how people represent themselves and their own body often use variants of "ownership illusions", such as the traditional rubber-hand illusion or the more recently discovered enfacement illusion. However, these examples require rather artificial experimental setups, in which the artificial effector needs to be stroked in synchrony with the participants' real hand or face—a situation in which participants have no control over the stroking or the movements of their real or artificial effector. Here, we describe a technique to establish ownership illusions in a setup that is more realistic, more intuitive, and of presumably higher ecological validity. It allows creating the virtual-hand illusion by having participants control the movements of a virtual hand presented on a screen or in virtual space in front of them. If the virtual hand moves in synchrony with the participants' own real hand, they tend to perceive the virtual hand as part of their own body. The technique also creates the virtual-face illusion by having participants control the movements of a virtual face in front of them, again with the effect that they tend to perceive the face as their own if it moves in synchrony with their real face. Studying the circumstances that illusions of this sort can be created, increased, or reduced provides important information about how people create and maintain representations of themselves.

Manipulating Bodily Presence Affects Cross-Modal Spatial Attention: A Virtual-Reality-Based ERP Study

Earlier studies have revealed cross-modal visuo-tactile interactions in endogenous spatial attention. The current research used event-related potentials (ERPs) and virtual reality (VR) to identify how the visual cues of the perceiver’s body affect visuo-tactile interaction in endogenous spatial attention and at what point in time the effect takes place. A bimodal oddball task with lateralized tactile and visual stimuli was presented in two VR conditions, one with and one without visible hands, and one VR-free control with hands in view. Participants were required to silently count one type of stimulus and ignore all other stimuli presented in irrelevant modality or location. The presence of hands was found to modulate early and late components of somatosensory and visual evoked potentials. For sensory-perceptual stages, the presence of virtual or real hands was found to amplify attention-related negativity on the somatosensory N140 and cross-modal interaction in somatosensory and visual P200. For postperceptual stages, an amplified N200 component was obtained in somatosensory and visual evoked potentials, indicating increased response inhibition in response to non-target stimuli. The effect of somatosensory, but not visual, N200 enhanced when the virtual hands were present. The findings suggest that bodily presence affects sustained cross-modal spatial attention between vision and touch and that this effect is specifically present in ERPs related to early- and late-sensory processing, as well as response inhibition, but do not affect later attention and memory-related P3 activity. Finally, the experiments provide commeasurable scenarios for the estimation of the signal and noise ratio to quantify effects related to the use of a head mounted display (HMD). However, despite valid a-priori reasons for fearing signal interference due to a HMD, we observed no significant drop in the robustness of our ERP measurements.

Ownership and Agency of an Independent Supernumerary Hand Induced by an Imitation Brain-Computer Interface

To study body ownership and control, illusions that elicit these feelings in non-body objects are widely used. Classically introduced with the Rubber Hand Illusion, these illusions have been replicated more recently in virtual reality and by using brain-computer interfaces. Traditionally these illusions investigate the replacement of a body part by an artificial counterpart, however as brain-computer interface research develops it offers us the possibility to explore the case where non-body objects are controlled in addition to movements of our own limbs. Therefore we propose a new illusion designed to test the feeling of ownership and control of an independent supernumerary hand. Subjects are under the impression they control a virtual reality hand via a brain-computer interface, but in reality there is no causal connection between brain activity and virtual hand movement but correct movements are observed with 80% probability. These imitation brain-computer interface trials are interspersed with movements in both the subjects' real hands, which are in view throughout the experiment. We show that subjects develop strong feelings of ownership and control over the third hand, despite only receiving visual feedback with no causal link to the actual brain signals. Our illusion is crucially different from previously reported studies as we demonstrate independent ownership and control of the third hand without loss of ownership in the real hands.

Self-perception beyond the body: the role of past agency

Technological progress provides us with an increasing variety of devices that now mediate what previously has been achieved by social face-to-face interaction. Here, we investigate whether this leads to the incorporation of such devices into representations of our body. Using explicit (body ownership questionnaire) and implicit (proprioceptive drift rate) measures together with a synchronous/asynchronous stroking technique, we show that people have an increased tendency to integrate non-corporeal objects into their body after synchronous stroking. Explicit measures of body ownership show that people had greater average scores in the synchronous condition as compared to the asynchronous condition for all objects that we tested (computer mouse, rubber hand, smart phone, and a wooden block). However, our implicit measure of body ownership showed a numerically larger proprioceptive drift for a rubber hand than for a computer mouse, numerically comparable ownership measures for a smart phone and a rubber hand, and a significantly stronger proprioceptive drift for a smart phone than for a wooden block. These findings suggest that direct, subjective measures and indirect, objective measures of body ownership are based on different kinds of information; the latter might be more sensitive to objects for which we recall past agency based on our history of personal experiences with these objects. Taken altogether, our observations support the idea that the perceived bodily self is rather flexible and is likely to emerge through multisensory integration and top-down expectations of agency.

Mood migration: How enfacing a smile makes you happier

People tend to perceive the face of another person more as their own if own and other face are stroked in synchrony-the enfacement illusion. We conceptually replicated the enfacement illusion in a virtual reality environment, in which participants could control the movements of a virtual face by moving and touching their own face. We then used this virtual enfacement illusion to study whether enfacing a virtual face would also involve adopting the emotion that this face is expressing. As predicted, participants adopted the expressed emotion, as indicated by higher valence scores and better performance in a mood-sensitive divergent-thinking task when facing a happy virtual face, if the virtual face moved in synchrony with their own head movements. This suggests that impact on or control over another person's facial movements invite "mood migration" from the person one identifies with to oneself.

Body visual discontinuity affects feeling of ownership and skin conductance responses

When we look at our hands we are immediately aware that they belong to us and we rarely doubt about the integrity, continuity and sense of ownership of our bodies. Here we explored whether the mere manipulation of the visual appearance of a virtual limb could influence the subjective feeling of ownership and the physiological responses (Skin Conductance Responses, SCRs) associated to a threatening stimulus approaching the virtual hand. Participants observed in first person perspective a virtual body having the right hand-forearm (i) connected by a normal wrist (Full-Limb) or a thin rigid wire connection (Wire) or (ii) disconnected because of a missing wrist (m-Wrist) or a missing wrist plus a plexiglass panel positioned between the hand and the forearm (Plexiglass). While the analysis of subjective ratings revealed that only the observation of natural full connected virtual limb elicited high levels of ownership, high amplitudes of SCRs were found also during observation of the non-natural, rigid wire connection condition. This result suggests that the conscious embodiment of an artificial limb requires a natural looking visual body appearance while implicit reactivity to threat may require physical body continuity, even non-naturally looking, that allows the implementation of protective reactions to threat.

A preliminary investigation into psychophysiological effects of threatening a perceptually embodied rubber hand in healthy human participants

BACKGROUND AND AIMS

Threatening a perceptually embodied rubber hand with noxious stimuli has been shown to generate levels of anxiety similar to that experienced when a real hand is threatened. The aim of this study was to investigate skin conductance response, self-reported anxiety and the incidence, type and location of sensations when a perceptually embodied rubber hand was exposed to threatening and non-threatening stimuli.

METHODS

A repeated measures cross-over design was used whereby 20 participants (≥18 years, 14 females) received a threatening (syringe needle) and non-threatening (soft brush) stimulus to a perceptually embodied rubber hand. Perceptual embodiment was achieved using a soft brush to synchronously stroke the participant's real hand (out of view) and a rubber hand (in view). Then the investigator approached the rubber hand with a syringe needle (threat) or soft brush (non-threat).

RESULTS

Repeated measures ANOVA found that approaching the perceptually embodied rubber hand with either stimulus produced statistically significant reductions in the rated intensity of response to the following questions (p<0.01): 'How strongly does it feel like the rubber hand is yours?'; 'How strongly does it feel like the rubber hand is part of your body?'; and 'How strongly does it feel you can move the rubber hand?'. However, there were no statistically significant differences in scores between needle and brush stimuli. Repeated measures ANOVA on skin conductance response found statistically significant effects for experimental Events (baseline; stroking; perceptual embodiment; stimuli approaching rubber hand; stimuli touching rubber hand; p<0.001) but not for Condition (needle versus brush p=0.964) or experimental Event×Condition interaction (p=0.160). Ten of the 20 participants (50%) reported that they experienced a sensation arising from the rubber hand when the rubber hand was approached and touched by either the needle and/or brush but these sensations lacked precision in location, timing, and nature.

CONCLUSION AND IMPLICATIONS

Our preliminary findings suggest that the increase in arousal in response to stimuli entering the peripersonal space may not be selective for threat. There was tentative evidence that more intense sensations were experienced when a perceptually embodied rubber hand was approached by a threatening stimulus. Our findings provide initial insights and should serve as a catalyst for further research.

The virtual hand illusion is moderated by context-induced spatial reference frames

The tendency to perceive an artificial effector as part of one’s own body is known to depend on temporal criteria, like the synchrony between stimulus events informing about the effector. The role of spatial factors is less well understood. Rather than physical distance, which has been manipulated in previous studies, we investigated the role of relative, context-induced distance between the participant’s real hand and an artificial hand stimulated synchronously or asynchronously with the real hand. We replicated previously reported distance effects in a virtual reality setup: the perception of ownership increased with decreased distance, and the impact of synchrony was stronger for short distances. More importantly, we found that ownership perception and impact of synchrony were affected by previous distance: the same, medium distance between real and artificial hand induced more pronounced ownership after having experienced a far-distance condition than after a near-distance condition. This suggests that subjective, context-induced spatial reference frames contribute to ownership perception, which does not seem to fit with the idea of fixed spatial criteria and/or permanent body representations as the sole determinants of perceived body ownership.

Body ownership and response to threat

A virtual-reality setup was used to investigate the relationship between perceived body ownership and subjective anxiety, as assessed by an anxiety inventory (SA-I). A pilot study confirmed that synchrony between the participant’s real hand movements and the movements of a virtual effector induced perceived ownership illusions. The illusions were comparable for virtual human hands and virtual cat claws, even though the overall acceptance was greater for human hands. In Experiment 1, participants used the virtual effector to collect coins and avoid knives descending on a screen before anxiety was measured. The level of anxiety increased with synchrony and was higher for human hands than for cat claws, but these two effects were independent. Experiment 2 separated effects of coin catching and knife avoiding by means of a between-participant design. The outcome of Experiment 1 was replicated in the knife-avoiding task but not in the coin-catching task, in which anxiety levels were low and not systematically affected by the type of virtual effector. Taken altogether, our findings suggest that subjective anxiety and ownership are strongly related.