The sense of body ownership relaxes temporal constraints for multisensory integration

Contextual consistency promotes visual-haptic simultaneity perception

In this study, we investigate the influence of causality validity in the information provided to each of two sensory modalities on the integration of multisensory information. For the purpose, stimuli that simulated a causal event, a ball striking an object, were created using a head-mounted display and a haptic device. The visual position and motion of the object were aligned to the haptic feedback received by the observer. The haptic device delivered a vibration around the moment of impact. Three vibration directions were used to assess the effect of the validity of the causal relationship between the two events. Participants were asked to determine whether the collision of the ball and the vibration were simultaneous. The findings revealed that the participants were more likely to perceive the events as simultaneous when the direction of the vibration matched the ball's movement. These results suggest that valid causal consistency across different modalities enhances the binding of these signals as originating from a single source.

Experiencing an Elongated Limb in Virtual Reality Modifies the Tactile Distance Perception of the Corresponding Real Limb

In measurement, a reference frame is needed to compare the measured object to something already known. This raises the neuroscientific question of which reference frame is used by humans when exploring the environment. Previous studies suggested that, in touch, the body employed as measuring tool also serves as reference frame. Indeed, an artificial modification of the perceived dimensions of the body changes the tactile perception of external object dimensions. However, it is unknown if such a change in tactile perception would occur when the body schema is modified through the illusion of owning a limb altered in size. Therefore, employing a virtual hand illusion paradigm with an elongated forearm of different lengths, we systematically tested the subjective perception of distance between two points [tactile distance perception (TDP) task] on the corresponding real forearm following the illusion. Thus, the TDP task is used as a proxy to gauge changes in the body schema. Embodiment of the virtual arm was found significantly greater after the synchronous visuotactile stimulation condition compared with the asynchronous one, and the forearm elongation significantly increased the TDP. However, we did not find any link between the visuotactile-induced ownership over the elongated arm and TDP variation, suggesting that vision plays the main role in the modification of the body schema. Additionally, significant effect of elongation found on TDP but not on proprioception suggests that these are affected differently by body schema modifications. These findings confirm the body schema malleability and its role as a reference frame in touch.

Quantifying body ownership information processing and perceptual bias in the rubber hand illusion

Bodily illusions have fascinated humankind for centuries, and researchers have studied them to learn about the perceptual and neural processes that underpin multisensory channels of bodily awareness. The influential rubber hand illusion (RHI) has been used to study changes in the sense of body ownership - that is, how a limb is perceived to belong to one's body, which is a fundamental building block in many theories of bodily awareness, self-consciousness, embodiment, and self-representation. However, the methods used to quantify perceptual changes in bodily illusions, including the RHI, have mainly relied on subjective questionnaires and rating scales, and the degree to which such illusory sensations depend on sensory information processing has been difficult to test directly. Here, we introduce a signal detection theory (SDT) framework to study the sense of body ownership in the RHI. We provide evidence that the illusion is associated with changes in body ownership sensitivity that depend on the information carried in the degree of asynchrony of correlated visual and tactile signals, as well as with perceptual bias and sensitivity that reflect the distance between the rubber hand and the participant's body. We found that the illusion's sensitivity to asynchrony is remarkably precise; even a 50 ms visuotactile delay significantly affected body ownership information processing. Our findings conclusively link changes in a complex bodily experience such as body ownership to basic sensory information processing and provide a proof of concept that SDT can be used to study bodily illusions.

Is this my foot? Experimentally induced disownership in individuals with body integrity dysphoria

In body integrity dysphoria (BID), otherwise healthy individuals feel like a part of their physical body does not belong to them despite normal sensorimotor functioning. Theoretical and empirical evidence suggested aweakened integration of the affected body part into higher-order multisensory cortical body networks. Here, we used a multisensory stimulation paradigm in mixed reality to modulate and investigate multisensory processing underlying body (dis)ownership in individuals with BID of the lower limb. In 20 participants with BID, delay perception and body ownership were measured after introducing delays between the visual and tactile information of viewed stroking applied to affected and unaffected body parts. Unlike predicted, delay perception did not differ between the two body parts. However, specifically for the affected limb, ownership was lower and more strongly modulated by delay. These findings might be following the idea of a stronger dependency on online bottom up sensory signals in BID.

Active inference unifies intentional and conflict-resolution imperatives of motor control

The field of motor control has long focused on the achievement of external goals through action (e.g., reaching and grasping objects). However, recent studies in conditions of multisensory conflict, such as when a subject experiences the rubber hand illusion or embodies an avatar in virtual reality, reveal the presence of unconscious movements that are not goal-directed, but rather aim at resolving multisensory conflicts; for example, by aligning the position of a person’s arm with that of an embodied avatar. This second, conflict-resolution imperative of movement control did not emerge in classical studies of motor adaptation and online corrections, which did not allow movements to reduce the conflicts; and has been largely ignored so far in formal theories. Here, we propose a model of movement control grounded in the theory of active inference that integrates intentional and conflict-resolution imperatives. We present three simulations showing that the active inference model is able to characterize movements guided by the intention to achieve an external goal, by the necessity to resolve multisensory conflict, or both. Furthermore, our simulations reveal a fundamental difference between the (active) inference underlying intentional and conflict-resolution imperatives by showing that it is driven by two different (model and sensory) kinds of prediction errors. Finally, our simulations show that when movement is only guided by conflict resolution, the model incorrectly infers that is velocity is zero, as if it was not moving. This result suggests a novel speculative explanation for the fact that people are unaware of their subtle compensatory movements to avoid multisensory conflict. Furthermore, it can potentially help shed light on deficits of motor awareness that arise in psychopathological conditions.

Neuroendocrine Response and State Anxiety Due to Psychosocial Stress Decrease after a Training with Subject's Own (but Not Another) Virtual Body: An RCT Study

Previous research involving healthy participants has reported that seeing a moving virtual body from the first person perspective induces the illusion of ownership and agency over that virtual body. When a person is sitting and the virtual body runs, it is possible to measure physiological, behavioral and cognitive reactions that are comparable to those that occur during actual movement. Capitalizing on this evidence, we hypothesized that virtual training could also induce neuroendocrine effects that prompt a decreased psychosocial stress response, as occurs after physical training. While sitting, 26 healthy young adults watched a virtual avatar running for 30 min from the first person perspective (experimental group), while another 26 participants watched the virtual body from the third person perspective (control group). We found a decreased salivary alpha-amylase concentration (a biomarker for the stress response) after the virtual training among the experimental group only, as well as a decreased subjective feeling of state anxiety (but no difference in heart rate). We argue that the virtual illusion of a moving body from the first person perspective can initiate a cascade of events, from the perception of the visual illusion to physiological activation that triggers other biological effects, such as the neuroendocrine stress response.

Influence of hand-arm self-avatar motion delay on the directional perception induced by an illusory sensation of being twisted

Sensory information from movements of body parts can alter their position when exposed to external physical stimuli. Visual information monitors the position and movement of body parts from an exterior perspective, whereas somatosensory information monitors them from an internal viewpoint. However, how such sensory data are integrated is unclear. In this study, a virtual reality (VR) system was used to evaluate the influence of the temporal difference between visual and somatosensory information from hand movements on the directional perception of a torque while modifying the visual appearance (human hand vs. non-human object) and visuohaptic congruency (congruent vs. incongruent) of self-avatars. Visual information was provided by the movement of the self-avatars in a VR environment, while somatosensory information was provided by vibrations with asymmetrical amplitudes that gave the participants the sensation of being continuously pushed or pulled without actually moving any body part. Delaying the movement of the avatar by 50 ms resulted in the sensitivity of the force direction perception to be lower with human hands than with non-human avatars, whereas a delay of 200 ms resulted in a higher sensitivity. This study can contribute to applications requiring multisensory integration in a VR environment.

Enhanced processing of aversive stimuli on embodied artificial limbs by the human amygdala

Body perception has been extensively investigated, with one particular focus being the integration of vision and touch within a neuronal body representation. Previous studies have implicated a distributed network comprising the extrastriate body area (EBA), posterior parietal cortex (PPC) and ventral premotor cortex (PMv) during illusory self-attribution of a rubber hand. Here, we set up an fMRI paradigm in virtual reality (VR) to study whether and how the self-attribution of (artificial) body parts is altered if these body parts are somehow threatened. Participants (N = 30) saw a spider (aversive stimulus) or a toy-car (neutral stimulus) moving along a 3D-rendered virtual forearm positioned like their real forearm, while tactile stimulation was applied on the real arm in the same (congruent) or opposite (incongruent) direction. We found that the PPC was more activated during congruent stimulation; higher visual areas and the anterior insula (aIns) showed increased activation during aversive stimulus presentation; and the amygdala was more strongly activated for aversive stimuli when there was stronger multisensory integration of body-related information (interaction of aversiveness and congruency). Together, these findings suggest an enhanced processing of aversive stimuli within the amygdala when they represent a bodily threat.

The illusion of having a large virtual body biases action-specific perception in patients with mild cognitive impairment

The illusion of having a large body makes us perceive objects as smaller than they really are. This action-specific perception effect occurs because we perceive the property of an object (i.e., size) differently according to our unique action capability (i.e., the affordance of body size). Although the body-ownership illusion contributing to this action-specific perception has been studied, its effects remain unclear in neurological patients. We examined the action-specific perception impairments of MCI patients by means of body-ownership illusion in a non-immersive virtual reality environment. Twenty healthy young adults, 21 healthy older adults, and 15 MCI patients were recruited. We assessed their “original-body action-specific perception” and “enlarged-body action-specific perception” using the original and enlarged sizes of their virtual bodies, respectively. The MCI patients’ original-body action-specific perception was no different than that of the healthy controls (p = 0.679). However, the enlarged-body action-specific perception of the MCI patients was significantly biased (p < 0.001). The inclusion of the enlarged-body action-specific perception provides additional discriminative power for early diagnosis of MCI (89.3% accuracy, 75.0% sensitivity, 100.0% specificity, and 87.5% balanced accuracy).

Virtual Hand Illusion in younger and older adults

Introduction

Embodiment involves experiencing ownership over our body and localizing it in space and is informed by multiple senses (visual, proprioceptive and tactile). Evidence suggests that embodiment and multisensory integration may change with older age. The Virtual Hand Illusion (VHI) has been used to investigate multisensory contributions to embodiment, but has never been evaluated in older adults. Spatio-temporal factors unique to virtual environments may differentially affect the embodied perceptions of older and younger adults.

Methods

Twenty-one younger (18–35 years) and 19 older (65+ years) adults completed the VHI paradigm. Body localization was measured at baseline and again, with subjective ownership ratings, following synchronous and asynchronous visual-tactile interactions.

Results

Higher ownership ratings were observed in the synchronous relative to the asynchronous condition, but no effects on localization/drift were found. No age differences were observed. Localization accuracy was biased in both age groups when the virtual hand was aligned with the real hand, indicating a visual mislocalization of the virtual hand.

Conclusions

No age-related differences in the VHI were observed. Mislocalization of the hand in VR occurred for both groups, even when congruent and aligned; however, tactile feedback reduced localization biases. Our results expand the current understanding of age-related changes in multisensory embodiment within virtual environments.

Active strategies for multisensory conflict suppression in the virtual hand illusion

The perception of our body in space is flexible and manipulable. The predictive brain hypothesis explains this malleability as a consequence of the interplay between incoming sensory information and our body expectations. However, given the interaction between perception and action, we might also expect that actions would arise due to prediction errors, especially in conflicting situations. Here we describe a computational model, based on the free-energy principle, that forecasts involuntary movements in sensorimotor conflicts. We experimentally confirm those predictions in humans using a virtual reality rubber-hand illusion. Participants generated movements (forces) towards the virtual hand, regardless of its location with respect to the real arm, with little to no forces produced when the virtual hand overlaid their physical hand. The congruency of our model predictions and human observations indicates that the brain-body is generating actions to reduce the prediction error between the expected arm location and the new visual arm. This observed unconscious mechanism is an empirical validation of the perception-action duality in body adaptation to uncertain situations and evidence of the active component of predictive processing.

Multisensory Integration as per Technological Advances: A Review

Multisensory integration research has allowed us to better understand how humans integrate sensory information to produce a unitary experience of the external world. However, this field is often challenged by the limited ability to deliver and control sensory stimuli, especially when going beyond audio-visual events and outside laboratory settings. In this review, we examine the scope and challenges of new technology in the study of multisensory integration in a world that is increasingly characterized as a fusion of physical and digital/virtual events. We discuss multisensory integration research through the lens of novel multisensory technologies and, thus, bring research in human-computer interaction, experimental psychology, and neuroscience closer together. Today, for instance, displays have become volumetric so that visual content is no longer limited to 2D screens, new haptic devices enable tactile stimulation without physical contact, olfactory interfaces provide users with smells precisely synchronized with events in virtual environments, and novel gustatory interfaces enable taste perception through levitating stimuli. These technological advances offer new ways to control and deliver sensory stimulation for multisensory integration research beyond traditional laboratory settings and open up new experimentations in naturally occurring events in everyday life experiences. Our review then summarizes these multisensory technologies and discusses initial insights to introduce a bridge between the disciplines in order to advance the study of multisensory integration.

Repeated Exposure to Illusory Sense of Body Ownership and Agency Over a Moving Virtual Body Improves Executive Functioning and Increases Prefrontal Cortex Activity in the Elderly

We previously showed that the illusory sense of ownership and agency over a moving body in immersive virtual reality (displayed in a first-person perspective) can trigger subjective and physiological reactions on the real subject’s body and, therefore, an acute improvement of cognitive functions after a single session of high-intensity intermittent exercise performed exclusively by one’s own virtual body, similar to what happens when we actually do physical activity. As well as confirming previous results, here, we aimed at finding in the elderly an increased improvement after a longer virtual training with similar characteristics. Forty-two healthy older subjects (28 females, average age = 71.71 years) completed a parallel-group randomized controlled trial (RCT; UMIN000039843, umin.ac.jp) including an adapted version of the virtual training previously used: while sitting, participants observed the virtual body in a first-person perspective (1PP) or a third-person perspective (3PP) performing 20 min of virtual high-intensity intermittent exercise (vHIE; the avatar switched between fast and slow walking every 2 min). This was repeated twice a week for 6 weeks. During the vHIE, we measured the heart rate and administered questionnaires to evaluate illusory body ownership and agency. Before the beginning of the intervention, immediately after the first session of vHIE, and at the end of the entire intervention, we evaluated the cognitive performance at the Stroop task with online recording of the hemodynamic activity over the left dorsolateral prefrontal cortex. While we confirm previous results regarding the virtual illusion and its physiological effects, we did not find significant cognitive or neural improvement immediately after the first vHIE session. As a novelty, in the 1PP group only, we detected a significant decrease in the response time of the Stroop task in the post-intervention assessment compared to its baseline; coherently, we found an increased activation on left dorsolateral prefrontal cortex (lDLPFC) after the entire intervention. While the current results strengthen the impact of the virtual full-body illusion and its physiological consequences on the elderly as well, they might have stronger and more established body representations. Perhaps, a longer and increased exposure to those illusions is necessary to initiate the cascade of events that culminates to an improved cognitive performance.

Staying in touch with our bodies: Stronger sense of ownership during self- compared to other touch despite temporal mismatches

Self-touch is considered important for bodily self-consciousness and self-other distinction and has been reported to improve clinical symptoms of disembodiment. To investigate the link between self-touch and disembodiment in healthy participants, we studied the effect of self-touch versus touch produced by another person (other-touch) on experimentally induced disembodiment. In a mixed reality paradigm, across two experiments, participants could see their own body and surroundings with a controllable visual delay and either stroked their own hand with a paintbrush or were stroked with it by the experimenter. Experiment 1 first assessed the sensitivity to temporal multimodal mismatches and delay-induced changes in the sense of body ownership in three conditions, namely self-touch, other-touch and hidden-self-touch (visually occluding the touching hand). In a second block, we compared phenomenological and physiological (threat response) measures of disembodiment between the self-touch and other-touch conditions. Experiment 2 roughly replicated the first block of Experiment 1 but included a condition in which participants performed the self-touch gesture without touching their hand. Such experiment attempted to control for the potential role of efferent signals. Our results show that increasing visual delay generally enhances the feeling of disembodiment, yet the decrease of body ownership is less pronounced during self-touch. For sensitivity to delay between conditions, however, diverging findings are discussed. This study provides evidence for the importance of self-touch in sustaining a healthy sense of body in the context of disembodiment.

Integration of predictions and afferent signals in body ownership

We aimed at investigating the contribution of sensory predictions triggered by the sight of an object moving towards the body for the sense of body ownership. We used a recently developed psychophysical discrimination task to assess body ownership in the rubber hand illusion. In this task, the participants had to choose which of the two right rubber hands in view felt most like their own, and the ownership discriminations were fitted to psychometric curves. In the current study, we occluded the visual impressions of the object moving towards one of the rubber hands (during the first two-thirds of the path) and only revealed the final third of the object's movement trajectory when it touched the rubber hand (approach-occluded condition). Alternatively, we occluded only the final part so that the main part of the movement towards the model hand was visible (touch-occluded). We compared these two conditions to an illusion baseline condition where the object was visible during the entire trajectory and contact (no-occlusion). The touch-occluded condition produced equally strong hand ownership as the baseline condition with no occlusion, while ownership perception was significantly reduced when vision of the object approaching the rubber hand was occluded (approach-occluded). Our results show that tactile predictions generated from seeing an object moving towards the body are temporally exact, and they contribute to the rubber hand illusion by integrating with temporally congruent afferent sensory signals. This finding highlights the importance of multisensory predictions in peripersonal space, object permanence, and the interplay between bottom-up sensory signals and top-down predictions in body ownership.

Owning a virtual body entails owning the value of its actions in a detection-of-deception procedure

The feeling of owning one's body underlies human self-awareness. Body-ownership illusions allow temporarily modulating body ownership, which has observable effects on the behavior and cognitive processes. However, the extent of those effects is unclear. Here, we investigated whether illusory ownership of a virtual body extended to ownership of the value/meaning of its actions. A variation of detection-of-deception procedure (Concealed Information Test) was performed by an embodied virtual avatar (first-person perspective, 1PP), or a non-embodied one (third-person perspective, 3PP), while the skin conductance responses (SCRs) were recorded from passively observing participants. Target stimuli (i.e., concealed information) evoked significantly larger SCRs than the neutral ones only when the avatar was embodied (in 1PP). Such pattern of SCR differences corresponds to that observed when participants perform the task themselves, thus suggesting that the sole experience of owning a virtual body can trigger physiological responses related to the subjective significance of the body's actions.

Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion

Virtual reality (VR) enables the fast, free, and highly controllable setting of experimental body images. Illusions pertaining to a body, such as the rubber hand illusion (RHI), can be easily conducted in VR settings, and some phenomena, such as full-body illusions, are only realized in virtual environments. However, the multisensory-integration process in VR is not yet fully understood. Thus, it remains to be clarified if specific phenomena that occur under VR settings manifest in real life as well. One useful investigative approach is measuring brain activities during a psychological experiment. Electroencephalography (EEG) oscillatory activities provide insight into the human multisensory integration process. Nevertheless, EEG data can be vulnerable to VR noise, which causes measurement and analytical difficulties for EEG data recorded in VR environments. Here, we achieve an experimental RHI setting using a head-mounted display that provides a VR visual space and VR dummy hand along with EEG measurements. We compared EEG data collected in both real and VR environments and observed the gamma and theta band oscillatory activities. Ultimately, we observed statistically significant differences between congruent (RHI) and incongruent (not RHI) conditions in the real environment, which is consistent with previous studies. Differences in the VR condition were observed only on the late theta band oscillation, suggesting that the VR setting itself altered the perceptual and sensory integration mechanisms. Thus, we must model this difference between real and VR settings whenever we use VR to investigate our bodily self-perception.

Virtual Body Ownership Illusions for Mental Health: A Narrative Review

Over the last 20 years, virtual reality (VR) has been widely used to promote mental health in populations presenting different clinical conditions. Mental health does not refer only to the absence of psychiatric disorders but to the absence of a wide range of clinical conditions that influence people’s general and social well-being such as chronic pain, neurological disorders that lead to motor o perceptual impairments, psychological disorders that alter behaviour and social cognition, or physical conditions like eating disorders or present in amputees. It is known that an accurate perception of oneself and of the surrounding environment are both key elements to enjoy mental health and well-being, and that both can be distorted in patients suffering from the clinical conditions mentioned above. In the past few years, multiple studies have shown the effectiveness of VR to modulate such perceptual distortions of oneself and of the surrounding environment through virtual body ownership illusions. This narrative review aims to review clinical studies that have explored the manipulation of embodied virtual bodies in VR for improving mental health, and to discuss the current state of the art and the challenges for future research in the context of clinical care.

Virtual training leads to physical, cognitive and neural benefits in healthy adults

Physical activity, such as high-intensity intermittent aerobic exercise (HIE), can improve executive functions. Although performing strength or aerobic training might be problematic or not feasible for someone. An experimental situation where there is no actual movement, but the body shows physiological reactions, is during the illusion through immersive virtual reality (IVR). We aimed to demonstrate whether a virtual HIE-based intervention (vHIE) performed exclusively by the own virtual body has physical, cognitive, and neural benefits on the real body. 45 healthy young adults (cross-over design) experienced HIE training in IVR (i.e., the virtual body performed eight sets of 30 s of running followed by 30 s of slow walking, while the subject is completely still) in two random-ordered conditions (administered in two sessions one week apart): the virtual body is displayed in first-person perspective (1PP) or third-person perspective (3PP). During the vHIE, we recorded the heart rate and subjective questionnaires to confirm the effectiveness of the illusion; before and after vHIE, we measured cortical hemodynamic changes in the participants' left dorsolateral prefrontal cortex (lDLPFC) using the fNIRS device during the Stroop task to test our main hypothesis. Preliminary, we confirmed that the illusion was effective: during the vHIE in 1PP, subjects' heart rate increased coherently with the virtual movements, and they reported subjective feelings of ownership and agency. Primarily, subjects were faster in executing the Stroop task after the vHIE in 1PP; also, the lDLPFC activity increased coherently. Clinically, these results might be exploited to train cognition and body simultaneously. Theoretically, we proved that the sense of body ownership and agency can affect other parameters, even in the absence of actual movements.

Toward Enhanced Teleoperation Through Embodiment

Telerobotics aims to transfer human manipulation skills and dexterity over an arbitrary distance and at an arbitrary scale to a remote workplace. A telerobotic system that is transparent enables a natural and intuitive interaction. We postulate that embodiment (with three sub-components: sense of ownership, agency, and self-location) of the robotic system leads to optimal perceptual transparency and increases task performance. However, this has not yet been investigated directly. We reason along four premises and present findings from the literature that substantiate each of them: (1) the brain can embody non-bodily objects (e.g., robotic hands), (2) embodiment can be elicited with mediated sensorimotor interaction, (3) embodiment is robust against inconsistencies between the robotic system and the operator's body, and (4) embodiment positively correlates to dexterous task performance. We use the predictive encoding theory as a framework to interpret and discuss the results reported in the literature. Numerous previous studies have shown that it is possible to induce embodiment over a wide range of virtual and real extracorporeal objects (including artificial limbs, avatars, and android robots) through mediated sensorimotor interaction. Also, embodiment can occur for non-human morphologies including for elongated arms and a tail. In accordance with the predictive encoding theory, none of the sensory modalities is critical in establishing ownership, and discrepancies in multisensory signals do not necessarily lead to loss of embodiment. However, large discrepancies in terms of multisensory synchrony or visual likeness can prohibit embodiment from occurring. The literature provides less extensive support for the link between embodiment and (dexterous) task performance. However, data gathered with prosthetic hands do indicate a positive correlation. We conclude that all four premises are supported by direct or indirect evidence in the literature, suggesting that embodiment of a remote manipulator may improve dexterous performance in telerobotics. This warrants further implementation testing of embodiment in telerobotics. We formulate a first set of guidelines to apply embodiment in telerobotics and identify some important research topics.

Effects of Human Synchronous Hand Movements in Eliciting a Sense of Agency and Ownership

The self is built as an entity independent from the external world using the human ability to experience the senses of agency and ownership. Humans usually experience these senses during movement. Nevertheless, researchers recently reported that another person’s synchronous mirror-symmetrical movements elicited both agency and ownership in research participants. However, it is unclear whether this elicitation was caused by the synchronicity or the mirror symmetry of the movements. To address this question, we investigated the effect of interpersonal synchronization on the self-reported sense of agency and ownership in two conditions, using movements with and without mirror symmetry. Participants performed rhythmic hand movements while viewing the experimenter’s synchronous or random hand movements, and then reported their perceptions of agency and ownership in a questionnaire. We observed that agency and ownership were significantly elicited by the experimenter’s synchronous hand movements in both conditions. The results suggested that the synchronous movements of another person—rather than mirror- or non-mirror-symmetrical movements—appear to elicit the experience of a sense of agency and ownership. The results also suggested that people could experience these senses not only from their own movements but also from another person’s synchronous movements.

Visual body form and orientation cues do not modulate visuo-tactile temporal integration

Body ownership relies on spatiotemporal correlations between multisensory signals and visual cues specifying oneself such as body form and orientation. The mechanism for the integration of bodily signals remains unclear. One approach to model multisensory integration that has been influential in the multisensory literature is Bayesian causal inference. This specifies that the brain integrates spatial and temporal signals coming from different modalities when it infers a common cause for inputs. As an example, the rubber hand illusion shows that visual form and orientation cues can promote the inference of a common cause (one's body) leading to spatial integration shown by a proprioceptive drift of the perceived location of the real hand towards the rubber hand. Recent studies investigating the effect of visual cues on temporal integration, however, have led to conflicting findings. These could be due to task differences, variation in ecological validity of stimuli and/or small samples. In this pre-registered study, we investigated the influence of visual information on temporal integration using a visuo-tactile temporal order judgement task with realistic stimuli and a sufficiently large sample determined by Bayesian analysis. Participants viewed videos of a touch being applied to plausible or implausible visual stimuli for one's hand (hand oriented plausibly, hand rotated 180 degrees, or a sponge) while also being touched at varying stimulus onset asynchronies. Participants judged which stimulus came first: viewed or felt touch. Results show that visual cues do not modulate visuo-tactile temporal order judgements. This is not in line with the idea that bodily signals indicating oneself influence the integration of multisensory signals in the temporal domain. The current study emphasises the importance of rigour in our methodologies and analyses to advance the understanding of how properties of multisensory events affect the encoding of temporal information in the brain.

The Effect of a Virtual-Reality Full-Body Illusion on Body Representation in Obesity

Background. The effective illusory ownership over an artificial body in modulating body representations in healthy and eating disorders population has been repeatedly reported in recent literature. In this study, we extended this research in the field of obesity: specifically, we investigated whether ownership over a virtual body with a skinny abdomen might be successfully experienced by participants affected by obesity. Methods. Fifteen participants with obesity and fifteen healthy-weight participants took part at this study in which the VR-Full-Body Illusion was adopted. The strength of illusion was investigated through the traditional Embodiment Questionnaire, while changes in bodily experience were measured through a body size estimation task. Results. Participants with obesity as well as healthy-weight participants reported to experience the illusion. About the body size estimation task, both groups reported changes only in the estimation of the abdomen’s circumference after the experimental condition, in absence of any another difference. Discussion. Participants with obesity reported to experience the illusion over a skinny avatar, but the modulation of the bodily experience seems controversial. Future lines of research exploiting this technique for modulating body representations in obesity, specifically in terms of potential therapeutic use, were discussed.

Avatar Embodiment Enhances Haptic Confidence on the Out-of-Body Touch Illusion

In the real world, our bodies influence how we perceive ourselves and how others perceive us. Our body can also affect estimations of object sizes and distances. But how does our body affect our haptic experience? Here, we examined the modulation of a visuo-haptic illusion of touch on a virtual stick in virtual reality, when participants were embodied in an avatar and when they were not. During the experiments participants (n = 49) received successions of three taps delivered from two independent controllers while they saw visual stimuli presented sequentially along the virtual stick. The stimulation pattern resulted in a robust illusion of tapping directly on the virtual stick. After each trial, participants were asked to report where they perceived the taps. We found that participants in both the body and no-body conditions displaced the second tap toward the center of the stick, and reported similar levels of certainty about their reported location. However, the illusion of touch on the stick, as measured by the reported location of the tap, was significantly stronger for those who had a virtual body than those who did not. Therefore, our study shows that avatar embodiment can change haptic perception.

Avatar Embodiment. Towards a Standardized Questionnaire

Inside virtual reality, users can embody avatars that are collocated from a first-person perspective. When doing so, participants have the feeling that the own body has been substituted by the self-avatar, and that the new body is the source of the sensations. Embodiment is complex as it includes not only body ownership over the avatar, but also agency, co-location, and external appearance. Despite the multiple variables that influence it, the illusion is quite robust, and it can be produced even if the self-avatar is of a different age, size, gender, or race from the participant's own body. Embodiment illusions are therefore the basis for many social VR experiences and a current active research area among the community. Researchers are interested both in the body manipulations that can be accepted, as well as studying how different self-avatars produce different attitudinal, social, perceptual, and behavioral effects. However, findings suggest that despite embodiment being strongly associated with the performance and reactions inside virtual reality, the extent to which the illusion is experienced varies between participants. In this paper, we review the questionnaires used in past experiments and propose a standardized embodiment questionnaire based on 25 questions that are prevalent in the literature. We encourage future virtual reality experiments that include first-person virtual avatars to administer this questionnaire in order to evaluate the degree of embodiment.

The Rubber Hand Illusion in Healthy Younger and Older Adults

Percepts about our body's position in space and about body ownership are informed by multisensory feedback from visual, proprioceptive, and tactile inputs. The Rubber Hand Illusion (RHI) is a multisensory illusion that is induced when an observer sees a rubber hand being stroked while they feel their own, spatially displaced, and obstructed hand being stroked. When temporally synchronous, the visual-tactile interactions can create the illusion that the rubber hand belongs to the observer and that the observer's real hand is shifted in position towards the rubber hand. Importantly, little is understood about whether these multisensory perceptions of the body change with older age. Thus, in this study we implemented a classic RHI protocol (synchronous versus asynchronous stroking) with healthy younger (18-35) and older (65+) adults and measured the magnitude of proprioceptive drift and the subjective experience of body ownership. As an adjunctive objective measure, skin temperature was recorded to evaluate whether decreases in skin temperature were associated with illusory percepts, as has been shown previously. The RHI was observed for both age groups with respect to increased drift and higher ratings of ownership following synchronous compared to asynchronous stroking. Importantly, no effects of age and no interactions between age and condition were observed for either of these outcome measures. No effects were observed for skin temperature. Overall, these results contribute to an emerging field of research investigating the conditions under which age-related differences in multisensory integration are observed by providing insights into the role of visual, proprioceptive, and tactile inputs on bodily percepts.

Embodiment in a virtual body that speaks produces agency over the speaking but does not necessarily influence subsequent real speaking

Previous results have shown that body ownership, induced through first-person perspective (1PP) over a virtual body (VB) that moves synchronously with real body movements, can lead to illusory agency over VB utterances even though the participant does not speak. It was also found that when participants later speak they follow the fundamental frequency (FF) of the voice of their VB, indicating a new motor plan for speaking. To eliminate the contribution of veridical agency over the VB movements, we conducted a study where we induced body ownership using visuotactile (VT) synchrony rather than visuomotor. Participants saw a life-sized VB from 1PP and reflected in a virtual mirror, that spoke with corresponding lip movements. Half of the 36 experimental participants experienced synchronous (Sync) passive VT on their hands and abdomen, and the other half asynchronous (Async). We found that both VT Sync and Async conditions resulted in a strong subjective illusion of body ownership and agency over the VB, but not, however, changes in voice FF in subsequent speaking. This shows that although illusory agency may be associated with body ownership, a change in motor plan is likely to be a generalisation from veridical agency over whole body movements.

The neuroscience of body memory: From the self through the space to the others

Our experience of the body is not direct; rather, it is mediated by perceptual information, influenced by internal information, and recalibrated through stored implicit and explicit body representation (body memory). This paper presents an overview of the current investigations related to body memory by bringing together recent studies from neuropsychology, neuroscience, and evolutionary and cognitive psychology. To do so, in the paper, I explore the origin of representations of human body to elucidate their developmental process and, in particular, their relationship with more explicit concepts of self. First, it is suggested that our bodily experience is constructed from early development through the continuous integration of sensory and cultural data from six different representations of the body, i.e., the Sentient Body (Minimal Selfhood), the Spatial Body (Self Location), the Active Body (Agency), the Personal Body (Whole Body Ownership - Me); the Objectified Body (Objectified Self - Mine), and the Social Body (Body Satisfaction - Ideal Me). Then, it is suggested that these six representations can be combined in a coherent supramodal representation, i.e. the "body matrix", through a predictive, multisensory processing activated by central, top-down, attentional processes. From an evolutionary perspective, the main goal of the body matrix is to allow the self to protect and extend its boundaries at both the homeostatic and psychological levels. From one perspective, the self extends its boundaries (peripersonal space) through the enactment and recognition of motor schemas. From another perspective, the body matrix, by defining the boundaries of the body, also defines where the self is present, i.e., in the body that is processed by the body matrix as the most likely to be its one, and in the space surrounding it. In the paper I also introduce and discuss the concept of "embodied medicine": the use of advanced technology for altering the body matrix with the goal of improving our health and well-being.

Concurrent talking in immersive virtual reality: on the dominance of visual speech cues

Humans are good at selectively listening to specific target conversations, even in the presence of multiple concurrent speakers. In our research, we study how auditory-visual cues modulate this selective listening. We do so by using immersive Virtual Reality technologies with spatialized audio. Exposing 32 participants to an Information Masking Task with concurrent speakers, we find significantly more errors in the decision-making processes triggered by asynchronous audiovisual speech cues. More precisely, the results show that lips on the Target speaker matched to a secondary (Mask) speaker’s audio severely increase the participants’ comprehension error rates. In a control experiment (n = 20), we further explore the influences of the visual modality over auditory selective attention. The results show a dominance of visual-speech cues, which effectively turn the Mask into the Target and vice-versa. These results reveal a disruption of selective attention that is triggered by bottom-up multisensory integration. The findings are framed in the sensory perception and cognitive neuroscience theories. The VR setup is validated by replicating previous results in this literature in a supplementary experiment.