Development of the bodily self: Effects of visuomotor synchrony and visual appearance on virtual embodiment in children and adults

Maternal Interaction Relates to Neural Processing of Self-Related Multisensory Information in 5-Month-Olds

The ontogenetic origin of the self in infancy is a topic of ongoing debate. Although influential developmental and neurocognitive theories propose that caregiver-infant interactions play an important role in infants' self-development, little is known about the specific mechanisms involved. Some theories highlight the importance of caregiver sensitivity and touch, while others propose that caregiver contingency plays a central role. The study aimed to investigate infants' self-perception by measuring brain activation in the posterior superior temporal sulcus (pSTS), a region previously associated with self-related processing. A total of 118 mother-infant dyads participated in a free-play interaction, during which maternal sensitivity and touch were measured. Additionally, a face-to-face interaction was conducted to measure maternal contingency. Infants' brain activation was measured using functional near-infrared spectroscopy (fNIRS). They watched a video of their own face while being stroked by a brush on the cheek. The video was either live and the stroking was synchronous to the video (contingent) or the video was delayed by 3 s, which made the stroking asynchronous (non-contingent). The results showed that infants exhibited more HbO-activation in the right pSTS in the non-contingent condition. Importantly, the more sensitive the mothers were and the more they touched infants during free play, the less differential activation the infants showed in response to both conditions. This effect was driven by infants showing less activation to the non-contingent condition when their mothers exhibited more care, maybe because of a smaller prediction error for non-contingent self-related multisensory information. Overall, the study deepens our knowledge of how early social interactions relate to the emergence of the self in infancy.

The role of visuomotor synchrony on virtual full-body illusions in children and adults

The present study explored the effects of visuomotor synchrony in virtual reality during the embodiment of a full human avatar in children (aged 5-6 years) and adults. Participants viewed their virtual bodies from a first-person perspective while they moved the body during self-generated and structured movement. Embodiment was measured via questions and psychophysiological responses (skin conductance) to a virtual body-threat and during both movement conditions. Both children and adults had increased feelings of ownership and agency over a virtual body during synchronous visuomotor feedback (compared to asynchronous visuomotor feedback). Children had greater ownership compared to adults during synchronous movement but did not differ from adults on agency. There were no differences in SCRs (frequency or magnitude) between children and adults, between conditions (i.e., baseline or movement conditions) or visuomotor feedback. Collectively, the study highlights the importance of visuomotor synchrony for children's ratings of embodiment for a virtual avatar from at least 5 years old, and suggests adults and children are comparable in terms of psychophysiological arousal when moving (or receiving a threat to) a virtual body. This has important implications for our understanding of the development of embodied cognition and highlights the considerable promise of exploring visuomotor VR experiences in children.

Malleability of the sense of bodily self in early childhood: 5- and 6-year-old children show the enfacement illusion

The mechanisms underlying the developing sense of bodily self are debated. Whereas some scholars stress the role of sensory factors, others propose the importance of contextual factors. By manipulating multisensory stimulation and social familiarity with the other person, we explored two factors that are proposed to relate to young children's developing sense of bodily self. Including an adult sample allowed us to investigate age-related differences of the malleability of the bodily self. To this end, the study implemented an enfacement illusion with children (N = 64) and adults (N = 33). Participants were exposed to one trial with synchronous interpersonal multisensory stimulation and one trial with asynchronous interpersonal multisensory stimulation-either with a stranger or with the mother as the other person. A self-recognition task using morph videos of self and other and an enfacement questionnaire were implemented as dependent measures. Results revealed evidence for the presence of the enfacement effect in children in both measures. The identity of the other person had a significant effect on the self-recognition task. Contrary to our hypothesis, the effect was significantly smaller in the caregiver condition. No significant differences between children and adults emerged. Our results demonstrate the role of both multisensory stimulation and contextual-here social familiarity-factors for the construction and development of a bodily self. The study provides developmental science with a novel approach to the bodily self by showing the validity of the self-recognition task in a child sample. Overall, the study supports proposals that the sense of bodily self is malleable early in development.

Embodiment in episodic memory through premotor-hippocampal coupling

Episodic memory (EM) allows us to remember and relive past events and experiences and has been linked to cortical-hippocampal reinstatement of encoding activity. While EM is fundamental to establish a sense of self across time, this claim and its link to the sense of agency (SoA), based on bodily signals, has not been tested experimentally. Using real-time sensorimotor stimulation, immersive virtual reality, and fMRI we manipulated the SoA and report stronger hippocampal reinstatement for scenes encoded under preserved SoA, reflecting recall performance in a recognition task. We link SoA to EM showing that hippocampal reinstatement is coupled with reinstatement in premotor cortex, a key SoA region. We extend these findings in a severe amnesic patient whose memory lacked the normal dependency on the SoA. Premotor-hippocampal coupling in EM describes how a key aspect of the bodily self at encoding is neurally reinstated during the retrieval of past episodes, enabling a sense of self across time.

Keeping up with ourselves: Multimodal processes underlying body ownership across the lifespan

The sense of a bodily self is thought to depend on adaptive weighting and integration of bodily afferents and prior beliefs. While the physical body changes in shape, size, and functionality across the lifespan, the sense of body ownership remains relatively stable. Yet, little is known about how multimodal integration underlying such sense of ownership is altered in ontogenetic periods of substantial physical changes. We aimed to study this link for the motor and the tactile domain in a mixed-realty paradigm where participants ranging from 7 to 80 years old saw their own body with temporally mismatching multimodal signals. Participants were either stroked on their hand or moved it, while they saw it in multiple trials with different visual delays. For each trial, they judged the visuo-motor/tactile synchrony and rated the sense of ownership for the seen hand. Visual dependence and proprioceptive acuity were additionally assessed. The results show that across the lifespan body ownership decreases with increasing temporal multisensory mismatch, both in the tactile and the motor domain. We found an increased sense of ownership with increasing age independent of delay and modality. Delay sensitivity during multisensory conflicts was not consistently related to age. No effects of age were found on visual dependence or proprioceptive accuracy. The results are at least partly in line with an enhanced weighting of top-down and a reduced weighting of bottom-up signals for the momentary sense of bodily self with increasing age.

Developmental changes of bodily self-consciousness in adolescent girls

The body and the self change markedly during adolescence, but how does bodily self-consciousness, the pre-reflexive experience of being a bodily subject, change? We addressed this issue by studying embodiment towards virtual avatars in 70 girls aged 10-17 years. We manipulated the synchrony between participants' and avatars' touch or movement, as well as the avatar visual shape or size relative to each participant's body. A weaker avatar's embodiment in case of mismatch between the body seen in virtual reality and the real body is indicative of a more robust bodily self-consciousness. In both the visuo-tactile and the visuo-motor experiments, asynchrony decreased ownership feeling to the same extent for all participants, while the effect of asynchrony on agency feeling increased with age. In the visuo-tactile experiment, incongruence in visual appearance did not affect agency feeling but impacted ownership, especially in older teenage girls. These findings highlight the higher malleability of bodily self-consciousness at the beginning of adolescence and suggest some independence between body ownership and agency.

Temporal visuomotor synchrony induces embodiment towards an avatar with biomechanically impossible arm movements

Visuomotor synchrony in time and space induces a sense of embodiment towards virtual bodies experienced in first-person view using Virtual Reality (VR). Here, we investigated whether temporal visuomotor synchrony affects avatar embodiment even when the movements of the virtual arms are spatially altered from those of the user in a non-human-like manner. In a within-subjects design VR experiment, participants performed a reaching task controlling an avatar whose lower arms bent in inversed and biomechanically impossible directions from the elbow joints. They performed the reaching task using this "unnatural avatar" as well as a "natural avatar," whose arm movements and positions spatially matched the user. The reaching tasks were performed with and without a one second delay between the real and virtual movements. While the senses of body ownership and agency towards the unnatural avatar were significantly lower compared to those towards the natural avatar, temporal visuomotor synchrony did significantly increase the sense of embodiment towards the unnatural avatar as well as the natural avatar. These results suggest that temporal visuomotor synchrony is crucial for inducing embodiment even when the spatial match between the real and virtual limbs is disrupted with movements outside the pre-existing cognitive representations of the human body.

From rubber hands to neuroprosthetics: Neural correlates of embodiment

Our interaction with the world rests on the knowledge that we are a body in space and time, which can interact with the environment. This awareness is usually referred to as sense of embodiment. For the good part of the past 30 years, the rubber hand illusion (RHI) has been a prime tool to study embodiment in healthy and people with a variety of clinical conditions. In this paper, we provide a critical overview of this research with a focus on the RHI paradigm as a tool to study prothesis embodiment in individuals with amputation. The RHI relies on well-documented multisensory integration mechanisms based on sensory precision, where parietal areas are involved in resolving the visuo-tactile conflict, and premotor areas in updating the conscious bodily representation. This mechanism may be transferable to prosthesis ownership in amputees. We discuss how these results might transfer to technological development of sensorised prostheses, which in turn might progress the acceptability by users.

Immersive Virtual Reality Avatars for Embodiment Illusions in People With Mild to Borderline Intellectual Disability: User-Centered Development and Feasibility Study

BACKGROUND

Immersive virtual reality (IVR) has been investigated as a tool for treating psychiatric conditions. In particular, the practical nature of IVR, by offering a doing instead of talking approach, could support people who do not benefit from existing treatments. Hence, people with mild to borderline intellectual disability (MBID; IQ=50-85) might profit particularly from IVR therapies, for instance, to circumvent issues in understanding relevant concepts and interrelations. In this context, immersing the user into a virtual body (ie, avatar) appears promising for enhancing learning (eg, by changing perspectives) and usability (eg, natural interactions). However, design requirements, immersion procedures, and proof of concept of such embodiment illusion (ie, substituting the real body with a virtual one) have not been explored in this group.

OBJECTIVE

Our study aimed to establish design guidelines for IVR embodiment illusions in people with MBID. We explored 3 factors to induce the illusion, by testing the avatar's appearance, locomotion using IVR controllers, and virtual object manipulation. Furthermore, we report on the feasibility to induce the embodiment illusion and provide procedural guidance.

METHODS

We conducted a user-centered study with 29 end users in care facilities, to investigate the avatar's appearance, controller-based locomotion (ie, teleport, joystick, or hybrid), and object manipulation. Overall, 3 iterations were conducted using semistructured interviews to explore design factors to induce embodiment illusions in our group. To further understand the influence of interactions on the illusion, we measured the sense of embodiment (SoE) during 5 interaction tasks.

RESULTS

IVR embodiment illusions can be induced in adults with MBID. To induce the illusion, having a high degree of control over the body outweighed avatar customization, despite the participants' desire to replicate their own body image. Similarly, the highest SoE was measured during object manipulation tasks, which required a combination of (virtual) locomotion and object manipulation behavior. Notably, interactions that are implausible (eg, teleport and occlusions when grabbing) showed a negative influence on SoE. In contrast, implementing artificial interaction aids into the IVR avatar's hands (ie, for user interfaces) did not diminish the illusion, presuming that the control was unimpaired. Nonetheless, embodiment illusions showed a tedious and complex need for (control) habituation (eg, motion sickness), possibly hindering uptake in practice.

CONCLUSIONS

Balancing the embodiment immersion by focusing on interaction habituation (eg, controller-based locomotion) and lowering customization effort seems crucial to achieve both high SoE and usability for people with MBID. Hence, future studies should investigate the requirements for natural IVR avatar interactions by using multisensory integrations for the virtual body (eg, animations, physics-based collision, and touch) and other interaction techniques (eg, hand tracking and redirected walking). In addition, procedures and use for learning should be explored for tailored mental health therapies in people with MBID.

Alice in Wonderland: The effects of body size and movement on children's size perception and body representation in virtual reality

Previous work shows that in adults, illusory embodiment of a virtual avatar can be induced using congruent visuomotor cues. Furthermore, embodying different-sized avatars influences adults' perception of their environment's size. This study (N = 92) investigated whether children are also susceptible to such embodiment and size illusions. Adults and 5-year-old children viewed a first-person perspective of different-sized avatars moving either congruently or incongruently with their own body. Participants rated their feelings of embodiment over the avatar and also estimated the sizes of their body and objects in the environment. Unlike adults, children embodied the avatar regardless of visuomotor congruency. Both adults and children freely embodied different-sized avatars, and this affected their size perception in the surrounding virtual environment; they felt that objects were larger in a small body and vice versa in a large body. In addition, children felt that their body had grown in the large body condition. These findings have important implications for both our theoretical understanding of own-body representation, and our knowledge of perception in virtual environments.

The role of motor memory dynamics in structuring bodily self-consciousness

Bodily self-consciousness has been considered a sensorimotor root of self-consciousness. If this is the case, how does sensorimotor memory, which is important for the prediction of sensory consequences of volitional actions, influence awareness of bodily self-consciousness? This question is essential for understanding the effective acquisition and recovery of self-consciousness following its impairment, but it has remained unexamined. Here, we investigated how body ownership and agency recovered following body schema distortion in a virtual reality environment along with two kinds of motor memories: memories that were rapidly updated and memories that were gradually updated. We found that, although agency and body ownership recovered in parallel, the recovery of body ownership was predicted by fast memories and that of agency was predicted by slow memories. Thus, the bodily self was represented in multiple motor memories with different dynamics. This finding demystifies the controversy about the causal relationship between body ownership and agency.