Neuroscience robotics to investigate multisensory integration and bodily awareness

Enhancing motor imagery in the third-person perspective by manipulating sense of body ownership with virtual reality

Virtual reality (VR)-guided motor imagery (MI) is a widely used approach for motor rehabilitation, especially for patients with severe motor impairments. Most approaches provide visual guidance from the first-person perspective (1PP). MI training with visual guidance from the third-person perspective (3PP) remains largely unexplored. We argue that 3PP MI training has its own advantages and can supplement 1PP MI. For some movements beyond the view of 1PP, such as shoulder shrugging and other axial movements, MI are suitable performed under 3PP. However, the efficiency of existing paradigms for 3PP MI is unsatisfactory. We speculate that the absence of sense of body ownership (SOO) from 3PP could be one possible factor and hypothesize that 3PP MI could be enhanced by eliciting SOO over a 3PP avatar. Based on our hypothesis, a novel paradigm was proposed to enhance 3PP MI by inducing full-body illusion (FBI) from 3PP, which is similar to the so-called out-of-body experience (OBE), using synchronous visuo-tactile stimulus with VR. The event-related Electroencephalograph (EEG) desynchronization (ERD) at motor-related regions from 31 healthy participants were calculated and compared with a control paradigm without "OBE" FBI induction. This study attempts to enhance 3PP MI with FBI induction. It offers an opportunity to perform MI guided by action observation from 3PP with elicited SOO to the observed avatar. We believe that 3PP MI could provide more possibilities for effective rehabilitation training, when SOO could be elicited to a virtual avatar and the present work demonstrates its viability and effectiveness.

Assessing MR-compatibility of somatosensory stimulation devices: A systematic review on testing methodologies

Functional magnetic resonance imaging (fMRI) has been extensively used as a tool to map the brain processes related to somatosensory stimulation. This mapping includes the localization of task-related brain activation and the characterization of brain activity dynamics and neural circuitries related to the processing of somatosensory information. However, the magnetic resonance (MR) environment presents unique challenges regarding participant and equipment safety and compatibility. This study aims to systematically review and analyze the state-of-the-art methodologies to assess the safety and compatibility of somatosensory stimulation devices in the MR environment. A literature search, following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement guidelines, was performed in PubMed, Scopus, and Web of Science to find original research on the development and testing of devices for somatosensory stimulation in the MR environment. Nineteen records that complied with the inclusion and eligibility criteria were considered. The findings are discussed in the context of the existing international standards available for the safety and compatibility assessment of devices intended to be used in the MR environment. In sum, the results provided evidence for a lack of uniformity in the applied testing methodologies, as well as an in-depth presentation of the testing methodologies and results. Lastly, we suggest an assessment methodology (safety, compatibility, performance, and user acceptability) that can be applied to devices intended to be used in the MR environment.

Systematic review registration

https://www.crd.york.ac.uk/prospero/, identifier CRD42021257838.

Visual gravity contributes to subjective first-person perspective

A fundamental component of conscious experience involves a first-person perspective (1PP), characterized by the experience of being a subject and of being directed at the world. Extending earlier work on multisensory perceptual mechanisms of 1PP, we here asked whether the experienced direction of the 1PP (i.e. the spatial direction of subjective experience of the world) depends on visual-tactile-vestibular conflicts, including the direction of gravity. Sixteen healthy subjects in supine position received visuo-tactile synchronous or asynchronous stroking to induce a full-body illusion. In the critical manipulation, we presented gravitational visual object motion directed toward or away from the participant’s body and thus congruent or incongruent with respect to the direction of vestibular and somatosensory gravitational cues. The results showed that multisensory gravitational conflict induced within-subject changes of the experienced direction of the 1PP that depended on the direction of visual gravitational cues. Participants experienced more often a downward direction of their 1PP (incongruent with respect to the participant’s physical body posture) when visual object motion was directed away rather than towards the participant’s body. These downward-directed 1PP experiences positively correlated with measures of elevated self-location. Together, these results show that visual gravitational cues contribute to the experienced direction of the 1PP, defining the subjective location and perspective from where humans experience to perceive the world.

Insights and Perspectives on Sensory-Motor Integration and Rehabilitation

The present review focuses on the flow and interaction of somatosensory-motor signals in the central and peripheral nervous system. Specifically, where incoming sensory signals from the periphery are processed and interpreted to initiate behaviors, and how ongoing behaviors produce sensory consequences encoded and used to fine-tune subsequent actions. We describe the structure–function relations of this loop, how these relations can be modeled and aspects of somatosensory-motor rehabilitation. The work reviewed here shows that it is imperative to understand the fundamental mechanisms of the somatosensory-motor system to restore accurate motor abilities and appropriate somatosensory feedback. Knowledge of the salient neural mechanisms of sensory-motor integration has begun to generate innovative approaches to improve rehabilitation training following neurological impairments such as stroke. The present work supports the integration of basic science principles of sensory-motor integration into rehabilitation procedures to create new solutions for sensory-motor disorders.

Full body illusion is associated with widespread skin temperature reduction

A central feature of our consciousness is the experience of the self as a unified entity residing in a physical body, termed bodily self-consciousness. This phenomenon includes aspects such as the sense of owning a body (also known as body ownership) and has been suggested to arise from the integration of sensory signals from the body. Several studies have shown that temporally synchronous tactile stimulation of the real body and visual stimulation of a fake or virtual body can induce changes in bodily self-consciousness, typically resulting in a sense of illusory ownership over the fake body. The present study assessed the effect of anatomical congruency of visuo-tactile stimulation on bodily self-consciousness. A virtual body was presented and temporally synchronous visuo-tactile stroking was applied simultaneously to the participants' body and to the virtual body. We manipulated the anatomical locations of the visuo-tactile stroking (i.e., on the back, on the leg), resulting in congruent stroking (stroking was felt and seen on the back or the leg) or incongruent stroking (i.e., stroking was felt on the leg and seen on the back). We measured self-identification with the virtual body and self-location as well as skin temperature. Illusory self-identification with the avatar as well as changes in self-location were experienced in the congruent stroking conditions. Participants showed a decrease in skin temperature across several body locations during congruent stimulation. These data establish that the full-body illusion (FBI) alters bodily self-consciousness and instigates widespread physiological changes in the participant's body.

Multisensory origin of the subjective first-person perspective: visual, tactile, and vestibular mechanisms

In three experiments we investigated the effects of visuo-tactile and visuo-vestibular conflict about the direction of gravity on three aspects of bodily self-consciousness: self-identification, self-location, and the experienced direction of the first-person perspective. Robotic visuo-tactile stimulation was administered to 78 participants in three experiments. Additionally, we presented participants with a virtual body as seen from an elevated and downward-directed perspective while they were lying supine and were therefore receiving vestibular and postural cues about an upward-directed perspective. Under these conditions, we studied the effects of different degrees of visuo-vestibular conflict, repeated measurements during illusion induction, and the relationship to a classical measure of visuo-vestibular integration. Extending earlier findings on experimentally induced changes in bodily self-consciousness, we show that self-identification does not depend on the experienced direction of the first-person perspective, whereas self-location does. Changes in bodily self-consciousness depend on visual gravitational signals. Individual differences in the experienced direction of first-person perspective correlated with individual differences in visuo-vestibular integration. Our data reveal important contributions of visuo-vestibular gravitational cues to bodily self-consciousness. In particular we show that the experienced direction of the first-person perspective depends on the integration of visual, vestibular, and tactile signals, as well as on individual differences in idiosyncratic visuo-vestibular strategies.

Multi-sensory and sensorimotor foundation of bodily self-consciousness - an interdisciplinary approach

Scientific investigations on the nature of the self have so far focused on high-level mechanisms. Recent evidence, however, suggests that low-level bottom-up mechanisms of multi-sensory integration play a fundamental role in encoding specific components of bodily self-consciousness, such as self-location and first-person perspective (Blanke and Metzinger, 2009). Self-location and first-person perspective are abnormal in neurological patients suffering from out-of-body experiences (Blanke et al., 2004), and can be manipulated experimentally in healthy subjects by imposing multi-sensory conflicts (Lenggenhager et al., 2009). Activity of the temporo-parietal junction (TPJ) reflects experimentally induced changes in self-location and first-person perspective (Ionta et al., 2011), and dysfunctions in TPJ are causally associated with out-of-body experiences (Blanke et al., 2002). We argue that TPJ is one of the key areas for multi-sensory integration of bodily self-consciousness, that its levels of activity reflect the experience of the conscious "I" as embodied and localized within bodily space, and that these mechanisms can be systematically investigated using state of the art technologies such as robotics, virtual reality, and non-invasive neuroimaging.