1
|
Boban L, Boulic R, Herbelin B. In Case of Doubt, One Follows One's Self: The Implicit Guidance of the Embodied Self-Avatar. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2024; 30:2109-2118. [PMID: 38437112 DOI: 10.1109/tvcg.2024.3372042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2024]
Abstract
The sense of embodiment in virtual reality (VR) is commonly understood as the subjective experience that one's physical body is substituted by a virtual counterpart, and is typically achieved when the avatar's body, seen from a first-person view, moves like one's physical body. Embodiment can also be experienced in other circumstances (e.g., in third-person view) or with imprecise or distorted visuo-motor coupling. It was moreover observed, in various cases of small or progressive temporal and spatial manipulations of avatars' movements, that participants may spontaneously follow the movement shown by the avatar. The present work investigates whether, in some specific contexts, participants would follow what their avatar does even when large movement discrepancies occur, thereby extending the scope of understanding of the self-avatar follower effect beyond subtle changes of motion or speed manipulations. We conducted an experimental study in which we introduced uncertainty about which movement to perform at specific times and analyzed participants' movements and subjective feedback after their avatar showed them an incorrect movement. Results show that, when in doubt, participants were influenced by their avatar's movements, leading them to perform that particular error twice more often than normal. Importantly, results of the embodiment score indicate that participants experienced a dissociation with their avatar at those times. Overall, these observations not only demonstrate the possibility of provoking situations in which participants follow the guidance of their avatar for large motor distortions, despite their awareness about the avatar movement disruption and on the possible influence it had on their choice, and, importantly, exemplify how the cognitive mechanism of embodiment is deeply rooted in the necessity of having a body.
Collapse
|
2
|
Iwane F, Porssut T, Blanke O, Chavarriaga R, Del R Millán J, Herbelin B, Boulic R. Customizing the human-avatar mapping based on EEG error related potentials. J Neural Eng 2024; 21:026016. [PMID: 38386506 DOI: 10.1088/1741-2552/ad2c02] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 01/26/2024] [Indexed: 02/24/2024]
Abstract
Objective.A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside the virtual body when they perceive erroneous interaction, i.e. a break-in-embodiment (BiE). However, the way to detect such an inadequate event is currently limited to questionnaires or spontaneous reports from users. The ability to implicitly detect BiE in real-time enables us to adjust human-avatar mapping without interruption.Approach.We propose and empirically demonstrate a novel brain computer interface (BCI) approach that monitors the occurrence of BiE based on the users' brain oscillatory activity in real-time to adjust the human-avatar mapping in VR. We collected EEG activity of 37 participants while they performed reaching movements with their avatar with different magnitude of distortion.Main results.Our BCI approach seamlessly predicts occurrence of BiE in varying magnitude of erroneous interaction. The mapping has been customized by BCI-reinforcement learning (RL) closed-loop system to prevent BiE from occurring. Furthermore, a non-personalized BCI decoder generalizes to new users, enabling 'Plug-and-Play' ErrP-based non-invasive BCI. The proposed VR system allows customization of human-avatar mapping without personalized BCI decoders or spontaneous reports.Significance.We anticipate that our newly developed VR-BCI can be useful to maintain an engaging avatar-based interaction and a compelling immersive experience while detecting when users notice a problem and seamlessly correcting it.
Collapse
Affiliation(s)
- Fumiaki Iwane
- Learning Algorithms and Systems Laboratory (LASA), École Polytechnique Féderale de Lausanne (EPFL), 1015 Lausanne, Switzerland
- Dept. of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, United States of America
- Dept. of Neurology, The University of Texas at Austin, Austin, TX 78712, United States of America
| | - Thibault Porssut
- Immersive Interaction Research Group (IIG), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
- Laboratory of Cognitive Neuroscience (LNCO), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
- Capgemini Engineering, Paris, France
| | - Olaf Blanke
- Laboratory of Cognitive Neuroscience (LNCO), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
- Dept. of Neurology, Geneva University Hospitals, Geneva, Switzerland
| | - Ricardo Chavarriaga
- Centre for Artificial Intelligence, Zurich University of Applied Sciences (ZHAW), Winterthur, Switzerland
| | - José Del R Millán
- Dept. of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, United States of America
- Dept. of Neurology, The University of Texas at Austin, Austin, TX 78712, United States of America
- Dept. of Biomedical Engineering, The University of Texas at Austin, Austin, TX 78712, United States of America
- Mulva Clinic for the Neurosciences, The University of Texas at Austin, Austin, TX 78712, United States of America
| | - Bruno Herbelin
- Laboratory of Cognitive Neuroscience (LNCO), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Ronan Boulic
- Immersive Interaction Research Group (IIG), Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| |
Collapse
|
3
|
A reassessment of the role of joint receptors in human position sense. Exp Brain Res 2023; 241:943-949. [PMID: 36869268 PMCID: PMC10082099 DOI: 10.1007/s00221-023-06582-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 02/22/2023] [Indexed: 03/05/2023]
Abstract
In the past, the peripheral sense organs responsible for generating human position sense were thought to be the slowly adapting receptors in joints. More recently, our views have changed and the principal position sensor is now believed to be the muscle spindle. Joint receptors have been relegated to the lesser role of acting as limit detectors when movements approach the anatomical limit of a joint. In a recent experiment concerned with position sense at the elbow joint, measured in a pointing task over a range of forearm angles, we have observed falls in position errors as the forearm was moved closer to the limit of extension. We considered the possibility that as the arm approached full extension, a population of joint receptors became engaged and that they were responsible for the changes in position errors. Muscle vibration selectively engages signals of muscle spindles. Vibration of elbow muscles undergoing stretch has been reported to lead to perception of elbow angles beyond the anatomical limit of the joint. The result suggests that spindles, by themselves, cannot signal the limit of joint movement. We hypothesise that over the portion of the elbow angle range where joint receptors become active, their signals are combined with those of spindles to produce a composite that contains joint limit information. As the arm is extended, the growing influence of the joint receptor signal is evidenced by the fall in position errors.
Collapse
|