Emotional stimulation during motor exercise: An integration to the holistic rehabilitation framework

VR-PEER: A Personalized Exer-Game Platform Based on Emotion Recognition

Motor rehabilitation exercises require recurrent repetitions to enhance patients’ gestures. However, these repetitive gestures usually decrease the patients’ motivation and stress them. Virtual Reality (VR) exer-games (serious games in general) could be an alternative solution to address the problem. This innovative technology encourages patients to train different gestures with less effort since they are totally immersed in an easy to play exer-game. Despite this evolution, patients, with available exer-games, still suffer in performing their gestures correctly without pain. The developed applications do not consider the patients psychological states when playing an exer-game. Therefore, we believe that is necessary to develop personalized and adaptive exer-games that take into consideration the patients’ emotions during rehabilitation exercises. This paper proposed a VR-PEER adaptive exer-game system based on emotion recognition. The platform contain three main modules: (1) computing and interpretation module, (2) emotion recognition module, (3) adaptation module. Furthermore, a virtual reality-based serious game is developed as a case study, that uses updated facial expression data and provides dynamically the patient’s appropriate game to play during rehabilitation exercises. An experimental study has been conducted on fifteen subjects who expressed the usefulness of the proposed system in motor rehabilitation process.

Personalized Virtual Reality Human-Computer Interaction for Psychiatric and Neurological Illnesses: A Dynamically Adaptive Virtual Reality Environment That Changes According to Real-Time Feedback From Electrophysiological Signal Responses

Virtual reality (VR) constitutes an alternative, effective, and increasingly utilized treatment option for people suffering from psychiatric and neurological illnesses. However, the currently available VR simulations provide a predetermined simulative framework that does not take into account the unique personality traits of each individual; this could result in inaccurate, extreme, or unpredictable responses driven by patients who may be overly exposed and in an abrupt manner to the predetermined stimuli, or result in indifferent, almost non-existing, reactions when the stimuli do not affect the patients adequately and thus stronger stimuli are recommended. In this study, we present a VR system that can recognize the individual differences and readjust the VR scenarios during the simulation according to the treatment aims. To investigate and present this dynamically adaptive VR system we employ an Anxiety Disorder condition as a case study, namely arachnophobia. This system consists of distinct anxiety states, aiming to dynamically modify the VR environment in such a way that it can keep the individual within a controlled, and appropriate for the therapy needs, anxiety state, which will be called "desired states" for the study. This happens by adjusting the VR stimulus, in real-time, according to the electrophysiological responses of each individual. These electrophysiological responses are collected by an external electrodermal activity biosensor that serves as a tracker of physiological changes. Thirty-six diagnosed arachnophobic individuals participated in a one-session trial. Participants were divided into two groups, the Experimental Group which was exposed to the proposed real-time adaptive virtual simulation, and the Control Group which was exposed to a pre-recorded static virtual simulation as proposed in the literature. These results demonstrate the proposed system's ability to continuously construct an updated and adapted virtual environment that keeps the users within the appropriately chosen state (higher or lower intensity) for approximately twice the time compared to the pre-recorded static virtual simulation. Thus, such a system can increase the efficiency of VR stimulations for the treatment of central nervous system dysfunctions, as it provides numerically more controlled sessions without unexpected variations.

Comparison between Full Body Motion Recognition Camera Interaction and Hand Controllers Interaction used in Virtual Reality Exposure Therapy for Acrophobia

Virtual Reality has already been proven as a useful supplementary treatment tool for anxiety disorders. However, no specific technological importance has been given so far on how to apply Virtual Reality with a way that properly stimulates the phobic stimulus and provide the necessary means for lifelike experience. Thanks to technological advancements, there is now a variety of hardware that can help enhance stronger emotions generated by Virtual Reality systems. This study aims to evaluate the feeling of presence during different hardware setups of Virtual Reality Exposure Therapy, and, particularly how the user's interaction with those setups can affects their sense of presence during the virtual simulation. An acrophobic virtual scenario is used as a case study by 20 phobic individuals and the Witmer-Singer presence questionnaire was used for presence evaluation by the users of the system. Statistical analysis on their answers revealed that the proposed full body Motion Recognition Cameras system generates a better feeling of presence compared to the Hand Controllers system. This is thanks to the Motion Recognition Cameras, which track and allow display of the user's entire body within the virtual environment. Thus, the users are enabled to interact and confront the anxiety-provoking stimulus as in real world. Further studies are recommended, in which the proposed system could be used in Virtual Reality Exposure Therapy trials with acrophobic patients and other anxiety disorders as well, since the proposed system can provide natural interaction in various simulated environments.