Vision-based serious games and virtual reality systems for motor rehabilitation: A review geared toward a research methodology

Effectiveness of virtual reality assisted active limb movement exercises for patients in the respiratory intensive care unit: a randomized pilot study

OBJECTIVE

The primary aim of this study is to compare the effectiveness of early active limb movement facilitated by virtual reality technologies with conventional exercise therapy in enhancing patient recovery in the Respiratory Intensive Care Unit. The follow-up period covers 1 week.

METHODS

In this prospective randomized controlled trial, patients were allocated to either a control group, which received standard exercise therapy, or a virtual reality group, which utilized virtual reality software and equipment for active exercises. Patients were followed for 1 week. The study compared compliance, safety, and rehabilitative outcomes between these groups. Data were analysed using a linear mixed-effects model.

RESULTS

Patients in the virtual reality-based exercise group exhibited significantly higher levels of average daily exercise time, out-of-bed exercise time, and overall exercise compliance compared with the control group (p < 0.05). There were no reports of adverse events related to exercise in either group. Notably, within the first week of intervention, the virtual reality-based exercise group showed significant improvements in various parameters, including muscle strength, grip strength, body mass index, and the Barthel Index, outperforming the control group in these areas (all p < 0.05).

CONCLUSION

Based on 1 week of follow-up data, the study confirms that virtual reality-based exercise modalities are more efficacious than traditional exercise approaches in enhancing exercise duration, compliance, and various health outcomes in Respiratory Intensive Care Unit patients. This approach also contributes to reducing Respiratory Intensive Care Unit stay duration. The system's effectiveness could be further increased by integrating more varied and engaging rehabilitation games and features tailored to the needs of ICU patients.

TRIAL REGISTRATION

Chictr.org: ChiCTR1900021452.

Using Virtual Reality Pablo Gaming in the Post-Operative Rehabilitation of Breast Cancer Patients: Randomized Controlled Trial

Background/Objectives: Surgical treatment of breast cancer may lead to physical and psychological side effects. Exercises, especially those aided by virtual reality (VR), can improve both physical and psychological dysfunctions. To explore the effects of exercises using VR through Pablo games Technology on the function, grip strength, wrist ROM, fatigue, pain, activities of daily living (ADLs), and anxiety among post-operative breast cancer females. Methods: Forty post-operative breast cancer females participated in the current study: nineteen in the control group (CG), who received a standard treatment consisting of upper limb exercises plus intermittent compression therapy, and twenty-one participants assigned to the Pablo group (PG), who received the standard treatment plus additional training using the Pablo game training system. The intervention period was eight weeks long. The outcome measures were function, grip strength, wrist ROM, fatigue, pain, activities of daily living, and anxiety. Data were obtained at the baseline, after eight weeks, and at two months follow-up. Results: There were statistically significant declines in pain and fatigue, while there were statistically significant improvements in ADLs, grip strength, function, and ROM post-intervention and at two months follow-up in both groups (p < 0.001). Between-group comparisons demonstrated a statistically significant decrease in pain, anxiety, and fatigue and statistically significant improvements in function, ADLs, grip strength, and ROM in favor of the PG post-treatment and at the follow-up (p < 0.001). Conclusions: Adding VR using the Pablo game training system to the standard rehabilitation of post-surgical breast cancer patients can further improve their function, hand grip, wrist ROM, fatigue, pain, and ADLs.

Comparing the effects of Swiss-ball training and virtual reality training on balance, mobility, and cortical activation in individuals with chronic stroke: study protocol for a multi-center randomized controlled trial

BACKGROUND

Balance and mobility deficits are major concerns in stroke rehabilitation. Virtual reality (VR) training and Swiss-ball training are commonly used approaches to improve balance and mobility. However, no study has compared the efficacy of VR training, Swiss-ball training, and their combination in improving balance and mobility function or investigated cortical activation and connectivity in individuals with stroke.

METHODS

A prospective, single-blinded, parallel-armed, multi-center randomized controlled trial with factorial design will be conducted. Seventy-six participants aged 30-80 years with stroke will be recruited. Participants will be allocated to one of the four groups: (A) the VR training + Swiss-ball training + conventional physical therapy group; (B) the Swiss-ball training + conventional physical therapy group; (C) the VR training + conventional physical therapy group; or (D) the conventional physical therapy group. All participants will receive 50 min of training per day, 5 times per week, for a total of 4 weeks. The primary outcomes will be balance and mobility measures. Secondary outcomes will include the 10-min walk test, dynamic gait index, and cortical activation. Outcomes will be measured on three occasions: at baseline, after the training, and at the 4-week follow-up.

DISCUSSION

This trial will provide evidence to determine whether there are differences in clinical outcomes and cortical activation following two different types of exercise programs and their combination, and to elucidate the recovery mechanisms of balance and mobility function in individuals with stroke.

TRIAL REGISTRATION

Chinese Clinical Trial Registry reference: www.chictr.org.cn (No. ChiCTR2400082135). Registered on May 24, 2024.

Effects of a Virtual Reality Game With Leap Motion Controller on Brain Activity Related to Attentional Function in Healthy Adults - A Pilot EEG Study

Objective Virtual reality (VR) games with the Leap Motion Controller (LMC) are used in clinical practice for cognitive rehabilitation to improve attentional function. However, the effects of VR games using the LMC on brain activity related to attentional function have not yet been elucidated. This study aimed to elucidate the effects of a VR game with the LMC on brain activity related to attentional function. Methods This single-arm study included 15 healthy adults (mean age, 23.2 ± 0.9 years; seven females) and analyzed their electroencephalography (EEG) findings. We measured event-related potentials (ERPs) before and after the VR game with the LMC, and the α, θ, and β values during the VR game with the LMC. EEG measurements were based on the international 10-20 system, with dish electrodes placed at F3, F4, Fz, C3, C4, Cz, P3, P4, Pz, O1, and O2 using EEG caps. For statistical analysis, the N1 peak amplitudes before and after the VR game were compared using paired t-tests. In addition, the average amplitudes of α, θ, and β at 10-20 ms and 280-290 ms during the VR game were compared using paired t-tests only for positions that showed significant changes in the N1 peak amplitude before and after the VR game. Results After the VR game, the N1 peak amplitude was significantly greater at the F4 (pre: -4.51 ± 3.49 μV, post: -6.31 ± 2.60 μV, P = 0.010), Fz (pre: -4.68 ± 2.85 μV, post: -6.29 ± 2.17 μV, P = 0.033), and C4 (pre: -4.43 ± 3.94 μV, post: -6.24 ± 2.56 μV, P = 0.015) positions. During the VR game, the average amplitude of α at the F4 position (during a VR game of 10-20 ms: 7.86 ± 1.33 μV; during a VR game of 280-290 ms: 9.40 ± 2.69 μV, P = 0.010) was significantly higher at 280-290 ms. Conclusions The N1 peak amplitude, meaning selective attention, in F4, Fz, and C4 and the amplitude of α, meaning control interference of unwanted stimuli in a task, in F4 were increased in the post-VR game using LMC. VR games using the LMC may contribute to improvements in attentional function. Further studies are required to assess their applications in cognitive rehabilitation.

Playfulness and New Technologies in Hand Therapy for Children With Cerebral Palsy: Scoping Review

BACKGROUND

Innovative technologies such as game consoles and smart toys used with games or playful approaches have proven to be successful and attractive in providing effective and motivating hand therapy for children with cerebral palsy (CP). Thus, there is an increased interest in designing and implementing interventions that can improve the well-being of these children. However, to understand how and why these interventions are motivating children, we need a better understanding of the playful elements of technology-supported hand therapy.

OBJECTIVE

This scoping review aims to identify the playful elements and the innovative technologies currently used in hand therapy for children with CP.

METHODS

We included studies that design or evaluate interventions for children with CP that use innovative technologies with game or play strategies. Data were extracted and analyzed based on the type of technology, description of the system, and playful elements according to the Lenses of Play, a play design toolkit. A total of 31 studies were included in the analysis.

RESULTS

Overall, 54 papers were included in the analysis. The results showed high use of consumer technologies in hand therapy for children with CP. Although several studies have used a combination of consumer technologies with therapeutic-specific technologies, only a few studies focused on the exclusive use of therapeutic-specific technologies. To analyze the playfulness of these interventions that make use of innovative technologies, we focused our review on 3 lenses of play: Open-ended Play, where it was found that the characteristics of ludus, such as a structured form of play and defined goals and rules, were the most common, whereas strategies that relate to paidia were less common. The most commonly used Forms of Play were physical or active form and games with rules. Finally, the most popular Playful experiences were control, challenge, and competition.

CONCLUSIONS

The inventory and analysis of innovative technology and playful elements provided in this study can be a starting point for new developments of fun and engaging tools to assist hand therapy for children with CP.

Evaluation of a computer game-assisted rehabilitation program for manual dexterity of children with cerebral palsy: Feasibility randomized control trial

BACKGROUND

There is a need for innovation to improve the engagement and compliance of rehabilitation programs for children with upper extremity (UE) motor impairments due to cerebral palsy (CP); a computer games-based rehabilitation platform (GRP) was developed to address this need. The GRP provides engaging task-specific exercises targeting manual dexterity (object handling and manipulation).

OBJECTIVE

To evaluate the therapeutic value and treatment effect size of an exercise program using the GRP in children with CP.

METHODS

A total of 63 children with CP, aged 4 to 10 years, were recruited. The Peabody Developmental Motor Scale-2 (PDMS-2) Grasp and Visual-Motor Integration (VMI) subscores and Computer game-based Upper Extremity (CUE) assessment of manual dexterity were used to assess participants before and after a 16-week intervention program, delivered three times per week. The experimental group (XG) received a computer games-based exercise program targeting object manipulation tasks. The active control arm (CG) consisted of task-specific training similar to the tasks used in constrained induced movement therapy.

RESULTS

There were only a few dropouts during the 16-week program, and compliance was high. Both groups showed significant improvements with medium to large effect sizes. Improvements in the PDMS-2 Grasp and VMI subscores observed in the XG were significantly greater than that in the CG. There were significant improvements (p < .01) in PDMS-2 grasp and VMI subscores for XG with moderate to large effect sizes (0.5-0.8). For CG, the Grasp and VMI subscores did improve but these changes were not statistically significant. There was a significant improvement observed in the majority of CUE object manipulation test scores for XG (p < .01) with moderate to large effect sizes (0.50-1.2) Although CG did show improvements in all CUE object manipulation test scores, the changes did not reach statistical significance (p < .01).

CONCLUSION

This study demonstrates the utility of the GRP to practice a broad range of object manipulation tasks in children with CP. The present findings are positive and support further research and development. The long-term effects of the GRP program in children with CP will need to be confirmed in a future randomized controlled trial. In addition to measures of structure and function, future trials should also include outcome measures such as health-related quality of life and level of participation to validate the findings.

Experimental Evaluation of EMKEY: An Assistive Technology for People with Upper Limb Disabilities

Assistive technology can help people with disabilities to use computers more effectively and can enable them to access the same information and resources as people without disabilities. To obtain more insight into the factors that can bring about the design of an Emulator of Mouse and Keyboard (EMKEY) to higher levels of user satisfaction, an experimental study was conducted in order to analyse its effectiveness and efficiency. The experimental study involved 27 participants (M_age = 20.81, SD = 1.14) who performed three experimental games under different conditions (using the mouse and using EMKEY with head movements and voice commands). According to the results, the use of EMKEY allowed for the successful performance of tasks such as matching stimuli (F_(2,78) = 2.39, p = 0.10, η² = 0.06). However, the execution times of a task were found to be higher when using the emulator to drag an object on the screen (t_(52,1) = -18.45, p ≤ 0.001, d = 9.60). These results indicate the effectiveness of technological development for people with upper limb disabilities; however, there is room for improvement in terms of efficiency. The findings are discussed in relation to previous research and are based on future studies aimed at improving the operation of the EMKEY emulator.

Technical aspects of virtual augmented reality-based rehabilitation systems for musculoskeletal disorders of the lower limbs: a systematic review

INTRODUCTION

Musculoskeletal disorders are one of the most common causes of physical disability. The rehabilitation process after musculoskeletal disorders is long and tedious, and patients are not motivated to follow rehabilitation protocols. Therefore, new systems must be used to increase patient motivation. Virtual reality (VR) and augmented reality (AR) technologies can be used in this regard. In developing such systems, various technologies and methods of movement recognition are used; therefore, this study aims to summarize the technical aspects of using VR/AR in rehabilitation and evaluate and discuss efficient methods of investigating studies using the Statement of Standards for Reporting Implementation Studies (StaRI).

METHODS

Search in four scientific databases was done systematically based on PRISMA through online search engines from inception to June 2021. These databases include Medline (PubMed), Scopus, IEEE, and Web of Science. An updated search was also conducted on 17 December 2021. The research used keywords and MeSH terms associated with VR/AR, musculoskeletal disorder, and rehabilitation. Selected articles were evaluated qualitatively using the Standards for Reporting Implementation Studies (StaRI) statement.

RESULTS

A total of 2343 articles were found, and 20 studies were included. We found that 11 (55%) studies used Kinect technology as input tools, and 15 (75%) studies have described the techniques used to analyze human movements, such as dynamic time warping (DTW) and support vector machines (SVM). In 10 (50%) studies, the Unity game engine was used for visualization. In 8 studies (40%), usability was assessed, and high usability was reported. Similarly, the results of the review of studies according to the StaRI checklist showed poor reporting in the title and discussion of the studies.

CONCLUSIONS

We found that academic studies did not describe the technical aspects of rehabilitation systems. Therefore, a good description of the technical aspects of the system in such studies should be considered to provide repeatability and generalizability of these systems for investigations by other researchers.

A feasibility study to assess the effectiveness of Muvity: A telerehabilitation system for chronic post-stroke subjects

OBJECTIVES

To assess the feasibility of a telerehabilitation system for chronic post-stroke subjects compared to a conventional treatment.

METHODS

A feasibility cross-over analysis was conducted in ten chronic post-stroke subjects. Two randomized groups followed two eight-weeks treatments, one with the telerehabilitation system Muvity and the other following conventional therapy (in random order). Before and after each treatment, physical evaluations were performed assessing functional independence, the perceived level of pain, balance control and self-reported health status. After the study, the participants answered a short questionnaire to measure the usability of the system.

RESULTS

Four out of six subjects demonstrated better performance in ADLs (equal or higher FIM scores) and five out of six reported lower pain (VAS score) after the treatment with Muvity when compared to the treatment without. There were no clear trends in terms of balance control (Berg scale) or self-reported health status (PCS score within SF-36).

CONCLUSIONS

The results suggest that the proposed telerehabilitation system aids users to overall maintain or improve their ability to perform ADLs without increasing pain, when compared to conventional therapy. Most subjects found the use of Muvity more motivating than the conventional rehabilitation treatment. This provides initial evidence that Muvity might be an appropriate complement for the telerehabilitation of patients with physical disabilities. However, the differences observed between both treatments were not statistically significant. A clinical study with a larger sample size will be necessary to obtain more robust results.

Virtual reality as an intervention tool for upper limbs in Parkinson’s disease: a case series

ABSTRACT Parkinson’s disease (PD) is a neurodegenerative disorder in which dopaminergic loss occurs in the basal nuclei region. One major complaint associated with PD is upper extremity motor deficits (UE), frequently reported in difficulties to perform activities of daily living (ADL), which may negatively affect quality of life. In recent years new technologies have emerged to assist the UE rehabilitation process in PD, such as virtual reality. Therefore, this study sought to verify the effects of an intervention in the UE with semi-immersive virtual reality equipment on ADLs and quality of life of individuals with PD. Six individuals with PD were selected for intervention, and evaluated by the Mini Mental State Examination, the Hoehn & Yahr Scale, the Unified Parkinson’s Disease Rating Scale (UPDRS), the Parkinson’s Disease Questionnaire (PDQ-39) and the test d’évaluation des membres supérieurs de personnes âgées (TEMPA). The interventions lasted 27 minutes per session, twice per week, for 5 weeks, using the Leap Motion Controller. Individuals showed improvement in muscle strength, muscle endurance, ADLs, and quality of life, all statistically significant. In conclusion, the protocol based on virtual reality applied to the upper limbs effectively improved the activities of daily living and quality of life in individuals with PD.

Realidade virtual como ferramenta de intervenção para os membros superiores na doença de Parkinson: série de casos

RESUMO A doença de Parkinson (DP) é uma desordem neurodegenerativa na qual ocorre a perda dopaminérgica na região dos núcleos da base. Uma das principais queixas associadas à DP são os déficits motores dos membros superiores (MMSS) frequentemente relatados em dificuldades para realizar as atividades de vida diária (AVDs), podendo interferir negativamente na qualidade de vida. Nos últimos anos novas tecnologias surgiram para auxiliar no processo de reabilitação dos MMSS na DP, sendo a realidade virtual uma delas. Portanto, este estudo teve como objetivo verificar os efeitos de uma intervenção nos MMSS com equipamento de realidade virtual semi-imersiva nas AVDs e na qualidade de vida de indivíduos com DP. Foram selecionados seis indivíduos com DP para intervenção, avaliados por meio do miniexame do estado mental, da escala de Hoehn e Yahr, da escala unificada de avaliação para a DP (UPDRS), do questionário sobre a doença de Parkinson (PDQ-39) e do test d’évaluation des membres supérieurs de personnes âgées (Tempa). Seis sujeitos foram submetidos à intervenção com duração de 27 minutos por sessão, duas vezes na semana, por cinco semanas, utilizando o Leap Motion Controller. Obteve-se melhora na força muscular, na resistência muscular, nas AVDs e na qualidade de vida, todos com significância estatística. Dessa forma, verificou-se que o protocolo baseado em realidade virtual aplicada nos MMSS foi eficaz para melhorar as AVDs e a qualidade de vida dos indivíduos com DP deste estudo.

Integration of persuasive elements into exergames: Application in the development of a novel gait rehabilitation system for children with musculoskeletal conditions

The main contribution of this paper is the application of the Persuasive System Design (PSD) model for the analysis and development of exergame systems to stimulate pediatric patients to adhere to short-term gait rehabilitation. It resulted in a novel therapy consisting of a video gaming and virtual reality (VG/VR) biofeedback system for treadmill gait rehabilitation, including a method for progressing the rehabilitation settings. During gait rehabilitation (GR) sessions, therapy settings need to be adjusted by physiotherapists, based on their clinical experience, to address the deficiencies of individuals while maximizing their motor functioning and maintaining their motivation. The system integrates persuasive elements, adjusted when physiotherapists progress the therapeutic settings, such as the treadmill speed, auditory feedback, and game challenges. We followed a scenario-based design method to develop the system, which comprised an observational study of conventional GR sessions and evaluations with 6 and 9 rehabilitation specialists who provided feedback about the system design. They perceived that the proposed method was valuable for physiotherapists to adapt the rehabilitation based on the children's performance. Also, they remarked that the system's visual and auditory stimulus would help engage the children in the therapy.

Motor Rehabilitation of Upper Limbs Using a Gesture-Based Serious Game: Evaluation of Usability and User Experience

Objective: Gesture-based serious games can be based on playful and interactive scenarios to enhance user engagement and experience during exercises, thereby increasing efficiency in the motor rehabilitation process. This study aimed to develop the Rehabilite Game (RG) as a complementary therapy tool for upper limb rehabilitation in clinics and home environments and to evaluate aspects of usability and user experience of it. Materials and Methods: The evaluation consisted of the use of a gesture-based serious game with motor rehabilitation sessions managed in a web platform. Thirty-three participants were recruited (21 physiotherapists and 12 patients). The protocol allowed each participant to have the experience of playing sessions with different combinations of settings. The User Experience Questionnaire (UEQ) was used to evaluate aspects of usability and user experience. The study was approved by the Research Ethics Board of the Federal University of Piaui (number 3,429,494). Results: The level of satisfaction with the RG was positive, with an excellent Net Promoter Score for 85.7% of physiotherapists and 100% of patients. All six UEQ scales (attractiveness, perspicuity, efficiency, dependability, stimulation, and novelty) reflected acceptance. Conclusion: The study demonstrated that, according to the results obtained in the experiments, the RG had positive feedback from physiotherapists and patients, indicating that the game can be used in a clinical trial to be compared with other rehabilitation techniques.

Validity and Reliability of Kinect v2 for Quantifying Upper Body Kinematics during Seated Reaching

Kinematic analysis of the upper limbs is a good way to assess and monitor recovery in individuals with stroke, but it remains little used in clinical routine due to its low feasibility. The aim of this study is to assess the validity and reliability of the Kinect v2 for the analysis of upper limb reaching kinematics. Twenty-six healthy participants performed seated hand-reaching tasks while holding a dumbbell to induce behaviour similar to that of stroke survivors. With the Kinect v2 and with the VICON, 3D upper limb and trunk motions were simultaneously recorded. The Kinect assesses trunk compensations, hand range of motion, movement time and mean velocity with a moderate to excellent reliability. In contrast, elbow and shoulder range of motion, time to peak velocity and path length ratio have a poor to moderate reliability. Finally, instantaneous hand and elbow tracking are not precise enough to reliably assess the number of velocity peaks and the peak hand velocity. Thanks to its ease of use and markerless properties, the Kinect can be used in clinical routine for semi-automated quantitative diagnostics guiding individualised rehabilitation of the upper limb. However, engineers and therapists must bear in mind the tracking limitations of the Kinect.

Upper limb rehabilitation system based on virtual reality for breast cancer patients: Development and usability study

Background

Functional exercise is crucial for breast cancer patients after surgery, and the use of virtual reality technology to assist patients with postoperative upper limb functional rehabilitation has gradually attracted the attention of researchers. However, the usability of the developed rehabilitation system is still unknown to a large extent. The purpose of this study was to develop a virtual reality upper limb rehabilitation system for patients after breast cancer surgery and to explore its usability.

Methods

We built a multidisciplinary team based on virtual reality and human-computer interaction technology and designed and developed an upper limb function rehabilitation system for breast cancer patients after surgery. Breast cancer patients were recruited from a grade III-a general hospital in Changchun city for the experiment. We used the System Usability Scale to evaluate the system availability, the Presence Questionnaire scale to measure the immersive virtual reality scene, and the Simulator Sickness Questionnaire subjective measurement scale for simulator sickness symptoms.

Results

This upper limb rehabilitation system hardware consisted of Head-mounted Display, a control handle and notebook computers. The software consisted of rehabilitation exercises and game modules. A total of 15 patients were tested on this system, all of whom were female. The mean age was 54.73±7.78 years, and no patients were excluded from the experiment because of adverse reactions such as dizziness and vomiting. The System Usability Scale score was 90.50±5.69, the Presence Questionnaire score was 113.40±9.58, the Simulator Sickness Questionnaire-nausea score was 0.93±1.16, the Simulator Sickness Questionnaire-oculomotor score was 0.80±1.27, the Simulator Sickness Questionnaire-disorientation score was 0.80±1.27, and the Simulator Sickness Questionnaire total score was 2.53±3.40.

Conclusions

This study fills in the blanks regarding the upper limb rehabilitation of breast cancer patients based on virtual reality technology system usability research. As the starting point of research in the future, we will improve the system’s function and design strictly randomized controlled trials, using larger samples in the promotion, to evaluate its application in breast cancer patients with upper limbs and other physiological functions and the feasibility and effects of rehabilitation.

Postural control assessment via Microsoft Azure Kinect DK: An evaluation study

BACKGROUND AND OBJECTIVE

Equipments generally used for entertainment, such as Microsoft Kinect, have been widely used for postural control as well. Such systems-compared to professional motion tracking systems-allow to obtain non-invasive and low-cost tracking. This makes them particularly suitable for the implementation of home rehabilitation systems. Microsoft has recently released a new version of Kinect, namely Azure Kinect DK, that is meant for developers, not consumers, and it has been specifically designed to implement professional applications. The hardware of this new version of the Kinect has been substantially improved as compared with previous versions. However, the accuracy of the Azure Kinect DK has not been evaluated yet in the context of the assessment of postural control as done for its predecessors.

METHODS

We present a study to compare the motion traces of the Azure Kinect DK with those of a Vicon 3D system, typically considered the gold standard for high-accuracy motion tracking. The study involved 26 subjects performing specific functional reach and functional balance exercises.

RESULTS

The results clearly indicates that the Azure Kinect DK provides a very accurate tracking of the main joints of the body for all the recording taken during the lateral reach movement. The Root Mean Square Error (RMSE) between the two tracking systems obtained is approximately 0.2 for the lateral and forward exercises while for the balance exercise it is around 0.47 considering the average of the results among all the joints. The angular Mean Absolute Error is approximately in the range 5-15 degrees for all the upper joints and independently on the exercise. The lower body joints show a higher angular error between the two systems. Not surprisingly, it was found that results are much better in correspondence of slow movements.

CONCLUSIONS

The results achieved that the Azure Kinect DK has an incredibly high potential to be used in applications of home rehabilitation, where the assessment of postural control is a fundamental and crucial activity.

Computer Game-Based Telerehabilitation Platform Targeting Manual Dexterity: Exercise Is Fun. "You Are Kidding-Right?"

There is a need for innovation to improve the engagement and accessibility of rehabilitation programs for children and adults with upper extremity motor impairments due to neurodevelopmental disorders, acquired brain injuries, or spinal cord injuries. For this purpose, a computer game-based telerehabilitation platform (GTP) was developed to address this need. Through the application of a miniature inertial-based computer mouse and the wide variety of commercial computer games, the developed GTP can provide engaging task-specific exercises for the rehabilitation of manual dexterity (object handling and manipulation). A purpose-built repetitive task practice software (RTP) was also developed to gather event data and synchronize it with patient movements during gameplays. This provides automated monitoring and quantification of patients' motor skills, while they practice a range of game-based exercises with their hand and/or arm. The GTP would initially be used in a supervised clinical setting followed by a transition to function at home and be monitored by clinician specialists. Clinical support for home and rural communities, with protocols that can be easily updated, will help increase accessibility to targeted and personalized solutions for patients and achieve the desired training effect.

Balance Measurement Using Microsoft Kinect v2: Towards Remote Evaluation of Patient with the Functional Reach Test

To prevent falls, it is important to measure periodically the balance ability of an individual using reliable clinical tests. As Red Green Blue Depth (RGBD) devices have been increasingly used for balance rehabilitation at home, they may also be used to assess objectively the balance ability and determine the effectiveness of a therapy. For this, we developed a system based on the Microsoft Kinect v2 for measuring the Functional Reach Test (FRT); one of the most used balance clinical tools to predict falls. Two experiments were conducted to compare the FRT measures computed by our system using the Microsoft Kinect v2 with those obtained by the standard method, i.e., manually. In terms of validity, we found a very strong correlation between the two methods (r = 0.97 and r = 0.99 (p < 0.05), for experiments 1 and 2, respectively). However, we needed to correct the measurements using a linear model to fit the data obtained by the Kinect system. Consequently, a linear regression model has been applied and examining the regression assumptions showed that the model works well for the data. Applying the paired t-test to the data after correction indicated that there is no statistically significant difference between the measurements obtained by both methods. As for the reliability of the test, we obtained good to excellent within repeatability of the FRT measurements tracked by Kinect (ICC = 0.86 and ICC = 0.99, for experiments 1 and 2, respectively). These results suggested that the Microsoft Kinect v2 device is reliable and adequate to calculate the standard FRT.

Assessing Children's Fine Motor Skills With Sensor-Augmented Toys: Machine Learning Approach

Background

Approximately 5%-10% of elementary school children show delayed development of fine motor skills. To address these problems, detection is required. Current assessment tools are time-consuming, require a trained supervisor, and are not motivating for children. Sensor-augmented toys and machine learning have been presented as possible solutions to address this problem.

Objective

This study examines whether sensor-augmented toys can be used to assess children’s fine motor skills. The objectives were to (1) predict the outcome of the fine motor skill part of the Movement Assessment Battery for Children Second Edition (fine MABC-2) and (2) study the influence of the classification model, game, type of data, and level of difficulty of the game on the prediction.

Methods

Children in elementary school (n=95, age 7.8 [SD 0.7] years) performed the fine MABC-2 and played 2 games with a sensor-augmented toy called “Futuro Cube.” The game “roadrunner” focused on speed while the game “maze” focused on precision. Each game had several levels of difficulty. While playing, both sensor and game data were collected. Four supervised machine learning classifiers were trained with these data to predict the fine MABC-2 outcome: k-nearest neighbor (KNN), logistic regression (LR), decision tree (DT), and support vector machine (SVM). First, we compared the performances of the games and classifiers. Subsequently, we compared the levels of difficulty and types of data for the classifier and game that performed best on accuracy and F1 score. For all statistical tests, we used α=.05.

Results

The highest achieved mean accuracy (0.76) was achieved with the DT classifier that was trained on both sensor and game data obtained from playing the easiest and the hardest level of the roadrunner game. Significant differences in performance were found in the accuracy scores between data obtained from the roadrunner and maze games (DT, P=.03; KNN, P=.01; LR, P=.02; SVM, P=.04). No significant differences in performance were found in the accuracy scores between the best performing classifier and the other 3 classifiers for both the roadrunner game (DT vs KNN, P=.42; DT vs LR, P=.35; DT vs SVM, P=.08) and the maze game (DT vs KNN, P=.15; DT vs LR, P=.62; DT vs SVM, P=.26). The accuracy of only the best performing level of difficulty (combination of the easiest and hardest level) achieved with the DT classifier trained with sensor and game data obtained from the roadrunner game was significantly better than the combination of the easiest and middle level (P=.046).

Conclusions

The results of our study show that sensor-augmented toys can efficiently predict the fine MABC-2 scores for children in elementary school. Selecting the game type (focusing on speed or precision) and data type (sensor or game data) is more important for determining the performance than selecting the machine learning classifier or level of difficulty.

Virtual Reality Customized 360-Degree Experiences for Stress Relief

The latest studies in virtual reality (VR) have evidenced the potential of this technology to reproduce environments from multiple domains in an immersive way. For instance, in stress relief research, VR has been presented as a portable and inexpensive alternative to chromotherapy rooms, which require an adapted space and are expensive. In this work, we propose a portable and versatile alternative to the traditional chromotherapy color-loop treatment through four different 360-degree virtual experiences. A group of 23 healthy participants (mean age 22.65 ± 5.48) were conducted through a single-session experience divided into four phases while their electroencephalography (EEG) was recorded. First, they were stressed via the Montreal imaging stress task (MIST), and then relaxed using our VR proposal. We applied the Wilcoxon test to evaluate the relaxation effect in terms of the EEG relative gamma and self-perceived stress surveys. The results that we obtained validate the effectiveness of our 360-degree proposal to significantly reduce stress (p-value = 0.0001). Furthermore, the participants deemed our proposal comfortable and immersive (score above 3.5 out of 5). These results suggest that 360-degree VR experiences can mitigate stress, reduce costs, and bring stress relief assistance closer to the general public, like in workplaces or homes.

Serious Games for Stroke Telerehabilitation of Upper Limb - A Review for Future Research

Maintaining appropriate home rehabilitation programs after stroke, with proper adherence and remote monitoring is a challenging task. Virtual reality (VR) - based serious games could be a strategy used in telerehabilitation (TR) to engage patients in an enjoyable and therapeutic approach. The aim of this review was to analyze the background and quality of clinical research on this matter to guide future research. The review was based on research material obtained from PubMed and Cochrane up to April 2020 using the PRISMA approach. The use of VR serious games has shown evidence of efficacy on upper limb TR after stroke, but the evidence strength is still low due to a limited number of randomized controlled trials (RCT), a small number of participants involved, and heterogeneous samples. Although this is a promising strategy to complement conventional rehabilitation, further investigation is needed to strengthen the evidence of effectiveness and support the dissemination of the developed solutions.

Application of AR and VR in hand rehabilitation: A systematic review

BACKGROUND

The human hand is the part of the body most frequently injured in work related accidents, accounting for a third of all accidents at work and often involving surgery and long periods of rehabilitation. Several applications of Augmented Reality (AR) and Virtual Reality (VR) have been used to improve the rehabilitation process. However, there is no sound evidence about the effectiveness of such applications nor the main drivers of therapeutic success.

OBJECTIVES

The objective of this study was to review the efficacy of AR and VR interventions for hand rehabilitation.

METHODS

A systematic search of publications was conducted in October 2019 in IEEE Xplore, Web of Science, Cochrane library, and PubMed databases. Search terms were: (1) video game or videogame, (2) hand, (3) rehabilitation or therapy and (4) VR or AR. Articles were included if (1) were written in English, (2) were about VR or AR applications, (3) were for hand rehabilitation, (4) the intervention had tests on at least ten patients with injuries or diseases which affected hand function and (5) the intervention had baseline or intergroup comparisons (AR or VR intervention group versus conventional physical therapy group). PRISMA protocol guidelines were followed to filter and assess the articles.

RESULTS

From the eight selected works, six showed improvements in the intervention group, and two no statistical differences between groups. We were able to identify motivators of patients' adherence, namely real-time feedback to the patients, challenge, and increased individualized difficulty. Automated tracking, easy integration in the home setting and the recording of accurate metrics may increase the scalability and facilitate healthcare professionals' assessments.

CONCLUSIONS

This systematic review provided advantages and drivers for the success of AR/VR application for hand rehabilitation. The available evidence suggests that patients can benefit from the use of AR or VR interventions for hand rehabilitation.

A Game-Based Rehabilitation System for Upper-Limb Cerebral Palsy: A Feasibility Study

Game-based rehabilitation systems provide an effective tool to engage cerebral palsy patients in physical exercises within an exciting and entertaining environment. A crucial factor to ensure the effectiveness of game-based rehabilitation systems is to assess the correctness of the movements performed by the patient during the game-playing sessions. In this study, we propose a game-based rehabilitation system for upper-limb cerebral palsy that includes three game-based exercises and a computerized assessment method. The game-based exercises aim to engage the participant in shoulder flexion, shoulder horizontal abduction/adduction, and shoulder adduction physical exercises that target the right arm. Human interaction with the game-based rehabilitation system is achieved using a Kinect sensor that tracks the skeleton joints of the participant. The computerized assessment method aims to assess the correctness of the right arm movements during each game-playing session by analyzing the tracking data acquired by the Kinect sensor. To evaluate the performance of the computerized assessment method, two groups of participants volunteered to participate in the game-based exercises. The first group included six cerebral palsy children and the second group included twenty typically developing subjects. For every participant, the computerized assessment method was employed to assess the correctness of the right arm movements in each game-playing session and these computer-based assessments were compared with matching gold standard evaluations provided by an experienced physiotherapist. The results reported in this study suggest the feasibility of employing the computerized assessment method to evaluate the correctness of the right arm movements during the game-playing sessions.

[New perspectives of motor rehabilitation of patients after focal brain lesions]

Rehabilitation of patients after focal brain lesions is one of the topical issues of modern medicine. Motor disorders are known to develop in more than 80% of survivors of stroke and traumatic brain injury and be one of the main causes of disability, which necessitates an active search for new effective techniques for correction of motor disorders. Modern rehabilitation includes both traditional techniques for recovery of patients with motor deficit (exercise therapy and physiotherapy) and botulinum therapy, kinesiotherapy, mechanotherapy, etc., which have been developed in recent years. Robotic technologies have been developed, improved, and implemented. Currently, due to progress in computerization, virtual reality-based rehabilitation of patients is of particular interest. The article reviews the key studies in this field. We describe various visualization methods and means of immersion in a virtual environment for recovery of upper and lower extremity function in patients with focal brain lesions. The study provides an assessment of the effectiveness and safety of various virtual reality-based rehabilitation programs in patients with motor disorders after stroke and traumatic brain injury.

Interactive serious game for shoulder rehabilitation based on real-time hand tracking

BACKGROUND

Virtual reality is becoming popular in the rehabilitation field thanks to the several advantages it can offer to patients and physicians. Indeed, serious games can: motivate and engage the patient; offer different levels of challenge and difficulty based on the patient baseline, and integrate objective measures of the patient's performance during each rehabilitation session.

OBJECTIVE

We designed and implemented a serious game for shoulder rehabilitation based on real-time hand tracking. The aim was to maintain the medical benefits of traditional rehabilitation, while reducing human resources and costs and facilitating active patient participation.

METHODS

Our software application provides the user with a shoulder horizontal adduction exercise. This exercise takes place in a 2D interactive game environment, controlled by hand movements on a desk pad. The hardware includes a standard desktop computer and screen, and the Leap Motion Controller: a hand tracking system. Changing the desk pad material allows the physiotherapist to vary the friction between the user hand and the supporting surface.

RESULTS

Fourteen healthy volunteers and six rehabilitation experts tested our serious game. The results showed that the application is attractive, ergonomic and clinically useful.

CONCLUSION

Despite promising results, clinical validation is necessary to demonstrate the efficacy of the serious game.