Immersive 3D Virtual Reality Cancellation Task for Visual Neglect Assessment: A Pilot Study

The environment as an important component of neurorehabilitation: introducing the BEEhive - brain and enriched environment (BEE) lab (hive)

PURPOSE

Contemporary healthcare design often overlooks the environment as a resource for supporting patient well-being and rehabilitation, particularly in neurotrauma care. The prioritisation of safety and efficiency has created stressful spaces that negatively impact patient needs. This paper explores whether environmental enrichment can enhance rehabilitation outcomes for individuals recovering from neurotrauma. It also introduces the BEEhive laboratory, a multidisciplinary initiative integrating environmental enrichment principles into healthcare.

METHODOLOGY

This paper reviews literature on the role of environmental enrichment in neurotrauma rehabilitation, synthesising empirical evidence on its benefits, and highlighting its potential to improve various aspects of neurorehabilitation. The findings are applied to the BEEhive laboratory's objectives.

RESULTS

Environmental enrichment is shown to stimulate neurogenesis, increase rehabilitation engagement, reduce disruptive behaviours and depressive symptoms, facilitate social relationships, improve cognitive functioning, reduce stress, and alleviate boredom. Despite these benefits, its application in neurotrauma rehabilitation remains underexplored. The BEEhive laboratory aims to address this gap through multidisciplinary collaboration, implementing strategies to enhance patient outcomes.

CONCLUSION

To optimise rehabilitation outcomes, healthcare environments must holistically support well-being. Environmentally focused, sustainable interventions in neurotrauma care, exemplified by the BEEhive initiative, are crucial for bridging the gap between research and practice, fostering innovative approaches to neurotrauma rehabilitation.

An immersive virtual reality serious game set for the clinical assessment of spatial attention impairments: Effects of avatars on perspective?

BACKGROUND

Hemineglect (HN) is a post-stroke condition, frequently defined as an impairment in finding spatial targets within an egocentric frame of reference, where the stimulus is coded relative to the self. However, the egocentric reference frame can change with the presence of another person. Immersive virtual reality (IVR) offers several advantages over paper-and-pencil tests typically used to assess HN, such as a realistic and controlled environment, standardised stimulus presentation, and sensitive response acquisition. We developed a new serious game in IVR to assess HN. Here we investigated (1) the feasibility and user experience of this serious game, and (2) the effect of the presence of an avatar on HN.

METHODS

We first tested a group of 61 control individuals (CI), followed by a group of post-stroke 11 individuals without HN (SI:HN-), 6 with HN (SI:HN+), and 17 resampled age matched group of control individuals (CI). All participants performed the "Peach test", which required them to find and respond to a target presented among distractors, either alone or in the presence of an avatar. We measured response time (RT) and omissions. The SI:HN- and SI:HN + groups also completed a paper-and-pencil test for HN and a user experience questionnaire.

RESULTS

The first analysis of results with CI showed no differences in responding to the target when in ipsi- compared to contra-lateral spaces, nor in peri- compared to extra-personal spaces. There were also no differences in responding to the target in the no-avatar condition relative to the two avatars conditions. In the second analysis, SI:HN + were slower than SI:HN- and CI. Although an interaction between group and Laterality was predicted, the results showed that there was no Laterality effect for any of the groups. An interaction between group and proximity, showed that both SI groups were slower in the extra- compared to peri-personal spaces. The user experience was globally positively rated by the SI.

CONCLUSION

We developed a serious game in IVR for the assessment of HN. Although most our findings were inconclusive, the Peach test showed excellent user experience results.Trial registration http://www.clinicaltrials.gov ; Unique identifier: NCT04694833, Date of registration: 11/24/2020.

Virtual reality in clinical evaluation of Unilateral Spatial Neglect, anatomy of current trends: A scoping review

BACKGROUND

Virtual technologies (VR) could respond to several challenges in Unilateral Spatial Neglect (USN) assessment, particularly the lack of sensitivity and ecological validity of traditional paper-and-pencil tests. A scoping review was conducted to explore current trends in this area.

METHODS

PubMed, EMBASE, PsycINFO, Web of Science, IEEE, ACM, and the Cochrane Library were systematically searched for VR USN assessment. The Joanna Briggs Institute methodological guidelines for scoping reviews were used to inform our methodology.

RESULTS

Thirty-one publications were included. There were two populations: healthy adults (n = 349) and post-stroke individuals (n = 903). A classification based on tasks and type of interaction used was proposed. Correlations with paper and pencil tests (PPTs) were often significant when the task structure was similar to PPTs but was lacking for activities with more dynamic components. The ecological validity of the tasks was assessed in comparison with the Catherine Bergego Scale (n = 4) and a real-world navigation task (n = 1). Using VR, USN disorders have been characterized using a wide range of indicators.

CONCLUSIONS

Few studies have addressed ecological validity, yet the use of VR in the assessment of the USN in this scoping review shows an undeniable contribution compared to traditional pencil-paper tests, especially for capturing the patient's behavior toward the far extrapersonal space, essential in daily life.

Gamified devices for stroke rehabilitation: A systematic review

BACKGROUND AND OBJECTIVE

Rehabilitation after stroke is essential to minimize permanent disability. Gamification, the integration of game elements into non-game environments, has emerged as a promising strategy for increasing motivation and rehabilitation effectiveness. This article systematically reviews the gamified devices used in stroke rehabilitation and evaluates their impact on emotional, social, and personal effects on patients, providing a comprehensive view of gamified rehabilitation.

METHODS

A comprehensive search using the PRISMA 2020 guidelines was conducted using the IEEE Xplore, PubMed, Springer Link, APA PsycInfo, and ScienceDirect databases. Empirical studies published between January 2019 and December 2023 that quantified the effects of gamification in terms of usability, motivation, engagement, and other qualitative patient responses were selected.

RESULTS

In total, 169 studies involving 6404 patients were included. Gamified devices are categorized into four types: robotic/motorized, non-motorized, virtual reality, and neuromuscular electrical stimulation. The results showed that gamified devices not only improved motor and cognitive function but also had a significant positive impact on patients' emotional, social and personal levels. Most studies have reported high levels of patient satisfaction and motivation, highlighting the effectiveness of gamification in stroke rehabilitation.

CONCLUSIONS

Gamification in stroke rehabilitation offers significant benefits beyond motor and cognitive recovery by improving patients' emotional and social well-being. This systematic review provides a comprehensive overview of the most effective gamified technologies and highlights the need for future multidisciplinary research to optimize the design and implementation of gamified solutions in stroke rehabilitation.

An immersive virtual reality tool for assessing left and right unilateral spatial neglect

The reported rate of the occurrence of unilateral spatial neglect (USN) is highly variable likely due to the lack of validity and low sensitivity of classical tools used to assess it. Virtual reality (VR) assessments try to overcome these limitations by proposing immersive and complex environments. Nevertheless, existing VR-based tasks are mostly focused only on near space and lack analysis of psychometric properties and/or clinical validation. The present study evaluates the clinical validity and sensitivity of a new immersive VR-based task to assess USN in the extra-personal space and examines the neuronal correlates of deficits of far space exploration. The task was administrated to two groups of patients with right (N = 28) or left (N = 11) hemispheric brain lesions, also undergoing classical paper-and-pencil assessment, as well as a group of healthy participants. Our VR-based task detected 44% of neglect cases compared to 31% by paper-and-pencil tests in the total sample. Importantly, 30% of the patients (with right or left brain lesions) with no clear sign of USN on the paper-and-pencil tests performed outside the normal range in the VR-based task. Voxel lesion-symptom mapping revealed that deficits detected in VR were associated with lesions in insular and temporal cortex, part of the neural network involved in spatial processing. These results show that our immersive VR-based task is efficient and sensitive in detecting mild to strong manifestations of USN affecting the extra-personal space, which may be undetected using standard tools.

Impact of VR-Based Cognitive Training on Working Memory and Inhibitory Control in IDD Young Adults

BACKGROUND

Young people with intellectual developmental disabilities have a persistent delay in the development of executive functions. Virtual reality (VR) is increasingly being used as a cognitive intervention tool, with significant effectiveness demonstrated in different types of populations.

METHODS

This pilot study aims to investigate the impact of a cognitive training program utilizing VR on young adults diagnosed with intellectual developmental disabilities (IDDs). The participants (N = 15) served as their own control group and were assessed three times: weeks 0, 8, and 16, with a rest period (0-8 weeks) and an intervention period (8-16 weeks). The assessments included measures of cognitive function provided by E-Prime® (Version 3).

RESULTS

Overall, an improvement in working memory and inhibitory control was found after the intervention, but not in sustained attention.

CONCLUSIONS

These findings suggest that VR-based cognitive training holds promise as an effective intervention for enhancing cognitive abilities in young adults with intellectual developmental disabilities. This study provides a foundation for future investigations into VR's role in cognitive rehabilitation and its potential to support daily living skills and overall quality of life for individuals with IDDs. Further research is needed to explore the long-term effects and broader applicability of VR interventions.

The Neuropsychological Assessment of Unilateral Spatial Neglect Through Computerized and Virtual Reality Tools: A Scoping Review

Unilateral Spatial Neglect is a disabling neuropsychological deficit. Patients with spatial neglect fail to detect and report events, and to perform actions in the side of space contralateral to a hemispheric cerebral lesion. Neglect is assessed by evaluating the patients' abilities in daily life activities and by psychometric tests. Computer-based, portable and Virtual Reality technologies may provide more and precise data, and be more sensitive and informative, compared to current paper-and-pencil procedures. Studies since 2010, in which such technologies have been used, are reviewed. Forty-two articles meeting inclusion criteria are categorized according to their technological approaches (computer-, graphics tablet or tablet-, virtual reality-based assessment, and other). The results are promising. However, a definite golden standard, technologically based procedure cannot be still established. Developing technologically based tests is a laborious process, which requires technical and user experience improvements as well as normative data, to increase the evidence of efficacy for clinical evaluation of at least some of the tests considered in this review.

Feasibility and relevance of an immersive virtual reality cancellation task assessing far space in unilateral spatial neglect

Unilateral spatial neglect (USN) is a highly prevalent neuropsychological syndrome. However, its assessment in clinical practice, mainly based on paper-and-pencil tests, encounters limits as only near space, called peripersonal, is assessed. However, USN is a multicomponent syndrome that can also affect far space, called extrapersonal. This space is not assessed in current clinical assessment although it can be more impacted than peripersonal space. Immersive virtual reality (VR) allows developing tasks in far space to assess this heterogeneity. This study aimed to test the feasibility and the relevance of an immersive VR task to assess far space. A cancellation task, the Bells test, was used in its original paper-and-pencil version and was also adapted into a far immersive VR version. Ten patients with left USN and sixteen age-matched healthy participants were included. A single-case method was performed to investigate the performance of each patient. Although five patients showed very similar results between both versions, the five others exhibited a dissociation with a more severe impairment in the VR version. Three of these five patients significantly differed from the healthy participants only on the VR version. As USN in far space is not brought to light by paper-and-pencil tests, immersive VR appears as a promising tool to detect USN affecting this space.

Advancements in brain-computer interfaces for the rehabilitation of unilateral spatial neglect: a concise review

This short review examines recent advancements in neurotechnologies within the context of managing unilateral spatial neglect (USN), a common condition following stroke. Despite the success of brain-computer interfaces (BCIs) in restoring motor function, there is a notable absence of effective BCI devices for treating cerebral visual impairments, a prevalent consequence of brain lesions that significantly hinders rehabilitation. This review analyzes current non-invasive BCIs and technological solutions dedicated to cognitive rehabilitation, with a focus on visuo-attentional disorders. We emphasize the need for further research into the use of BCIs for managing cognitive impairments and propose a new potential solution for USN rehabilitation, by combining the clinical subtleties of this syndrome with the technological advancements made in the field of neurotechnologies.

Virtual reality gameplay classification illustrates the multidimensionality of visuospatial neglect

Brain injuries can significantly impact mental processes and lead to hidden disabilities not easily detectable. Traditional methods for assessing these impacts are imprecise, leading to unreliable prevalence estimates and treatments with uncertain effectiveness. Immersive virtual reality has shown promise for assessment, but its use as a standalone tool is rare. Our research focused on developing and validating a standalone immersive virtual reality classification system for unilateral spatial neglect, a condition common following brain injury characterized by inattention to one side of space. Our study involved 51 brain injury inpatients and 30 controls, all engaging with 'The Attention Atlas', an immersive virtual reality game for testing visual search skills. Our classification system aimed to identify patients with neglect, 'minor atypicality' (indicative of inattention not consistent enough to be labelled as neglect) or non-neglect. This categorization was based on a simple mathematical definition, utilizing gameplay to describe spatial orientation (to the left or right side) and attentional challenge (indicative of search inefficiency). These metrics were benchmarked against a normative model to detect atypical visual search, which refers to gameplay beyond the usual bounds. The combination of neglected side, orientation and challenge factors was used to categorize neglect. We discovered a strong correlation between atypical visual search patterns and neglect risk factors, such as middle cerebral artery stroke, parietal injuries and existing neglect diagnoses (Poisson regression incidence rate ratio = 7.18, 95% confidence interval = 4.41-11.90). In our study, immersive virtual reality-identified neglect in one-fourth of the patients (n = 13, 25.5%), minor atypicality in 17.6% (n = 9) and non-neglect in the majority, 56.9% (n = 29). This contrasts with standard assessments, which detected neglect in 17.6% (n = 9) of cases and had no intermediate category. Our analysis determined six categories of neglect, the most common being left hemispace neglect with above-median orientation and challenge scores. Traditional assessments were not significantly more accurate (accuracy = 84.3%, P = 0.06) than a blanket assumption of non-neglect. Traditional assessments were also relatively insensitive in detecting immersive virtual reality-identified neglect (53.8%), particularly in less severe cases and those involving right-side inattention. Our findings underline the effectiveness of immersive virtual reality in revealing various dimensions of neglect, surpassing traditional methods in sensitivity and detail and operating independently from them. To integrate immersive virtual reality into real-world clinical settings, collaboration with healthcare professionals, patients and other stakeholders is crucial to ensure practical applicability and accessibility.

Application of immersive virtual reality for assessing chronic neglect in individuals with stroke: the immersive virtual road-crossing task

BACKGROUND

Neglect can be a long-term consequence of chronic stroke that can impede an individual's ability to perform daily activities, but chronic and discrete forms can be difficult to detect. We developed and evaluated the "immersive virtual road-crossing task" (iVRoad) to identify and quantify discrete neglect symptoms in chronic stroke patients.

METHOD

The iVRoad task requires crossing virtual intersections and placing a letter in a mailbox placed either on the left or right. We tested three groups using the HTC Vive Pro Eye: (1) chronic right hemisphere stroke patients with (N = 20) and (2) without (N = 20) chronic left-sided neglect, and (3) age and gender-matched healthy controls (N = 20). We analyzed temporal parameters, errors, and head rotation to identify group-specific patterns, and applied questionnaires to measure self-assessed pedestrian behavior and usability.

RESULTS

Overall, the task was well-tolerated by all participants with fewer cybersickness-induced symptoms after the VR exposure than before. Reaction time, left-sided errors, and lateral head movements for traffic from left most clearly distinguished between groups. Neglect patients committed more dangerous crossings, but their self-rated pedestrian behavior did not differ from that of stroke patients without neglect. This demonstrates their reduced awareness of the risks in everyday life and highlights the clinical relevance of the task.

CONCLUSIONS

Our findings suggest that a virtual road crossing task, such as iVRoad, has the potential to identify subtle symptoms of neglect by providing virtual scenarios that more closely resemble the demands and challenges of everyday life. iVRoad is an immersive, naturalistic virtual reality task that can measure clinically relevant behavioral variance and identify discrete neglect symptoms.

Extended reality to assess post-stroke manual dexterity: contrasts between the classic box and block test, immersive virtual reality with controllers, with hand-tracking, and mixed-reality tests

BACKGROUND

Recent technological advancements present promising opportunities to enhance the frequency and objectivity of functional assessments, aligning with recent stroke rehabilitation guidelines. Within this framework, we designed and adapted different manual dexterity tests in extended reality (XR), using immersive virtual reality (VR) with controllers (BBT-VR-C), immersive VR with hand-tracking (BBT-VR-HT), and mixed-reality (MD-MR).

OBJECTIVE

This study primarily aimed to assess and compare the validity of the BBT-VR-C, BBT-VR-HT and MD-MR to assess post-stroke manual dexterity. Secondary objectives were to evaluate reliability, usability and to define arm kinematics measures.

METHODS

A sample of 21 healthy control participants (HCP) and 21 stroke individuals with hemiparesis (IHP) completed three trials of the traditional BBT, the BBT-VR-C, BBT-VR-HT and MD-MR. Content validity of the different tests were evaluated by asking five healthcare professionals to rate the difficulty of performing each test in comparison to the traditional BBT. Convergent validity was evaluated through correlations between the scores of the traditional BBT and the XR tests. Test-retest reliability was assessed through correlations between the second and third trial and usability was assessed using the System Usability Scale (SUS). Lastly, upper limb movement smoothness (SPARC) was compared between IHP and HCP for both BBT-VR test versions.

RESULTS

For content validity, healthcare professionals rated the BBT-VR-HT (0[0-1]) and BBT-MR (0[0-1]) as equally difficult to the traditional BBT, whereas they rated BBT-VR-C as more difficult than the traditional BBT (1[0-2]). For IHP convergent validity, the Pearson tests demonstrated larger correlations between the scores of BBT and BBT-VR-HT (r = 0.94;p < 0.001), and BBT and MD-MR (r = 0.95;p < 0.001) than BBT and BBT-VR-C (r = 0.65;p = 0.001). BBT-VR-HT and MD-MR usability were both rated as excellent, with median SUS scores of 83[57.5-91.3] and 83[53.8-92.5] respectively. Excellent reliability was found for the BBT-VR-C (ICC = 0.96;p < 0.001), BBT-VR-HT (ICC = 0.96;p < 0.001) and BBT-MR (ICC = 0.99;p < 0.001). The usability of the BBT-VR-C was rated as good with a median SUS of 70[43.8-83.8]. Upper limb movements of HCP were significantly smoother than for IHP when completing either the BBT-VR-C (t = 2.05;p = 0.043) and the BBT-VR-HT (t = 5.21;p < 0.001).

CONCLUSION

The different XR manual tests are valid, short-term reliable and usable tools to assess post-stroke manual dexterity.

TRIAL REGISTRATION

https://clinicaltrials.gov/ct2/show/NCT04694833 ; Unique identifier: NCT04694833, Date of registration: 11/24/2020.

Virtual reality tasks with eye tracking for mild spatial neglect assessment: a pilot study with acute stroke patients

Objective

Increasing evidence shows that traditional neuropsychological tests are insensitive for detecting mild unilateral spatial neglect (USN), lack ecological validity, and are unable to clarify USN in all different spatial domains. Here we present a new, fully immersive virtual reality (VR) task battery with integrated eye tracking for mild visual USN and extinction assessment in the acute state of stroke to overthrow these limitations.

Methods

We included 11 right-sided stroke patients and 10 healthy controls aged 18-75 years. Three VR tasks named the Extinction, the Storage and the Shoot the target tasks were developed to assess USN. Furthermore, neuropsychological assessment examining various parts of cognitive functioning was conducted to measure general abilities. We compared VR and neuropsychological task performance in stroke patients - those with (USN+, n = 5) and without USN (USN-, n = 6) - to healthy controls (n = 10) and tentatively reported the usability of VR system in the acute state of stroke.

Results

Patients had mostly mild neurological and USN symptoms. Nonetheless, we found several differences between the USN+ and healthy control groups in VR task performance. Compared to controls, USN+ patients showed visual extinction and asymmetry in gaze behavior and detection times in distinct spatial locations. Extinction was most evident in the extrapersonal space and delayed detection times on the extreme left and on the left upper parts. Also, USN+ patients needed more time to complete TMT A compared with USN- patients and TMT B compared with controls. VR system usability and acceptance were rated high; no relevant adverse effects occurred.

Conclusion

New VR technology with eye tracking enables ecologically valid and objective assessment methods with various exact measures for mild USN and thus could potentially improve future clinical assessments.

The attention atlas virtual reality platform maps three-dimensional (3D) attention in unilateral spatial neglect patients: a protocol

BACKGROUND

Deficits in visuospatial attention, known as neglect, are common following brain injury, but underdiagnosed and poorly treated, resulting in long-term cognitive disability. In clinical settings, neglect is often assessed using simple pen-and-paper tests. While convenient, these cannot characterise the full spectrum of neglect. This protocol reports a research programme that compares traditional neglect assessments with a novel virtual reality attention assessment platform: The Attention Atlas (AA).

METHODS/DESIGN

The AA was codesigned by researchers and clinicians to meet the clinical need for improved neglect assessment. The AA uses a visual search paradigm to map the attended space in three dimensions and seeks to identify the optimal parameters that best distinguish neglect from non-neglect, and the spectrum of neglect, by providing near-time feedback to clinicians on system-level behavioural performance. A series of experiments will address procedural, scientific, patient, and clinical feasibility domains.

RESULTS

Analyses focuses on descriptive measures of reaction time, accuracy data for target localisation, and histogram-based raycast attentional mapping analysis; which measures the individual's orientation in space, and inter- and intra-individual variation of visuospatial attention. We will compare neglect and control data using parametric between-subjects analyses. We present example individual-level results produced in near-time during visual search.

CONCLUSIONS

The development and validation of the AA is part of a new generation of translational neuroscience that exploits the latest advances in technology and brain science, including technology repurposed from the consumer gaming market. This approach to rehabilitation has the potential for highly accurate, highly engaging, personalised care.

Immersive virtual reality gameplay detects visuospatial atypicality, including unilateral spatial neglect, following brain injury: a pilot study

BACKGROUND

In neurorehabilitation, problems with visuospatial attention, including unilateral spatial neglect, are prevalent and routinely assessed by pen-and-paper tests, which are limited in accuracy and sensitivity. Immersive virtual reality (VR), which motivates a much wider (more intuitive) spatial behaviour, promises new futures for identifying visuospatial atypicality in multiple measures, which reflects cognitive and motor diversity across individuals with brain injuries.

METHODS

In this pilot study, we had 9 clinician controls (mean age 43 years; 4 males) and 13 neurorehabilitation inpatients (mean age 59 years; 9 males) recruited a mean of 41 days post-injury play a VR visual search game. Primary injuries included 7 stroke, 4 traumatic brain injury, 2 other acquired brain injury. Three patients were identified as having left sided neglect prior to taking part in the VR. Response accuracy, reaction time, and headset and controller raycast orientation quantified gameplay. Normative modelling identified the typical gameplay bounds, and visuospatial atypicality was defined as gameplay beyond these bounds.

RESULTS

The study found VR to be feasible, with only minor instances of motion sickness, positive user experiences, and satisfactory system usability. Crucially, the analytical method, which emphasized identifying 'visuospatial atypicality,' proved effective. Visuospatial atypicality was more commonly observed in patients compared to controls and was prevalent in both groups of patients-those with and without neglect.

CONCLUSION

Our research indicates that normative modelling of VR gameplay is a promising tool for identifying visuospatial atypicality after acute brain injury. This approach holds potential for a detailed examination of neglect.

Visual feedback and age affect upper limb reaching accuracy and kinematics in immersive virtual reality among healthy adults

This cross-sectional study aimed to evaluate the effect of visual feedback, age and movement repetition on the upper limb (UL) accuracy and kinematics during a reaching task in immersive virtual reality (VR). Fifty-one healthy participants were asked to perform 25 trials of a reaching task in immersive VR with and without visual feedback of their hand. They were instructed to place, as accurately and as fast as possible, a controller held in their non-dominant hand in the centre of a virtual red cube of 3 cm side length. For each trial, the end-point error (distance between the tip of the controller and the centre of the cube), a coefficient of linearity (CL), the movement time (MT), and the spectral arc length of the velocity signal (SPARC), which is a movement smoothness index, were calculated. Multivariate analyses of variance were conducted to assess the influence of visual feedback, age and trial repetition on the average end-point error, SPARC, CL and MT, and their time course throughout the 25 trials. Providing visual feedback of the hand reduced average end-point error ( P  < 0.001) and MT ( P  = 0.044), improved SPARC ( P  < 0.001) but did not affect CL ( P  = 0.07). Younger participants obtained a lower mean end-point error ( P  = 0.037), a higher SPARC ( P  = 0.021) and CL ( P  = 0.013). MT was not affected by age ( P  = 0.671). Trial repetition increased SPARC ( P  < 0.001) and CL ( P  < 0.001), and reduced MT ( P  = 0.001) but did not affect end-point error ( P  = 0.608). In conclusion, the results of this study demonstrated that providing visual feedback of the hand and being younger improves UL accuracy and movement smoothness in immersive VR. UL kinematics but not accuracy can be improved with more trial repetitions. These findings could guide the future development of protocols in clinical rehabilitation and research.

Physically real and virtual reality exposed line bisection response patterns: visuospatial attention allocation in virtual reality

INTRODUCTION

To understand the nature of hemispatial attention allocation in virtual reality (VR), a line bisection task (LBT) was administered both in a real environment and a virtual environment to assess the rate of pseudoneglect. The mental construction of real and virtual environments was assumed to increase visuospatial activity in right hemisphere-related cognitive processes; an alteration in the activity that manifests in the direction and rate of line bisection lateral error.

METHODS

In the present study, fifty-one right-handed healthy college students were recruited. They performed a line bisection task in real and virtual environments.

RESULTS

The obtained data showed that LBT errors in real and VR environments were correlated and individually consistent. Furthermore, a leftward LBT error was found in the physically real environment, however, in a VR the line bisection bias drifted towards the right hemispace. Participants with a lower right-handedness score showed a lower rate of left LBT bias in a real environment, but in VR, their LBT error showed a stronger rightwards error.

DISCUSSION

Participants showed an individually consistent pattern in both real and VR environments, but VR-induced visuospatial reality construction was associated with rightward LBT bias in a virtual environment.

Speech-Language Pathologists' Views of Using Virtual Reality for Managing Cognitive-Communication Disorders Following Traumatic Brain Injury

PURPOSE

Using virtual reality (VR) to support rehabilitation is an emerging area of research that may offer people with communication disorders a stable and safe communication environment to practice their communication skills. There are currently no VR applications that have been designed to assess or treat cognitive-communication disorders (CCDs) following traumatic brain injury (TBI). Therefore, this study aimed to explore the views of speech-language pathologists (SLPs) who work with people who have a TBI to generate ideas and considerations for using VR in rehabilitation for CCDs. VR researchers were included to provide expert advice about VR technology.

METHOD

A total of 14 SLPs and three VR specialists participated in an online interview or focus group. Semistructured discussions explored participants' perspectives related to potential ideas for VR use and any perceived barriers and facilitators to VR implementation for managing CCDs following TBI. Data were video- and audio-recorded, transcribed, and analyzed qualitatively using thematic analysis.

RESULTS

Three main themes were generated from thematic analysis: VR is a tool that could enhance clinical practice, the need to consider and navigate potential red flags, and solutions to pave the way forward. Suggestions to overcome perceived barriers to VR use were also provided.

DISCUSSION

Participants expressed interest in using VR for rehabilitation of CCDs following TBI. However, potential barriers and risks to use should be considered prior to implementation. The findings offer guidance to support future research and development of VR in this field.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21669647.

An immersive virtual reality system for ecological assessment of peripersonal and extrapersonal unilateral spatial neglect

BACKGROUND

Unilateral spatial neglect (USN) is a debilitating neuropsychological syndrome that often follows brain injury, in particular a stroke affecting the right hemisphere. In current clinical practice, the assessment of neglect is based on old-fashioned paper-and-pencil and behavioral tasks, and sometimes relies on the examiner's subjective judgment. Therefore, there is a need for more exhaustive, objective and ecological assessments of USN.

METHODS

In this paper, we present two tasks in immersive virtual reality to assess peripersonal and extrapersonal USN. The tasks are designed with several levels of difficulty to increase sensitivity of the assessment. We then validate the feasibility of both assessments in a group of healthy adult participants.

RESULTS

We report data from a study with a group of neurologically unimpaired participants (N = 39). The results yield positive feedback on comfort, usability and design of the tasks. We propose new objective scores based on participant's performance captured by head gaze and hand position information, including, for instance, time of exploration, moving time towards left/right and time-to-reach, which could be used for the evaluation of the attentional spatial bias with neurological patients. Together with the number of omissions, the new proposed parameters can result in lateralized index ratios as a measure of asymmetry in space exploration.

CONCLUSIONS

We presented two innovative assessments for USN based on immersive virtual reality, evaluating the far and the near space, using ecological tasks in multimodal, realistic environments. The proposed protocols and objective scores can help distinguish neurological patients with and without USN.

Virtual reality technology in neuropsychological testing: A systematic review

Neuropsychological testing aims to measure individuals' cognitive abilities (e.g. memory, attention), analysing their performance on specific behavioural tasks. Most neuropsychological tests are administered in the so-called 'paper-and-pencil' modality or via computerised protocols. The adequacy of these procedures has been recently questioned, with more specific concerns about their ecological validity, i.e. the relation between test scores observed in the laboratory setting and the actual everyday cognitive functioning. In developing more ecological tasks, researchers started to implement virtual reality (VR) technology as an administration technique focused on exposing individuals to simulated but realistic stimuli and environments, maintaining at the same time a controlled laboratory setting and collecting advanced measures of cognitive functioning. This systematic review aims to present how VR procedures for neuropsychological testing have been implemented in the last years. We initially explain the rationale for supporting VR as an advanced assessment tool, but we also discuss the challenges and risks that can limit the widespread implementation of this technology. Then, we systematised the large body of studies adopting VR for neuropsychological testing, describing the VR tools' distribution amongst different cognitive functions through a PRISMA-guided systematic review. The systematic review highlighted that only very few instruments are ready for clinical use, reporting psychometric proprieties (e.g. validity) and providing normative data. Most of the tools still need to be standardised on large cohorts of participants, having published only limited data on small samples up to now. Finally, we discussed the possible future directions of the VR neuropsychological test development linked to technological advances.

Effect of immersive visualization technologies on cognitive load, motivation, usability, and embodiment

Virtual reality (VR) is a promising tool to promote motor (re)learning in healthy users and brain-injured patients. However, in current VR-based motor training, movements of the users performed in a three-dimensional space are usually visualized on computer screens, televisions, or projection systems, which lack depth cues (2D screen), and thus, display information using only monocular depth cues. The reduced depth cues and the visuospatial transformation from the movements performed in a three-dimensional space to their two-dimensional indirect visualization on the 2D screen may add cognitive load, reducing VR usability, especially in users suffering from cognitive impairments. These 2D screens might further reduce the learning outcomes if they limit users' motivation and embodiment, factors previously associated with better motor performance. The goal of this study was to evaluate the potential benefits of more immersive technologies using head-mounted displays (HMDs). As a first step towards potential clinical implementation, we ran an experiment with 20 healthy participants who simultaneously performed a 3D motor reaching and a cognitive counting task using: (1) (immersive) VR (IVR) HMD, (2) augmented reality (AR) HMD, and (3) computer screen (2D screen). In a previous analysis, we reported improved movement quality when movements were visualized with IVR than with a 2D screen. Here, we present results from the analysis of questionnaires to evaluate whether the visualization technology impacted users' cognitive load, motivation, technology usability, and embodiment. Reports on cognitive load did not differ across visualization technologies. However, IVR was more motivating and usable than AR and the 2D screen. Both IVR and AR rea ched higher embodiment level than the 2D screen. Our results support our previous finding that IVR HMDs seem to be more suitable than the common 2D screens employed in VR-based therapy when training 3D movements. For AR, it is still unknown whether the absence of benefit over the 2D screen is due to the visualization technology per se or to technical limitations specific to the device.

Rapid assessment of hand reaching using virtual reality and application in cerebellar stroke

The acquisition of sensory information about the world is a dynamic and interactive experience, yet the majority of sensory research focuses on perception without action and is conducted with participants who are passive observers with very limited control over their environment. This approach allows for highly controlled, repeatable experiments and has led to major advances in our understanding of basic sensory processing. Typical human perceptual experiences, however, are far more complex than conventional action-perception experiments and often involve bi-directional interactions between perception and action. Innovations in virtual reality (VR) technology offer an approach to close this notable disconnect between perceptual experiences and experiments. VR experiments can be conducted with a high level of empirical control while also allowing for movement and agency as well as controlled naturalistic environments. New VR technology also permits tracking of fine hand movements, allowing for seamless empirical integration of perception and action. Here, we used VR to assess how multisensory information and cognitive demands affect hand movements while reaching for virtual targets. First, we manipulated the visibility of the reaching hand to uncouple vision and proprioception in a task measuring accuracy while reaching toward a virtual target (n = 20, healthy young adults). The results, which as expected revealed multisensory facilitation, provided a rapid and a highly sensitive measure of isolated proprioceptive accuracy. In the second experiment, we presented the virtual target only briefly and showed that VR can be used as an efficient and robust measurement of spatial memory (n = 18, healthy young adults). Finally, to assess the feasibility of using VR to study perception and action in populations with physical disabilities, we showed that the results from the visual-proprioceptive task generalize to two patients with recent cerebellar stroke. Overall, we show that VR coupled with hand-tracking offers an efficient and adaptable way to study human perception and action.

Detection of Stroke-Induced Visual Neglect and Target Response Prediction Using Augmented Reality and Electroencephalography

We aim to build a system incorporating electroencephalography (EEG) and augmented reality (AR) that is capable of identifying the presence of visual spatial neglect (SN) and mapping the estimated neglected visual field. An EEG-based brain-computer interface (BCI) was used to identify those spatiospectral features that best detect participants with SN among stroke survivors using their EEG responses to ipsilesional and contralesional visual stimuli. Frontal-central delta and alpha, frontal-parietal theta, Fp1 beta, and left frontal gamma were found to be important features for neglect detection. Additionally, temporal analysis of the responses shows that the proposed model is accurate in detecting potentially neglected targets. These targets were predicted using common spatial patterns as the feature extraction algorithm and regularized discriminant analysis combined with kernel density estimation for classification. With our preliminary results, our system shows promise for reliably detecting the presence of SN and predicting visual target responses in stroke patients with SN.

Improving the Telemedicine Evaluation of Patients With Acute Vision Loss: A Call to Eyes

Acute vision loss related to cerebral or retinal ischemia is a time-sensitive emergency with potential treatment options including intravenous or intraarterial thrombolysis and mechanical thrombectomy. However, patients either present in delayed fashion or present to an emergency department that lacks the subspecialty expertise to recognize and treat these conditions in a timely fashion. Moreover, healthcare systems in the United States are becoming increasingly reliant on telestroke and teleneurology services for acute neurologic care, making accurate diagnosis of acute vision loss even more challenging due to critical limitations to the remote video evaluation, including the inability to perform routine ophthalmoscopy. The COVID-19 pandemic has led to a greater reliance on telemedicine services and helped to accelerate the development of novel tools and care pathways to improve remote ophthalmologic evaluation, but these tools have yet to be adapted for use in the remote evaluation of acute vision loss. Permanent vision loss can be disabling for patients and efforts must be made to increase and improve early diagnosis and management. Herein, the authors outline the importance of improving acute ophthalmologic diagnosis, outline key limitations and barriers to the current video-based teleneurology assessments, highlight opportunities to leverage new tools to enhance the remote assessment of vision loss, and propose new avenues to improve access to emergent ophthalmology subspeciality.

Virtual reality for the assessment and rehabilitation of neglect: where are we now? A 6-year review update

Unilateral spatial neglect (USN) is a frequent repercussion of a cerebrovascular accident, typically a stroke. USN patients fail to orient their attention to the contralesional side to detect auditory, visual, and somatosensory stimuli, as well as to collect and purposely use this information. Traditional methods for USN assessment and rehabilitation include paper-and-pencil procedures, which address cognitive functions as isolated from other aspects of patients' functioning within a real-life context. This might compromise the ecological validity of these procedures and limit their generalizability; moreover, USN evaluation and treatment currently lacks a gold standard. The field of technology has provided several promising tools that have been integrated within the clinical practice; over the years, a "first wave" has promoted computerized methods, which cannot provide an ecological and realistic environment and tasks. Thus, a "second wave" has fostered the implementation of virtual reality (VR) devices that, with different degrees of immersiveness, induce a sense of presence and allow patients to actively interact within the life-like setting. The present paper provides an updated, comprehensive picture of VR devices in the assessment and rehabilitation of USN, building on the review of Pedroli et al. (2015). The present paper analyzes the methodological and technological aspects of the studies selected, considering the issue of usability and ecological validity of virtual environments and tasks. Despite the technological advancement, the studies in this field lack methodological rigor as well as a proper evaluation of VR usability and should improve the ecological validity of VR-based assessment and rehabilitation of USN.

Effects of Virtual Reality-Based Multimodal Audio-Tactile Cueing in Patients With Spatial Attention Deficits: Pilot Usability Study

BACKGROUND

Virtual reality (VR) devices are increasingly being used in medicine and other areas for a broad spectrum of applications. One of the possible applications of VR involves the creation of an environment manipulated in a way that helps patients with disturbances in the spatial allocation of visual attention (so-called hemispatial neglect). One approach to ameliorate neglect is to apply cross-modal cues (ie, cues in sensory modalities other than the visual one, eg, auditory and tactile) to guide visual attention toward the neglected space. So far, no study has investigated the effects of audio-tactile cues in VR on the spatial deployment of visual attention in neglect patients.

OBJECTIVE

This pilot study aimed to investigate the feasibility and usability of multimodal (audio-tactile) cueing, as implemented in a 3D VR setting, in patients with neglect, and obtain preliminary results concerning the effects of different types of cues on visual attention allocation compared with noncued conditions.

METHODS

Patients were placed in a virtual environment using a head-mounted display (HMD). The inlay of the HMD was equipped to deliver tactile feedback to the forehead. The task was to find and flag appearing birds. The birds could appear at 4 different presentation angles (lateral and paracentral on the left and right sides), and with (auditory, tactile, or audio-tactile cue) or without (no cue) a spatially meaningful cue. The task usability and feasibility, and 2 simple in-task measures (performance and early orientation) were assessed in 12 right-hemispheric stroke patients with neglect (5 with and 7 without additional somatosensory impairment).

RESULTS

The new VR setup showed high usability (mean score 10.2, SD 1.85; maximum score 12) and no relevant side effects (mean score 0.833, SD 0.834; maximum score 21). A repeated measures ANOVA on task performance data, with presentation angle, cue type, and group as factors, revealed a significant main effect of cue type (F30,3=9.863; P<.001) and a significant 3-way interaction (F90,9=2.057; P=.04). Post-hoc analyses revealed that among patients without somatosensory impairment, any cue led to better performance compared with no cue, for targets on the left side, and audio-tactile cues did not seem to have additive effects. Among patients with somatosensory impairment, performance was better with both auditory and audio-tactile cueing than with no cue, at every presentation angle; conversely, tactile cueing alone had no significant effect at any presentation angle. Analysis of early orientation data showed that any type of cue triggered better orientation in both groups for lateral presentation angles, possibly reflecting an early alerting effect.

CONCLUSIONS

Overall, audio-tactile cueing seems to be a promising method to guide patient attention. For instance, in the future, it could be used as an add-on method that supports attentional orientation during established therapeutic approaches.

Virtual Reality and Eye-Tracking Assessment, and Treatment of Unilateral Spatial Neglect: Systematic Review and Future Prospects

Unilateral spatial neglect (USN) is a disorder characterized by the failure to report, respond to, or orient toward the contralateral side of space to a brain lesion. Current assessment methods often fail to discover milder forms, cannot differentiate between unilateral spatial neglect subtypes and lack ecological validity. There is also a need for treatment methods that target subtypes. Immersive virtual reality (VR) systems in combination with eye-tracking (ET) have the potential to overcome these shortcomings, by providing more naturalistic environments and tasks, with sensitive and detailed measures. This systematic review examines the state of the art of research on these technologies as applied in the assessment and treatment of USN. As we found no studies that combined immersive VR and ET, we reviewed these approaches individually. The review of VR included seven articles, the ET review twelve. The reviews revealed promising results. (1) All included studies found significant group-level differences for several USN measures. In addition, several studies found asymmetric behavior in VR and ET tasks for patients who did not show signs of USN in conventional tests. Particularly promising features were multitasking in complex VR environments and detailed eye-movement analysis. (2) No VR and only a few ET studies attempted to differentiate USN subtypes, although the technologies appeared appropriate. One ET study grouped USN participants using individual heatmaps, and another differentiated between subtypes on drawing tasks. Regarding (3) ecological validity, although no studies tested the prognostic validity of their assessment methods, VR and ET studies utilized naturalistic tasks and stimuli reflecting everyday situations. Technological characteristics, such as the field of view and refresh rate of the head-mounted displays, could be improved, though, to improve ecological validity. We found (4) no studies that utilized VR or ET technologies for USN treatment up until the search date of the 26th of February 2020. In conclusion, VR-ET-based systems show great potential for USN assessment. VR-ET holds great promise for treatment, for example, by monitoring behavior and adapting and tailoring to the individual person's needs and abilities. Future research should consider developing methods for individual subtypes and differential diagnostics to inform individual treatment programs.

Computer-Based Assessment: Dual-Task Outperforms Large-Screen Cancellation Task in Detecting Contralesional Omissions

Objective: Traditionally, asymmetric spatial processing (i.e., hemispatial neglect) has been assessed with paper-and-pencil tasks, but growing evidence indicates that computer-based methods are a more sensitive assessment modality. It is not known, however, whether simply converting well-established paper-and-pencil methods into a digital format is the best option. The aim of the present study was to compare sensitivity in detecting contralesional omissions of two different computer-based methods: a "digitally converted" cancellation task was compared with a computer-based Visual and Auditory dual-tasking approach, which has already proved to be very sensitive. Methods: Participants included 40 patients with chronic unilateral stroke in either the right hemisphere (RH patients, N = 20) or the left hemisphere (LH patients, N = 20) and 20 age-matched healthy controls. The cancellation task was implemented on a very large format (173 cm × 277 cm) or in a smaller (A4) paper-and-pencil version. The computer-based dual-tasks were implemented on a 15'' monitor and required the detection of unilateral and bilateral briefly presented lateralized targets. Results: Neither version of the cancellation task was able to show spatial bias in RH patients. In contrast, in the Visual dual-task RH patients missed significantly more left-sided targets than controls in both unilateral and bilateral trials. They also missed significantly more left-sided than right-sided targets only in the bilateral trials of the Auditory dual-task. Conclusion: The dual-task setting outperforms the cancellation task approach even when the latter is implemented on a (large) screen. Attentionally demanding methods are useful for revealing mild forms of contralesional visuospatial deficits.

Examination and treatment of unilateral spatial neglect using virtual reality in three-dimensional space

Here, we developed a method that randomly generates balloons in the left-right, up-down, and near-far spaces on a monitor using a head-mounted display. In this study, we evaluated a lack of stimulus-driven attention case that was undetected by conventional assessments such as the Behavioral Inattention Test. We could identify mild neglect with our virtual reality method, as later confirmed using the Catherine Bergego scale. After repeated practice under a tilted background space condition, the patient demonstrated a reduction in the time needed to perceive the appearing balloons, suggesting a therapeutic effect.

Development of a Search Task Using Immersive Virtual Reality: Proof-of-Concept Study

BACKGROUND

Serious games are gaining increasing importance in neurorehabilitation since they increase motivation and adherence to therapy, thereby potentially improving its outcome. The benefits of serious games, such as the possibility to implement adaptive feedback and the calculation of comparable performance measures, can be even further improved by using immersive virtual reality (iVR), allowing a more intuitive interaction with training devices and higher ecological validity.

OBJECTIVE

This study aimed to develop a visual search task embedded in a serious game setting for iVR, including self-adapting difficulty scaling, thus being able to adjust to the needs and ability levels of different groups of individuals.

METHODS

In a two-step process, a serious game in iVR (bird search task) was developed and tested in healthy young (n=21) and elderly (n=23) participants and in a group of patients with impaired visual exploration behavior (ie, patients with hemispatial neglect after right-hemispheric stroke; n=11). Usability, side effects, game experience, immersion, and presence of the iVR serious game were assessed by validated questionnaires. Moreover, in the group of stroke patients, the performance in the iVR serious game was also considered with respect to hemispatial neglect severity, as assessed by established objective hemispatial neglect measures.

RESULTS

In all 3 groups, reported usability of the iVR serious game was above 4.5 (on a Likert scale with scores ranging from 1 to 5) and reported side effects were infrequent and of low intensity (below 1.5 on a Likert scale with scores ranging from 1 to 4). All 3 groups equally judged the iVR serious game as highly motivating and entertaining. Performance in the game (in terms of mean search time) showed a lateralized increase in search time in patients with hemispatial neglect that varied strongly as a function of objective hemispatial neglect severity.

CONCLUSIONS

The developed iVR serious game, "bird search task," was a motivating, entertaining, and immersive task, which can, due to its adaptive difficulty scaling, adjust and be played by different populations with different levels of skills, including individuals with cognitive impairments. As a complementary finding, it seems that performance in the game is able to capture typical patterns of impaired visual exploration behavior in hemispatial neglect, as there is a high correlation between performance and neglect severity as assessed with a cancellation task.

Procedural Learning through Action Observation: Preliminary Evidence from Virtual Gardening Activity in Intellectual Disability

Intellectual disability (ID) compromises intellectual and adaptive functioning. People with an ID show difficulty with procedural skills, with loss of autonomy in daily life. From an embodiment perspective, observation of action promotes motor skill learning. Among promising technologies, virtual reality (VR) offers the possibility of engaging the sensorimotor system, thus, improving cognitive functions and adaptive capacities. Indeed, VR can be used as sensorimotor feedback, which enhances procedural learning. In the present study, fourteen subjects with an ID underwent progressive steps training combined with VR aimed at learning gardening procedures. All participants were trained twice a week for fourteen weeks (total 28 sessions). Participants were first recorded while sowing zucchini, then they were asked to observe a virtual video which showed the correct procedure. Next, they were presented with their previous recordings, and they were asked to pay attention and to comment on the errors made. At the end of the treatment, the results showed that all participants were able to correctly garden in a real environment. Interestingly, action observation facilitated, not only procedural skills, but also specific cognitive abilities. This evidence emphasizes, for the first time, that action observation combined with VR improves procedural learning in ID.