Performance Monitoring via Functional Near Infrared Spectroscopy for Virtual Reality Based Basic Life Support Training

Brain activity during a public-speaking situation in virtual reality in patients with irritable bowel syndrome and functional dyspepsia

BACKGROUND

Psychosocial stress plays a central role in the pathophysiology of disorders of gut-brain interactions (DGBI), including functional dyspepsia (FD) and irritable bowel syndrome (IBS). Brain activity during psychosocial stress in patients with DGBI has not been adequately investigated. In this prospective study, we aimed to explore brain activity during psychosocial stress in patients with DGBI.

METHODS

Situations in an unmanned room, public space without attention, and public speaking were simulated in a virtual reality (VR) environment. Subjective stress, emotional state, and gastrointestinal (GI) symptoms were assessed using a visual analog scale, the State-Trait Anxiety Inventory, and the GI Symptom Rating Scale, respectively. Electrocardiograms were recorded to evaluate autonomic function. Activity in the prefrontal cortex (PFC) was examined using functional near-infrared spectroscopy (fNIRS).

RESULTS

Overall, 15 healthy controls, 15 patients with IBS, and 15 patients with FD were included. In the public-speaking scenario, subjective stress scores significantly decreased (indicating more stress) and sympathetic nervous activity increased equally among the three groups compared with those in an unmanned scene. Patients with IBS had higher activity in the left ventrolateral prefrontal cortex (VLPFC) and lower activity in the dorsolateral PFC (DLPFC) than those with FD and healthy controls.

CONCLUSIONS

Brain activity increased in the VLPFC and decreased in the DLPFC under stressful psychosocial situations created in the VR space in patients with IBS. Thus, the combination of VR and fNIRS is a viable option for evaluating brain activity under psychosocial stress in natural clinical settings.

Extended reality technologies in adult basic life support education: A scoping review

Aim

In recent years, virtual and augmented reality (VR/AR) technologies have gained increasing attention as innovative tools for education, including in the field of adult Basic Life Support (BLS). While existing reviews on this topic primarily focus on comparing VR/AR with other educational approaches, our research aimed to identify the VR/AR hardware and software applications assessed in published studies and their alignment with learning objectives in adult BLS education.

Methods

We conducted a scoping literature review using the Population, Exposure, and Outcome (PEO) framework to analyse publications from 2018 to 2024. The review focused on the impact of VR/AR (exposure) on affective, behavioral, and cognitive learning outcomes (outcome) in adult BLS education among laypersons, healthcare professionals, pre-licensure students, and duty-to-respond laypersons (population).

Results

From 1,282 database records and 54 alternative sources, 31 articles were selected for comprehensive analysis. Many of the studies (11/31; 36%) targeted pre-licensure students, such as nursing students, and laypersons (9/31; 20%), primarily high school students. Only one study focused on duty-to-respond laypersons (1/31; 3%). VR studies (24/31; 77%) were more common than AR studies (6/31; 19%), featuring a broad spectrum of ten VR headsets compared to just two types of AR headsets. Among the assessed software applications, twenty-one commercial programs were examined-sixteen designed for VR and five for AR. Most studies investigated affective outcomes (25/31; 81%), while behavioural outcomes were also commonly examined (22/31; 71%). In contrast, cognitive outcomes were explored in fewer studies (9/31; 29%).

Conclusion

Our review identified several challenges in existing studies, including variability in software and hardware, diverse learning outcomes, and accessibility issues with extended reality (XR) technology. To maximize its effectiveness, XR should be aligned with specific learning objectives rather than adopted for its novelty. Prioritizing educational efficacy ensures that XR enhances learning by addressing precise gaps, ultimately improving the understanding and retention of resuscitation skills among both laypersons and healthcare professionals.

iVR-fNIRS: studying brain functions in a fully immersive virtual environment

Immersive virtual reality (iVR) employs head-mounted displays or cave-like environments to create a sensory-rich virtual experience that simulates the physical presence of a user in a digital space. The technology holds immense promise in neuroscience research and therapy. In particular, virtual reality (VR) technologies facilitate the development of diverse tasks and scenarios closely mirroring real-life situations to stimulate the brain within a controlled and secure setting. It also offers a cost-effective solution in providing a similar sense of interaction to users when conventional stimulation methods are limited or unfeasible. Although combining iVR with traditional brain imaging techniques may be difficult due to signal interference or instrumental issues, recent work has proposed the use of functional near infrared spectroscopy (fNIRS) in conjunction with iVR for versatile brain stimulation paradigms and flexible examination of brain responses. We present a comprehensive review of current research studies employing an iVR-fNIRS setup, covering device types, stimulation approaches, data analysis methods, and major scientific findings. The literature demonstrates a high potential for iVR-fNIRS to explore various types of cognitive, behavioral, and motor functions in a fully immersive VR (iVR) environment. Such studies should set a foundation for adaptive iVR programs for both training (e.g., in novel environments) and clinical therapeutics (e.g., pain, motor and sensory disorders and other psychiatric conditions).

Cognitive Effort during Visuospatial Problem Solving in Physical Real World, on Computer Screen, and in Virtual Reality

Spatial cognition plays a crucial role in academic achievement, particularly in science, technology, engineering, and mathematics (STEM) domains. Immersive virtual environments (VRs) have the growing potential to reduce cognitive load and improve spatial reasoning. However, traditional methods struggle to assess the mental effort required for visuospatial processes due to the difficulty in verbalizing actions and other limitations in self-reported evaluations. In this neuroergonomics study, we aimed to capture the neural activity associated with cognitive workload during visuospatial tasks and evaluate the impact of the visualization medium on visuospatial task performance. We utilized functional near-infrared spectroscopy (fNIRS) wearable neuroimaging to assess cognitive effort during spatial-reasoning-based problem-solving and compared a VR, a computer screen, and a physical real-world task presentation. Our results reveal a higher neural efficiency in the prefrontal cortex (PFC) during 3D geometry puzzles in VR settings compared to the settings in the physical world and on the computer screen. VR appears to reduce the visuospatial task load by facilitating spatial visualization and providing visual cues. This makes it a valuable tool for spatial cognition training, especially for beginners. Additionally, our multimodal approach allows for progressively increasing task complexity, maintaining a challenge throughout training. This study underscores the potential of VR in developing spatial skills and highlights the value of comparing brain data and human interaction across different training settings.

Assessment of learning in simulator-based arthroscopy training with the diagnostic arthroscopy skill score (DASS) and neurophysiological measures

PURPOSE

Virtual arthroscopic training has become increasingly popular. However, there is a lack of efficiency-based tracking of the trainee, which may be critical for determining the specifics of training programs and adapting them for the needs of each trainee. This study aims to evaluate and compare the measures obtained with a non-invasive neurophysiological method with The Diagnostic Arthroscopy Skill Score (DASS), a commonly used assessment tool for evaluating arthroscopic skills.

METHODS

The study collected simulator performance scores, consisting of "Triangulation Right Hand", "Triangulation Left Hand", "Catch the Stars" and "Three Rings" and DASS scores from 22 participants (11 novices, 11 experts). These scores were obtained while participants underwent a structured program of exercises for the fundamentals of arthroscopic surgery training (FAST) and knee module using a simulator-based arthroscopy device. During the evaluation, data on oxy-hemoglobin and deoxy-hemoglobin levels in the prefrontal cortex were collected using the Functional Near-Infrared Spectroscopy (fNIRS) imaging system. Performance scores, DASS scores, and fNIRS data were subsequently analyzed to determine any correlation between performance and cortex activity.

RESULTS

The simulator performance scores and the DASSPart2 scores were significantly higher in the expert group compared to the novice group (200.1 ± 28.5 vs 172.5 ± 48.9, p = 0.04 and 9.4 ± 5.6 vs. 5.4 ± 5.6 p = 0.02). In the expert group, fNIRS data showed a significantly lower prefrontal cortex activation during fundamental tasks in the FAST module, indicating significantly more efficient mental resource use.

CONCLUSION

The analysis of cognitive workload changes during simulation-based arthroscopy training revealed a significant correlation between the trainees' DASS scores and fNIRS data. This correlation suggests the potential use of fNIRS data and DASS scores as additional metrics to create adaptive training protocols for each participant. By incorporating these metrics, the training process can be optimized, leading to more efficient arthroscopic training and better preparedness for clinical operations.

LEVEL OF EVIDENCE

III.

Assessment of Surgical Tasks Using Neuroimaging Dataset (ASTaUND)

Functional near-infrared spectroscopy (fNIRS) is a neuroimaging tool for studying brain activity in mobile subjects. Open-access fNIRS datasets are limited to simple and/or motion-restricted tasks. Here, we report a fNIRS dataset acquired on mobile subjects performing Fundamentals of Laparoscopic Surgery (FLS) tasks in a laboratory environment. Demonstrating competency in the FLS tasks is a prerequisite for board certification in general surgery in the United States. The ASTaUND data set was acquired over four different studies. We provide the relevant information about the hardware, FLS task execution protocols, and subject demographics to facilitate the use of this open-access data set. We also provide the concurrent FLS scores, a quantitative metric for surgical skill assessment developed by the FLS committee. This data set is expected to support the growing field of assessing surgical skills via neuroimaging data and provide an example of data processing pipeline for use in realistic, non-restrictive environments.

An Examination of the Effects of Virtual Reality Training on Spatial Visualization and Transfer of Learning

Spatial visualization ability (SVA) has been identified as a potential key factor for academic achievement and student retention in Science, Technology, Engineering, and Mathematics (STEM) in higher education, especially for engineering and related disciplines. Prior studies have shown that training using virtual reality (VR) has the potential to enhance learning through the use of more realistic and/or immersive experiences. The aim of this study was to investigate the effect of VR-based training using spatial visualization tasks on participant performance and mental workload using behavioral (i.e., time spent) and functional near infrared spectroscopy (fNIRS) brain-imaging-technology-derived measures. Data were collected from 10 first-year biomedical engineering students, who engaged with a custom-designed spatial visualization gaming application over a six-week training protocol consisting of tasks and procedures that varied in task load and spatial characteristics. Findings revealed significant small (Cohen's d: 0.10) to large (Cohen's d: 2.40) effects of task load and changes in the spatial characteristics of the task, such as orientation or position changes, on time spent and oxygenated hemoglobin (HbO) measures from all the prefrontal cortex (PFC) areas. Transfer had a large (d = 1.37) significant effect on time spent and HbO measures from right anterior medial PFC (AMPFC); while training had a moderate (d = 0.48) significant effect on time spent and HbR measures from left AMPFC. The findings from this study have important implications for VR training, research, and instructional design focusing on enhancing the learning, retention, and transfer of spatial skills within and across various VR-based training scenarios.

Illuminating neurodegeneration: a future perspective on near-infrared spectroscopy in dementia research

SIGNIFICANCE

Dementia presents a global healthcare crisis, and neuroimaging is the main method for developing effective diagnoses and treatments. Yet currently, there is a lack of sensitive, portable, and low-cost neuroimaging tools. As dementia is associated with vascular and metabolic dysfunction, near-infrared spectroscopy (NIRS) has the potential to fill this gap.

AIM

This future perspective aims to briefly review the use of NIRS in dementia to date and identify the challenges involved in realizing the full impact of NIRS for dementia research, including device development, study design, and data analysis approaches.

APPROACH

We briefly appraised the current literature to assess the challenges, giving a critical analysis of the methods used. To assess the sensitivity of different NIRS device configurations to the brain with atrophy (as is common in most forms of dementia), we performed an optical modeling analysis to compare their cortical sensitivity.

RESULTS

The first NIRS dementia study was published in 1996, and the number of studies has increased over time. In general, these studies identified diminished hemodynamic responses in the frontal lobe and altered functional connectivity in dementia. Our analysis showed that traditional (low-density) NIRS arrays are sensitive to the brain with atrophy (although we see a mean decrease of 22% in the relative brain sensitivity with respect to the healthy brain), but there is a significant improvement (a factor of 50 sensitivity increase) with high-density arrays.

CONCLUSIONS

NIRS has a bright future in dementia research. Advances in technology - high-density devices and intelligent data analysis-will allow new, naturalistic task designs that may have more clinical relevance and increased reproducibility for longitudinal studies. The portable and low-cost nature of NIRS provides the potential for use in clinical and screening tests.

Functional Near-Infrared Spectroscopy as a Personalized Digital Healthcare Tool for Brain Monitoring

The sustained growth of digital healthcare in the field of neurology relies on portable and cost-effective brain monitoring tools that can accurately monitor brain function in real time. Functional near-infrared spectroscopy (fNIRS) is one such tool that has become popular among researchers and clinicians as a practical alternative to functional magnetic resonance imaging, and as a complementary tool to modalities such as electroencephalography. This review covers the contribution of fNIRS to the personalized goals of digital healthcare in neurology by identifying two major trends that drive current fNIRS research. The first major trend is multimodal monitoring using fNIRS, which allows clinicians to access more data that will help them to understand the interconnection between the cerebral hemodynamics and other physiological phenomena in patients. This allows clinicians to make an overall assessment of physical health to obtain a more-detailed and individualized diagnosis. The second major trend is that fNIRS research is being conducted with naturalistic experimental paradigms that involve multisensory stimulation in familiar settings. Cerebral monitoring of multisensory stimulation during dynamic activities or within virtual reality helps to understand the complex brain activities that occur in everyday life. Finally, the scope of future fNIRS studies is discussed to facilitate more-accurate assessments of brain activation and the wider clinical acceptance of fNIRS as a medical device for digital healthcare.

Use of neuroimaging to measure neurocognitive engagement in health professions education: a scoping review

PURPOSE

To map the current literature on functional neuroimaging use in medical education research as a novel measurement modality for neurocognitive engagement, learning, and expertise development.

METHOD

We searched PubMed, Embase, Cochrane, ERIC, and Web of Science, and hand-searched reference lists of relevant articles on April 4, 2019, and updated the search on July 7, 2020. Two authors screened the abstracts and then full-text articles for eligibility based on inclusion criteria. The data were then charted, synthesized, and analyzed descriptively.

RESULTS

Sixty-seven articles published between 2007 and 2020 were included in this scoping review. These studies used three main neuroimaging modalities: functional magnetic resonance imaging, functional near-infrared spectroscopy, and electroencephalography. Most of the publications (90%, n = 60) were from the last 10 years (2011-2020). Although these studies were conducted in 16 countries, 68.7% (n = 46) were from three countries: the USA (n = 21), UK (n = 15), and Canada (n = 10). These studies were mainly non-experimental (74.6%, n = 50). Most used neuroimaging techniques to examine psychomotor skill development (57%, n = 38), but several investigated neurocognitive correlates of clinical reasoning skills (22%, n = 15).

CONCLUSION

This scoping review maps the available literature on functional neuroimaging use in medical education. Despite the heterogeneity in research questions, study designs, and outcome measures, we identified a few common themes. Included studies are encouraging of the potential for neuroimaging to complement commonly used measures in education research and may help validate/challenge established theoretical assumptions and provide insight into training methods. This review highlighted several areas for further research. The use of these emerging technologies appears ripe for developing precision education, establishing viable study protocols for realistic operational settings, examining team dynamics, and exploring applications for real-time monitoring/intervention during critical clinical tasks.

Scoping review: The use of augmented reality in clinical anatomical education and its assessment tools

The purpose of this review was to identify the different augmented reality (AR) modalities used to teach anatomy to students, health professional trainees, and surgeons, and to examine the assessment tools used to evaluate the performance of various AR modalities. A scoping review of four databases was performed using variations of: (1) AR, (2) medical or anatomical teaching/education/training, and (3) anatomy or radiology or cadaver. Scientific articles were identified and screened for the inclusion and exclusion criteria as per Preferred Reporting Items for Systematic Reviews and Meta-Analyses with extension for scoping reviews guidelines. Virtual reality was an exclusion criterion. From this scoping review, data were extracted from a total of 54 articles and the following four AR modalities were identified: head-mounted display, projection, instrument and screen, and mobile device. The usability, feasibility, and acceptability of these AR modalities were evaluated using a variety of quantitative and qualitative assessment tools. Within more recent years of AR integration into anatomy education, the assessment of visuospatial ability, cognitive load, time on task, and increasing academic achievement outcomes are variables of interest, which continue to warrant more exploration. Sufficiently powered studies using validated assessment tools must be conducted to better understand the role of AR in anatomical education.

Detecting Fear of Heights Response to a Virtual Reality Environment Using Functional Near-Infrared Spectroscopy

To enable virtual reality exposure therapy (VRET) that treats anxiety disorders by gradually exposing the patient to fear using virtual reality (VR), it is important to monitor the patient's fear levels during the exposure. Despite the evidence of a fear circuit in the brain as reflected by functional near-infrared spectroscopy (fNIRS), the measurement of fear response in highly immersive VR using fNIRS is limited, especially in combination with a head-mounted display (HMD). In particular, it is unclear to what extent fNIRS can differentiate users with and without anxiety disorders and detect fear response in a highly ecological setting using an HMD. In this study, we investigated fNIRS signals captured from participants with and without a fear of height response. To examine the extent to which fNIRS signals of both groups differ, we conducted an experiment during which participants with moderate fear of heights and participants without it were exposed to VR scenarios involving heights and no heights. The between-group statistical analysis shows that the fNIRS data of the control group and the experimental group are significantly different only in the channel located close to right frontotemporal lobe, where the grand average oxygenated hemoglobin Δ[HbO] contrast signal of the experimental group exceeds that of the control group. The within-group statistical analysis shows significant differences between the grand average Δ[HbO] contrast values during fear responses and those during no-fear responses, where the Δ[HbO] contrast values of the fear responses were significantly higher than those of the no-fear responses in the channels located towards the frontal part of the prefrontal cortex. Also, the channel located close to frontocentral lobe was found to show significant difference for the grand average deoxygenated hemoglobin contrast signals. Support vector machine-based classifier could detect fear responses at an accuracy up to 70% and 74% in subject-dependent and subject-independent classifications, respectively. The results demonstrate that cortical hemodynamic responses of a control group and an experimental group are different to a considerable extent, exhibiting the feasibility and ecological validity of the combination of VR-HMD and fNIRS to elicit and detect fear responses. This research thus paves a way toward the a brain-computer interface to effectively manipulate and control VRET.

A Novel Game-Based Intelligent Test for Detecting Elderly Cognitive Function Impairment

PURPOSES

This research explores the game-based intelligent test (GBIT), predicts the possibilities of Mini-Mental State Examination (MMSE) scores and the risk of cognitive impairment, and then verifies GBIT as one of the reliable and valid cognitive assessment tools.

METHODS

This study recruited 117 elderly subjects in Taiwan (average age is 79.92 ± 8.68, average height is 156.91 ± 8.01, average weight is 59.14 ± 9.67, and average MMSE score is 23.33 ± 6.16). A multiple regression model was used to analyze the GBIT parameters of the elderly's reaction, attention, coordination, and memory to predict their MMSE performance. The binary logistic regression was then utilized to predict their risk of cognitive impairment. The statistical significance level was set as α = 0.05.

RESULTS

Multiple regression analysis showed that gender, the correct number of reactions, and the correct number of memory have a significantly positive predictive power on MMSE of the elderly (F = 37.60, R 2 = 0.69, and p < 0.05). Binary logistic regression analysis noted that the correct average number of reactions falls by one question, and the ratio of cognitive dysfunction risk increases 1.09 times (p < 0.05); the correct average number of memory drops by one question, the ratio of cognitive dysfunction risk increases 3.76 times (p < 0.05), and the overall model predictive power is 88.20% (sensitivity: 84.00%; specificity: 92.30%).

CONCLUSIONS

This study verifies that GBIT is reliable and can effectively predict the cognitive function and risk of cognitive impairment in the elderly. Therefore, GBIT can be used as one of the feasible tools for evaluating older people's cognitive function.

Studying Brain Activation during Skill Acquisition via Robot-Assisted Surgery Training

Robot-assisted surgery systems are a recent breakthrough in minimally invasive surgeries, offering numerous benefits to both patients and surgeons including, but not limited to, greater visualization of the operation site, greater precision during operation and shorter hospitalization times. Training on robot-assisted surgery (RAS) systems begins with the use of high-fidelity simulators. Hence, the increasing demand of employing RAS systems has led to a rise in using RAS simulators to train medical doctors. The aim of this study was to investigate the brain activity changes elicited during the skill acquisition of resident surgeons by measuring hemodynamic changes from the prefrontal cortex area via a neuroimaging sensor, namely, functional near-infrared spectroscopy (fNIRS). Twenty-four participants, who are resident medical doctors affiliated with different surgery departments, underwent an RAS simulator training during this study and completed the sponge suturing tasks at three different difficulty levels in two consecutive sessions/blocks. The results reveal that cortical oxygenation changes in the prefrontal cortex were significantly lower during the second training session (Block 2) compared to the initial training session (Block 1) (p < 0.05).