Usability Evaluation of the Preoperative ISBAR (Identification, Situation, Background, Assessment, and Recommendation) Desktop Virtual Reality Application: Qualitative Observational Study

Association between game metrics in a simulation game and nursing students' surgical nursing knowledge - a quasi-experimental study

BACKGROUND

Simulation games are effective for acquiring surgical nursing knowledge during education by offering possibilities to learn theoretical knowledge through practical patient scenarios, thus preparing students for demanding surgical nursing care. Game metrics stored in the game system enable assessment of students' behaviour while gameplaying. Combining game metrics with the assessment of a student's surgical nursing knowledge allows versatile information to be obtained about the student's learning outcomes. However, studies on game metrics stored in systems and their relationship with learning outcomes are scarce.

METHODS

The aim here was to evaluate the association between game metrics in a simulation game and nursing students' surgical nursing knowledge. Nursing students from three universities of applied sciences in Finland participated in a one-week simulation gameplaying intervention that included five surgical nursing scenarios. Students' surgical nursing knowledge was investigated with a quasi-experimental, one-group, pre- and post-test design using a surgical nursing knowledge test. In total, 280 students filled in the knowledge tests. In addition, cross-sectional game data were collected at a single time point between pre- and post-tests. The data were analysed with descriptive statistics and multivariate analysis methods.

RESULTS

Students' surgical nursing knowledge improved with the intervention. The total number of playthroughs was 3562. The mean maximum score was 126.2 (maximum score range 76-195). The mean playing time of all playthroughs by all players was 4.3 minutes (SD = 81.61). A statistically significant association was found between mean score and knowledge test total score (p < 0.0072), but no significant association emerged between mean playing time and knowledge test total score.

CONCLUSION

The results indicated that the higher the mean score the better the students' surgical nursing knowledge in the knowledge test. This study did not show that the time spent playing had an impact on students' post-playing knowledge. Our findings support the idea that game metrics can be used in performance evaluation and the results can be used to improve nursing students' readiness for challenging preoperative and postoperative clinical situations.

The effect of using desktop VR to practice preoperative handovers with the ISBAR approach: a randomized controlled trial

AIM

The aim was to investigate whether second-year undergraduate nursing students practicing the Identification-Situation-Background-Assessment-Recommendation (ISBAR) communication approach in a desktop virtual reality (VR) application had a non-inferior learning outcome compared with the traditional paper-based method when sorting patient information correctly based on the ISBAR structure.

METHODS

A non-inferior parallel group assessor blinded randomized controlled trial, conducted in simulation sessions as part of preparation for clinical placements in March and April 2022. After a 20-minute introductory session, the participants were randomized to self-practice the ISBAR approach for 45 minutes in groups of three in either an interactive desktop VR application (intervention) or traditional paper-based (TP) simulation. The primary outcome concerned the proportion of nursing students who sorted all 11 statements of patient information in the correct ISBAR order within a time limit of 5 min. The predefined, one-sided, non-inferiority limit was 13 percentage points in favor of traditional paper-based simulation.

RESULTS

Of 210 eligible students, 175 (83%) participated and were allocated randomly to the VR (N = 87) or TP (N = 88) group. Practicing in the desktop VR application (36% of everything correct) was non-inferior to the traditional paper-based method (22% everything correct), with a difference of 14.2 percentage points (95% CI 0.7 to 27.1) in favor of VR. The VR group repeated the simulation 0.6 times more (95% CI 0.5 to 0.7). Twenty percent more (95% CI 6.9 to 31.6) of the students in the VR group reported liked how they practiced. All the other outcomes including the System Usability Scale indicated non-inferiority or were in favor of VR.

CONCLUSIONS

Self-practicing with the ISBAR approach in desktop VR was non-inferior to the traditional paper-based method and gave a superior learning outcome.

TRIAL REGISTRATION NUMBER

ISRCTN62680352 registered 30/05/2023.