Augmented reality in medical education: a systematic review

Accuracy of LLMs in medical education: evidence from a concordance test with medical teacher

BACKGROUND

There is an unprecedented increase in the use of Generative AI in medical education. There is a need to assess these models' accuracy to ensure patient safety. This study assesses the accuracy of ChatGPT, Gemini, and Copilot in answering multiple-choice questions (MCQs) compared to a qualified medical teacher.

METHODS

This study randomly selected 40 Multiple Choice Questions (MCQs) from past United States Medical Licensing Examination (USMLE) and asked for answers to three LLMs: ChatGPT, Gemini, and Copilot. The results of an LLM are then compared with those of a qualified medical teacher and with responses from other LLMs. The Fleiss' Kappa Test was used to determine the concordance between four responders (3 LLMs + 1 Medical Teacher). In case of poor agreement between responders, Cohen's Kappa test was performed to assess the agreement between responders.

RESULTS

ChatGPT demonstrated the highest accuracy (70%, Cohen's Kappa = 0.84), followed by Copilot (60%, Cohen's Kappa = 0.69), while Gemini showed the lowest accuracy (50%, Cohen's Kappa = 0.53). The Fleiss' Kappa value of -0.056 indicated significant disagreement among all four responders.

CONCLUSION

The study provides an approach for assessing the accuracy of different LLMs. The study concludes that ChatGPT is far superior (70%) to other LLMs when asked medical questions across different specialties, while contrary to expectations, Gemini (50%) performed poorly. When compared with medical teachers, the low accuracy of LLMs suggests that general-purpose LLMs should be used with caution in medical education.

Military Medical Simulations-Scoping Review

INTRODUCTION

The military employs a wide variety of training paradigms to prepare a ready medical force. Simulation-based training is prominently used in the military for all roles of care to provide the knowledge, skills, and abilities needed to render care from the battlefield to the hospital. The purpose of this scoping review is to synthesize the body of research in military healthcare simulation, highlight trends in the literature, and identify research gaps.

MATERIALS AND METHODS

Using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis process, the databases of PubMed, Google Scholar, and targeted conferences were searched for articles focused on simulation-based training in the military healthcare community. Inclusion criteria required that the studies assessed a healthcare simulation intervention and had military participants. Data were gathered on population parameters (branch of service and provider level) as well as study parameter (simulation modality, medical domain, and outcome measures). Outcome measures were categorized according to the Kirkpatrick model of training evaluation.

RESULTS

A total of 43 articles met inclusion criteria. Article summaries and descriptive data on the participant populations and study parameters are provided in Tables 1, 2, and Supplementary Table S1.

CONCLUSIONS

Participant populations were inclusive of all the services and roles of care, suggesting appropriate representation of the broad military healthcare community. The majority of literature has studied physical simulations, such as manikins or task trainers. Few studies employed augmented or virtual reality as the training intervention, likely because of the nascency of the technology. Trauma care was the focus of 65% of the studies; this is attributable to the criticality of trauma care within battlefield medicine and casualty response. Related to study outcomes, participant reactions, such as usability and user acceptance, and immediate learning outcomes were heavily studied. Retention and behavioral changes were rarely studied and represent a significant research gap. Future research assessing mixed reality technologies would be beneficial to determine whether the technology warrants inclusion in programs of instruction. Finally, studies with outcome measures including long-term knowledge and skills retention, behavioral change, or patient outcomes are strongly recommended for future research.

Virtual Reality and Augmented Reality Use Cases in Gastroenterology

PURPOSE OF REVIEW

Virtual reality (VR) and augmented reality (AR) are emerging technologies with significant potential in medical education and therapeutic interventions, particularly within gastroenterology. This review aims to explore the current applications of VR and AR in enhancing endoscopy training, procedural skills, and patient comfort, while also identifying their role in non-pharmacological pain management and pre-procedure education.

RECENT FINDINGS

Extensive research has been conducted on the use of VR and AR in surgical and neurological fields, but their application in gastroenterology is still evolving. VR simulators provide realistic training environments, contributing to improved procedural skills and patient care. Additionally, VR has been shown to reduce patient discomfort and serve as an alternative to sedation during procedures like colonoscopies. AR, specifically in colonoscopies, has demonstrated potential in enhancing polyp detection by overlaying real-time digital information, leading to better diagnostic accuracy. Studies also suggest that VR can improve patient outcomes in functional gastrointestinal disorders and enhance pre-procedure education, increasing patient satisfaction. VR and AR hold significant promise in gastroenterology by advancing both educational and procedural practices. These technologies offer cost-effective, patient-friendly solutions that improve diagnostic accuracy and patient outcomes. Continued research is essential to fully realize the benefits of VR and AR in gastroenterology, as these tools become more prevalent in clinical practice.

Augmented Reality for extremity hemorrhage training: a usability study

Introduction

Limb massive hemorrhage is the first cause of potentially preventable death in trauma. Its prompt and proper management is crucial to increase the survival rate. To handle a massive hemorrhage, it is important to train people without medical background, who might be the first responders in an emergency. Among the possible ways to train lay rescuers, healthcare simulation allows to practice in a safe and controlled environment. In particular, immersive technologies such as Virtual Reality (VR) and Augmented Reality (AR) give the possibility to provide real time feedback and present a realistic and engaging scenario, even though they often lack personalization.

Methods

This work aims to overcome the above-mentioned limitation, by presenting the design, development and usability test of an AR application to train non-experienced users on the use of antihemorrhagic devices. The application combines a Microsoft Hololens2 headset, with an AR application developed in Unity Game Engine. It includes a training scenario with a multimodal interactive system made of visual and audio cues, that would adapt to user's learning pace and feedback preference.

Results

Usability tests on 20 subjects demonstrated that the system is well tolerated in terms of discomfort and workload. Also, the system has been high rated for usability, user experience, immersion and sense of presence.

Discussion

These preliminary results suggest that the combination of AR with multimodal cues can be a promising tool to improve hemorrhage management training, particularly for unexperienced users. In the future, the proposed application might increase the number of people who know how to use an anti-hemorrhagic device.

Metaverse-based simulation: a scoping review of charting medical education over the last two decades in the lens of the 'marvelous medical education machine'

BACKGROUND

Over the past two decades, the use of Metaverse-enhanced simulations in medical education has witnessed significant advancement. These simulations offer immersive environments and technologies, such as augmented reality, virtual reality, and artificial intelligence that have the potential to revolutionize medical training by providing realistic, hands-on experiences in diagnosing and treating patients, practicing surgical procedures, and enhancing clinical decision-making skills. This scoping review aimed to examine the evolution of simulation technology and the emergence of metaverse applications in medical professionals' training, guided by Friedman's three dimensions in medical education: physical space, time, and content, along with an additional dimension of assessment.

METHODS

In this scoping review, we examined the related literature in six major databases including PubMed, EMBASE, CINAHL, Scopus, Web of Science, and ERIC. A total of 173 publications were selected for the final review and analysis. We thematically analyzed these studies by combining Friedman's three-dimensional framework with assessment.

RESULTS

Our scoping review showed that Metaverse technologies, such as virtual reality simulation and online learning modules have enabled medical education to extend beyond physical classrooms and clinical sites by facilitating remote training. In terms of the Time dimension, simulation technologies have made partial but meaningful progress in supplementing traditional time-dependent curricula, helping to shorten learning curves, and improve knowledge retention. As for the Content dimension, high-quality simulation and metaverse content require alignment with learning objectives, interactivity, and deliberate practice that should be developmentally integrated from basic to advanced skills. With respect to the Assessment dimension, learning analytics and automated metrics from metaverse-enabled simulation systems have enhanced competency evaluation and formative feedback mechanisms. However, their integration into high-stakes testing is limited, and qualitative feedback and human observation remain crucial.

CONCLUSION

Our study provides an updated perspective on the achievements and limitations of using simulation to transform medical education, offering insights that can inform development priorities and research directions for human-centered, ethical metaverse applications that enhance healthcare professional training.

Satisfaction and learning experience of students using online learning platforms for medical education

BACKGROUND

Advancement in medical education has led to the adoption of online learning platforms in the development and execution of learning modules. Online learning platforms are appraised and accessed regarding their capability of ensuring a seamless experience and enhancing satisfaction in users, especially students. In this study, the satisfaction and learning experience of medical students were studied with emphasis on their sociodemographic features.

METHOD

Data were collected using a structured questionnaires distributed to a group of medical students in a medical college in Eastern Nigeria. 300 undergraduate students from Enugu State University of Science and Technology participated in this survey from four departments: anatomy, medical laboratory, nursing, and medicine. The questionnaires included closed-ended questions divided into sociodemographic information, learning experience, and satisfaction with online learning.

RESULT

Results from the survey indicate that sociodemographic factors like the course of study and sex of respondents show a noticeable relationship to the learning experience and satisfaction with online learning platforms while other factors have no impact. The majority of respondents (63.1%) strong agreed that online learning platform effectively delivers medical course content with a mean value of user learning experience of online learning platform as 4.15.

CONCLUSION

Feature perception, learning experience, and satisfaction level of medical students were dependent on their course of study and sex, thus independent course curriculum was relevant in determining satisfaction of students. The findings of this study add to the empirical and practical understanding of students' satisfaction with using online learning platforms as a success in medical education and its use is recommended by other medical institutions.

Augmented Reality in Ward Round-Based Simulation: Exploring Student Experiences and Impact on Confidence

INTRODUCTION

 Doctors in training make substantial contributions to ward rounds. Despite this, formal education in this area is lacking, leading to diminished confidence and competence among undergraduate students and trainees. Ward round-based simulation (WRBS) has shown promise in improving clinical and decision-making skills. This quasi-experimental mixed-methods study aims to explore student experiences of augmented reality (AR) in simulated medical ward rounds. Specifically, it seeks to compare AR to existing traditional simulation modalities (TSM), manikin, and actor, to evaluate its viability as an alternative and to explore the impact of a mixed-modality simulated ward round on student confidence levels in performing ward round tasks.

MATERIALS AND METHODS

Fourteen participants engaged in a simulated ward round involving three cases: an actor as a patient, a manikin, and an AR case. Guided by pre- and post-simulation questionnaires, confidence levels around WRBS were explored using Wilcoxon's signed-rank test. Additionally, thematic analysis of semi-structured focus groups explored the use of AR in simulation compared to TSM.

RESULTS

Significant improvements in confidence shown through the pre- and post-simulation questionnaires (p < 0.019) were found using Wilcoxon's signed-rank test across all 11 questions, with effect sizes (r) ranging from 0.65 to 0.9. The highest effect size observed (r = 0.9) asked about the change in confidence when starting or stopping medications during a ward round (p = 0.002). Qualitative analysis of focus group discussions identified key themes such as the visual accuracy of AR, the need for interactivity, and the cognitive load of mixed-method simulations.

CONCLUSION

The findings suggest that AR can significantly enhance medical training by providing realistic and immersive learning experiences, although further refinements are necessary to improve interactivity and reduce cognitive demands. This study highlights the potential for integrating innovative technologies to better prepare students for clinical practise and provides further insight into the practicalities of using AR in medical education.

The metaverse in nuclear medicine: transformative applications, challenges, and future directions

The metaverse, a rapidly evolving virtual reality space, holds immense potential to revolutionize nuclear medicine by enhancing education, training, diagnostics, and therapeutics. This review explores the transformative applications of the metaverse in nuclear medicine, where immersive virtual learning environments, simulation-based training, artificial intelligence (AI)-powered decision support systems integrated into interactive three-dimensional (3D) visualizations, and personalized dosimetry using realistic patient-specific virtual models are seamlessly incorporated into the metaverse ecosystem, creating a synergistic platform for healthcare professionals and patients alike. However, the responsible and sustainable adoption of the metaverse in nuclear medicine requires a multidisciplinary approach to address challenges related to standardization, accessibility, data security, and ethical concerns. The formation of cross-disciplinary consortia, increased research and development (R&D) investment, and the strengthening of data governance and cybersecurity measures are crucial steps in ensuring the safe and effective integration of the metaverse in healthcare. As the metaverse continues to evolve, researchers, practitioners, and policymakers must collaborate and explore its potential, navigate the challenges, and shape a future where technology and medicine seamlessly integrate to enhance patient care and outcomes in nuclear medicine. Further research is needed to fully understand the implications of the metaverse in clinical practice, education, and research, as well as to develop evidence-based guidelines for its responsible implementation. By embracing responsible innovation and collaboration, the nuclear medicine community can harness the power of the metaverse to transform and improve patient care.

Perspective or Spectacle? Teaching thoracic aortic anatomy in a mixed reality assisted educational approach- a two-armed randomized pilot study

PURPOSE

Anatomical understanding is an important basis for medical teaching, especially in a surgical context. The interpretation of complex vascular structures via two-dimensional visualization can yet be difficult, particularly for students. The objective of this study was to investigate the feasibility of an MxR-assisted educational approach in vascular surgery undergraduate education, comparing an MxR-based teaching-intervention with CT-based material for learning and understanding the vascular morphology of the thoracic aorta.

METHODS

In a prospective randomized controlled trial learning success and diagnostic skills following an MxR- vs. a CT-based intervention was investigated in 120 thoracic aortic visualizations. Secondary outcomes were motivation, system-usability as well as workload/satisfaction. Motivational factors and training-experience were also assessed. Twelve students (7 females; mean age: 23 years) were randomized into two groups undergoing educational intervention with MxR or CT.

RESULTS

Evaluation of learning success showed a mean improvement of 1.17 points (max.score: 10; 95%CI: 0.36-1.97). The MxR-group has improved by a mean of 1.33 [95% CI: 0.16-2.51], against 1.0 points [95% CI: -0.71- 2.71] in the CT-group. Regarding diagnostic skills, both groups performed equally (CT-group: 58.25 ± 7.86 vs. MxR-group:58.5 ± 6.60; max. score 92.0). 11/12 participants were convinced that MxR facilitated learning of vascular morphologies. The usability of the MxR-system was rated positively, and the perceived workload was low.

CONCLUSION

MxR-systems can be a valuable addition to vascular surgery education. Further evaluation of the technology in larger teaching situations are required. Especially regarding the acquisition of practical skills, the use of MxR-systems offers interesting application possibilities in surgical education.

Medical Students' Perception Toward Using AI in Medical Education in the Kurdistan Region, Iraq: A Cross-Sectional Study

Background and aim AI is revolutionizing medical education by offering innovative tools and simulations that augment traditional teaching methods. This study explored the perceptions and expectations of medical students in the Kurdistan region, Iraq, regarding AI integration in medical education. Methods A cross-sectional online survey collected data from 224 medical students over four months. A descriptive analysis was conducted to present the student's attitudes.  Results In total, 224 medical students responded to the online survey. The majority of them were female (n=129; 57.6%), while 95 were male (42.4%). Additionally, most of the participants were in stage 4 (54 (24.1%); stage 1, 48 (21.4%); and stage 2, 43 (19.2%). In terms of measuring students' perceptions of AI integration in medical education, 186 (83%) of the students wanted to use smartphones and tablets, and 38 (17%) of them reported wanting hard copies. In addition, 112 (50%) of the medical students considered themselves experts in using AI and 98 (43.8%) did not know exactly what AI was used; however, only a few of them (6.3%) did not use AI. Few patients reported using Manikins instead of real patients (42 (18.8%)), while 140 (62.5%) reported that they could be used but not an alternative. Conclusion While many agree that digital tools and simulations are useful teaching tools, they are frequently viewed as adjunctive approaches. Better integration and training are required for the infrequent use of AI tools in medical education.

The Updated ITAG Spinal Simulator (ISS) For Difficult Lumbar Punctures

Lumbar punctures are important and delicate procedures necessitating precise training tools for skill acquisition. This study introduces an advanced simulator with enhanced features including dynamic motor systems and an intuitive GUI. The results from motor accuracy tests indicate significant improvements in precision and reliability, crucial for replicating the nuanced conditions of lumbar puncture procedures. An average absolute angular deviation of 0.5 degrees was observed over 19 trials indicating a consistent performance in mimicking real life anatomical vertebral settings. These advancements set a new standard in medical simulation technology for lumbar punctures, aiming to better prepare healthcare professionals for real-world clinical scenarios. This sets the board for future integrations using augmented and virtual reality paired with motorized systems to facilitate unique and complex training scenarios.

Use of augmented and virtual reality in resuscitation training: A systematic review

Objectives

To evaluate the effectiveness of augmented reality (AR) and virtual reality (VR), compared with other instructional methods, for basic and advanced life support training.

Methods

This systematic review was part of the continuous evidence evaluation process of the International Liaison Committee on Resuscitation (ILCOR) and reported based on the Preferred Reporting Items for Systematic review and Meta-Analysis (PRISMA) guidelines and registered with PROSPERO (CRD42023376751). MEDLINE, EMBASE, and SCOPUS were searched from inception to January 16, 2024. We included all published studies comparing virtual or augmented reality to other methods of resuscitation training evaluating knowledge acquisition and retention, skills acquisition and retention, skill performance in real resuscitation, willingness to help, bystander CPR rate, and patients' survival.

Results

Our initial literature search identified 1807 citations. After removing duplicates, reviewing the titles and abstracts of the remaining 1301 articles, full text review of 74 articles and searching references lists of relevant articles, 19 studies were identified for analysis. AR was used in 4 studies to provide real-time feedback during CPR, demonstrating improved CPR performance compared to groups trained with no feedback, but no difference when compared to other sources of CPR feedback. VR use in resuscitation training was explored in 15 studies, with the majority of studies that assessed CPR skills favoring other interventions over VR, or showing no difference between groups.

Conclusion

Augmented and virtual reality can be used to support resuscitation training of lay people and healthcare professionals, however current evidence does not clearly demonstrate a consistent benefit when compared to other methods of training.

Incorporating Augmented Reality Into Anatomy Education in a Contemporary Medical School Curriculum

Anatomy education in the medical school curriculum has encountered considerable challenges during the last decade. The exponential growth of medical science has necessitated a review of the classical ways to teach anatomy to shorten the time students spend dissecting, allowing them to acquire critical, new knowledge in other disciplines. Augmented and mixed reality technologies have developed tremendously during the last few years, offering a wide variety of possibilities to deliver anatomy education to medical students. Here, we provide a methodology to develop, deliver, and assess an anatomy laboratory course using augmented reality applications. We suggest a novel approach, based on Microsoft® HoloLens II, to develop systematic sequences of holograms to reproduce human dissection. The laboratory sessions are prepared before classes and include a series of holograms revealing sequential layers of the human body, isolated structures, or a combination of structures forming a system or a functional unit. The in-class activities are conducted either as one group of students (n = 8-9) with a leading facilitator or small groups of students (n = 4) with facilitators (n = 4) joining the groups for discussion. The same or different sessions may be used for the assessment of students' knowledge. Although currently in its infancy, the use of holograms will soon become a substantial part of medical education. Currently, several companies are offering a range of useful learning platforms, from anatomy education to patient encounters. By describing the holographic program at our institution, we hope to provide a roadmap for other institutions looking to implement a systematic approach to teaching anatomy through holographic dissection. This approach has several benefits, including a sequential 3D presentation of the human body with varying layers of dissection, demonstrations of facilitator-selected three-dimensional (3D) anatomical regions or specific body units, and the option for classroom or remote facilitation, with the ability for students to review each session individually.

Smartphone-Based Virtual and Augmented Reality Implicit Association Training (VARIAT) for Reducing Implicit Biases Toward Patients Among Health Care Providers: App Development and Pilot Testing

Background

Implicit bias is as prevalent among health care professionals as among the wider population and is significantly associated with lower health care quality.

Objective

The study goal was to develop and evaluate the preliminary efficacy of an innovative mobile app, VARIAT (Virtual and Augmented Reality Implicit Association Training), to reduce implicit biases among Medicaid providers.

Methods

An interdisciplinary team developed 2 interactive case-based training modules for Medicaid providers focused on implicit bias related to race and socioeconomic status (SES) and sexual orientation and gender identity (SOGI), respectively. The simulations combine experiential learning, facilitated debriefing, and game-based educational strategies. Medicaid providers (n=18) participated in this pilot study. Outcomes were measured on 3 domains: training reactions, affective knowledge, and skill-based knowledge related to implicit biases in race/SES or SOGI.

Results

Participants reported high relevance of training to their job for both the race/SES module (mean score 4.75, SD 0.45) and SOGI module (mean score 4.67, SD 0.50). Significant improvement in skill-based knowledge for minimizing health disparities for lesbian, gay, bisexual, transgender, and queer patients was found after training (Cohen d=0.72; 95% CI -1.38 to -0.04).

Conclusions

This study developed an innovative smartphone-based implicit bias training program for Medicaid providers and conducted a pilot evaluation on the user experience and preliminary efficacy. Preliminary evidence showed positive satisfaction and preliminary efficacy of the intervention.

Artificial Intelligence Revolutionizing the Field of Medical Education

Medical education has ventured into a new arena of computer-assisted teaching powered by artificial intelligence (AI). In medical institutions, AI can serve as an intelligent tool facilitating the decision-making process effectively. AI can enhance teaching by assisting in developing new strategies for educators. Similarly, students also benefit from intelligent systems playing the role of competent teachers. Thus, AI-integrated medical education paves new opportunities for advanced teaching and learning experiences and improved outcomes. On the other hand, optical mark recognition and automated scoring are ways AI can also transform into a real-time assessor and evaluator in medical education. This review summarizes the AI tools and their application in medical teaching or learning, assessment, and administrative support. This article can aid medical institutes in planning and implementing AI according to the needs of the educators.

Digital Versus Conventional Teaching of Surgical Pathology: A Comparative Study

OBJECTIVE

To compare the digital method and the conventional method of teaching surgical pathology to medical students.

METHODS

A prospective case-control study was conducted on second-year students during the period of August 20, 2022, through January 15, 2023. Students, divided into two groups of 45 each, were taught surgical pathology via both conventional and digital methods. Four specimens and four slides were taught in total to the same set of students. A pre-test and a post-test were used to evaluate students' performance and the impact of the teaching method. The answers were analyzed using a paired t-test. In the end, students' responses were obtained regarding their views on a better method of teaching on a Likert scale.

RESULTS

To study gross pathology, 50.7% of students were in favor of the digital method, and 21% were not in favor. For the microscopic examination of tissues, 56.92% of students were in favor of the digital method, and 15% were not in favor. There was a significant increase in post-test scores (12.54-9.79 = 2.75, p=0.007) when digital methods for teaching surgical pathology were applied.

CONCLUSION

The Likert scale demonstrated that the digital method of teaching surgical pathology not only improved student performance but also resulted in a better understanding of the subject.

Intra-operative applications of augmented reality in glioma surgery: a systematic review

Background

Augmented reality (AR) is increasingly being explored in neurosurgical practice. By visualizing patient-specific, three-dimensional (3D) models in real time, surgeons can improve their spatial understanding of complex anatomy and pathology, thereby optimizing intra-operative navigation, localization, and resection. Here, we aimed to capture applications of AR in glioma surgery, their current status and future potential.

Methods

A systematic review of the literature was conducted. This adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guideline. PubMed, Embase, and Scopus electronic databases were queried from inception to October 10, 2022. Leveraging the Population, Intervention, Comparison, Outcomes, and Study design (PICOS) framework, study eligibility was evaluated in the qualitative synthesis. Data regarding AR workflow, surgical application, and associated outcomes were then extracted. The quality of evidence was additionally examined, using hierarchical classes of evidence in neurosurgery.

Results

The search returned 77 articles. Forty were subject to title and abstract screening, while 25 proceeded to full text screening. Of these, 22 articles met eligibility criteria and were included in the final review. During abstraction, studies were classified as "development" or "intervention" based on primary aims. Overall, AR was qualitatively advantageous, due to enhanced visualization of gliomas and critical structures, frequently aiding in maximal safe resection. Non-rigid applications were also useful in disclosing and compensating for intra-operative brain shift. Irrespective, there was high variance in registration methods and measurements, which considerably impacted projection accuracy. Most studies were of low-level evidence, yielding heterogeneous results.

Conclusions

AR has increasing potential for glioma surgery, with capacity to positively influence the onco-functional balance. However, technical and design limitations are readily apparent. The field must consider the importance of consistency and replicability, as well as the level of evidence, to effectively converge on standard approaches that maximize patient benefit.

Virtual and augmented reality in biomedical engineering

BACKGROUND

In the future, extended reality technology will be widely used. People will be led to utilize virtual reality (VR) and augmented reality (AR) technologies in their daily lives, hobbies, numerous types of entertainment, and employment. Medical augmented reality has evolved with applications ranging from medical education to picture-guided surgery. Moreover, a bulk of research is focused on clinical applications, with the majority of research devoted to surgery or intervention, followed by rehabilitation and treatment applications. Numerous studies have also looked into the use of augmented reality in medical education and training.

METHODS

Using the databases Semantic Scholar, Web of Science, Scopus, IEEE Xplore, and ScienceDirect, a scoping review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria. To find other articles, a manual search was also carried out in Google Scholar. This study presents studies carried out over the previous 14 years (from 2009 to 2023) in detail. We classify this area of study into the following categories: (1) AR and VR in surgery, which is presented in the following subsections: subsection A: MR in neurosurgery; subsection B: spine surgery; subsection C: oral and maxillofacial surgery; and subsection D: AR-enhanced human-robot interaction; (2) AR and VR in medical education presented in the following subsections; subsection A: medical training; subsection B: schools and curriculum; subsection C: XR in Biomedicine; (3) AR and VR for rehabilitation presented in the following subsections; subsection A: stroke rehabilitation during COVID-19; subsection B: cancer and VR, and (4) Millimeter-wave and MIMO systems for AR and VR.

RESULTS

In total, 77 publications were selected based on the inclusion criteria. Four distinct AR and/or VR applications groups could be differentiated: AR and VR in surgery (N = 21), VR and AR in Medical Education (N = 30), AR and VR for Rehabilitation (N = 15), and Millimeter-Wave and MIMO Systems for AR and VR (N = 7), where N is number of cited studies. We found that the majority of research is devoted to medical training and education, with surgical or interventional applications coming in second. The research is mostly focused on rehabilitation, therapy, and clinical applications. Moreover, the application of XR in MIMO has been the subject of numerous research.

CONCLUSION

Examples of these diverse fields of applications are displayed in this review as follows: (1) augmented reality and virtual reality in surgery; (2) augmented reality and virtual reality in medical education; (3) augmented reality and virtual reality for rehabilitation; and (4) millimeter-wave and MIMO systems for augmented reality and virtual reality.

Participant Perceptions of Augmented Reality Simulation for Cardiac Anesthesiology Training: A Prospective, Mixed-Methods Study

Background

Simulations are a critical component of anesthesia education, and ways to broaden their delivery and accessibility should be studied. The primary aim was to characterize anesthesiology resident, fellow, and faculty experience with augmented reality (AR) simulations. The secondary aim was to explore the feasibility of quantifying performance using integrated eye-tracking technology.

Methods

This was a prospective, mixed-methods study using qualitative thematic analysis of user feedback and quantitative analysis of gaze patterns. The study was conducted at a large academic medical center in Northern California. Participants included 7 anesthesiology residents, 6 cardiac anesthesiology fellows, and 5 cardiac anesthesiology attendings. Each subject participated in an AR simulation involving resuscitation of a patient with pericardial tamponade. Postsimulation interviews elicited user feedback, and eye-tracking data were analyzed for gaze duration and latency.

Results

Thematic analysis revealed 5 domains of user experience: global assessment, spectrum of immersion, comparative assessment, operational potential, and human-technology interface. Participants reported a positive learning experience and cited AR technology's portability, flexibility, and cost-efficiency as qualities that may expand access to simulation training. Exploratory analyses of gaze patterns suggested that trainees had increased gaze duration of vital signs and gaze latency of malignant arrythmias compared with attendings. Limitations of the study include lack of a control group and underpowered statistical analyses of gaze data.

Conclusions

This study suggests positive user perception of AR as a novel modality for medical simulation training. AR technology may increase exposure to simulation education and offer eye-tracking analyses of learner performance.

Rehabilitation Is the Main Topic in Virtual and Augmented Reality and Physical Activity Research: A Bibliometric Analysis

Researchers' interest in finding practical applications for virtual reality (VR) and augmented reality (AR) technologies has increased as new devices have become cheaper and more accessible, being used in entertainment, healthcare, and rehabilitation fields, among others. This study aims to provide an overview of the current state of scientific literature related to VR, AR, and physical activity (PA). A bibliometric analysis of studies published between 1994 and 2022 was conducted using The Web of Science (WoS), applying the traditional bibliometric laws and using the VOSviewer software for data and metadata processing. The results revealed an exponential increase in scientific production between 2009 and 2021 (R² = 94%). The United States (USA) was the country/region with the most relevant co-authorship networks (72 papers); the most prolific author was Kerstin Witte, and the most prominent was Richard Kulpa. The most productive journal's core was composed of high-impact and open access journals. A great thematic diversity was found according to the most used keywords by the co-authors, highlighting concepts such as rehabilitation, cognition, training, and obesity. Then, the research related to this topic is in an exponential development phase, with great interest in the rehabilitation and sports sciences fields.

Reviews in Medical Education: Advances in Simulation to Address New Challenges in Neurology

Simulation is an engaging modality of medical education that leverages adult learning theory. Since its inception, educators have used simulation to train clinicians in bedside procedures and neurologic emergencies, as well as in communication, teamwork, and leadership skills. Many applications of simulation in neurology are yet to be fully adopted or explored. However, challenges to traditional educational paradigms, such as the shift to competency-based assessments and the need for remote or hybrid platforms, have created an impetus for neurologists to embrace simulation. In this article, we explore how simulation might be adapted to meet these current challenges in neurologic education by reviewing the existing literature in simulation from the field of neurology and beyond. We discuss how simulation can engage neurology trainees who seek interactive, contextualized, on-demand education. We consider how educators can incorporate simulation for competency-based evaluations and procedural training. We foresee a growing role of simulation initiatives that assess bias and promote equity. We also provide tangible solutions that make simulation an educational tool that is within reach for any educator in both high-resource and low-resource settings.

Use of Extended Reality in Medical Education: An Integrative Review

Extended reality (XR) has emerged as an innovative simulation-based learning modality. An integrative review was undertaken to explore the nature of evidence, usage, and effectiveness of XR modalities in medical education. One hundred and thirty-three (N = 133) studies and articles were reviewed. XR technologies are commonly reported in surgical and anatomical education, and the evidence suggests XR may be as effective as traditional medical education teaching methods and, potentially, a more cost-effective means of curriculum delivery. Further research to compare different variations of XR technologies and best applications in medical education and training are required to advance the field.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-022-01698-4.

Student Engagement Using HoloLens Mixed-Reality Technology in Human Anatomy Laboratories for Osteopathic Medical Students: an Instructional Model

Mixed-reality technology is a powerful tool used in healthcare and medical education to engage students in life-like scenarios. This blend of virtual and augmented reality images incorporates virtual projections with the real environment to allow real-time observation and interaction [1]. While this immersive technology offers advantages over cadaver dissections, it creates new challenges to keeping students engaged [2, 3]. Student engagement improves students' commitment to learning, critical thinking, and motivation and results in successful course outcomes [4, 5]. This paper provides an activity model using the HoloLens mixed-reality technology to deliver human gross anatomy laboratory sessions to first-year osteopathic medical students. The activity was designed using Gagne's model for instructional design and team-based learning to create an active learning model, which targets the behavioral, emotional, and cognitive dimensions of student engagement [6, 7]: behavioral engagement through autonomy and time on task, emotional engagement through providing the guiding exploration and narrative flow to accompany students' visual experience, and cognitive engagement by incorporating team-based learning (TBL) and case-based learning (CBL). The instructional model also answers the call for a new type of virtual reality instructor and pedagogical strategy that addresses the unique challenges and increases student engagement with this new technology. The effectiveness of this classroom activity was assessed by observing students for indicators or behaviors of student engagement, which are discussed. Further studies are required to measure the extent to which these indicators were exhibited and compare student engagement with this mixed-reality to didactic cadaver-based laboratory sessions.

Augmented Resuscitation- simulacrum of AR

This brief article is a reflection of immersive technology in healthcare education that features a digital illustration to capture the frenetic clinical environment that is broadcast live using augmented reality with a virtual onlooker, portrayed as the all seeing eye. The purpose of the artwork is to promote a discussion over consent, reality, and psychological safety.

Communication Skills Training Using Remote Augmented Reality Medical Simulation: a Feasibility and Acceptability Qualitative Study

INTRODUCTION

Augmented reality (AR) has promise as a clinical teaching tool, particularly for remote learning. The Chariot Augmented Reality Medical (CHARM) simulator integrates real-time communication into a portable medical simulator with a holographic patient and monitor. The primary aim was to analyze feedback from medical and physician assistant students regarding acceptability and feasibility of the simulator.

METHODS

Using the CHARM simulator, we created an advanced cardiovascular life support (ACLS) simulation scenario. After IRB approval, preclinical medical and physician assistant students volunteered to participate from August to September 2020. We delivered augmented reality headsets (Magic Leap One) to students before the study. Prior to the simulation, via video conference, we introduced students to effective communication skills during a cardiac arrest. Participants then, individually and remotely from their homes, synchronously completed an instructor-led ACLS AR simulation in groups of three. After the simulation, students participated in a structured focus group using a qualitative interview guide. Our study team coded their responses and interpreted them using team-based thematic analysis.

RESULTS

Eighteen medical and physician assistant students participated. We identified four domains that reflected trainee experiences: experiential satisfaction, learning engagement, technology learning curve, and opportunities for improvement. Students reported that the simulator was acceptable and enjoyable for teaching trainees communication skills; however, there were some technical difficulties associated with initial use.

CONCLUSION

This study suggests that multiplayer AR is a promising and feasible approach for remote medical education of communication skills during medical crises.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-022-01598-7.

Mild simulator sickness can alter heart rate variability, mental workload, and learning outcomes in a 360° virtual reality application for medical education: a post hoc analysis of a randomized controlled trial

Virtual reality (VR) applications could be beneficial for education, training, and treatment. However, VR may induce symptoms of simulator sickness (SS) such as difficulty focusing, difficulty concentrating, or dizziness that could impair autonomic nervous system function, affect mental workload, and worsen interventional outcomes. In the original randomized controlled trial, which explored the effectiveness of using a 360° VR video versus a two-dimensional VR video to learn history taking and physical examination skills, only the former group participants had SS. Therefore, 28 undergraduate medical students who participated in a 360° VR learning module were included in this post hoc study using a repeated measures design. Data of the Simulator Sickness Questionnaire (SSQ), heart rate variability (HRV) analysis, Task Load Index, and Mini-Clinical Evaluation Exercise were retrospectively reviewed and statistically analyzed. Ten (36%) participants had mild SS (total score > 0 and ≤ 20), and 18 (64%) had no SS symptom. Total SSQ score was positively related to the very low frequency (VLF) band power, physical demand subscale, and frustration subscale, and inversely related to physical examination score. Using multilevel modeling, the VLF power mediated the relationship between total SSQ score and physical examination score. Furthermore, frustration subscale moderated the mediating effects of the VLF power. Our results highlight the importance of documenting SS to evaluate a 360° VR training program. Furthermore, the combination of HRV analysis with mental workload measurement and outcome assessments provided the important clinical value in evaluating the effects of SS in VR applications in medical education.

Current Current Challenges and Future Research Directions in Augmented Reality for Education

The progression and adoption of innovative learning methodologies signify that a respective part of society is open to new technologies and ideas and thus is advancing. The latest innovation in teaching is the use of Augmented Reality (AR). Applications using this technology have been deployed successfully in STEM (Science, Technology, Engineering, and Mathematics) education for delivering the practical and creative parts of teaching. Since AR technology already has a large volume of published studies about education that reports advantages, limitations, effectiveness, and challenges, classifying these projects will allow for a review of the success in the different educational settings and discover current challenges and future research areas. Due to COVID-19, the landscape of technology-enhanced learning has shifted more toward blended learning, personalized learning spaces and user-centered approach with safety measures. The main findings of this paper include a review of the current literature, investigating the challenges, identifying future research areas, and finally, reporting on the development of two case studies that can highlight the first steps needed to address these research areas. The result of this research ultimately details the research gap required to facilitate real-time touchless hand interaction, kinesthetic learning, and machine learning agents with a remote learning pedagogy.

Learning from 360-degree film in healthcare simulation: a mixed methods pilot

Technology that delivers an immersive experience in education offers a viable alternative to in-person teaching. This study aims to compare learning from a clinical encounter viewed in a virtual reality 360-degree headset to that of a traditional monitor by quantifying the user experience and testing what was learnt. Furthermore, experiential learning is described as a key concept in simulation practice, and this is explored using transcripts of participants' experiences with 360-degree video. We could determine no statistical difference between median exam scores between groups (p = 0.25), and there was no correlation found between total immersion and motivational scores with exam performance (Rho = -0.14 p = 0.18, Rho = 0.08 p = 0.31). However, those viewing 360 media reported significantly higher immersion, motivation, and empathy scores (p < 0.05). Domains based upon Kolb's learning cycle generated themes including engagement, communication, and self-efficacy. 360 video creates an immersive experience with an associated high-value motivational position; however, this could not be translated to an increase in exam scores. There are benefits to perceived learning and emotional content with 360 videos, although, pedagogical theory needs further understanding if educators are to embed new immersive technology in curriculums.

Comparing the Psychological Effects of Manikin-Based and Augmented Reality-Based Simulation Training: Within-Subjects Crossover Study

BACKGROUND

Patient simulators are an increasingly important part of medical training. They have been shown to be effective in teaching procedural skills, medical knowledge, and clinical decision-making. Recently, virtual and augmented reality simulators are being produced, but there is no research on whether these more realistic experiences cause problematic and greater stress responses as compared to standard manikin simulators.

OBJECTIVE

The purpose of this research is to examine the psychological and physiological effects of augmented reality (AR) in medical simulation training as compared to traditional manikin simulations.

METHODS

A within-subjects experimental design was used to assess the responses of medical students (N=89) as they completed simulated (using either manikin or AR) pediatric resuscitations. Baseline measures of psychological well-being, salivary cortisol, and galvanic skin response (GSR) were taken before the simulations began. Continuous GSR assessments throughout and after the simulations were captured along with follow-up measures of emotion and cortisol. Participants also wrote freely about their experience with each simulation, and narratives were coded for emotional word use.

RESULTS

Of the total 86 medical students who participated, 37 (43%) were male and 49 (57%) were female, with a mean age of 25.2 (SD 2.09, range 22-30) years and 24.7 (SD 2.08, range 23-36) years, respectively. GSR was higher in the manikin group adjusted for day, sex, and medications taken by the participants (AR-manikin: -0.11, 95% CI -0.18 to -0.03; P=.009). The difference in negative affect between simulation types was not statistically significant (AR-manikin: 0.41, 95% CI -0.72 to 1.53; P=.48). There was no statistically significant difference between simulation types in self-reported stress (AR-manikin: 0.53, 95% CI -2.35 to 3.42; P=.71) or simulation stress (AR-manikin: -2.17, 95% CI -6.94 to 2.59; P=.37). The difference in percentage of positive emotion words used to describe the experience was not statistically significant between simulation types, which were adjusted for day of experiment, sex of the participants, and total number of words used (AR-manikin: -4.0, 95% CI -0.91 to 0.10; P=.12). There was no statistically significant difference between simulation types in terms of the percentage of negative emotion words used to describe the experience (AR-manikin: -0.33, 95% CI -1.12 to 0.46; P=.41), simulation sickness (AR-manikin: 0.17, 95% CI -0.29 to 0.62; P=.47), or salivary cortisol (AR-manikin: 0.04, 95% CI -0.05 to 0.13; P=.41). Finally, preexisting levels of posttraumatic stress disorder, perceived stress, and reported depression were not tied to physiological responses to AR.

CONCLUSIONS

AR simulators elicited similar stress responses to currently used manikin-based simulators, and we did not find any evidence of AR simulators causing excessive stress to participants. Therefore, AR simulators are a promising tool to be used in medical training, which can provide more emotionally realistic scenarios without the risk of additional harm.

Augmented Reality and Gamification in Education: A Systematic Literature Review of Research, Applications, and Empirical Studies

This study scrutinizes the existing literature regarding the use of augmented reality and gamification in education to establish its theoretical basis. A systematic literature review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement was conducted. To provide complete and valid information, all types of related studies for all educational stages and subjects throughout the years were investigated. In total, 670 articles from 5 databases (Scopus, Web of Science, Google Scholar, IEEE, and ERIC) were examined. Based on the results, using augmented reality and gamification in education can yield several benefits for students, assist educators, improve the educational process, and facilitate the transition toward technology-enhanced learning when used in a student-centered manner, following proper educational approaches and strategies and taking students’ knowledge, interests, unique characteristics, and personality traits into consideration. Students demonstrated positive behavioral, attitudinal, and psychological changes and increased engagement, motivation, active participation, knowledge acquisition, focus, curiosity, interest, enjoyment, academic performance, and learning outcomes. Teachers also assessed them positively. Virtual rewards were crucial for improving learning motivation. The need to develop appropriate validation tools, design techniques, and theories was apparent. Finally, their potential to create collaborative and personalized learning experiences and to promote and enhance students’ cognitive and social–emotional development was evident.

Developing measures of immersion and motivation for learning technologies in healthcare simulation: a pilot study

INTRODUCTION

Medical education has benefitted from the introduction of new technology within recent years. Immersive devices, such as, 360-degree films and virtual reality have become new ways of simulating clinical experiences. The aim of the study was to validate and test reliability of a new measure of engagement.

METHODS

A between-participants design of 2 groups viewing a clinical consultation on a 360-degree headset or 2D monitor was conducted following computer random allocation of 40 healthcare professionals recruited from scheduled teaching. Twenty-three were assigned to 360-degree and 17 to 2D Medias. Adapted Immersion Experience Questionnaire (AIEQ) and Abridged Intrinsic Motivation Inventory (AIMI) were modified to match factors relating to clinical encounters. AIEQ and AIMI were utilised as the data collection tool by each group following video viewing. Spearman's rank correlation was used to assess relationship between immersion and motivation. Comparisons between 360-degree and 2D media responses were made using Wilcoxon's signed ranks test. Internal reliability coefficients of adapted measures were calculated with Cronbach alpha scores.

RESULTS

Total immersion scores were statistically higher in those experiencing 360 (p<0.05), with a median difference of 14.50 (95% CI 6.50-22.00). A positive correlation existed between the total AIEQ and total score of the AIMI in both groups (r_s =0.88, n=17, p<0.001). Internal consistency and reliability was demonstrated with a high Cronbach alpha score for the AIEQ (α= 0.91). AIMI subscale alpha value was also high at (α= 0.95) which shows the measures to be of high internal reliability.

CONCLUSIONS

Adaptation and validation of existing measures for use in healthcare education can be used to quantify levels of immersion and motivation. Standardising measures for use in evaluating new Technology Enhanced Learning is a step to aid understanding on how we develop these tools in medical education and how we might learn from immersive technology.

Assessing Pediatric Life Support Skills Using Augmented Reality Medical Simulation With Eye Tracking: A Pilot Study

BACKGROUND

Augmented reality (AR) and eye tracking are promising adjuncts for medical simulation, but they have remained distinct tools. The recently developed Chariot Augmented Reality Medical (CHARM) Simulator combines AR medical simulation with eye tracking. We present a novel approach to applying eye tracking within an AR simulation to assess anesthesiologists during an AR pediatric life support simulation. The primary aim was to explore clinician performance in the simulation. Secondary outcomes explored eye tracking as a measure of shockable rhythm recognition and participant satisfaction.

METHODS

Anesthesiology residents, pediatric anesthesiology fellows, and attending pediatric anesthesiologists were recruited. Using CHARM, they participated in a pediatric crisis simulation. Performance was scored using the Anesthesia-centric Pediatric Advanced Life Support (A-PALS) scoring instrument, and eye tracking data were analyzed. The Simulation Design Scale measured participant satisfaction.

RESULTS

Nine each of residents, fellows, and attendings participated for a total of 27. We were able to successfully progress participants through the AR simulation as demonstrated by typical A-PALS performance scores. We observed no differences in performance across training levels. Eye tracking data successfully allowed comparisons of time to rhythm recognition across training levels, revealing no differences. Finally, simulation satisfaction was high across all participants.

CONCLUSIONS

While the agreement between A-PALS score and gaze patterns is promising, further research is needed to fully demonstrate the use of AR eye tracking for medical training and assessment. Physicians of multiple training levels were satisfied with the technology.

Practical Application of Augmented/Mixed Reality Technologies in Surgery of Abdominal Cancer Patients

The technology of augmented and mixed reality (AR/MR) is useful in various areas of modern surgery. We considered the use of augmented and mixed reality technologies as a method of preoperative planning and intraoperative navigation in abdominal cancer patients. Practical use of AM/MR raises a range questions, which demand suitable solutions. The difficulties and obstacles we encountered in the practical use of AR/MR are presented, along with the ways we chose to overcome them. The most demonstrative case is covered in detail. The three-dimensional anatomical model obtained from the CT scan needed to be rigidly attached to the patient’s body, and therefore an invasive approach was developed, using an orthopedic pin fixed to the pelvic bones. The pin is used both similarly to an X-ray contrast marker and as a marker for augmented reality. This solution made it possible, not only to visualize the anatomical structures of the patient and the border zone of the tumor, but also to change the position of the patient during the operation. In addition, a noninvasive (skin-based) marking method was developed that allows the application of mixed and augmented reality during operation. Both techniques were used (8 clinical cases) for preoperative planning and intraoperative navigation, which allowed surgeons to verify the radicality of the operation, to have visual control of all anatomical structures near the zone of interest, and to reduce the time of surgical intervention, thereby reducing the complication rate and improving the rehabilitation period.

Focus Group Findings to Support the Preliminary Development of the Augmented Reality Education Experience (AREduX)

Dementia is considered a global health priority with projections of the disease set to increase dramatically across the world. Current support for persons living with dementia (PLWD) relies on long-term care and local service centers to provide education and support. Augmented reality-based programs continue to gain momentum across health sectors, becoming an innovative approach that provides an opportunity to have a visceral experience, which can deepen understanding and provide an embodied perspective of other groups within a relatively short time frame. There is increasing interest in developing approaches to aid patient care outcomes for PLWD and their caregivers. Hence, healthcare providers (HCPs) who are appropriately trained and equipped to provide quality care to PLWD are essential and of international concern. The purpose of this research program is to develop an augmented reality (AR) education experience (AREduX), a proof of concept prototype in the form of a digital resource that uses AR to simulate the physical and cognitive symptoms that PLWD experience. The findings from a stakeholder focus group will allow for the preliminary development of the AREduX.

Augmented Reality, Virtual Reality, and Game Technologies in Ophthalmology Training

Ophthalmology is a medical profession with a tradition in teaching that has developed throughout history. Although ophthalmologists are generally considered to only prescribe contact lenses, and they handle more than half of eye-related enhancements, diagnoses, and treatments. The training of qualified ophthalmologists is generally carried out under the traditional settings, where there is a supervisor and a student, and training is based on the use of animal eyes or artificial eye models. These models have significant disadvantages, as they are not immersive and are extremely expensive and difficult to acquire. Therefore, technologies related to Augmented Reality (AR) and Virtual Reality (VR) are rapidly and prominently positioning themselves in the medical sector, and the field of ophthalmology is growing exponentially both in terms of the training of professionals and in the assistance and recovery of patients. At the same time, it is necessary to highlight and analyze the developments that have made use of game technologies for the teaching of ophthalmology and the results that have been obtained. This systematic review aims to investigate software and hardware applications developed exclusively for educational environments related to ophthalmology and provide an analysis of other related tools. In addition, the advantages and disadvantages, limitations, and challenges involved in the use of virtual reality, augmented reality, and game technologies in this field are also presented.

When medical trainees encountering a performance difficulty: evidence from pupillary responses

BACKGROUND

Medical trainees are required to learn many procedures following instructions to improve their skills. This study aims to investigate the pupillary response of trainees when they encounter moment of performance difficulty (MPD) during skill learning. Detecting the moment of performance difficulty is essential for educators to assist trainees when they need it.

METHODS

Eye motions were recorded while trainees practiced the thoracostomy procedure in the simulation model. To make pupillary data comparable among trainees, we proposed the adjusted pupil size (APS) normalizing pupil dilation for each trainee in their entire procedure. APS variables including APS, maxAPS, minAPS, meanAPS, medianAPS, and max interval indices were compared between easy and difficult subtasks; the APSs were compared among the three different performance situations, the moment of normal performance (MNP), MPD, and moment of seeking help (MSH).

RESULTS

The mixed ANOVA revealed that the adjusted pupil size variables, such as the maxAPS, the minAPS, the meanAPS, and the medianAPS, had significant differences between performance situations. Compared to MPD and MNP, pupil size was reduced during MSH. Trainees displayed a smaller accumulative frequency of APS during difficult subtask when compared to easy subtasks.

CONCLUSIONS

Results from this project suggest that pupil responses can be a good behavioral indicator. This study is a part of our research aiming to create an artificial intelligent system for medical trainees with automatic detection of their performance difficulty and delivering instructional messages using augmented reality technology.

Learning Outcomes of Immersive Technologies in Health Care Student Education: Systematic Review of the Literature

BACKGROUND

There is a lack of evidence in the literature regarding the learning outcomes of immersive technologies as educational tools for teaching university-level health care students.

OBJECTIVE

The aim of this review is to assess the learning outcomes of immersive technologies compared with traditional learning modalities with regard to knowledge and the participants' learning experience in medical, midwifery, and nursing preclinical university education.

METHODS

A systematic review was conducted according to the Cochrane Collaboration guidelines. Randomized controlled trials comparing traditional learning methods with virtual, augmented, or mixed reality for the education of medicine, nursing, or midwifery students were evaluated. The identified studies were screened by 2 authors independently. Disagreements were discussed with a third reviewer. The quality of evidence was assessed using the Medical Education Research Study Quality Instrument (MERSQI). The review protocol was registered with PROSPERO (International Prospective Register of Systematic Reviews) in April 2020.

RESULTS

Of 15,627 studies, 29 (0.19%) randomized controlled trials (N=2722 students) were included and evaluated using the MERSQI tool. Knowledge gain was found to be equal when immersive technologies were compared with traditional learning modalities; however, the learning experience increased with immersive technologies. The mean MERSQI score was 12.64 (SD 1.6), the median was 12.50, and the mode was 13.50. Immersive technology was predominantly used to teach clinical skills (15/29, 52%), and virtual reality (22/29, 76%) was the most commonly used form of immersive technology. Knowledge was the primary outcome in 97% (28/29) of studies. Approximately 66% (19/29) of studies used validated instruments and scales to assess secondary learning outcomes, including satisfaction, self-efficacy, engagement, and perceptions of the learning experience. Of the 29 studies, 19 (66%) included medical students (1706/2722, 62.67%), 8 (28%) included nursing students (727/2722, 26.71%), and 2 (7%) included both medical and nursing students (289/2722, 10.62%). There were no studies involving midwifery students. The studies were based on the following disciplines: anatomy, basic clinical skills and history-taking skills, neurology, respiratory medicine, acute medicine, dermatology, communication skills, internal medicine, and emergency medicine.

CONCLUSIONS

Virtual, augmented, and mixed reality play an important role in the education of preclinical medical and nursing university students. When compared with traditional educational modalities, the learning gain is equal with immersive technologies. Learning outcomes such as student satisfaction, self-efficacy, and engagement all increase with the use of immersive technology, suggesting that it is an optimal tool for education.

AEducaAR, Anatomical Education in Augmented Reality: A Pilot Experience of an Innovative Educational Tool Combining AR Technology and 3D Printing

Gross anatomy knowledge is an essential element for medical students in their education, and nowadays, cadaver-based instruction represents the main instructional tool able to provide three-dimensional (3D) and topographical comprehensions. The aim of the study was to develop and test a prototype of an innovative tool for medical education in human anatomy based on the combination of augmented reality (AR) technology and a tangible 3D printed model that can be explored and manipulated by trainees, thus favoring a three-dimensional and topographical learning approach. After development of the tool, called AEducaAR (Anatomical Education with Augmented Reality), it was tested and evaluated by 62 second-year degree medical students attending the human anatomy course at the International School of Medicine and Surgery of the University of Bologna. Students were divided into two groups: AEducaAR-based learning ("AEducaAR group") was compared to standard learning using human anatomy atlas ("Control group"). Both groups performed an objective test and an anonymous questionnaire. In the objective test, the results showed no significant difference between the two learning methods; instead, in the questionnaire, students showed enthusiasm and interest for the new tool and highlighted its training potentiality in open-ended comments. Therefore, the presented AEducaAR tool, once implemented, may contribute to enhancing students' motivation for learning, increasing long-term memory retention and 3D comprehension of anatomical structures. Moreover, this new tool might help medical students to approach to innovative medical devices and technologies useful in their future careers.

[Perioperative augmented reality technology in surgical treatment of locally advanced recurrent rectal cancer]

Rectal cancer occupies the leading position among cancers, and incidence of locally advanced recurrences is still high despite comprehensive treatment. Combined resections are usually associated with high perioperative risks. These procedures are technically complex interventions requiring further improvement. Virtual reality technology in surgical treatment of locally advanced rectal cancer recurrence has not been widely discussed. The authors present multidisciplinary construction of the matched topographic-anatomical virtual model and virtual planning of the combined surgical intervention. Intraoperative use of augmented reality allowed specifying topographic and anatomical features of surgical area, level of vascular ligation, localization of tumor fixation points and resection borders. These data ensured safety and quality of resection. Further research of augmented reality technology and improvement of its technical aspects will improve the results of surgical treatment of patients with locally advanced pelvic tumors and recurrences.

Augmented reality in medical education: students' experiences and learning outcomes

Augmented reality (AR) is a relatively new technology that allows for digitally generated three-dimensional representations to be integrated with real environmental stimuli. AR can make use of smart phones, tablets, or other devices to achieve a highly stimulating learning environment and hands-on immersive experience. The use of AR in industry is becoming widespread with applications being developed for use not just for entertainment and gaming but also healthcare, retail and marketing, education, military, travel and tourism, automotive industry, manufacturing, architecture, and engineering. Due to the distinct learning advantages that AR offers, such as remote learning and interactive simulations, AR-based teaching programs are also increasingly being adopted within medical schools across the world. These advantages are further highlighted by the current COVID-19 pandemic, which has caused an even greater shift towards online learning. In this review, we investigate the use of AR in medical training/education and its effect on students' experiences and learning outcomes. This includes the main goals of AR-based learning, such as to simplify the delivery and enhance the comprehension of complex information. We also describe how AR can enhance the experiences of medical students, by improving knowledge and understanding, practical skills and social skills. These concepts are discussed within the context of specific AR medical training programs, such as HoloHuman, OculAR SIM, and HoloPatient. Finally, we discuss the challenges of AR in learning and teaching and propose future directions for the use of this technology in medical education.

Augmented Reality in Pediatric Septic Shock Simulation: Randomized Controlled Feasibility Trial

BACKGROUND

Septic shock is a low-frequency but high-stakes condition in children requiring prompt resuscitation, which makes it an important target for simulation-based education.

OBJECTIVE

In this study, we aimed to design and implement an augmented reality app (PediSepsisAR) for septic shock simulation, test the feasibility of measuring the timing and volume of fluid administration during septic shock simulation with and without PediSepsisAR, and describe PediSepsisAR as an educational tool. We hypothesized that we could feasibly measure our desired data during the simulation in 90% of the participants in each group. With regard to using PediSepsisAR as an educational tool, we hypothesized that the PediSepsisAR group would report that it enhanced their awareness of simulated patient blood flow and would more rapidly verbalize recognition of abnormal patient status and desired management steps.

METHODS

We performed a randomized controlled feasibility trial with a convenience sample of pediatric care providers at a large tertiary care pediatric center. Participants completed a prestudy questionnaire and were randomized to either the PediSepsisAR or control (traditional simulation) arms. We measured the participants' time to administer 20, 40, and 60 cc/kg of intravenous fluids during a septic shock simulation using each modality. In addition, facilitators timed how long participants took to verbalize they had recognized tachycardia, hypotension, or septic shock and desired to initiate the sepsis pathway and administer antibiotics. Participants in the PediSepsisAR arm completed a poststudy questionnaire. We analyzed data using descriptive statistics and a Wilcoxon rank-sum test to compare the median time with event variables between groups.

RESULTS

We enrolled 50 participants (n=25 in each arm). The timing and volume of fluid administration were captured in all the participants in each group. There was no statistically significant difference regarding time to administration of intravenous fluids between the two groups. Similarly, there was no statistically significant difference between the groups regarding time to verbalized recognition of patient status or desired management steps. Most participants in the PediSepsisAR group reported that PediSepsisAR enhanced their awareness of the patient's perfusion.

CONCLUSIONS

We developed an augmented reality app for use in pediatric septic shock simulations and demonstrated the feasibility of measuring the volume and timing of fluid administration during simulation using this modality. In addition, our findings suggest that PediSepsisAR may enhance participants' awareness of abnormal perfusion.

Effectiveness of virtual and augmented reality for improving knowledge and skills in medical students: protocol for a systematic review

INTRODUCTION

Virtual reality (VR) and augmented reality (AR) technologies are increasingly being used in undergraduate medical education. We aim to evaluate the effectiveness of VR and AR technologies for improving knowledge and skills in medical students.

METHODS AND ANALYSIS

Using Best Evidence in Medical Education (BEME) collaboration guidelines, we will search MEDLINE (via PubMed), Education Resources Information Center, PsycINFO, Web of Knowledge, Embase and the Cochrane Central Register of Controlled Trials for English-language records, from January 1990 to March 2021. Randomised trials that studied the use of VR or AR devices for teaching medical students will be included. Studies that assessed other healthcare professionals, or did not have a comparator group, will be excluded. The primary outcome measures relate to medical students' knowledge and clinical skills. Two reviewers will independently screen studies and assess eligibility based on our prespecified eligibility criteria, and then extract data from each eligible study using a modified BEME coding form. Any disagreements will be resolved by discussion or, if necessary, the involvement of a third reviewer. The BEME Quality Indicators checklist and the Cochrane Risk of Bias Tool will be used to assess the quality of the body of evidence. Where data are of sufficient homogeneity, a meta-analysis using a random-effects model will be conducted. Otherwise, a narrative synthesis approach will be taken and studies will be evaluated based on Kirkpatrick's levels of educational outcomes and the Synthesis Without Meta-analysis guidelines.

ETHICS AND DISSEMINATION

Ethical approval is not required for this systematic review as no primary data are being collected. We will disseminate the findings of this review through scientific conferences and through publication in a peer-reviewed journal.

The Effectiveness of Using Augmented Reality for Training in the Medical Professions: A Meta Analysis (Preprint)

Background

Augmented reality (AR) is an interactive technology that uses persuasive digital data and real-world surroundings to expand the user's reality, wherein objects are produced by various computer applications. It constitutes a novel advancement in medical care, education, and training.

Objective

The aim of this work was to assess how effective AR is in training medical students when compared to other educational methods in terms of skills, knowledge, confidence, performance time, and satisfaction.

Methods

We performed a meta-analysis on the effectiveness of AR in medical training that was constructed by using the Cochrane methodology. A web-based literature search was performed by using the Cochrane Library, Web of Science, PubMed, and Embase databases to find studies that recorded the effect of AR in medical training up to April 2021. The quality of the selected studies was assessed by following the Cochrane criteria for risk of bias evaluations.

Results

In total, 13 studies with a total of 654 participants were included in the meta-analysis. The findings showed that using AR in training can improve participants' performance time (I²=99.9%; P<.001), confidence (I²=97.7%; P=.02), and satisfaction (I²=99.8%; P=.006) more than what occurs under control conditions. Further, AR did not have any effect on the participants’ knowledge (I²=99.4%; P=.90) and skills (I²=97.5%; P=.10). The meta-regression plot shows that there has been an increase in the number of articles discussing AR over the years and that there is no publication bias in the studies used for the meta-analysis.

Conclusions

The findings of this work suggest that AR can effectively improve performance time, satisfaction, and confidence in medical training but is not very effective in areas such as knowledge and skill. Therefore, more AR technologies should be implemented in the field of medical training and education. However, to confirm these findings, more meticulous research with more participants is needed.

The effectiveness of the use of augmented reality in anatomy education: a systematic review and meta-analysis

The use of Augmented Reality (AR) in anatomical education has been promoted by numerous authors. Next to financial and ethical advantages, AR has been described to decrease cognitive load while increasing student motivation and engagement. Despite these advantages, the effects of AR on learning outcome varies in different studies and an overview and aggregated outcome on learning anatomy is lacking. Therefore, a meta-analysis on the effect of AR vs. traditional anatomical teaching methods on learning outcome was performed. Systematic database searches were conducted by two independent investigators using predefined inclusion and exclusion criteria. This yielded five papers for meta-analysis totaling 508 participants; 240 participants in the AR-groups and 268 participants in the control groups. (306 females/202 males). Meta-analysis showed no significant difference in anatomic test scores between the AR group and the control group (- 0.765 percentage-points (%-points); P = 0.732). Sub analysis on the use of AR vs. the use of traditional 2D teaching methods showed a significant disadvantage when using AR (- 5.685%-points; P = 0.024). Meta-regression analysis showed no significant co-relation between mean difference in test results and spatial abilities (as assessed by the mental rotations test scores). Student motivation and/or engagement could not be included since studies used different assessment tools. This meta-analysis showed that insufficient evidence is present to conclude AR significantly impacts learning outcome and that outcomes are significantly impacted by students' spatial abilities. However, only few papers were suitable for meta-analysis, indicating that there is a need for more well-designed, randomized-controlled trials on AR in anatomy education research.

The Challenges and Perspectives of the Integration Between Virtual and Augmented Reality and Manual Therapies

Virtual reality (VR) and augmented reality (AR) have been combined with physical rehabilitation and psychological treatments to improve patients' emotional reactions, body image, and physical function. Nonetheless, no detailed investigation assessed the relationship between VR or AR manual therapies (MTs), which are touch-based approaches that involve the manipulation of tissues for relieving pain and improving balance, postural stability and well-being in several pathological conditions. The present review attempts to explore whether and how VR and AR might be integrated with MTs to improve patient care, with particular attention to balance and to fields like chronic pain that need an approach that engages both mind and body. MTs rely essentially on touch to induce tactile, proprioceptive, and interoceptive stimulations, whereas VR and AR rely mainly on visual, auditory, and proprioceptive stimulations. MTs might increase patients' overall immersion in the virtual experience by inducing parasympathetic tone and relaxing the mind, thus enhancing VR and AR effects. VR and AR could help manual therapists overcome patients' negative beliefs about pain, address pain-related emotional issues, and educate them about functional posture and movements. VR and AR could also engage and change the sensorimotor neural maps that the brain uses to cope with environmental stressors. Hence, combining MTs with VR and AR could define a whole mind-body intervention that uses psychological, interoceptive, and exteroceptive stimulations for rebalancing sensorimotor integration, distorted perceptions, including visual, and body images. Regarding the technology needed to integrate VR and AR with MTs, head-mounted displays could be the most suitable devices due to being low-cost, also allowing patients to follow VR therapy at home. There is enough evidence to argue that integrating MTs with VR and AR could help manual therapists offer patients better and comprehensive treatments. However, therapists need valid tools to identify which patients would benefit from VR and AR to avoid potential adverse effects, and both therapists and patients have to be involved in the development of VR and AR applications to define truly patient-centered therapies. Furthermore, future studies should assess whether the integration between MTs and VR or AR is practically feasible, safe, and clinically useful.

Impact of 360° vs 2D Videos on Engagement in Anatomy Education

Medical education is constantly evolving, especially as students were forced to study from home during the coronavirus disease 2019 (COVID-19) pandemic, and new technologies have driven the rapid development of supplemental online educational resources. In this study, we examine if 360° videos can promote increased engagement over standard two-dimensional (2D) videos among medical students learning anatomy. We enrolled 39 fourth-year medical students to watch two four-minute videos of anatomy lab exercises in a 360° three-dimensional format using an immersive headset or in a 2D format on a laptop computer. Every two minutes, students were asked to rate their engagement from 0-100. Following the videos, they reported their degree of agreement with 14 statements related to engagement, practicality, and interest in the technology. While watching the videos, the average engagement reported by the 360° video group was higher at each time point than the engagement reported by the two-dimensional group. Further, the engagement remained high in the 360° group through the six- and eight-minute timepoints. In the post-video survey, the 360° group reported a statistically significantly higher average engagement in seven of eight measures on the assessment. A 360° video was rated as more practical and interesting than a two-dimensional video. No significant difference existed in the perceived ease of learning. Overall, the use of 360° video may improve engagement for short videos used in medical education. However, developing a better understanding of its impact on learning outcomes will be critical for determining the overall value and effectiveness of this tool.

A Worldwide Journey through Distance Education—From the Post Office to Virtual, Augmented and Mixed Realities, and Education during the COVID-19 Pandemic

Surprisingly, distance education is quite an old concept. Its origins date back to the first correspondence-based course, which took place via the postal service in Boston, USA, in the 18th century. Rapid technological developments, especially in video and audio streaming, have increased the availability of such courses and moved learning into the virtual world. Due to the ongoing COVID-19 pandemic, we are witnessing an accelerated revolution in the learning process, as nearly all forms of education have been shifted online. Will this have a destructive effect on the human psyche? Is humanity sufficiently aware and ready for such a dramatic change? Will we return to physical in-classroom studies, or is remote distance education set to become the new norm? In particular, in medicine, computer science, fine arts, or architectural design, such a rapid change in the way students learn can be quite challenging. In this paper, we provide an overview of the history of distance learning, taking into account teachers’ and students’ points of view in both secondary and higher education.

Using Immersive Technologies to Develop Medical Education Materials

Principles of modern surgical education for clerkship and residency were established by the novel approaches of Sir William Osler, MD, Flexner report, and Halsted's principles. The evaluation of surgical education has continued to benefit from the wisdom of the past by harnessing technologies. Rapidly changing and improving the nature of the surgery fostered that evaluation and enforced the institutions to find new solutions for surgical education.

In the present descriptive technical report, our aim was threefold: (1) to share acquired educational materials based on immersive technologies involving 3D-printing, Augmented Reality (AR), and 360-degree video recording to improve ongoing pediatric surgery student training at our faculty, (2) to describe workflow underlying the construction of the materials, and (3) to provide approaches that may help other students and lecturers to develop their educational materials.

The educational materials, including 3D-printed models, AR hybrid student book, a hydrogel-based simulation model of the kidney, and Mirror World Simulation, were constructed. The authors, who are medical students, led the construction of the educational materials, so the educational materials were shaped by a collaboration between students and pediatric surgeons.

The materials constructed enabled the students to practice surgical procedures and experience different surgical environments. We believe these educational materials can serve as a valuable resource for training in many medical specialties in the future.

This work was presented at the American College of Surgeons (ACS) Quality and Safety Conference Virtual, August 21-24, 2020.

Effectiveness of the Use of Augmented Reality in Teaching the Management of Anaphylactic Shock at the Primary Care Level: Protocol for a Randomized Controlled Trial

BACKGROUND

Augmented reality (AR) has benefits and feasibility in emergency medicine, especially in the clinical care of patients, in operating rooms and inpatient facilities, and in the education and training of emergency care providers, but current research on this topic is sparse.

OBJECTIVE

The primary objective is to evaluate the short-term and long-term effectiveness of the use of AR in the treatment of patients with anaphylactic shock. The secondary objectives are to evaluate the safety in the treatment of patients with anaphylactic shock, evaluate the short-term and long-term effectiveness of stress management in this process, and determine the experiences and attitudes towards the use of AR in education.

METHODS

The study will be conducted in 3 phases. In the first phase, we will develop and test the scenario for simulation of anaphylactic shock and the evaluation scale for assessing the effect of the intervention. In the second phase, a single-blinded, randomized controlled trial will be conducted. In the third phase, the use of AR in teaching the management of anaphylactic shock using focus groups will be evaluated qualitatively. All participants will participate in a 1-day training program consisting of a lecture on emergency care and anaphylactic shock as well as exercises in manual dexterity (aspiration, airway management, alternative airway management, artificial respiration, chest compressions, safe defibrillation, oxygen application, use of medication during emergency care). The test group will also focus on education about anaphylactic shock in AR (the intervention). The main outcome will be the evaluation of the participants' performance in coping with a simulated scenario of anaphylactic shock using a high-fidelity simulator (simulator with high levels of realism) and a standardized patient in an educational and clinical environment. The study will be conducted with primary care physicians.

RESULTS

A scenario for the simulation with a high-fidelity simulator and standardized patient has already been developed. For the time being, we are developing an evaluation scale and starting to recruit participants. We plan to complete the recruitment of participants by the end of December 2020, start the randomized controlled trial in January 2021, and finish 1 year later. The first results are expected to be submitted for publication in 2021.

CONCLUSIONS

This will be the first study to evaluate the effectiveness of the use of AR in medical teaching. Specifically, it will be based on a clinical case of anaphylactic shock at the primary care level. With our study, we also want to evaluate the translation of these educational results into clinical practice and assess their long-term impact.

TRIAL REGISTRATION

ISRCTN Registry ISRCTN58047410; http://www.isrctn.com/ISRCTN58047410.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/22460.