Primary mass casualty incident triage: evidence for the benefit of yearly brief re-training from a simulation study

Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators

BACKGROUND

Immersive virtual reality (iVR) has emerged as a training method to prepare medical first responders (MFRs) for mass casualty incidents (MCIs) and disasters in a resource-efficient, flexible, and safe manner. However, systematic evaluations and validations of potential performance indicators for virtual MCI training are still lacking.

OBJECTIVE

This study aimed to investigate whether different performance indicators based on visual attention, triage performance, and information transmission can be effectively extended to MCI training in iVR by testing if they can discriminate between different levels of expertise. Furthermore, the study examined the extent to which such objective indicators correlate with subjective performance assessments.

METHODS

A total of 76 participants (mean age 25.54, SD 6.01 y; 45/76, 59% male) with different medical expertise (MFRs: paramedics and emergency physicians; non-MFRs: medical students, in-hospital nurses, and other physicians) participated in 5 virtual MCI scenarios of varying complexity in a randomized order. Tasks involved assessing the situation, triaging virtual patients, and transmitting relevant information to a control center. Performance indicators included eye-tracking-based visual attention, triage accuracy, triage speed, information transmission efficiency, and self-assessment of performance. Expertise was determined based on the occupational group (39/76, 51% MFRs vs 37/76, 49% non-MFRs) and a knowledge test with patient vignettes.

RESULTS

Triage accuracy (d=0.48), triage speed (d=0.42), and information transmission efficiency (d=1.13) differentiated significantly between MFRs and non-MFRs. In addition, higher triage accuracy was significantly associated with higher triage knowledge test scores (Spearman ρ=0.40). Visual attention was not significantly associated with expertise. Furthermore, subjective performance was not correlated with any other performance indicator.

CONCLUSIONS

iVR-based MCI scenarios proved to be a valuable tool for assessing the performance of MFRs. The results suggest that iVR could be integrated into current MCI training curricula to provide frequent, objective, and potentially (partly) automated performance assessments in a controlled environment. In particular, performance indicators, such as triage accuracy, triage speed, and information transmission efficiency, capture multiple aspects of performance and are recommended for integration. While the examined visual attention indicators did not function as valid performance indicators in this study, future research could further explore visual attention in MCI training and examine other indicators, such as holistic gaze patterns. Overall, the results underscore the importance of integrating objective indicators to enhance trainers' feedback and provide trainees with guidance on evaluating and reflecting on their own performance.

Management of mass casualty incidents: a systematic review and clinical practice guideline update

PURPOSE

Our aim was to generate evidence- and consensus-based recommendations for the management of mass casualty incidents (MCIs) based on current evidence. This guideline topic is part of the 2022 update of the German guideline on the treatment of patients with severe/multiple injuries.

METHODS

MEDLINE and Embase were systematically searched to August 2021. Further literature reports were obtained from clinical experts. Randomised controlled trials, cross-sectional studies, prospective cohort studies, and comparative registry studies were included if they compared triage algorithms, interventions for MCI training, logistics or transport, decontamination, diagnosis or therapy during MCIs in the prehospital and hospital settings. We considered patient-relevant clinical outcomes such as mortality, diagnostic outcomes including sensitivity and specificity, rates of undertriage and overtriage as well as resource use. Risk of bias was assessed using NICE 2012 checklists. The evidence was synthesised narratively, and expert consensus was used to develop recommendations and determine their strength. Population, intervention, comparison, and outcome (PICO) questions from clinical questions were developed by clinical experts and guideline methodologists.

RESULTS

We screened 321 records in the original guideline version and 4225 during this update. Twenty-five studies were included, all of them from the updated search from 2009 to 2021. Twenty-five new studies were identified. Interventions covered were triage training (n = 7 studies), prehospital triage (n = 6), secondary triage (n = 2), transport/logistics (n = 3), decontamination (n = 5), and therapy (n = 2) during MCIs. Three new recommendations were developed. All achieved strong consensus.

CONCLUSION

Due to unsatisfactory evidence, recommendations could only be made on training for improving triage quality and regular exercises for testing a hospital's emergency response plan. No triage algorithm can be scientifically proven to be superior in all aspects. The key recommendation is the following: To improve triage quality, exercises or (virtual) training should be conducted in-house using verified triage systems and algorithms.

Integrating GPT-Based AI into Virtual Patients to Facilitate Communication Training Among Medical First Responders: Usability Study of Mixed Reality Simulation

BACKGROUND

Training in social-verbal interactions is crucial for medical first responders (MFRs) to assess a patient's condition and perform urgent treatment during emergency medical service administration. Integrating conversational agents (CAs) in virtual patients (VPs), that is, digital simulations, is a cost-effective alternative to resource-intensive human role-playing. There is moderate evidence that CAs improve communication skills more effectively when used with instructional interventions. However, more recent GPT-based artificial intelligence (AI) produces richer, more diverse, and more natural responses than previous CAs and has control of prosodic voice qualities like pitch and duration. These functionalities have the potential to better match the interaction expectations of MFRs regarding habitability.

OBJECTIVE

We aimed to study how the integration of GPT-based AI in a mixed reality (MR)-VP could support communication training of MFRs.

METHODS

We developed an MR simulation of a traffic accident with a VP. ChatGPT (OpenAI) was integrated into the VP and prompted with verified characteristics of accident victims. MFRs (N=24) were instructed on how to interact with the MR scenario. After assessing and treating the VP, the MFRs were administered the Mean Opinion Scale-Expanded, version 2, and the Subjective Assessment of Speech System Interfaces questionnaires to study their perception of the voice quality and the usability of the voice interactions, respectively. Open-ended questions were asked after completing the questionnaires. The observed and logged interactions with the VP, descriptive statistics of the questionnaires, and the output of the open-ended questions are reported.

RESULTS

The usability assessment of the VP resulted in moderate positive ratings, especially in habitability (median 4.25, IQR 4-4.81) and likeability (median 4.50, IQR 3.97-5.91). Interactions were negatively affected by the approximately 3-second latency of the responses. MFRs acknowledged the naturalness of determining the physiological states of the VP through verbal communication, for example, with questions such as "Where does it hurt?" However, the question-answer dynamic in the verbal exchange with the VP and the lack of the VP's ability to start the verbal exchange were noticed. Noteworthy insights highlighted the potential of domain-knowledge prompt engineering to steer the actions of MFRs for effective training.

CONCLUSIONS

Generative AI in VPs facilitates MFRs' training but continues to rely on instructions for effective verbal interactions. Therefore, the capabilities of the GPT-VP and a training protocol need to be communicated to trainees. Future interactions should implement triggers based on keyword recognition, the VP pointing to the hurting area, conversational turn-taking techniques, and add the ability for the VP to start a verbal exchange. Furthermore, a local AI server, chunk processing, and lowering the audio resolution of the VP's voice could ameliorate the delay in response and allay privacy concerns. Prompting could be used in future studies to create a virtual MFR capable of assisting trainees.

Implementation of an Education Module to Improve Emergency Medical Service Provider Accuracy and Confidence in Trauma Triage

INTRODUCTION

Prehospital triage is critical to ensure timely activation of trauma center resources. Undertriage (UT) results in higher morbidity and mortality. To minimize this risk, the American College of Surgeons Committee on Trauma recommends trauma centers aim for a UT rate below 5%. Our center has a 3-tiered triage system aimed at optimizing resource allocation. We hypothesized that a trauma triage criteria educational module (TCEM) would 1) improve emergency medical services (EMSs) provider confidence and accuracy in triage and 2) improve our UT rate.

METHODS

From July to November 2022, the TCEM was presented to 8 local EMS agencies who transport patients to our Level 1 trauma center. Preclass and postclass surveys assessed EMS provider triage confidence using a Likert scale 1-5. Validated trauma scenario questions were used to measure triage accuracy. The UT rate was compared between January-May 2022 (pre-TCEM) to January-May 2023 (post-TCEM) using trauma registry data. Data were analyzed using paired Wilcoxon signed rank and t-tests.

RESULTS

72 prehospital providers participated in TCEM, most were Caucasian (65.3%), non-Hispanic (84.7%), males (77.8%) with emergency medical technician-basic certifications (90.3%). There was a significant increase in triage confidence from pre-TCEM to post-TCEM (2 versus 5; P < 0.001) and accuracy (23.2% versus 88.9%; P < 0.001). Regression analysis did not indicate a significant difference in confidence or accuracy based on years of experience, paid or volunteer provider status, or transport volume per week. The UT rate remained stable after TCEM initiation (2.3% versus 2.0%; P < 0.669).

CONCLUSIONS

This novel community based educational program demonstrated improvements in EMS provider confidence and accuracy regarding prehospital trauma triage. Outreach programs like these are often well received by EMS, and implementation is highly reproducible at other centers.

Usefulness of Self-Selected Scenarios for Simple Triage and Rapid Treatment Method Using Virtual Reality

BACKGROUND

Repeated triage training is necessary to maintain and improve the accuracy of simple triage and rapid treatment (START), a popular triage method. Virtual reality (VR) may be more effective than conventional training methods. This study aimed to verify the educational usefulness of START using VR originally developed for students.

METHODS

A VR was initially developed with a function that allowed students to select the triage procedure and its evaluation. Triage was performed using a simple modified START method, and eight scenarios were developed. The participants included 70 paramedic students classified into VR and live lecture groups. They took a 20-question written test that evaluated their academic ability before the course. After the course, a practical test and a 20-question written test were conducted. The total score of the practical test was 43 points. Triage procedure (1 point), observation and evaluation (1-5 points), and triage categories (1 point) were evaluated in this test.

RESULTS

The VR and live lecture groups consisted of 33 and 29 participants, respectively. No significant differences were observed pre- and post-test. In the practical test, the median (interquartile range) score was 29 (26-32) and 25 (23-29) for the VR and live lecture groups, respectively, with the VR group scoring significantly higher (P=0.03).

CONCLUSION

Our results confirmed the educational usefulness of selective VR for active learning of START. Therefore, VR combined with live lectures and simulations would be an optimal educational technique.

Exploring objective measures for assessing team performance in healthcare: an interview study

Introduction

Effective teamwork plays a critical role in achieving high-performance outcomes in healthcare. Consequently, conducting a comprehensive assessment of team performance is essential for providing meaningful feedback during team trainings and enabling comparisons in scientific studies. However, traditional methods like self-reports or behavior observations have limitations such as susceptibility to bias or being resource consuming. To overcome these limitations and gain a more comprehensive understanding of team processes and performance, the assessment of objective measures, such as physiological parameters, can be valuable. These objective measures can complement traditional methods and provide a more holistic view of team performance. The aim of this study was to explore the potential of the use of objective measures for evaluating team performance for research and training purposes. For this, experts in the field of research and medical simulation training were interviewed to gather their opinions, ideas, and concerns regarding this novel approach.

Methods

A total of 34 medical and research experts participated in this exploratory qualitative study, engaging in semi-structured interviews. During the interview, experts were asked for (a) their opinion on measuring team performance with objective measures, (b) their ideas concerning potential objective measures suitable for measuring team performance of healthcare teams, and (c) their concerns regarding the use of objective measures for evaluating team performance. During data analysis responses were categorized per question.

Results

The findings from the 34 interviews revealed a predominantly positive reception of the idea of utilizing objective measures for evaluating team performance. However, the experts reported limited experience in actively incorporating objective measures into their training and research. Nevertheless, they identified various potential objective measures, including acoustical, visual, physiological, and endocrinological measures and a time layer. Concerns were raised regarding feasibility, complexity, cost, and privacy issues associated with the use of objective measures.

Discussion

The study highlights the opportunities and challenges associated with employing objective measures to assess healthcare team performance. It particularly emphasizes the concerns expressed by medical simulation experts and team researchers, providing valuable insights for developers, trainers, researchers, and healthcare professionals involved in the design, planning or utilization of objective measures in team training or research.

Preparing medical first responders for crises: a systematic literature review of disaster training programs and their effectiveness

BACKGROUND

Adequate training and preparation of medical first responders (MFRs) are essential for an optimal performance in highly demanding situations like disasters (e.g., mass accidents, natural catastrophes). The training needs to be as effective as possible, because precise and effective behavior of MFRs under stress is central for ensuring patients' survival and recovery. This systematic review offers an overview of scientifically evaluated training methods used to prepare MFRs for disasters. It identifies different effectiveness indicators and provides an additional analysis of how and to what extent the innovative training technologies virtual (VR) and mixed reality (MR) are included in disaster training research.

METHODS

The systematic review was conducted according to the PRISMA guidelines and focused specifically on (quasi-)experimental studies published between January 2010 and September 2021. The literature search was conducted via Web of Science and PubMed and led to the inclusion of 55 articles.

RESULTS

The search identified several types of training, including traditional (e.g., lectures, real-life scenario training) and technology-based training (e.g., computer-based learning, educational videos). Most trainings consisted of more than one method. The effectiveness of the trainings was mainly assessed through pre-post comparisons of knowledge tests or self-reported measures although some studies also used behavioral performance measures (e.g., triage accuracy). While all methods demonstrated effectiveness, the literature indicates that technology-based methods often lead to similar or greater training outcomes than traditional trainings. Currently, few studies systematically evaluated immersive VR and MR training.

CONCLUSION

To determine the success of a training, proper and scientifically sound evaluation is necessary. Of the effectiveness indicators found, performance assessments in simulated scenarios are closest to the target behavior during real disasters. For valid yet inexpensive evaluations, objectively assessible performance measures, such as accuracy, time, and order of actions could be used. However, performance assessments have not been applied often. Furthermore, we found that technology-based training methods represent a promising approach to train many MFRs repeatedly and efficiently. These technologies offer great potential to supplement or partially replace traditional training. Further research is needed on those methods that have been underrepresented, especially serious gaming, immersive VR, and MR.

A Region-Wide All-Hazard Training Program for Prehospital Mass Casualty Incident Management: A Real-World Case Study

OBJECTIVE

We report the development, implementation, and results of a sustainable region-wide mass-casualty management prehospital training program implemented by the Regione Lombardia emergency medical services (EMS) agency AREU in Italy.

METHODS

The educational program learning objectives are: (1) command and control, communications, and resource management; (2) mass casualty triage and the START triage protocol; (3) on-scene management; (4) Regione Lombardia and AREU Mass Casualty standard operating procedures; and (5) inter-agency communications and relations. For each course edition data on participants' summative assessment, participants' feedback and costs were collected.

RESULTS

Between June 26, 2013, and December 31, 2020, a total of 84 editions of the provider training event were delivered, training an overall 1329 prehospital providers; 1239 (93%) passed the summative assessment and were qualified as being operationally "ready." Regarding participant feedback, the overall program was rated 4.4 ± 0.7 out of 5. The overall cost of running the provider program during the study period was €321 510 (circa US $382 000). The average cost per edition was €3828 and €242 per participant.

CONCLUSIONS

We have described a simple yet interactive simulation and blended-learning approach, which has yielded good pass rates, good participant satisfaction, and contained costs to systematically train emergency medical service personnel.

Perspectives of Triage Team Members Participating in Statewide Triage Simulations for Scarce Resource Allocation During the COVID-19 Pandemic in Washington State

IMPORTANCE

The COVID-19 pandemic prompted health care institutions worldwide to develop plans for allocation of scarce resources in crisis capacity settings. These plans frequently rely on rapid deployment of institutional triage teams that would be responsible for prioritizing patients to receive scarce resources; however, little is known about how these teams function or how to support team members participating in this unique task.

OBJECTIVE

To identify themes illuminating triage team members' perspectives and experiences pertaining to the triage process.

DESIGN, SETTING, AND PARTICIPANTS

This qualitative study was conducted using inductive thematic analysis of observations of Washington state triage team simulations and semistructured interviews with participants during the COVID-19 pandemic from December 2020 to February 2021. Participants included clinician and ethicist triage team members. Data were analyzed from December 2020 through November 2021.

MAIN OUTCOMES AND MEASURES

Emergent themes describing the triage process and experience of triage team members.

RESULTS

Among 41 triage team members (mean [SD] age, 50.3 [11.4] years; 21 [51.2%] women) who participated in 12 simulations and 21 follow-up interviews, there were 5 Asian individuals (12.2%) and 35 White individuals (85.4%); most participants worked in urban hospital settings (32 individuals [78.0%]). Three interrelated themes emerged from qualitative analysis: (1) understanding the broader approach to resource allocation: participants strove to understand operational and ethical foundations of the triage process, which was necessary to appreciate their team's specific role; (2) contending with uncertainty: team members could find it difficult or feel irresponsible making consequential decisions based on limited clinical and contextual patient information, and they grappled with ethically ambiguous features of individual cases and of the triage process as a whole; and (3) transforming mindset: participants struggled to disentangle narrow determinations about patients' likelihood of survival to discharge from implicit biases and other ethically relevant factors, such as quality of life. They cited the team's open deliberative process, as well as practice and personal experience with triage as important in helping to reshape their usual cognitive approach to align with this unique task.

CONCLUSIONS AND RELEVANCE

This study found that there were challenges in adapting clinical intuition and training to a distinctive role in the process of scarce resource allocation. These findings suggest that clinical experience, education in ethical and operational foundations of triage, and experiential training, such as triage simulations, may help prepare clinicians for this difficult role.

Lernen und üben wir das Richtige?

Der Massenanfall von Verletzten (MANV) ist eine Ausnahmesituation für Rettungsdienst und andere Einsatzkräfte. Trotz niedriger Inzidenz müssen sich die Einsatzkräfte sowohl auf ärztlicher als auch auf nichtärztlicher Seite auf diesen Einsatzfall vorbereiten. In der vorliegenden Pilotstudie wurden anhand einer Fehlermöglichkeits- und -einflussanalyse (FMEA) die kritischen Einsatzfaktoren im MANV ermittelt und mit den Ausbildungscurricula verglichen. Die herangezogenen Curricula waren Notfallsanitäter:in, organisatorische:r Leiter:in, Konzept zur katastrophenmedizinischen Ausbildung im studentischen Unterricht an deutschen Hochschulen, Nationaler Kompetenz-basierter Lernzielkatalog Medizin (NKLM), Zusatz-Weiterbildung Notfallmedizin und Fortbildung zum:zur leitenden Notarzt:ärztin. Die Ergebnisse lassen vermuten, dass in der praktischen Ausbildung der MANV eine eher untergeordnete Rolle spielt. Weitere empirische Untersuchungen sind aus Sicht der Autoren notwendig.

Refining mass casualty plans with simulation-based iterative learning

BACKGROUND

Preparatory, written plans for mass casualty incidents are designed to help hospitals deliver an effective response. However, addressing the frequently observed mismatch between planning and delivery of effective responses to mass casualty incidents is a key challenge. We aimed to use simulation-based iterative learning to bridge this gap.

METHODS

We used Normalisation Process Theory as the framework for iterative learning from mass casualty incident simulations. Five small-scale 'focused response' simulations generated learning points that were fed into two large-scale whole-hospital response simulations. Debrief notes were used to improve the written plans iteratively. Anonymised individual online staff surveys tracked learning. The primary outcome was system safety and latent errors identified from group debriefs. The secondary outcomes were the proportion of completed surveys, confirmation of reporting location, and respective roles for mass casualty incidents.

RESULTS

Seven simulation exercises involving more than 700 staff and multidisciplinary responses were completed with debriefs. Usual emergency care was not affected by simulations. Each simulation identified latent errors and system safety issues, including overly complex processes, utilisation of space, and the need for clarifying roles. After the second whole hospital simulation, participants were more likely to return completed surveys (odds ratio=2.7; 95% confidence interval [CI], 1.7-4.3). Repeated exercises resulted in respondents being more likely to know where to report (odds ratio=4.3; 95% CI, 2.5-7.3) and their respective roles (odds ratio=3.7; 95% CI, 2.2-6.1) after a simulated mass casualty incident was declared.

CONCLUSION

Simulation exercises are a useful tool to improve mass casualty incident plans iteratively and continuously through hospital-wide engagement of staff.

Preparedness for Mass Casualty Incidents: The Effectiveness of Current Training Model

The importance of MCI organization and training was highlighted by the events of September 11, 2001. Training focuses on the management of physical injuries caused by a single traumatic event over a well-defined, relatively short timeframe. MCI management is integrated into surgical and trauma training, with disaster management training involving the emergency services, law enforcement, and state infrastructure agencies. The COVID-19 pandemic revealed gaps in the preparedness of nation states and global partners in disaster management. The questions that arose include 'has training really prepared us for an actual emergency,' 'what changes need to be made to training to make it more effective,' and 'who else should training be extended to?' This article focuses on the importance of involving multiple sectors in mass casualty training and asks whether greater involvement of non-medical agencies and the public, in operational drills might improve preparedness for global events such as the COVID-19 pandemic.

Simultaneous Casualty Admissions-Do they Affect Treatment in the Receiving Trauma Center?

Background

Simultaneous trauma admissions expose medical professionals to increased workload. The impact of simultaneous trauma admissions on hospital allocation, therapy, and outcome is currently unclear. We hypothesized that multiple admission-scenarios impact the diagnostic pathway and outcome.

Methods

The TraumaRegister DGU® was utilized. Patients admitted between 2002–2015 with an ISS ≥ 9, treated with ATLS®- algorithms were included. Group ´IND´ included individual admissions, two individuals that were admitted within 60 min of each other were selected for group ´MULT´. Patients admitted within 10 min were considered as simultaneous (´SIM´) admissions. We compared patient and trauma characteristics, treatment, and outcomes between both groups.

Results

132,382 admissions were included, and 4,462/3.4% MULTiple admissions were found. The SIM-group contained 1,686/1.3% patients. The overall median injury severity score was 17 and a mean age of 48 years was found. MULT patients were more frequently admitted to level-one trauma centers (68%) than individual trauma admissions were (58%, p < 0.001). Mean time to CT-scanning (24 vs. 26/28 min) was longer in MULT / SIM patients compared to individual admissions. No differences in utilization of damage control principles were seen. Moreover, mortality rates did not differ between the groups (13.1% in regular admissions and 11.4%/10,6% in MULT/SIM patients).

Conclusion

This study demonstrates that simultaneous treatment of injured patients is rare. Individuals treated in parallel with other patients were more often admitted to level-one trauma centers compared with individual patients. Although diagnostics take longer, treatment principles and mortality are equal in individual admissions and simultaneously admitted patients. More studies are required to optimize health care under these conditions.

Multiple victims incident simulation: training professionals and university teaching

OBJECTIVE

to describe the teaching strategy based on the Multiple Victims Incident (MVI) simulation, discussing and evaluating the performance of the students involved in the initial care of trauma victims.

METHODS

a cross-sectional, and quantitative study was performed. A realistic MVI simulation involving students, and professionals from nursery and medical schools, as well as a prehospital care team was performed.

RESULTS

it was possible to notice that the classification according to the START method (Simple Triage and Rapid Treatment) was correct in 94.1% of the time from the analysis of 17 preestablished checklists. Following the primary evaluation with the ABCDE mnemonic, all steps were performed correctly in 70%. However, there was only supply of oxygen in high flow in 64.7% of the examination. The search for visible and hidden bleeding was performed in 70.6% of the examination. The neurological evaluation with the Glasgow coma scale and pupillary evaluation occurred in 70.6% of the victims. The victims exposure was performed in 70.6% of the examination.

CONCLUSION

a simulated environment allows the consolidation and improvement of professional skills, especially when we are talking about a poorly trained area during the undergraduate program, such as the MVI. Early training and teamwork encourage clinical thinking, integration and communication, essential abilities when facing chaotic situations.