Mobile in Situ Simulation as a Tool for Evaluation and Improvement of Trauma Treatment in the Emergency Department

Closing the Trauma Performance Improvement Loop With In-situ Simulation

INTRODUCTION

Continuous performance improvement (PI) programs are essential for excellent trauma care. We incorporated PI identified from trauma cases into an in-situ simulation-based medical education curriculum. This is a proof-of-concept study exploring the efficacy of high-fidelity pediatric trauma simulations in improving self-reported provider comfort and knowledge for identified trauma PI issues.

METHODS

This study was performed at an American College of Surgeons-verified Level I Pediatric Trauma Center. Several clinical issues were identified during the trauma PI process, including management of elevated intracranial pressure in traumatic brain injury and the use of massive transfusion protocol. These issues were incorporated into a simulation-based medical education curriculum and high-fidelity in-situ trauma mock codes were held. In-depth debriefing sessions were led by a senior faculty member after the simulations. The study participants completed pre- and postsimulation surveys. Univariate statistics are presented.

RESULTS

Twenty three providers completed surveys for the pediatric trauma simulations. Self-reported provider confidence Likert scale improved from pre- to postsimulation (P = 0.02) and trauma experience and knowledge scores improved from 82% presimulation to 93% postsimulation (P = 0.02).

CONCLUSIONS

High-fidelity pediatric trauma simulations enhance provider comfort, knowledge, and experience in trauma scenarios. By integrating high-fidelity trauma simulations to address clinical issues identified in the trauma PI process, provider education can be reinforced and practiced in a controlled environment to improve trauma care. Future studies evaluating the implementation of clinical pathways and patient outcomes are needed to demonstrate the effectiveness of simulations in PI pathways.

Modified Needleman-Wunsch algorithm for trauma management performance evaluation

BACKGROUND

Trauma injuries are one of the leading causes of death in the world, representing approximately 8 % of all deaths. Therefore, trauma management training is of great importance and new training courses have arisen during the last decades. However, actual training courses do not typically analyze compliance with the protocols and guidelines available in the literature. Considering general trauma management guidelines such as the Advanced Trauma Life Support (ATLS) manual and the expertise of trauma specialists, a trauma management automated evaluation system has been designed in this paper.

METHODS

A modification to the Needleman-Wunsch (NW) algorithm is developed, including all relevant aspects of trauma management to automatically evaluate how a trauma intervention has been implemented according to trauma protocols. This allows to consider more information with respect to the order of the actions taken and the type of actions performed than current evaluation methods, such as checklists or videos recorded in simulation. A web-based trauma simulator is used so that it can be used at any setting with internet connection. Final-year medical students and first- and second-year residents performed an experimental test, where a trauma score is obtained with the modified NW algorithm. This automatic score relates to how similar the actions are to trauma protocols.

RESULTS

The results show the best combination of the scores used for the modified NW variables. This combination has an error, for the different case scenarios created, below 0.07 which verifies the values obtained. Additionally, trauma experts verified the results obtained showing a median difference of 0 between the protocol adherence evaluation using the algorithm and the one provided by the trauma experts.

CONCLUSIONS

The best set of score values to apply to the modified NW algorithm show that the modified NW algorithm provides a successful objective measurement with respect to the protocol compliance.

Technology-enhanced trauma training in low-resource settings: A scoping review and feasibility analysis of educational technologies

BACKGROUND

Lack of training contributes to the burden of trauma-related mortality and morbidity in low- and lower-middle-income countries (LMICs). Educational technologies present a unique opportunity to enhance the quality of trauma training. Therefore, this study reviews current technologies used in trauma courses and evaluates their feasibility for LMICs.

METHODS

We conducted a scoping review evaluating the learning outcomes of technology-enhanced training in general trauma assessment, team skills or any procedures covered in the 2020 Advanced Trauma Life Support® program. Based on the Technology-Enhanced Learning criteria, we created and applied a feasibility analysis tool to evaluate the technologies for use in LMICs.

RESULTS

We screened 6471 articles and included 64. Thirty-four (45%) articles explored training in general trauma assessment, 28 (37%) in team skills, and 24 (32%) in procedures. The most common technologies were high-fidelity mannequins (60%), video-assisted debriefing (19%), and low-fidelity mannequins (13%). Despite their effectiveness, high-fidelity mannequins ranked poorly in production, maintenance, cost, and reusability categories, therefore being poorly suited for LMICs. Virtual simulation and digital courses had the best feasibility scores, but still represented a minority of articles in our review.

CONCLUSION

To our knowledge, this is the first study to perform a feasibility analysis of trauma training technologies in the LMIC context. We identified that the majority of trauma courses in the literature use technologies which are less suitable for LMICs. Given the urgent need for pediatric trauma training, educators must use technologies that optimize learning outcomes and remain feasible for low-resource settings.

LEVEL OF EVIDENCE

IV.

A Literature Study of Medical Simulations for Non-Technical Skills Training in Emergency Medicine: Twenty Years of Progress, an Integrated Research Framework, and Future Research Avenues

Medical simulations have led to extensive developments in emergency medicine. Apart from the growing number of applications and research efforts in patient safety, few studies have focused on modalities, research methods, and professions via a synthesis of simulation studies with a focus on non-technical skills training. Intersections between medical simulation, non-technical skills training, and emergency medicine merit a synthesis of progress over the first two decades of the 21st century. Drawing on research from the Web of Science Core Collection's Science Citation Index Expanded and Social Science Citation Index editions, results showed that medical simulations were found to be effective, practical, and highly motivating. More importantly, simulation-based education should be a teaching approach, and many simulations are utilised to substitute high-risk, rare, and complex circumstances in technical or situational simulations. (1) Publications were grouped by specific categories of non-technical skills, teamwork, communication, diagnosis, resuscitation, airway management, anaesthesia, simulation, and medical education. (2) Although mixed-method and quantitative approaches were prominent during the time period, further exploration of qualitative data would greatly contribute to the interpretation of experience. (3) High-fidelity dummy was the most suitable instrument, but the tendency of simulators without explicitly stating the vendor selection calls for a standardised training process. The literature study concludes with a ring model as the integrated framework of presently known best practices and a broad range of underexplored research areas to be investigated in detail.

Simulation-Based Education in Trauma Management: A Scoping Review

Trauma injuries are an important healthcare problem and one of the main leading causes of death worldwide. The purpose of this review was to analyze current practices in teaching trauma management using simulations, with the aim of summarizing them, identifying gaps and providing a critical overview on what has already been achieved. A search on the Web of Science website for simulation-based trauma training articles published from 2010 onwards was performed, obtaining 1617 publications. These publications were screened to 35 articles, which were deeply analyzed, gathering the following information: the authors, the publication type, the year of the publication, the total number of citations, the population of the training, the simulation method used, the skills trained, the evaluation type used for the simulation method presented in the paper, if skills improved after the training and the context in which the simulation took place. Of the 35 articles included in this review, only a few of them had students as the target audience. The more used simulation method was a high-fidelity mannequin, in which the participants trained in more technical than non-technical skills. Almost none of the studies introduced an automated evaluation process and most of the evaluation methods consisted of checklists or questionnaires. Finally, trauma training focused more on treating trauma patients in a hospital environment than in a pre-hospital one. Overall, improvements in the evaluation method, as well as in the development of trauma training on undergraduate education, are important areas for further development.

Is in situ simulation in emergency medicine safe? A scoping review

OBJECTIVES

To provide an overview of the available evidence regarding the safety of in situ simulation (ISS) in the emergency department (ED).

DESIGN

Scoping review.

METHODS

Original articles published before March 2021 were included if they investigated the use of ISS in the field of emergency medicine.

INFORMATION SOURCES

MEDLINE, EMBASE, Cochrane and Web of Science.

RESULTS

A total of 4077 records were identified by our search strategy and 2476 abstracts were screened. One hundred and thirty full articles were reviewed and 81 full articles were included. Only 33 studies (40%) assessed safety-related issues, among which 11 chose a safety-related primary outcome. Latent safety threats (LSTs) assessment was conducted in 24 studies (30%) and the cancellation rate was described in 9 studies (11%). The possible negative impact of ISS on real ED patients was assessed in two studies (2.5%), through a questionnaire and not through patient outcomes.

CONCLUSION

Most studies use ISS for systems-based or education-based applications. Patient safety during ISS is often evaluated in the context of identifying or mitigating LSTs and rarely on the potential impact and risks to patients simultaneously receiving care in the ED. Our scoping review identified knowledge gaps related to the safe conduct of ISS in the ED, which may warrant further investigation.

GENESISS 1-Generating Standards for In-Situ Simulation project: a scoping review and conceptual model

BACKGROUND

In-Situ Simulation (ISS) enables teams to rehearse and review practice in the clinical environment to facilitate knowledge transition, reflection and safe learning. There is increasing use of ISS in healthcare organisations for which patient safety and quality improvement are key drivers. However, the effectiveness of ISS interventions has not yet been fully demonstrated and requires further study to maximise impact. Cohesive programmatic implementation is lacking and efforts to standardise ISS terms and concepts, strengthen the evidence base and develop an integrated model of learning is required. The aim of this study was to explore the current evidence, theories and concepts associated with ISS across all areas of healthcare and develop a conceptual model to inform future ISS research and best practice guidance.

METHODS

A scoping review was undertaken with stakeholder feedback to develop a conceptual model for ISS. Medline, OpenGrey and Web of Science were searched in September 2018 and updated in December 2020. Data from the included scoping review studies were analysed descriptively and organised into categories based on the different motivations, concepts and theoretical approaches for ISS. Categories and concepts were further refined through accessing stakeholder feedback.

RESULTS

Thirty-eight papers were included in the scoping review. Papers reported the development and evaluation of ISS interventions. Stakeholder groups highlighted situations where ISS could be suitable to improve care and outcomes and identified contextual and practical factors for implementation. A conceptual model of ISS was developed which was organised into four themes: 1. To understand and explore why systematic events occur in complex settings; 2.To design and test new clinical spaces, equipment, information technologies and procedures; 3. To practice and develop capability in individual and team performance; 4. To assess competency in complex clinical settings.

CONCLUSIONS

ISS presents a promising approach to improve individual and team capabilities and system performance and address the 'practice-theory gap'. However, there are limitations associated with ISS such as the impact on the clinical setting and service provision, the reliance of having an open learning culture and availability of relevant expertise. ISS should be introduced with due consideration of the specific objectives and learning needs it is proposed to address. Effectiveness of ISS has not yet been established and further research is required to evaluate and disseminate the findings of ISS interventions.

A scoping review of nontechnical skill assessment tools to evaluate trauma team performance

BACKGROUND

The objective of this scoping review was to identify assessment tools of trauma team performance (outside of technical skills) and assess the validity and reliability of each tool in assessing trauma team performance.

METHODS

We searched Embase, Cochrane Library, Web of Science, Ovid Medline, and Cumulative Index to Nursing and Allied Health Literature from inception to June 1, 2021. English studies that evaluated trauma team performance using nontechnical skill assessment tools in a simulation or real-world setting were included. Studies were assessed by two independent reviewers for meeting inclusion/exclusion criteria. Data regarding team assessment tools were extracted and synthesized into behavior domains. Each tool was then assessed for validity and reliability.

RESULTS

The literature search returned 4,215 articles with 29 meeting inclusion criteria. Our search identified 12 trauma team performance assessment tools. Most studies were conducted in the United States (n = 20 [69%]). Twenty studies (69%) assessed trauma team performance in a simulation setting; Team Emergency Assessment Measure (TEAM) and Trauma Nontechnical Skills Scale (T-NOTECHS) were the only tools to be applied in a simulation and real-world setting. Most studies assessed trauma team performance using video review technology (n = 17 [59%]). Five overarching themes were designed to encompass behavioral domains captured across the 12 tools: (1) Leadership, (2) Communication, (3) Teamwork, (4) Assessment, and (5) Situation Awareness. The reliability and validity of T-NOTECHS were investigated by the greatest number of studies (n = 13); however, TEAM had the most robust evidence of reliability and validity.

CONCLUSION

We identified 12 trauma team performance tools that assessed nontechnical skills to varying degrees. Trauma Nontechnical Skills Scale and TEAM tools had the most evidence to support their reliability and validity. Considering the limited research in the impact of trauma team performance on patient outcomes, future studies could use video review technology in authentic trauma cases to further study this important relationship.

LEVEL OF EVIDENCE

Systematic reviews and meta-analyses, level IV.

Trauma Bay Virtual Reality - A Game Changer for ATLS Instruction and Assessment

BACKGROUND

Medical educational research highlights the need for high-fidelity, multidisciplinary simulation training to teach complex decision-making skills such as those taught in ATLS. This approach is, however, expensive and time intensive. Virtual reality (VR) education simulation may improve skill acquisition in a cost-effective and time-sensitive manner. We developed a novel trauma VR simulator (TVRSim) for providers to apply ATLS principles. We hypothesized in this pilot study that TVRSim could differentiate practitioner competency with increasing experience and would be well accepted.

METHODS

Providers at a level 1 trauma center (acute care surgeons, novice (MS4 & PGY1), junior (PGY2 & 3), senior (PGY4-6) residents) ran a blunt, polytrauma VR code. Ten critical decision points were assessed: intubation, cricothyroidotomy, chest tube, IV access, FAST, pelvic binder, activation of MTP, administration of hypertonic saline (HTS), hyperventilation and decision to go to the OR. Learner assessment was based upon frequency and time to correct decisions. Participant satisfaction was measured using validated surveys.

RESULTS

All 31 providers intubated and obtained IV access. Novices and juniors frequently failed at HTS and hyperventilation decisions. Juniors often failed at cricothyroidotomy (60%), and OR (100%) decisions. Mean time to all decisions except going to the OR was longer for all groups compared to ACS surgeons. Mean number of decisions/min was significantly higher for surgeons and seniors compared to juniors and novices. Mortality was 92.3% for novices, 80% for juniors, 25% for seniors and 0% for the attendings. Participants found TVRSim comfortable, easy to use/interact with/performance enhancing, and helped develop skills and learning.

CONCLUSIONS

In this pilot study using a sample of convenience, TVRSim was able to discern decision-making abilities among trainees with increasing experience. All trainees felt the platform enhanced their performance and facilitated skill acquisition and learning. TVRSim could be a useful adjunct to teach and assess ATLS skills.

LEVEL OF EVIDENCE

III, diagnostic test/education.

Effectiveness of Interprofessional Manikin-Based Simulation Training on Teamwork Among Real Teams During Trauma Resuscitation in Adult Emergency Departments: A Systematic Review

STATEMENT

This systematic review synthesizes the relevant evidence about the effectiveness of interprofessional manikin-based simulation training on teamwork among real teams during trauma resuscitation in adult civilian emergency departments. A systematic literature search was conducted in MEDLINE, CINAHL, EMBASE, EBM reviews, PsycINFO, and Web of Science with no time limit. Only experimental and quasi-experimental studies were included. Effects of the simulation intervention on teamwork were categorized according to a modified version of the Kirkpatrick's model. From the 1120 studies found, 11 studies were included for synthesis. All studies showed immediate improvement in teamwork after training, but divergent results were found regarding skills retention. Although this review focused on interprofessional manikin-based simulations in real trauma teams, the results are similar to previous systematic reviews including different types of simulation. This raises significant questions regarding the importance of simulation design characteristics to improve teamwork in trauma care.

The clock is ticking: using in situ simulation to improve time to blood administration for bleeding trauma patients

INTRODUCTION

Massive hemorrhage protocols are widely used to facilitate the administration of blood components to bleeding trauma patients. Delays in this process are associated with worse patient outcomes. We used in situ simulation as a novel and iterative quality improvement technique to reduce the mean time between massive hemorrhage protocol activation and blood administration during actual trauma resuscitations.

METHODS

We completed monthly, risk-informed unannounced in situ trauma simulations at a Canadian Level 1 trauma centre. We identified three major latent safety threats: (1) massive hemorrhage protocol activation; (2) transport of blood components; and (3) situational awareness of team members. Process improvements for each latent safety threats were tested and implemented during subsequent in situ simulation sessions. We evaluated the effect of this simulation-based intervention on the care of patients before, during and after the intervention. Demographic, clinical and massive hemorrhage protocol data were collected. The primary outcome was mean time between massive hemorrhage protocol activation and blood administration during actual trauma resuscitations as analyzed using a two-sample t test.

RESULTS

Each group was similar in demographic and injury characteristics. The time from massive hemorrhage protocol activation to blood administration decreased from 11.6 min pre-intervention to 9.1 min post-intervention. This represented a significant reduction (2.5 min, 95% confidence interval, 0.03-5.08) following the in situ simulation-based quality improvement intervention.

CONCLUSIONS

A comprehensive, in situ simulation-based quality improvement project was associated with a significant reduction in the mean time between massive hemorrhage protocol activation and blood administration among injured patients. In situ simulation represents a novel approach to the identification and mitigation of latent safety threats during massive hemorrhage protocol activation.

The Use of in situ Simulation in Healthcare Education: Current Perspectives

In situ simulation is the practice of using simulated scenarios in a clinical environment itself rather than in training facilities to promote learning and improved clinical care. The use of in situ simulation has been increasingly used to train healthcare staff in dealing with emergencies, resuscitation and clinical skills. The aim of this study is to provide an overview of the themes, perspectives and approaches to in situ simulation for educational purposes with healthcare staff. The literature search included studies describing and evaluating in situ simulations with an educational component. We carried out a narrative synthesis and extracted data on the clinical setting, the simulation purpose, design, evaluation method and impact. In situ simulation has proved useful in a range of different specialties for skills improvement and team development. Simulation design ranges in terms of fidelity, duration and topic. No specific design has shown to be the most efficient. However, adopting a design that fits into the specific centers resources, educational needs and clinical demands is the most important consideration.

Comparison of nontechnical skills grading rubrics for OR in situ simulation for general surgery and Obstetrician/Gynecologist residents

BACKGROUND

This study utilized the Team Strategies and Tools to Enhance Performance and Patient Safety and the Nontechnical Skills for Surgeons grading systems to evaluate the nontechnical skills of general surgery and obstetrician/gynecologist residents to see if these grading systems were concordant. These simulations were also intended to teach about crisis resources available at our institution.

METHODS

Nineteen teams were created consisting of either one general surgery resident or 2 Obstetrician/Gynecologist residents plus 2 Anesthesia residents and 2 to 4 nurses. Each team was given a short briefing on Team Strategies and Tools to Enhance Performance and Patient Safety, then performed 2 simulated operating room crises. All exercises were graded by 2 independent observers with experience in the operating room and in using the Team Strategies and Tools to Enhance Performance and Patient Safety and Nontechnical Skills for Surgeons grading systems.

RESULTS

Averaged general surgery Team Strategies and Tools To Enhance Performance and Patient Safety score increased between scenarios (14.3-17; P ≤ .01), as did obstetrician/gynecologist Team Strategies and Tools to Enhance Performance and Patient Safety score (14.9-19.2; P ≤ .01). Averaged general surgery Nontechnical Skills for Surgeons score increased between scenarios (10.3-12.2; P ≤ .02), as did obstetrician/gynecologist Nontechnical Skills for Surgeons score (10.2-14.3; P ≤ .01). Surgery Team Strategies and Tools to Enhance Performance and Patient Safety scores demonstrated a strong correlation of movement with Nontechnical Skills for Surgeons scores (r = 0.83), as did obstetrician/gynecologist (r = 0.91). On average both general surgery (11%-100%; P ≤ .01) and obstetrician/gynecologist (50%-90%; P ≤ .01) saw a statistically significant increase in their awareness of the crisis checklist.

CONCLUSION

Team Strategies and Tools to Enhance and Patient Safety scores and Nontechnical Skills for Surgeons are effective and concordant tools for gauging general surgery and obstetrician/gynecologist resident nontechnical skills. In situ simulations are an effective way to teach general surgery and obstetrician/gynecologist residents about available crisis resources.

Interventions to improve team effectiveness within health care: a systematic review of the past decade

BACKGROUND

A high variety of team interventions aims to improve team performance outcomes. In 2008, we conducted a systematic review to provide an overview of the scientific studies focused on these interventions. However, over the past decade, the literature on team interventions has rapidly evolved. An updated overview is therefore required, and it will focus on all possible team interventions without restrictions to a type of intervention, setting, or research design.

OBJECTIVES

To review the literature from the past decade on interventions with the goal of improving team effectiveness within healthcare organizations and identify the "evidence base" levels of the research.

METHODS

Seven major databases were systematically searched for relevant articles published between 2008 and July 2018. Of the original search yield of 6025 studies, 297 studies met the inclusion criteria according to three independent authors and were subsequently included for analysis. The Grading of Recommendations, Assessment, Development, and Evaluation Scale was used to assess the level of empirical evidence.

RESULTS

Three types of interventions were distinguished: (1) Training, which is sub-divided into training that is based on predefined principles (i.e. CRM: crew resource management and TeamSTEPPS: Team Strategies and Tools to Enhance Performance and Patient Safety), on a specific method (i.e. simulation), or on general team training. (2) Tools covers tools that structure (i.e. SBAR: Situation, Background, Assessment, and Recommendation, (de)briefing checklists, and rounds), facilitate (through communication technology), or trigger (through monitoring and feedback) teamwork. (3) Organizational (re)design is about (re)designing structures to stimulate team processes and team functioning. (4) A programme is a combination of the previous types. The majority of studies evaluated a training focused on the (acute) hospital care setting. Most of the evaluated interventions focused on improving non-technical skills and provided evidence of improvements.

CONCLUSION

Over the last decade, the number of studies on team interventions has increased exponentially. At the same time, research tends to focus on certain interventions, settings, and/or outcomes. Principle-based training (i.e. CRM and TeamSTEPPS) and simulation-based training seem to provide the greatest opportunities for reaching the improvement goals in team functioning.

Multidisciplinary Simulation-Based Team Training for Trauma Resuscitation: A Scoping Review

OBJECTIVE

Simulation-based training as an educational intervention for healthcare providers has increased in use over the past 2 decades. The simulation community has called for standardized reporting of methodologies and outcomes. The purpose of this review was to (1) summarize existing data on the use of simulation-based team training for acute trauma resuscitation, and (2) describe differences in training methodologies, outcomes reporting, and gaps in the literature to inform research priorities.

DESIGN

We performed a scoping review of Ovid Medline, Embase, Cochrane Library, CINAHL, Web of Science, ERIC, and Google Scholar for studies evaluating simulation-based team training for acute trauma resuscitation. Full-text review was performed by 2 reviewers and variables related to study design, training methodology, outcomes reported, and impact of training were abstracted.

RESULTS

Forty-seven out of 3,911 screened studies met criteria for inclusion. Only 2 studies were randomized. The most frequent design was a pre-post study (64%). Eleven studies did not report their simulated scenario design. Interventions occurred most frequently in a laboratory-based setting (45%). Simulation-based training was associated with greater knowledge (n = 5/6), higher nontechnical skills (n = 12/13), greater number of resuscitation tasks completed (n = 10/13), and faster time to resuscitation task completion (n = 11/11). No differences in patient outcomes were found (n = 3/3).

CONCLUSIONS

Simulation-based training for trauma resuscitation is associated with improved measures of teamwork, task performance and speed, knowledge, and provider satisfaction. Type of reported outcomes and training methodologies are variable. Standardized reporting of training methodology and outcomes is needed to address the impact of this intervention.

The Golden Opportunity: Multidisciplinary Simulation Training Improves Trauma Team Efficiency

OBJECTIVE

Every trauma patient has a golden hour, and resuscitation efficiency within that hour has large implications for patients. We instituted simulation based trauma resuscitation training with the hypothesis that it would improve trauma team efficiency.

METHODS

Five simulation training sessions were conducted with immediate debriefing. Metrics collected in actual trauma resuscitations before and after simulation training included time of primary and secondary surveys and time to computed tomography (CT) scan. Study participants were from multidisciplinary specialties involved in trauma resuscitations as well as former trauma patients from the Trauma Survivors Network.

RESULTS

Seventy-three patients undergoing trauma resuscitations were screened and 67 patients were included. Time to CT scan and secondary survey completion were significantly reduced in actual trauma patient activations following implementation of the curriculum (reduction of 23 to 16 minutes for CT scan p < 0.05, and reduction from 14 to 6 minutes for secondary survey, p < 0.05). Time to primary survey completion did not change (5 minutes).

CONCLUSIONS

Multidisciplinary simulation training was associated with improved trauma team efficiency in the form of reduced assessment time. As emergency department length of stay is an independent predictor of hospital mortality following trauma activation, team-based simulation training has the potential to improve patient outcomes. Multidisciplinary involvement was a key factor, and Trauma Survivors Network involvement brought credibility from the patient perspective.

Observer-based tools for non-technical skills assessment in simulated and real clinical environments in healthcare: a systematic review

Background

Over the past three decades multiple tools have been developed for the assessment of non-technical skills (NTS) in healthcare. This study was designed primarily to analyse how they have been designed and tested but also to consider guidance on how to select them.

Objectives

To analyse the context of use, method of development, evidence of validity (including reliability) and usability of tools for the observer-based assessment of NTS in healthcare.

Design

Systematic review.

Data sources

Search of electronic resources, including PubMed, Embase, CINAHL, ERIC, PsycNet, Scopus, Google Scholar and Web of Science. Additional records identified through searching grey literature (OpenGrey, ProQuest, AHRQ, King’s Fund, Health Foundation).

Study selection

Studies of observer-based tools for NTS assessment in healthcare professionals (or undergraduates) were included if they: were available in English; published between January 1990 and March 2018; assessed two or more NTS; were designed for simulated or real clinical settings and had provided evidence of validity plus or minus usability. 11,101 articles were identified. After limits were applied, 576 were retrieved for evaluation and 118 articles included in this review.

Results

One hundred and eighteen studies describing 76 tools for assessment of NTS in healthcare met the eligibility criteria. There was substantial variation in the method of design of the tools and the extent of validity, and usability testing. There was considerable overlap in the skills assessed, and the contexts of use of the tools.

Conclusion

This study suggests a need for rationalisation and standardisation of the way we assess NTS in healthcare and greater consistency in how tools are developed and deployed.

An in-situ simulation-based educational outreach project for pediatric trauma care in a rural trauma system

BACKGROUND

Outcome disparities between urban and rural pediatric trauma patients persist, despite regionalization of trauma systems. Rural patients are initially transported to the nearest emergency department (ED), where pediatric care is infrequent. We aim to identify educational intervention targets and increase provider experience via pediatric trauma simulation.

METHODS

Prospective study of simulation-based pediatric trauma resuscitation was performed at three community EDs. Level one trauma center providers facilitated simulations, providing educational feedback. Provider performance comfort and skill with tasks essential to initial trauma care were assessed, comparing pre-/postsimulations. Primary outcomes were: 1) improved comfort performing skills, and 2) team performance during resuscitation.

RESULTS

Provider comfort with the following improved (p-values <0.05): infant airway, infant IV access, blood administration, infant C-spine immobilization, chest tube placement, obtaining radiographic images, initiating transport, and Broselow tape use. The proportion of tasks needing improvement decreased: 42% to 27% (p-value=0.001). Most common deficiencies were: failure to obtain additional history (75%), beginning secondary survey (58.33%), log rolling/examining the back (66.67%), calling for transport (50%), calculating medication dosages (50%).

CONCLUSIONS

Simulation-based education improves provider comfort and performance. Comparison of patient outcomes to evaluate improvement in pediatric trauma care is warranted.

LEVEL OF EVIDENCE RATING

IV.

Mannequin-based Telesimulation: Increasing Access to Simulation-based Education

A telesimulation platform utilizes communications technology to provide mannequin-based simulation education between learners and instructors located remotely from one another. Specifically, the instructor controls the mannequin and moderates the debriefing remotely. During these sessions, the instructor observes the learners in real time and provides immediate feedback during the debriefing. This platform obviates the need to have instructors, learners, and mannequins in the same place at the same time, potentially allowing simulation-based educational sessions to occur with greater frequency for institutions not located proximate to formal simulation centers. Additionally, the telesimulation platform enables an experienced simulation instructor to observe and directly help new simulation instructors at remote simulation locations. Readily available Web-conferencing, screen-sharing software, microphones, and webcams makes telesimulation possible. Mannequin-based telesimulation is relatively new and not well represented in the literature, but could facilitate systems changes, providing educational experiences to health care professionals in locations not currently benefiting from mannequin-based simulation opportunities. Several research questions need to be addressed in future studies to better develop this educational approach, including technical feasibility, logistic issues, a comparison of telesimulation to other simulation approaches, and assessing limitations of the telesimulation platform.

Realism in paediatric emergency simulations: A prospective comparison of in situ, low fidelity and centre-based, high fidelity scenarios

OBJECTIVE

To measure scenario participant and faculty self-reported realism, engagement and learning for the low fidelity, in situ simulations and compare this to high fidelity, centre-based simulations.

METHODS

A prospective survey of scenario participants and faculty completing in situ and centre-based paediatric simulations.

RESULTS

There were 382 responses, 276 from scenario participants and 106 from faculty with 241 responses from in situ and 141 from centre-based simulations. Scenario participant responses showed significantly higher ratings for the centre-based simulations for respiratory rate (P = 0.007), pulse (P = 0.036), breath sounds (P = 0.002), heart sounds (P < 0.001) and patient noises (P < 0.001). There was a significant difference in overall rating of the scenario reality by scenario participants in favour of the centre-based simulations (P = 0.005); however, there was no significant difference when rating participant engagement (P = 0.11) and participant learning (P = 0.77). With the centre-based scenarios, nurses rated the reality of the respiratory rate (P < 0.001), blood pressure (P = 0.016) and abdominal signs (P = 0.003) significantly higher than doctors. Nurses rated the overall reality higher than doctors for the centre simulations (96.8% vs 84.2% rated as realistic, P = 0.041), which was not demonstrated in the in situ scenarios (76.2% vs 73.5%, P = 0.65).

CONCLUSION

Some aspects of in situ simulations may be less 'real' than centre-based simulations, but there was no significant difference in self-reported engagement or learning by scenario participants. Low fidelity, in situ simulation provides adequate realism for engagement and learning.

Video-Based Teaching of Image-Guided Breast Interventions: Stereotactic Core Biopsy Using a Prone Table

INTRODUCTION

The introduction of new technologies and teaching strategies to educate the digital learner creates the potential for a better and more standardized training experience across programs. Thus, we sought to create an instructional video on stereotactic core breast biopsy that simulates best practices and could be readily accessed by training programs to improve and standardize resident education.

METHODS

At our institution, we use the video and questions as part of a flipped classroom educational activity. Residents are requested to complete the questions at home and watch the video. They then take the posttest questions during the lecture period, at which time the answers are reviewed and there is additional discussion of the procedure. The tests contain both video-related questions and control questions.

RESULTS

After viewing the video, there was a 30% mean improvement in the video-related questions compared to a 0% improvement in the control set of questions.

DISCUSSION

An instructional video on stereotactic core biopsy was created with associated assessment questions that can be used at any institution for the purposes of improving and standardizing training in breast imaging procedures. This resource can be especially useful for programs where trainees have limited procedure exposure.

Impact of a TeamSTEPPS Trauma Nurse Academy at a Level 1 Trauma Center

PROBLEM

Nurses are crucial members of the team caring for the acutely injured trauma patient. Until recently, nurses and physicians gained an understanding of leadership and supportive roles separately. With the advent of a multidisciplinary team approach to trauma care, formal team training and simulation has transpired.

METHODS

Since 2007, our Level I trauma system has integrated TeamSTEPPS (Team Strategies & Tools to Enhance Performance & Patient Safety; Agency for Healthcare Research and Quality, Rockville, MD) into our clinical care, joint training of nurses and physicians, using simulations with participation of all health care providers. With the increased expectations of a well-orchestrated team and larger number of emergency nurses, our program created the Trauma Nurse Academy. This academy provides a core of experienced nurses with an advanced level of training while decreasing the variability of personnel in the trauma bay. Components of the academy include multidisciplinary didactic education, the Essentials of TeamSTEPPS, and interactive trauma bay learning, to include both equipment and drug use. Once completed, academy graduates participate in the orientation and training of General Surgery and Emergency Medicine residents' trauma bay experience and injury prevention activities.

RESULTS

Internal and published data have demonstrated growing evidence linking trauma teamwork training to knowledge and self-confidence in clinical judgment to team performance, patient outcomes, and quality of care.

IMPLICATIONS FOR PRACTICE

Although trauma resuscitations are stressful, high risk, dynamic, and a prime environment for error, new methods of teamwork training and collaboration among trauma team members have become essential.

Qualitative assessment of simulation-based training for pediatric trauma resuscitation

BACKGROUND

Effective teamwork is critical in the trauma bay, although there is a lack of consensus related to optimal training for these skills. We implemented in situ trauma simulations with debriefing as a possible training methodology to improve team-oriented skills.

METHODS

Focus groups were conducted with multidisciplinary clinicians who respond to trauma activations. The focus group questions were intended to elicit discussion on the clinicians' experiences during trauma activations and simulations with an emphasis on confidence, leadership, cooperation, communication, and opportunities for improvement. Thematic content analysis was conducted using Atlas.ti analytical software.

RESULTS

Ten focus groups were held with a total of 55 clinicians. Qualitative analysis of focus group feedback revealed the following selected themes: characteristics of a strong leader during a trauma, factors impacting trauma team members' confidence, and effective communication as a key component during trauma response. Participants recommended continued simulations to enhance trauma team trust and efficiency.

CONCLUSION

Clinicians responding to pediatric trauma resuscitations valued the practice they received during trauma simulations and supported the continuation of the simulations to improve trauma activation teamwork and communication. Findings will inform the development of future simulation-based training programs to improve teamwork, confidence, and communication between trauma team members.