National growth in simulation training within emergency medicine residency programs, 2003-2008

Simulation in medical school education: review for emergency medicine

Medical education is rapidly evolving. With the paradigm shift to small-group didactic sessions and focus on clinically oriented case-based scenarios, simulation training has provided educators a novel way to deliver medical education in the 21st century. The field continues to expand in scope and practice and is being incorporated into medical school clerkship education, and specifically in emergency medicine (EM). The use of medical simulation in graduate medical education is well documented. Our aim in this article is to perform a retrospective review of the current literature, studying simulation use in EM medical student clerkships. Studies have demonstrated the effectiveness of simulation in teaching basic science, clinical knowledge, procedural skills, teamwork, and communication skills. As simulation becomes increasingly prevalent in medical school curricula, more studies are needed to assess whether simulation training improves patient-related outcomes.

Simulation in medical student education: survey of clerkship directors in emergency medicine

Introduction

The objective of this study is to identify (1) the current role of simulation in medical student emergency medicine (EM) education; (2) the challenges to initiating and sustaining simulation-based programs; and (3) educational advances to meet these challenges.

Methods

We solicited members of the Clerkship Directors in Emergency Medicine (CDEM) e-mail list to complete a Web-based survey addressing the use of simulation in both EM clerkships and preclinical EM curricula. Survey elements addressed the nature of the undergraduate EM clerkship and utilization of simulation, types of technology, and barriers to increased use in each setting.

Results

CDEM members representing 60 EM programs on the list (80%) responded. Sixty-seven percent of EM clerkships are in the fourth year of medical school only and 45% are required. Fewer than 25% of clerkship core curriculum hours incorporate simulation. The simulation modalities used most frequently were high-fidelity models (79%), task trainers (55%), and low-fidelity models (30%). Respondents identified limited faculty time (88.7%) and clerkship hours (47.2%) as the main barriers to implementing simulation training in EM clerkships. Financial resources, faculty time, and the volume of students were the main barriers to additional simulation in preclinical years.

Conclusion

A focused, stepwise application of simulation to medical student EM curricula can help optimize the ratio of student benefit to faculty time. Limited time in the curriculum can be addressed by replacing existing material with simulation-based modules for those subjects better suited to simulation. Faculty can use hybrid approaches in the preclinical years to combine simulation with classroom settings for either small or large groups to more actively engage learners while minimizing identified barriers.

Directed self-regulated learning versus instructor-regulated learning in simulation training

OBJECTIVES

Simulation training offers opportunities for unsupervised, self-regulated learning, yet little evidence is available to indicate the efficacy of this approach in the learning of procedural skills. We evaluated the effectiveness of directed self-regulated learning (DSRL) and instructor-regulated learning (IRL), respectively, for teaching lumbar puncture (LP) using simulation.

METHODS

We randomly assigned internal medicine residents in postgraduate year 1 to either DSRL ('directed' to progress from easy to difficult LP simulators during self-regulated learning) or IRL (in groups of four led by an instructor). All participants practised for up to 50 minutes and completed a pre-test, post-test and delayed (by 3 months) retention test on the simulator. Pairs of blinded trained experts independently rated all videotaped performances using a validated global rating scale and a modified version of a validated checklist. Participants provided measures of LP experience and self-reported confidence. We analysed the pre-post (n = 42) and pre-post-retention performance scores (n = 23) using two separate repeated-measures analyses of variance (anovas) and computed Pearson correlation coefficients between participants' confidence and performance scores.

RESULTS

Inter-rater agreement was strong for both performance measures (intra-class correlation coefficient > 0.81). The groups achieved similar pre-test and post-test scores (p > 0.05) and scores in both groups improved significantly from the pre- to the post-test (p < 0.05). On retention, a significant interaction (F(2,42) = 3.92, p = 0.03) suggests the DSRL group maintained its post-test performance, whereas that in the IRL group dropped significantly (p < 0.05). Correlations between self-reported confidence and post-test performance were positive and significant for the DSRL group, and negative and non-significant for the IRL group.

CONCLUSIONS

Both IRL and DSRL led to improved LP performance immediately after practice. Whereas the IRL group's skills declined after 3 months, the DSRL group's performance was maintained, suggesting a potential long-term benefit of this training. Participants in the DSRL group also developed a more accurate relationship between confidence and competence following practice. Further research is needed to clarify the mechanisms of self-regulated learning and its role in simulation contexts.

Can simulation replace part of clinical time? Two parallel randomised controlled trials

CONTEXT

Education in simulated learning environments (SLEs) has grown rapidly across health care professions, yet no substantive randomised controlled trial (RCT) has investigated whether SLEs can, in part, substitute for traditional clinical education.

METHODS

Participants were physiotherapy students (RCT 1, n = 192; RCT 2, n = 178) from six Australian universities undertaking clinical education in an ambulatory care setting with patients with musculoskeletal disorders. A simulated learning programme was developed as a replica for clinical education in musculoskeletal practice to replace 1 week of a 4-week clinical education placement. Two SLE models were designed. Model 1 provided 1 week in the SLE, followed by 3 weeks in clinical immersion; Model 2 offered training in the SLE in parallel with clinical immersion during the first 2 weeks of the 4-week placement. Two single-blind, multicentre RCTs (RCT 1, Model 1; RCT 2, Model 2) were conducted using a non-inferiority design to determine if the clinical competencies of students part-educated in SLEs would be any worse than those of students educated fully in traditional clinical immersion. The RCTs were conducted simultaneously, but independently. Within each RCT, students were stratified on academic score and randomised to either the SLE group or the control ('Traditional') group, which undertook 4 weeks of traditional clinical immersion. The primary outcome measure was a blinded assessment of student competency conducted over two clinical examinations at week 4 using the Assessment of Physiotherapy Practice (APP) tool.

RESULTS

Students' achievement of clinical competencies was no worse in the SLE groups than in the Traditional groups in either RCT (Margin [Δ] ≥ 0.4 difference on APP score; RCT 1: 95% CI - 0.07 to 0.17; RCT 2: 95% CI - 0.11 to 0.16).

CONCLUSIONS

These RCTs provide evidence that clinical education in an SLE can in part (25%) replace clinical time with real patients without compromising students' attainment of the professional competencies required to practise.

As accessible as a book on a library shelf: the imperative of routine simulation in modern health care

Technology-enhanced patient simulation has emerged as an important new modality for teaching and learning in medicine. In particular, immersive simulation platforms that replicate the clinical environment promise to revolutionize medical education by enabling an enhanced level of safety, standardization, and efficiency across health-care training. Such an experiential approach seems unique in reliably catalyzing a level of emotional engagement that fosters immediate and indelible learning and allows for increasingly reliable levels of performance evaluation-all in a completely risk-free environment. As such, medical simulation is poised to emerge as a critical component of training and certification throughout health care, promising to fundamentally enhance quality and safety across disciplines. To encourage routine simulation-based practice as part of its core quality and safety mission, Massachusetts General Hospital now incorporates simulation resources within its historic medical library (est. 1847), located at the center of the campus. In this new model, learners go to the library not only to read about a patient's illness, but also to take care of their "patient." Such an approach redefines and advances the central role of the library on the campus and ensures that simulation-based practice is centrally available as part of everyday hospital operations. This article describes the reasons for identifying simulation as an institutional priority leading up to the Massachusetts General Hospital Bicentennial Celebration (1811-2011) and for creating a simulation-based learning laboratory within a hospital library.

[Bringing clinical simulation into anesthesiology and postoperative recovery care residency training]

This article describes the use of clinical simulations for training residents in anesthesiology and postoperative recovery care at Hospital Universitario Marqués de Valdecilla. A working group defined criteria for the competencies residents would acquire by means of simulation training, designed the scenarios to be used, and took responsibility for coordinating and funding the program. We used the platform of the Critical Events Training Center of the Marcelino Botin Foundation, now part of our center's virtual hospital. The simulation-based training modules include 4 activities in the residents' first year, 3 in each of the second and third years, and 4 in the fourth year; all center on acquisition of the identified competencies and take into consideration the time availability of residents and instructors and the budget. We have concluded that integrating clinical simulations into residency training is a challenge for educators, given that a large part of the benefit derived from this tool comes from complementing it with other instructional resources and adapting it to the syllabus. More studies are required to establish criteria to guide the integration of this tool into the curriculum in those areas of the specialty where it can work most efficiently; the effectiveness of the approach also needs to be assessed. Simulations facilitate training without putting patients at risk and provide residents with early exposure to situations that might otherwise be difficult to observe. This tool also encourages the practice of reflective clinical decision-making.

Perceptions of High-Fidelity Simulation Teaching by Non-Specialist Doctors in an Emergency Department in Singapore

Simulation training was introduced in 2008 as part of the core education program for non-specialist doctors posted to our department. It aims to help them improve clinical knowledge and skills, as well as to facilitate teamwork and communication. A survey was conducted to elicit their views on this training technique. All the participants felt that it was most effective in improving knowledge base in resuscitation work while 97 % felt that the session allowed them to train their critical decision making skills. Only 57% felt that the session helped them to improve their patient and doctor communication skills. Simulation training has been generally well received and deemed beneficial by the participants in our study.

Use of simulation-based education to improve outcomes of central venous catheterization: a systematic review and meta-analysis

PURPOSE

Central venous catheterization (CVC) is increasingly taught by simulation. The authors reviewed the literature on the effects of simulation training in CVC on learner and clinical outcomes.

METHOD

The authors searched computerized databases (1950 to May 2010), reference lists, and considered studies with a control group (without simulation education intervention). Two independent assessors reviewed the retrieved citations. Independent data abstraction was performed on study design, study quality score, learner characteristics, sample size, components of interventional curriculum, outcomes assessed, and method of assessment. Learner outcomes included performance measures on simulators, knowledge, and confidence. Patient outcomes included number of needle passes, arterial puncture, pneumothorax, and catheter-related infections.

RESULTS

Twenty studies were identified. Simulation-based education was associated with significant improvements in learner outcomes: performance on simulators (standardized mean difference [SMD] 0.60 [95% CI 0.45 to 0.76]), knowledge (SMD 0.60 [95% CI 0.35 to 0.84]), and confidence (SMD 0.41 [95% CI 0.30 to 0.53] for studies with single-group pretest and posttest design; SMD 0.52 (95% CI 0.23 to 0.81) for studies with nonrandomized, two-group design). Furthermore, simulation-based education was associated with improved patient outcomes, including fewer needle passes (SMD -0.58 [95% CI -0.95 to -0.20]), and pneumothorax (relative risk 0.62 [95% CI 0.40 to 0.97]), for studies with nonrandomized, two-group design. However, simulation-based training was not associated with a significant reduction in risk of either arterial puncture or catheter-related infections.

CONCLUSIONS

Despite some limitations in the literature reviewed, evidence suggests that simulation-based education for CVC provides benefits in learner and select clinical outcomes.

Difficult airway simulator intubation success rates using Commission on Accreditation of Medical Transport systems training standards

OBJECTIVES

This study was undertaken to evaluate difficult airway simulator intubation success rates using Commission on Accreditation of Medical Transport Systems (CAMTS) initial and maintenance intubation training standards on transport-RN novice intubators over a 1-year period.

METHODS

Twelve transport nurses were blinded to and randomly assigned five or six of 64 different difficult airway simulator scenarios. Intubation success rates were measured 1 month before training, 1 month after training, and 1 year later, following CAMTS initial and maintenance intubation standards. Outcome measurements included first attempt intubation rate, overall intubation success rate, number of attempts to intubation, time per attempt, time to intubation, and time between attempts. During the study, participants received no additional training or opportunities to intubate.

RESULTS

First-attempt intubation rates significantly improved (P 5 .022) from 19% 1 month before training to 36% 1 month after training, but did not significantly change (P > .999) 1 year later following CAMTS maintenance standards (34%). Mean cumulative success rates did not significantly improve after four attempts or after 3.5 minutes. The overall mean time per attempt and time between attempts declined with subsequent intubation attempts.

CONCLUSIONS

Using initial and maintenance CAMTS standards, simulator difficult airway intubation success rates are low in novice intubators. Our results suggest that one intubation/quarter may be enough to maintain difficult airway intubation success rates. Training significantly improves intubation rates. Little advantage occurs in intubation rates after four attempts or 3.5 minutes.

Simulation in emergency medicine training

Simulation provides a range of educational tools that have increasingly been incorporated into emergency medicine (EM) curricula. Standardized patients and some partial task trainers, such as intubation heads, have been used for decades. More recently, a growing number of computer-screen simulations, high-fidelity mannequins, and virtual-reality simulators have expanded the number of procedures and conditions, which can be effectively simulated.The Accreditation Council for Graduate Medical Education transitioned to a competency-based assessment of residency programs in 2001 and included simulation as a method for incorporating the 6 core competencies into graduate medical education curricula. Over the past decade, numerous peer-reviewed publications have promoted simulation as an effective educational tool for each of the core competencies.The advanced technology used to operate many current simulators can erroneously become the focus of efforts to create a simulation-based curriculum. Simulation can most effectively be incorporated into EM curricula through the use of time-proven concepts, which start with defining the targeted learners, assessing their general and specific educational needs, defining learning objectives, and selecting the best educational strategy for achieving each objective. In many, but not all, instances, simulation can be the best tool for achieving EM learning objectives.

Simulation center accreditation and programmatic benchmarks: a review for emergency medicine

Simulation-based education has grown significantly over the past 10 years. As a result, more professional organizations are developing or implementing accreditation processes to help define minimum standards and best practices in simulation-based training. However, the benefits and potential pitfalls of sponsoring and implementing such programs have yet to be fully evaluated across specialties. The board of directors of the Society for Academic Emergency Medicine (SAEM) requested an evaluation of the potential to create an emergency medicine (EM)-based Simulation Consultation and Accreditation Service. In response to this request, the Simulation Accreditation and Consultation Work Group, a subgroup of the Committee on Technology in Medical Education (now Simulation Academy), was created. The work group was charged with: 1) reviewing current benchmarks and standards set by existing simulation accreditation programs; 2) analyzing current EM simulation program structures, including leadership, administrative, and financial components; and 3) proposing a potential model for EM-based simulation accreditation. This article outlines currently existing and proposed accreditation models and identifies components that support best practices. It then goes on to describe three general programmatic models to better understand how simulation training can be operationalized in EM. Finally, the work group uses this collective information to propose how an accreditation process, in concert with the SAEM Simulation Consultation Service, can enhance and advance EM simulation training.

Centre of Excellence For Simulation Education and Innovation (CESEI)

Simulation is becoming an integral part of medical education. The American College of Surgeons (ACS) was the first organization to recognize the value of simulation-based learning, and to award accreditation for educational institutions that aim to provide simulation as part of the experiential learning opportunity. Centre of Excellence for Simulation Education and Innovation (CESEI) is a multidisciplinary and interprofessional educational facility that is based at the University of British Columbia (UBC) and Vancouver Costal Health Authority (VCH). Centre of Excellence for Simulation Education and Innovation's goal is to provide excellence in education, research, and healthcare delivery by providing a technologically advanced environment and learning opportunity using simulation for various groups of learners including undergraduate, postgraduate, nursing, and allied health professionals. This article is an attempt to describe the infrastructure, services, and uniqueness of the Centre of Excellence for Simulation Education and Innovation.

The usefulness of design of experimentation in defining the effect difficult airway factors and training have on simulator oral-tracheal intubation success rates in novice intubators

OBJECTIVES

This exploratory study examined novice intubators and the effect difficult airway factors have on pre- and posttraining oral-tracheal simulation intubation success rates.

METHODS

Using a two-level, full-factorial design of experimentation (DOE) involving a combination of six airway factors (curved vs. straight laryngoscope blade, trismus, tongue edema, laryngeal spasm, pharyngeal obstruction, or cervical immobilization), 64 airway scenarios were prospectively randomized to 12 critical care nurses to evaluate pre- and posttraining first-pass intubation success rates on a simulator. Scenario variables and intubation outcomes were analyzed using a generalized linear mixed-effects model to determine two-way main and interactive effects.

RESULTS

Interactive effects between the six study factors were nonsignificant (p = 0.69). For both pre- and posttraining, main effects showed the straight blade (p = 0.006), tongue edema (p = 0.0001), and laryngeal spasm (p = 0.004) significantly reduced success rates, while trismus (p = 0.358), pharyngeal obstruction (p = 0.078), and cervical immobilization did not significantly change the success rate. First-pass intubation success rate on the simulator significantly improved (p = 0.005) from pre- (19%) to posttraining (36%).

CONCLUSIONS

Design of experimentation is useful in analyzing the effect difficult airway factors and training have on simulator intubation success rates. Future quality improvement DOE simulator research studies should be performed to help clarify the relationship between simulator factors and patient intubation rates.

The utility of simulation in medical education: what is the evidence?

Medical schools and residencies are currently facing a shift in their teaching paradigm. The increasing amount of medical information and research makes it difficult for medical education to stay current in its curriculum. As patients become increasingly concerned that students and residents are "practicing" on them, clinical medicine is becoming focused more on patient safety and quality than on bedside teaching and education. Educators have faced these challenges by restructuring curricula, developing small-group sessions, and increasing self-directed learning and independent research. Nevertheless, a disconnect still exists between the classroom and the clinical environment. Many students feel that they are inadequately trained in history taking, physical examination, diagnosis, and management. Medical simulation has been proposed as a technique to bridge this educational gap. This article reviews the evidence for the utility of simulation in medical education. We conducted a MEDLINE search of original articles and review articles related to simulation in education with key words such as simulation, mannequin simulator, partial task simulator, graduate medical education, undergraduate medical education, and continuing medical education. Articles, related to undergraduate medical education, graduate medical education, and continuing medical education were used in the review. One hundred thirteen articles were included in this review. Simulation-based training was demonstrated to lead to clinical improvement in 2 areas of simulation research. Residents trained on laparoscopic surgery simulators showed improvement in procedural performance in the operating room. The other study showed that residents trained on simulators were more likely to adhere to the advanced cardiac life support protocol than those who received standard training for cardiac arrest patients. In other areas of medical training, simulation has been demonstrated to lead to improvements in medical knowledge, comfort in procedures, and improvements in performance during retesting in simulated scenarios. Simulation has also been shown to be a reliable tool for assessing learners and for teaching topics such as teamwork and communication. Only a few studies have shown direct improvements in clinical outcomes from the use of simulation for training. Multiple studies have demonstrated the effectiveness of simulation in the teaching of basic science and clinical knowledge, procedural skills, teamwork, and communication as well as assessment at the undergraduate and graduate medical education levels. As simulation becomes increasingly prevalent in medical school and resident education, more studies are needed to see if simulation training improves patient outcomes.

Alternatives to the conference status quo: summary recommendations from the 2008 CORD Academic Assembly Conference Alternatives workgroup

Abstract Objective: A panel of Council of Emergency Medicine Residency Directors (CORD) members was asked to examine and make recommendations regarding the existing Accreditation Council of Graduate Medical Education (ACGME) EM Program Requirements pertaining to educational conferences, identified best practices, and recommended revisions as appropriate.

METHODS

Using quasi-Delphi technique, 30 emergency medicine (EM) residency program directors and faculty examined existing requirements. Findings were presented to the CORD members attending the 2008 CORD Academic Assembly, and disseminated to the broader membership through the CORD e-mail list server.

RESULTS

The following four ACGME EM Program Requirements were examined, and recommendations made: 1. The 5 hours/week conference requirement: For fully accredited programs in good standing, outcomes should be driving how programs allocate and mandate educational time. Maintain the 5 hours/week conference requirement for new programs, programs with provisional accreditation, programs in difficult political environs, and those with short accreditation cycles. If the program requirements must retain a minimum hours/week reference, future requirements should take into account varying program lengths (3 versus 4 years). 2. The 70% attendance requirement: Develop a new requirement that allows programs more flexibility to customize according to local resources, individual residency needs, and individual resident needs. 3. The requirement for synchronous versus asynchronous learning: Synchronous and asynchronous learning activities have advantages and disadvantages. The ideal curriculum capitalizes on the strengths of each through a deliberate mixture of each. 4. Educationally justified innovations: Transition from process-based program requirements to outcomes-based requirements.

CONCLUSIONS

The conference requirements that were logical and helpful years ago may not be logical or helpful now. Technologies available to educators have changed, the amount of material to cover has grown, and online on-demand education has grown even more. We believe that flexibility is needed to customize EM education to suit individual resident and individual program needs, to capitalize on regional and national resources when local resources are limited, to innovate, and to analyze and evaluate interventions with an eye toward outcomes.

Highlights in emergency medicine medical education research: 2008

OBJECTIVES

The purpose of this article is to highlight medical education research studies published in 2008 that were methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine.

METHODS

Through a PubMed search of the English language literature in 2008, 30 medical education research studies were independently identified as hypothesis-testing investigations and measurements of educational interventions. Six reviewers independently rated and scored all articles based on eight anchors, four of which related to methodologic criteria. Articles were ranked according to their total rating score. A ranking agreement among the reviewers of 83% was established a priori as a minimum for highlighting articles in this review.

RESULTS

Five medical education research studies met the a priori criteria for inclusion and are reviewed and summarized here. Four of these employed experimental or quasi-experimental methodology. Although technology was not a component of the structured literature search employed to identify the candidate articles for this review, 14 of the articles identified, including four of the five highlighted articles, employed or studied technology as a focus of the educational research. Overall, 36% of the reviewed studies were supported by funding; three of the highlighted articles were funded studies.

CONCLUSIONS

This review highlights quality medical education research studies published in 2008, with outcomes of relevance to teaching and education in emergency medicine. It focuses on research methodology, notes current trends in the use of technology for learning in emergency medicine, and suggests future avenues for continued rigorous study in education.

Hybrid simulation combining a high fidelity scenario with a pelvic ultrasound task trainer enhances the training and evaluation of endovaginal ultrasound skills

OBJECTIVES

In this study, an endovaginal ultrasound (US) task trainer was combined with a high-fidelity US mannequin to create a hybrid simulation model. In a scenario depicting a patient with ectopic pregnancy and hemorrhagic shock, this model was compared with a standard high-fidelity simulation during training sessions with emergency medicine (EM) residents. The authors hypothesized that use of the hybrid model would increase both the residents' self-reported educational experience and the faculty's self-reported ability to evaluate the residents' skills.

METHODS

A total of 45 EM residents at two institutions were randomized into two groups. Each group was assigned to one of two formats involving an ectopic pregnancy scenario. One format incorporated the new hybrid model, in which residents had to manipulate an endovaginal US probe in a task trainer; the other used the standard high-fidelity simulation mannequin together with static photo images. After finishing the scenario, residents self-rated their overall learning experience and how well the scenario evaluated their ability to interpret endovaginal US images. Faculty members reviewed video recordings of the other institution's residents and rated their own ability to evaluate residents' skills in interpreting endovaginal US images and diagnosing and managing the case scenario. Visual analog scales (VAS) were used for the self-ratings.

RESULTS

Compared to the residents assigned to the standard simulation scenario, residents assigned to the hybrid model reported an increase in their overall educational experience (Delta VAS = 10, 95% confidence interval [CI] = 4 to 18) and felt the hybrid model was a better measure of their ability to interpret endovaginal US images (Delta VAS = 17, 95% CI = 7 to 28). Faculty members found the hybrid model to be better than the standard simulation for evaluating residents' skills in interpreting endovaginal US images (Delta VAS = 13, 95% CI = 6 to 20) and diagnosing and managing the case (Delta VAS = 10, 95% CI = 2 to 18). Time to reach a diagnosis was similar in both groups (p = 0.053).

CONCLUSIONS

Use of a hybrid simulation model combining a high-fidelity simulation with an endovaginal US task trainer improved residents' educational experience and improved faculty's ability to evaluate residents' endovaginal US and clinical skills. This novel hybrid tool should be considered for future education and evaluation of EM residents.

Simulation in graduate medical education 2008: a review for emergency medicine

Health care simulation includes a variety of educational techniques used to complement actual patient experiences with realistic yet artificial exercises. This field is rapidly growing and is widely used in emergency medicine (EM) graduate medical education (GME) programs. We describe the state of simulation in EM resident education, including its role in learning and assessment. The use of medical simulation in GME is increasing for a number of reasons, including the limitations of the 80-hour resident work week, patient dissatisfaction with being "practiced on," a greater emphasis on patient safety, and the importance of early acquisition of complex clinical skills. Simulation-based assessment (SBA) is advancing to the point where it can revolutionize the way clinical competence is assessed in residency training programs. This article also discusses the design of simulation centers and the resources available for developing simulation programs in graduate EM education. The level of interest in these resources is evident by the numerous national EM organizations with internal working groups focusing on simulation. In the future, the health care system will likely follow the example of the airline industry, nuclear power plants, and the military, making rigorous simulation-based training and evaluation a routine part of education and practice.