Credentialing and certifying with simulation

Certification of Basic Skills in Endovascular Aortic Repair Through a Modular Simulation Course With Real Time Performance Assessment

OBJECTIVE

Endovascular aortic repair (EVAR) is being used increasingly for the treatment of infrarenal abdominal aortic aneurysms. Improvement in educational strategies is required to teach future vascular surgeons EVAR skills, but a comprehensive, pre-defined e-learning and simulation curriculum remains to be developed and tested. EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), an assessment tool for simulation based education (SBE) in EVAR, has previously been designed to assess EVAR skills, and a pass limit defining mastery level has been set. However, EVARATE was developed for anonymous video ratings in a research setting, and its feasibility for real time ratings in a standardised SBE programme in EVAR is unproven. This study aimed to test the effect of a newly developed simulation based modular course in EVAR. In addition, the applicability of EVARATE for real time performance assessments was investigated.

METHODS

The European Society of Vascular Surgery (ESVS) and Copenhagen Certification Programme in EVAR (ENHANCE-EVAR) was tested in a prospective cohort study. ENHANCE-EVAR is a modular SBE programme in EVAR consisting of e-learning and hands-on SBE. Participants were rated with the EVARATE tool by experienced EVAR surgeons.

RESULTS

Twenty-four physicians completed the study. The mean improvement in EVARATE score during the course was +11.8 (95% confidence interval 9.8 - 13.7) points (p < .001). Twenty-two participants (92%) passed with a mean number of 2.8 ± 0.7 test attempts to reach the pass limit. Cronbach's alpha coefficient was 0.91, corresponding to excellent reliability of the EVARATE scale. Differences between instructors' EVARATE ratings were insignificant (p = .16), with a maximum variation between instructors of ± 1.3 points.

CONCLUSION

ENHANCE-EVAR, a comprehensive certifying EVAR course, was proven to be effective. EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE) is a trustworthy tool for assessing performance within an authentic educational setting, enabling real time feedback.

A Decade Later-Progress and Next Steps for Pediatric Simulation Research

SUMMARY STATEMENT

A decade ago, at the time of formation of the International Network for Pediatric Simulation-based Innovation, Research, and Education, the group embarked on a consensus building exercise. The goal was to forecast the facilitators and barriers to growth and maturity of science in the field of pediatric simulation-based research. This exercise produced 6 domains critical to progress in the field: (1) prioritization, (2) research methodology and outcomes, (3) academic collaboration, (4) integration/implementation/sustainability, (5) technology, and (6) resources/support/advocacy. This article reflects on and summarizes a decade of progress in the field of pediatric simulation research and suggests next steps in each domain as we look forward, including lessons learned by our collaborative grass roots network that can be used to accelerate research efforts in other domains within healthcare simulation science.

Simulation-Based Assessment Identifies Longitudinal Changes in Cognitive Skills in an Anesthesiology Residency Training Program

OBJECTIVES

We describe observed improvements in nontechnical or "higher-order" deficiencies and cognitive performance skills in an anesthesia residency cohort for a 1-year time interval. Our main objectives were to evaluate higher-order, cognitive performance and to demonstrate that simulation can effectively serve as an assessment of cognitive skills and can help detect "higher-order" deficiencies, which are not as well identified through more traditional assessment tools. We hypothesized that simulation can identify longitudinal changes in cognitive skills and that cognitive performance deficiencies can then be remediated over time.

METHODS

We used 50 scenarios evaluating 35 residents during 2 subsequent years, and 18 of those 35 residents were evaluated in both years (post graduate years 3 then 4) in the same or similar scenarios. Individual basic knowledge and cognitive performance during simulation-based scenarios were assessed using a 20- to 27-item scenario-specific checklist. Items were labeled as basic knowledge/technical (lower-order cognition) or advanced cognitive/nontechnical (higher-order cognition). Identical or similar scenarios were repeated annually by a subset of 18 residents during 2 successive academic years. For every scenario and item, we calculated group error scenario rate (frequency) and individual (resident) item success. Grouped individuals' success rates are calculated as mean (SD), and item success grade and group error rates are calculated and presented as proportions. For all analyses, α level is 0.05.

RESULTS

Overall PGY4 residents' error rates were lower and success rates higher for the cognitive items compared with technical item performance in the operating room and resuscitation domains. In all 3 clinical domains, the cognitive error rate by PGY4 residents was fairly low (0.00-0.22) and the cognitive success rate by PGY4 residents was high (0.83-1.00) and significantly better compared with previous annual assessments (P < 0.05). Overall, there was an annual decrease in error rates for 2 years, primarily driven by decreases in cognitive errors. The most commonly observed cognitive error types remained anchoring, availability bias, premature closure, and confirmation bias.

CONCLUSIONS

Simulation-based assessments can highlight cognitive performance areas of relative strength, weakness, and progress in a resident or resident cohort. We believe that they can therefore be used to inform curriculum development including activities that require higher-level cognitive processing.

Attitudes Towards Introduction of Multiple Modalities of Simulation in Objective Structured Clinical Examination (OSCE) of Emergency Medicine (EM) Final Board Examination: A Cross-Sectional Study

Purpose

Objective Structured Clinical Examination (OSCE) is the current modality of choice for evaluating practical skills for graduating emergency medicine residents of final Saudi board examination. This study aims to evaluate the attitudes of both residents and faculty towards the idea of utilizing multiple modalities of simulation in a high-stakes emergency medicine (EM) examination. The goal is to propose a method to improve the process of this examination.

Participants and Methods

The data were obtained using a cross-sectional survey questionnaire that was distributed to 141 participants, including both EM residents and instructors in the Saudi Board of Emergency Medicine. An online survey tool was used. The data were collected and subsequently analyzed to gauge the general and specific attitudes of both residents and instructors.

Results

Of the 141 participants, 136 provided complete responses; almost half were residents from all years, and the other half were primarily instructors (registrars, senior registrars, or consultants). Most of the participants from both groups (70% of the residents and 86% of the instructors) would like to see simulation incorporated into the final EM board OSCEs. Most of the participants (78%), however, had no experience with using multiple modalities of simulation in OSCEs. Overall, the majority (74.82%) expressed the belief that simulation-based OSCEs would improve the assessment of EM residents’ competencies. The modalities that received the most support were part-task trainers and hybrid simulation (70.71% and 70%, respectively).

Conclusion

From this study, we can conclude that both parties (residents and instructors) are largely willing to see multimodality simulation being incorporated into the final board examinations. Stakeholders should interpret this consensus as an impetus to proceed with such an implementation of multimodality simulation. Input from both groups should be considered when planning for such a change in this high-stakes exam.

Multi-Disciplinary Trauma Evaluation and Management Simulation (MD-TEAMS) training for emergency medicine and general surgery residents

BACKGROUND

Successful trauma resuscitation relies on multi-disciplinary collaboration. In most academic programs, general surgery (GS) and emergency medicine (EM) residents rarely train together before functioning as a team.

METHODS

In our Multi-Disciplinary Trauma Evaluation and Management Simulation (MD-TEAMS), EM and GS residents completed manikin-based trauma scenarios and were evaluated on resuscitation and communication skills. Residents were surveyed on confidence surrounding training objectives.

RESULTS

Residents showed improved confidence running trauma scenarios in multi-disciplinary teams. Residents received lower communication scores from same-discipline vs cross-discipline faculty. EM residents scored higher in evaluation and planning domains; GS residents scored higher in action processes; groups scored equally in team management. Strong correlation existed between team leader communication and resuscitative skill completion.

CONCLUSION

MD-TEAMS demonstrated correlation between communication and resuscitation checklist item completion and communication differences by resident specialty. In the future, we plan to evaluate training-related resident behavior changes and specialty-specific communication differences by residents.

Simulation in Neurocritical Care: Past, Present, and Future

Simulation-based medical education is a technique that leverages adult learning theory to train healthcare professionals by recreating real-world scenarios in an interactive way. It allows learners to emotionally engage in the assessment and management of critically ill patients without putting patients at risk. Learners are encouraged to work at the edge of their expertise to promote growth and are provided with feedback to nurture development. Thus, the training is targeted to the learner, not the patient. Despite its origins as a teaching tool for neurological diseases, simulation-based medical education has been historically abandoned by neurocritical care educators. In contrast, other critical care educators have embraced the technique and built an impressive foundation of literature supporting its use. Slowly, neurocritical care educators have started experimenting with simulation-based medical education and sharing their results. In this review, we will investigate the historical origins of simulation in the neurosciences, the conceptual framework supporting the technique, current applications, and future directions.

Interprofessional simulation training in difficult airway management: a narrative review

The aim of this narrative literature review was to explore the impact of interprofessional simulation-based team training on difficult airway management. The Fourth National Audit Project of The Royal College of Anaesthetists and The Difficult Airway Society identified recurrent deficits in practice that included delayed recognition of critical events, inadequate provision of appropriately trained staff and poor collaboration and communication strategies between teams. Computerised databases were assessed to enable data collection, and a narrative literature review and synthesis of eight quantitative studies were performed. Four core themes were identified: debriefing, measures of assessment and evaluation, non-technical skills and patient safety, and patient outcomes. There are many benefits to be gained from interprofessional simulation training as a method of teaching high-risk and infrequent clinical airway emergencies. The practised response to emergency algorithms is crucial and plays a vital role in the reduction of errors and adverse patient outcomes.

The impact of simulated patient death on medical students' stress response and learning of ACLS

INTRODUCTION

There is considerable controversy as to whether the simulator should die during high-fidelity simulation (HFS). We sought to describe the physiologic and biochemical stress response induced by simulated patient death as well as the impact on long-term retention of Advanced Cardiovascular Life Support (ACLS) knowledge and skills.

METHODS

Twenty-six subjects received an American Heart Association (AHA) ACLS provider course. Following the course, subjects participated in HFS and were randomized to simulated death or survival. Heart rate and salivary cortisol (SC) and dihydroepiandrosterone (DHEA) were collected at this time. Subjects returned six months later for a follow-up simulation in which ACLS knowledge and skills were tested.

RESULTS

For all participants, there was an increase in heart rate during simulation compared with baseline heart rate (+ 32 beats/minute), p < 0.0001. Similarly, SC and DHEA were higher compared with baseline levels (+ 0.115 μg/dL, p <0.01 and + 97 pg/mL, p < 0.001, respectively). However, the only statistically significant difference between groups was an increase in heart rate response at the end of the simulation compared with baseline in the death group (+ 29.2 beats/minute versus + 18.5 beats/minute), p < 0.05. There was no difference on long-term knowledge or skills.

CONCLUSIONS

Learners experience stress during high-fidelity simulation; however, there does not appear to be a readily detectable difference or negative response to a simulated patient death compared with simulated survival.

Simulation With PARTS (Phase-Augmented Research and Training Scenarios): A Structure Facilitating Research and Assessment in Simulation

INTRODUCTION

Assessment in simulation is gaining importance, as are scenario design methods increasing opportunity for assessment. We present our approach to improving measurement in complex scenarios using PARTS [Phase-Augmented Research and Training Scenarios], essentially separating cases into clearly delineated phases.

METHODS

We created 7 PARTS with real-time rating instruments and tested these in 63 cases during 4 weeks of simulation. Reliability was tested by comparing real-time rating with postsimulation video-based rating using the same instrument. Validity was tested by comparing preintervention and postintervention total results, by examining the difference in improvement when focusing on the phase-specific results addressed by the intervention, and further explored by trying to demonstrate the discrete improvement expected from proficiency in the rare occurrence of leader inclusive behavior.

RESULTS

Intraclass correlations [3,1] between real-time and postsimulation ratings were 0.951 (95% confidence interval [CI], 0.794-0.990), 1.00 (95% CI, --to--), 0.948 (95% CI, 0.783-0.989), and 0.995 (95% CI, 0.977-0.999) for 3 phase-specific scores and total scenario score, respectively. Paired t tests of prelecture-postlecture performance showed an improvement of 14.26% (bias-corrected and accelerated bootstrap [BCa] 95% CI, 4.71-23.82; P = 0.009) for total performance but of 28.57% (BCa 95% CI, 13.84-43.30; P = 0.002) for performance in the respective phase. The correlation of total scenario performance with leader inclusiveness was not significant (rs = 0.228; BCa 95% CI. -0.082 to 0.520; P = 0.119) but significant for specific phase performance (rs = 0.392; BCa 95% CI, 0.118-0.632; P = 0.006).

CONCLUSIONS

The PARTS allowed for improved reliability and validity of measurements in complex scenarios.

Mobile in Situ Simulation as a Tool for Evaluation and Improvement of Trauma Treatment in the Emergency Department

BACKGROUND

Medical simulation is an increasingly recognized tool for teaching, coaching, training, and examining practitioners in the medical field. For many years, simulation has been used to improve trauma care and teamwork. Despite technological advances in trauma simulators, including better means of mobilization and control, most reported simulation-based trauma training has been conducted inside simulation centers, and the practice of mobile simulation in hospitals' trauma rooms has not been investigated fully.

METHODS

The emergency department personnel from a second-level trauma center in Israel were evaluated. Divided into randomly formed trauma teams, they were reviewed twice using in situ mobile simulation training at the hospital's trauma bay. In all, 4 simulations were held before and 4 simulations were held after a structured learning intervention. The intervention included a 1-day simulation-based training conducted at the Israel Center for Medical Simulation (MSR), which included video-based debriefing facilitated by the hospital's 4 trauma team leaders who completed a 2-day simulation-based instructors' course before the start of the study. The instructors were also trained on performance rating and thus were responsible for the assessment of their respective teams in real time as well as through reviewing of the recorded videos; thus enabling a comparison of the performances in the mobile simulation exercise before and after the educational intervention.

RESULTS

The internal reliability of the experts' evaluation calculated in the Cronbach α model was found to be 0.786. Statistically significant improvement was observed in 4 of 10 parameters, among which were teamwork (29.64%) and communication (24.48%) (p = 0.00005).

CONCLUSION

The mobile in situ simulation-based training demonstrated efficacy both as an assessment tool for trauma teams' function and an educational intervention when coupled with in vitro simulation-based training, resulting in a significant improvement of the teams' function in various aspects of treatment.

Developing a trauma curriculum for anesthesiology residents and fellows

PURPOSE OF REVIEW

The board certification process for qualification by the American Board of Anesthesiology is undergoing significant review. A basic sciences examination has been added to the process and the traditional oral examination is evolving into a combined oral interview and practical skills assessment. These recent developments, as well as the growing body of evidence regarding the resuscitation of trauma patients, call for a revision in the curriculum beyond the documentation of participation in the anesthetics of 20 trauma patients.

RECENT FINDINGS

The implications of the 80-h work week are beginning to be appreciated. The development of a new trauma curriculum must take this significant change in residency training into account while incorporating modern educational theory (e.g. simulation) and new data on the resuscitation of trauma patients.

SUMMARY

Currently, the curriculum for trauma anesthesia requires only that residents participate in the anesthetics of 20 trauma patients. There is no plan for, and little literature regarding, a more extensive educational program. This offers a unique opportunity to innovate a novel curriculum in the anesthesiology residency. The American Society of Anesthesiologists Committee on Trauma and Emergency Preparedness has designed a curriculum that can serve as a template for this important step forward in anesthesiology education.

Construct Validity and Generalizability of Simulation-Based Objective Structured Clinical Examination Scenarios

BACKGROUND

It is not known if construct-related validity (progression of scores with different levels of training) and generalizability of Objective Structured Clinical Examination (OSCE) scenarios previously used with non-US graduating anesthesiology residents translate to a US training program.

OBJECTIVE

We assessed for progression of scores with training for a validated high-stakes simulation-based anesthesiology examination.

METHODS

Fifty US anesthesiology residents in postgraduate years (PGYs) 2 to 4 were evaluated in operating room, trauma, and resuscitation scenarios developed for and used in a high-stakes Israeli Anesthesiology Board examination, requiring a score of 70% on the checklist for passing (including all critical items).

RESULTS

The OSCE error rate was lower for PGY-4 than PGY-2 residents in each field, and for most scenarios within each field. The critical item error rate was significantly lower for PGY-4 than PGY-3 residents in operating room scenarios, and for PGY-4 than PGY-2 residents in resuscitation scenarios. The final pass rate was significantly higher for PGY-3 and PGY-4 than PGY-2 residents in operating room scenarios, and also was significantly higher for PGY-4 than PGY-2 residents overall. PGY-4 residents had a better error rate, total scenarios score, general evaluation score, critical items error rate, and final pass rate than PGY-2 residents.

CONCLUSIONS

The comparable error rates, performance grades, and pass rates for US PGY-4 and non-US (Israeli) graduating (PGY-4 equivalent) residents, and the progression of scores among US residents with training level, demonstrate the construct-related validity and generalizability of these high-stakes OSCE scenarios.

History of simulation in medicine: from Resusci Annie to the Ann Myers Medical Center

Medical and surgical graduate medical education has historically used a halstedian approach of "see one, do one, teach one." Increased public demand for safety, quality, and accountability in the setting of regulated resident work hours and limited resources is driving the development of innovative educational tools. The use of simulation in nonmedical, medical, and neurosurgical disciplines is reviewed in this article. Simulation has been validated as an educational tool in nonmedical fields such as aviation and the military. Across most medical and surgical subspecialties, simulation is recognized as a valuable tool that will shape the next era of medical education, postgraduate training, and maintenance of certification.

Simulation-based assessment to evaluate cognitive performance in an anesthesiology residency program

BACKGROUND

Problem solving in a clinical context requires knowledge and experience, and most traditional examinations for learners do not capture skills that are required in some situations where there is uncertainty about the proper course of action.

OBJECTIVE

We sought to evaluate anesthesiology residents for deficiencies in cognitive performance within and across 3 clinical domains (operating room, trauma, and cardiac resuscitation) using simulation-based assessment.

METHODS

Individual basic knowledge and cognitive performance in each simulation-based scenario were assessed in 47 residents using a 15- to 29-item scenario-specific checklist. For every scenario and item we calculated group error scenario rate (frequency) and individual (resident) item success. For all analyses, alpha was designated as 0.05.

RESULTS

Postgraduate year (PGY)-3 and PGY-4 residents' cognitive items error rates were higher and success rates lower compared to basic and technical performance in each domain tested (P < .05). In the trauma and resuscitation scenarios, the cognitive error rate by PGY-4 residents was fairly high (0.29-0.5) and their cognitive success rate was low (0.5-0.68). The most common cognitive errors were anchoring, availability bias, premature closure, and confirmation bias.

CONCLUSIONS

Simulation-based assessment can differentiate between higher-order (cognitive) and lower-order (basic and technical) skills expected of relatively experienced (PGY-3 and PGY-4) anesthesiology residents. Simulation-based assessments can also highlight areas of relative strength and weakness in a resident group, and this information can be used to guide curricular modifications to address deficiencies in tasks requiring higher-order processing and cognition.

Simulation in healthcare education: a best evidence practical guide. AMEE Guide No. 82

Over the past two decades, there has been an exponential and enthusiastic adoption of simulation in healthcare education internationally. Medicine has learned much from professions that have established programs in simulation for training, such as aviation, the military and space exploration. Increased demands on training hours, limited patient encounters, and a focus on patient safety have led to a new paradigm of education in healthcare that increasingly involves technology and innovative ways to provide a standardized curriculum. A robust body of literature is growing, seeking to answer the question of how best to use simulation in healthcare education. Building on the groundwork of the Best Evidence in Medical Education (BEME) Guide on the features of simulators that lead to effective learning, this current Guide provides practical guidance to aid educators in effectively using simulation for training. It is a selective review to describe best practices and illustrative case studies. This Guide is the second part of a two-part AMEE Guide on simulation in healthcare education. The first Guide focuses on building a simulation program, and discusses more operational topics such as types of simulators, simulation center structure and set-up, fidelity management, and scenario engineering, as well as faculty preparation. This Guide will focus on the educational principles that lead to effective learning, and include topics such as feedback and debriefing, deliberate practice, and curriculum integration - all central to simulation efficacy. The important subjects of mastery learning, range of difficulty, capturing clinical variation, and individualized learning are also examined. Finally, we discuss approaches to team training and suggest future directions. Each section follows a framework of background and definition, its importance to effective use of simulation, practical points with examples, and challenges generally encountered. Simulation-based healthcare education has great potential for use throughout the healthcare education continuum, from undergraduate to continuing education. It can also be used to train a variety of healthcare providers in different disciplines from novices to experts. This Guide aims to equip healthcare educators with the tools to use this learning modality to its full capability.

[Bringing clinical simulation into an Anesthesia residency training program in a university hospital. Participants' acceptability assessment]

INTRODUCTION

Clinical simulation is currently an integral part of the curriculum of the Anesthesiology residency programs in other countries. We aimed to describe and evaluate the insertion of simulation in an anesthesia residency training program.

METHODS

Activities feasible to be used for training in a simulated environment were classified into 2 modules: workshops for technical skills conducted with first year residents, and high fidelity simulation scenarios performed with second and third year residents. After each activity, and using an anonymous questionnaire, residents assessed their satisfaction and objectives accomplished.

RESULTS

A total of 18 activities: 6 skills workshops and 12 high fidelity scenarios were assessed. A total of 206 questionnaires were analyzed, corresponding to 41 residents. Almost all (96%) of respondents agreed or strongly agreed that workshops met the objectives and should be mandatory in the anesthesia curriculum; however, 11% agreed that the activity caused anxiety and/or nervousness. The high fidelity scenarios were considered realistic and consistent with the objectives by 97% of residents, and 42% felt that workshops caused anxiety and/or nervousness.

CONCLUSIONS

The inclusion of simulation has been well accepted by the residents. The activities have been described as realistic, and limited to the objectives, essential points in adult education, as according to Kolb's learning model this is associated with profound, useful and long lasting knowledge.

Training in trauma management: the role of simulation-based medical education

Simulation-based medical education (SBME) offers a safe and "mistake-forgiving" environment to teach and train medical professionals. The diverse range of medical-simulation modalities enables trainees to acquire and practice an array of tasks and skills. SBME offers the field of trauma training multiple opportunities to enhance the effectiveness of the education provided in this challenging domain. Further research is needed to better learn the role of simulation-based learning in trauma management and education.

Rater training to support high-stakes simulation-based assessments

Competency-based assessment and an emphasis on obtaining higher-level outcomes that reflect physicians' ability to demonstrate their skills has created a need for more advanced assessment practices. Simulation-based assessments provide medical education planners with tools to better evaluate the 6 Accreditation Council for Graduate Medical Education (ACGME) and American Board of Medical Specialties (ABMS) core competencies by affording physicians opportunities to demonstrate their skills within a standardized and replicable testing environment, thus filling a gap in the current state of assessment for regulating the practice of medicine. Observational performance assessments derived from simulated clinical tasks and scenarios enable stronger inferences about the skill level a physician may possess, but also introduce the potential of rater errors into the assessment process. This article reviews the use of simulation-based assessments for certification, credentialing, initial licensure, and relicensing decisions and describes rater training strategies that may be used to reduce rater errors, increase rating accuracy, and enhance the validity of simulation-based observational performance assessments.

Simulation in Otolaryngology

Simulation is revolutionizing medical education, certification, and ongoing professional development. Simulation encompasses a variety of technologies as well as nontechnical approaches to improve individual psychomotor skills, group effectiveness, and systems processes, all without direct risk to patients. Simulation-enhanced learning experiences, addressing learning objectives based on the needs of the individual or the group and following the principles of adult education, can be used to ensure consistent and comprehensive learning opportunities, thereby creatively complementing didactic and clinical learning experiences. Pockets of simulation expertise are already present in the field of otolaryngology; more will develop as these exciting and important innovations blossom.

High-fidelity simulation in anesthesiology training: a survey of Canadian anesthesiology residents' simulator experience

PURPOSE

The objective of this survey was to explore Canadian anesthesiology residents' educational experience with high-fidelity simulation and to improve understanding of the factors perceived to have either a positive or a negative effect on residents' learning.

METHODS

In 2008, all Canadian anesthesiology residents (n = 599) were invited to complete a ten-minute anonymous online survey. Survey questions were derived from two sources, a literature search of MEDLINE (1966 to present), EMBASE (1980 to present), and the Cochrane and Campbell collaboration libraries and the experience of 25 pilot residents and the lead author.

RESULTS

The survey response rate was 27.9% (n = 167). Junior residents (PGY1-3) responded that it would be helpful to have an introductory simulation course dealing with common intraoperative emergencies. The introduction of multidisciplinary scenarios (where nurses and colleagues from different specialties were involved in scenarios) was strongly supported. With respect to gender, male anesthesia residents indicated their comfort in making mistakes and asking for help in the simulator more frequently than female residents. In accordance with the ten Best Evidence Medical Education (BEME) principles of successful simulator education, Canadian centres could improve residents' opportunities for repetitive practice (with feedback), individualization of scenarios, and defined learning outcomes for scenarios.

DISCUSSION

Anesthesiology residents indicate that simulation-based education is an anxiety provoking experience, but value its role in promoting safe practice and enhancing one's ability to deal with emergency situations. Suggestions to improve simulation training include increasing residents' access, adopting a more student-centred approach to learning, and creating a safer learning environment.

The utility of simulation in medical education: what is the evidence?

Medical schools and residencies are currently facing a shift in their teaching paradigm. The increasing amount of medical information and research makes it difficult for medical education to stay current in its curriculum. As patients become increasingly concerned that students and residents are "practicing" on them, clinical medicine is becoming focused more on patient safety and quality than on bedside teaching and education. Educators have faced these challenges by restructuring curricula, developing small-group sessions, and increasing self-directed learning and independent research. Nevertheless, a disconnect still exists between the classroom and the clinical environment. Many students feel that they are inadequately trained in history taking, physical examination, diagnosis, and management. Medical simulation has been proposed as a technique to bridge this educational gap. This article reviews the evidence for the utility of simulation in medical education. We conducted a MEDLINE search of original articles and review articles related to simulation in education with key words such as simulation, mannequin simulator, partial task simulator, graduate medical education, undergraduate medical education, and continuing medical education. Articles, related to undergraduate medical education, graduate medical education, and continuing medical education were used in the review. One hundred thirteen articles were included in this review. Simulation-based training was demonstrated to lead to clinical improvement in 2 areas of simulation research. Residents trained on laparoscopic surgery simulators showed improvement in procedural performance in the operating room. The other study showed that residents trained on simulators were more likely to adhere to the advanced cardiac life support protocol than those who received standard training for cardiac arrest patients. In other areas of medical training, simulation has been demonstrated to lead to improvements in medical knowledge, comfort in procedures, and improvements in performance during retesting in simulated scenarios. Simulation has also been shown to be a reliable tool for assessing learners and for teaching topics such as teamwork and communication. Only a few studies have shown direct improvements in clinical outcomes from the use of simulation for training. Multiple studies have demonstrated the effectiveness of simulation in the teaching of basic science and clinical knowledge, procedural skills, teamwork, and communication as well as assessment at the undergraduate and graduate medical education levels. As simulation becomes increasingly prevalent in medical school and resident education, more studies are needed to see if simulation training improves patient outcomes.

Hybrid simulation combining a high fidelity scenario with a pelvic ultrasound task trainer enhances the training and evaluation of endovaginal ultrasound skills

OBJECTIVES

In this study, an endovaginal ultrasound (US) task trainer was combined with a high-fidelity US mannequin to create a hybrid simulation model. In a scenario depicting a patient with ectopic pregnancy and hemorrhagic shock, this model was compared with a standard high-fidelity simulation during training sessions with emergency medicine (EM) residents. The authors hypothesized that use of the hybrid model would increase both the residents' self-reported educational experience and the faculty's self-reported ability to evaluate the residents' skills.

METHODS

A total of 45 EM residents at two institutions were randomized into two groups. Each group was assigned to one of two formats involving an ectopic pregnancy scenario. One format incorporated the new hybrid model, in which residents had to manipulate an endovaginal US probe in a task trainer; the other used the standard high-fidelity simulation mannequin together with static photo images. After finishing the scenario, residents self-rated their overall learning experience and how well the scenario evaluated their ability to interpret endovaginal US images. Faculty members reviewed video recordings of the other institution's residents and rated their own ability to evaluate residents' skills in interpreting endovaginal US images and diagnosing and managing the case scenario. Visual analog scales (VAS) were used for the self-ratings.

RESULTS

Compared to the residents assigned to the standard simulation scenario, residents assigned to the hybrid model reported an increase in their overall educational experience (Delta VAS = 10, 95% confidence interval [CI] = 4 to 18) and felt the hybrid model was a better measure of their ability to interpret endovaginal US images (Delta VAS = 17, 95% CI = 7 to 28). Faculty members found the hybrid model to be better than the standard simulation for evaluating residents' skills in interpreting endovaginal US images (Delta VAS = 13, 95% CI = 6 to 20) and diagnosing and managing the case (Delta VAS = 10, 95% CI = 2 to 18). Time to reach a diagnosis was similar in both groups (p = 0.053).

CONCLUSIONS

Use of a hybrid simulation model combining a high-fidelity simulation with an endovaginal US task trainer improved residents' educational experience and improved faculty's ability to evaluate residents' endovaginal US and clinical skills. This novel hybrid tool should be considered for future education and evaluation of EM residents.

In Situ Simulation-based Team Training for Post-cardiac Surgical Emergency Chest Reopen in the Intensive Care Unit

Emergency chest reopen of the post cardiac surgical patient in the intensive care unit is a high-stakes but infrequent procedure which requires a high-level team response and a unique skill set. We evaluated the impact on knowledge and confidence of team-based chest reopen training using a patient simulator compared with standard video-based training. We evaluated 49 medical and nursing participants before and after training using a multiple choice questions test and a questionnaire of self-reported confidence in performing or assisting with emergency reopen.

Both video- and simulation-based training significantly improved results in objective and subjective domains. Although the post-test scores did not differ between the groups for either the objective (P=0.28) or the subjective measures (P=0.92), the simulation-based training produced a numerically larger improvement in both domains. In a multiple choice question out of 10, participants improved by a mean of 1.9 marks with manikin-based training compared to 0.9 with video training (P=0.03). On a questionnaire out of 20 assessing subjective levels of confidence, scores improved by 3.9 with manikin training compared to 1.2 with video training (P=0.002).

Simulation-based training appeared to be at least as effective as video-based training in improving both knowledge and confidence in post cardiac surgical emergency resternotomy.

Educational and research implications of portable human patient simulation in acute care medicine

Advanced medical simulation has become widespread. One development, the adaptation of simulation techniques and manikin technologies for portable operation, is starting to impact the training of personnel in acute care fields such as emergency medicine (EM) and trauma surgery. Unencumbered by cables and wires, portable simulation programs mitigate several limitations of traditional (nonportable) simulation and introduce new approaches to acute care education and research. Portable simulation is already conducted across multiple specialties and disciplines. In situ medical simulations are those carried out within actual clinical environments, while off-site portable simulations take place outside of clinical practice settings. Mobile simulation systems feature functionality while moving between locations; progressive simulations are longer-duration events using mobile simulations that follow a simulated patient through sequential care environments. All of these variants have direct applications for acute care medicine. Unique training and investigative opportunities are created by portable simulation through four characteristics: 1) enhancement of experiential learning by reframing training inside clinical care environments, 2) improving simulation accessibility through delivery of training to learner locations, 3) capitalizing on existing care environments to maximize simulation realism, and 4) provision of improved training capabilities for providers in specialized fields. Research agendas in acute care medicine are expanded via portable simulation's introduction of novel topics, new perspectives, and innovative methodologies. Presenting opportunities and challenges, portable simulation represents an evolutionary progression in medical simulation. The use of portable manikins and associated techniques may increasingly complement established instructional measures and research programs at acute care institutions and simulation centers.

Summative assessment in medicine: the promise of simulation for high-stakes evaluation

Throughout their careers, physicians are exposed to a wide array of assessments, including those aimed at evaluating knowledge, clinical skills, and clinical decision-making. While many of these assessments are used as part of formative evaluation activities, others are employed to establish competence and, as a byproduct, to promote patient safety. In the past 10 years, simulations have been successfully incorporated in a number of high-stakes physician certification and licensure exams. In developing these simulation-based assessments, testing organizations were able to promote novel test administration protocols, build enhanced assessment rubrics, advance sophisticated scoring and equating algorithms, and promote innovative standard-setting methods. Moreover, numerous studies have been conducted to identify potential threats to the validity of test score interpretations. As simulation technology expands and new simulators are invented, this groundbreaking work can serve as a basis for organizations to build or expand their summative assessment activities. Although there will continue to be logistical and psychometric problems, many of which will be specialty- or simulator-specific, past experience with performance-based assessments suggests that most challenges can be addressed through focused research. Simulation, whether it involves standardized patients (SPs), computerized case management scenarios, part-task trainers, electromechanical mannequins, or a combination of these methods, holds great promise for high-stakes assessment.

Human patient simulation and its role in endoscopic sedation training

Patient simulation is now considered to be a valid method for the education and evaluation of providers of sedation. Using full-scale human simulators to provide a realistic setting, participants can acquire skills for patient monitoring, administration of sedation medications, and the recognition and management of critical events. Although obstacles to its implementation exist, it appears likely that simulation training will become an integral part of training for providers of procedural sedation.