Assessment Scores of a Mock Objective Structured Clinical Examination Administered to 99 Anesthesiology Residents at 8 Institutions

Simulation-Based Education in Acute and Chronic Pain Training

PURPOSE OF REVIEW

The use of simulation-based education (SBE) in medical training has expanded greatly and has grown to include high fidelity and task simulation along with hybrid models using patient actors to enhance education and training of critical events as well as technical skills.

RECENT FINDINGS

In the field of anesthesiology, SBE has been particularly useful for crisis resource management and rare critical scenarios and new research into the use of SBE using task simulation for procedural skill development has been done highlighting the benefits to subspecialty procedural training. Medical simulation has become a common practice in medical training and research. SBE has demonstrated positive outcomes in improving technical skills, knowledge, comfort, and clinical performance. The widespread implementation of SBE in regional anesthesia and chronic pain training varies, with cost and availability being factors. Nonetheless, SBE has shown great potential in enhancing education and preparing physicians in subspecialties of anesthesia.

A modern roadmap for the use of simulation in regional anesthesiology training

PURPOSE OF REVIEW

A variety of educational modalities are used to teach regional anesthesia. Simulation is an educational tool that facilitates hands-on learning in a well tolerated, reproducible environment, eliminating potential harm to patients during the process of learning. Available literature and expert consensus statements support customizing simulation programs according to the level of training and experience of the learners.

RECENT FINDINGS

Simulation is useful for learners of all levels of expertise, though the application and frequency of simulation must be adapted to meet the learners' objectives.

SUMMARY

This review presents recommendations for the use of simulation for residents, fellows, practicing anesthesiologists without formal training in regional anesthesia, and practicing anesthesiologists with regional anesthesia expertise. Passports and portfolio programs that include simulation can be used to verify training. Virtual applications of simulation are growing, expanding the scope of regional anesthesia simulation and increasing access to lower resource areas.

Reliability of simulation-based assessment for practicing physicians: performance is context-specific

INTRODUCTION

Even physicians who routinely work in complex, dynamic practices may be unprepared to optimally manage challenging critical events. High-fidelity simulation can realistically mimic critical clinically relevant events, however the reliability and validity of simulation-based assessment scores for practicing physicians has not been established.

METHODS

Standardised complex simulation scenarios were developed and administered to board-certified, practicing anesthesiologists who volunteered to participate in an assessment study during formative maintenance of certification activities. A subset of the study population agreed to participate as the primary responder in a second scenario for this study. The physicians were assessed independently by trained raters on both teamwork/behavioural and technical performance measures. Analysis using Generalisability and Decision studies were completed for the two scenarios with two raters.

RESULTS

The behavioural score was not more reliable than the technical score. With two raters > 20 scenarios would be required to achieve a reliability estimate of 0.7. Increasing the number of raters for a given scenario would have little effect on reliability.

CONCLUSIONS

The performance of practicing physicians on simulated critical events may be highly context-specific. Realistic simulation-based assessment for practicing physicians is resource-intensive and may be best-suited for individualized formative feedback. More importantly, aggregate data from a population of participants may have an even higher impact if used to identify skill or knowledge gaps to be addressed by training programs and inform continuing education improvements across the profession.