Simulators in training: defining the optimal role for various simulation models in the training environment

The efficacy of training insertion skill on a physical model colonoscopy simulator

Background and study aims: Prior research supports the validity of performance measures derived from the use of a physical model colonoscopy simulator - the Kyoto Kagaku Colonoscope Training Model (Kyoto Kagaku Co. Ltd., Kyoto, Japan) - for assessing insertion skill. However, its use as a training tool has received little research attention. We assessed the efficacy of a brief structured program to develop basic colonoscope insertion skill through unsupervised practice on the model. Participants and methods: This was a training study with pretesting and post-testing. Thirty-two colonoscopy novices completed an 11-hour training regime in which they practiced cases on the model in a colonoscopy simulation research laboratory. They also attempted a series of test cases before and after training. For each outcome measure (completion rates, time to cecum and peak force applied to the model), we compared trainees' post-test performance with the untrained novices and experienced colonoscopists from a previously-reported validation study. Results: Compared with untrained novices, trained novices had higher completion rates and shorter times to cecum overall (Ps < .001), but were out-performed by the experienced colono-scopists on these metrics (Ps < .001). Nevertheless, their performance was generally closer to that of the experienced group. Overall, trained novices did not differ from either experience-level comparison group in the peak forces they applied (P > .05). We also present the results broken down by case. Conclusions: The program can be used to teach trainees basic insertion skill in a more or less self-directed way. Individuals who have completed the program (or similar training on the model) are better prepared to progress to supervised live cases.

The Future of Teaching Surgical Endoscopy

Gastrointestinal surgery, with its emphasis on endoscopy, has renewed interest in teaching surgical endoscopy. The field is rapidly evolving, with innovative techniques emanating from the laboratory to the operating room and endoscopy suite. To ensure that surgeons spearhead the field of endoscopic surgery, a new strategy for teaching surgical endoscopy to residents and practicing surgeons must be developed.

Effects of simulation-based training in gastrointestinal endoscopy: a systematic review and meta-analysis

BACKGROUND & AIMS

Simulation-based training (SBT) in gastrointestinal endoscopy has been increasingly adopted by gastroenterology fellowship programs. However, the effectiveness of SBT in enhancing trainee skills remains unclear. We performed a systematic review with a meta-analysis of published literature on SBT in gastrointestinal endoscopy.

METHODS

We performed a systematic search of multiple electronic databases for all original studies that evaluated SBT in gastrointestinal endoscopy in comparison with no intervention or alternative instructional approaches. Outcomes included skills (in a test setting), behaviors (in clinical practice), and effects on patients. We pooled effect size (ES) using random-effects meta-analysis.

RESULTS

From 10,903 articles, we identified 39 articles, including 21 randomized trials of SBT, enrolling 1181 participants. Compared with no intervention (n = 32 studies), SBT significantly improved endoscopic process skills in a test setting (ES, 0.79; n = 22), process behaviors in clinical practice (ES, 0.49; n = 8), time to procedure completion in both a test setting (ES, 0.79; n = 16) and clinical practice (ES, 0.75; n = 5), and patient outcomes (procedural completion and risk of major complications; ES, 0.45; n = 10). Only 5 studies evaluated the comparative effectiveness of different SBT approaches; which provided inconclusive evidence regarding feedback and simulation modalities.

CONCLUSIONS

Simulation-based education in gastrointestinal endoscopy is associated with improved performance in a test setting and in clinical practice, and improved patient outcomes compared with no intervention. Comparative effectiveness studies of different simulation modalities are limited.

Construct validation of a physical model colonoscopy simulator

BACKGROUND

Previous studies have demonstrated the construct validity of virtual reality colonoscopy simulators by showing that they can distinguish between users according to their level of endoscopic experience. Although physical model simulators are known to simulate looping more realistically than these devices, they lack published validation evidence.

OBJECTIVE

To assess the construct validity of a physical model simulator, the Kyoto Kagaku Colonoscope Training Model (Kyoto Kagaku Co. Ltd, Kyoto, Japan) and to determine its suitability for assessing the insertion skill of trainee colonoscopists.

DESIGN

Validation study; 21 experienced colonoscopists and 18 novices made 2 attempts at each of 4 standard cases on the Kyoto Kagaku physical model simulator, and we compared their performance on each case.

SETTING

A medical simulation center in a large tertiary hospital.

MAIN OUTCOME MEASUREMENTS

Completion rates, times to cecum, and peak forces applied to the colon model.

RESULTS

Compared with novices, experienced colonoscopists had significantly higher completion to cecum rates and shorter times to cecum for each of the 4 cases (all P < .005). For 2 cases, experienced colonoscopists also exerted significantly lower peak forces than did novices (both P = .01).

LIMITATIONS

Two of the model's 6 "standard cases" were not included in the study.

CONCLUSIONS

The 4 cases included in the study have construct validity in that they can distinguish between the performance of experienced colonoscopists and novices, reproducing experienced/novice differences found in real colonoscopy. These cases can be used to validly assess the insertion skill of colonoscopy trainees.

Assessing the realism of colonoscopy simulation: the development of an instrument and systematic comparison of 4 simulators

BACKGROUND

No useful comparative data exist on the relative realism of commercially available devices for simulating colonoscopy.

OBJECTIVES

To develop an instrument for quantifying realism and provide the first wide-ranging empiric comparison.

DESIGN

Repeated measures, observational study. Nineteen experienced colonoscopists completed cases on 4 colonoscopy simulators (AccuTouch, GI Mentor II, Koken, and Kyoto Kagaku) and evaluated each device.

SETTING

A medical simulation center in a large tertiary hospital.

MAIN OUTCOME MEASURES

For each device, colonoscopists completed the newly developed Colonoscopy Simulator Realism Questionnaire (CSRQ), which contains 58 items grouped into 10 subscales measuring the realism of different aspects of the simulation. Subscale scores are weighted and combined into an aggregated score, and there is also a single overall realism item.

RESULTS

Overall, current colonoscopy simulators were rated as only moderately realistic compared with real human colonoscopy (mean aggregated score, 56.28/100; range, 48.39-60.45, where 0 = "extremely unrealistic" and 100 = "extremely realistic"). On both overall realism measures, the GI Mentor II was rated significantly less realistic than the AccuTouch, Kyoto Kagaku, and Koken (P < .001). There were also significant differences between simulators on 9 subscales, and the pattern of results varied between subscales.

LIMITATIONS

The study was limited to commercially available simulators, excluding ex-vivo models. The CSRQ does not assess simulated therapeutic procedures.

CONCLUSIONS

The CSRQ is a useful instrument for quantifying simulator realism. There is no clear "first choice" simulator among those assessed. Each has unique strengths and weaknesses, reflected in the differing results observed across 9 subscales. These findings may facilitate the targeted selection of simulators for various aspects of colonoscopy training.

Computer simulator among experts involved in screening colonoscopy

BACKGROUND

In the era of screening colonoscopy, assessment of operator competence is warranted.

AIM

To evaluate feasibility of a computer simulator (CS) use for assessment of competence in colonoscopy by investigating performance of expert endoscopists at CS.

SUBJECTS

Twenty expert endoscopists involved in screening colonoscopy.

METHODS

Experts returned a questionnaire regarding personal practice (duration of activity, number of colonoscopies in the last year and assistance by a nurse) and performances (percentage of caecal intubation and polyp detection rate). One easy and one difficult colonoscopy were proposed at CS in randomized order.

RESULTS

Participation rate was 75%. Caecal intubation rate in clinical practice was more than 90% for all experts. At CS, time to caecal intubation and number of attempts for ileal intubation were significantly lower during easy versus difficult colonoscopy (P<0.01 for both items); interestingly, percentage of mucosa explored was higher (P<0.05) during the difficult simulation. Withdrawal time >/=6 min was achieved by 40 and 33% of experts during the easy and difficult simulation, respectively. Independent of simulation difficulty, time with loop was lower (P<0.05) for experts using hands-free insertion (n = 8) compared with those using nurse assistance in their clinical practice (n = 7). No correlation was found between scores at CS and performance in clinical practice.

CONCLUSION

Scores at CS are sensitive to the rate of technical difficulty and nurse assistance during daily practice. Withdrawal time is often shorter than required for high accuracy in polyp detection. CS could be a well-accepted tool for assessment of competence.