Surgical skills training and simulation

Validation of a Novel Cognitive Simulator for Orbital Floor Reconstruction

PURPOSE

The increasing focus on patient safety in current medical practice has promoted the development of surgical simulation technology in the form of virtual reality (VR) training designed largely to improve technical skills and less so for nontechnical aspects of surgery such as decision making and material knowledge. The present study investigated the validity of a novel cognitive VR simulator called Touch Surgery for a core maxillofacial surgical procedure: orbital floor reconstruction (OFR).

MATERIALS AND METHODS

A cross-sectional study was carried out on 2 groups of participants with different experience levels. Novice graduate dental students and expert surgeons were recruited from a local dental school and academic residency programs, respectively. All participants completed the OFR module on Touch Surgery. The primary outcome variable was simulator performance score. Post-module questionnaires rating specific aspects of the simulation experience were completed by the 2 groups and served as the secondary outcome variables. The age and gender of participants were considered additional predictor variables. From these data, conclusions were made regarding 3 types of validity (face, content, and construct) for the Touch Surgery simulator. Dependent-samples t tests were used to explore the consistency in simulation performance scores across phases 1 and 2 by experience level. Two multivariate ordinary least-squares regression models were fit to estimate the relation between experience and phase 1 and 2 scores.

RESULTS

Thirty-nine novices and 10 experts who were naïve to Touch Surgery were recruited for the study. Experts outperformed novices on phases 1 and 2 of the OFR module (P < .001), which provided the measurement of construct validation. Responses to the questionnaire items used to assess face validity were favorable from the 2 groups. Positive questionnaire responses also were recorded from experts alone on items assessing the content validity for the module. Participant age and gender were not relevant predictors of performance scores.

CONCLUSION

Construct, content, and face validities were observed for the OFR module on a novel cognitive simulator, Touch Surgery. Therefore, OFR simulation on the smart device platform could serve as a useful cognitive training and assessment tool in maxillofacial surgery residency programs.

The efficacy of training insertion skill on a physical model colonoscopy simulator

Background and study aims: Prior research supports the validity of performance measures derived from the use of a physical model colonoscopy simulator - the Kyoto Kagaku Colonoscope Training Model (Kyoto Kagaku Co. Ltd., Kyoto, Japan) - for assessing insertion skill. However, its use as a training tool has received little research attention. We assessed the efficacy of a brief structured program to develop basic colonoscope insertion skill through unsupervised practice on the model. Participants and methods: This was a training study with pretesting and post-testing. Thirty-two colonoscopy novices completed an 11-hour training regime in which they practiced cases on the model in a colonoscopy simulation research laboratory. They also attempted a series of test cases before and after training. For each outcome measure (completion rates, time to cecum and peak force applied to the model), we compared trainees' post-test performance with the untrained novices and experienced colonoscopists from a previously-reported validation study. Results: Compared with untrained novices, trained novices had higher completion rates and shorter times to cecum overall (Ps < .001), but were out-performed by the experienced colono-scopists on these metrics (Ps < .001). Nevertheless, their performance was generally closer to that of the experienced group. Overall, trained novices did not differ from either experience-level comparison group in the peak forces they applied (P > .05). We also present the results broken down by case. Conclusions: The program can be used to teach trainees basic insertion skill in a more or less self-directed way. Individuals who have completed the program (or similar training on the model) are better prepared to progress to supervised live cases.

Basic airway skills acquisition using the American College of Surgeons/Association for Surgical Education medical student simulation-based surgical skills curriculum: Initial results

BACKGROUND

The ACS/ASE Medical Student Simulation-Based Skills Curriculum was developed to standardize medical student training. This study aims to evaluate the feasibility and validity of implementing the basic airway curriculum.

METHODS

This single-center, prospective study of medical students participating in the basic airway module from 12/2014-3/2016 consisted of didactics, small-group practice, and testing in a simulated clinical scenario. Proficiency was determined by a checklist of skills (1-15), global score (1-5), and letter grade (NR-needs review, PS-proficient in simulation scenario, CP-proficient in clinical scenario). A proportion of students completed pre/post-test surveys regarding experience, satisfaction, comfort, and self-perceived proficiency.

RESULTS

Over 16 months, 240 students were enrolled with 98% deemed proficient in a simulated or clinical scenario. Pre/post-test surveys (n = 126) indicated improvement in self-perceived proficiency by 99% of learners. All students felt moderately to very comfortable performing basic airway skills and 94% had moderate to considerable satisfaction after completing the module.

CONCLUSIONS

The ACS/ASE Surgical Skills Curriculum is a feasible and effective way to teach medical students basic airway skills using simulation.

Experience of General Surgery Residents in the Creation of Small Bowel and Colon Anastomoses

BACKGROUND

With the introduction of stapling devices (SDs), the proportion of hand-sewn (HS) intestinal anastomoses (IAs) has declined. As more IAs are constructed with SDs, there are fewer opportunities for general surgery residents (GSRs) to acquire the skills for HS techniques during their training.

STUDY DESIGN

Data for this study were extracted from an existing database of all IAs performed at the Department of Surgery of the Morristown Medical Center since 2003. For the purposes of this study, a 5.5-year timeframe was used between July 2006 and 2011, which contained 1659 IA operations on adult patients with resident involvement. GSRs of the 5-year general surgery residency program were grouped by postgraduate year (PGY) for further analysis.

RESULTS

The number of all IAs created by each resident during the 5-year training was 67.2 on average. Most of these operations were done in the last 2 years of the training: 45.1% of all IAs in PGY5 and 37.3% of all IAs in PGY4. Of all, 1659 IAs performed in the study period, 711 (42.9% of total) were done laparoscopically and 948 (57.1% of all IAs) were done as open operations. Laparoscopic operations had a proportionally higher rate of SD use when compared to open cases (90.9% vs 82.4%). On average, each resident constructed 9.4 HS IAs (13.98% of all IAs) and 57.8 SD IAs (86.02% of total). Out of all anastomoses, ostomy reversals (30.7%) had the highest percentage of HS suturing followed by right colectomies (27.5%), ileal pouch-anal anastomoses and total colectomies and proctocolectomies (23.3%), small bowel resection (17.0%), and left colectomies (5.5%). Regardless of the location of the operation, stapled and sutured anastomoses had similar outcomes measured by the rate of anastomotic leaks. Residents used significantly more SDs in the creation of anastomoses than HS suturing in the PGY3, PGY4, and PGY5 years. We also documented that attending surgeons who are older more often used HS suturing than their younger colleagues when creating IAs.

CONCLUSIONS

The experiences of GSRs in IA operations are heavily weighted toward the use of SDs. There are select cases, however, when HS suturing can have an advantage over stapler use in anastomosis creation. Therefore, we believe that GSRs should continue learning, perfecting, and using the both techniques.

Robotic surgery training: construct validity of Global Evaluative Assessment of Robotic Skills (GEARS)

The objective of this study is to determine the ability of the GEARS scale (Global Evaluative Assessment of Robotic Skills) to differentiate individuals with different levels of experience in robotic surgery, as a fundamental validation. This is a cross-sectional study that included three groups of individuals with different levels of experience in robotic surgery (expert, intermediate, novice) their performance were assessed by GEARS applied by two reviewers. The difference between groups was determined by Mann-Whitney test and the consistency between the reviewers was studied by Kendall W coefficient. The agreement between the reviewers of the scale GEARS was 0.96. The score was 29.8 ± 0.4 to experts, 24 ± 2.8 to intermediates and 16 ± 3 to novices, with a statistically significant difference between all of them (p < 0.05). All parameters from the scale allow discriminating between different levels of experience, with exception of the depth perception item. We conclude that the scale GEARS was able to differentiate between individuals with different levels of experience in robotic surgery and, therefore, is a validated and useful tool to evaluate surgeons in training.

Laparoscopic surgery skills evaluation: analysis based on accelerometers

Background and Objective:

Technical skills assessment is considered an important part of surgical training. Subjective assessment is not appropriate for training feedback, and there is now increased demand for objective assessment of surgical performance. Economy of movement has been proposed as an excellent alternative for this purpose. The investigators describe a readily available method to evaluate surgical skills through motion analysis using accelerometers in Apple's iPod Touch device.

Methods:

Two groups of individuals with different minimally invasive surgery skill levels (experts and novices) were evaluated. Each group was asked to perform a given task with an iPod Touch placed on the dominant-hand wrist. The Accelerometer Data Pro application makes it possible to obtain movement-related data detected by the accelerometers. Average acceleration and maximum acceleration for each axis (x, y, and z) were determined and compared.

Results:

The analysis of average acceleration and maximum acceleration showed statistically significant differences between groups on both the y (P = .04, P = .03) and z (P = .04, P = .04) axes. This demonstrates the ability to distinguish between experts and novices. The analysis of the x axis showed no significant differences between groups, which could be explained by the fact that the task involves few movements on this axis.

Conclusion:

Accelerometer-based motion analysis is a useful tool to evaluate laparoscopic skill development of surgeons and should be used in training programs. Validation of this device in an in vivo setting is a research goal of the investigators' team.

Face and construct validation of a next generation virtual reality (Gen2-VR) surgical simulator

INTRODUCTION

Surgical performance is affected by distractors and interruptions to surgical workflow that exist in the operating room. However, traditional surgical simulators are used to train surgeons in a skills laboratory that does not recreate these conditions. To overcome this limitation, we have developed a novel, immersive virtual reality (Gen2-VR) system to train surgeons in these environments. This study was to establish face and construct validity of our system.

METHODS AND PROCEDURES

The study was a within-subjects design, with subjects repeating a virtual peg transfer task under three different conditions: Case I: traditional VR; Case II: Gen2-VR with no distractions and Case III: Gen2-VR with distractions and interruptions. In Case III, to simulate the effects of distractions and interruptions, music was played intermittently, the camera lens was fogged for 10 s and tools malfunctioned for 15 s at random points in time during the simulation. At the completion of the study subjects filled in a 5-point Likert scale feedback questionnaire. A total of sixteen subjects participated in this study.

RESULTS

Friedman test showed significant difference in scores between the three conditions (p < 0.0001). Post hoc analysis using Wilcoxon signed-rank tests with Bonferroni correction further showed that all the three conditions were significantly different from each other (Case I, Case II, p < 0.0001), (Case I, Case III, p < 0.0001) and (Case II, Case III, p = 0.009). Subjects rated that fog (mean 4.18) and tool malfunction (median 4.56) significantly hindered their performance.

CONCLUSION

The results showed that Gen2-VR simulator has both face and construct validity and that it can accurately and realistically present distractions and interruptions in a simulated OR, in spite of limitations of the current HMD hardware technology.

Assessment parameters for a novel simulator in minimally invasive spine surgery

Surgical simulators provide a safe environment where novice surgeons can acquire their surgical skills. Although the number of patients with diseases of the musculoskeletal system is growing, the development of orthopedic simulators is still in it's infancy. The aim of this work was to identify simulation-based assessment parameters for a novel simulator in minimally invasive spine surgery. Apart from parameters targeting the duration and the surgeon's economy of motion during percutaneous bone access, parameters characterizing the movement smoothness were also examined with respect to their suitability. The results indicated, that the overall duration, the number of instrument movements, the number of velocity peaks and the Movement Arrest Period Ratio are the most promising predictors of expertise. Targeting performance improvement, the overall duration (p = 0.001), the number of instrument movements (p = 0.003) and the traveled instrument path length (p = 0.009) detected significant differences between subsequent trials. Using these parameters, a study can be designed targeting the validity and reliability of the simulation-based assessment.

Acquisition and maintenance of medical expertise: a perspective from the expert-performance approach with deliberate practice

As a part of a special collection in this issue of Academic Medicine, which is focused on mastery learning in medical education, this Perspective describes how the expert-performance approach with deliberate practice is consistent with many characteristics of mastery learning. Importantly, this Perspective also explains how the expert-performance approach provides a very different perspective on the acquisition of skill. Whereas traditional education with mastery learning focuses on having students attain an adequate level of performance that is based on goals set by the existing curricula, the expert-performance approach takes an empirical approach and first identifies the final goal of training-namely, reproducibly superior objective performance (superior patient outcomes) for individuals in particular medical specialties. Analyzing this superior complex performance reveals three types of mental representations that permit expert performers to plan, execute, and monitor their own performance. By reviewing research on medical performance and education, the author describes evidence for these representations and their development within the expert-performance framework. He uses the research to generate suggestions for improved training of medical students and professionals. Two strategies-designing learning environments with libraries of cases and creating opportunities for individualized teacher-guided training-should enable motivated individuals to acquire a full set of refined mental representations. Providing the right resources to support the expert-performance approach will allow such individuals to become self-regulated learners-that is, members of the medical community who have the tools to improve their own and their team members' performances throughout their entire professional careers.

Unsupervised Trajectory Segmentation for Surgical Gesture Recognition in Robotic Training

Dexterity and procedural knowledge are two critical skills that surgeons need to master to perform accurate and safe surgical interventions. However, current training systems do not allow us to provide an in-depth analysis of surgical gestures to precisely assess these skills. Our objective is to develop a method for the automatic and quantitative assessment of surgical gestures. To reach this goal, we propose a new unsupervised algorithm that can automatically segment kinematic data from robotic training sessions. Without relying on any prior information or model, this algorithm detects critical points in the kinematic data that define relevant spatio-temporal segments. Based on the association of these segments, we obtain an accurate recognition of the gestures involved in the surgical training task. We, then, perform an advanced analysis and assess our algorithm using datasets recorded during real expert training sessions. After comparing our approach with the manual annotations of the surgical gestures, we observe 97.4% accuracy for the learning purpose and an average matching score of 81.9% for the fully automated gesture recognition process. Our results show that trainees workflow can be followed and surgical gestures may be automatically evaluated according to an expert database. This approach tends toward improving training efficiency by minimizing the learning curve.

Virtual reality training for improving the skills needed for performing surgery of the ear, nose or throat

BACKGROUND

Virtual reality simulation uses computer-generated imagery to present a simulated training environment for learners. This review seeks to examine whether there is evidence to support the introduction of virtual reality surgical simulation into ear, nose and throat surgical training programmes.

OBJECTIVES

1. To assess whether surgeons undertaking virtual reality simulation-based training achieve surgical ('patient') outcomes that are at least as good as, or better than, those achieved through conventional training methods.2. To assess whether there is evidence from either the operating theatre, or from controlled (simulation centre-based) environments, that virtual reality-based surgical training leads to surgical skills that are comparable to, or better than, those achieved through conventional training.

SEARCH METHODS

The Cochrane Ear, Nose and Throat Disorders Group (CENTDG) Trials Search Co-ordinator searched the CENTDG Trials Register; Central Register of Controlled Trials (CENTRAL 2015, Issue 6); PubMed; EMBASE; ERIC; CINAHL; Web of Science; ClinicalTrials.gov; ICTRP and additional sources for published and unpublished trials. The date of the search was 27 July 2015.

SELECTION CRITERIA

We included all randomised controlled trials and controlled trials comparing virtual reality training and any other method of training in ear, nose or throat surgery.

DATA COLLECTION AND ANALYSIS

We used the standard methodological procedures expected by The Cochrane Collaboration. We evaluated both technical and non-technical aspects of skill competency.

MAIN RESULTS

We included nine studies involving 210 participants. Out of these, four studies (involving 61 residents) assessed technical skills in the operating theatre (primary outcomes). Five studies (comprising 149 residents and medical students) assessed technical skills in controlled environments (secondary outcomes). The majority of the trials were at high risk of bias. We assessed the GRADE quality of evidence for most outcomes across studies as 'low'. Operating theatre environment (primary outcomes) In the operating theatre, there were no studies that examined two of three primary outcomes: real world patient outcomes and acquisition of non-technical skills. The third primary outcome (technical skills in the operating theatre) was evaluated in two studies comparing virtual reality endoscopic sinus surgery training with conventional training. In one study, psychomotor skill (which relates to operative technique or the physical co-ordination associated with instrument handling) was assessed on a 10-point scale. A second study evaluated the procedural outcome of time-on-task. The virtual reality group performance was significantly better, with a better psychomotor score (mean difference (MD) 1.66, 95% CI 0.52 to 2.81; 10-point scale) and a shorter time taken to complete the operation (MD -5.50 minutes, 95% CI -9.97 to -1.03). Controlled training environments (secondary outcomes) In a controlled environment five studies evaluated the technical skills of surgical trainees (one study) and medical students (three studies). One study was excluded from the analysis. Surgical trainees: One study (80 participants) evaluated the technical performance of surgical trainees during temporal bone surgery, where the outcome was the quality of the final dissection. There was no difference in the end-product scores between virtual reality and cadaveric temporal bone training. Medical students: Two other studies (40 participants) evaluated technical skills achieved by medical students in the temporal bone laboratory. Learners' knowledge of the flow of the operative procedure (procedural score) was better after virtual reality than conventional training (SMD 1.11, 95% CI 0.44 to 1.79). There was also a significant difference in end-product score between the virtual reality and conventional training groups (SMD 2.60, 95% CI 1.71 to 3.49). One study (17 participants) revealed that medical students acquired anatomical knowledge (on a scale of 0 to 10) better during virtual reality than during conventional training (MD 4.3, 95% CI 2.05 to 6.55). No studies in a controlled training environment assessed non-technical skills.

AUTHORS' CONCLUSIONS

There is limited evidence to support the inclusion of virtual reality surgical simulation into surgical training programmes, on the basis that it can allow trainees to develop technical skills that are at least as good as those achieved through conventional training. Further investigations are required to determine whether virtual reality training is associated with better real world outcomes for patients and the development of non-technical skills. Virtual reality simulation may be considered as an additional learning tool for medical students.

Procedural surgical skill assessment in laparoscopic training environments

PURPOSE

This study aimed to identify detailed differences in laparoscopic surgical processes between expert and novice surgeons in a training environment and demonstrate that surgical process modeling can be used for such detailed analysis.

METHODS

Eleven expert surgeons each of whom had performed [Formula: see text] laparoscopic procedures were compared with 10 young surgeons each of whom had performed [Formula: see text] laparoscopic procedures, and five medical students. Each examinee performed a specific skill assessment task. During tasks, instrument motion was monitored using a video capture system. From the video, the corresponding workflow was recorded by labeling the surgeons' activities according to a predefined terminology. Activities represented manual work steps performed during the task, described by a combination of a verb (representing the action), a tool, and the involved structure. The results were described as the number of occurrences (times), average duration (seconds), total duration (seconds), minimal duration (seconds), maximal duration (seconds), and occupancy percentage (%).

RESULTS

The terminology for describing the processes of this task included 10 actions, six tools, four structures, and three events for each hand. There were 63 combinations of different possible activities; significant differences in 12 activities were observed between the expert and novice groups (young surgeons and medical students). The expert group performed the task with fewer occurrences and shorter duration than did the novice group in the left hand.

CONCLUSIONS

We identified differences in surgical process between experts and novices in laparoscopic surgical simulation. Our proposed method would be useful for education and training in laparoscopic surgery.

On orthopedic surgical skill prediction--the limited value of traditional testing

OBJECTIVES

Primary: to assess the utility of our distal radius fracture repair model as a tool for examining residents' surgical skills. Secondary: to compare the residents' ability to achieve specific biomechanically measured fracture stability with traditional test scores.

DESIGN

Our laboratory pioneered a model that measures biomechanical qualities of a repaired distal radius fracture. Before participation, all residents to be tested completed specified knowledge examinations. During the laboratory exercise, proctors observed each resident and completed Objective Structured Assessment of Technical Skills forms. At the completion of the laboratory, each specimen was tested biomechanically. Written examinations were completed in a proctored setting and computer examinations at home following the honor system. The laboratory exercise had adequate space and materials and allowed 60 minutes to complete the procedure. Residents had equal access to x-ray imaging.

SETTING

The examination environment of the study resembled an operating room.

PARTICIPANTS

Postgraduate years 3 and 4 orthopedic residents in our program were asked to participate. The institutional review board reviewed and approved the study as exempt.

RESULTS

Fracture repair constructs capable of resisting loads expected during rehabilitation were created by approximately half the residents tested. However, traditional written and computer-based testing methods failed to predict which resident's fracture construct would pass the biomechanical testing. Prior in vivo similar case experience was not predictive.

CONCLUSIONS

The idea that "book smart does not equal street smart" applies to the tested model. To measure surgical skill acquisition and increase public safety related to surgery, it will be necessary to employ new and specific examination methods that identify the skill to be acquired and test the acquisition of this skill as precisely as possible.

A pilot study to assess the construct and face validity of the Northwestern Objective Microanastomosis Assessment Tool

OBJECT

Microsurgical skills remain an integral component of neurosurgical education. There is a need for an objective scale to assess microsurgical skills. The objective of this study was to assess the face and construct validity of a bench training microanastomosis module and an objective assessment scale, i.e., the Northwestern Objective Microanastomosis Assessment Tool (NOMAT).

METHODS

Medical students, neurosurgical residents, and postdoctoral research fellows at Northwestern University were enrolled in the study. Trainees were divided into 3 groups based on microsurgical experience: 1) experienced, 2) exposed, and 3) novices. Each trainee completed two end-to-end microanastomoses using a 1-mm and a 3-mm synthetic vessel. Two cameras were installed to capture procedural footage. One neurosurgeon blindly graded the performance of trainees using both objective and subjective methods to assess construct validity. Two neurosurgeons reviewed the contents of the simulation module to assess face validity.

RESULTS

Twenty-one trainees participated in the study, including 6 experienced, 6 exposed, and 9 novices. The mean NOMAT score for experienced trainees on the 1-mm module was 47.3/70 compared with 26.0/70 and 25.8/70 for exposed and novice trainees, respectively (p = 0.02). Using subjective grading, experienced trainees performed significantly better on the 1-mm module (64.2/100) compared with exposed or novice trainees (23.3/100 and 25.0/100, respectively; p = 0.02). No statistical difference between groups was noted for the 3-mm module with both NOMAT and subjective grading. Experienced trainees took less time to perform both tasks compared with the others.

CONCLUSIONS

Face and construct validities of the microanastomosis module were established. The scale and the microanastomosis module could help assess the microsurgical skills of neurosurgical trainees and serve as a basis for the creation of a microsurgical curriculum.

The acquisition and retention of urinary catheterisation skills using surgical simulator devices: teaching method or student traits

BACKGROUND

The acquisition of procedural skills is an essential component of learning for medical trainees. The objective of this study was to assess which teaching method of performing urinary catheterisation is associated with most efficient procedural skill acquisition and retention. We evaluated factors affecting acquisition and retention of skills when using simulators as adjuncts to medical training.

METHODS

Forty-two second year medical students were taught urinary catheter insertion using different teaching methods. The interactive group (n = 19) were taught using a lecture format presentation and a high fidelity human urinary catheter simulator. They were provided with the use of simulators prior to examination. The observer group (n = 12) were taught using the same method but without with simulator use prior to examination. The didactic group (n = 11) were taught using the presentation alone. Student characteristics such as hand dexterity and IQ were measured to assess for intrinsic differences. All students were examined at four weeks to measure skill retention.

RESULTS

Catheter scores were significantly higher in the interactive group (p < 0.005). Confidence scores with catheter insertion were similar at index exam however were significantly lower in the didactic group at the retention testing (p < 0.05). Retention scores were higher in the interactive group (p < 0.001). A significant positive correlation was observed between laparoscopy scores and time to completion with overall catheter score (p < 0.05). Teaching method, spatial awareness and time to completion of laparoscopy were significantly associated with higher catheter scores at index exam (p = 0.001). Retention scores at 4 weeks were significantly associated with teaching method and original catheter score (p = 0.001).

CONCLUSION

The importance of simulators in teaching a complex procedural skill has been highlighted. Didactic teaching method was associated with a significantly higher rate of learning decay at retention testing.

Simulator-based assessment of haptic surgical skill: a comparative study

The aim of this study was to examine if the forces applied by users of a haptic simulator could be used to distinguish expert surgeons from novices. Seven surgeons with significant operating room expertise and 9 novices with no surgical experience participated in this study. The experimental task comprised exploring 4 virtual materials with the haptic device and learning the precise forces required to compress the materials to various depths. The virtual materials differed in their stiffness and force-displacement profiles. The results revealed that for nonlinear virtual materials, surgeons applied significantly greater magnitudes of force than novices. Furthermore, for the softer nonlinear and linear materials, surgeons were significantly more accurate in reproducing forces than novices. The results of this study suggest that the magnitudes of force measured using haptic simulators may be used to objectively differentiate experts' haptic skill from that of novices. This knowledge can inform the design of virtual reality surgical simulators and lead to the future incorporation of haptic skills training in medical school curricula.

Impact of a hands-on component on learning in the Fundamental Use of Surgical Energy™ (FUSE) curriculum: a randomized-controlled trial in surgical trainees

BACKGROUND

While energy devices are ubiquitous in the operating room, they remain poorly understood and can result in significant complications. The purpose of this study was to estimate the extent to which adding a novel bench-top component improves learning of SAGES' Fundamental Use of Surgical Energy™ (FUSE) electrosurgery curriculum among surgical trainees.

METHODS

Surgical residents participated in a 1-h didactic electrosurgery (ES) course, based on the FUSE curriculum. They were then randomized to one of two groups: an unstructured hands-on session where trainees used ES devices (control group) or a goal-directed hands-on training session (Sim group). Pre- and post-curriculum (immediate and at 3 months) assessments included knowledge of ES (multiple-choice examination), self-perceived competence for each of the 35 course objectives (questionnaire), and self-perceived comfort with performance of seven tasks related to safe use of ES. Data expressed as median[interquartile range], *p < 0.05.

RESULTS

56 (29 control; 27 Sim) surgical trainees completed the curriculum and assessments. Baseline characteristics, including pre-curriculum exam and questionnaire scores, were similar. Total score on the exam improved from 46%[40;54] to 84%[77;91]* for the entire cohort, with higher immediate post-curriculum scores in the Sim group compared to controls (89%[83;94] vs. 83%[71;86]*). At 3 months, performance on the exam declined in both groups, but remained higher in the Sim group (77%[69;90] vs 60%[51;80]*). Participants in both groups reported feeling greater comfort and competence post-curriculum (immediate and at 3 months) compared to baseline. This improvement was greater in the Sim group with a higher proportion feeling "Very Comfortable" or "Fully Competent" (Sim: 3/7 tasks and 28/35 objectives; control: 0/7 tasks and 10/35 objectives).

CONCLUSIONS

A FUSE-based curriculum improved surgical trainees' knowledge and comfort in the safe use of electrosurgical devices. The addition of a structured interactive bench-top simulation component further improved learning and retention at 3 months.

Evidence-based microsurgical skill-acquisition series part 1: validated microsurgical models--a systematic review

OBJECTIVES

The purpose of this study is to (1) systematically review all the literature pertaining to microsurgical training models and to (2) determine which of these are specific to and validated for microsurgery training.

DESIGN

PubMed, MEDLINE (OVID/EBSCO), Google Scholar, and Cochrane Central Register of Controlled Trials were searched using preset terms. The last search date was in July 2012. Articles of all languages, years of publication, sample sizes, and model types pertaining to microsurgery were included. The eligibility criteria included the use of a microsurgical training model on a subject group with statistical analysis and measures of validation. Two assessors independently reviewed the articles and their references.

RESULTS

Of the 238 articles reviewed, 9 articles met the criteria. Those excluded were predominantly model descriptions that had not been validated in a set of learners. The 9 models whose performances were assessed in a group of learners included an online curriculum, nonliving prosthetics and biologics, and the live rat femoral artery model. Each model was evaluated for content, construct, face, and criterion (concurrent and predictive) validity, as well as selection and observation/expectant bias. Content, construct, concurrent, and face validities were consistently demonstrated for all 9 models. Selection bias was also reliably well controlled with random allocation of participants to each study group. Observation/expectant bias was controlled in 6 of the 8 papers. Predictive validity, an arguably more difficult factor to measure, was only present in 1 article.

CONCLUSIONS

Despite a plethora of papers describing microsurgical learning tools, only 9 were discovered that provided validation of the proposed method of microsurgical skills acquisition. This review depicts the need for basic, yet well-designed studies that substantiate the effectiveness of microsurgical training models by using a subject group and demonstrating a statistical improvement with employment of the model. Ease of access, cost, and assessment tools used also require attention.

A review of the available urology skills training curricula and their validation

BACKGROUND

The transforming field of urological surgery continues to demand development of novel training devices and curricula for its trainees. Contemporary trainees have to balance workplace demands while overcoming the cognitive barriers of acquiring skills in rapidly multiplying and advancing surgical techniques. This article provides a brief review of the process involved in developing a surgical curriculum and the current status of real and simulation-based curricula in the 4 subgroups of urological surgical practice: open, laparoscopic, endoscopic, and robotic.

METHODS

An informal literature review was conducted to provide a snapshot into the variety of simulation training tools available for technical and nontechnical urological surgical skills within all subgroups of urological surgery using the following keywords: "urology, surgery, training, curriculum, validation, non-technical skills, technical skills, LESS, robotic, laparoscopy, animal models." Validated training tools explored in research were tabulated and summarized.

RESULTS AND CONCLUSIONS

A total of 20 studies exploring validated training tools were identified. Huge variation was noticed in the types of validity sought by researchers and suboptimal incorporation of these tools into curricula was noted across the subgroups of urological surgery. The following key recommendations emerge from the review: adoption of simulation-based curricula in training; better integration of dedicated training time in simulated environments within a trainee's working hours; better incentivization for educators and assessors to improvise, research, and deliver teaching using the technologies available; and continued emphasis on developing nontechnical skills in tandem with technical operative skills.

The development of a virtual simulator for training neurosurgeons to perform and perfect endoscopic endonasal transsphenoidal surgery

BACKGROUND

A virtual reality (VR) neurosurgical simulator with haptic feedback may provide the best model for training and perfecting surgical techniques for transsphenoidal approaches to the sella turcica and cranial base. Currently there are 2 commercially available simulators: NeuroTouch (Cranio and Endo) developed by the National Research Council of Canada in collaboration with surgeons at teaching hospitals in Canada, and the Immersive Touch. Work in progress on other simulators at additional institutions is currently unpublished.

OBJECTIVE

This article describes a newly developed application of the NeuroTouch simulator that facilitates the performance and assessment of technical skills for endoscopic endonasal transsphenoidal surgical procedures as well as plans for collecting metrics during its early use.

METHODS

The main components of the NeuroTouch-Endo VR neurosurgical simulator are a stereovision system, bimanual haptic tool manipulators, and high-end computers. The software engine continues to evolve, allowing additional surgical tasks to be performed in the VR environment. Device utility for efficient practice and performance metrics continue to be developed by its originators in collaboration with neurosurgeons at several teaching hospitals in the United States. Training tasks are being developed for teaching 1- and 2-nostril endonasal transsphenoidal approaches. Practice sessions benefit from anatomic labeling of normal structures along the surgical approach and inclusion (for avoidance) of critical structures, such as the internal carotid arteries and optic nerves.

CONCLUSION

The simulation software for NeuroTouch-Endo VR simulation of transsphenoidal surgery provides an opportunity for beta testing, validation, and evaluation of performance metrics for use in neurosurgical residency training.

ABBREVIATIONS

CTA, cognitive task analysisVR, virtual reality.

Ready for OR or not? Human reader supplements Eyesi scoring in cataract surgical skills assessment

Purpose

To compare the internal computer-based scoring with human-based video scoring of cataract modules in the Eyesi virtual reality intraocular surgical simulator, a comparative case series was conducted at the Department of Clinical Sciences – Ophthalmology, Lund University, Skåne University Hospital, Malmö, Sweden.

Methods

Seven cataract surgeons and 17 medical students performed one video-recorded trial with each of the capsulorhexis, hydromaneuvers, and phacoemulsification divide-and-conquer modules. For each module, the simulator calculated an overall score for the performance ranging from 0 to 100. Two experienced masked cataract surgeons analyzed each video using the Objective Structured Assessment of Cataract Surgical Skill (OSACSS) for individual models and modified Objective Structured Assessment of Surgical Skills (OSATS) for all three modules together. The average of the two assessors’ scores for each tool was used as the video-based performance score. The ability to discriminate surgeons from naïve individuals using the simulator score and the video score, respectively, was compared using receiver operating characteristic (ROC) curves.

Results

The ROC areas for simulator score did not differ from 0.5 (random) for hydromaneuvers and phacoemulsification modules, yielding unacceptably poor discrimination. OSACSS video scores all showed good ROC areas significantly different from 0.5. The OSACSS video score was also superior compared to the simulator score for the phacoemulsification procedure: ROC area 0.945 vs 0.664 for simulator score (P = 0.010). Corresponding values for capsulorhexis were 0.887 vs 0.761 (P = 0.056) and for hydromaneuvers 0.817 vs 0.571 (P = 0.052) for the video scores and simulator scores, respectively. The ROC area for the combined procedure was 0.938 for OSATS video score and 0.799 for simulator score (P=0.072).

Conclusion

Video-based scoring of the phacoemulsification procedure was superior to the innate simulator scoring system in distinguishing cataract surgical skills. Simulator scoring rendered unacceptably poor discrimination for both the hydromaneuvers and the phacoemulsification divide-and-conquer module. Our results indicate a potential for improvement in Eyesi internal computer-based scoring.

The Development of a Virtual Simulator for Training Neurosurgeons to Perform and Perfect Endoscopic Endonasal Transsphenoidal Surgery

BACKGROUND:

A virtual reality (VR) neurosurgical simulator with haptic feedback may provide the best model for training and perfecting surgical techniques for transsphenoidal approaches to the sella turcica and cranial base. Currently there are 2 commercially available simulators: NeuroTouch (Cranio and Endo) developed by the National Research Council of Canada in collaboration with surgeons at teaching hospitals in Canada, and the Immersive Touch. Work in progress on other simulators at additional institutions is currently unpublished.

OBJECTIVE:

This article describes a newly developed application of the NeuroTouch simulator that facilitates the performance and assessment of technical skills for endoscopic endonasal transsphenoidal surgical procedures as well as plans for collecting metrics during its early use.

METHODS:

The main components of the NeuroTouch-Endo VR neurosurgical simulator are a stereovision system, bimanual haptic tool manipulators, and high-end computers. The software engine continues to evolve, allowing additional surgical tasks to be performed in the VR environment. Device utility for efficient practice and performance metrics continue to be developed by its originators in collaboration with neurosurgeons at several teaching hospitals in the United States. Training tasks are being developed for teaching 1- and 2-nostril endonasal transsphenoidal approaches. Practice sessions benefit from anatomic labeling of normal structures along the surgical approach and inclusion (for avoidance) of critical structures, such as the internal carotid arteries and optic nerves.

CONCLUSION:

The simulation software for NeuroTouch-Endo VR simulation of transsphenoidal surgery provides an opportunity for beta testing, validation, and evaluation of performance metrics for use in neurosurgical residency training.

Training haptic stiffness discrimination: time course of learning with or without visual information and knowledge of results

OBJECTIVE

In this study, we explored the time course of haptic stiffness discrimination learning and how it was affected by two experimental factors, the addition of visual information and/or knowledge of results (KR) during training.

BACKGROUND

Stiffness perception may integrate both haptic and visual modalities. However, in many tasks, the visual field is typically occluded, forcing stiffness perception to be dependent exclusively on haptic information. No studies to date addressed the time course of haptic stiffness perceptual learning.

METHOD

Using a virtual environment (VE) haptic interface and a two-alternative forced-choice discrimination task, the haptic stiffness discrimination ability of 48 participants was tested across 2 days. Each day included two haptic test blocks separated by a training block Additional visual information and/or KR were manipulated between participants during training blocks.

RESULTS

Practice repetitions alone induced significant improvement in haptic stiffness discrimination. Between days, accuracy was slightly improved, but decision time performance was deteriorated. The addition of visual information and/or KR had only temporary effects on decision time, without affecting the time course of haptic discrimination learning.

CONCLUSION

Learning in haptic stiffness discrimination appears to evolve through at least two distinctive phases: A single training session resulted in both immediate and latent learning. This learning was not affected by the training manipulations inspected.

APPLICATION

Training skills in VE in spaced sessions can be beneficial for tasks in which haptic perception is critical, such as surgery procedures, when the visual field is occluded. However, training protocols for such tasks should account for low impact of multisensory information and KR.

A systematic review of evidence for education and training interventions in microsurgery

Over the past decade, driven by advances in educational theory and pressures for efficiency in the clinical environment, there has been a shift in surgical education and training towards enhanced simulation training. Microsurgery is a technical skill with a steep competency learning curve on which the clinical outcome greatly depends. This paper investigates the evidence for educational and training interventions of traditional microsurgical skills courses in order to establish the best evidence practice in education and training and curriculum design. A systematic review of MEDLINE, EMBASE, and PubMed databases was performed to identify randomized control trials looking at educational and training interventions that objectively improved microsurgical skill acquisition, and these were critically appraised using the BestBETs group methodology. The databases search yielded 1,148, 1,460, and 2,277 citations respectively. These were then further limited to randomized controlled trials from which abstract reviews reduced the number to 5 relevant randomised controlled clinical trials. The best evidence supported a laboratory based low fidelity model microsurgical skills curriculum. There was strong evidence that technical skills acquired on low fidelity models transfers to improved performance on higher fidelity human cadaver models and that self directed practice leads to improved technical performance. Although there is significant paucity in the literature to support current microsurgical education and training practices, simulated training on low fidelity models in microsurgery is an effective intervention that leads to acquisition of transferable skills and improved technical performance. Further research to identify educational interventions associated with accelerated skill acquisition is required.

Do we need animal hands-on courses for transplantation surgery?

BACKGROUND

Transplantation surgery requires many years of training. This study evaluates and presents the results of our recent four-yr animal hands-on courses of transplantation surgery on participants' training.

METHODS

Since 2008, five two-d hands-on courses of transplantation surgery were performed on swine models at our department. Sixty-one participants were asked to answer three questionnaires (pre-course, immediate post-course, subsequent post-course). The questions pertained to their past education, expectations, and evaluation of our courses, as well as our course's effectiveness in advancing their surgical abilities. The results were analyzed, compared and are presented herein.

RESULTS

On average, 1.8 multiorgan procurements, 2.3 kidney, 1.5 liver, and 0.7 pancreas transplantations were performed by each participant. 41.7% of participants considered their previous practical training only satisfactory; 85% hoped for more opportunities to practice surgery; 73.3% evaluated our courses as very good; and 95.8% believed that our courses had fulfilled their expectations. 66% found the effectiveness of our course in advancing their surgical abilities very good; 30% good, and 4% satisfactory.

CONCLUSION

Animal hands-on courses of transplantation surgery are one of the best options to learn and practice different operations and techniques in a near to clinical simulated model. Regular participation in such courses with a focus on practical issues can provide optimal opportunities for trainees with the advantage of direct mentoring and feedback.

A theoretical framework for simulation in nursing: answering Schiavenato's call

The aim of this article was to provide a response that supports and extends Schiavenato's call for a theoretically guided approach to simulation use in nursing education.We propose that a theoretical framework for simulation In nursing must first include, as a basis, a theoretical understanding of human performance and how it is enhanced.This understanding will, in turn, allow theorists to provide a framework regarding the utility, application, and design of the training environment, including internal and external validity. The expert performance approach, a technique that recently has been termed Expert-Performance-based Training (ExPerT), is introduced as a guiding frame work for addressing these training needs. We also describe how the theory of deliberate practice within the framework of ExPerT can be useful for developing effective training methods in health care domains and highlight examples of how deliberate practice has been successfully applied to the training of psychomotor and cognitive skills.

How to build your own coronary anastomosis simulator from scratch

OBJECTIVES

Gaining cardiac surgical competence is a complex, multifactorial process that may take years of experience and on-the-job training. It is critical to provide suitable educational opportunities to gain the necessary knowledge, judgment and skills. In response to the multitude of factors (e.g. European Working Time Directive) currently influencing cardiac surgical training, there have been concerted efforts to reform training practices. Simulation plays an increasingly important role in the educational process and serves to fill the most important gap in the current training model, i.e. operative exposure. Therefore, a contest has been written out for cardiac surgical trainees to construct their own coronary anastomosis simulator using everyday materials.

METHODS

Cardiac surgical trainees were invited to construct their own coronary anastomosis simulator. An international jury of cardiac surgeons assessed the simulator and its presentation according to preset developmental criteria (low fidelity concept, innovative character, general presentation and description, general attractiveness to the scholar, ergonomical issues, perceived haptics, number of applicable components, transportability, ease of construction, repeatability and overall costs of the simulator).

RESULTS

Six prototypes of simulators built by cardiac surgical trainees were generated. A general evaluation of each simulator prototype is provided according to the preset developmental criteria.

CONCLUSIONS

All simulator prototypes have provided a considerable contribution to the field of surgical simulation. By designing simulator prototypes, the trainees have demonstrated their 'out of the box' thinking capability, which is of paramount importance for the development of future innovative surgical techniques and procedures. The Valladolid cardiac team coronary anastomosis simulator box was selected for the EACTS Ethicon Simulation Award 2011. This project will be mass produced and distributed to the participants of structured simulation sessions for coronary anastomoses.

Objective structured assessment of debriefing: bringing science to the art of debriefing in surgery

OBJECTIVE

: To identify the features of effective debriefing and to use this to develop and validate a tool for assessing such debriefings.

INTRODUCTION

: Simulation-based training has become an accepted means of surgical skill acquisition. A key component of this is debriefing-yet there is a paucity of research to guide best practice.

METHODS

: Phase 1-Identification of best practice and tool development. A search of the Medline, Embase, PsycINFO, and ERIC databases identified current evidence on debriefing. End-user input was obtained through 33 semistructured interviews conducted with surgeons (n = 18) and other operating room personnel (n = 15) from 3 continents (UK, USA, Australia) using standardized qualitative methodology. An expert panel (n = 7) combined the data to create the Objective Structured Assessment of Debriefing (OSAD) tool. Phase 2-Psychometric testing. OSAD was tested for feasibility, reliability, and validity by 2 independent assessors who rated 20 debriefings following high-fidelity simulations.

RESULTS

: Phase 1: 28 reports on debriefing were retrieved from the literature. Key components of an effective debriefing identified from these reports and the 33 interviews included: approach to debriefing, learning environment, learner engagement, reaction, reflection, analysis, diagnosis of strengths and areas for improvement, and application to clinical practice. Phase 2: OSAD was feasible, reliable [inter-rater ICC (intraclass correlation coefficient) = 0.88, test-retest ICC = 0.90], and face and content valid (content validity index = 0.94).

CONCLUSIONS

: OSAD provides an evidence-based, end-user informed approach to debriefing in surgery. By quantifying the quality of a debriefing, OSAD has the potential to identify areas for improving practice and to optimize learning during simulation-based training.

Needs analysis for developing a virtual-reality NOTES simulator

INTRODUCTION AND STUDY AIM: Natural orifice translumenal endoscopic surgery (NOTES) is an emerging surgical technique that requires a cautious adoption approach to ensure patient safety. High-fidelity virtual-reality-based simulators allow development of new surgical procedures and tools and train medical personnel without risk to human patients. As part of a project funded by the National Institutes of Health, we are developing the virtual transluminal endoscopic surgery trainer (VTEST) for this purpose. The objective of this study is to conduct a structured needs analysis to identify the design parameters for such a virtual-reality-based simulator for NOTES.

METHODS

A 30-point questionnaire was distributed at the 2011 National Orifice Surgery Consortium for Assessment and Research meeting to obtain responses from experts. Ordinal logistic regression and the Wilcoxon rank-sum test were used for analysis.

RESULTS

A total of 22 NOTES experts participated in the study. Cholecystectomy (CE, 68 %) followed by appendectomy (AE, 63 %) (CE vs AE, p = 0.0521) was selected as the first choice for simulation. Flexible (FL, 47 %) and hybrid (HY, 47 %) approaches were equally favorable compared with rigid (RI, 6 %) with p < 0.001 for both FL versus RI and HY versus RI. The transvaginal approach was preferred 3 to 1 to the transgastric. Most participants preferred two-channel (2C) scopes (65 %) compared with single (1C) or three (3C) or more channels with p < 0.001 for both 2C versus 1C and 2C versus 3C. The importance of force feedback and the utility of a virtual NOTES simulator in training and testing new tools for NOTES were rated very high by the participants.

CONCLUSION

Our study reinforces the importance of developing a virtual NOTES simulator and clearly presents expert preferences. The results of this analysis will direct our initial development of the VTEST platform.

Does a mixed training course on the Oxford unicompartmental knee arthroplasty improve non-technical skills of orthopaedic surgeons?

PURPOSE

To determine whether a mixed course on the Oxford unicompartmental knee arthroplasty (UKA) could improve the non-technical (cognitive) skills of performing UKA.

METHODS

120 delegates consisting of consultant orthopaedic surgeons and advanced surgical trainees attended a 2-day course. 104 (87%) of the delegates had performed total knee arthroplasties, whereas 79 (66%) had performed UKAs. The course consisted of didactic lectures, interactive surgical demonstrations, and practical dry-bone skills workshops. Cognitive skills were assessed at the start (day 1) and end (day 2) of the course using 10 multiple-choice questions. The maximum test score was 10. Multilevel modelling was used to compare the pre- and post-course test scores. The pairings of pre- and post-course scores were not known because of a confidentiality clause.

RESULTS

Of the 120 delegates, 71 (59%) took the pre-course test and 120 (100%) took the post-course test. The median score improved significantly from 2 (interquartile range [IQR], 0.5-3.5) to 6 (IQR, 4.5- 7.5) [bootstrap p<0.0001] for every single one of the randomly allocated pairings. Most delegates had poor cognitive skills for the UKA before the course and improved significantly after the course. Sub-analysis of each question topic showed significant improvement in scores for all topics after the course (bootstrap p<0.0001). Nonetheless, the extent to which individual topic scores improved varied widely. The odds ratio for the pre- versus post-course total test score was 4.36.

CONCLUSION

A mixed continuing medical education course could enhance the non-technical (cognitive) skills for UKA.

Virtual Reality Simulator

Background. The overriding importance of patient safety, the complexity of surgical techniques, and the challenges associated with teaching surgical trainees in the operating room are all factors driving the need for innovative surgical simulation technologies. Technical development. Despite these issues, widespread use of virtual reality simulation technology in surgery has not been fully implemented, largely because of the technical complexities in developing clinically relevant and useful models. This article describes the successful use of the NeuroTouch neurosurgical simulator in the resection of a left frontal meningioma. Conclusion. The widespread application of surgical simulation technology has the potential to decrease surgical risk, improve operating room efficiency, and fundamentally change surgical training.