Technical skills assessment in a coronary angiography simulator for construct validation

Teaching Strategies in Interventional Radiology: A Narrative Review of the Literature

INTRODUCTION

Interventional radiology (IR) is a rapidly developing speciality where innovation-especially in teaching practices-is vital. With workforce and capacity shortages, synthesis of classical educational theories and novel strategies utilising virtual reality (VR) and artificial intelligence (AI) provide opportunities to make teaching as efficient and effective as possible. The aim of this review is to examine the literature on different approaches in IR teaching and learning in undergraduates and postgraduates.

METHODS

Literature was reviewed using a comprehensive search strategy with relevant keywords. Articles were limited to 2013-2023. Databases searched included MEDLINE, Embase, British Education Index and ERIC, in addition to a manual review of references.

RESULTS

Of the 2903 unique abstracts reviewed by the authors, 43 were relevant to the purpose of this study. The major pedagogical approaches identified were categorised into the following-traditional master-apprentice mentoring, virtual reality/simulation, physical models, and remote teaching. VR simulations enable practise free from the limits of time and risk to patients, as well as potential for standardised formal curricula. AI has the capability to enhance training simulations and assessment of trainees. With recent events necessitating innovation in online remote teaching, programs that are accessible whilst arguably imparting just as much clinical knowledge as in-person education have now been developed.

CONCLUSION

Mentoring has conventionally been the standard for radiology teaching, however there are now several alternative pedagogical approaches available to the IR community. A combination of the most effective ideas within each is the optimal method by which IR should be taught.

Post-procedure micro-CT analyses of coronary artery stenting in left main vessels of reanimated and perfusion-fixed human hearts

BACKGROUND

Percutaneous coronary interventions (PCIs) within left main coronary arteries are high-risk procedures that require optimization of interactions between stent(s) and diseased vessels. Optical Coherence Tomography (OCT) is a widely accepted tool that enhances physicians' ability to assess proper stent appositions during clinical procedures. The primary aim of this study was to develop complementary post-procedure imaging methodologies to better assess and interpret outcomes of left main PCI procedures, utilizing both reanimated and perfusion-fixed human hearts.

METHODS

PCIs were performed while obtaining OCT scans within the left main anatomies of six human hearts. Subsequently, each heart was scanned with a micro-CT scanner with optimized parameters to achieve resolutions up to 20 µm. Scans were reconstructed and imported into a DICOM segmentation software to generate computational models of implanted stents and associated coronary vessels. 2D images from OCT that were obtained during PCIs were compared to the 3D models generated from micro-CT reconstructions. In addition, the 3D models were utilized to create virtual reality scenes and enlarged 3D prints for development of "mixed reality" tools relative to bifurcation stenting within human left main coronary arteries.

RESULTS

We developed reproducible methodologies for post-implant analyses of coronary artery stenting procedures. In addition, we generated high-resolution 3D computational models, with ~ 20-micron resolutions, of PCIs performed within reanimated and perfusion-fixed heart specimens.

CONCLUSIONS

Generated computational models of left main PCIs performed in isolated human hearts can be used to obtain detailed measurements that provide further clinical insights on procedural outcomes. The 3D models from these procedures are useful for generating virtual reality scenes and 3D prints for physician training and education.

Can virtual-reality simulation ensure transthoracic echocardiography skills before trainees examine patients?

OBJECTIVES

This study aimed to develop and gather the validity evidence for a standardised simulation-based skills test in transthoracic echocardiography and to establish a credible pass/fail score.

METHODS

Experts developed a virtual-reality simulator test in cardiology, medical education and simulation-based education. Thirty-six physicians with different experiences in transthoracic echocardiography completed the test at Odense University Hospital, Denmark. The performances of novice, intermediate and experienced participants were compared using the Bonferroni post hoc test. Cronbach's alpha was used to determine the internal consistency reliability of the test. The consistency of performance was analysed using the intraclass correlation coefficient. A pass/fail score was established using the contrasting groups' standard-setting method.

RESULTS

We developed a test with high consistent reliability (Alpha = .81), 95% CI [.69, .89]. In both cases, the performers' level was consistent, fitting others at the same level of experience (intraclass correlation r₍₃₅₎=.81, p<.001). A pass/fail score of 48/50 points was established based on the mean test score of novice and experienced physicians.

CONCLUSIONS

We developed a standardised virtual-reality simulation-based test of echocardiography skills with the ability to distinguish between participants with different levels of transthoracic echocardiography experience. This test could direct a mastery learning training program where trainees practise until they reach the pre-defined level and secure a higher level of competency to ensure quality and safety for patients.

Treatment of coronary bifurcation lesions, part II: implanting two stents. The 16th expert consensus document of the European Bifurcation Club

The European Bifurcation Club (EBC) supports a continuous review of the field of coronary artery bifurcation interventions and aims to facilitate a scientific discussion and an exchange of ideas on the management of bifurcation disease. The recent focus of meetings and consensus statements has been on the technical issues in bifurcation stenting, recognising that the final result of a bifurcation procedure and the long-term outcome for our patients are strongly influenced by factors, including preprocedural strategy, stenting technique selection, performance of optimal procedural steps, the ability to identify and correct complications and finally, and most important, the overall performance of the operator. Continuous refinement of bifurcation stenting techniques and the promotion of education and training in bifurcation stenting techniques represent a major clinical need. Accordingly, the consensus from the latest EBC meeting in Brussels, October 2021, was to promote education and training in bifurcation stenting based on the EBC principle. Part II of this 16th EBC consensus document aims to provide a step-by-step overview of the pitfalls and technical troubleshooting during the implantation of the second stent either in the provisional stenting (PS) strategy or in upfront 2-stent techniques (e.g., 2-stent PS pathway and double kissing crush stenting). Finally, a detailed overview and discussion of the numerous modalities available to provide continuous education and technical training in bifurcation stenting techniques are discussed, with consideration of their future application in enhancing training and practice in coronary bifurcation lesion treatment.

Impact of Simulation-Based Training on Radiation Exposure of Young Interventional Cardiologists

Reducing radiation exposure during cardiovascular catheterization is of paramount importance to ensure patient and staff safety. Our study aimed to assess the transferability of acquired skills from virtual reality to the real world, including radioprotection measures during mentored simulation training (ST) in coronary angiography. A total of 10 cardiology residents were evaluated during real-life cases in the catheterization laboratory before (group A) and after mentored ST. The educational effect of mentored simulator training on real-life case performance was evaluated at 2 different time points: within the first week (group B) and after 12 weeks (group C). Compared with group A, the total dose area product (DAP) (µGy•m²) and total air kerma (mGy) were lower after ST: group A: 2,633 (1,723 to 3,617) versus group B: 1,618 (1,032 to 2,562), p <0.05 and 214 (136 to 297) versus 135 (84 to 222), p <0.05, respectively. Concerning operator radiation exposure (µSv), left finger dose: 1,090 (820 to 1,460) versus 635 (300 to 900), p = 0.028; left leg dose 80 (0 to 110) versus 0 (0 to 0), p = 0.027; left eye lens dose: 39 (24 to 69) versus 11 (8 to 20), p <0.0001; and chest dose outside the lead apron: 50 (34 to 88) versus 29 (21 to 50), p <0.003 were significantly lower in the group B than group A. A total of 12 weeks after ST, the total DAP and total air kerma remained stable along with operator exposure except left eye lens dose (µSv): group B: 11 (8 to 20) versus group C: 16 (12 to 27), p = 0.02. In addition, left eye lens dose, left wrist dose, and chest dose outside the lead apron were significantly correlated with total DAP (rs = 0.635, rs = 0.729, and rs = 0, 629, respectively) and total air kerma (rs = 0.488, rs = 0.514, and rs = 0.548, respectively) at 12 weeks. In conclusion, ST for coronary angiography may improve radioprotection learning and should be incorporated into training curricula.

Use of Endovascular Simulator in Training of Neurosurgery Residents - A Review and Single Institution Experience

Simulators for surgical procedures and interventions have undergone significant technological advancement in the past decade and are becoming more commonplace in medical training. Neurosurgery residents across multiple training levels underwent performance evaluation using a neuro-interventional simulator, employing a variety of metrics for assessment. We identified seven core metrics used in the evaluation of neurosurgery residents performing simulated mechanical thrombectomies. Additionally, a systematic PubMed search for studies related to Neurointerventional Radiology training via simulation was performed. The purpose of this study is to examine the validity and benefits of training with these simulation devices and compare our institution's experience. Additionally, an exploration of their applicability to neurosurgery resident training is discussed.

Simulation Training in Neuroangiography: Transfer to Reality

PURPOSE

Endovascular simulation is an established and validated training method, but there is still no proof of direct patient's benefit, defined as lower complication rate. In this study, the impact of such a training was investigated for rehearsal of patient-specific cases as well as for a structured simulation curriculum to teach angiographer novices.

MATERIALS AND METHODS

A total of 40 patients undergoing a diagnostic neuroangiography were randomized in a training and control group. In all training group patients, the angiographer received a patient-anatomy-specific rehearsal on a high-fidelity simulator prior to the real angiography. Radiation exposure, total duration, fluoroscopy time and amount of contrast agent of the real angiography were recorded. Silent cerebral ischemia was counted by magnetic resonance diffusion-weighted imaging (DWI). Additionally, the first 30 diagnostic neuroangiographies of six novices were compared (n_total = 180). Three novices had undergone a structured simulation curriculum; three had acquired angiographic skills without simulation.

RESULTS

No differences were found in the number of DWI lesions or in other quality measures of the angiographies performed with and without patient-specific rehearsal. A structured simulation curriculum for angiographer novices reduced fluoroscopy time significantly and radiation exposure. The curriculum had no influence on the total duration of the examination, the amount of contrast medium or the number of catheters used.

CONCLUSION

There was no measurable benefit of patient-anatomy-specific rehearsal for an unselected patient cohort. A structured simulation-based curriculum to teach angiographic skills resulted in a reduction of fluoroscopy time and radiation dose in the first real angiographies of novice angiographers.

LEVEL OF EVIDENCE

Level 4, part 1: randomized trial, part 2: historically controlled study.

Simulation Training in Neuroangiography-Validation and Effectiveness

Purpose

Simulators are increasingly used in the training of endovascular procedures; however, for the use of the Mentice vascular interventional system trainer (VIST) simulator in neuroradiology, the validity of the method has not yet been proven. The study was carried out to test the construct validity of such a simulator by demonstrating differences between beginner and expert neurointerventionalists and to evaluate whether a training effect can be demonstrated in repeated cases for different levels of experience.

Methods

In this study 4 experts and 6 beginners performed 10 diagnostic angiographies on the VIST simulator (Mentice AB, Gothenburg, Sweden). Of the cases four were non-recurring, whereas three were repeated once and ten subjects performed all tasks. Additionally, another expert performed only five non-recurring cases. The simulator recorded total time, fluoroscopy time, amount of contrast medium and number of material changes. Furthermore, gaze direction and heart rate were recorded, and subjects completed a questionnaire on workload.

Results

Beginners and experts showed significant differences in total duration time, fluoroscopy time and amount of contrast agent (all p < 0.05). Gaze direction, dwell time and heart rate were similar between both groups. Only beginners improved during training with respect to total duration time, fluoroscopy time and amount of contrast agent. If a case was previously known to them, the total duration and fluoroscopy time were significantly shortened (p < 0.001).

Conclusion

This study demonstrated both the construct validity of a diagnostic neuroangiography simulator as well as a significant training effect for beginners. Therefore, in particular beginner neurointerventionalists should use such simulation tools more extensively in their initial training.

The Simulation Training in Coronary Angiography and Its Impact on Real Life Conduct in the Catheterization Laboratory

Our study aimed to evaluate the effectiveness of mentored simulation training (ST) in coronary angiography and to assess the transferability of acquired skills from virtual reality to the real world. Twenty cardiology residents were randomized to ST or control before performing real-life cases in the catheterization laboratory. The control group underwent secondary ST and reperformed real-life cases in the catheterization laboratory. Skill metrics were compared between the ST and the control group, and within the control group between before and after ST. In real-life cases, the procedure time was shorter (p = 0.002), the radiation dose lower (p = 0.001), and the global procedure skill score was higher (p = 0.0001) in the ST group as compared with the control (before ST) group. During virtual ST procedural time (p <0.001), fluoroscopic time (p <0.001), training contrast amount (p <0.001), and global training score (p <0.001) significantly decreased. In the control group, all monitoring procedure parameters were significantly improved after ST, as well as, the global procedure flow score (p <0.0001). In conclusion, simulator-based training in coronary angiography improved operator skills compared with traditional in catheterization laboratory mentor-based training. ST should be incorporated in the curriculum of the interventionalist to improve learning in coronary angiography.

Validation of NOViSE

The goal of this study was to establish face, content, and construct validity of NOViSE—the first force-feedback enabled virtual reality (VR) simulator for natural orifice transluminal endoscopic surgery (NOTES). Fourteen surgeons and surgical trainees performed 3 simulated hybrid transgastric cholecystectomies using a flexible endoscope on NOViSE. Four of them were classified as “NOTES experts” who had independently performed 10 or more simulated or human NOTES procedures. Seven participants were classified as “Novices” and 3 as “Gastroenterologists” with no or minimal NOTES experience. A standardized 5-point Likert-type scale questionnaire was administered to assess the face and content validity. NOViSE showed good overall face and content validity. In 14 out of 15 statements pertaining to face validity (graphical appearance, endoscope and tissue behavior, overall realism), ≥50% of responses were “agree” or “strongly agree.” In terms of content validity, 85.7% of participants agreed or strongly agreed that NOViSE is a useful training tool for NOTES and 71.4% that they would recommend it to others. Construct validity was established by comparing a number of performance metrics such as task completion times, path lengths, applied forces, and so on. NOViSE demonstrated early signs of construct validity. Experts were faster and used a shorter endoscopic path length than novices in all but one task. The results indicate that NOViSE authentically recreates a transgastric hybrid cholecystectomy and sets promising foundations for the further development of a VR training curriculum for NOTES without compromising patient safety or requiring expensive animal facilities.

The McGill simulator for endoscopic sinus surgery (MSESS): a validation study

Background

Endoscopic sinus surgery (ESS) is a technically challenging procedure, associated with a significant risk of complications. Virtual reality simulation has demonstrated benefit in many disciplines as an important educational tool for surgical training. Within the field of rhinology, there is a lack of ESS simulators with appropriate validity evidence supporting their integration into residency education. The objectives of this study are to evaluate the acceptability, perceived realism and benefit of the McGill Simulator for Endoscopic Sinus Surgery (MSESS) among medical students, otolaryngology residents and faculty, and to present evidence supporting its ability to differentiate users based on their level of training through the performance metrics.

Methods

10 medical students, 10 junior residents, 10 senior residents and 3 expert sinus surgeons performed anterior ethmoidectomies, posterior ethmoidectomies and wide sphenoidotomies on the MSESS. Performance metrics related to quality (e.g. percentage of tissue removed), efficiency (e.g. time, path length, bimanual dexterity, etc.) and safety (e.g. contact with no-go zones, maximum applied force, etc.) were calculated. All users completed a post-simulation questionnaire related to realism, usefulness and perceived benefits of training on the MSESS.

Results

The MSESS was found to be realistic and useful for training surgical skills with scores of 7.97 ± 0.29 and 8.57 ± 0.69, respectively on a 10-point rating scale. Most students and residents (29/30) believed that it should be incorporated into their curriculum. There were significant differences between novice surgeons (10 medical students and 10 junior residents) and senior surgeons (10 senior residents and 3 sinus surgeons) in performance metrics related to quality (p < 0.05), efficiency (p < 0.01) and safety (p < 0.05).

Conclusion

The MSESS demonstrated initial evidence supporting its use for residency education. This simulator may be a potential resource to help fill the void in endoscopic sinus surgery training.