1
|
Devlin‐Hegedus J, Miller M, Cooke S, Ware S, Richmond C. Measured task load in directed observers versus active participants undergoing high-fidelity simulation education in a critical care setting. AEM EDUCATION AND TRAINING 2023; 7:e10894. [PMID: 37448628 PMCID: PMC10336023 DOI: 10.1002/aet2.10894] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 06/12/2023] [Accepted: 06/20/2023] [Indexed: 07/15/2023]
Abstract
Objectives The use of directed observers in high-fidelity simulation education is increasingly common. While evidence suggests similar educational outcomes for directed observers compared to active participants in technical skills, it remains uncertain if this benefit also exists for senior clinicians, especially in mental workload. We sought to compare the workload between active participants and directed observers using an objective measure. Methods We performed a prospective, repeated-measures observational study during the New South Wales Ambulance Aeromedical Operations induction training from 2019 to 2020. Participants included senior critical care doctors, paramedics, and nurses undergoing high-fidelity simulation of prehospital and interhospital aeromedical missions. Task load was measured using the National Aeronautics and Space Administration task load index (NASA-TLX) administered following each simulation debrief. Prehospital and interhospital simulations were compared separately by building a multilevel model for complete case and all study data. Post hoc comparisons of NASA-TLX score for each group were performed using estimated marginal means (EMMs). Results We enrolled 70 participants, comprising 49 physicians (70%), 19 paramedics (27%), and two flight nurses (3%). From the complete case analysis, statistically significant differences were observed for total NASA-TLX scores between active participants and directed observers in both prehospital (participant EMM 78, observer EMM 65, estimated difference -13, 95% confidence interval [CI] -20 to -7) and interhospital simulations (participant EMM 69, observer EMM 59, estimated difference -10, 95% CI -16 to -3). When all available data were included, the pattern of results did not change. Conclusions In our sample of senior clinicians, the task load experienced by both active participants and directed observers in high-fidelity simulation education was high for both prehospital and interhospital simulation exercises. The statistically significant differences we report are unlikely to be practically significant. Our results support the use of directed observers when resource limitations do not allow all course attendees to participate in every simulation.
Collapse
Affiliation(s)
- Jessica Devlin‐Hegedus
- Wollongong HospitalWollongongNew South WalesAustralia
- NSW AmbulanceRozelleNew South WalesAustralia
- Graduate School of MedicineUniversity of WollongongWollongongNew South WalesAustralia
| | - Matthew Miller
- NSW Ambulance Aeromedical OperationsBankstownNew South WalesAustralia
- St George HospitalKogarahNew South WalesAustralia
- St George and Sutherland Clinical CampusUNSW SydneyKogarahNew South WalesAustralia
| | - Sean Cooke
- NSW Ambulance Aeromedical OperationsBankstownNew South WalesAustralia
| | - Sandra Ware
- NSW Ambulance Aeromedical OperationsBankstownNew South WalesAustralia
| | - Clare Richmond
- NSW Ambulance Aeromedical OperationsBankstownNew South WalesAustralia
| |
Collapse
|
2
|
Surgical Training: the European Minimally Invasive Skills Education Model in Urology. Indian J Surg 2022. [DOI: 10.1007/s12262-021-03070-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022] Open
|
3
|
De Witte B, Barnouin C, Moreau R, Lelevé A, Martin X, Collet C, Hoyek N. A haptic laparoscopic trainer based on affine velocity analysis: engineering and preliminary results. BMC Surg 2021; 21:139. [PMID: 33736639 PMCID: PMC7977247 DOI: 10.1186/s12893-021-01128-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Accepted: 03/01/2021] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND There is a general agreement upon the importance of acquiring laparoscopic skills outside the operation room through simulation-based training. However, high-fidelity simulators are cost-prohibitive and elicit a high cognitive load, while low-fidelity simulators lack effective feedback. This paper describes a low-fidelity simulator bridging the existing gaps with affine velocity as a new assessment variable. Primary validation results are also presented. METHODS Psycho-motor skills and engineering key features have been considered e.g. haptic feedback and complementary assessment variables. Seventy-seven participants tested the simulator (17 expert surgeons, 12 intermediates, 28 inexperienced interns, and 20 novices). The content validity was tested with a 10-point Likert scale and the discriminative power by comparing the four groups' performance over two sessions. RESULTS Participants rated the simulator positively, from 7.25 to 7.72 out of 10 (mean, 7.57). Experts and intermediates performed faster with fewer errors (collisions) than inexperienced interns and novices. The affine velocity brought additional differentiations, especially between interns and novices. CONCLUSION This affordable haptic simulator makes it possible to learn and train laparoscopic techniques. Self-assessment of basic skills was easily performed with slight additional cost compared to low-fidelity simulators. It could be a good trade-off among the products currently used for surgeons' training.
Collapse
Affiliation(s)
- Benjamin De Witte
- Inter-University Laboratory of Human Movement Science (EA 7424), Univ Lyon, University Claude Bernard Lyon 1, 27-29 Boulevard du 11 Novembre 1918, 69622, Villeurbanne Cedex, France
| | - Charles Barnouin
- INSA Lyon, Ampère (UMR5005), Univ Lyon, 25 av. Jean Capelle ouest, 69621, Villeurbanne Cedex, France
| | - Richard Moreau
- INSA Lyon, Ampère (UMR5005), Univ Lyon, 25 av. Jean Capelle ouest, 69621, Villeurbanne Cedex, France
| | - Arnaud Lelevé
- INSA Lyon, Ampère (UMR5005), Univ Lyon, 25 av. Jean Capelle ouest, 69621, Villeurbanne Cedex, France.
| | - Xavier Martin
- Faculty of Medicine, Surgery School, Univ Lyon, University Claude Bernard Lyon 1, 8 Avenue Rockefeller, 69003, Lyon, France
- Service d'Urologie et de chirurgie de la Transplantation, Hôpital Édouard Herriot, Hospices Civils de Lyon, 5 Place d'Arsonval, 69003, Lyon, France
| | - Christian Collet
- Inter-University Laboratory of Human Movement Science (EA 7424), Univ Lyon, University Claude Bernard Lyon 1, 27-29 Boulevard du 11 Novembre 1918, 69622, Villeurbanne Cedex, France
| | - Nady Hoyek
- Inter-University Laboratory of Human Movement Science (EA 7424), Univ Lyon, University Claude Bernard Lyon 1, 27-29 Boulevard du 11 Novembre 1918, 69622, Villeurbanne Cedex, France
| |
Collapse
|
4
|
Assessment of training and selected factors on speed and quality of performing different tasks on the endoscopic simulator. Wideochir Inne Tech Maloinwazyjne 2020; 16:110-116. [PMID: 33786123 PMCID: PMC7991932 DOI: 10.5114/wiitm.2020.97364] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Accepted: 06/09/2020] [Indexed: 11/17/2022] Open
Abstract
Introduction One of the most significant challenges nowadays is to educate and predict the predispositions of young surgeons taking into consideration that every ability has its own learning curve. Aim To determine the influence of selected factors and examine the shape and the length of the learning curve in performing simple tasks on an endoscopic simulator. Material and methods Twenty students took part in 4 training sessions with a one-week break between sessions. They were training 12 min and performed three tasks at every session on the endoscopic simulator. To identify whether selected factors influence the time of completing tasks, the participants were asked to fill in questionnaires. All participants also completed the Minnesota Manual Dexterity Test (MMDT) to assess hand-eye coordination. Results Our research reveals that regardless of activities performed in free time, the shape of the learning curve was logarithmic. Improvement after the fourth session ranged from 50% to 75%. Performing specific activities in the free time did not influence the results achieved on the simulator. No statistically significant correlation between MMDT results and the time to accomplish each task was found. Conclusions This study has shown that the length of the learning curve of performing simple tasks is quite short and the shape is logarithmic. It suggests that more complex exercises should be included in the training programme.
Collapse
|
5
|
Vaidya A, Aydin A, Ridgley J, Raison N, Dasgupta P, Ahmed K. Current Status of Technical Skills Assessment Tools in Surgery: A Systematic Review. J Surg Res 2020; 246:342-378. [DOI: 10.1016/j.jss.2019.09.006] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2019] [Revised: 08/29/2019] [Accepted: 09/11/2019] [Indexed: 12/18/2022]
|
6
|
Deliberate Practice: Applying the Expert Performance Approach to Gynecologic Surgical Training. Clin Obstet Gynecol 2019; 63:295-304. [PMID: 31855902 DOI: 10.1097/grf.0000000000000509] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Surgical training is shifting from the historical Halstedian apprenticeship model to outcomes-based methods. Surgical residents can reach a higher level of performance when utilizing deliberate practice and the expert performance approach. This article discusses methods for implementing deliberate practice and the expert performance approach into gynecologic surgical training programs.
Collapse
|
7
|
Osorio J, Bubien RS, Ruff JD, Brenyo AJ, Rajendra A, Gidney BA, Zei P, Morales GX. Single Day Observational Experience at High Volume Ablation Programs: What is the Impact to Practicing Electrophysiologists? J Atr Fibrillation 2019; 11:2059. [PMID: 31139281 DOI: 10.4022/jafib.2059] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2017] [Revised: 08/19/2017] [Accepted: 09/14/2018] [Indexed: 12/28/2022]
Abstract
Introduction Significant improvements in catheter technology, electro-anatomic (EA) mapping and techniques to reduce fluoroscopy during radiofrequency ablation (RFA) of atrial fibrillation (AF) are on-going.However, few educational opportunities are available post fellowship for Electrophysiologists (EPs) to understand and integrate them into their practice, preventing wide spread adoption. The impact of observational learning for adoption of new technologies and techniques in the field of cardiac electrophysiology has not been studied. We sought to report the impact of a visit to a high-volume center with experience in new technologies and fluoroscopy reductionto the clinical practice of EPs. Methods Between 8/2014 and 10/2017 a total of 150 EPs visited 3 hospitals that perform a high volume of AF RFAs. EPs observed a minimum of 4 RFAs, primarily AF. AF RFAs were performed without fluoroscopy, using Carto 3 Version 4 (Biosense Webster) and intracardiac Echocardiography. There was ample interaction and discussion between hosting and visiting EP. Results 73 EPs (48.6% of visitors) completed an electronic survey after the visit. The majority reported a significant reduction in fluoroscopy (>50%) and procedure (>20%).68% adopted a rigorous workflow and reported an increase in their confidence level with intracardiac echo (79%), continuous mapping (52%) and the Visitag module (61%). Conclusions Observational experience can have an immense impact on the clinical practice of EPs. Further effort should be devoted to such programs and to study in a more systematic way their ultimate impact on patient care.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Paul Zei
- Brigham and Women's Hospital, Boston, MA
| | | |
Collapse
|
8
|
Julian O, Patrick H, Felix N, Tilman W, Mirco F, Beat-Peter MS, Gerhard S, Tanner MC. Development and validation of an objective assessment scale for chest tube insertion under 'direct' and 'indirect' rating. BMC MEDICAL EDUCATION 2018; 18:320. [PMID: 30587187 PMCID: PMC6307220 DOI: 10.1186/s12909-018-1430-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/08/2018] [Accepted: 12/14/2018] [Indexed: 06/09/2023]
Abstract
BACKGROUND There is an increasing need for objective and validated educational concepts. This holds especially true for surgical procedures like chest tube insertion (CTI). Thus, we developed an instrument for objectification of learning successes: the assessment scale based on Objective Structured Assessment of Technical Skill (OSATS) for chest tube insertion, which is evaluated in this study. Primary endpoint was the evaluation of intermethod reliability (IM). Secondary endpoints are 'indirect' interrater reliability (IR) and construct validity of the scale (CV). METHODS Every participant (N = 59) performed a CTI on a porcine thorax. Participants received three ratings (one 'direct' on site, two 'indirect' via video rating). IM compares 'direct' with 'indirect' ratings. IR was assessed between 'indirect' ratings. CV was investigated by subgroup analysis based on prior experience in CTI for 'direct' and 'indirect' rating. RESULTS We included 59 medical students to our study. IM showed moderate conformity ('direct' vs. 'indirect 1' ICC = 0.735, 95% CI: 0.554-0.843; 'direct' vs. 'indirect 2' ICC = 0.722, 95% CI 0.533-0.835) and good conformity between 'direct' vs. 'average indirect' rating (ICC = 0.764, 95% CI: 0.6-0.86). IR showed good conformity (ICC = 0.84, 95% CI: 0.707-0.91). CV was proven between subgroups in 'direct' (p = 0.037) and 'indirect' rating (p = 0.013). CONCLUSION Results for IM suggest equivalence for 'direct' and 'indirect' ratings, while both IR and CV was demonstrated in both rating methods. Thus, the assessment scale seems a reliable method for rating trainees' performances 'directly' as well as 'indirectly'. It may help to objectify and facilitate the assessment of training of chest tube insertion.
Collapse
Affiliation(s)
- Ober Julian
- HTRG – Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118 Heidelberg, Germany
| | - Haubruck Patrick
- HTRG – Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118 Heidelberg, Germany
| | - Nickel Felix
- Department of General, Visceral and Transplantation Surgery Heidelberg University Hospital, D-69120 Heidelberg, Germany
| | - Walker Tilman
- HTRG – Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118 Heidelberg, Germany
| | - Friedrich Mirco
- Department of General, Visceral and Transplantation Surgery Heidelberg University Hospital, D-69120 Heidelberg, Germany
| | - Müller-Stich Beat-Peter
- Department of General, Visceral and Transplantation Surgery Heidelberg University Hospital, D-69120 Heidelberg, Germany
| | - Schmidmaier Gerhard
- HTRG – Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118 Heidelberg, Germany
| | - Michael C. Tanner
- HTRG – Heidelberg Trauma Research Group, Center for Orthopedics, Trauma Surgery and Spinal Cord Injury, Trauma and Reconstructive Surgery, Heidelberg University Hospital, Schlierbacher Landstrasse 200a, D-69118 Heidelberg, Germany
| |
Collapse
|