1
|
Gazit N, Ben-Gal G, Eliashar R. Development and validation of an objective virtual reality tool for assessing technical aptitude among potential candidates for surgical training. BMC MEDICAL EDUCATION 2024; 24:286. [PMID: 38486166 PMCID: PMC10941473 DOI: 10.1186/s12909-024-05228-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Accepted: 02/26/2024] [Indexed: 03/17/2024]
Abstract
BACKGROUND Good technical skills are crucial for surgeons. Yet although surgical training programs strive to assess technical aptitude when selecting surgical residents, valid assessments of such aptitude are still lacking. Surgical simulators have been proposed as a potentially effective tool for this purpose. The current study aims to develop a technical aptitude test using a virtual reality surgical simulator, and to validate its use for the selection of surgical residents. METHODS The study had three phases. In Phase 1, we developed an initial version of the technical aptitude test using the Lap-X-VR laparoscopic simulator. In Phases 2 and 3 we refined the test and collected empirical data to evaluate four main sources of validity evidence (content, response process, internal structure, and relationships with other variables), and to evaluate the feasibility and acceptability of the test. Specifically, Phase 2 comprised a review of the test by 30 senior surgeons, and in Phase 3 a revised version of the test was administered to 152 interns to determine its psychometric properties. RESULTS Both the surgeons and interns rated the test as highly relevant for selecting surgical residents. Analyses of the data obtained from the trial administration of the test supported the appropriateness of the score calculation process and showed good psychometric properties, including reliability (α = 0.83) and task discrimination (mean discrimination = 0.5, SD = 0.1). The correlations between test scores and background variables revealed significant correlations with gender, surgical simulator experience, and video game experience (ps < 0.001). These variables, however, explained together only 10% of the variance in test scores. CONCLUSIONS We describe the systematic development of an innovative virtual reality test for assessing technical aptitude in candidates for surgical training, and present evidence for its validity, feasibility and acceptability. Further validation is required to support the application of the test for selection, as well as to discern the impact of gender, surgical simulator experience, and video game experience on the fairness of test results. However, the test appears to be a promising tool that may help training programs assess the suitability of candidates for surgical training.
Collapse
Affiliation(s)
- Noa Gazit
- Department of Prosthodontics, Hadassah Medical Center, Faculty of Dental Medicine, Hebrew University of Jerusalem, Jerusalem, Israel.
- Department of Otolaryngology/HNS, Hadassah Medical Center, Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel.
| | - Gilad Ben-Gal
- Department of Prosthodontics, Hadassah Medical Center, Faculty of Dental Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Ron Eliashar
- Department of Otolaryngology/HNS, Hadassah Medical Center, Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
| |
Collapse
|
2
|
Koutsimani P, Montgomery A. Burnout and Cognitive Functioning: Are We Underestimating the Role of Visuospatial Functions? Front Psychiatry 2022; 13:775606. [PMID: 35401261 PMCID: PMC8983930 DOI: 10.3389/fpsyt.2022.775606] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Accepted: 02/28/2022] [Indexed: 11/21/2022] Open
Abstract
Job burnout is a psychological syndrome which results from chronic occupational stress and cognitive impairments are among its negative consequences. The demands of the COVID-19 pandemic have challenged the healthcare system increasing the risk of job burnout among healthcare professionals. The studies conducted so far have mainly focused on the effects of job burnout on executive functions. Visuospatial functions are a cognitive domain which plays an important role in healthcare workers' optimal performance. Healthcare workers are constantly relying on their visuospatial abilities in order to care for their patients as they are required to use techniques that involve manipulation of medical instruments, they need to have excellent hand-eye coordination and great perception of spatial anatomy, factors that can affect healthcare workers' performance is of significance and can put patient safety at risk. However, our understanding of how visuospatial functions are being affected in job burnout is limited. The scope of this mini-review is to examine the evidence concerning the relationship of job burnout with visuospatial functions. The sparsity of the relevant empirical evidence does not allow for definite conclusions. However, given the implications of diminished visuospatial abilities in patient safety we highlight the need for studies exploring the effects of job burnout on visuospatial functions. Limitations of studies are discussed.
Collapse
Affiliation(s)
- Panagiota Koutsimani
- Department of Educational & Social Policy, School of Social Sciences, Humanities and Arts, University of Macedonia, Thessaloniki, Greece
| | - Anthony Montgomery
- Department of Educational & Social Policy, School of Social Sciences, Humanities and Arts, University of Macedonia, Thessaloniki, Greece
| |
Collapse
|
3
|
Global versus task-specific postoperative feedback in surgical procedure learning. Surgery 2021; 170:81-87. [PMID: 33589246 DOI: 10.1016/j.surg.2020.12.038] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 12/23/2020] [Accepted: 12/26/2020] [Indexed: 12/26/2022]
Abstract
BACKGROUND Task-specific checklists and global rating scales are both recommended assessment tools to provide constructive feedback on surgical performance. This study evaluated the most effective feedback tool by comparing the effects of the Observational Clinical Human Reliability Analysis (OCHRA) and the Objective Structured Assessment of Technical Skills (OSATS) on surgical performance in relation to the visual-spatial ability of the learners. METHODS In a randomized controlled trial, medical students were allocated to either the OCHRA (n = 25) or OSATS (n = 25) feedback group. Visual-spatial ability was measured by a Mental Rotation Test. Participants performed an open inguinal hernia repair procedure on a simulation model twice. Feedback was provided after the first procedure. Improvement in performance was evaluated blindly using a global rating scale (performance score) and hand-motion analysis (time and path length). RESULTS Mean improvement in performance score was not significantly different between the OCHRA and OSATS feedback groups (P = .100). However, mean improvement in time (371.0 ± 223.4 vs 274.6 ± 341.6; P = .027) and path length (53.5 ± 42.4 vs 34.7 ± 39.0; P = .046) was significantly greater in the OCHRA feedback group. When stratified by mental rotation test scores, the greater improvement in time (P = .032) and path length (P = .053) was observed only among individuals with low visual-spatial abilities. CONCLUSION A task-specific (OCHRA) feedback is more effective in improving surgical skills in terms of time and path length in novices compared to a global rating scale (OSATS). The effects of a task-specific feedback are present mostly in individuals with lower visual-spatial abilities.
Collapse
|
4
|
Mason EM, Deal MJ, Richey BP, Baker A, Zeini IM, Service BC, Osbahr DC. Innate Arthroscopic & Laparoscopic Surgical Skills: A Systematic Review of Predictive Performance Indicators Within Novice Surgical Trainees. JOURNAL OF SURGICAL EDUCATION 2021; 78:178-200. [PMID: 32591323 DOI: 10.1016/j.jsurg.2020.06.006] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2020] [Revised: 05/11/2020] [Accepted: 06/04/2020] [Indexed: 06/11/2023]
Abstract
OBJECTIVE To query the literature for predictive factors for performance on arthroscopic and laparoscopic surgical simulators in novice surgical trainees. These predictive factors may prove a valuable tool in identifying certain innate potential to becoming a future skilled surgeon that could benefit both surgical residency candidates and program directors alike, while also improving patient care. DESIGN Systematic Review. RESULTS The initial searches yielded 249 articles. After screening titles/abstracts and implementing inclusion and exclusion criteria, 36 studies were included in the final systematic review. CONCLUSIONS Current literature suggests that video game experience/frequency, psychomotor and visuospatial aptitude, and perceptual ability are among the most promising predictive indicators of baseline simulator performance. Study limitations include utilization of different standards for characterizing predictive factors. Future studies should aim to utilize standard guidelines for accurate quantification of innate predictive factors. Future research should also focus on utilizing standardized simulator platforms and aptitude tests to allow for more accurate cross-study comparisons and meta-analyses with larger sample sizes.
Collapse
Affiliation(s)
- Eric M Mason
- University of Central Florida College of Medicine, Orlando, Florida
| | | | - Bradley P Richey
- University of Central Florida College of Medicine, Orlando, Florida
| | - Alexandra Baker
- University of Central Florida College of Medicine, Orlando, Florida
| | | | - Benjamin C Service
- Sports Medicine Division, Orlando Health Orthopedic Institute, Orlando, Florida
| | | |
Collapse
|
5
|
Kalun P, Dunn K, Wagner N, Pulakunta T, Sonnadara R. Recent evidence on visual-spatial ability in surgical education: A scoping review. CANADIAN MEDICAL EDUCATION JOURNAL 2020; 11:e111-e127. [PMID: 33349760 PMCID: PMC7749687 DOI: 10.36834/cmej.69051] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
BACKGROUND Understanding the relationships between structures is critical for surgical trainees. However, the heterogeneity of the literature on visual-spatial ability (VSA) in surgery makes it challenging for educators to make informed decisions on incorporating VSA into their programs. We conducted a scoping review of the literature on VSA in surgery to provide a map of the literature and identify where gaps still exist for future research. METHODS We searched databases until December 2019 using keywords related to VSA and surgery. The resulting articles were independently screened by two researchers for inclusion in our review. RESULTS We included 117 articles in the final review. Fifty-nine articles reported significant correlations between VSA tests and surgical performance, and this association is supported by neuroimaging studies. However, it remains unclear whether VSA should be incorporated into trainee selection and whether there is a benefit of three-dimensional (3D) over two-dimensional (2D) training. CONCLUSIONS It appears that VSA correlates with surgical performance in the simulated environment, particularly for novice learners. Based on our findings, we make suggestions for how surgical educators may use VSA to support novice learners. Further research should determine whether VSA remains correlated to surgical performance when trainees move into the operative environment.
Collapse
Affiliation(s)
- Portia Kalun
- Department of Surgery, McMaster University, Ontario, Canada
| | - Krista Dunn
- Faculty of Medicine, Dalhousie University, Nova Scotia, Canada
| | - Natalie Wagner
- Department of Surgery, McMaster University, Ontario, Canada
- Office of Professional Development & Educational Scholarship, Faculty of Health Sciences, Queen’s University, Ontario, Canada
| | | | - Ranil Sonnadara
- Department of Surgery, McMaster University, Ontario, Canada
- Department of Surgery, University of Toronto, Ontario, Canada
| |
Collapse
|
6
|
Langlois J, Bellemare C, Toulouse J, Wells GA. Spatial abilities training in the field of technical skills in health care: A systematic review. Heliyon 2020; 6:e03280. [PMID: 32190751 PMCID: PMC7068633 DOI: 10.1016/j.heliyon.2020.e03280] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2019] [Revised: 08/24/2019] [Accepted: 01/06/2020] [Indexed: 11/17/2022] Open
Abstract
Objective To conduct a systematic review of the effect of interventions on spatial abilities in the field of technical skills in health care. Methods A literature search was conducted up to November 14, 2017 in Scopus and in several databases on EBSCOhost platform. Citations were obtained, articles related to retained citations were reviewed and a final list of included studies was identified. Methods in the field of technical skills relating an intervention to spatial abilities test scores between intervention groups or obtained before and after the intervention were identified as eligible. The quality of included studies was assessed and data were extracted in a systematic way. Results A series of 5513 citations was obtained. Ninety-nine articles were retained and fully reviewed, yielding four included studies. No difference in the Hidden Figure Test score after one year was observed after residency training in General Surgery of at least nine months. A first-year dental curriculum was not found to elevate the Novel Object Cross-Sections Test score (P = 0.07). A two-semester learning period of abdominal sonography was found to increase the Revised Minnesota Paper Form Board Test score (P < 0.05). A hands-on radiology course using interactive three-dimensional image post-processing software consisting of seven two-hour long seminars on a weekly basis was found to amplify the Cube Perspective Test score (P < 0.001). Conclusion Spatial abilities tests scores were enhanced by courses in abdominal sonography and hands-on radiology, but were not improved by residency training in General Surgery and first-year dental curriculum.
Collapse
Affiliation(s)
- Jean Langlois
- Department of Emergency Medicine, CIUSSS de l'Estrie - Centre hospitalier universitaire de Sherbrooke, Sherbrooke, Quebec, Canada
| | - Christian Bellemare
- Department of Multidisciplinary Services, Clinical Quality Division, CIUSSS de l'Estrie - Centre hospitalier universitaire de Sherbrooke, Sherbrooke, Quebec, Canada
| | - Josée Toulouse
- Librairies and Archives Services, Université de Sherbrooke, Sherbrooke, Quebec, Canada
| | - George A Wells
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada.,Cardiovascular Research Methods Centre, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
| |
Collapse
|
7
|
Self-directed training with e-learning using the first-person perspective for laparoscopic suturing and knot tying: a randomised controlled trial : Learning from the surgeon's real perspective. Surg Endosc 2019; 34:869-879. [PMID: 31139998 DOI: 10.1007/s00464-019-06842-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2018] [Accepted: 05/16/2019] [Indexed: 12/23/2022]
Abstract
BACKGROUND Laparoscopic suturing and knot tying is essential for advanced laparoscopic procedures and requires training outside of the operating room. However, personal instruction by experienced surgeons is limitedly available. To address this, the concept of combining e-learning with practical training has become of interest. This study aims to investigate the influence of the first-person perspective in instructional videos, as well as the feasibility of a completely self-directed training curriculum for laparoscopic suturing and knot tying. MATERIALS AND METHODS Ninety-one laparoscopically naïve medical students were randomised into two groups training with e-learning videos in either the first-person perspective (combining endoscopic view and view of hands/instruments/forearm motion) or the endoscopic view only. Both groups trained laparoscopic suturing and knot tying in teams of two until reaching predefined proficiency levels. Blinded, trained raters regularly assessed the participants' performance by using validated checklists. After training, participants filled out questionnaires regarding training experience and personal characteristics. RESULTS Average training time to reach proficiency did not differ between groups [first-person perspective (min): 112 ± 44; endoscopic view only (min): 109 ± 47; p = 0.746]. However, participants from both groups perceived the first-person perspective as useful for learning new laparoscopic skills. Both groups showed similar baseline performances and improved significantly after training [Objective Structured Assessment of Technical Skills (OSATS) (max. 37 points): first-person perspective: 30.3 ± 2.3; endoscopic view only: 30.8 ± 2.3]. All participants managed to reach proficiency, needing 8-43 attempts without differences between groups. Visuospatial abilities (mental rotation) seemed to enhance the learning curve. CONCLUSION Modifying instructional videos to the first-person perspective did not translate into a better performance in this setting but was welcomed by participants. Completely self-directed training with the use of e-learning can be a feasible training approach to achieve technical proficiency in laparoscopic suturing and knot tying in a training setting.
Collapse
|
8
|
Dall Jensen R, Ravn S, Krogh Christensen M. Identification and development of talent in surgery. EUROPEAN JOURNAL OF TRAINING AND DEVELOPMENT 2019. [DOI: 10.1108/ejtd-07-2018-0070] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Purpose
Education of the surgeon and development of surgical expertise have been debated for centuries. Today, research in surgical education applies terms and methods from other performance domains such as sport and music. However, there still seems to be a lack of consensus as to how talent may be brought into the discourse about surgical education. Especially, when it comes to identifying and developing trainees who in the future will perform better than the average surgeon.
Design/methodology/approach
This five-step scoping study aims to map existing literature about talent identification, talent development and development of expertise in the domains of surgery, sport and music in the period of 1985-2014.
Findings
A total of 242 studies, divided in the four domains of surgery (69 studies), sport (115 studies), music (34 studies) and cross-disciplinary studies (24 studies) published in the period 1985-2014 were included.
Originality/value
Informed by the performance domains of sports and music and their inclusion of a holistic, ecological approach to research, this study suggests that research in surgical education may benefit from broadening its view on talent by including psychosocial variables and environmental, demographic and structural influencers when considering how surgical talent may be identified and developed.
Collapse
|
9
|
Burkhardt R, Hämmerle CHF, Lang NP. How do visual-spatial and psychomotor abilities influence clinical performance in periodontal plastic surgery? J Clin Periodontol 2018; 46:72-85. [PMID: 30358900 DOI: 10.1111/jcpe.13028] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2017] [Revised: 10/05/2018] [Accepted: 10/19/2018] [Indexed: 11/29/2022]
Abstract
AIM We want to evaluate the relationship of self-assessed experience and proficiency, manual dexterity and visual-spatial ability with surgical performance. MATERIAL AND METHODS A total of 26 professionals were included in the study which consisted of four parts: (a) self-assessment by a questionnaire regarding proficiency and experience, (b) evaluation of visual-spatial ability, (c) testing of manual dexterity assessed by validated psychomotor tests and (d) evaluation of surgical performance by Objective Structured Assessment of Technical Skills (OSATS). RESULTS Self-assessed proficiency and experience levels did not correlate with objectively evaluated surgical performances (OSATS). However, low-level visual-spatial ability tests strongly correlated with OSATS while intermediate- and high-level tests did not. No correlation was found between psychomotor ability and clinical performance. CONCLUSIONS Self-assessed proficiency is not a good predictor for surgical performance as experts tend to be overconfident. To evaluate and predict surgical performance, visual-spatial ability tests seem to be more appropriate than measuring manual dexterity which failed to correlate with the surgical outcome.
Collapse
Affiliation(s)
- Rino Burkhardt
- Prince Philip Dental Hospital, The University of Hong Kong, Hong Kong, Hong Kong SAR.,Universities of Berne and Zurich, Switzerland
| | - Christoph H F Hämmerle
- Prince Philip Dental Hospital, The University of Hong Kong, Hong Kong, Hong Kong SAR.,Universities of Berne and Zurich, Switzerland
| | - Niklaus P Lang
- Prince Philip Dental Hospital, The University of Hong Kong, Hong Kong, Hong Kong SAR.,Universities of Berne and Zurich, Switzerland
| | | |
Collapse
|
10
|
Vajsbaher T, Schultheis H, Francis NK. Spatial cognition in minimally invasive surgery: a systematic review. BMC Surg 2018; 18:94. [PMID: 30404634 PMCID: PMC6223063 DOI: 10.1186/s12893-018-0416-1] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2018] [Accepted: 09/20/2018] [Indexed: 02/08/2023] Open
Abstract
Background Spatial cognition is known to play an important role in minimally invasive surgery (MIS), as it was found to enable faster surgical skill acquisition, reduce surgical time and errors made and significantly improve surgical performance. No prior research attempted to summarize the available literature, to indicate the level of importance of the individual spatial abilities and how they impact surgical performance and skill acquisition in MIS. Methods Psychological and medical databases were systematically searched to identify studies directly exploring spatial cognition in MIS learning and performance outcomes. Articles written in the English language articles, published between 2006 and 2016, investigating any and all aspect of spatial cognition in direct relation to influence over performance or learning of MIS, were deemed eligible. Results A total of 26 studies satisfied this criterion and were included in the review. The studies were very heterogeneous and the vast majority of the participants were novice trainees but with variable degree of skills. There were no clinical studies as almost all studies were conducted on either box trainers or virtual reality simulators. Mental rotation ability was found to have a clear impact on operative performance and mental practice was identified as an effective tool to enhance performance, pre-operatively. Ergonomic set-up of the MIS equipment has a marked influence on MIS performance and learning outcomes. Conclusions Spatial cognition was found to play an important role in MIS, with mental rotation showing a specific significance. Future research is required to further confirm and quantify these findings in the clinical settings.
Collapse
Affiliation(s)
- Tina Vajsbaher
- Bremen Spatial Cognition Center & Department of Human and Health Sciences, University of Bremen, Enrique-Schmidt-Str.5, 28359, Bremen, Germany. .,Department of Human and Health Sciences, University of Bremen, Bremen, Germany.
| | - Holger Schultheis
- Bremen Spatial Cognition Center & Department of Human and Health Sciences, University of Bremen, Enrique-Schmidt-Str.5, 28359, Bremen, Germany
| | - Nader K Francis
- Department of General Surgery, Yeovil District Hospital NHS Foundation Trust, Yeovil, UK.,Faculty of Health and Life Sciences, University of Liverpool, Brownlow Hill, Liverpool, L69 7ZX, UK
| |
Collapse
|
11
|
Abe T, Raison N, Shinohara N, Shamim Khan M, Ahmed K, Dasgupta P. The Effect of Visual-Spatial Ability on the Learning of Robot-Assisted Surgical Skills. JOURNAL OF SURGICAL EDUCATION 2018; 75:458-464. [PMID: 28918007 DOI: 10.1016/j.jsurg.2017.08.017] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/21/2017] [Revised: 06/28/2017] [Accepted: 08/15/2017] [Indexed: 06/07/2023]
Abstract
BACKGROUND The aim of this study was to determine the correlation of visual-spatial ability with progression along the learning curve for robotic surgical skills training. METHODS A total of 21 novice participants were recruited. All participants completed a training program consisting of 5 training sessions of 30 minutes of virtual reality (VR) simulation and 30 minutes of dry laboratory training. The VR simulation part was the subject of the present study. During VR simulation training, participants performed the basic skill exercises of Camera Targeting 1, Pick and Place, and Peg Board 1 followed by advanced skill exercises of Suture Sponge 1 and Thread the Rings. The visual-spatial ability was assessed using a mental rotation test (MRT). Pearson correlation coefficients were used to assess the relationship between the MRT score and simulator score for the aforementioned 5 tasks. Student t test was used to compare the simulator score between high- and low-MRT score groups. RESULTS A median MRT score of 26/40 (range: 13-38) was observed. Approximately 19 participants completed the full curriculum but 2 did not complete "Thread the Rings" during the study period. A significant correlation was observed between the MRT score and simulator score only in "Suture Sponge 1" over the first 3 attempts (first: r = 0.584, p = 0.0054; second: r = 0.443, p = 0.0443; third: r = 0.4458, p = 0.0428). After the third attempt, this significant correlation was lost. Comparison of the score for "Suture Sponge 1" between the high-MRT and low-MRT scoring participants divided by a median MRT score of 26 also showed a significant difference in the score until the third trial. CONCLUSION Our observations suggest that the spatial cognitive ability influences the initial learning of robotic suturing skills. Further studies are necessary to verify the usefulness of an individual's spatial ability to tailor the surgical training program.
Collapse
Affiliation(s)
- Takashige Abe
- Division of Transplantation, Immunology & Mucosal Biology, Faculty of Life Sciences & Medicine, King's College London, Guy's Campus, London, England, United Kingdom; Department of Urology, Hokkaido University Graduate School of Medicine, Sapporo, Japan.
| | - Nicholas Raison
- Division of Transplantation, Immunology & Mucosal Biology, Faculty of Life Sciences & Medicine, King's College London, Guy's Campus, London, England, United Kingdom
| | - Nobuo Shinohara
- Department of Urology, Hokkaido University Graduate School of Medicine, Sapporo, Japan
| | - M Shamim Khan
- Division of Transplantation, Immunology & Mucosal Biology, Faculty of Life Sciences & Medicine, King's College London, Guy's Campus, London, England, United Kingdom
| | - Kamran Ahmed
- Division of Transplantation, Immunology & Mucosal Biology, Faculty of Life Sciences & Medicine, King's College London, Guy's Campus, London, England, United Kingdom
| | - Prokar Dasgupta
- Division of Transplantation, Immunology & Mucosal Biology, Faculty of Life Sciences & Medicine, King's College London, Guy's Campus, London, England, United Kingdom
| |
Collapse
|
12
|
Kowalewski KF, Hendrie JD, Schmidt MW, Proctor T, Paul S, Garrow CR, Kenngott HG, Müller-Stich BP, Nickel F. Validation of the mobile serious game application Touch Surgery™ for cognitive training and assessment of laparoscopic cholecystectomy. Surg Endosc 2017; 31:4058-4066. [PMID: 28281111 DOI: 10.1007/s00464-017-5452-x] [Citation(s) in RCA: 44] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2016] [Accepted: 02/03/2017] [Indexed: 11/30/2022]
Abstract
BACKGROUND Touch Surgery™ (TS) is a serious gaming application for cognitive task simulation and rehearsal of key steps in surgical procedures. The aim was to establish face, content, and construct validity of TS for laparoscopic cholecystectomy (LC). Furthermore, learning curves with TS and a virtual reality (VR) trainer were compared in a randomized trial. METHODS The performance of medical students and general surgeons was compared for all three modules of LC in TS to establish construct validity. Questionnaires assessed face and content validity. For analysis of learning curves, students were randomized to train on VR or TS first, and then switched to the other training modality. Performance data were recorded. RESULTS 54 Surgeons and 51 medical students completed the validation study. Surgeons outperformed students with TS: patient preparation (students = 45.0 ± 19.1%; surgeons = 57.3 ± 15.2%; p < 0.001), access and laparoscopy (students = 70.2 ± 10.9%; surgeons = 75.9 ± 9.7%; p = 0.008) and LC (students = 69.8 ± 12.4%; surgeons = 77.7 ± 9.6%; p < 0.001). Both groups agreed that TS was a highly useful and realistic application. 46 students were randomized for learning curve analysis. It took them 2-4 attempts to reach a 100% score with TS. Training with TS first did not improve students' performance on the VR trainer; however, students who trained with VR first scored significantly higher in module 3 of TS. CONCLUSION TS is an accepted serious gaming application for learning cognitive aspects of LC with established construct, face, and content validity. There appeared to be a synergy between TS and the VR trainer. Therefore, the two training modalities should accompany one another in a multimodal training approach to laparoscopy.
Collapse
Affiliation(s)
- Karl-Friedrich Kowalewski
- Department of General, Visceral, and Transplantation Surgery, University of Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany
| | - Jonathan D Hendrie
- Department of General, Visceral, and Transplantation Surgery, University of Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany
| | - Mona W Schmidt
- Department of General, Visceral, and Transplantation Surgery, University of Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany
| | - Tanja Proctor
- Department of Medical Biometry and Informatics, University of Heidelberg, Im Neuenheimer Feld 130.3, 69120, Heidelberg, Germany
| | - Sai Paul
- Department of General, Visceral, and Transplantation Surgery, University of Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany
| | - Carly R Garrow
- Department of General, Visceral, and Transplantation Surgery, University of Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany
| | - Hannes G Kenngott
- Department of General, Visceral, and Transplantation Surgery, University of Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany
| | - Beat P Müller-Stich
- Department of General, Visceral, and Transplantation Surgery, University of Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany
| | - Felix Nickel
- Department of General, Visceral, and Transplantation Surgery, University of Heidelberg, Im Neuenheimer Feld 110, 69120, Heidelberg, Germany.
| |
Collapse
|
13
|
Louridas M, Szasz P, Montbrun SD, Harris KA, Grantcharov TP. Optimizing the Selection of General Surgery Residents: A National Consensus. JOURNAL OF SURGICAL EDUCATION 2017; 74:100-107. [PMID: 27476793 DOI: 10.1016/j.jsurg.2016.06.015] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2016] [Revised: 05/06/2016] [Accepted: 06/20/2016] [Indexed: 06/06/2023]
Abstract
BACKGROUND Surgical programs strive to recruit trainees who will graduate as competent surgeons; however, selection processes vary between institutions. The purpose of the present study was to (1) solicit program directors' (PDs) opinions on the proportion of trainees who have difficulty achieving competence and (2) establish consensus on the desired attributes of general surgery (GS) candidates and the technical skills that would be most indicative of future performance. METHODS Delphi consensus methodology was used. An open-ended questionnaire, followed by a closed-ended questionnaire, formulated as a 5-point Likert scale, was administered. A Cronbach α ≥ 0.8 with 80% of responses in agreement (4-agree and 5-strongly agree) determined the threshold for consensus. RESULTS The first and second rounds were completed by 14 and 11, of a potential 17, GS PDs, respectively. PDs felt that 5% or less of trainees have difficulty reaching competence in clinical knowledge, 5% to 10% in decision-making, and 5% to 15% in technical skill by the time of completion of training. Consensus was excellent (α = 0.92). The top attributes for success in GS included work ethic and passion for surgery. Technical skills that felt to be most appropriate were open tasks (one-handed tie and subcuticular suture) and laparoscopic tasks (coordination, grasping, and cutting). CONCLUSION PDs indicate that of the 3 domains, the largest proportion of trainees had difficulty reaching competence in technical skill. Consensus among PDs suggests that top personal attributes include work ethic and passion for surgery. Consensus of technical tasks for inclusion into selection was basic open and laparoscopic skills.
Collapse
Affiliation(s)
- Marisa Louridas
- Division of General Surgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada; Division of General Surgery, St. Michael's Hospital, Toronto, Ontario, Canada.
| | - Peter Szasz
- Division of General Surgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada; Division of General Surgery, St. Michael's Hospital, Toronto, Ontario, Canada
| | - Sandra de Montbrun
- Division of General Surgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada; Division of General Surgery, St. Michael's Hospital, Toronto, Ontario, Canada
| | - Kenneth A Harris
- Royal College of Physicians and Surgeons of Canada, Ottawa, Ontario, Canada
| | - Teodor P Grantcharov
- Division of General Surgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada; Division of General Surgery, St. Michael's Hospital, Toronto, Ontario, Canada
| |
Collapse
|
14
|
Schwibbe A, Kothe C, Hampe W, Konradt U. Acquisition of dental skills in preclinical technique courses: influence of spatial and manual abilities. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2016; 21:841-857. [PMID: 26891678 DOI: 10.1007/s10459-016-9670-0] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/17/2015] [Accepted: 02/11/2016] [Indexed: 06/05/2023]
Abstract
Sixty years of research have not added up to a concordant evaluation of the influence of spatial and manual abilities on dental skill acquisition. We used Ackerman's theory of ability determinants of skill acquisition to explain the influence of spatial visualization and manual dexterity on the task performance of dental students in two consecutive preclinical technique courses. We measured spatial and manual abilities of applicants to Hamburg Dental School by means of a multiple choice test on Technical Aptitude and a wire-bending test, respectively. Preclinical dental technique tasks were categorized as consistent-simple and inconsistent-complex based on their contents. For analysis, we used robust regression to circumvent typical limitations in dental studies like small sample size and non-normal residual distributions. We found that manual, but not spatial ability exhibited a moderate influence on the performance in consistent-simple tasks during dental skill acquisition in preclinical dentistry. Both abilities revealed a moderate relation with the performance in inconsistent-complex tasks. These findings support the hypotheses which we had postulated on the basis of Ackerman's work. Therefore, spatial as well as manual ability are required for the acquisition of dental skills in preclinical technique courses. These results support the view that both abilities should be addressed in dental admission procedures in addition to cognitive measures.
Collapse
Affiliation(s)
- Anja Schwibbe
- Department of Biochemistry and Molecular Cell Biology, Center for Experimental Medicine, Universitätsklinikum Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
| | - Christian Kothe
- Department of Biochemistry and Molecular Cell Biology, Center for Experimental Medicine, Universitätsklinikum Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany
| | - Wolfgang Hampe
- Department of Biochemistry and Molecular Cell Biology, Center for Experimental Medicine, Universitätsklinikum Hamburg-Eppendorf, Martinistraße 52, 20246, Hamburg, Germany
| | - Udo Konradt
- Unit of Work and Organizational Psychology, Institute of Psychology, University of Kiel, Olshausenstr. 62, 24098, Kiel, Germany
| |
Collapse
|
15
|
Louridas M, Szasz P, de Montbrun S, Harris KA, Grantcharov TP. Can We Predict Technical Aptitude?: A Systematic Review. Ann Surg 2016; 263:673-91. [PMID: 26079898 DOI: 10.1097/sla.0000000000001283] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
OBJECTIVE To identify background characteristics and cognitive tests that may predict surgical trainees' future technical performance, and therefore be used to supplement existing surgical residency selection criteria. BACKGROUND Assessment of technical skills is not commonly incorporated as part of the selection process for surgical trainees in North America. Emerging evidence, however, suggests that not all trainees are capable of reaching technical competence. Therefore, incorporating technical aptitude into selection processes may prove useful. METHODS A systematic search was carried out of the MEDLINE, PsycINFO, and Embase online databases to identify all studies that assessed associations between surrogate markers of innate technical abilities in surgical trainees, and whether these abilities correlate with technical performance. The quality of each study was evaluated using the Grading of Recommendations, Assessment, Development, and Evaluation system. RESULTS A total of 8035 records were identified. After screening by title, abstract, and full text, 52 studies were included. Very few surrogate markers were found to predict technical performance. Significant associations with technical performance were seen for 1 of 23 participant-reported surrogate markers, 2 of 25 visual spatial tests, and 2 of 19 dexterity tests. The assessment of trainee Basic Performance Resources predicted technical performance in 62% and 75% of participants. CONCLUSIONS To date, no single test has been shown to reliably predict the technical performance of surgical trainees. Strategies that rely on assessing multiple innate abilities, their interaction, and their relationship with technical skill may ultimately be more likely to serve as reliable predictors of future surgical performance.
Collapse
Affiliation(s)
- Marisa Louridas
- *Division of General Surgery, Department of Surgery, University of Toronto, Toronto, Canada †Division of General Surgery, St. Michael's Hospital, Toronto, Canada ‡Royal College of Physicians and Surgeons of Canada, Ottawa, Canada
| | | | | | | | | |
Collapse
|
16
|
Kramp KH, van Det MJ, Hoff C, Veeger NJGM, ten Cate Hoedemaker HO, Pierie JPEN. The predictive value of aptitude assessment in laparoscopic surgery: a meta-analysis. MEDICAL EDUCATION 2016; 50:409-427. [PMID: 26995481 DOI: 10.1111/medu.12945] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2015] [Revised: 06/15/2015] [Accepted: 09/24/2015] [Indexed: 06/05/2023]
Abstract
CONTEXT Current methods of assessing candidates for medical specialties that involve laparoscopic skills suffer from a lack of instruments to assess the ability to work in a minimally invasive surgery environment. OBJECTIVES A meta-analysis was conducted to investigate whether aptitude assessment can be used to predict variability in the acquisition and performance of laparoscopic skills. METHODS PubMed, PsycINFO and Google Scholar were searched to November 2014 for published and unpublished studies reporting the measurement of a form of aptitude for laparoscopic skills. The quality of studies was assessed with QUADAS-2. Summary correlations were calculated using a random-effects model. RESULTS Thirty-four studies were found to be eligible for inclusion; six of these studies used an operating room performance measurement. Laparoscopic skills correlated significantly with visual-spatial ability (r = 0.32, 95% confidence interval [CI] 0.25-0.39; p < 0.001), perceptual ability (r = 0.31, 95% CI 0.22-0.39; p < 0.001), psychomotor ability (r = 0.26, 95% CI 0.10-0.40; p = 0.003) and simulator-based assessment of aptitude (r = 0.64, 95% CI 0.52-0.73; p < 0.001). Three-dimensional dynamic visual-spatial ability showed a significantly higher correlation than intrinsic static visual-spatial ability (p = 0.024). CONCLUSIONS In general, aptitude assessments are associated with laparoscopic skill level. Simulator-based assessment of aptitude appears to have the potential to represent a job sample and to enable the assessment of all forms of aptitude for laparoscopic surgery at once. A laparoscopy aptitude test can be a valuable additional tool in the assessment of candidates for medical specialties that require laparoscopic skills.
Collapse
Affiliation(s)
- Kelvin H Kramp
- Department of Surgery, Medical Centre Leeuwarden, Leeuwarden, The Netherlands
| | - Marc J van Det
- Department of Surgery, Hospital Group Twente, Almelo, The Netherlands
| | - Christiaan Hoff
- Department of Surgery, Medical Centre Leeuwarden, Leeuwarden, The Netherlands
| | - Nic J G M Veeger
- Department of Epidemiology, University Medical Centre Groningen, Groningen, The Netherlands
- Department of Epidemiology, Leeuwarden Medical Center, Leeuwarden, the Netherlands
| | | | - Jean-Pierre E N Pierie
- Department of Surgery, Medical Centre Leeuwarden, Leeuwarden, The Netherlands
- Post Graduate School of Medicine, University Medical Center Groningen and University of Groningen, Groningen, the Netherlands
| |
Collapse
|
17
|
Langlois J, Bellemare C, Toulouse J, Wells GA. Spatial abilities and technical skills performance in health care: a systematic review. MEDICAL EDUCATION 2015; 49:1065-1085. [PMID: 26494061 DOI: 10.1111/medu.12786] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/12/2015] [Revised: 04/07/2015] [Accepted: 05/11/2015] [Indexed: 06/05/2023]
Abstract
OBJECTIVES The aim of this study was to conduct a systematic review and meta-analysis of the relationship between spatial abilities and technical skills performance in health care in beginners and to compare this relationship with those in intermediate and autonomous learners. METHODS Search criteria included 'spatial abilities' and 'technical skills'. Keywords related to these criteria were defined. A literature search was conducted to 20 December, 2013 in Scopus (including MEDLINE) and in several databases on EBSCOhost platforms (CINAHL Plus with Full Text, ERIC, Education Source and PsycINFO). Citations were obtained and reviewed by two independent reviewers. Articles related to retained citations were reviewed and a final list of eligible articles was determined. Articles were assessed for quality using the Scottish Intercollegiate Guidelines Network-50 assessment instrument. Data were extracted from articles in a systematic way. Correlations between spatial abilities test scores and technical skills performance were identified. RESULTS A series of 8289 citations was obtained. Eighty articles were retained and fully reviewed, yielding 36 eligible articles. The systematic review found a tendency for spatial abilities to be negatively correlated with the duration of technical skills and positively correlated with the quality of technical skills performance in beginners and intermediate learners. Pooled correlations of studies were -0.46 (p = 0.03) and -0.38 (95% confidence interval [CI] -0.53 to -0.21) for duration and 0.33 (95% CI 0.20-0.44) and 0.41 (95% CI 0.26-0.54) for quality of technical skills performance in beginners and intermediate learners, respectively. However, correlations between spatial abilities test scores and technical skills performance were not statistically significant in autonomous learners. CONCLUSIONS Spatial abilities are an important factor to consider in selecting and training individuals in technical skills in health care.
Collapse
Affiliation(s)
- Jean Langlois
- Department of Emergency Medicine, Centre hospitalier universitaire de Sherbrooke, Quebec, Canada
| | - Christian Bellemare
- Department of Health Technology Assessment, Centre hospitalier universitaire de Sherbrooke, Sherbrooke, Quebec, Canada
| | - Josée Toulouse
- Library and Archive Services, Université de Sherbrooke, Sherbrooke, Quebec, Canada
| | - George A Wells
- Department of Epidemiology and Community Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Cardiovascular Research Methods Centre, University of Ottawa Heart Institute, Ottawa, Ontario, Canada
| |
Collapse
|
18
|
Groenier M, Groenier KH, Miedema HAT, Broeders IAMJ. Perceptual Speed and Psychomotor Ability Predict Laparoscopic Skill Acquisition on a Simulator. JOURNAL OF SURGICAL EDUCATION 2015; 72:1224-1232. [PMID: 26341168 DOI: 10.1016/j.jsurg.2015.07.006] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/04/2015] [Revised: 05/11/2015] [Accepted: 07/13/2015] [Indexed: 06/05/2023]
Abstract
OBJECTIVE Performing minimally invasive surgery puts high demands on a surgeon's cognitive and psychomotor abilities. Assessment of these abilities can be used to predict a surgeon's learning curve, to create individualized training programs, and ultimately in selection programs for surgical training. The aim of this study was to examine the influence of cognitive and psychomotor ability on the training duration and learning rate. DESIGN A prospective quasiexperimental field study regarding the influence of cognitive and psychomotor ability, baseline measures of time to complete task, damage to tissue, and efficiency of movement, age, and gender on the number of sessions needed to reach a predefined performance level on a laparoscopy simulator. The same variables were investigated as predictors of the learning rate. SETTING The study was performed at the Experimental Center for Technical Medicine at the University of Twente, The Netherlands. PARTICIPANTS In all, 98 novices from the Master program of Technical Medicine followed a proficiency-based basic laparoscopic skills training. RESULTS Perceptual speed (PS) predicted training duration (hazard ratio = 1.578; 95% CI = 1.084, 2.300; p = 0.017). Cognitive (b = -0.721, p = 0.014) and psychomotor ability (b = 0.182, p = 0.009) predicted the learning rate of time to complete the task. Also, the learning rate for participants with higher levels of PS was lower (b = 0.167, p = 0.036). Psychomotor ability also predicted the learning rate for damage to tissue (b = 0.194, p = 0.015) and efficiency of movement (b = 0.229, p = 0.004). Participants with better psychomotor ability outperformed other participants across all sessions on all outcome measures. CONCLUSIONS PS predicted training duration in a basic laparoscopic skills training and the learning rate for the time to complete the task. Psychomotor ability predicted the learning rate for laparoscopic skill acquisition in terms of time to complete task, damage to tissue, and efficiency of movements. These results indicate early automation of basic laparoscopic skill. Careful selection of the cognitive abilities tests is advised for use in training programs and to identify individuals who need more training.
Collapse
Affiliation(s)
- Marleen Groenier
- Department of Technical Medicine, University of Twente, Enschede, The Netherlands.
| | - Klaas H Groenier
- Department of General Practice, University of Groningen, University Medical Centre Groningen, Groningen, The Netherlands
| | - Heleen A T Miedema
- Department of Technical Medicine, University of Twente, Enschede, The Netherlands
| | - Ivo A M J Broeders
- Department of Technical Medicine, University of Twente, Enschede, The Netherlands; Department of Surgery, Meander Medical Centre, Amersfoort, The Netherlands
| |
Collapse
|
19
|
Norman G. Simulation comes of age. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2014; 19:143-146. [PMID: 24722737 DOI: 10.1007/s10459-014-9507-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
|