1
|
Ravichandran R, Patton JL, Park H. Electrotactile proprioception training improves finger control accuracy and potential mechanism is proprioceptive recalibration. Sci Rep 2024; 14:26568. [PMID: 39496827 PMCID: PMC11535408 DOI: 10.1038/s41598-024-78063-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2024] [Accepted: 10/28/2024] [Indexed: 11/06/2024] Open
Abstract
This study presents a novel training technique, visual + electrotactile proprioception training (visual + EP training), which provides additional proprioceptive information via tactile channel during motor training to enhance the training effectiveness. In this study, electrotactile proprioception delivers finger aperture distance information in real-time, by mapping frequency of electrical stimulation to finger aperture distance. To test the effect of visual + EP training, twenty-four healthy subjects participated in the experiment of matching finger aperture distance with distance displayed on screen. Subjects were divided to three groups: the first group received visual training and the other two groups received visual + EP training with or without a post-training test with electrotactile proprioception. Finger aperture control error was measured before and after the training (baseline, 15-min post, 24-h post). Experimental data suggest that both training methods decreased finger aperture control error at 15-min post-training. However, at 24-h post-training, the training effect was fully retained only for the subjects who received visual + EP training, while it washed out for the subjects with visual training. Distribution analyses based on Bayesian inference suggest that the most likely mechanism of this long-term retention is proprioceptive recalibration. Such applications of artificially administered sense have the potential to improve motor control accuracy in a variety of applications.
Collapse
Affiliation(s)
- Rachen Ravichandran
- Electrical and Computer Engineering, Texas A&M University, College Station, TX, 77843, USA
| | - James L Patton
- Richard and Loan Hill Department of Biomedical Engineering, University of Illinois Chicago, Chicago, IL, 60607, USA
| | - Hangue Park
- Electrical and Computer Engineering, Texas A&M University, College Station, TX, 77843, USA.
- Department of Biomedical Engineering, Sungkyunkwan University, Suwon, South Korea.
- Department of Intelligent Precision Healthcare Convergence, Sungkyunkwan University, Suwon, South Korea.
- Department of MetaBioHealth, Sungkyunkwan University, Suwon, South Korea.
| |
Collapse
|
2
|
Bakhaidar M, Alsayegh A, Yilmaz R, Fazlollahi AM, Ledwos N, Mirchi N, Winkler-Schwartz A, Luo L, Del Maestro RF. Performance in a Simulated Virtual Reality Anterior Cervical Discectomy and Fusion Task: Disc Residual, Rate of Removal, and Efficiency Analyses. Oper Neurosurg (Hagerstown) 2023; 25:e196-e205. [PMID: 37441799 DOI: 10.1227/ons.0000000000000813] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Accepted: 05/05/2023] [Indexed: 07/15/2023] Open
Abstract
BACKGROUND AND OBJECTIVES Anterior cervical discectomy and fusion (ACDF) is among the most common spine procedures. The Sim-Ortho virtual reality simulator platform contains a validated ACDF simulated task for performance assessment. This study aims to develop a methodology to extract three-dimensional data and reconstruct and quantitate specific simulated disc tissues to generate novel metrics to analyze performance metrics of skilled and less skilled participants. METHODS We used open-source platforms to develop a methodology to extract three-dimensional information from ACDF simulation data. Metrics generated included, efficiency index, disc volumes removed from defined regions, and rate of tissue removal from superficial, central, and deep disc regions. A pilot study was performed to assess the utility of this methodology to assess expertise during the ACDF simulated procedure. RESULTS The system outlined, extracts data allowing the development of a methodology which accurately reconstructs and quantitates 3-dimensional disc volumes. In the pilot study, data sets from 27 participants, divided into postresident, resident, and medical student groups, allowed assessment of multiple novel metrics, including efficiency index (surgical time spent in actively removing disc), where the postresident group spent 61.8% of their time compared with 53% and 30.2% for the resident and medical student groups, respectively ( P = .01). During the annulotomy component, the postresident group removed 47.4% more disc than the resident groups and 102% more than the medical student groups ( P = .03). CONCLUSION The methodology developed in this study generates novel surgical procedural metrics from 3-dimensional data generated by virtual reality simulators and can be used to assess surgical performance.
Collapse
Affiliation(s)
- Mohamad Bakhaidar
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Ahmad Alsayegh
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Recai Yilmaz
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Ali M Fazlollahi
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Nicole Ledwos
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Nykan Mirchi
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Alexander Winkler-Schwartz
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| | - Lucy Luo
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Orthopedic Surgery, McGill University Health Centre, Montreal, Quebec, Canada
| | - Rolando F Del Maestro
- Department of Neurology and Neurosurgery, Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Hospital and Institute, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
3
|
Ng PY, Bing EG, Cuevas A, Aggarwal A, Chi B, Sundar S, Mwanahamuntu M, Mutebi M, Sullivan R, Parham GP. Virtual reality and surgical oncology. Ecancermedicalscience 2023; 17:1525. [PMID: 37113716 PMCID: PMC10129400 DOI: 10.3332/ecancer.2023.1525] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Indexed: 04/29/2023] Open
Abstract
More than 80% of people diagnosed with cancer will require surgery. However, less than 5% have access to safe, affordable and timely surgery in low- and middle-income countries (LMICs) settings mostly due to the lack of trained workforce. Since its creation, virtual reality (VR) has been heralded as a viable adjunct to surgical training, but its adoption in surgical oncology to date is poorly understood. We undertook a systematic review to determine the application of VR across different surgical specialties, modalities and cancer pathway globally between January 2011 and 2021. We reviewed their characteristics and respective methods of validation of 24 articles. The results revealed gaps in application and accessibility of VR with a proclivity for high-income countries and high-risk, complex oncological surgeries. There is a lack of standardisation of clinical evaluation of VR, both in terms of clinical trials and implementation science. While all VR illustrated face and content validity, only around two-third exhibited construct validity and predictive validity was lacking overall. In conclusion, the asynchrony between VR development and actual global cancer surgery demand means the technology is not effectively, efficiently and equitably utilised to realise its surgical capacity-building potential. Future research should prioritise cost-effective VR technologies with predictive validity for high demand, open cancer surgeries required in LMICs.
Collapse
Affiliation(s)
- Peng Yun Ng
- King’s College London, London WC2R 2LS, UK
- Guy’s and St Thomas’ Trust, London SE1 9R, UK
| | - Eric G Bing
- Institute for Leadership Impact, Southern Methodist University, Dallas, TX 75205, USA
| | - Anthony Cuevas
- Department of Teaching and Learning, Technology-Enhanced Immersive Learning Cluster, Annette Simmons School of Education and Human Development, Southern Methodist University, Dallas, TX 75205, USA
| | - Ajay Aggarwal
- King’s College London, London WC2R 2LS, UK
- Guy’s and St Thomas’ Trust, London SE1 9R, UK
- London School of Hygiene and Tropical Medicine, London WC1E 7HT, UK
| | - Benjamin Chi
- Icahn School of Medicine, New York, NY 10029-6574, USA
| | - Sudha Sundar
- Institute of Cancer and Genomic Sciences, University of Birmingham, Birmingham B152TT, UK
- Pan Birmingham Gynaecological Cancer Centre, City Hospital, Birmingham, B187QH, UK
| | | | - Miriam Mutebi
- Department of Surgery, Aga Khan University Hospital, Nairobi 30270-00100, Kenya
| | - Richard Sullivan
- Conflict & Health Research Group, King’s College London, London WC2R 2LS, UK
| | - Groesbeck P Parham
- Department of Surgery, Aga Khan University Hospital, Nairobi 30270-00100, Kenya
| |
Collapse
|
4
|
Ledwos N, Mirchi N, Yilmaz R, Winkler-Schwartz A, Sawni A, Fazlollahi AM, Bissonnette V, Bajunaid K, Sabbagh AJ, Del Maestro RF. Assessment of learning curves on a simulated neurosurgical task using metrics selected by artificial intelligence. J Neurosurg 2022; 137:1160-1171. [PMID: 35120309 DOI: 10.3171/2021.12.jns211563] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Accepted: 12/09/2021] [Indexed: 01/10/2023]
Abstract
OBJECTIVE Understanding the variation of learning curves of experts and trainees for a given surgical procedure is important in implementing formative learning paradigms to accelerate mastery. The study objectives were to use artificial intelligence (AI)-derived metrics to determine the learning curves of participants in 4 groups with different expertise levels who performed a series of identical virtual reality (VR) subpial resection tasks and to identify learning curve differences among the 4 groups. METHODS A total of 50 individuals participated, 14 neurosurgeons, 4 neurosurgical fellows and 10 senior residents (seniors), 10 junior residents (juniors), and 12 medical students. All participants performed 5 repetitions of a subpial tumor resection on the NeuroVR (CAE Healthcare) platform, and 6 a priori-derived metrics selected using the K-nearest neighbors machine learning algorithm were used to assess participant learning curves. Group learning curves were plotted over the 5 trials for each metric. A mixed, repeated-measures ANOVA was performed between the first and fifth trial. For significant interactions (p < 0.05), post hoc Tukey's HSD analysis was conducted to determine the location of the significance. RESULTS Overall, 5 of the 6 metrics assessed had a significant interaction (p < 0.05). The 4 groups, neurosurgeons, seniors, juniors, and medical students, showed an improvement between the first and fifth trial on at least one of the 6 metrics evaluated. CONCLUSIONS Learning curves generated using AI-derived metrics provided novel insights into technical skill acquisition, based on expertise level, during repeated VR-simulated subpial tumor resections, which will allow educators to develop more focused formative educational paradigms for neurosurgical trainees.
Collapse
Affiliation(s)
- Nicole Ledwos
- 1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University
| | - Nykan Mirchi
- 1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University
| | - Recai Yilmaz
- 1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University
| | - Alexander Winkler-Schwartz
- 1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University
- 3Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Anika Sawni
- 1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University
| | - Ali M Fazlollahi
- 1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University
| | - Vincent Bissonnette
- 1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University
- 2Division of Orthopaedic Surgery, Montreal General Hospital, McGill University
| | - Khalid Bajunaid
- 6Department of Surgery, College of Medicine, University of Jeddah, Jeddah, Saudi Arabia
| | - Abdulrahman J Sabbagh
- 4Division of Neurosurgery, Department of Surgery, College of Medicine, King Abdulaziz University
- 5Clinical Skills and Simulation Center, King Abdulaziz University; and
| | - Rolando F Del Maestro
- 1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute and Hospital, McGill University
- 3Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
5
|
Reich A, Mirchi N, Yilmaz R, Ledwos N, Bissonnette V, Tran DH, Winkler-Schwartz A, Karlik B, Del Maestro RF. Artificial Neural Network Approach to Competency-Based Training Using a Virtual Reality Neurosurgical Simulation. Oper Neurosurg (Hagerstown) 2022; 23:31-39. [PMID: 35726927 DOI: 10.1227/ons.0000000000000173] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Accepted: 11/08/2021] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND The methodology of assessment and training of surgical skills is evolving to deal with the emergence of competency-based training. Artificial neural networks (ANNs), a branch of artificial intelligence, can use newly generated metrics not only for assessment performance but also to quantitate individual metric importance and provide new insights into surgical expertise. OBJECTIVE To outline the educational utility of using an ANN in the assessment and quantitation of surgical expertise. A virtual reality vertebral osteophyte removal during a simulated surgical spine procedure is used as a model to outline this methodology. METHODS Twenty-one participants performed a simulated anterior cervical diskectomy and fusion on the Sim-Ortho virtual reality simulator. Participants were divided into 3 groups, including 9 postresidents, 5 senior residents, and 7 junior residents. Data were retrieved from the osteophyte removal component of the scenario, which involved using a simulated burr. The data were manipulated to initially generate 83 performance metrics spanning 3 categories (safety, efficiency, and motion) of which only the most relevant metrics were used to train and test the ANN. RESULTS The ANN model was trained on 6 safety metrics to a testing accuracy of 83.3%. The contributions of these performance metrics to expertise were revealed through connection weight products and outlined 2 identifiable learning patterns of technical skills. CONCLUSION This study outlines the potential utility of ANNs which allows a deeper understanding of the composites of surgical expertise and may contribute to the paradigm shift toward competency-based surgical training.
Collapse
Affiliation(s)
- Aiden Reich
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | | | | | | | | | | | | | | | | |
Collapse
|
6
|
Yilmaz R, Ledwos N, Sawaya R, Winkler-Schwartz A, Mirchi N, Bissonnette V, Fazlollahi AM, Bakhaidar M, Alsayegh A, Sabbagh AJ, Bajunaid K, Del Maestro R. Nondominant Hand Skills Spatial and Psychomotor Analysis During a Complex Virtual Reality Neurosurgical Task-A Case Series Study. Oper Neurosurg (Hagerstown) 2022; 23:22-30. [PMID: 35726926 DOI: 10.1227/ons.0000000000000232] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2021] [Accepted: 02/09/2022] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Virtual reality surgical simulators provide detailed psychomotor performance data, allowing qualitative and quantitative assessment of hand function. The nondominant hand plays an essential role in neurosurgery in exposing the operative area, assisting the dominant hand to optimize task execution, and hemostasis. Outlining expert-level nondominant hand skills may be critical to understand surgical expertise and aid learner training. OBJECTIVE To (1) provide validity for the simulated bimanual subpial tumor resection task and (2) to use this simulation in qualitative and quantitative evaluation of nondominant hand skills for bipolar forceps utilization. METHODS In this case series study, 45 right-handed participants performed a simulated subpial tumor resection using simulated bipolar forceps in the nondominant hand for assisting the surgery and hemostasis. A 10-item questionnaire was used to assess task validity. The nondominant hand skills across 4 expertise levels (neurosurgeons, senior trainees, junior trainees, and medical students) were analyzed by 2 visual models and performance metrics. RESULTS Neurosurgeon median (range) overall satisfaction with the simulated scenario was 4.0/5.0 (2.0-5.0). The visual models demonstrated a decrease in high force application areas on pial surface with increased expertise level. Bipolar-pia mater interactions were more focused around the tumoral region for neurosurgeons and senior trainees. These groups spent more time using the bipolar while interacting with pia. All groups spent significantly higher time in the left upper pial quadrant than other quadrants. CONCLUSION This work introduces new approaches for the evaluation of nondominant hand skills which may help surgical trainees by providing both qualitative and quantitative feedback.
Collapse
Affiliation(s)
- Recai Yilmaz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Nicole Ledwos
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Robin Sawaya
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Alexander Winkler-Schwartz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| | - Nykan Mirchi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Vincent Bissonnette
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
- Division of Orthopaedic Surgery, Montreal General Hospital, McGill University, Montreal, Quebec, Canada
| | - Ali M Fazlollahi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| | - Mohamad Bakhaidar
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Ahmad Alsayegh
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Abdulrahman J Sabbagh
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
- Clinical Skills and Simulation Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Khalid Bajunaid
- Department of Surgery, Faculty of Medicine, University of Jeddah, Jeddah, Saudi Arabia
| | - Rolando Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
7
|
Yilmaz R, Winkler-Schwartz A, Mirchi N, Reich A, Christie S, Tran DH, Ledwos N, Fazlollahi AM, Santaguida C, Sabbagh AJ, Bajunaid K, Del Maestro R. Continuous monitoring of surgical bimanual expertise using deep neural networks in virtual reality simulation. NPJ Digit Med 2022; 5:54. [PMID: 35473961 PMCID: PMC9042967 DOI: 10.1038/s41746-022-00596-8] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Accepted: 03/29/2022] [Indexed: 11/22/2022] Open
Abstract
In procedural-based medicine, the technical ability can be a critical determinant of patient outcomes. Psychomotor performance occurs in real-time, hence a continuous assessment is necessary to provide action-oriented feedback and error avoidance guidance. We outline a deep learning application, the Intelligent Continuous Expertise Monitoring System (ICEMS), to assess surgical bimanual performance at 0.2-s intervals. A long-short term memory network was built using neurosurgeon and student performance in 156 virtually simulated tumor resection tasks. Algorithm predictive ability was tested separately on 144 procedures by scoring the performance of neurosurgical trainees who are at different training stages. The ICEMS successfully differentiated between neurosurgeons, senior trainees, junior trainees, and students. Trainee average performance score correlated with the year of training in neurosurgery. Furthermore, coaching and risk assessment for critical metrics were demonstrated. This work presents a comprehensive technical skill monitoring system with predictive validation throughout surgical residency training, with the ability to detect errors.
Collapse
Affiliation(s)
- Recai Yilmaz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada.
| | - Alexander Winkler-Schwartz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Institute and hospital, McGill University, Montreal, Quebec, Canada
| | - Nykan Mirchi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Aiden Reich
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Sommer Christie
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Dan Huy Tran
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Nicole Ledwos
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Ali M Fazlollahi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Carlo Santaguida
- Department of Neurology and Neurosurgery, Montreal Neurological Institute and hospital, McGill University, Montreal, Quebec, Canada
| | - Abdulrahman J Sabbagh
- Division of Neurosurgery, Department of Surgery, College of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
- Clinical Skills and Simulation Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Khalid Bajunaid
- Department of Surgery, Faculty of Medicine, University of Jeddah, Jeddah, Saudi Arabia
| | - Rolando Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
- Department of Neurology and Neurosurgery, Montreal Neurological Institute and hospital, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
8
|
Virtual Reality Simulator Enhances Ergonomics Skills for Neurosurgeons. INT J SEMANT WEB INF 2022. [DOI: 10.4018/ijswis.297041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This paper aims to assess the needs of neurosurgical training in order to strategize the future plans for simulation and rehearsal. The project main objective is to investigate the ability virtual reality to enhance the training.An online questionnaire has been conducted among surgeons practicing in different countries across the globe. The study shows significant differences in rehearsal methods and surgical teaching methods practiced by the respondents. Among respondents, 90% did believe that virtual reality technology can serve surgical training, and almost all respondents agreed that there is a gap in the existing neurosurgical training in terms of operating room ergonomics. Adequate education on surgical ergonomics might lead to an improvement in the outcomes for both surgeon and patient. The contribution of the paper is two fold. From one side investigates the new requirements for the enhancement of Neurosurgenos’ training and adoption on Virtual Reality Simulator. From the other side contributes to the body of knowledge related to the required Ergonomics skills.
Collapse
|
9
|
Alkadri S, Ledwos N, Mirchi N, Reich A, Yilmaz R, Driscoll M, Del Maestro RF. Utilizing a multilayer perceptron artificial neural network to assess a virtual reality surgical procedure. Comput Biol Med 2021; 136:104770. [PMID: 34426170 DOI: 10.1016/j.compbiomed.2021.104770] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 08/12/2021] [Accepted: 08/13/2021] [Indexed: 11/18/2022]
Abstract
BACKGROUND Virtual reality surgical simulators are a safe and efficient technology for the assessment and training of surgical skills. Simulators allow trainees to improve specific surgical techniques in risk-free environments. Recently, machine learning has been coupled to simulators to classify performance. However, most studies fail to extract meaningful observations behind the classifications and the impact of specific surgical metrics on the performance. One benefit from integrating machine learning algorithms, such as Artificial Neural Networks, to simulators is the ability to extract novel insights into the composites of the surgical performance that differentiate levels of expertise. OBJECTIVE This study aims to demonstrate the benefits of artificial neural network algorithms in assessing and analyzing virtual surgical performances. This study applies the algorithm on a virtual reality simulated annulus incision task during an anterior cervical discectomy and fusion scenario. DESIGN An artificial neural network algorithm was developed and integrated. Participants performed the simulated surgical procedure on the Sim-Ortho simulator. Data extracted from the annulus incision task were extracted to generate 157 surgical performance metrics that spanned three categories (motion, safety, and efficiency). SETTING Musculoskeletal Biomechanics Research Lab; Neurosurgical Simulation and Artificial Intelligence Learning Center, McGill University, Montreal, Canada. PARTICIPANTS Twenty-three participants were recruited and divided into 3 groups: 11 post-residents, 5 senior and 7 junior residents. RESULTS An artificial neural network model was trained on nine selected surgical metrics, spanning all three categories and achieved 80% testing accuracy. CONCLUSIONS This study outlines the benefits of integrating artificial neural networks to virtual reality surgical simulators in understanding composites of expertise performance.
Collapse
Affiliation(s)
- Sami Alkadri
- Musculoskeletal Biomechanics Research Lab, Department of Mechanical Engineering, McGill University, Macdonald Engineering Building, 815 Sherbrooke St W, Montreal, H3A 2K7, QC, Canada
| | - Nicole Ledwos
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Nykan Mirchi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Aiden Reich
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Recai Yilmaz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| | - Mark Driscoll
- Musculoskeletal Biomechanics Research Lab, Department of Mechanical Engineering, McGill University, Macdonald Engineering Building, 815 Sherbrooke St W, Montreal, H3A 2K7, QC, Canada.
| | - Rolando F Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University Street, Room E2.89, H3A 2B4, Montreal, Quebec, Canada
| |
Collapse
|
10
|
Chan J, Pangal DJ, Cardinal T, Kugener G, Zhu Y, Roshannai A, Markarian N, Sinha A, Anandkumar A, Hung A, Zada G, Donoho DA. A systematic review of virtual reality for the assessment of technical skills in neurosurgery. Neurosurg Focus 2021; 51:E15. [PMID: 34333472 DOI: 10.3171/2021.5.focus21210] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Accepted: 05/19/2021] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Virtual reality (VR) and augmented reality (AR) systems are increasingly available to neurosurgeons. These systems may provide opportunities for technical rehearsal and assessments of surgeon performance. The assessment of neurosurgeon skill in VR and AR environments and the validity of VR and AR feedback has not been systematically reviewed. METHODS A systematic review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines was conducted through MEDLINE and PubMed. Studies published in English between January 1990 and February 2021 describing the use of VR or AR to quantify surgical technical performance of neurosurgeons without the use of human raters were included. The types and categories of automated performance metrics (APMs) from each of these studies were recorded. RESULTS Thirty-three VR studies were included in the review; no AR studies met inclusion criteria. VR APMs were categorized as either distance to target, force, kinematics, time, blood loss, or volume of resection. Distance and time were the most well-studied APM domains, although all domains were effective at differentiating surgeon experience levels. Distance was successfully used to track improvements with practice. Examining volume of resection demonstrated that attending surgeons removed less simulated tumor but preserved more normal tissue than trainees. More recently, APMs have been used in machine learning algorithms to predict level of training with a high degree of accuracy. Key limitations to enhanced-reality systems include limited AR usage for automated surgical assessment and lack of external and longitudinal validation of VR systems. CONCLUSIONS VR has been used to assess surgeon performance across a wide spectrum of domains. The VR environment can be used to quantify surgeon performance, assess surgeon proficiency, and track training progression. AR systems have not yet been used to provide metrics for surgeon performance assessment despite potential for intraoperative integration. VR-based APMs may be especially useful for metrics that are difficult to assess intraoperatively, including blood loss and extent of resection.
Collapse
Affiliation(s)
- Justin Chan
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Dhiraj J Pangal
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Tyler Cardinal
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Guillaume Kugener
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Yichao Zhu
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Arman Roshannai
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Nicholas Markarian
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Aditya Sinha
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Anima Anandkumar
- 2Computing + Mathematical Sciences, California Institute of Technology, Pasadena, California
| | - Andrew Hung
- 3USC Department of Urology, Keck School of Medicine of the University of Southern California, Los Angeles, California; and
| | - Gabriel Zada
- 1USC Department of Neurosurgery, Keck School of Medicine of the University of Southern California, Los Angeles, California
| | - Daniel A Donoho
- 4Texas Children's Hospital, Baylor College of Medicine, Houston, Texas
| |
Collapse
|
11
|
Golahmadi AK, Khan DZ, Mylonas GP, Marcus HJ. Tool-tissue forces in surgery: A systematic review. Ann Med Surg (Lond) 2021; 65:102268. [PMID: 33898035 PMCID: PMC8058906 DOI: 10.1016/j.amsu.2021.102268] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Accepted: 03/26/2021] [Indexed: 11/30/2022] Open
Abstract
Background Excessive tool-tissue interaction forces often result in tissue damage and intraoperative complications, while insufficient forces prevent the completion of the task. This review sought to explore the tool-tissue interaction forces exerted by instruments during surgery across different specialities, tissues, manoeuvres and experience levels. Materials & methods A PRISMA-guided systematic review was carried out using Embase, Medline and Web of Science databases. Results Of 462 articles screened, 45 studies discussing surgical tool-tissue forces were included. The studies were categorized into 9 different specialities with the mean of average forces lowest for ophthalmology (0.04N) and highest for orthopaedic surgery (210N). Nervous tissue required the least amount of force to manipulate (mean of average: 0.4N), whilst connective tissue (including bone) required the most (mean of average: 45.8). For manoeuvres, drilling recorded the highest forces (mean of average: 14N), whilst sharp dissection recorded the lowest (mean of average: 0.03N). When comparing differences in the mean of average forces between groups, novices exerted 22.7% more force than experts, and presence of a feedback mechanism (e.g. audio) reduced exerted forces by 47.9%. Conclusions The measurement of tool-tissue forces is a novel but rapidly expanding field. The range of forces applied varies according to surgical speciality, tissue, manoeuvre, operator experience and feedback provided. Knowledge of the safe range of surgical forces will improve surgical safety whilst maintaining effectiveness. Measuring forces during surgery may provide an objective metric for training and assessment. Development of smart instruments, robotics and integrated feedback systems will facilitate this. This review explores tool-tissue forces during surgery, a new and expanding field. Forces were lowest in ophthalmology (0.04N) and highest in orthopaedics (210N). Forces were lowest during sharp dissection (0.03N) and highest when drilling (14N). Being an expert (vs. novice) and having feedback mechanisms (e.g. haptic) reduced exerted forces. Development of force metrics will facilitate training, assessment & novel technology.
Collapse
Affiliation(s)
- Aida Kafai Golahmadi
- Imperial College London School of Medicine, London, United Kingdom.,HARMS Laboratory, The Hamlyn Centre, Department of Surgery & Cancer, Imperial College London, London, United Kingdom
| | - Danyal Z Khan
- National Hospital for Neurology and Neurosurgery, London, United Kingdom.,Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, United Kingdom
| | - George P Mylonas
- HARMS Laboratory, The Hamlyn Centre, Department of Surgery & Cancer, Imperial College London, London, United Kingdom
| | - Hani J Marcus
- National Hospital for Neurology and Neurosurgery, London, United Kingdom.,Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, United Kingdom
| |
Collapse
|
12
|
Three-Dimensional Modeling of Complex Pediatric Intracranial Aneurysmal Malformations With a Virtual Reality System. Simul Healthc 2020; 16:295-300. [PMID: 32890320 DOI: 10.1097/sih.0000000000000498] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
INTRODUCTION Surgical simulation is valuable in neurovascular surgery given the progressive rarity of these cases and their technical complexity, but its use has not been well described for pediatric vascular pathologies. We herein review the use of surgical simulation at our institution for complex pediatric aneurysmal malformations. METHODS A retrospective review of patients treated for middle cerebral artery aneurysmal malformations with surgical simulation assistance (SuRgical Planner [SRP]; Surgical Theater, Mayfield Village, OH) during a 2-year period at Rady Children's Hospital of San Diego was performed. RESULTS In 5 pediatric patients with complex MCA aneurysmal malformations (mean age = 33.2 ± 49.9 months), preoperative 3-dimensional (3D) interactive modeling informed treatment planning and enhanced surgeon understanding of the vascular pathology. Availability of intraoperative simulation also aided real-time anatomical understanding during surgery. Specific benefits of simulation for these cases included characterization of involved perforating vessels, as well as an enhanced understanding of flow patterns within associated complex arteriovenous fistulas and feeding vessel/daughter branch anatomy. Despite the complexity of the lesions treated, use of simulation qualitatively enhanced surgeon confidence. There were no perioperative complications for patients treated with open surgery. CONCLUSIONS Surgical simulation may aid in the treatment of complex pediatric aneurysmal malformations.
Collapse
|
13
|
Siyar S, Azarnoush H, Rashidi S, Del Maestro RF. Tremor Assessment during Virtual Reality Brain Tumor Resection. JOURNAL OF SURGICAL EDUCATION 2020; 77:643-651. [PMID: 31822389 DOI: 10.1016/j.jsurg.2019.11.011] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2019] [Revised: 11/25/2019] [Accepted: 11/26/2019] [Indexed: 06/10/2023]
Abstract
OBJECTIVE Assessment of physiological tremor during neurosurgical procedures may provide further insights into the composites of surgical expertise. Virtual reality platforms may provide a mechanism for the quantitative assessment of physiological tremor. In this study, a virtual reality simulator providing haptic feedback was used to study physiological tremor in a simulated tumor resection task with participants from a "skilled" group and a "novice" group. DESIGN The task involved using a virtual ultrasonic aspirator to remove a series of virtual brain tumors with different visual and tactile characteristics without causing injury to surrounding tissue. Power spectral density analysis was employed to quantitate hand tremor during tumor resection. Statistical t test was used to determine tremor differences between the skilled and novice groups obtained from the instrument tip x, y, z coordinates, the instrument roll, pitch, yaw angles, and the instrument haptic force applied during tumor resection. SETTING The study was conducted at the Neurosurgical Simulation and Artificial Intelligence Learning Centre, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada. PARTICIPANTS The skilled group comprised 23 neurosurgeons and senior residents and the novice group comprised 92 junior residents and medical students. RESULTS The spectral analysis allowed quantitation of physiological tremor during virtual reality tumor resection. The skilled group displayed smaller physiological tremor than the novice group in all cases. In 3 out of 7 cases the difference was statistically significant. CONCLUSIONS The first investigation of the application of a virtual reality platform is presented for the quantitation of physiological tremor during a virtual reality tumor resection task. The goal of introducing such methodology to assess tremor is to highlight its potential educational application in neurosurgical resident training and in helping to further define the psychomotor skill set of surgeons.
Collapse
Affiliation(s)
- Samaneh Siyar
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran; Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
| | - Hamed Azarnoush
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran; Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada.
| | - Saeid Rashidi
- Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Rolando F Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
| |
Collapse
|
14
|
Siyar S, Azarnoush H, Rashidi S, Winkler-Schwartz A, Bissonnette V, Ponnudurai N, Del Maestro RF. Machine learning distinguishes neurosurgical skill levels in a virtual reality tumor resection task. Med Biol Eng Comput 2020; 58:1357-1367. [DOI: 10.1007/s11517-020-02155-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2019] [Accepted: 03/12/2020] [Indexed: 10/24/2022]
|
15
|
The Virtual Operative Assistant: An explainable artificial intelligence tool for simulation-based training in surgery and medicine. PLoS One 2020; 15:e0229596. [PMID: 32106247 PMCID: PMC7046231 DOI: 10.1371/journal.pone.0229596] [Citation(s) in RCA: 88] [Impact Index Per Article: 17.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2019] [Accepted: 02/10/2020] [Indexed: 01/16/2023] Open
Abstract
Simulation-based training is increasingly being used for assessment and training of psychomotor skills involved in medicine. The application of artificial intelligence and machine learning technologies has provided new methodologies to utilize large amounts of data for educational purposes. A significant criticism of the use of artificial intelligence in education has been a lack of transparency in the algorithms' decision-making processes. This study aims to 1) introduce a new framework using explainable artificial intelligence for simulation-based training in surgery, and 2) validate the framework by creating the Virtual Operative Assistant, an automated educational feedback platform. Twenty-eight skilled participants (14 staff neurosurgeons, 4 fellows, 10 PGY 4-6 residents) and 22 novice participants (10 PGY 1-3 residents, 12 medical students) took part in this study. Participants performed a virtual reality subpial brain tumor resection task on the NeuroVR simulator using a simulated ultrasonic aspirator and bipolar. Metrics of performance were developed, and leave-one-out cross validation was employed to train and validate a support vector machine in Matlab. The classifier was combined with a unique educational system to build the Virtual Operative Assistant which provides users with automated feedback on their metric performance with regards to expert proficiency performance benchmarks. The Virtual Operative Assistant successfully classified skilled and novice participants using 4 metrics with an accuracy, specificity and sensitivity of 92, 82 and 100%, respectively. A 2-step feedback system was developed to provide participants with an immediate visual representation of their standing related to expert proficiency performance benchmarks. The educational system outlined establishes a basis for the potential role of integrating artificial intelligence and virtual reality simulation into surgical educational teaching. The potential of linking expertise classification, objective feedback based on proficiency benchmarks, and instructor input creates a novel educational tool by integrating these three components into a formative educational paradigm.
Collapse
|
16
|
Mirchi N, Bissonnette V, Ledwos N, Winkler-Schwartz A, Yilmaz R, Karlik B, Del Maestro RF. Artificial Neural Networks to Assess Virtual Reality Anterior Cervical Discectomy Performance. Oper Neurosurg (Hagerstown) 2019; 19:65-75. [DOI: 10.1093/ons/opz359] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Accepted: 09/04/2019] [Indexed: 11/14/2022] Open
Abstract
Abstract
BACKGROUND
Virtual reality surgical simulators provide a safe environment for trainees to practice specific surgical scenarios and allow for self-guided learning. Artificial intelligence technology, including artificial neural networks, offers the potential to manipulate large datasets from simulators to gain insight into the importance of specific performance metrics during simulated operative tasks.
OBJECTIVE
To distinguish performance in a virtual reality-simulated anterior cervical discectomy scenario, uncover novel performance metrics, and gain insight into the relative importance of each metric using artificial neural networks.
METHODS
Twenty-one participants performed a simulated anterior cervical discectomy on the novel virtual reality Sim-Ortho simulator. Participants were divided into 3 groups, including 9 post-resident, 5 senior, and 7 junior participants. This study focused on the discectomy portion of the task. Data were recorded and manipulated to calculate metrics of performance for each participant. Neural networks were trained and tested and the relative importance of each metric was calculated.
RESULTS
A total of 369 metrics spanning 4 categories (safety, efficiency, motion, and cognition) were generated. An artificial neural network was trained on 16 selected metrics and tested, achieving a training accuracy of 100% and a testing accuracy of 83.3%. Network analysis identified safety metrics, including the number of contacts on spinal dura, as highly important.
CONCLUSION
Artificial neural networks classified 3 groups of participants based on expertise allowing insight into the relative importance of specific metrics of performance. This novel methodology aids in the understanding of which components of surgical performance predominantly contribute to expertise.
Collapse
Affiliation(s)
- Nykan Mirchi
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
| | - Vincent Bissonnette
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
- Division of Orthopaedic Surgery, Montreal General Hospital, McGill University, Montreal, Canada
| | - Nicole Ledwos
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
| | - Alexander Winkler-Schwartz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
| | - Recai Yilmaz
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
| | - Bekir Karlik
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
| | - Rolando F Del Maestro
- Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Canada
| |
Collapse
|
17
|
Sugiyama T, Lama S, Gan LS. Forces of Tool-Tissue Interaction to Assess Surgical Skill Level. JAMA Surg 2019; 153:234-242. [PMID: 29141073 DOI: 10.1001/jamasurg.2017.4516] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Affiliation(s)
- Taku Sugiyama
- Department of Clinical Neurosciences and the Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada,Department of Neurosurgery, Hokkaido University Graduate School of Medicine, Kita-ku, Sapporo, Japan
| | - Sanju Lama
- Department of Clinical Neurosciences and the Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada
| | - Liu Shi Gan
- Department of Clinical Neurosciences and the Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, Canada
| |
Collapse
|
18
|
Sawaya R, Alsideiri G, Bugdadi A, Winkler-Schwartz A, Azarnoush H, Bajunaid K, Sabbagh AJ, Del Maestro R. Development of a performance model for virtual reality tumor resections. J Neurosurg 2019; 131:192-200. [PMID: 30074456 DOI: 10.3171/2018.2.jns172327] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2017] [Accepted: 02/16/2018] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Previous work from the authors has shown that hand ergonomics plays an important role in surgical psychomotor performance during virtual reality brain tumor resections. In the current study they propose a hypothetical model that integrates the human and task factors at play during simulated brain tumor resections to better understand the hand ergonomics needed for optimal safety and efficiency. They hypothesize that 1) experts (neurosurgeons), compared to novices (residents and medical students), spend a greater proportion of their time in direct contact with critical tumor areas; 2) hand ergonomic conditions (most favorable to unfavorable) prompt participants to adapt in order to optimize tumor resection; and 3) hand ergonomic adaptation is acquired with increasing expertise. METHODS In an earlier study, experts (neurosurgeons) and novices (residents and medical students) were instructed to resect simulated brain tumors on the NeuroVR (formerly NeuroTouch) virtual reality neurosurgical simulation platform. For the present study, the simulated tumors were divided into four quadrants (Q1 to Q4) to assess hand ergonomics at various levels of difficulty. The spatial distribution of time expended, force applied, and tumor volume removed was analyzed for each participant group (total of 22 participants). RESULTS Neurosurgeons spent a significantly greater percentage of their time in direct contact with critical tumor areas. Under the favorable hand ergonomic conditions of Q1 and Q3, neurosurgeons and senior residents spent significantly more time in Q1 than in Q3. Although forces applied in these quadrants were similar, neurosurgeons, having spent more time in Q1, removed significantly more tumor in Q1 than in Q3. In a comparison of the most favorable (Q2) to unfavorable (Q4) hand ergonomic conditions, neurosurgeons adapted the forces applied in each quadrant to resect similar tumor volumes. Differences between Q2 and Q4 were emphasized in measures of force applied per second, tumor volume removed per second, and tumor volume removed per unit of force applied. In contrast, the hand ergonomics of medical students did not vary across quadrants, indicating the existence of an "adaptive capacity" in neurosurgeons. CONCLUSIONS The study results confirm the experts' (neurosurgeons) greater capacity to adapt their hand ergonomics during simulated neurosurgical tasks. The proposed hypothetical model integrates the study findings with various human and task factors that highlight the importance of learning in the acquisition of hand ergonomic adaptation.
Collapse
Affiliation(s)
- Robin Sawaya
- 1Neurosurgical Simulation Research and Training Centre, Department of Neurology & Neurosurgery, McGill University, Montreal, Quebec, Canada
| | - Ghusn Alsideiri
- 1Neurosurgical Simulation Research and Training Centre, Department of Neurology & Neurosurgery, McGill University, Montreal, Quebec, Canada
- 2Department of Surgery, College of Medicine, Sultan Qaboos University, Muscat, Oman
| | - Abdulgadir Bugdadi
- 1Neurosurgical Simulation Research and Training Centre, Department of Neurology & Neurosurgery, McGill University, Montreal, Quebec, Canada
- 3Department of Surgery, Faculty of Medicine, Umm Al-Qura University, Mecca, Saudi Arabia
| | - Alexander Winkler-Schwartz
- 1Neurosurgical Simulation Research and Training Centre, Department of Neurology & Neurosurgery, McGill University, Montreal, Quebec, Canada
| | - Hamed Azarnoush
- 4Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| | - Khalid Bajunaid
- 1Neurosurgical Simulation Research and Training Centre, Department of Neurology & Neurosurgery, McGill University, Montreal, Quebec, Canada
- 5Divison of Neurosurgery, Faculty of Medicine, University of Jeddah, Saudi Arabia
| | - Abdulrahman J Sabbagh
- 1Neurosurgical Simulation Research and Training Centre, Department of Neurology & Neurosurgery, McGill University, Montreal, Quebec, Canada
- 6Department of Neurosurgery, National Neuroscience Institute, King Fahad Medical City, Riyadh, Saudi Arabia; and
- 7Division of Neurosurgery, Department of Surgery, Faculty of Medicine and Clinical Skill and Simulation Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Rolando Del Maestro
- 1Neurosurgical Simulation Research and Training Centre, Department of Neurology & Neurosurgery, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
19
|
Lee C, Wong GKC. Virtual reality and augmented reality in the management of intracranial tumors: A review. J Clin Neurosci 2019; 62:14-20. [PMID: 30642663 DOI: 10.1016/j.jocn.2018.12.036] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Accepted: 12/22/2018] [Indexed: 01/19/2023]
Abstract
Neurosurgeons are faced with the challenge of planning, performing, and learning complex surgical procedures. With improvements in computational power and advances in visual and haptic display technologies, augmented and virtual surgical environments can offer potential benefits for tests in a safe and simulated setting, as well as improve management of real-life procedures. This systematic literature review is conducted in order to investigate the roles of such advanced computing technology in neurosurgery subspecialization of intracranial tumor removal. The study would focus on an in-depth discussion on the role of virtual reality and augmented reality in the management of intracranial tumors: the current status, foreseeable challenges, and future developments.
Collapse
Affiliation(s)
- Chester Lee
- Division of Neurosurgery, Department of Surgery, The Chinese University of Hong Kong, Hong Kong Special Administrative Region
| | - George Kwok Chu Wong
- Division of Neurosurgery, Department of Surgery, The Chinese University of Hong Kong, Hong Kong Special Administrative Region.
| |
Collapse
|
20
|
Bugdadi A, Sawaya R, Bajunaid K, Olwi D, Winkler-Schwartz A, Ledwos N, Marwa I, Alsideiri G, Sabbagh AJ, Alotaibi FE, Al-Zhrani G, Maestro RD. Is Virtual Reality Surgical Performance Influenced by Force Feedback Device Utilized? JOURNAL OF SURGICAL EDUCATION 2019; 76:262-273. [PMID: 30072262 DOI: 10.1016/j.jsurg.2018.06.012] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2018] [Revised: 05/19/2018] [Accepted: 06/19/2018] [Indexed: 06/08/2023]
Abstract
OBJECTIVE The study objectives were to assess if surgical performance and subjective assessment of a virtual reality simulator platform was influenced by changing force feedback devices. DESIGN Participants used the NeuroVR (formerly NeuroTouch) simulator to perform 5 practice scenarios and a realistic scenario involving subpial resection of a virtual reality brain tumor with simulated bleeding. The influence of force feedback was assessed by utilizing the Omni and Entact haptic systems. Tier 1, tier 2, and tier 2 advanced metrics were used to compare results. Operator subjective assessment of the haptic systems tested utilized seven Likert criteria (score 1 to 5). SETTING The study is carried out at the McGill Neurosurgical Simulation Research and Training Centre, Montreal Neurological Institute and Hospital, Montreal, Canada. PARTICIPANTS Six expert operators in the utilization of the NeuroVR simulator platform. RESULTS No significant differences in surgical performance were found between the two haptic devices. Participants significantly preferred the Entact system on all 7 Likert criteria of subjective assessment. CONCLUSIONS Our results show no statistical differences in virtual reality surgical performance utilizing the two bimanual haptic devices tested. Subjective assessments demonstrated that participants preferred the Entact system. Our results suggest that to maximize realism of the training experience educators employing virtual reality simulators may find it useful to assess expert opinion before choosing a force feedback device.
Collapse
Affiliation(s)
- Abdulgadir Bugdadi
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada; Department of Surgery, Faculty of Medicine, Umm Al-Qura University, Makkah Almukarramah, Saudi Arabia.
| | - Robin Sawaya
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada
| | - Khalid Bajunaid
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada; Division of Neurosurgery, Faculty of Medicine, University of Jeddah, Jeddah, Saudi Arabia
| | - Duaa Olwi
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada; King Abdullah International Medical Research Center, Ministry of National Guard Health Affairs, Jeddah, Saudi Arabia
| | - Alexander Winkler-Schwartz
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada
| | - Nicole Ledwos
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada
| | - Ibrahim Marwa
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada
| | - Ghusn Alsideiri
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada; Department of Surgery, College of Medicine, Sultan Qaboos University, Muscat, Oman
| | - Abdulrahman Jafar Sabbagh
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada; Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia; Clinical Skill and Simulation Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Fahad E Alotaibi
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada; National Neuroscience Institute, Department of Neurosurgery, King Fahad Medical City, Riyadh, Saudi Arabia
| | - Gmaan Al-Zhrani
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada; National Neuroscience Institute, Department of Neurosurgery, King Fahad Medical City, Riyadh, Saudi Arabia
| | - Rolando Del Maestro
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery and Neurology, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
21
|
Gridding Microsurgical Anatomy of Far Lateral Approach in the Three-Dimensional Model. J Craniofac Surg 2018; 30:87-90. [PMID: 30394967 DOI: 10.1097/scs.0000000000004849] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022] Open
Abstract
OBJECTIVE The far lateral craniotomy involves osteotomy of various portions of occipital condyle. Intracranial operation exposing clivus encounters complicated neurovascular anatomy. The aim of the present study was to make refinement for the anatomy of far lateral approach by gridding route in the 3-dimensional model. METHODS Computed tomography and magnetic resonance imaging data were used to construct 3-dimensional model containing osseous and neurovascular structures of skull base. Then, far lateral approach was simulated by triangular prism and divided into gridding surgical route. The relationship of surgical route and osseous and neurovascular structures was observed. Measurement of volume was performed to evaluate surgical exposure. RESULTS Observation of 3-dimensional model showed bony drilling of far lateral approach started with the occipital condyle and passed through the lateral edge of foramen magnum. The cerebellum and medulla oblongata were exempted from the surgical route exposing clivus. The anatomy variances of operative space, osseous, and neurovascular structures in the gridding route were displayed clearly and compared objectively. CONCLUSION The gridding operative spaces for the far lateral approach are useful to disclose the detailed discrepancy in the different surgical region. The volumetric measurement provides quantified information to facilitate a better understanding of the anatomy variance.
Collapse
|
22
|
Sawaya R, Bugdadi A, Azarnoush H, Winkler-Schwartz A, Alotaibi FE, Bajunaid K, AlZhrani GA, Alsideiri G, Sabbagh AJ, Del Maestro RF. Virtual Reality Tumor Resection: The Force Pyramid Approach. Oper Neurosurg (Hagerstown) 2017; 14:686-696. [DOI: 10.1093/ons/opx189] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2017] [Accepted: 08/01/2017] [Indexed: 11/13/2022] Open
Abstract
Abstract
BACKGROUND
The force pyramid is a novel visual representation allowing spatial delineation of instrument force application during surgical procedures. In this study, the force pyramid concept is employed to create and quantify dominant hand, nondominant hand, and bimanual force pyramids during resection of virtual reality brain tumors.
OBJECTIVE
To address 4 questions: Do ergonomics and handedness influence force pyramid structure? What are the differences between dominant and nondominant force pyramids? What is the spatial distribution of forces applied in specific tumor quadrants? What differentiates “expert” and “novice” groups regarding their force pyramids?
METHODS
Using a simulated aspirator in the dominant hand and a simulated sucker in the nondominant hand, 6 neurosurgeons and 14 residents resected 8 different tumors using the CAE NeuroVR virtual reality neurosurgical simulation platform (CAE Healthcare, Montréal, Québec and the National Research Council Canada, Boucherville, Québec). Position and force data were used to create force pyramids and quantify tumor quadrant force distribution.
RESULTS
Force distribution quantification demonstrates the critical role that handedness and ergonomics play on psychomotor performance during simulated brain tumor resections. Neurosurgeons concentrate their dominant hand forces in a defined crescent in the lower right tumor quadrant. Nondominant force pyramids showed a central peak force application in all groups. Bimanual force pyramids outlined the combined impact of each hand. Distinct force pyramid patterns were seen when tumor stiffness, border complexity, and color were altered.
CONCLUSION
Force pyramids allow delineation of specific tumor regions requiring greater psychomotor ability to resect. This information can focus and improve resident technical skills training.
Collapse
Affiliation(s)
- Robin Sawaya
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
| | - Abdulgadir Bugdadi
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
- Department of Surgery, Faculty of Medicine, Umm Al-Qura University, Makkah Almukarramah, Saudi Arabia
| | - Hamed Azarnoush
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
- Department of Biomedical Engineering, Amirkabir University of Technology (Tehran Polytechnic), Tehran, Iran
| | - Alexander Winkler-Schwartz
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
| | - Fahad E Alotaibi
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
- Department of Neurosurgery, National Neuroscience Institute, King Fahad Medical City, Riyadh, Saudi Arabia
| | - Khalid Bajunaid
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
- Division of Neurosurgery, Faculty of Medicine, University of Jeddah, Saudi Arabia
| | - Gmaan A AlZhrani
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
- Department of Neurosurgery, National Neuroscience Institute, King Fahad Medical City, Riyadh, Saudi Arabia
| | - Ghusn Alsideiri
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
- Department of Surgery, College of Medicine, Sultan Qaboos University, Muscat, Oman
| | - Abdulrahman J Sabbagh
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
- Department of Neurosurgery, National Neuroscience Institute, King Fahad Medical City, Riyadh, Saudi Arabia
- Division of Neurosurgery, Department of Surgery, Faculty of Medicine and Clinical Skill and Simulation Center, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Rolando F Del Maestro
- Neurosurgical Simulation Research and Training Centre, Department of Neurosurgery, Montréal Neurological Institute and Hospital, McGill University, Montréal, Québec, Canada
| |
Collapse
|