1
|
Lim C, Obuseh M, Cha J, Steward J, Sundaram C, Yu D. Neural insights on expert surgeons' mental workload during live robotic surgeries. Sci Rep 2025; 15:12073. [PMID: 40200047 PMCID: PMC11978782 DOI: 10.1038/s41598-025-96064-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Accepted: 03/25/2025] [Indexed: 04/10/2025] Open
Abstract
Despite its adoption and benefits, robotic surgeries can impose additional mental workload on surgeons. Validated questionnaires mostly administered at the end of procedures may not accurately capture the dynamic nature of mental workload over an entire procedure. Hence, we sought to determine if electroencephalogram (EEG) based neural activities in different brain regions can measure variations in expert surgeons' mental workload intraoperatively. EEG data was collected from five different surgeons performing 13 robotic-assisted urological procedures. Data analysis focused on three surgery phases (before, critical, and after). After performing each phase, surgeons provided a rating of their perceived mental workload. A linear mixed effects model was applied to explore the impact of the study phases on the relative spectral band power of EEG signals. The relative theta band power in the frontal brain region was highest during the critical portions of the procedure (p < 0.05). As the subjective ratings increased, the relative frontal theta band power increased (p < 0.001) while the relative parietal alpha band power decreased across all phases. We show that EEG signals can distinguish intraoperative workload in robotic surgeries. This has several applications including predicting risk factors for increased case complexity and surgical education.
Collapse
Affiliation(s)
- Chiho Lim
- Edwardson School of Industrial Engineering, Purdue University, West Lafayette, USA
| | - Marian Obuseh
- Edwardson School of Industrial Engineering, Purdue University, West Lafayette, USA
| | - Jackie Cha
- Department of Industrial Engineering, Clemson University, Clemson, USA
| | | | | | - Denny Yu
- Edwardson School of Industrial Engineering, Purdue University, West Lafayette, USA.
- School of Medicine, Indiana University, Bloomington, USA.
| |
Collapse
|
2
|
Athanasiadis DI, Monfared S, Timsina L, Whiteside J, Banerjee A, Butler A, Stefanidis D. Evaluation of operating room inefficiencies and their impact on operating room duration using a surgical app. Am J Surg 2024; 235:115751. [PMID: 38679510 DOI: 10.1016/j.amjsurg.2024.04.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2024] [Revised: 03/09/2024] [Accepted: 04/23/2024] [Indexed: 05/01/2024]
Abstract
BACKGROUND Efficient utilization of the operating room (OR) is essential. Inefficiencies are thought to cause preventable delays. Our goal was to identify OR incidents causing delays and estimate their impact on the duration of various general surgery procedures. MATERIALS Three trained observers prospectively collected intraoperative data using the ExplORer Surgical app, a tool that helped capture incidents causing delays. The impact of each incident on case duration was assessed using multivariable analysis. RESULTS 151 general surgery procedures were observed. The mean number of incidents was 2.7 per each case that averaged 109min. On average, each incident caused a 2.8 min delay (p < 0.001), however, some incidents were associated with longer delays. The procedural step of each procedure most susceptible to incidents was also defined. CONCLUSION The identification of the type of incidents and the procedural step during which they occur may allow targeted interventions to optimize OR efficiency and decrease operative time.
Collapse
Affiliation(s)
| | - Sara Monfared
- Department of Surgery, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Lava Timsina
- Department of Surgery, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Jake Whiteside
- Indiana University School of Medicine, Indianapolis, IN, USA
| | - Ambar Banerjee
- Department of Surgery, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Annabelle Butler
- Department of Surgery, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Dimitrios Stefanidis
- Department of Surgery, Indiana University School of Medicine, Indianapolis, IN, USA.
| |
Collapse
|
3
|
Ali JT, Yang G, Green CA, Reed BL, Madani A, Ponsky TA, Hazey J, Rothenberg SS, Schlachta CM, Oleynikov D, Szoka N. Defining digital surgery: a SAGES white paper. Surg Endosc 2024; 38:475-487. [PMID: 38180541 DOI: 10.1007/s00464-023-10551-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Accepted: 10/17/2023] [Indexed: 01/06/2024]
Abstract
BACKGROUND Digital surgery is a new paradigm within the surgical innovation space that is rapidly advancing and encompasses multiple areas. METHODS This white paper from the SAGES Digital Surgery Working Group outlines the scope of digital surgery, defines key terms, and analyzes the challenges and opportunities surrounding this disruptive technology. RESULTS In its simplest form, digital surgery inserts a computer interface between surgeon and patient. We divide the digital surgery space into the following elements: advanced visualization, enhanced instrumentation, data capture, data analytics with artificial intelligence/machine learning, connectivity via telepresence, and robotic surgical platforms. We will define each area, describe specific terminology, review current advances as well as discuss limitations and opportunities for future growth. CONCLUSION Digital Surgery will continue to evolve and has great potential to bring value to all levels of the healthcare system. The surgical community has an essential role in understanding, developing, and guiding this emerging field.
Collapse
Affiliation(s)
- Jawad T Ali
- University of Texas at Austin, Austin, TX, USA
| | - Gene Yang
- University at Buffalo, Buffalo, NY, USA
| | | | | | - Amin Madani
- University of Toronto, Toronto, ON, Canada
- Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada
| | - Todd A Ponsky
- Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA
| | | | | | | | - Dmitry Oleynikov
- Monmouth Medical Center, Robert Wood Johnson Barnabas Health, Rutgers School of Medicine, Long Branch, NJ, USA
| | - Nova Szoka
- Department of Surgery, West Virginia University, Suite 7500 HSS, PO Box 9238, Morgantown, WV, 26506-9238, USA.
| |
Collapse
|
4
|
Cheikh Youssef S, Haram K, Noël J, Patel V, Porter J, Dasgupta P, Hachach-Haram N. Evolution of the digital operating room: the place of video technology in surgery. Langenbecks Arch Surg 2023; 408:95. [PMID: 36807211 PMCID: PMC9939374 DOI: 10.1007/s00423-023-02830-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Accepted: 02/06/2023] [Indexed: 02/23/2023]
Abstract
PURPOSE The aim of this review was to collate current evidence wherein digitalisation, through the incorporation of video technology and artificial intelligence (AI), is being applied to the practice of surgery. Applications are vast, and the literature investigating the utility of surgical video and its synergy with AI has steadily increased over the last 2 decades. This type of technology is widespread in other industries, such as autonomy in transportation and manufacturing. METHODS Articles were identified primarily using the PubMed and MEDLINE databases. The MeSH terms used were "surgical education", "surgical video", "video labelling", "surgery", "surgical workflow", "telementoring", "telemedicine", "machine learning", "deep learning" and "operating room". Given the breadth of the subject and the scarcity of high-level data in certain areas, a narrative synthesis was selected over a meta-analysis or systematic review to allow for a focussed discussion of the topic. RESULTS Three main themes were identified and analysed throughout this review, (1) the multifaceted utility of surgical video recording, (2) teleconferencing/telemedicine and (3) artificial intelligence in the operating room. CONCLUSIONS Evidence suggests the routine collection of intraoperative data will be beneficial in the advancement of surgery, by driving standardised, evidence-based surgical care and personalised training of future surgeons. However, many barriers stand in the way of widespread implementation, necessitating close collaboration between surgeons, data scientists, medicolegal personnel and hospital policy makers.
Collapse
Affiliation(s)
| | | | - Jonathan Noël
- Guy's and St. Thomas' NHS Foundation Trust, Urology Centre, King's Health Partners, London, UK
| | - Vipul Patel
- Adventhealth Global Robotics Institute, 400 Celebration Place, Celebration, FL, USA
| | - James Porter
- Department of Urology, Swedish Urology Group, Seattle, WA, USA
| | - Prokar Dasgupta
- Guy's and St. Thomas' NHS Foundation Trust, Urology Centre, King's Health Partners, London, UK
| | - Nadine Hachach-Haram
- Department of Plastic Surgery, Guy's and St. Thomas' NHS Foundation Trust, King's Health Partners, London, UK
| |
Collapse
|
5
|
Nedelcu M, Carandina S, Noel P, Mercoli HA, Danan M, Zulian V, Nedelcu A, Vilallonga R. The Utility of Video Recording in Assessing Bariatric Surgery Complications. J Clin Med 2022; 11:jcm11195573. [PMID: 36233435 PMCID: PMC9572461 DOI: 10.3390/jcm11195573] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Revised: 08/28/2022] [Accepted: 09/02/2022] [Indexed: 11/16/2022] Open
Abstract
Introduction: Recording every procedure could diminish the postoperative complication rates in bariatric surgery. The aim of our study was to evaluate the correlation between recording every bariatric surgery and their postoperative analysis in relation to the early or late postoperative complications. Methods: Seven hundred fifteen patients who underwent a bariatric procedure between January 2018 and December 2019 were included in a retrospective analysis. There were: 589 laparoscopic sleeve gastrectomies (LSGs); 110 Roux-en-Y bypasses (RYGBs) and 16 gastric bands (LAGBs). The video recording was systematically used, and all patients were enrolled in the IFSO registry. Results: There were 15 patients (2.1%) with surgical postoperative complications: 5 leaks, 8 hemorrhages and 2 stenosis. Most complications were consequent to LSG, except for two, which occurred after RYGB. In four cases a site of active bleeding was identified. After reviewing the video, in three cases the site was correlated with an event which occurred during the initial procedure. Three out of five cases of leak following sleeve were treated purely endoscopically, and no potential correlated mechanism was identified. Two other possible benefits were observed: a better evaluation of the gastric pouch for the treatment of the ulcer post bypass and the review of one per operative incident. Two negative diagnostic laparoscopies were performed. The benefit of the systematic video recording was singled out in eight cases. All the other cases were completed by laparoscopy with no conversion. Conclusion: To record every bariatric procedure could help in understanding the mechanism of certain complications, especially when the analysis is performed within the team. Still, recording the procedure did not prevent the negative diagnostic laparoscopy, but it could play a significant role for the medico-legal aspect in the future.
Collapse
Affiliation(s)
- Marius Nedelcu
- ELSAN, Clinique Saint Michel, Centre Chirurgical de l’Obesite, 83000 Toulon, France
- ELSAN, Clinique Bouchard, 13000 Marseille, France
- Correspondence: ; Tel.: +33-695950965
| | - Sergio Carandina
- ELSAN, Clinique Saint Michel, Centre Chirurgical de l’Obesite, 83000 Toulon, France
| | - Patrick Noel
- ELSAN, Clinique Bouchard, 13000 Marseille, France
- Emirates Specialty Hospital, Dubai 505240, United Arab Emirates
| | | | - Marc Danan
- ELSAN, Clinique Saint Michel, Centre Chirurgical de l’Obesite, 83000 Toulon, France
| | - Viola Zulian
- ELSAN, Clinique Saint Michel, Centre Chirurgical de l’Obesite, 83000 Toulon, France
| | - Anamaria Nedelcu
- ELSAN, Clinique Saint Michel, Centre Chirurgical de l’Obesite, 83000 Toulon, France
| | - Ramon Vilallonga
- ELSAN, Clinique Saint Michel, Centre Chirurgical de l’Obesite, 83000 Toulon, France
- Universitat Autònoma de Barcelona, 08028 Barcelona, Spain
- Endocrine, Metabolic and Bariatric Unit, General Surgery Department, Hospital Vall d’Hebron, 08023 Barcelona, Spain
| |
Collapse
|
6
|
Basiev K, Goldbraikh A, Pugh CM, Laufer S. Open surgery tool classification and hand utilization using a multi-camera system. Int J Comput Assist Radiol Surg 2022; 17:1497-1505. [PMID: 35759176 DOI: 10.1007/s11548-022-02691-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 05/26/2022] [Indexed: 11/30/2022]
Abstract
PURPOSE The goal of this work is to use multi-camera video to classify open surgery tools as well as identify which tool is held in each hand. Multi-camera systems help prevent occlusions in open surgery video data. Furthermore, combining multiple views such as a top-view camera covering the full operative field and a close-up camera focusing on hand motion and anatomy may provide a more comprehensive view of the surgical workflow. However, multi-camera data fusion poses a new challenge: A tool may be visible in one camera and not the other. Thus, we defined the global ground truth as the tools being used regardless their visibility. Therefore, tools that are out of the image should be remembered for extensive periods of time while the system responds quickly to changes visible in the video. METHODS Participants (n = 48) performed a simulated open bowel repair. A top-view and a close-up cameras were used. YOLOv5 was used for tool and hand detection. A high-frequency LSTM with a 1-second window at 30 frames per second (fps) and a low-frequency LSTM with a 40-second window at 3 fps were used for spatial, temporal, and multi-camera integration. RESULTS The accuracy and F1 of the six systems were: top-view (0.88/0.88), close-up (0.81,0.83), both cameras (0.9/0.9), high-fps LSTM (0.92/0.93), low-fps LSTM (0.9/0.91), and our final architecture the multi-camera classifier(0.93/0.94). CONCLUSION Since each camera in a multi-camera system may have a partial view of the procedure, we defined a 'global ground truth.' Defining this at the data labeling phase emphasized this requirement at the learning phase, eliminating the need for any heuristic decisions. By combining a system with a high fps and a low fps from the multiple camera array, we improved the classification abilities of the global ground truth.
Collapse
Affiliation(s)
- Kristina Basiev
- Faculty of Industrial Engineering and Management, Technion - Israel Institute of Technology, 3200003, Haifa, Israel.
| | - Adam Goldbraikh
- Applied Mathematics Department, Technion - Israel Institute of Technology, 3200003, Haifa, Israel
| | - Carla M Pugh
- Department of Surgery, Stanford University School of Medicine, Stanford, CA, 94305, USA
| | - Shlomi Laufer
- Faculty of Industrial Engineering and Management, Technion - Israel Institute of Technology, 3200003, Haifa, Israel
| |
Collapse
|