Intra-operative disruptions, surgeon's mental workload, and technical performance in a full-scale simulated procedure

An Integrated Electroencephalography and Eye-Tracking Analysis Using eXtreme Gradient Boosting for Mental Workload Evaluation in Surgery

ObjectiveWe aimed to develop advanced machine learning models using electroencephalogram (EEG) and eye-tracking data to predict the mental workload associated with engaging in various surgical tasks.BackgroundTraditional methods of evaluating mental workload often involve self-report scales, which are subject to individual biases. Due to the multidimensional nature of mental workload, there is a pressing need to identify factors that contribute to mental workload across different surgical tasks.MethodEEG and eye-tracking data from 26 participants performing Matchboard and Ring Walk tasks from the da Vinci simulator and the pattern cut and suturing tasks from the Fundamentals of Laparoscopic Surgery (FLS) program were used to develop an eXtreme Gradient Boosting (XGBoost) model for mental workload evaluation.ResultsThe developed XGBoost models demonstrated strong predictive performance with R2 values of 0.82, 0.81, 0.82, and 0.83 for the Matchboard, Ring Walk, pattern cut, and suturing tasks, respectively. Key features for predicting mental workload included task average pupil diameter, complexity level, average functional connectivity strength at the temporal lobe, and the total trajectory length of the nondominant eye's pupil. Integrating features from both EEG and eye-tracking data significantly enhanced the performance of mental workload evaluation models, as evidenced by repeated-measures t-tests yielding p-values less than 0.05. However, this enhancement was not observed in the Pattern Cut task (repeated-measures t-tests; p > 0.05).ConclusionThe findings underscore the potential for machine learning and multidimensional feature integration to predict mental workload and thereby improve task design and surgical training.ApplicationThe advanced mental workload prediction models could serve as instrumental tools to enhance our understanding of surgeons' cognitive demands and significantly improve the effectiveness of surgical training programs.

Intraoperative workload of the surgeon in robot-assisted radical prostatectomy: a systematic review

In the present study, we aimed to systematically evaluate the current evidence regarding the intraoperative workload of surgeons performing robot-assisted radical prostatectomy (RARP) for prostate cancer. A systematic search was carried out in the PubMed-MEDLINE and Web of Science databases through April 2024 using the following search terms: "workload AND robot assisted radical prostatectomy", "workload AND robotic radical prostatectomy", "task load AND robotic radical prostatectomy", "task load AND robot assisted radical prostatectomy" and "NASA-TLX AND robot assisted radical prostatectomy" by combining population, intervention, comparison, and outcome (PICO) terms, following preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. We therefore selected studies that included patients with prostate cancer (P) who underwent robotic radical prostatectomy (I) and reported a workload/task load questionnaire (C) to assess the intraoperative workload/task load of the surgeon performing robot-assisted radical prostatectomy (O). A total of 11 studies were identified. The surgeon's workload during RARP was assessed using the National Aeronautics and Space Administration task load index (NASA-TLX) and/or the surgery task load index (SURG-TLX) in the studies. Total NASA-TLX scores of the studies ranged from 22.7 ± 3.2 to 62.0 ± 6.4. Mental and physical demands, flow interruptions, surgeon experience, the use of single or multiple ports, and the relationship between the surgeon and other staff in the operating theater may play a role in the intraoperative workload of the console surgeon. The studies we reviewed suggest that RARP offers an acceptable workload for the console surgeon despite its mental demands.

Neurosurgery Residents' Satisfaction Toward Their Saudi Training Program: Insights from a National Survey

BACKGROUND

Given the high-stakes nature of their work, neurosurgery residents face constant pressure and require high-quality training to succeed. We aim to investigate the satisfaction levels of residents with their Saudi Neurosurgery Residency Training Program (SNRTP) and its influential factors.

METHODS

This is a nationwide, cross-sectional study that employed a questionnaire, structured based on the relevant literature, which was disseminated to neurosurgery residents, commencing from December 2021 and culminating in September 2022.

RESULTS

A total of 70 out of 143 neurosurgery residents were included, giving a response rate of 48.9%. Most participants (62.9%) aged 24-28 years old, 55.7% were males, and 40.0% were from the Central region of Saudi Arabia. The residents were further divided into juniors (R1-R3; 64.3%) and seniors (R4-R6; 35.7%). Approximately 13.3% of the juniors were satisfied with the SNRTP, whereas only 8.0% of the seniors were satisfied. Dissatisfaction rates over the SNRTP were significantly higher in the seniors (68.0%) compared to the juniors (28.9%; P = 0.006). The frequency of operating room sessions per week and presence of protected research time were the only 2 factors significantly associated with the junior and senior residents' satisfaction, respectively.

CONCLUSIONS

The SNRTP has a vision to provide the society with elite competent neurosurgeons. However, we found a degree of dissatisfaction among the residents, indicating a need for improving the SNRTP's policies. We recommend incorporating more hands-on training opportunities, implementing a mentorship model, setting tailored teaching sessions, and establishing resident wellness programs. We hope this study initiate dialogue on promoting residents' satisfaction and overall well-being.

An Adaptive Human-Robotic Interaction Architecture for Augmenting Surgery Performance Using Real-Time Workload Sensing-Demonstration of a Semi-autonomous Suction Tool

OBJECTIVE

This study developed and evaluated a mental workload-based adaptive automation (MWL-AA) that monitors surgeon cognitive load and assist during cognitively demanding tasks and assists surgeons in robotic-assisted surgery (RAS).

BACKGROUND

The introduction of RAS makes operators overwhelmed. The need for precise, continuous assessment of human mental workload (MWL) states is important to identify when the interventions should be delivered to moderate operators' MWL.

METHOD

The MWL-AA presented in this study was a semi-autonomous suction tool. The first experiment recruited ten participants to perform surgical tasks under different MWL levels. The physiological responses were captured and used to develop a real-time multi-sensing model for MWL detection. The second experiment evaluated the effectiveness of the MWL-AA, where nine brand-new surgical trainees performed the surgical task with and without the MWL-AA. Mixed effect models were used to compare task performance, objective- and subjective-measured MWL.

RESULTS

The proposed system predicted high MWL hemorrhage conditions with an accuracy of 77.9%. For the MWL-AA evaluation, the surgeons' gaze behaviors and brain activities suggested lower perceived MWL with MWL-AA than without. This was further supported by lower self-reported MWL and better task performance in the task condition with MWL-AA.

CONCLUSION

A MWL-AA systems can reduce surgeons' workload and improve performance in a high-stress hemorrhaging scenario. Findings highlight the potential of utilizing MWL-AA to enhance the collaboration between the autonomous system and surgeons. Developing a robust and personalized MWL-AA is the first step that can be used do develop additional use cases in future studies.

APPLICATION

The proposed framework can be expanded and applied to more complex environments to improve human-robot collaboration.

The Distraction Perceptions of Health Care Professionals in the Operating Room: The Disruptions in Surgery Index (DiSI)

PURPOSE

The purpose of the study was to evaluate the psychometric properties of the Disruptions in Surgery Index (DiSI) in operating room health care professionals and to determine the frequency of distractions DESIGN: Methodological study.

METHODS

The sample consisted of 152 health care professionals. Data were collected online using the DiSI scale. The language validity was ensured, and the data were analyzed with the content validity index, Cronbach α coefficient, and item-total score correlation. Data on distractions of health care workers were given as percentages and averages.

FINDINGS

The mean age of health care professionals was 27.3 ± 6.0 years, and 77.0% of them were operating room nurses. The content validity index of the scale was found to be 0.95. The Cronbach α coefficient of the scale was 0.953 for frequency, 0.967 for contribution to error, and 0.971 for obstruction of goals. The correlation between the item and the total item was positive and significant (p < .001). Tiredness was determined as the most common distraction factor, causing errors and making it difficult to achieve goals.

CONCLUSIONS

The DiSI was found to be a valid and reliable tool. The most common distractions, contributing to errors and obstructing to goals, were related to individuals' skills, performance, and personality. Health care professionals perceived the distractions related to the surgical processes and the situations of the team members in the coordination and situational awareness subdimension as the least distracting factor.

Examining workload variations among different surgical team roles, specialties, and techniques: a multicenter cross-sectional descriptive study

BACKGROUND

A high workload may negatively impact the surgical team's performance and jeopardize patient safety. The aim of this study was to measure the workload of the surgical team across different surgical roles, specialties, and techniques in several hospitals.

METHODS

This cross-sectional multicenter study was performed in the operating rooms of eight teaching hospitals affiliated with Isfahan University of Medical Sciences, Iran. At the conclusion of each surgical procedure, all members of the surgical team completed the Surgery Task Load Index (SURG-TLX) questionnaire to assess workload levels. Descriptive statistics, analysis of variance (ANOVA), and Pearson correlations, were performed to compare surgical roles, specialties, techniques, and surgical time on workload overall and by subscale.

RESULTS

A total of 409 workload questionnaires were obtained from 76 surgical teams or cases, involving 346 surgical team members. The total workload among all participants was 32.41 ± 17.21. Surgical complexity, physical demands, and mental demands were the highest workload subscales and distraction was the lowest workload subscale. Cardiovascular specialty had a higher workload compared to other specialties. Open techniques resulted in a higher workload compared to minimally invasive techniques. Surgical technologists who act in both the role of circulating and scrub nurse (C&Ss) experienced the highest workload, followed by surgical residents and surgeons.

CONCLUSIONS

The results of the study showed that the workload for some members of the surgical team is disproportionately high and is influenced by factors such as specialty, technique, role, and surgical duration. By knowing the distribution of workload among the members of the surgical team, efforts can be made to optimize the team members' workload.

Remembering to Resume: A Randomized Trial Comparing Combined Interruption Management Training and Simulation-Based Education to Simulation-Based Education Alone

AIM

This study aimed to determine if purposeful presimulation interruption management training impacts cognitive load and successful completion of simulation objectives more than the experience alone.

BACKGROUND

Practicing nurses are frequently interrupted, increasing the risk for error and task time. Novices are particularly vulnerable to interruption consequences.

METHOD

A between-subjects design and block randomization of prelicensure baccalaureate nursing students ( n = 146) was used to compare group differences in cognitive load, use of interruption management strategies, and completion of simulation required elements. Potential relationships between outcomes and age, mindfulness, and experience were explored.

RESULTS

An analysis of covariance demonstrated significantly lower perceived mental demand for those receiving training. Older learners and those receiving training implemented more interruption management strategies.

CONCLUSION

Combining simulation-based education (SBE) with purposeful training enhances interruption management more than SBE alone. Frequent interruption training and SBE are recommended to enhance risk awareness.

Broad Responses and Attitudes to Having Music in Surgery (The BRAHMS Study): An Australia and Aotearoa New Zealand Perspective

Background

Surgery is a stressful exercise, and the experience of occupational stress may have impacts on surgical performance, and surgeon well-being. Music is played in operating theatres (OTs) throughout the world, and while it may improve surgical performance, and reduce clinician stress within the OT, concerns exist over its distracting and noise-creating properties.

Methods

In this prospective observational study, between May to August 2022, Vascular, General and Paediatric surgeons and registrars in Australia and Aotearoa New Zealand (AoNZ) responded to a survey investigating the way they use music, and their perceptions and attitudes towards its effect on the OT environment. Binomial logistic regression and Chi squared tests of association were performed, accepting p < 0.05 as significant.

Results

In this cohort of 120 surgeons, 45 % were vascular specialists, 30 % were female and 59 % were consultant surgeons. The most commonly preferred music genres were easy listening and pop. Over 75 % of surgeons enjoyed having music in their OTs with the majority reporting it improved their temperament, how mentally fatiguing a procedure felt and how anxious or stressed they felt. Vascular surgeons were more likely to believe music had a positive influence on communication than their general and paediatric surgery colleagues (p < 0.01). Registrars had significantly higher odds of believing music had a positive effect on their temperament, and how stressed and anxious they felt when operating, when compared to consultants (p < 0.05).

Conclusions

This study provides a window into the surgeons' use of and attitudes towards intra-operative background music and its effect on stress and cognitive load in Australia and AoNZ. While overall, music is viewed positively by this cohort, there was some difference seen across specialties and level of experience. Further subjective and objective data in this field may provide useful information to guide hospital policy and inform pathways for clinician wellbeing.

Effectiveness of a vision-based handle trajectory monitoring system in studying robotic suture operation

Data on surgical robots are not openly accessible, limiting further study of the operation trajectory of surgeons' hands. Therefore, a trajectory monitoring system should be developed to examine objective indicators reflecting the characteristic parameters of operations. 20 robotic experts and 20 first-year residents without robotic experience were included in this study. A dry-lab suture task was used to acquire relevant hand performance data. Novices completed training on the simulator and then performed the task, while the expert team completed the task after warm-up. Stitching errors were measured using a visual recognition method. Videos of operations were obtained using the camera array mounted on the robot, and the hand trajectory of the surgeons was reconstructed. The stitching accuracy, robotic control parameters, balance and dexterity parameters, and operation efficiency parameters were compared. Experts had smaller center distance (p < 0.001) and larger proximal distance between the hands (p < 0.001) compared with novices. The path and volume ratios between the left and right hands of novices were larger than those of experts (both p < 0.001) and the total volume of the operation range of experts was smaller (p < 0.001). The surgeon trajectory optical monitoring system is an effective and non-subjective method to distinguish skill differences. This demonstrates the potential of pan-platform use to evaluate task completion and help surgeons improve their robotic learning curve.

Mental workload profile and its relationship with presenteeism, absenteeism and job performance among surgeons: The mediating role of occupational fatigue

Introduction

Surgeons are one of the most significant jobs in the health care system that plays an important role in the patients' health promotion and their treatment. In the current study, the effect of mental workload on the work performance of surgeons was tested by considering the mediating effect of fatigue on this relationship.

Method

This study was done analytically on 165 surgeons working in the operating rooms of hospitals in Iran. To determine of mental workload, the SURG-TLX method was used. The job performance was measured using the short version of the job performance questionnaire provided by the World Health Organization (WHO-HPQ), and accordingly relative presenteeism, relative absenteeism and job performance variables were calculated. The Swedish Occupational Fatigue Inventory (SOFI) questionnaire was used to determine occupational fatigue. A conceptual model was built to determine the direct and indirect relationship between mental workload and job performance, and the mediating effect of occupational fatigue on the relationship between mental workload and job performance was tested using structural equation modeling (SEM).

Results

Out of 165 distributed questionnaires, 140 questionnaires were completed and delivered to the researchers (85% response rate). The mean ± standard deviations of mental workload, fatigue, and work performance were 16.57 ± 5.83, 6.32 ± 2.86, and 0.65 ± 0.28, respectively. The results of model fit indexes revealed that all indexes are within the acceptable range. Regarding this model, the direct effect of mental workload on job performance was not significant (β = -0.21; p = 0.072). A significant positive relationship was observed between mental workload and fatigue (β = 0.36; p < 0.001). The direct effect of fatigue on job performance was also the opposite and statistically significant (β = -0.39; p < 0.001). Finally, results indicated that the effect of mental workload on work performance mediated by occupational fatigue.

Conclusion

Surgeons suffer a high level of mental workload during their work, and this factor can have a negative effect on surgeons' job performance. The effect of mental workload on job performance in surgeons can be detected, directly and indirectly, through the mediating effect of occupational fatigue. Improving the mental and physical conditions of the work environment can reduce occupational fatigue and improve surgeons' job performance.

Advances in artificial intelligence, robotics, augmented and virtual reality in neurosurgery

Neurosurgical practitioners undergo extensive and prolonged training to acquire diverse technical proficiencies, while neurosurgical procedures necessitate a substantial amount of pre-, post-, and intraoperative clinical data acquisition, making decisions, attention, and convalescence. The past decade witnessed an appreciable escalation in the significance of artificial intelligence (AI) in neurosurgery. AI holds significant potential in neurosurgery as it supplements the abilities of neurosurgeons to offer optimal interventional and non-interventional care to patients by improving prognostic and diagnostic outcomes in clinical therapy and assisting neurosurgeons in making decisions while surgical interventions to enhance patient outcomes. Other technologies including augmented reality, robotics, and virtual reality can assist and promote neurosurgical methods as well. Moreover, they play a significant role in generating, processing, as well as storing experimental and clinical data. Also, the usage of these technologies in neurosurgery is able to curtail the number of costs linked with surgical care and extend high-quality health care to a wider populace. This narrative review aims to integrate the results of articles that elucidate the role of the aforementioned technologies in neurosurgery.

Unpacking the Broad Landscape of Intraoperative Stressors for Clinical Personnel: A Mixed-Methods Systematic Review

Purpose

The main goals of this mixed-methods systematic review are to identify what types of intraoperative stressors for operating room personnel have been reported in collected studies and examine the characteristics of each intraoperative stressor.

Methods

With a systematic literature search, we retrieved empirical studies examining intraoperative stress published between 2010 and 2020. To synthesize findings, we applied two approaches. First, a textual narrative synthesis was employed to summarize key study information of the selected studies by focusing on surgical platforms and study participants. Second, a thematic synthesis was employed to identify and characterize intraoperative stressors and their subtypes.

Results

Ninety-four studies were included in the review. Regarding the surgical platforms, the selected studies mainly focused on minimally invasive surgery and few studies examined issues around robotic surgery. Most studies examined intra-operative stress from surgeons' perspectives but rarely considered other clinical personnel such as nurses and anesthetists. Among seven identified stressors, technical factors were the most frequently examined followed by individual, operating room environmental, interpersonal, temporal, patient, and organizational factors.

Conclusion

By presenting stressors as multifaceted elements affecting collaboration and interaction between multidisciplinary team members in the operating room, we discuss the potential interactions between stressors which should be further investigated to build a safe and efficient environment for operating room personnel.

Identifying Workflow Disruptions in Robotic-Assisted Bariatric Surgery: Elucidating Challenges Experienced by Surgical Teams

PURPOSE

Bariatric surgery is an effective and durable treatment for weight loss for patients with extreme obesity. Although traditionally approached laparoscopically, robotic bariatric surgery (RBS) has unique benefits for both surgeons and patients. Nonetheless, the technological complexity of robotic surgery presents new challenges for OR teams and the wider clinical system. Further assessment of the role of RBS in delivering quality care for patients with obesity is necessary and can be done through a human factors approach. This observational study sought to investigate the impact of RBS on the surgical work system via the study of flow disruptions (FDs), or deviations from the natural workflow progression.

MATERIALS AND METHODS

RBS procedures were observed between October 2019 and March 2022. FDs were recorded in real time and subsequently classified into one of nine work system categories. Coordination FDs were further classified into additional sub-categories.

RESULTS

Twenty-nine RBS procedures were observed at three sites. An average FD rate of 25.05 (CI =  ± 2.77) was observed overall. FDs were highest between insufflation and robot docking (M = 29.37, CI =  ± 4.01) and between patient closing and wheels out (M = 30.00, CI =  ± 6.03). FD rates due to coordination issues were highest overall, occurring once every 4 min during docking (M = 14.28, CI =  ± 3.11).

CONCLUSION

FDs occur roughly once every 2.4 min and happen most frequently during the final patient transfer and robot docking phases of RBS. Coordination challenges associated with waiting for staff/instruments not readily available and readjusting equipment contributed most to these disruptions.

Efficacy of a Novel Augmented Reality Navigation System Using 3D Computer Graphic Modeling in Endoscopic Transsphenoidal Surgery for Sellar and Parasellar Tumors

In endoscopic transsphenoidal skull base surgery, knowledge of tumor location on imaging and the anatomic structures is required simultaneously. However, it is often difficult to accurately reconstruct the endoscopic vision of the surgical field from the pre-surgical radiographic images because the lesion remarkably displaces the geography of normal anatomic structures. We created a precise three-dimensional computer graphic model from preoperative radiographic data that was then superimposed on a visual image of the actual surgical field and displayed on a video monitor during endoscopic transsphenoidal surgery. We evaluated the efficacy of this augmented reality (AR) navigation system in 15 consecutive patients with sellar and parasellar tumors. The average score overall was 4.7 [95% confidence interval: 4.58-4.82], which indicates that the AR navigation system was as useful as or more useful than conventional navigation in certain patients. In two patients, AR navigation was assessed as less useful than conventional navigation because perception of the depth of the lesion was more difficult. The developed system was more useful than conventional navigation for facilitating an immediate three-dimensional understanding of the lesion and surrounding structures.

Computer-assisted simulated workplace-based assessment in surgery: application of the universal framework of intraoperative performance within a mixed-reality simulation

Objectives

Workplace-based assessment (WBA) is a key requirement of competency-based medical education in postgraduate surgical education. Although simulated workplace-based assessment (SWBA) has been proposed to complement WBA, it is insufficiently adopted in surgical education. In particular, approaches to criterion-referenced and automated assessment of intraoperative surgical competency in contextualized SWBA settings are missing.Main objectives were (1) application of the universal framework of intraoperative performance and exemplary adaptation to spine surgery (vertebroplasty); (2) development of computer-assisted assessment based on criterion-referenced metrics; and (3) implementation in contextualized, team-based operating room (OR) simulation, and evaluation of validity.

Design

Multistage development and assessment study: (1) expert-based definition of performance indicators based on framework's performance domains; (2) development of respective assessment metrics based on preoperative planning and intraoperative performance data; (3) implementation in mixed-reality OR simulation and assessment of surgeons operating in a confederate team. Statistical analyses included internal consistency and interdomain associations, correlations with experience, and technical and non-technical performances.

Setting

Surgical simulation center. Full surgical team set-up within mixed-reality OR simulation.

Participants

Eleven surgeons were recruited from two teaching hospitals. Eligibility criteria included surgical specialists in orthopedic, trauma, or neurosurgery with prior VP or kyphoplasty experience.

Main outcome measures

Computer-assisted assessment of surgeons' intraoperative performance.

Results

Performance scores were associated with surgeons' experience, observational assessment (Objective Structured Assessment of Technical Skill) scores and overall pass/fail ratings. Results provide strong evidence for validity of our computer-assisted SWBA approach. Diverse indicators of surgeons' technical and non-technical performances could be quantified and captured.

Conclusions

This study is the first to investigate computer-assisted assessment based on a competency framework in authentic, contextualized team-based OR simulation. Our approach discriminates surgical competency across the domains of intraoperative performance. It advances previous automated assessment based on the use of current surgical simulators in decontextualized settings. Our findings inform future use of computer-assisted multidomain competency assessments of surgeons using SWBA approaches.

Intraoperative workload during robotic radical prostatectomy: Comparison between multi-port da Vinci Xi and single port da Vinci SP robots

The goal of this study was to quantify and compare prospective self-reported intraoperative workload and teamwork during robot-assisted radical prostatectomy (RARP) for multi-port da Vinci Xi (MP) and single-port da Vinci SP (SP) robots. The self-reported workload (surgeon and surgical team) and teamwork (surgeon) measures were collected and compared between MP and SP RARPs, as well as the learning curve. Results from 25 MP and SP RARPs showed that overall, the NASA-TLX workload subscales were lower, and the teamwork modified NOTECHS subscales were higher for the MP RARPs compared to the SP RARPs. The underlying reason for the significant differences between these two RARP surgical procedures could be other factors (e.g., robot design factors) in addition to the surgeon and surgical team's experience. The results also suggested learning effects through the 25 SP RARPs; however, twenty-five procedures may not be enough to achieve proficiency with the SP system.

Eye Tracking Use in Surgical Research: A Systematic Review

INTRODUCTION

Eye tracking (ET) is a popular tool to study what factors affect the visual behaviour of surgical team members. To our knowledge, there have been no reviews to date that evaluate the broad use of ET in surgical research. This review aims to identify and assess the quality of this evidence, to synthesize how ET can be used to inform surgical practice, and to provide recommendations to improve future ET surgical studies.

METHODS

In line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, a systematic literature review was conducted. An electronic search was performed in MEDLINE, Cochrane Central, Embase, and Web of Science databases up to September 2020. Included studies used ET to measure the visual behaviour of members of the surgical team during surgery or surgical tasks. The included studies were assessed by two independent reviewers.

RESULTS

A total of 7614 studies were identified, and 111 were included for data extraction. Eleven applications were identified; the four most common were skill assessment (41%), visual attention assessment (22%), workload measurement (17%), and skills training (10%). A summary was provided of the various ways ET could be used to inform surgical practice, and three areas were identified for the improvement of future ET studies in surgery.

CONCLUSIONS

This review provided a comprehensive summary of the various applications of ET in surgery and how ET could be used to inform surgical practice, including how to use ET to improve surgical education. The information provided in this review can also aid in the design and conduct of future ET surgical studies.

Association Between Operating Room Noise and Team Cognitive Workload in Cardiac Surgery

Excessive intra-operative noise in cardiac surgery has the potential to serve as source of distraction and additional cognitive workload for the surgical team, and may interfere with optimal performance. The separation from bypass phase is a technically complex phase of surgery, making it highly susceptible to communication breakdowns due to high cognitive demands and requiring tightly coupled team coordination. The objective of this study was to investigate team cognitive workload levels and communication in relation to intra-operative time periods representative of infrequent vs. frequent peaks in ambient noise. Compared to 5-minute segments with no peaks in noise at all, segments with the highest percentage of noise peaks (≥10%) were significantly associated with higher team members' heart rate before, during, and after noise segments analyzed. These noisier segments were also associated with a significantly higher level of case-irrelevant communication events. These data suggest that case-irrelevant conversations associated with a greater degree of excessive peaks in noise may be associated with team workload levels, warranting further investigation into efforts to standardize communication during critical surgical phases.

Effect of phone call distraction on the performance of medical students in an OSCE

BACKGROUND

The usage of smartphones in the daily clinical routine is an essential aspect however it seems that they also present an important distractor that needs to be evaluated. The aim of this prospective study was the evaluation of the influence of phone calls as distractors on the performance levels of medical students during an objective structured clinical examination (OSCE), simulating the normal clinical practice.

METHODS

As the goal of an OSCE presents the examination of clinical skills of medical students in a realistic setting, more than 100 students recruited from the university hospital of Cologne participated in either OSCE I or II. During the OSCE I intravenous cannulation was simulated while OSCE II simulated an acute abdominal pain station. Participants had to perform each of these stations under two circumstances: a normal simulated OSCE and an OSCE station with phone call distraction. Their performance during both simulations was then evaluated.

RESULTS

In OSCE I students achieved significantly more points in the intravenous cannulation station if they were not distracted by phone calls (M=6.44 vs M=5.95). In OSCE II students achieved significantly more points in the acute abdominal pain station if they were not distracted by phone calls (M=7.59 vs M=6.84). While comparing only those students that completed both stations in OSCE I/II participating students achieved significantly more points in both OSCE I and II if they were not distracted by phone calls.

CONCLUSION

The presented data shows that phone call distraction decreases the performance level of medical students during an OSCE station. Therefore, it is an indicator that distraction especially for younger doctors should be held to a minimum. On a second note distraction should be integrated in the medical education system as it plays an important role in clinical routine.

The impact of design on workflow: a comparative case study of level I trauma rooms

Purpose

This study aims to examine trauma room staff’s perception of factors that influence workflow in trauma care from a physical environment standpoint.

Design/methodology/approach

A semi-structured focus group method was used. Trauma team members, representative of various roles within a team, were recruited from five Level I trauma centers in the USA, through a convenience sampling method. A total of 53 participants were recruited to participate in online focus groups. The Systems Engineering Initiative for Patient Safety model was used to analyze the findings.

Findings

In addition to factors directly related to the physical environment, aspects of people and technology, such as crowding and access to technology, were found to be related to the physical environment. Examples of factors that improve or hinder workflow are layout design, appropriate room size, doors, sink locations, access to resources such as X-ray or blood and access to technology. Seamless and uninterrupted workflow is crucial in achieving efficient and safe care in the time-pressured environments of trauma rooms. To support workflow, the physical environment can offer solutions through effective layout design, thoughtful location of resources and technology and room size.

Originality/value

Trauma rooms are time-pressured and complex environments where seconds matter to save a patient’s life. Ensuring safe and efficient care requires seamless workflow. However, the literature on workflow in trauma rooms is limited.

Virtual Reality in Neurosurgery: Beyond Neurosurgical Planning

BACKGROUND

While several publications have focused on the intuitive role of augmented reality (AR) and virtual reality (VR) in neurosurgical planning, the aim of this review was to explore other avenues, where these technologies have significant utility and applicability.

METHODS

This review was conducted by searching PubMed, PubMed Central, Google Scholar, the Scopus database, the Web of Science Core Collection database, and the SciELO citation index, from 1989-2021. An example of a search strategy used in PubMed Central is: "Virtual reality" [All Fields] AND ("neurosurgical procedures" [MeSH Terms] OR ("neurosurgical" [All Fields] AND "procedures" [All Fields]) OR "neurosurgical procedures" [All Fields] OR "neurosurgery" [All Fields] OR "neurosurgery" [MeSH Terms]). Using this search strategy, we identified 487 (PubMed), 1097 (PubMed Central), and 275 citations (Web of Science Core Collection database).

RESULTS

Articles were found and reviewed showing numerous applications of VR/AR in neurosurgery. These applications included their utility as a supplement and augment for neuronavigation in the fields of diagnosis for complex vascular interventions, spine deformity correction, resident training, procedural practice, pain management, and rehabilitation of neurosurgical patients. These technologies have also shown promise in other area of neurosurgery, such as consent taking, training of ancillary personnel, and improving patient comfort during procedures, as well as a tool for training neurosurgeons in other advancements in the field, such as robotic neurosurgery.

CONCLUSIONS

We present the first review of the immense possibilities of VR in neurosurgery, beyond merely planning for surgical procedures. The importance of VR and AR, especially in "social distancing" in neurosurgery training, for economically disadvantaged sections, for prevention of medicolegal claims and in pain management and rehabilitation, is promising and warrants further research.

XR (Extended Reality: Virtual Reality, Augmented Reality, Mixed Reality) Technology in Spine Medicine: Status Quo and Quo Vadis

In recent years, with the rapid advancement and consumerization of virtual reality, augmented reality, mixed reality, and extended reality (XR) technology, the use of XR technology in spine medicine has also become increasingly popular. The rising use of XR technology in spine medicine has also been accelerated by the recent wave of digital transformation (i.e., case-specific three-dimensional medical images and holograms, wearable sensors, video cameras, fifth generation, artificial intelligence, and head-mounted displays), and further accelerated by the COVID-19 pandemic and the increase in minimally invasive spine surgery. The COVID-19 pandemic has a negative impact on society, but positive impacts can also be expected, including the continued spread and adoption of telemedicine services (i.e., tele-education, tele-surgery, tele-rehabilitation) that promote digital transformation. The purpose of this narrative review is to describe the accelerators of XR (VR, AR, MR) technology in spine medicine and then to provide a comprehensive review of the use of XR technology in spine medicine, including surgery, consultation, education, and rehabilitation, as well as to identify its limitations and future perspectives (status quo and quo vadis).

Barriers to safety and efficiency in robotic surgery docking

BACKGROUND

The introduction of new technology into the operating room (OR) can be beneficial for patients, but can also create new problems and complexities for physicians and staff. The observation of flow disruptions (FDs)-small deviations from the optimal course of care-can be used to understand how systems problems manifest. Prior studies showed that the docking process in robotic assisted surgery (RAS), which requires careful management of process, people, technology and working environment, might be a particularly challenging part of the operation. We sought to explore variation across multiple clinical sites and procedures; and to examine the sources of those disruptions.

METHODS

Trained observers recorded FDs during 45 procedures across multiple specialties at three different hospitals. The rate of FDs was compared across surgical phases, sites, and types of procedure. A work-system flow of the RAS docking procedure was used to determine which steps were most disrupted.

RESULTS

The docking process was significantly more disrupted than other procedural phases, with no effect of hospital site, and a potential interaction with procedure type. Particular challenges were encountered in room organization, retrieval of supplies, positioning the patient, and maneuvering the robot.

CONCLUSIONS

Direct observation of surgical procedures can help to identify approaches to improve the design of technology and procedures, the training of staff, and configuration of the OR environment, with the eventual goal of improving safety, efficiency and teamwork in high technology surgery.

Intraoperative dynamics of workflow disruptions and surgeons' technical performance failures: insights from a simulated operating room

INTRODUCTION

Flow disruptions (FD) in the operating room (OR) have been found to adversely affect the levels of stress and cognitive workload of the surgical team. It has been concluded that frequent disruptions also lead to impaired technical performance and subsequently pose a risk to patient safety. However, respective studies are scarce. We therefore aimed to determine if surgical performance failures increase after disruptive events during a complete surgical intervention.

METHODS

We set up a mixed-reality-based OR simulation study within a full-team scenario. Eleven orthopaedic surgeons performed a vertebroplasty procedure from incision to closure. Simulations were audio- and videotaped and key surgical instrument movements were automatically tracked to determine performance failures, i.e. injury of critical tissue. Flow disruptions were identified through retrospective video observation and evaluated according to duration, severity, source, and initiation. We applied a multilevel binary logistic regression model to determine the relationship between FDs and technical performance failures. For this purpose, we compared FDs in one-minute intervals before performance failures with intervals without subsequent performance failures.

RESULTS

Average simulation duration was 30:02 min (SD = 10:48 min). In 11 simulated cases, 114 flow disruption events were observed with a mean hourly rate of 20.4 (SD = 5.6) and substantial variation across FD sources. Overall, 53 performance failures were recorded. We observed no relationship between FDs and likelihood of immediate performance failures: Adjusted odds ratio = 1.03 (95% CI 0.46-2.30). Likewise, no evidence could be found for different source types of FDs.

CONCLUSION

Our study advances previous methodological approaches through the utilisation of a mixed-reality simulation environment, automated surgical performance assessments, and expert-rated observations of FD events. Our data do not support the common assumption that FDs adversely affect technical performance. Yet, future studies should focus on the determining factors, mechanisms, and dynamics underlying our findings.

Endoscopic Image-Based Skill Assessment in Robot-Assisted Minimally Invasive Surgery

Objective skill assessment-based personal performance feedback is a vital part of surgical training. Either kinematic-acquired through surgical robotic systems, mounted sensors on tooltips or wearable sensors-or visual input data can be employed to perform objective algorithm-driven skill assessment. Kinematic data have been successfully linked with the expertise of surgeons performing Robot-Assisted Minimally Invasive Surgery (RAMIS) procedures, but for traditional, manual Minimally Invasive Surgery (MIS), they are not readily available as a method. 3D visual features-based evaluation methods tend to outperform 2D methods, but their utility is limited and not suited to MIS training, therefore our proposed solution relies on 2D features. The application of additional sensors potentially enhances the performance of either approach. This paper introduces a general 2D image-based solution that enables the creation and application of surgical skill assessment in any training environment. The 2D features were processed using the feature extraction techniques of a previously published benchmark to assess the attainable accuracy. We relied on the JHU-ISI Gesture and Skill Assessment Working Set dataset-co-developed by the Johns Hopkins University and Intuitive Surgical Inc. Using this well-established set gives us the opportunity to comparatively evaluate different feature extraction techniques. The algorithm reached up to 95.74% accuracy in individual trials. The highest mean accuracy-averaged over five cross-validation trials-for the surgical subtask of Knot-Tying was 83.54%, for Needle-Passing 84.23% and for Suturing 81.58%. The proposed method measured well against the state of the art in 2D visual-based skill assessment, with more than 80% accuracy for all three surgical subtasks available in JIGSAWS (Knot-Tying, Suturing and Needle-Passing). By introducing new visual features-such as image-based orientation and image-based collision detection-or, from the evaluation side, utilising other Support Vector Machine kernel methods, tuning the hyperparameters or using other classification methods (e.g., the boosted trees algorithm) instead, classification accuracy can be further improved. We showed the potential use of optical flow as an input for RAMIS skill assessment, highlighting the maximum accuracy achievable with these data by evaluating it with an established skill assessment benchmark, by evaluating its methods independently. The highest performing method, the Residual Neural Network, reached means of 81.89%, 84.23% and 83.54% accuracy for the skills of Suturing, Needle-Passing and Knot-Tying, respectively.

Use of a Virtual Reality Simulator for Tendon Repair Training: Randomized Controlled Trial

BACKGROUND

Virtual reality (VR) simulators have become widespread tools for training medical students and residents in medical schools. Students using VR simulators are provided with a 3D human model to observe the details by using multiple senses and they can participate in an environment that is similar to reality.

OBJECTIVE

The aim of this study was to promote a new approach consisting of a shared and independent study platform for medical orthopedic students, to compare traditional tendon repair training with VR simulation of tendon repair, and to evaluate future applications of VR simulation in the academic medical field.

METHODS

In this study, 121 participants were randomly allocated to VR or control groups. The participants in the VR group studied the tendon repair technique via the VR simulator, while the control group followed traditional tendon repair teaching methods. The final assessment for the medical students involved performing tendon repair with the "Kessler tendon repair with 2 interrupted tendon repair knots" (KS) method and the "Bunnell tendon repair with figure 8 tendon repair" (BS) method on a synthetic model. The operative performance was evaluated using the global rating scale.

RESULTS

Of the 121 participants, 117 participants finished the assessment and 4 participants were lost to follow-up. The overall performance (a total score of 35) of the VR group using the KS method and the BS method was significantly higher (P<.001) than that of the control group. Thus, participants who received VR simulator training had a significantly higher score on the global rating scale than those who received traditional tendon repair training (P<.001).

CONCLUSIONS

Our study shows that compared with the traditional tendon repair method, the VR simulator for learning tendon suturing resulted in a significant improvement of the medical students in the time in motion, flow of operation, and knowledge of the procedure. Therefore, VR simulator development in the future would most likely be beneficial for medical education and clinical practice.

TRIAL REGISTRATION

Chinese Clinical Trial Registry ChiCTR2100046648; http://www.chictr.org.cn/hvshowproject.aspx?id=90180.

Non-Technical Skill Assessment and Mental Load Evaluation in Robot-Assisted Minimally Invasive Surgery

BACKGROUND: Sensor technologies and data collection practices are changing and improving quality metrics across various domains. Surgical skill assessment in Robot-Assisted Minimally Invasive Surgery (RAMIS) is essential for training and quality assurance. The mental workload on the surgeon (such as time criticality, task complexity, distractions) and non-technical surgical skills (including situational awareness, decision making, stress resilience, communication, leadership) may directly influence the clinical outcome of the surgery. METHODS: A literature search in PubMed, Scopus and PsycNet databases was conducted for relevant scientific publications. The standard PRISMA method was followed to filter the search results, including non-technical skill assessment and mental/cognitive load and workload estimation in RAMIS. Publications related to traditional manual Minimally Invasive Surgery were excluded, and also the usability studies on the surgical tools were not assessed. RESULTS: 50 relevant publications were identified for non-technical skill assessment and mental load and workload estimation in the domain of RAMIS. The identified assessment techniques ranged from self-rating questionnaires and expert ratings to autonomous techniques, citing their most important benefits and disadvantages. CONCLUSIONS: Despite the systematic research, only a limited number of articles was found, indicating that non-technical skill and mental load assessment in RAMIS is not a well-studied area. Workload assessment and soft skill measurement do not constitute part of the regular clinical training and practice yet. Meanwhile, the importance of the research domain is clear based on the publicly available surgical error statistics. Questionnaires and expert-rating techniques are widely employed in traditional surgical skill assessment; nevertheless, recent technological development in sensors and Internet of Things-type devices show that skill assessment approaches in RAMIS can be much more profound employing automated solutions. Measurements and especially big data type analysis may introduce more objectivity and transparency to this critical domain as well. SIGNIFICANCE: Non-technical skill assessment and mental load evaluation in Robot-Assisted Minimally Invasive Surgery is not a well-studied area yet; while the importance of this domain from the clinical outcome's point of view is clearly indicated by the available surgical error statistics.

Research and Exploratory Analysis Driven-Time-data Visualization (read-tv) software

MOTIVATION

Research & Exploratory Analysis Driven Time-data Visualization (read-tv) is an open source R Shiny application for visualizing irregularly and regularly spaced longitudinal data. read-tv provides unique filtering and changepoint analysis (CPA) features. The need for these analyses was motivated by research of surgical work-flow disruptions in operating room settings. Specifically, for the analysis of the causes and characteristics of periods of high disruption-rates, which are associated with adverse surgical outcomes.

MATERIALS AND METHODS

read-tv is a graphical application, and the main component of a package of the same name. read-tv generates and evaluates code to filter and visualize data. Users can view the visualization code from within the application, which facilitates reproducibility. The data input requirements are simple, a table with a time column with no missing values. The input can either be in the form of a file, or an in-memory dataframe- which is effective for rapid visualization during curation.

RESULTS

We used read-tv to automatically detect surgical disruption cascades. We found that the most common disruption type during a cascade was training, followed by equipment.

DISCUSSION

read-tv fills a need for visualization software of surgical disruptions and other longitudinal data. Every visualization is reproducible, the exact source code that read-tv executes to create a visualization is available from within the application. read-tv is generalizable, it can plot any tabular dataset given the simple requirements that there is a numeric, datetime, or datetime string column with no missing values. Finally, the tab-based architecture of read-tv is easily extensible, it is relatively simple to add new functionality by implementing a tab in the source code.

CONCLUSION

read-tv enables quick identification of patterns through customizable longitudinal plots; faceting; CPA; and user-specified filters. The package is available on GitHub under an MIT license.

Episodes of strain experienced in the operating room: impact of the type of surgery, the profession and the phase of the operation

Background

Strain episodes, defined as phases of higher workload, stress or negative emotions, occur everyday in the operating room (OR). Accurate knowledge of when strain is most intense for the different OR team members is imperative for developing appropriate interventions. The primary goal of the study was to investigate temporal patterns of strain across surgical phases for different professionals working in the OR, for different types of operations.

Methods

We developed a guided recall method to assess the experience of strain from the perspective of operating room (OR) team members. The guided recall was completed by surgeons, residents, anesthesiologists, circulating nurses and scrub technicians immediately after 113 operations, performed in 5 departments of one hospital in North America. We also conducted interviews with 16 surgeons on strain moments during their specific operation types. Strain experiences were related to surgical phases and compared across different operation types separately for each profession in the OR.

Results

We analyzed 693 guided recalls. General linear modeling (GLM) showed that strain varied across the phases of the operations (defined as before incision, first third, middle third and last third) [quadratic (F = 47.85, p < 0.001) and cubic (F = 8.94, p = 0.003) effects]. Phases of operations varied across professional groups [linear (F = 4.14, p = 0.001) and quadratic (F = 14.28, p < 0.001) effects] and surgery types [only cubic effects (F = 4.92, p = 0.001)]. Overall strain was similar across surgery types (F = 1.27, p = 0.28). Surgeons reported generally more strain episodes during the first and second third of the operations; except in vascular operations, where no phase was associated with significantly higher strain levels, and emergency/trauma surgery, where strain episodes occurred primarily during the first third of the operation. Other professional groups showed different strain time patterns.

Conclusions

Members of the OR teams experience strain differently across the phases of an operation. Thus, phases with high concentration requirements may highly vary across OR team members and no single phase of an operation can be defined as a “sterile cockpit” phase for all team members.

Associations of workflow disruptions in the operating room with surgical outcomes: a systematic review and narrative synthesis

BACKGROUND

Performance in the operating room is an important determinant of surgical safety. Flow disruptions (FDs) represent system-related performance problems that affect the efficiency of the surgical team and have been associated with a risk to patient safety. Despite the growing evidence base on FDs, a systematic synthesis has not yet been published.

OBJECTIVE

Our aim was to identify, evaluate and summarise the evidence on relationships between intraoperative FD events and provider, surgical process and patient outcomes.

METHODS

We systematically searched databases MEDLINE, Embase and PsycINFO (last update: September 2019). Two reviewers independently screened the resulting studies at the title/abstract and full text stage in duplicate, and all inconsistencies were resolved through discussion. We assessed the risk of bias of included studies using established and validated tools. We summarised effects from included studies through a narrative synthesis, stratified based on predefined surgical outcome categories, including surgical process, provider and patient outcomes.

RESULTS

We screened a total of 20 481 studies. 38 studies were found to be eligible. Included studies were highly heterogeneous in terms of methodology, medical specialty and context. Across studies, 20.5% of operating time was attributed to FDs. Various other process, patient and provider outcomes were reported. Most studies reported negative or non-significant associations of FDs with surgical outcomes.

CONCLUSION

Apart from the identified relationship of FDs with procedure duration, the evidence base concerning the impact of FDs on provider, surgical process and patient outcomes is limited and heterogeneous. We further provide recommendations concerning use of methods, relevant outcomes and avenues for future research on associated effects of FDs in surgery.

Improving the Quality of Evaluation Data in Simulation-Based Healthcare Improvement Projects: A Practitioner's Guide to Choosing and Using Published Measurement Tools

STATEMENT

Simulation is increasingly being used in healthcare improvement projects. The aims of such projects can be extremely diverse. Accordingly, the outcomes or participant attributes that need to be measured can vary dramatically from project-to-project and may include a wide range of nontechnical skills, technical skills, and psychological constructs. Consequently, there is a growing need for simulation practitioners to be able to identify suitable measurement tools and incorporate them into their work. This article provides a practical introduction and guide to the key considerations for practitioners when selecting and using such tools. It also offers a substantial selection of example tools, both to illustrate the key considerations in relation to choosing a measure (including reliability and validity) and to serve as a convenient resource for those planning a study. By making well-informed choices, practitioners can improve the quality of the data they collect, and the likelihood that their projects will succeed.

Utility of the sliding lung sign for the prediction of preoperative intrathoracic adhesions

Background

To assess the potential of the ultrasonographic sliding lung sign to detect severe intrathoracic adhesions before surgery.

Methods

This was a prospective, single-center, observational study including all patients aged 20-89 years undergoing elective thoracic surgery. Patients with pneumothorax, pyothorax, hemothorax, chylothorax, and hydrothorax were excluded. We recorded the ultrasound sliding lung sign, surgical characteristics, and follow-up parameters: past medical history, respiratory function, chest X-ray findings, and computed tomography (CT) findings. Severe intrathoracic adhesion was defined as the need for adhesiolysis requiring more than 30 minutes.

Results

A total of 168 patients consented to participate. All 15 patients without the sliding lung sign had hard severe adhesions [specificity 100%, sensitivity 88.2%, positive predictive value (PPV) 100%, negative predictive value (NPV) 98.7%, and area under curve (AUC) 0.94]. There were two false-negative results, both of which were soft adhesions. Although blunting of the costophrenic (CP) angle, CT findings, past medical history, and restrictive lung disease were identified as significant risk factors of severe intrathoracic adhesion, all areas under the curve were low (0.71, 0.71, 0.69, 0.61, respectively). Thoracotomy frequency, intraoperative bleeding, operative time, and postoperative hospitalization were significantly greater in these patients than in those with non-severe adhesions.

Conclusions

The ultrasound sliding lung sign could be used to predict severe intrathoracic adhesions before surgery. Preoperative confirmation of the ultrasound sliding lung sign is important for planning surgical approaches and implementing appropriate safety management.

Applying the science of learning to the teaching and learning of surgical skills: The basics of surgical education

The changing climate of surgical education has led to a renewed interest in the process of learning. Research from the fields of cognitive and educational psychology, neuroscience, sociology, and behavioral economics have clear implications for the teaching and learning of psychomotor skills. This article summarizes how key learning theories impact the field of surgical education and proposes practical tips, supported by the science of learning, that can be applied to optimize resident and fellow education.

Results of exploratory investigation into adherence to auditory coping instructions during an acutely stressful task

Healthcare providers often perform under significant stress, during which their performance must be optimal, but is known to suffer. Stress management interventions in this context can provide cognitive support to rescue performance. This exploratory study sought to evaluate the effect of stress intervention components on stress and performance while clinicians engaged in two versions of a computer-based task, differing in overall level of demand: one high-stress and one low-stress. Participants (N = 45) were assigned to one of five groups (N = 9 per group), where they each completed both versions of the task, under different conditions of cognitive support. Group 1 received no intervention; Group 2 received biofeedback; and Group 3 received biofeedback and explicit coping instructions. Group 4 received emotional intelligence training, and Group 5 received emotional intelligence training and biofeedback. We hypothesized that Group 3 participants would present the lowest self-reported and physiological measures of stress, and the highest performance. Results reveal that the high-stress task induced significantly higher self-reported and physiological stress/anxiety, and lower task performance. No significant main effects of experimental condition or interaction effects were detected, indicating that intervention components had minimal effect on stress and performance. However, ultra-short term physiological analysis, analyzing <5 min of HRV data, revealed significantly decreased stress (SDNN, the standard deviation of normal-to-normal peaks) following auditory coping instructions. Exploratory study results suggest that although cognitive intervention components had minimal effect on stress and performance, physiological stress may be significantly reduced immediately following adherence to a coping instruction intervention. Future work is needed.Lay summaryThis exploratory study evaluated the potential benefit of providing healthcare practitioners with various stress management components during an acutely stressful task. Our results support the positive effect of following behavioral coping instructions on immediate physiological measures of stress.

Clinical and Nonclinical Effects on Operative Duration: Evidence from a Database on Thoracic Surgery

Background

Due to the high maintenance costs, it is critical to make full use of operating rooms (ORs). Operative duration is an important factor that guides research on surgery scheduling. Clinical effects, for example, surgery type, rationally influences operative duration. In this study, we also investigate whether the planning and scheduling decisions in ORs influence the operative duration.

Methods

For our study, we collected and reviewed data on 2,451 thoracic operations from a large hospital in China. The study was conducted over a period of 34 months. Linear and nonlinear regression models were used to detect the effects on the duration of the operations. We have also examined interactions between the factors.

Results

Operative duration decreased with the number of operations a surgeon performed in a day (P < 0.001). It was also found that operative duration decreased with the number of operations allocated to an OR, as long as there were not more than four surgeries per day (P < 0.001). It was also found that operative duration decreased with the number of operations allocated to an OR, as long as there were not more than four surgeries per day (P < 0.001). It was also found that operative duration decreased with the number of operations allocated to an OR, as long as there were not more than four surgeries per day (.

Conclusions

Operative duration was affected not only due to clinical effects but also some nonclinical effects. Scheduling decisions significantly influenced operative duration.

Determining the Effect of External Stressors and Cognitive Distraction on Microsurgical Skills and Performance

Introduction: Microsurgery is an essential element of Plastic Surgery practice. There is a paucity of studies assessing the impact of stress and cognitive distraction on technical microsurgical performance. The ability to complete cognitive and technical skills in parallel has not been assessed in a microsurgical setting.

Aim: To test the hypothesis that cognitive distraction and external stressors negatively affect microsurgical performance in a high fidelity simulation setting.

Materials/Methods: Fourteen surgeons across all levels of training undertook 2 microsurgical skills sessions, 1 month apart. Session one established baseline microsurgical skill. In session two, skills were assessed with the introduction of realistic operative room cognitive distractions (ORDIs). Outcome measures were efficiency and accuracy, measured by Time to Completion (TTC) and Anastomosis Lapse Index (ALI), respectively.

Key Results: Fourteen participants (6 novices, 5 plastic surgery specialist trainees and 3 consultants) completed both microsurgical skills sessions. In total, 28-microvascular anastomosis were analyzed. Mean baseline TTC for the group was 20.36 min. With cognitive distraction and external stress mean TTC decreased to 17.87 min. Mean baseline ALI score for the group was 3.32 errors per anastomosis. The introduction of cognitive distraction and external stress increased the mean to 4.86 errors per anastomosis. Total errors per anastomosis increased from 91 errors at baseline to 137 errors with cognitive distraction and external stress. Under stress, participants were more efficient but had reduced anastomotic accuracy.

Conclusion: Under stress, surgeons were more efficient, this translated into faster completion of a microsurgical anastomosis. Efficiency, however, came at the expense of accuracy.

Virtual reality in spinal endoscopy: a paradigm shift in education to support spine surgeons

BACKGROUND

Minimally invasive spine surgery (MISS) and endoscopic spine surgery have continually evolving indications in the cervical, thoracic, and lumbar spine. Endoscopic spine surgery entails treatment of disc disease, stenosis, spondylolisthesis, radiculopathy, and deformity. MISS involves complex motor skills in regions of variable anatomy. Simulator use has been proposed to aid in training and skill retention, preoperative planning, and intraoperative use.

METHODS

A systematic review of five databases was performed for publications pertaining to the use of virtual (VR), augmented (AR), and mixed (MR) reality in MISS and spinal endoscopic surgery. Qualitative data analysis was undertaken with focus of study design, quality, and reported outcomes. Study quality was assessed using the Medical Education Research Quality Instrument (MERSQI) score and level of evidence (LoE) by a modified Oxford Centre for Evidence-Based Medicine (OCEBM) level for simulation in medicine.

RESULTS

Thirty-eight studies were retained for data collection. Studies were of intervention-control, clinical application, and pilot or cross-sectional design. Identified articles illustrated use of VR, AR, and MR in all study designs. Procedures included pedicle cannulation and screw insertion, vertebroplasty, kyphoplasty, percutaneous transforaminal endoscopic discectomy (PTED), lumbar puncture and facet injection, transvertebral anterior cervical foraminotomy (TVACF) and posterior cervical laminoforaminotomy. Overall MERSQI score was low-to-medium [M =9.71 (SD =2.60); range, 4.5-13.5], and LoE was predominantly low given the number of purely descriptive articles, or low-quality randomized studies.

CONCLUSIONS

The current scope of VR, AR, and MR surgical simulators in MISS and spinal endoscopic surgery was described. Studies demonstrate improvement in technical skill and patient outcomes in short term follow-up. Despite this, overall study quality and levels of evidence remain low. Cohesive study design and reporting with focus on transfer validity in training scenarios, and patient derived outcome measures in clinical studies are required to further advance the field.

Interruptions in Surgery: A Comprehensive Review

BACKGROUND

Recent literature showed that analysis of interruptions can contribute to evaluating the care process in the operating room, and thus, understanding potential errors that may occur during surgical procedures. The aim of this comprehensive review was to summarize current knowledge on the description and impact of interruptions in surgery.

MATERIAL AND METHODS

A literature search was conducted according to a set of criteria in the databases MEDLINE, BASE, Cochrane's Library, and PsycINFO.

RESULTS

41 articles were included. Two main methodological approaches were found, observational in the OR, or controlled in an experimental simulated environment. Interruptions in the OR were manifold, and several classifications were used. The severity of interruptions differed according to the category of the interruptions. Interruptions were influenced by team familiarity and the expertise of the surgical team; high team familiarity and a high level of expertise decreased the frequency of interruptions. However, our literature search lacked controlled studies carried out in the OR. Interruptions seemed to increase the workload and stress of the surgical team and impair nontechnical skills, but no clear evidence of this was advanced.

CONCLUSIONS

Interruptions are probably risk factors for errors in the operating room. However, there is as yet no clear evidence of the association of interruption frequency with errors in the operating room. There is a need to define and target interruptions, which should be reduced by putting safeguards in place, thereby allowing those which could be beneficial and neglecting those with no potential consequences.

Interruptions in Health Care: Assessing Their Connection With Error and Patient Harm

OBJECTIVE

We address the problem of how researchers investigate the actual or potential causal connection between interruptions and medical errors, and whether interventions might reduce the potential for harm.

BACKGROUND

It is widely assumed that interruptions lead to errors and patient harm. However, many reviewers and authors have commented that there is not strong evidence for a causal connection.

METHOD

We introduce a framework of criteria for assessing how strongly evidence implies causality: the so-called Bradford Hill criteria. We then examine four key "metanarratives" of research into interruptions in health care-applied cognitive psychology, epidemiology, quality improvement, and cognitive systems engineering-and assess how each tradition has addressed the causal connection between interruptions and error.

RESULTS

Outcomes of applying the Bradford Hill criteria are that the applied cognitive psychology and epidemiology metanarratives address the causal connection relatively directly, whereas the quality improvement metanarrative merely assumes causality, and the cognitive systems engineering metanarrative either implicitly or explicitly questions the feasibility of finding a direct causal connection with harm.

CONCLUSION

The Bradford Hill criteria are useful for evaluating the existing literature on the relationship between interruptions in health care, clinical errors, and the potential for patient harm. In the future, more attention is needed to the issue of why interruptions usually do not lead to harm, and the implications for how we approach patient safety.

Teaching robotic rectal cancer surgery at your workplace: does the presence of visiting surgeons in the operating room have a detrimental effect on outcomes?

BACKGROUND

Surgery demonstration (SD) is considered to be a mainstay of surgical education, but controversy exists concerning the patient's safety. Indeed, the presence of visiting surgeons is a source of distraction and may have an impact on surgeon's performance. This study's objective was to evaluate possible differences in outcomes between robotic sphincter-saving rectal cancer surgery (RRCS) performed during routine surgical practice versus in the presence of visiting surgeons in the operating room (OR) with direct access to the surgeon.

METHODS

Retrospective case-matched studies were conducted from a prospectively collected database. 114 patients (38 with the presence of visiting surgeons) who underwent RRCS between January 2013 and September 2018 were included. Patients were matched in a 1:2 basis after propensity score analysis using five criteria: gender, body mass index, preoperative chemoradiation, type of mesorectum excision, and synchronous liver metastasis.

RESULTS

There was no difference between the two groups with regard to mean operating time, estimated blood loss, conversion, and hospital stay. Also, overall (44% vs. 40%; P = 0.6), major morbidity (26% vs. 19%; P = 0.5), and unplanned reoperation (17% vs. 15%; P = 1.0) rates were not statistically different. No difference was noted with regard to the quality of mesorectum excision, or positive rate of circumferential and distal longitudinal resection margins. The mean number of harvested lymph nodes (17 vs. 14.5; P = 0.04) was lower in the SD group and the number of patients with < 12 harvested lymph nodes (31% vs. 16%; P = 0.09) was greater after SD although it did not reach statistical significance. No differences were observed in disease-free or overall survival.

CONCLUSIONS

The presence of visiting surgeons in the OR seems not to interfere in the quality of rectal resection and does not compromise patient's short-term outcome and survival. However, mild differences in the extent of lymphadenectomy were observed and the surgeons performing SD may be aware of this.

[Team training and assessment in mixed reality-based simulated operating room : Current state of research in the field of simulation in spine surgery exemplified by the ATMEOS project]

Surgical simulators are being increasingly used as an attractive alternative to clinical training in addition to conventional animal models and human specimens. Typically, surgical simulation technology is designed for the purpose of teaching technical surgical skills (so-called task trainers). Simulator training in surgery is therefore in general limited to the individual training of the surgeon and disregards the participation of the rest of the surgical team. The objective of the project Assessment and Training of Medical Experts based on Objective Standards (ATMEOS) is to develop an immersive simulated operating room environment that enables the training and assessment of multidisciplinary surgical teams under various conditions. Using a mixed reality approach, a synthetic patient model, real surgical instruments and radiation-free virtual X‑ray imaging are combined into a simulation of spinal surgery. In previous research studies, the concept was evaluated in terms of realism, plausibility and immersiveness. In the current research, assessment measurements for technical and non-technical skills are developed and evaluated. The aim is to observe multidisciplinary surgical teams in the simulated operating room during minimally invasive spinal surgery and objectively assess the performance of the individual team members and the entire team. Moreover, the effectiveness of training methods and surgical techniques or success critical factors, e. g. management of crisis situations, can be captured and objectively assessed in the controlled environment.

Cognitive load theory for training health professionals in the workplace: A BEME review of studies among diverse professions: BEME Guide No. 53

AIM

Cognitive load theory (CLT) is of increasing interest to health professions education researchers. CLT has intuitive applicability to workplace settings, yet how CLT should inform teaching, learning, and research in health professions workplaces is unclear.

METHOD

To map the existing literature, we performed a scoping review of studies involving cognitive load, mental effort and/or mental workload in professional workplace settings within and outside of the health professions. We included actual and simulated workplaces and workplace tasks.

RESULT

Searching eight databases, we identified 4571 citations, of which 116 met inclusion criteria. Studies were most often quantitative. Methods to measure cognitive load included psychometric, physiologic, and secondary task approaches. Few covariates of cognitive load or performance were studied. Overall cognitive load and intrinsic load were consistently negatively associated with the level of experience and performance. Studies consistently found distractions and other aspects of workplace environments as contributing to extraneous load. Studies outside the health professions documented similar findings to those within the health professions, supporting relevance of CLT to workplace learning.

CONCLUSION

The authors discuss implications for workplace teaching, curricular design, learning environment, and metacognition. To advance workplace learning, the authors suggest future CLT research should address higher-level questions and integrate other learning frameworks.

Say, What Is on Your Mind? Surgeons' Evaluations of Realism and Usability of a Virtual Reality Vertebroplasty Simulator

BACKGROUND

Virtual reality (VR)-based simulations offer rich opportunities for surgical skill training and assessment of surgical novices and experts. A structured evaluation and validation process of such training and assessment tools is necessary for effective surgical learning environments.

OBJECTIVE

To develop and apply a classification system of surgeon-reported experience during operation of a VR vertebroplasty simulator.

METHODS

A group of orthopedic, trauma surgeons and neurosurgeons (n = 13) with various levels of expertise performed on a VR vertebroplasty simulator. We established a mixed-methods design using think-aloud protocols, senior surgical expert evaluations, performance metrics, and a post-simulation questionnaire. Verbal content was systematically analyzed using structured qualitative content analysis. We established a category system for classification of surgeons' verbal evaluations during the simulation. Furthermore, we evaluated intraoperative performance metrics and explored potential associations with surgeons' characteristics and simulator evaluation.

RESULTS

Overall, 244 comments on realism and usability of the vertebroplasty simulator were collected. This included positive and negative remarks, questions, and specific suggestions for improvement. Further findings included surgeons' approval of the realism and usability of the simulator and the observation that the haptic feedback of the VR patient's anatomy requires further improvement. Surgeon-reported evaluations were not associated with performance decrements.

DISCUSSION

This study is the first to apply think-aloud protocols for evaluation of a surgical VR-based simulator. A novel classification approach is introduced that can be used to classify surgeons' verbalized experiences during simulator use. Our lessons learned may be valuable for future research with similar methodological approach.

A pilot study of non-routine events in gynecological surgery: Type, impact, and effect

OBJECTIVE

Quantifying non-routine events (NREs) assists with identify underlying sociotechnical factors that could lead to adverse events. NREs are considered any event that is unusual or atypical during surgical procedures. This study aimed to use prospective observations to characterize the occurrence of non-routine events in gynecological surgeries.

METHODS

Observational data were collected prospectively within one surgical gynecology department over a five month period. Researchers captured NREs in real time using a validated tablet PC-based tool according to the NRE type, impact, whom was affected, and duration. Researchers also noted what surgical approach (i.e. open, laparoscopic, robotic) was used.

RESULTS

Across 45 surgical cases, 554 non-routine events (M = 12.31 NREs per case, SD = 9.81) were identified. The majority of non-routine events were external interruptions (40.3%), teamwork (26.7%), or equipment (21.3%). The circulating nurse was most frequently affected by NREs (43.2%) followed by the entire surgical team (13.7%). There was no statistically significant difference in non-routine events based on surgical approach.

CONCLUSION

Non-routine events are prevalent in the gynecological surgical setting. Identifying the sociotechnical factors that influence non-routine events are important in determining interventions that will combat the associated risks. Interventions focusing on teamwork, managing external interruptions, and coordinating equipment may have the greatest impact to reduce or eliminate NREs in gynecological surgeries.

Effects of Flow Disruptions on Mental Workload and Surgical Performance in Robotic-Assisted Surgery

BACKGROUND

Robotic systems introduced new surgical and technical demands. Surgical flow disruptions are critical for maintaining operating room (OR) teamwork and patient safety. Specifically for robotic surgery, effects of intra-operative disruptive events for OR professionals' workload, stress, and performance have not been investigated yet. This study aimed to identify flow disruptions and assess their association with mental workload and performance during robotic-assisted surgery.

METHODS

Structured expert-observations to identify different disruption types during 40 robotic-assisted radical prostatectomies were conducted. Additionally, 216 postoperative reports on mental workload (mental demands, situational stress, and distractions) and performance of all OR professionals were collected.

RESULTS

On average 15.8 flow disruptions per hour were observed with the highest rate after abdominal insufflation and before console time. People entering the OR caused most flow disruptions. Disruptions due to equipment showed the highest severity of interruption. Workload significantly correlated with severity of disruptions due to coordination and communication.

CONCLUSIONS

Flow disruptions occur frequently and are associated with increased workload. Therefore, strategies are needed to manage disruptions to maintain OR teamwork and safety during robotic-assisted surgery.

More Than Talking About the Weekend: Content of Case-Irrelevant Communication Within the OR Team

BACKGROUND

Case-irrelevant communication (CIC) is defined as "any conversation" irrelevant to the case. It includes small talk, but also communication related to other work issues besides the actual task. CIC during surgeries is generally seen as distracting, despite a lack of knowledge about the content of CIC and its regulation in terms of adjustments to the situation of CIC. Primary goal of the study was to evaluate CIC content; secondary goal was to evaluate whether surgical teams regulate CIC according to different concentration demands of surgical procedures.

METHODS

In 125 surgeries, 1396 CIC events were observed. CIC were content coded into work-related CIC (pertaining to other tasks or work in general) and social CIC (pertaining to acquaintance talk, gossip, or private conversation). The impact of different phases and the difficulty of the surgical procedure on CIC were assessed.

RESULTS

Work-related CIC were significantly more frequent (2.49 per hour, SD = 2.17) than social CIC (1.42 per hour, SD = 2.17). Across phases, frequency of work-related CIC was constant, whereas social CIC increased significantly across phases. In surgeries assessed as highly difficult by the surgeons, social CIC were observed at a lower frequency, and less work-related CIC were observed during the main phase compared to surgeries assessed as less difficult.

CONCLUSION

The high proportion of work-related CIC indicates that surgical teams deal with other tasks during surgeries. Surgical teams adapt CIC according to the demands of the procedure. Hospital policies should support these adaptations rather than attempt to suppress CIC entirely.

Intelligent Interruption Management System to Enhance Safety and Performance in Complex Surgical and Robotic Procedures

Procedural flow disruptions secondary to interruptions play a key role in error occurrence during complex medical procedures, mainly because they increase mental workload among team members, negatively impacting team performance and patient safety. Since certain types of interruptions are unavoidable, and consequently the need for multitasking is inherent to complex procedural care, this field can benefit from an intelligent system capable of identifying in which moment flow interference is appropriate without generating disruptions. In the present study we describe a novel approach for the identification of tasks imposing low cognitive load and tasks that demand high cognitive effort during real-life cardiac surgeries. We used heart rate variability analysis as an objective measure of cognitive load, capturing data in a real-time and unobtrusive manner from multiple team members (surgeon, anesthesiologist and perfusionist) simultaneously. Using audio-video recordings, behavioral coding and a hierarchical surgical process model, we integrated multiple data sources to create an interactive surgical dashboard, enabling the identification of specific steps, substeps and tasks that impose low cognitive load. An interruption management system can use these low demand situations to guide the surgical team in terms of the appropriateness of flow interruptions. The described approach also enables us to detect cognitive load fluctuations over time, under specific conditions (e.g. emergencies) or in situations that are prone to errors. An in-depth understanding of the relationship between cognitive overload states, task demands, and error occurrence will drive the development of cognitive supporting systems that recognize and mitigate errors efficiently and proactively during high complex procedures.

Ergonomic Assessment of the Mental Workload Confronted by Surgeons during Laparoscopic Surgery

Although the mental workload confronted by laparoscopic surgeons is rather high, there is presently no reliable, established method for evaluating this workload. In the present study, four evaluation indices of eye movement metrics were applied to evaluate surgeons’ mental workload. Correlations between these indices and National Aeronautics and Space Administration Task Load Index (NASA-TLX) scores were also explored. Sixteen participants were recruited to complete four laparoscopic procedures. Eye movement was recorded during the tasks, and NASA-TLX scales were also introduced for subjective evaluation. The data were analyzed using R 3.3.2. Significant differences in the mental workload of each task were observed. Statistically significant correlations between mean pupil diameter change and NASA-TLX scores were also observed. The correlation coefficients were 0.763, 0.675, 0.405, and 0.547, and the P values correspondingly were 0.001, 0.004, 0.12, and 0.028, respectively. The results clarify that the mental workload of laparoscopic surgeons is dependent on the specific demands of the operation. Appropriate objective physiological indices can be used to identify the mental workload state of the surgeon.

Timing of Coping Instruction Presentation for Real-time Acute Stress Management: Potential Implications for Improved Surgical Performance

Individual performance on complex healthcare tasks can be influenced by acutely stressful situations. Real-time biofeedback using passive physiological monitoring may help to better understand an individual's progression towards acute stress-induced performance decrement. Providing biofeedback at an appropriate time may provide learners within an indicator that their current performance is susceptible to a decrement, and offer the opportunity to intervene. We explored the presentation timing of coping instructions during an acutely stressful task. In this pilot study, we recorded and analyzed electrocardiography data surrounding coping instruction presentation on various time schedules while participants played a first-person shooter computer game. Around times of significantly elevated heart rate, an indicator of acute stress, presenting a coping instruction tended to result in an increase in heart rate variability (HRV) following its presentation, with a more marked effect in high-stress conditions; not presenting a coping instruction at this time tended to result in a decrease in HRV in high-stress conditions, and no change in low-stress conditions. HRV following instruction presentation tended to increase in both high- and low-stress conditions when the instruction was presented at times of elevated heart rate; there was very little change in HRV when instruction presentation was not bound to physiology. Performance data showed that better performance was associated with greater adherence to coping instructions, compared to when zero instructions were followed. Implications for healthcare are significant, as acute stress is constant and it is necessary for providers to maintain a high level of performance.