Measuring mental workload during the performance of advanced laparoscopic tasks

Sensorimotor Challenges in Minimally Invasive Surgery: A Theoretically-Oriented Review

OBJECTIVE

This review surveys the literature on sensorimotor challenges impacting performance in laparoscopic minimally invasive surgery (MIS).

BACKGROUND

Despite its well-known benefits for patients, achieving proficiency in MIS can be challenging for surgeons due to many factors including altered visual perspectives and fulcrum effects in instrument handling. Research on these and other sensorimotor challenges has been hindered by imprecise terminology and the lack of a unified theoretical framework to guide research questions in the field.

METHOD

We conducted a systematic survey of the MIS literature, focusing on studies investigating sensorimotor challenges affecting laparoscopic performance. To provide a common foundation for cross-study comparisons, we propose a standardized taxonomy that distinguishes between different experimental paradigms used in the literature. We then show how the computational motor learning perspective provides a unifying theoretical framework for the field that can facilitate progress and motivate future research along clearer, hypothesis-driven lines.

RESULTS

The survey identified diverse sensorimotor perturbations in MIS, which can be effectively categorized according to our proposed taxonomy. Studies investigating monitor-, camera-, and tool-based perturbations were systematically analyzed, elucidating their impact on surgical performance. We also show how the computational motor learning perspective provides deeper insights and potential strategies to mitigate challenges.

CONCLUSION

Sensorimotor challenges significantly impact MIS, necessitating a systematic, empirically informed approach. Our proposed taxonomy and theoretical framework shed light on the complexities involved, paving the way for more structured research and targeted training approaches to enhance surgical proficiency.

APPLICATION

Understanding the sensorimotor challenges inherent to MIS can guide the design of improved training curricula and inform the configuration of setups in the operating room to enhance surgeon performance and ultimately patient outcomes. This review offers key insights for surgeons, educators, and researchers in surgical performance and technology development.

Comparison Between Scene-Independent and Scene-Dependent Eye Metrics in Assessing Psychomotor Skills

OBJECTIVE

This study aims to compare the relative sensitivity between scene-independent and scene-dependent eye metrics in assessing trainees' performance in simulated psychomotor tasks.

BACKGROUND

Eye metrics have been extensively studied for skill assessment and training in psychomotor tasks, including aviation, driving, and surgery. These metrics can be categorized as scene-independent or scene-dependent, based on whether predefined areas of interest are considered. There is a paucity of direct comparisons between these metric types, particularly in their ability to assess performance during early training.

METHOD

Thirteen medical students practiced the peg transfer task in the Fundamentals of Laparoscopic Surgery. Scene-independent and scene-dependent eye metrics, completion time, and tool motion metrics were derived from eye-tracking data and task videos. K-means clustering of nine eye metrics identified three groups of practice trials with similar gaze behaviors, corresponding to three performance levels verified by completion time and tool motion metrics. A random forest model using eye metrics estimated classification accuracy and determined the feature importance of the eye metrics.

RESULTS

Scene-dependent eye metrics demonstrated a clearer linear trend with performance levels than scene-independent metrics. The random forest model achieved 88.59% accuracy, identifying the top four predictors of performance as scene-dependent metrics, whereas the two least effective predictors were scene-independent metrics.

CONCLUSION

Scene-dependent eye metrics are overall more sensitive than scene-independent ones for assessing trainee performance in simulated psychomotor tasks.

APPLICATION

The study's findings are significant for advancing eye metrics in psychomotor skill assessment and training, enhancing operator competency, and promoting safe operations.

Experimental evaluation of accuracy and efficiency of two control strategies for a novel foot commanded robotic laparoscope holders with surgeons

The implementation of a laparoscope-holding robot in minimally invasive surgery enhances the efficiency and safety of the operation. However, the extra robot control task can increase the cognitive load on surgeons. A suitable interface may simplify the control task and reduce the surgeon load. Foot interfaces are commonly used for commanding laparoscope-holding robots, with two control strategies available: decoupled control permits only one Cartesian axis actuation, known as decoupled commands; hybrid control allows for both decoupled commands and multiple axes actuation, known as coupled commands. This paper aims to determine the optimal control strategy for foot interfaces by investigating two common assumptions in the literature: (1) Decoupled control is believed to result in better predictability of the final laparoscopic view orientation, and (2) Hybrid control has the efficiency advantage in laparoscope control. Our user study with 11 experienced and trainee surgeons shows that decoupled control has better predictability than hybrid control, while both approaches are equally efficient. In addition, using two surgery-like tasks in a simulator, users' choice of decoupled and coupled commands is analysed based on their level of surgical experience and the nature of the movement. Results show that trainee surgeons tend to issue more commands than the more experienced participants. Single decoupled commands were frequently used in small view adjustments, while a mixture of coupled and decoupled commands was preferred in larger view adjustments. A guideline for foot interface control strategy selection is provided.

Mental workload profile and its relationship with presenteeism, absenteeism and job performance among surgeons: The mediating role of occupational fatigue

Introduction

Surgeons are one of the most significant jobs in the health care system that plays an important role in the patients' health promotion and their treatment. In the current study, the effect of mental workload on the work performance of surgeons was tested by considering the mediating effect of fatigue on this relationship.

Method

This study was done analytically on 165 surgeons working in the operating rooms of hospitals in Iran. To determine of mental workload, the SURG-TLX method was used. The job performance was measured using the short version of the job performance questionnaire provided by the World Health Organization (WHO-HPQ), and accordingly relative presenteeism, relative absenteeism and job performance variables were calculated. The Swedish Occupational Fatigue Inventory (SOFI) questionnaire was used to determine occupational fatigue. A conceptual model was built to determine the direct and indirect relationship between mental workload and job performance, and the mediating effect of occupational fatigue on the relationship between mental workload and job performance was tested using structural equation modeling (SEM).

Results

Out of 165 distributed questionnaires, 140 questionnaires were completed and delivered to the researchers (85% response rate). The mean ± standard deviations of mental workload, fatigue, and work performance were 16.57 ± 5.83, 6.32 ± 2.86, and 0.65 ± 0.28, respectively. The results of model fit indexes revealed that all indexes are within the acceptable range. Regarding this model, the direct effect of mental workload on job performance was not significant (β = -0.21; p = 0.072). A significant positive relationship was observed between mental workload and fatigue (β = 0.36; p < 0.001). The direct effect of fatigue on job performance was also the opposite and statistically significant (β = -0.39; p < 0.001). Finally, results indicated that the effect of mental workload on work performance mediated by occupational fatigue.

Conclusion

Surgeons suffer a high level of mental workload during their work, and this factor can have a negative effect on surgeons' job performance. The effect of mental workload on job performance in surgeons can be detected, directly and indirectly, through the mediating effect of occupational fatigue. Improving the mental and physical conditions of the work environment can reduce occupational fatigue and improve surgeons' job performance.

Fundamentals of Microsurgery: A Novel Simulation Curriculum Based on Validated Laparoscopic Education Approaches

BACKGROUND

 Microsurgical techniques have a steep learning curve. We adapted validated surgical approaches to develop a novel, competency-based microsurgical simulation curriculum called Fundamentals of Microsurgery (FMS). The purpose of this study is to present our experience with FMS and quantify the effect of the curriculum on resident performance in the operating room.

METHODS

 Trainees underwent the FMS curriculum requiring task progression: (1) rubber band transfer, (2) coupler tine grasping, (3) glove laceration repair, (4) synthetic vessel anastomosis, and (5) vessel anastomosis in a deep cavity. Resident anastomoses were also evaluated in the operative room with the Stanford Microsurgery and Resident Training (SMaRT) tool to evaluate technical performance. The National Aeronautics and Space Administration Task Load Index (NASA-TLX) and Short-Form Spielberger State-Trait Anxiety Inventory (STAI-6) quantified learner anxiety and workload.

RESULTS

 A total of 62 anastomoses were performed by residents in the operating room during patient care. Higher FMS task completion showed an increased mean SMaRT score (p = 0.05), and a lower mean STAI-6 score (performance anxiety) (p = 0.03). Regression analysis demonstrated residents with higher SMaRT score had lower NASA-TLX score (mental workload) (p < 0.01) and STAI-6 scores (p < 0.01).

CONCLUSION

 A novel microsurgical simulation program FMS was implemented. We found progression of trainees through the program translated to better technique (higher SMaRT scores) in the operating room and lower performance anxiety on STAI-6 surveys. This suggests that the FMS curriculum improves proficiency in basic microsurgical skills, reduces trainee mental workload, anxiety, and improves intraoperative clinical proficiency.

Unpacking the Broad Landscape of Intraoperative Stressors for Clinical Personnel: A Mixed-Methods Systematic Review

Purpose

The main goals of this mixed-methods systematic review are to identify what types of intraoperative stressors for operating room personnel have been reported in collected studies and examine the characteristics of each intraoperative stressor.

Methods

With a systematic literature search, we retrieved empirical studies examining intraoperative stress published between 2010 and 2020. To synthesize findings, we applied two approaches. First, a textual narrative synthesis was employed to summarize key study information of the selected studies by focusing on surgical platforms and study participants. Second, a thematic synthesis was employed to identify and characterize intraoperative stressors and their subtypes.

Results

Ninety-four studies were included in the review. Regarding the surgical platforms, the selected studies mainly focused on minimally invasive surgery and few studies examined issues around robotic surgery. Most studies examined intra-operative stress from surgeons' perspectives but rarely considered other clinical personnel such as nurses and anesthetists. Among seven identified stressors, technical factors were the most frequently examined followed by individual, operating room environmental, interpersonal, temporal, patient, and organizational factors.

Conclusion

By presenting stressors as multifaceted elements affecting collaboration and interaction between multidisciplinary team members in the operating room, we discuss the potential interactions between stressors which should be further investigated to build a safe and efficient environment for operating room personnel.

Eye tracking metrics of orthopedic surgeons with different competency levels who practice simulation-based hip arthroscopic procedures

Objective

This study aimed to investigate the feasibility of using eye tracking data to identify orthopedic trainees' technical proficiency in hip arthroscopic procedures during simulation-based training.

Design

A cross sectional study.

Setting

A simulation-based training session for hip arthroscopy was conducted. Eye tracking devices were used to record participants' eye movements while performing simulated operations. The NASA Task Load Index survey was then used to measure subjective opinions on the perceived workload of the training. Statistical analyses were performed to determine the significance of the eye metrics and survey data.

Participants

A total of 12 arthroscopic trainees, including resident doctors, junior specialist surgeons, and consultant surgeons from the Department of Orthopedics in five hospitals, participated in this study. They were divided into three subgroups based on their prior clinical experience.

Results

Significant differences, including those for dwell time, number of fixations, number of saccades, saccade duration, peak velocity of the saccade, and pupil entropy, were observed among the three subgroups. Additionally, there were clear trends in the perceived workload of the simulation-based training based on feedback from the participants.

Conclusion

Based on this preliminary study, a correlation was identified between the eye tracking metrics and participants' experience levels. Hence, it is feasible to apply eye tracking data as a supplementary objective assessment tool to benchmark the technical proficiency of surgical trainees in hip arthroscopy, and enhance simulation-based training.

Surgeons' workload assessment during indocyanine-assisted deep endometriosis surgery using the surgery task load index: The impact of the learning curve

Objective

Assess the surgeons' workload during deep endometriosis surgery after ureteral ICG

Design

Prospective, consecutive, comparative, single-center study

Population

41 patients enrolled to deep endometriosis surgery with ureteral ICG from January 2019 to July 2021 at La Paz University Hospital

Methods

Patients were divided into 2 groups: patients operated during the learning curve of ureteral ICG instillation and patients operated after the technique was implemented and routinely performed. After surgery, the SURG-TLX form was completed by the surgeons. We evaluated whether a workload reduction occurred.

Main outcomes measures

Surgeon's workload was measured using the SURG-TLX form, obtaining the total workload and 6 different dimensions (distractions, temporal demands, task complexity, mental demands, situational stress and physical demands)

Results

A significant positive correlation was found between surgical complexity and situational stress (p = 0.04). Mental demands (p = 0.021), physical demands (p = 0.03), and total workload (p = 0.025) were significantly lower when the technique was routinely performed. The mental demand, physical demands, and total workload perceived by the surgeons at the beginning of the implementation was higher (68 [39–72], 27 [11–46.5], 229 [163–240], respectively) than in the latter ones (40 [9–63], 11.5 [0–32.8], 152 [133.3–213.8], respectively). Distractions appeared to be higher in the latter surgeries (8.5 [0–27.8]) than in the first surgeries (0 [0–7]; p = 0.057).

Conclusions

Ureter ICG instillation prior to DE surgery significantly reduces the mental and physical demands and total workload of the surgeons in DE surgeries after overcoming the learning curve. Distractions appear to increase as surgical stress decreases.

Automating Endoscope Motion in Robotic Surgery: A Usability Study on da Vinci-Assisted Ex Vivo Neobladder Reconstruction

Robots for minimally invasive surgery introduce many advantages, but still require the surgeon to alternatively control the surgical instruments and the endoscope. This work aims at providing autonomous navigation of the endoscope during a surgical procedure. The autonomous endoscope motion was based on kinematic tracking of the surgical instruments and integrated with the da Vinci Research Kit. A preclinical usability study was conducted by 10 urologists. They carried out an ex vivo orthotopic neobladder reconstruction twice, using both traditional and autonomous endoscope control. The usability of the system was tested by asking participants to fill standard system usability scales. Moreover, the effectiveness of the method was assessed by analyzing the total procedure time and the time spent with the instruments out of the field of view. The average system usability score overcame the threshold usually identified as the limit to assess good usability (average score = 73.25 > 68). The average total procedure time with the autonomous endoscope navigation was comparable with the classic control (p = 0.85 > 0.05), yet it significantly reduced the time out of the field of view (p = 0.022 < 0.05). Based on our findings, the autonomous endoscope improves the usability of the surgical system, and it has the potential to be an additional and customizable tool for the surgeon that can always take control of the endoscope or leave it to move autonomously.

NASA-TLX assessment of workload in resident physicians and faculty surgeons covering trauma, surgical intensive care unit, and emergency general surgery services

BACKGROUND

Higher workload is associated with burnout and lower performance. Therefore, we aim to assess shift-related factors associated with higher workload on EGS, ICU, and trauma surgery services.

METHODS

In this prospective cohort study, faculty surgeons and surgery residents completed a survey after each EGS, ICU, or trauma shift, including shift details and a modified NASA-TLX.

RESULTS

Seventeen faculty and 12 residents completed 174 and 48 surveys after working scheduled 12-h and 24-h shifts, respectively (response rates: faculty - 62%, residents - 42%). NASA-TLX was significantly increased with a higher physician subjective fatigue level. Further, seeing more consults or performing more operations than average significantly increased workload. Finally, NASA-TLX was significantly higher for faculty when they felt their shift was more difficult than expected.

CONCLUSIONS

Higher volume clinical responsibilities and higher subjective fatigue levels are independently associated with higher workload. Designing shift coverage to expand on busier days may decrease workload, impacting burnout and shift performance.

The Selection of Main Surgical Work Factors in Operating Rooms

The main component of error minimization in operating rooms (ORs) is to maintain high reliability of surgical teams. The analysis of adverse events in the OR reveals deficiencies in cognitive and interpersonal skills as the main factors influencing surgeons’ errors. Therefore, research of these additional factors is necessary, besides factors related to surgeons’ clinical knowledge and technical skills. In this paper, the key factors for evaluating activities in surgical operating rooms are identified. Fuzzy analytic hierarchy process is used for identification of key factors. Fifteen key factors are identified for evaluating activities in surgical operating rooms to improve the efficiency of surgical operations. For each group of activities (surgical “capabilities,” operating room characteristics, and non-technical skills), five factors are identified. As the most important, the following factors are obtained: communication, indoor environment standardization, and tool handle design. The aim of the analysis of these key factors is surgeons’ work capability enhancement, rational design of operating rooms, and advancement of operators’ cognitive and interpersonal skills.

Uniportal versus multiportal thoracoscopic lobectomy: Ergonomic evaluation and perioperative outcomes from a randomized and controlled trial

BACKGROUND

To compare perioperative outcomes and surgeon physical and mental stress when performing lobectomy through uniportal and multiportal video-assisted thoracoscopic surgery (VATS) on patients with non-small-cell lung cancer (NSCLC).

METHODS

Patients aged 41 to 73 years with resectable NSCLC were randomly assigned via a computer-generated randomisation sequence to receive either uniportal VATS (UVATS) or multiportal VATS (MVATS) lobectomy and lymphadenectomy between December 2015 and October 2016. Overall, we randomly assigned 35 patients to the UVATS and 34 to the MVATS group. Patients and the investigators undertaking interventions, assessing short-term outcomes, performing ergonomic evaluations, and analyzing data were not masked to group assignment.

RESULTS

Patient demographics of the 2 groups were comparable. The ergonomic evaluation considered eye blink rate and the NASA Task Load Index (NASA-TLX), better results were observed in UVATS than in MVATS. The operative time, number of lymph nodes harvested, chest tube duration, length of hospital stay, and lung function were not significantly different between the groups. Compared with MVATS lobectomy, UVATS lobectomy was associated with less intraoperative blood loss and less volume of total drainage in the 24 hours. No conversion, no reoperation, and no in-hospital mortality occurred in either group.

CONCLUSIONS

UVATS lobectomy is a safe and programmable technique with some better perioperative outcomes and ergonomic results than MVATS. Further studies based on large numbers of patients and with long-term follow-up are required to confirm its benefits towards patients.

TRIAL REGISTRATION

ClinicalTrials.gov ID:NCT02462356. Registered May 27, 2015.

Effects of surgical flow disruptions on surgeons' resources: a pilot study

BACKGROUND

Minimally invasive surgery requires surgeons to allocate more attention and efforts than open surgery. A surgeon's pool of resource is affected by the multiple occurrences of interruptions and distractions in the operating room. Surgical flow disruption has been addressed from a quantitative perspective. However, little is known on its impact on the surgeons' physiological resources.

METHODS

Three physiological markers, heat flux (HF), energy expenditure in metabolic equivalent of tasks and galvanic skin response were recorded using body sensor monitoring during the 21 surgical operations. The three markers, respectively, represent: stress, energy mobilization and task engagement. A total of 8 surgeons with different levels of expertise (expert vs. novice) were observed performing 21 surgical procedures categorized as short versus long. Factors of distractions were time-stamped, and triangulated with physiological markers. Two cases illustrate the impact of surgical flow disruptions on the surgeons.

RESULTS

The results indicate that expert surgeons' mental schemata are better organized than novices. Additionally, the physiological markers indicate that novice surgeons display a higher HF at the start (tendency p = .059) and at the end of procedures (p = .001) when compared to experts. However, during longer procedures, expert surgeons have higher HF at the start (p = .041) and at the end (p = .026), than at the start and end of a short procedure.

CONCLUSION

Data collected during this pilot study showed that interruptions and disruptions affect novice and expert surgeons differently. Surgical flow disruption appears to be taxing on the surgeons' mental, emotional and physiological resources; as a function of the length and nature of the disruptions. Several training curricula have incorporated the use of virtual reality programs to train surgeons to cope with the new technology and equipment. We recommend integrating interruptions and distractions in virtual reality training programs as these impact the surgeons' pool of resources.

Physiological correlates of cognitive load in laparoscopic surgery

Laparoscopic surgery can be exhausting and frustrating, and the cognitive load experienced by surgeons may have a major impact on patient safety as well as healthcare economics. As cognitive load decreases with increasing proficiency, its robust assessment through physiological data can help to develop more effective training and certification procedures in this area. We measured data from 31 novices during laparoscopic exercises to extract features based on cardiac and ocular variables. These were compared with traditional behavioural and subjective measures in a dual-task setting. We found significant correlations between the features and the traditional measures. The subjective task difficulty, reaction time, and completion time were well predicted by the physiology features. Reaction times to randomly timed auditory stimuli were correlated with the mean of the heart rate (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r = - 0.29$$\end{document}r=-0.29) and heart rate variability (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$r = 0.4$$\end{document}r=0.4). Completion times were correlated with the physiologically predicted values with a correlation coefficient of 0.84. We found that the multi-modal set of physiology features was a better predictor than any individual feature and artificial neural networks performed better than linear regression. The physiological correlates studied in this paper, translated into technological products, could help develop standardised and more easily regulated frameworks for training and certification.

Robotics-Assisted Surgical Skills Evaluation based on Electrocortical Activity

Skills assessment in Robotics-Assisted Minimally Invasive Surgery (RAMIS) is mainly performed based on temporal, motion-based and outcome-based metrics. While these components are essential for the proper assessment of skills in RAMIS, they do not suffice for full representation of all underlying aspects of skilled performance. Besides such commonplace components of skills, there exist other elements to be taken into account for comprehensive skills assessment. Among such elements are cognitive states (such as levels of stress, attention, concentration) that can directly affect performance. Investigating the impact of electrocortical activity and cognitive states of RAMIS surgeons over their performance has, however, received little attention in the literature. Therefore, in this paper, novel performance metrics based on electroencephalography (EEG) signals are studied for potential augmentation into RAMIS training and its assessment platform. For this purpose, a user study was conducted involving 23 novices and 9 expert RAMIS surgeons. The participants were asked to perform two tasks on the dv-Trainer®, (Mimic Technologies) RAMIS simulator, while their brain EEG signals were being measured using the Muse EEG headband (InteraXon Inc.). The performance metrics were defined as mean values of band powers of EEG signals over various ranges of frequency. Statistical analysis was performed to evaluate metrics over 5 different ranges of frequency for 4 electrode locations and during 2 RAMIS training tasks. The results indicated statistically significant differences in electrocortical activity between novices and experts in temporoparietal and left frontal regions of their brain for mid to high-frequency ranges. Overall, RAMIS experts showed lower levels of electrocortical activity in those regions compared to novices. The results indicate that electrocortical activity measured by EEG signals have the potential to provide useful information for skills assessment in RAMIS.

Simulation platforms to assess laparoscopic suturing skills: a scoping review

BACKGROUND

Laparoscopic suturing (LS) has become a common technique used in a variety of advanced laparoscopic procedures. However, LS is a challenging skill to master, and many trainees may not be competent in performing LS at the end of their training. The purpose of this review is to identify simulation platforms available for assessment of LS skills, and determine the characteristics of the platforms and the LS skills that are targeted.

METHODS

A scoping review was conducted between January 1997 and October 2018 for full-text articles. The search was done in various databases. Only articles written in English or French were included. Additional studies were identified through reference lists. The search terms included "laparoscopic suturing" and "clinical competence."

RESULTS

Sixty-two studies were selected. The majority of the simulation platforms were box trainers with inanimate tissue, and targeted basic suturing and intracorporeal knot-tying techniques. Most of the validation came from internal structure (rater reliability) and relationship to other variables (compare training levels/case experience, and various metrics). Consequences were not addressed in any of the studies.

CONCLUSION

We identified many types of simulation platforms that were used for assessing LS skills, with most being for assessment of basic skills. Platforms assessing the competence of trainees for advanced LS skills were limited. Therefore, future research should focus on development of LS tasks that better reflect the needs of the trainees.

Comparison of 3- vs 2-Dimensional Endoscopy Using Eye Tracking and Assessment of Cognitive Load Among Surgeons Performing Endoscopic Ear Surgery

Importance

Endoscopic ear surgery (EES) is an emerging technique to treat middle ear diseases; however, the interventions are performed in 2-dimensional (2D) endoscopic views, which do not provide depth perception. Recent technical developments now allow the application of 3-dimensional (3D) endoscopy in EES.

Objective

To investigate the usability, advantages, and disadvantages of 3D vs 2D endoscopy in EES under standardized conditions.

Design, Setting, and Participants

This cohort study conducted at a tertiary academic medical center in Bern, Switzerland, included 16 residents and consultants of the Department of Otorhinolaryngology, Head & Neck Surgery, Inselspital, Bern.

Interventions

Each participant performed selected steps of a type I tympanoplasty and stapedotomy in 3D and 2D views in a cadaveric model using a randomized, Latin-square crossover design.

Main Outcomes and Measures

Time taken to perform the EES, number of attempts, and accidental damage during the dissections were compared between 3D and 2D endoscopy. Eye tracking was performed throughout the interventions. Cognitive load and subjective feedback were measured by standardized questionnaires.

Results

Of the 16 surgeons included in the study (11 inexperienced residents; 5 experienced consultants), 8 were women (50%); mean age was 36 years (range, 27-57 years). Assessment of surgical time revealed similar operating times for both techniques (181 seconds in 2D vs 174 seconds in 3D). A total of 64 surgical interventions were performed. Most surgeons preferred the 3D technique (10 for 3D vs 6 for 2D), even though a higher incidence of eye strain, measured on a 7-point Likert scale, was observed (3D, 2.19 points vs 2D, 1.44 points; mean difference , 0.74; 95% CI, 0.29-1.20; r = 0.67). Eye movement assessment revealed a higher duration of fixation for consultants in 2D (0.79 seconds) compared with 3D endoscopy (0.54 seconds), indicating a less-efficient application of previously acquired experiences using the new technique. Residents (mean [SD], 49.02 [16.4]) had a significantly higher workload than consultants (mean [SD], 27.21 [12.20]), independent of the used technique or task.

Conclusions and Relevance

Three-dimensional endoscopy is suitable for EES, especially for inexperienced surgeons whose mental model of the intervention has yet to be consolidated. The application of 3D endoscopy in clinical routines and for educational purposes may be feasible and beneficial.

Human Factors Evaluation of the Universal Anaesthesia Machine: Assessing Equipment with High-Fidelity Simulation Prior to Deployment in a Resource-Constrained Environment

BACKGROUND

Anesthesia providers in low- and middle-income countries face many challenges, including poor availability of functioning equipment designed to meet their environmental, organizational, and resource constraints. These are serious global health disparities which threaten access to care and patient safety for those who receive surgical care. In this study, we conducted a simulation-based human factors analysis of the Universal Anaesthesia Machine (UAM®), a device designed to support anesthesia providers in austere medical settings. Our team anticipated the introduction of the UAM® to the two major referral hospitals in Freetown, Sierra Leone. A prior observational study had identified these two hospitals as having environmental conditions consistent with an austere environment: an unstable electrical grid, as well as limited access to compressed oxygen, biomedical support, and consumables. Although the Baltimore simulation environment cannot reproduce all of the challenges present in a resource-constrained environment such as Sierra Leone, the major impediments to standard anesthesia machine functionality and human factors-associated use can be reproduced with the use of high-fidelity simulation. Using anesthesia care providers who have limited UAM® familiarity, this study allowed for the examination of machine-user issues in a controlled environment in preparation for further field studies concerning equipment introduction, training and device deployment in Sierra Leone. The goals of this study were: 1. to assess the usability of the UAM® (machine-user interface, simulated patient use, symbology, etc.) across different provider user groups during simulation of use in scenarios depicting routine use in healthy patients, use in clinically challenging patients and use in environmentally-challenging scenarios in a controlled setting devoid of patient risk, and 2. To gather feedback on available UAM manuals and cognitive aides and UAM usability issues in order to guide development of curricula for training providers on use of the UAM® in the intended austere clinical environments.

METHODS

Residents, fellows, attending physician anesthesiologists, student nurse anesthetists, and nurse anesthetists participated in a variety of simulations involving the Universal Anaesthesia Machine® at the Johns Hopkins Medicine Simulation Center between September 2012 and July 2013. Data collected included participant demographics, performance during simulation scenarios captured with critical action checklists, workload ratings captured with the National Aeronautics and Space Administration Task Load Index (NASA TLX), and participant reactions to UAM® use captured through a post-session survey and semi-structured usability debriefing. The scenarios were: 1. normal use (machine check, induction, and maintenance of an uneventful case), 2. use in a challenging clinical condition (acute onset of bronchospasm) and 3.use in an adverse environmental event (power failure). Critical action checklists and workload ratings were analyzed by Analysis of Covariance (ANCOVA) to control for participant demographics. Usability debriefings were analyzed qualitatively.

RESULTS

Thirty-five anesthesia providers participated in the study. Overall participant ratings, observations of performance in simulation scenarios, and usability debriefings indicated a high level of usability for the UAM®. Mean participant ratings were high for ease of use (5.4 ± 0.96) and clarity of instruction (6.2 ± 0.87) on a 7-point scale in which higher ratings indicate more positive perceptions. After adjusting for clinical experience, workload ratings were significantly higher in the bronchospasm scenario than in the normal/routine use (P = 0.046; 95% CI, 0.33-34.7) or power failure scenarios (P = 0.012; 95% CI, 5.24-37.9). Thirty-two specific usability issues were identified and grouped into five themes: device design and labeling, machine use during simulation scenarios, user-anticipated errors or hazards, curriculum issues, and overall impressions of the UAM®.

CONCLUSIONS

The UAM® design addresses many of the key challenges facing anesthesia providers in resource-constrained settings. The simulation-based human factors evaluation described here successfully identified opportunities for continued refinement of the initial device design as well as issues to be addressed in future curricula and cognitive aides.

Cognitive load theory for training health professionals in the workplace: A BEME review of studies among diverse professions: BEME Guide No. 53

AIM

Cognitive load theory (CLT) is of increasing interest to health professions education researchers. CLT has intuitive applicability to workplace settings, yet how CLT should inform teaching, learning, and research in health professions workplaces is unclear.

METHOD

To map the existing literature, we performed a scoping review of studies involving cognitive load, mental effort and/or mental workload in professional workplace settings within and outside of the health professions. We included actual and simulated workplaces and workplace tasks.

RESULT

Searching eight databases, we identified 4571 citations, of which 116 met inclusion criteria. Studies were most often quantitative. Methods to measure cognitive load included psychometric, physiologic, and secondary task approaches. Few covariates of cognitive load or performance were studied. Overall cognitive load and intrinsic load were consistently negatively associated with the level of experience and performance. Studies consistently found distractions and other aspects of workplace environments as contributing to extraneous load. Studies outside the health professions documented similar findings to those within the health professions, supporting relevance of CLT to workplace learning.

CONCLUSION

The authors discuss implications for workplace teaching, curricular design, learning environment, and metacognition. To advance workplace learning, the authors suggest future CLT research should address higher-level questions and integrate other learning frameworks.

Using Eye-Movement Events to Determine the Mental Workload of Surgical Residents

These days, eye-tracking is one of the promising technologies used in different fields such as aviation, arts, sports, psychology and driving for several purposes. Even though it is being used for health purposes, studies involving eye-tracking are rare in the field of endo-neurosurgery. This study aims to use this technology to promote our understanding of the effect related to computer-based instructional materials on mental workload of endo-neurosurgery residents. Four computer-based simulation scenarios are developed based on skill development requirements of endo-neurosurgery residents. Two of them were designed as general models and the other two as simulated surgical models. During these surgery procedures, in real settings, surgical residents need to use their both hands simultaneously to control the endoscope and the operational tool in a coordinated fashion. Therefore, to shed light on the participants' behaviors, these scenarios are performed with dominant-hand, non-dominant hand and, finally with both-hands using haptic interfaces. Twenty-three residents volunteered in this study. Their eye-movements were recorded while performing the scenarios. According to the results of this study, when performing the simulated surgical models, an increase in the participants' mental workload was recorded when compared to the other scenarios. Accordingly, it can be concluded that the eye-movements of surgical residents can provide insights about the anticipated level of difficulty about the skill-based tasks. This information might be very critical to properly design and organize instructional materials for endo-neurosurgery, and also to better guide and evaluate the progress of trainees in computer simulation-based skill training environments.

Validation of a Visual-Spatial Secondary Task to Assess Automaticity in Laparoscopic Skills

INTRODUCTION

Our objective was to assess reliability and validity of a visual-spatial secondary task (VSST) as a method to measure automaticity on a basic simulated laparoscopic skill model. In motor skill acquisition, expertise is defined by automaticity. The highest level of performance with less cognitive and attentional resources characterizes this stage, allowing experts to perform multiple tasks. Conventional validated parameters as operative time, objective assessment skills scales (OSATS), and movement economy, are insufficient to distinguish if an individual has reached the more advanced learning phases, such as automaticity. There is literature about using a VSST as an attention indicator that correlates with the automaticity level.

METHODS

Novices with completed and approved Fundamentals of Laparoscopic Surgery course, and laparoscopy experts were enrolled for an experimental study and measured under dual tasks conditions. Each participant performed the test giving priority to the primary task while at the same time they responded to a VSST. The primary task consisted of 4 interrupted laparoscopic stitches (ILS) on a bench-model. The VSST was a screen that showed different patterns that the surgeon had to recognize and press a pedal while doing the stitches (PsychoPsy software, Python, MacOS). Novices were overtrained on ILS until they reach at least 100 repetitions and then were retested. Participants were video recorded and then assessed by 2 blinded evaluators who measured operative time and OSATS. These scores were considered indicators of quality for the primary task. The VSST performance was measured by the detectability index (DI), which is a ratio between correct and wrong detections. A reliable evaluation was defined as two measures of DI with less than 10% of difference, maintaining the cutoff scores for performance on the primary task (operative time <110 seg and OSATS >17 points).

RESULTS

Novices (n = 11) achieved reliable measure of the test after 2 (2-5) repetitions on the preassessment and 3.75 (2-5) on the postassessment (p = 0.04); whereas laparoscopy experts (n = 4) did it after 3.5 (3-4) repetitions. Proficiency cutoff scores for the primary task were achieved on every measure for novices (prepost overtraining) and experts. Expert performance on VSST was DI 0.78 (0.69-0.87). Novice performance was significantly better on postassessment (DI-pre 0.48 [0.06-0.71] vs DI-post 0.78 [0.48-0.95], p = 0.003). Overtraining consisted in 140 (100-210) repetitions of ILS for all novices, made in 8 hours (3-15). By categorizing DI based on expert performance, novices with DI-post >0.65 achieved better OSATS score and less operative time than novices with DI-post<0.65 (p = 0.007 y, p = 0.089, respectively).

CONCLUSION

Measuring automaticity is feasible using a VSST. This instrument is reliable and has a face, content and construct validity. A DI over 0.65 may be a cutoff point correlated with high standard performance on the primary task. This instrument measures performance on laparoscopic skills, and along with conventional indicators, would better define advance levels of expertise. More studies are required applying this VSST to achieve external validity by reproducing our results.

The effect of multitasking on the communication skill and clinical skills of medical students

BACKGROUND

Mental workload is an abstract concept that perceives cognition as the brain having a small and finite capacity to process information, with high levels of workload associated with poor performance and error. While an individual may be able to complete two different tasks individually, a combination of tasks may lead to cognitive overload and poor performance. In many high-risk industries, it is common to measure mental workload and then to redesign tasks until cognitive overload is avoided. This study aimed to measure the effect of multitasking on the mental workload and performance of medical students completing single and combined clinical tasks.

METHODS

Medical students who had completed basic clinical skills training in a single undergraduate Medical School completed four standardised tasks for a total of four minutes each, consisting of: inactivity, listening, venepuncture and a combination of listening and venepuncture. Task performance was measured using standard binary checklists and with mental workload measured using a secondary task method.

RESULTS

The tasks were successfully completed by 40 subjects and as expected, mental workload increased with task complexity. Combining the two tasks showed no difference in the associated mental workload and performance at venepuncture (p = 0.082) However, during the combined task, listening appeared to deteriorate (p < 0.001).

CONCLUSIONS

If staff are expected to simultaneously complete multiple tasks then they may preferentially shed communication tasks in order to maintain their performance of physical tasks, leading to the appearance of poor communication skills. Although this is a small-scale study in medical students it suggests that the active assessment and management of clinician workload in busy clinical settings may be an effective strategy to improve doctor-patient communication.

Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload

BACKGROUND

Surgeons in the operating theatre deal constantly with high-demand tasks that require simultaneous processing of a large amount of information. In certain situations, high cognitive load occurs, which may impact negatively on a surgeon's performance. This systematic review aims to provide a comprehensive understanding of the different methods used to assess surgeons' cognitive load, and a critique of the reliability and validity of current assessment metrics.

METHODS

A search strategy encompassing MEDLINE, Embase, Web of Science, PsycINFO, ACM Digital Library, IEEE Xplore, PROSPERO and the Cochrane database was developed to identify peer-reviewed articles published from inception to November 2016. Quality was assessed by using the Medical Education Research Study Quality Instrument (MERSQI). A summary table was created to describe study design, setting, specialty, participants, cognitive load measures and MERSQI score.

RESULTS

Of 391 articles retrieved, 84 met the inclusion criteria, totalling 2053 unique participants. Most studies were carried out in a simulated setting (59 studies, 70 per cent). Sixty studies (71 per cent) used self-reporting methods, of which the NASA Task Load Index (NASA-TLX) was the most commonly applied tool (44 studies, 52 per cent). Heart rate variability analysis was the most used real-time method (11 studies, 13 per cent).

CONCLUSION

Self-report instruments are valuable when the aim is to assess the overall cognitive load in different surgical procedures and assess learning curves within competence-based surgical education. When the aim is to assess cognitive load related to specific operative stages, real-time tools should be used, as they allow capture of cognitive load fluctuation. A combination of both subjective and objective methods might provide optimal measurement of surgeons' cognition.

Establishment of Next-Generation Neurosurgery Research and Training Laboratory with Integrated Human Performance Monitoring

Quality of neurosurgical care and patient outcomes are inextricably linked to surgical and technical proficiency and a thorough working knowledge of microsurgical anatomy. Neurosurgical laboratory-based cadaveric training is essential for the development and refinement of technical skills before their use on a living patient. Recent biotechnological advances including 3-dimensional (3D) microscopy and endoscopy, 3D printing, virtual reality, surgical simulation, surgical robotics, and advanced neuroimaging have proved to reduce the learning curve, improve conceptual understanding of complex anatomy, and enhance visuospatial skills in neurosurgical training. Until recently, few means have allowed surgeons to obtain integrated surgical and technological training in an operating room setting. We report on a new model, currently in use at our institution, for technologically integrated surgical training and innovation using a next-generation microneurosurgery skull base laboratory designed to recreate the setting of a working operating room. Each workstation is equipped with a 3D surgical microscope, 3D endoscope, surgical drills, operating table with a Mayfield head holder, and a complete set of microsurgical tools. The laboratory also houses a neuronavigation system, a surgical robotic, a surgical planning system, 3D visualization, virtual reality, and computerized simulation for training of surgical procedures and visuospatial skills. In addition, the laboratory is equipped with neurophysiological monitoring equipment in order to conduct research into human factors in surgery and the respective roles of workload and fatigue on surgeons' performance.

Novel Simulation Device for Targeting Tumors in Laparoscopic Ablation: A Learning Curve Study

Introduction. A novel 3-dimensional (3D) guidance system was developed to aid accurate needle placement during ablation. Methods. Five novices and 5 experienced hepatobiliary surgeons were recruited. Using an agar block with analog tumor, participants targeted under 4 conditions: in-line with the ultrasound plane using ultrasound, in-line using 3D guidance, 45° off-axis using ultrasound, and off-axis using 3D guidance. Time to target the tumor, number of withdrawals, and the National Aeronautics and Space Administration Task Load Index were collected. Initial and final parameters for each of the conditions were compared using a within-subjects paired t test. Results. A significant reduction was seen in the number of required withdrawals in all situations when using the 3D guidance (0.75 vs 3.65 in-line and 0.25 vs 3.6 for off-axis). Mental workload was significantly lower when using 3D guidance compared with ultrasound both for novices (29.85 vs 41.03) and experts (31.98 vs 44.57), P < .001 for both. The only difference in targeting time between first and last attempt was in the novice group during off-axis targeting using 3D guidance (115 vs 32.6 seconds, P = .03). Conclusion. Though 3D guidance appeared to decrease time to target, this was not statistically significant likely as a result of lack of power in our trial. Three-dimensional guidance did reduce the number of required withdrawals, potentially decreasing complications, as well as mental workload after proficiency was achieved. Furthermore, novices without experience in ultrasound were able to learn targeting with the 3D guidance system at a faster pace than targeting with ultrasound alone.

Game-based training improves the surgeon's situational awareness in the operation room: a randomized controlled trial

Background

Equipment-related malfunctions directly relate to one-fourth of the adverse events in the surgical theater. A serious game trains residents to recognize and respond to equipment problems in minimally invasive surgery (MIS). These include disturbed vision, gas transport, electrocautery, and pathophysiological disturbances. This randomized controlled trial explores whether game-based training improves surgical residents’ response to equipment-related problems during surgery.

Methods

Thirty-one surgical residents with no previous experience in MIS took part in a standardized basic laparoscopy training course. Fifteen residents were randomly assigned to the game-enhanced curriculum (intervention) and sixteen were assigned to the regular curriculum (control). Participants performed a MIS task in a live anesthetized pig model, during which three standardized equipment malfunction scenarios occurred. Observers recorded the problems recognized and solved, time, and participants’ technical performance.

Results

Twenty-four participants completed the post-test (n = 12 per group). The intervention group solved more problems than the control group (59 vs. 33%, p = 0.029). The intervention group also recognized a larger proportion of problems, although this parameter was non-significant (67 vs. 42%, p = 0.14). Random effects modeling showed a significant improved game performance per participant over time.

Conclusions

Surgical residents, who play for only 1 h on a custom-made serious game, respond significantly better to equipment-related problems during surgery than residents trained by a standard training curriculum. These results imply that entertaining serious games can indeed be considered for use in official training for surgeons and other medical specialists.

Automated Task Load Detection with Electroencephalography: Towards Passive Brain–Computer Interfacing in Robotic Surgery

Automatic detection of the current task load of a surgeon in the theatre in real time could provide helpful information, to be used in supportive systems. For example, such information may enable the system to automatically support the surgeon when critical or stressful periods are detected, or to communicate to others when a surgeon is engaged in a complex maneuver and should not be disturbed. Passive brain–computer interfaces (BCI) infer changes in cognitive and affective state by monitoring and interpreting ongoing brain activity recorded via an electroencephalogram. The resulting information can then be used to automatically adapt a technological system to the human user. So far, passive BCI have mostly been investigated in laboratory settings, even though they are intended to be applied in real-world settings. In this study, a passive BCI was used to assess changes in task load of skilled surgeons performing both simple and complex surgical training tasks. Results indicate that the introduced methodology can reliably and continuously detect changes in task load in this realistic environment.

Reaction time for processing visual stimulus in a computer-assisted rehabilitation environment

PURPOSE

To examine the reaction time when human subjects process information presented in the visual channel under both a direct vision and a virtual rehabilitation environment when walking was performed.

METHOD

Visual stimulus included eight math problems displayed on the peripheral vision to seven healthy human subjects in a virtual rehabilitation training (computer-assisted rehabilitation environment (CAREN)) and a direct vision environment. Subjects were required to verbally report the results of these math calculations in a short period of time. Reaction time measured by Tobii Eye tracker and calculation accuracy were recorded and compared between the direct vision and virtual rehabilitation environment.

RESULTS

Performance outcomes measured for both groups included reaction time, reading time, answering time and the verbal answer score. A significant difference between the groups was only found for the reaction time (p = .004). Participants had more difficulty recognizing the first equation of the virtual environment.

CONCLUSIONS

Participants reaction time was faster in the direct vision environment. This reaction time delay should be kept in mind when designing skill training scenarios in virtual environments. This was a pilot project to a series of studies assessing cognition ability of stroke patients who are undertaking a rehabilitation program with a virtual training environment. Implications for rehabilitation Eye tracking is a reliable tool that can be employed in rehabilitation virtual environments. Reaction time changes between direct vision and virtual environment.

Detection of Changes in Surgical Difficulty

Background. Assessing the workload of surgeons requires technology to continuously monitor surgeons’ behaviors without interfering with their performance. We investigated the feasibility of using eye-tracking to reveal surgeons’ response to increasing task difficulty. Methods. A controlled study was conducted in a simulated operating room, where 14 subjects were required to perform a laparoscopic procedure that includes 9 subtasks. The subtasks could be divided into 3 types with different levels of task difficulty, calculated by the index of task difficulty (ID) proposed by Fitts in 1954. Pupillary responses of subjects in performing the procedure were recorded using Tobii eye-tracking equipment. Peak pupil dilation and movement time were compared between subtasks with different IDs as well as between fast moving and slow aiming phases within each subtask. Results. When the task difficulty was increased, task completion time increased. Meanwhile, the subjects’ peak pupil size also increased. As the entire procedure was performed continuously, we found that pupil responses were not only affected by the ID in the current subtask but also influenced by subtasks before and after. Discussion. Decomposing a surgical procedure into meaningful subtasks and examining the surgeon’s pupil response to each subtask enables us to identify the challenging steps within a continuous surgical procedure. Psychomotor evidence on surgeon’s performance may lead to an innovation for designing a task-specific training curriculum.

Intra-operative disruptions, surgeon's mental workload, and technical performance in a full-scale simulated procedure

BACKGROUND AND AIM

Surgical flow disruptions occur frequently and jeopardize perioperative care and surgical performance. So far, insights into subjective and cognitive implications of intra-operative disruptions for surgeons and inherent consequences for performance are inconsistent. This study aimed to investigate the effect of surgical flow disruption on surgeon's intra-operative workload and technical performance.

METHODS

In a full-scale OR simulation, 19 surgeons were randomly allocated to either of the two disruption scenarios (telephone call vs. patient discomfort). Using a mixed virtual reality simulator with a computerized, high-fidelity mannequin, all surgeons were trained in performing a vertebroplasty procedure and subsequently performed such a procedure under experimental conditions. Standardized measures on subjective workload and technical performance (trocar positioning deviation from expert-defined standard, number, and duration of X-ray acquisitions) were collected.

RESULTS

Intra-operative workload during simulated disruption scenarios was significantly higher compared to training sessions (p < .01). Surgeons in the telephone call scenario experienced significantly more distraction compared to their colleagues in the patient discomfort scenario (p < .05). However, workload tended to be increased in surgeons who coped with distractions due to patient discomfort. Technical performance was not significantly different between both disruption scenarios. We found a significant association between surgeons' intra-operative workload and technical performance such that surgeons with increased mental workload tended to perform worse (β = .55, p = .04).

CONCLUSIONS

Surgical flow disruptions affect surgeons' intra-operative workload. Increased mental workload was associated with inferior technical performance. Our simulation-based findings emphasize the need to establish smooth surgical flow which is characterized by a low level of process deviations and disruptions.

Psychophysical workload in the operating room: primary surgeon versus assistant

BACKGROUND

Working in the operating room is characterized by high demands and overall workload of the surgical team. Surgeons often report that they feel more stressed when operating as a primary surgeon than in the function as an assistant which has been confirmed in recent studies. In this study, intra-individual workload was assessed in both intraoperative functions using a multidimensional approach that combined objective and subjective measures in a realistic work setting.

METHODS

Surgeons' intraoperative psychophysiologic workload was assessed through a mobile health system. 25 surgeons agreed to take part in the 24-hour monitoring by giving their written informed consent. The mobile health system contained a sensor electronic module integrated in a chest belt and measuring physiological parameters such as heart rate (HR), breathing rate (BR), and skin temperature. Subjective workload was assessed pre- and postoperatively using an electronic version of the NASA-TLX on a smartphone. The smartphone served as a communication unit and transferred objective and subjective measures to a communication server where data were stored and analyzed.

RESULTS

Working as a primary surgeon did not result in higher workload. Neither NASA-TLX ratings nor physiological workload indicators were related to intraoperative function. In contrast, length of surgeries had a significant impact on intraoperative physical demands (p < 0.05; η(2) = 0.283), temporal demands (p < 0.05; η(2) = 0.260), effort (p < 0.05; η(2) = 0.287), and NASA-TLX sum score (p < 0.01; η(2) = 0.287).

CONCLUSIONS

Intra-individual workload differences do not relate to intraoperative role of surgeons when length of surgery is considered as covariate. An intelligent operating management that considers the length of surgeries by implementing short breaks could contribute to the optimization of intraoperative workload and the preservation of surgeons' health, respectively. The value of mobile health systems for continuous psychophysiologic workload assessment was shown.

Evaluation of a precise and measurable model for learning laparoscopic tissue handling

INTRODUCTION

Laparoscopic tissue handling is quite difficult to measure using virtual-reality laparoscopic simulators and box-trainer exercises, and therefore, completion time is the predominant performance measure for simulation-based laparoscopic training exercises. The purpose of this study was to evaluate the construct validity of a training and assessment model for precise laparoscopic handling of delicate tissue.

METHODS

Participants (n = 35) completed 2 progressively challenging laparoscopic tissue translocation exercises using delicate foam pieces and templates. Deidentified performances were scored using objective measures for tissue damage, accuracy, percentage complete, and completion time. Evaluation included multiple analysis of variance with repeated measures among the 3 groups as follows: medical students, residents and faculty who perform laparoscopic surgery less than once per week, and faculty members who perform laparoscopic surgery at least once per week.

RESULTS

The model demonstrated significant construct validity by discriminating performances between the types of shapes and templates and across the levels of surgical experience on all dimensions. A significant interaction effect between the level of expertise and the difficulty of the exercise revealed excellent discrimination between experienced laparoscopic surgeons and others.

DISCUSSION

This low-cost model provides an alternative or adjunct platform for laparoscopic training and assessment that requires precise and measurable handling of a delicate tissue.

The impact of intra-operative interruptions on surgeons' perceived workload: an observational study in elective general and orthopedic surgery

BACKGROUND AND AIM

Surgeons' intra-operative workload is critical for effective and safe surgical performance. Detrimental conditions in the operating room (OR) environment may add to perceived workload and jeopardize surgical performance and outcomes. This study aims to evaluate the impact of different intra-operative workflow interruptions on surgeons' capacity to manage their workload safely and efficiently.

METHODS

This was an observational study of intra-operative interruptions and self-rated workload in two surgical specialties (general, orthopedic/trauma surgery). Intra-operative interruptions were assessed via expert observation using a well-validated observation tool. Surgeons, nurses, and anesthesiologists assessed their intra-operative workload directly after case completion based on three items of the validated Surgery Task Load Index (mental demand, situational stress, distraction).

RESULTS

A total of 56 elective cases (35 open, 21 laparoscopic) with 94 workload ratings were included. Mean intra-operative duration was 1 h 37 min. Intra-operative interruptions were on average observed 9.78 times per hour. People who entered/exited the OR (30.6 %) as well as telephone-/beeper-related disruptions (23.6 %) occurred most often. Equipment and OR environment-related interruptions were associated with highest interference with team functioning particularly in laparoscopic procedures. After identifying task and procedural influences, partial correlational analyses revealed that case-irrelevant communications were negatively associated with surgeons' mental fatigue and situational stress, whereas surgeons' reported distraction was increased by case-irrelevant communication and procedural disruptions. OR nurses' and anesthesiologists' perceived workload was also related to intra-operative interruption events.

CONCLUSIONS

Our study documents the unique contribution of different interruptions on surgeons' workload; whereas case-irrelevant communications may be beneficial for mental fatigue and stress in routine cases, procedural interruptions and case-irrelevant communication may contribute to surgeons' mental focus deteriorating. Well-designed OR environments, surgical leadership, and awareness can help to control unnecessary interruptions for effective and safe surgical care.

Exploring the impact of mental workload on rater-based assessments

When appraising the performance of others, assessors must acquire relevant information and process it in a meaningful way in order to translate it effectively into ratings, comments, or judgments about how well the performance meets appropriate standards. Rater-based assessment strategies in health professional education, including scale and faculty development strategies aimed at improving them have generally been implemented with limited consideration of human cognitive and perceptual limitations. However, the extent to which the task assigned to raters aligns with their cognitive and perceptual capacities will determine the extent to which reliance on human judgment threatens assessment quality. It is well recognized in medical decision making that, as the amount of information to be processed increases, judges may engage mental shortcuts through the application of schemas, heuristics, or the adoption of solutions that satisfy rather than optimize the judge's needs. Further, these shortcuts may fundamentally limit/bias the information perceived or processed. Thinking of the challenges inherent in rater-based assessments in an analogous way may yield novel insights regarding the limits of rater-based assessment and may point to greater understanding of ways in which raters can be supported to facilitate sound judgment. This paper presents an initial exploration of various cognitive and perceptual limitations associated with rater-based assessment tasks. We hope to highlight how the inherent cognitive architecture of raters might beneficially be taken into account when designing rater-based assessment protocols.

Assessment of workload during pediatric trauma resuscitation

BACKGROUND

Trauma resuscitations are high-pressure, time-critical events during which health care providers form ad hoc teams to rapidly assess and treat injured patients. Trauma team members experience varying levels of workload during resuscitations resulting from the objective demands of their role-specific tasks, the circumstances surrounding the event, and their individual previous experiences. The goal of this study was to determine factors influencing workload experienced by trauma team members during pediatric trauma resuscitations.

METHODS

Workload was measured using the National Aeronautics and Space Administration Task Load Index (TLX). TLX surveys were administered to four trauma team roles: charge nurse, senior surgical resident (surgical coordinator), emergency medicine physician, and junior surgical resident or nurse practitioner (bedside clinician). A total of 217 surveys were completed. Univariate and multivariate statistical techniques were used to examine the relationship between workload and patient and clinical factors.

RESULTS

Bedside clinicians reported the highest total workload score (208.7), followed by emergency medicine physicians (156.3), surgical coordinators (144.1), and charge nurses (129.1). Workload was higher during higher-level activations (235.3), for events involving intubated patients (249.0), and for patients with an Injury Severity Score greater than 15 (230.4) (p, 0.001 for all). When controlling for potential confounders using multiple linear regression, workload was increased during higher level activations (79.0 points higher, p = 0.01) and events without previous notification (38.9 points higher, p = 0.03). Workload also remained significantly higher for the bedside clinician compared with the other three roles (p ≤ 0.005 for all).

CONCLUSION

Workload during pediatric trauma resuscitations differed by team role and was increased for higher-level activations and events without previous notification. This study demonstrates the validity of the TLX as a tool to measure workload in trauma resuscitation.

LEVEL OF EVIDENCE

Prognostic study, level II.