Error rating tool to identify and analyse technical errors and events in laparoscopic surgery

Comprehensive comparison of technical performance, surgical outcomes, and oncologic prognosis between remnant gastric cancer and primary upper-third gastric cancer in the era of minimally invasive surgery: A pooled analysis of 3 prospective trials

BACKGROUND AND OBJECTIVE

To compare the technical performances and short- and long-term outcomes of laparoscopic total gastrectomy for remnant gastric cancer and primary upper gastric cancer.

METHODS

This prospective study (FUGES-004 study) enrolled 50 remnant gastric cancer patients who underwent laparoscopic total gastrectomy at Fujian Medical University Union Hospital between June 2016 and June 2020 (ClinicalTrials.gov identifier: NCT02792881). Propensity score matching (1:2) was used to select upper gastric cancer patients who underwent laparoscopic total gastrectomy in the FUGES-001 and FUGES-002 studies. Technical performance was assessed using the General Error Reporting Tool, Objective Structured Assessment of Technical Skills (OSATS), and Intraoperative Complication Classification.

RESULTS

After matching, 46 remnant gastric cancer and 92 upper gastric cancer patients were included in the final analysis. Abdominal adhesions in the epigastrium, central abdomen, and bowel-to-bowel regions were more severe in the remnant gastric cancer group (P < .001). The remnant gastric cancer group had more technical errors and intraoperative adverse events (especially grade I bleeding) during surgery (P < .05). However, the Objective Structured Assessment of Technical Skills scores were comparable between the remnant gastric cancer and upper gastric cancer groups (30.8 vs 31.0, P = .799). Although the severe postoperative complication rates were similar between the 2 groups (P = .333), the postoperative complication rate was significantly higher in the remnant gastric cancer group (28.3% vs 7.6%, P = .001). Additionally, the long-term oncologic outcomes (including 3-year disease-free survival, overall survival, and recurrence pattern) were comparable between the remnant gastric cancer and upper gastric cancer groups (log-rank P > .05).

CONCLUSIONS

Although the long-term oncologic outcomes were comparable between the groups, the remnant gastric cancer group had more intraoperative errors and adverse events and higher postoperative complication rates than the upper gastric cancer group. For complex remnant gastric cancer cases, laparoscopic total gastrectomy may serve as an effective therapeutic option. However, experienced surgeons at high-volume centers should exercise caution when performing laparoscopic total gastrectomy and implement more rigorous perioperative management strategies.

Comparison of surgical results and technical performance between robotic and laparoscopic approaches for Kasai portoenterostomy in biliary atresia: a multicenter retrospective study

BACKGROUND

Many variables, including age at surgery, disease type, surgical approaches and perioperative management factors have been demonstrated to influence efficacy in BA infants, however, the effect of surgical performance remains unclear. The objective of this retrospective study was to compare the postoperative efficacy and surgical performance of robotic (RKPE) versus laparoscopic Kasai portoenterostomy (LKPE) for BA.

METHODS

Between October 2018 and June 2023, 158 type III BA patients undergoing minimally invasive surgery (RKPE = 66, LKPE = 92) were included in this multicenter retrospective study. All procedures were performed by surgical teams experienced in Kasai portoenterostomy techniques. Technical performance was quantified and analyzed using the Objective Structured Assessments of Technical Skills (OSATS) and Generic Error Rating Tool instruments (GERT). Postoperative outcomes and surgical performance were compared.

RESULTS

Compared with LKPE group, RKPE group had shorter fibrous cone transection time (48.92 ± 6.98 vs. 61.45 ± 8.98 min; p < 0.001), shorter hepaticojejunostomy time (47.55 ± 6.57 vs. 59.93 ± 7.88 min; p < 0.001) and less estimated intraoperative bleeding [7.00 (5.00-10.00) vs. 13.50 (10.50-16.50) mL; p < 0.001]. More importantly, RKPE group showed a superior OSATS score [30.50 (29.00-31.00) vs. 28.00 (28.00-29.00); p < 0.001], number of errors (46.62 ± 6.32 vs. 56.40 ± 6.82 times/case; p < 0.001), and number of events [9.40 (8.40-10.40) vs. 16.00 (14.00-17.80) times/case; p < 0.001]. On postoperative days 1 and 3, RKPE group had lower C-reactive protein levels (19.87 ± 12.28 vs. 27.05 ± 11.16 mg/L, p < 0.001; 14.88 ± 7.11 vs. 20.73 ± 9.09 mg/L, p < 0.001). During follow-up, RKPE group had higher jaundice clearance rate at 3 (68.18% vs. 51.09%; p = 0.032) and 6 months (78.79% vs. 64.13%; p = 0.047) postoperatively. However, the cholangitis rate within 1 year postoperatively (46.97% vs. 50.00%; p = 0.707), as well as one-year (75.76% vs. 72.83%; p = 0.678) and two-year survival with native liver rates (68.42% vs. 66.67%; p = 0.857), were comparable between two groups.

CONCLUSIONS

RKPE provided superior technical skill performance and a higher jaundice clearance rate than LKPE, indicating that it may be a better minimally invasive option for BA. In addition, the survival with native liver rate showed no significant difference between the two cohorts, which needs to be confirmed by further study.

Measuring Residents' Competence in Chest Tube Insertion on Thiel-Embalmed Bodies: A Validity Study

INTRODUCTION

Chest tube insertions (CTIs) have a high complication rate, prompting the training of technical skills in simulated settings. However, assessment tools require validity evidence prior to their implementation. This study aimed to collect validity evidence for assessment of technical skills in CTI on Thiel-embalmed human bodies.

METHODS

Invitations were sent to residents and staff from the departments of surgery, pulmonology, and emergency medicine. Participants were familiarized with the Thiel body and the supplied equipment. Standardized clinical context and instructions were provided. All participants performed 2 CTIs and were assessed with the Assessment for Competence in Chest Tube InsertiON (ACTION) tool, consisting of a 17-item rating scale and a 16-item error checklist. Live and post hoc video-based assessments by 2 raters were performed. Generalizability analysis was performed to evaluate reliability. Mean scores and errors were compared using a mixed-model repeated measures analysis of variance (ANOVA). A pass/fail score was determined using the contrasting groups' method.

RESULTS

Ten novices and 8 experienced participants completed the study. The Generalizability coefficients were moderate for the rating scale (0.75), and low for the error checklist (0.4). Novices scored lower on the rating scale?? (44±6.7/68 vs 50.8 ± 5.7/68, P = 0.024), but did not commit significantly more errors (1.6 ± 1.1/16 vs 1.0 ± 0.6/16, P = 0.066). A pass/fail score of 47/68 was established.

CONCLUSION

The rating scale in the Assessment for Competence in Chest Tube InsertiON tool has a robust validity argument for use on Thiel-embalmed bodies, allowing it to be used in simulation-based mastery learning curricula. In contrast, its error checklist has insufficient reliability and validity to be used for summative assessment.

ESGE/ESGO/SERGS consensus statement on surgical steps in minimally invasive surgery in gynecologic oncology: transperitoneal and extraperitioneal approach for paraaortic lymphadenectomy

INTRODUCTION

Assessment of retroperitoneal nodes is an important part of the surgical staging of gynecologic cancers. Although pelvic and paraaortic lymphadenectomy have been widely described by different authors, there is little consensus on the description of the different surgical steps for each procedure. An Intergroup Committee on Onco-Gyn Minimally Invasive Surgery has been established with members of the European Society for Gynecological Endoscopy (ESGE), European Society of Gynaecological Oncology (ESGO) and the Society of European Robotic Gynaecological Surgery (SERGS). The Intergroup Committee has various objectives: writing down a surgical description of the technique, which will be assessed by a group of experts following a formal consensus method and developing a specific Objective Structured Assessment of Technical Skills (OSATS) scale for each procedure.

METHODS

A hierarchical task analysis was conducted by a working group of eight experts from the three societies in order to identify the surgical steps of transperitoneal and extraperitoneal approach in paraaortic lymphadenectomy. The selection of the definitive surgical steps was confirmed by a group of 19 experts from the different societies, following a formal consensus method. Two rounds of Delphi panel rating were considered necessary for achieving an agreement. The consensus agreement identified 29 surgical steps in transperitoneal and 17 surgical steps in extraperitoneal approach to complete a paraaortic lymphadenectomy. Once the description of the procedure and the consensus were established, an Objective specific Scale for the Assessment of Technical Skills for Paraaortic lymphadenectomy (PA-OSATS) in the transperitoneal and extraperitoneal approach was developed.

RESULTS

In the first round of rating we found that 28 steps out of 29 in the transperitoneal approach and 13 out of 17 in the extraperitoneal approach did not reach a strong degree of agreement. They were reformulated based on comments made by the experts, and submitted to a second round of rating and this finally achieved an agreement.

CONCLUSION

We defined a list of surgical steps in transperitoneal and extraperitoneal approach in paraaortic lymphadenectomy and a specific PA-OSATS scale for these procedures. This tool will be useful for teaching, assessing and standardizing this surgical procedure.

Safety and efficacy of three-dimensional versus two-dimensional endoscopy in otolaryngology surgery and training: A systematic review

OBJECTIVE

Three-dimensional (3D) endoscopy has been developed to provide depth perception to allow for improved visualisation during otolaryngology surgery. We conducted a systematic review to determine the surgical safety and efficacy of 3D endoscopy in comparison to two-dimensional (2D) endoscopy in performing otolaryngology procedures, and the role of 3D endoscopy as a training tool for novice otolaryngology surgeons.

METHODS

Primary studies were identified through MEDLINE, Embase and Web of Science databases, which were searched for articles published through June 2022 that compared the outcomes of 2D and 3D endoscopy in otolaryngology surgical procedures or otolaryngology-relevant simulations. Candidate articles were independently reviewed by two authors.

RESULTS

A total of 18 full-text articles met inclusion criteria for this study. In clinical trials (n = 8 studies, 362 subjects), there were no significant differences in performance time, intraoperative or postoperative complications with 3D endoscopes when compared to 2D. In simulation studies (n = 10 studies, 336 participants), 3D endoscopes demonstrated a decreased error rate (n = 5 studies) and shorter performance time (n = 3 studies). Studies also reported improved depth perception (n = 14 studies) and visualisation preference (n = 5 studies) with 3D over 2D systems. The 3D systems were found to have a shorter learning curve and better manoeuvrability among novice surgeons.

CONCLUSION

3D endoscopy showed equivalent safety and efficacy compared to 2D endoscopy in otolaryngology surgery. The improved depth perception and performance for novices using 3D endoscopes suggests the technology may be superior to 2D endoscopes as a training tool for otolaryngology surgeons.

Editor's Choice - Development and Testing of Step, Error, and Event Frameworks to Evaluate Technical Performance in Peripheral Endovascular Interventions

OBJECTIVE

Tools for endovascular performance assessment are necessary in competency based education. This study aimed to develop and test a detailed analysis tool to assess steps, errors, and events in peripheral endovascular interventions (PVI).

METHODS

A modified Delphi consensus was used to identify steps, errors, and events in iliac-femoral-popliteal endovascular interventions. International experts in vascular surgery, interventional radiology, cardiology, and angiology were identified, based on their scientific track record. In an initial open ended survey round, experts volunteered a comprehensive list of steps, errors, and events. The items were then rated on a five point Likert scale until consensus was reached with a pre-defined threshold (Cronbach's alpha > 0.7) and > 70% expert agreement. An experienced endovascular surgeon applied the finalised frameworks on 10 previously videorecorded elective PVI cases.

RESULTS

The expert consensus panel was formed by 28 of 98 invited proceduralists, consisting of three angiologists, seven interventional radiologists, five cardiologists, and 13 vascular surgeons, with 29% from North America and 71% from Europe. The Delphi process was completed after three rounds (Cronbach's alpha; αsteps = 0.79; αerrors = 0.90; αevents = 0.90), with 15, 26, and 18 items included in the final step (73 - 100% agreement), error (73 - 100% agreement), and event (73 - 100% agreement) frameworks, respectively. The median rating time per case was 4.3 hours (interquartile range [IQR] 3.2, 5 hours). A median of 55 steps (IQR 40, 67), 27 errors (IQR 21, 49), and two events (IQR 1, 6) were identified per case.

CONCLUSION

An evaluation tool for the procedural steps, errors, and events in iliac-femoral-popliteal endovascular procedures was developed through a modified Delphi consensus and applied to recorded intra-operative data to identify hazardous steps, common errors, and events. Procedural mastery may be promoted by using the frameworks to provide endovascular proceduralists with detailed technical performance feedback.

Real-time detection of active bleeding in laparoscopic colectomy using artificial intelligence

BACKGROUND

Most intraoperative adverse events (iAEs) result from surgeons' errors, and bleeding is the majority of iAEs. Recognizing active bleeding timely is important to ensure safe surgery, and artificial intelligence (AI) has great potential for detecting active bleeding and providing real-time surgical support. This study aimed to develop a real-time AI model to detect active intraoperative bleeding.

METHODS

We extracted 27 surgical videos from a nationwide multi-institutional surgical video database in Japan and divided them at the patient level into three sets: training (n = 21), validation (n = 3), and testing (n = 3). We subsequently extracted the bleeding scenes and labeled distinctively active bleeding and blood pooling frame by frame. We used pre-trained YOLOv7_6w and developed a model to learn both active bleeding and blood pooling. The Average Precision at an Intersection over Union threshold of 0.5 (AP.50) for active bleeding and frames per second (FPS) were quantified. In addition, we conducted two 5-point Likert scales (5 = Excellent, 4 = Good, 3 = Fair, 2 = Poor, and 1 = Fail) questionnaires about sensitivity (the sensitivity score) and number of overdetection areas (the overdetection score) to investigate the surgeons' assessment.

RESULTS

We annotated 34,117 images of 254 bleeding events. The AP.50 for active bleeding in the developed model was 0.574 and the FPS was 48.5. Twenty surgeons answered two questionnaires, indicating a sensitivity score of 4.92 and an overdetection score of 4.62 for the model.

CONCLUSIONS

We developed an AI model to detect active bleeding, achieving real-time processing speed. Our AI model can be used to provide real-time surgical support.

Appraisal of surgical outcomes and oncological efficiency of intraoperative adverse events in robotic radical gastrectomy for gastric cancer

BACKGROUND

Surgical quality control is a crucial determinant of evaluating the tumor efficacy.

OBJECTIVE

To assess the ClassIntra grade for quality control and oncological outcomes of robotic radical surgery for gastric cancer (GC).

METHODS

Data of patients undergoing robotic radical surgery for GC at a high-volume center were retrospectively analyzed. Patients were categorized into two groups, the intraoperative adverse event (iAE) group and the non-iAE group, based on the occurrence of intraoperative adverse events. The iAEs were further classified into five sublevels (ranging from I to V according to severity) based on the ClassIntra grade. Surgical performance was assessed using the Objective Structured Assessment of Technical Skill (OSATS) and the General Error Reporting Tool.

RESULTS

This study included 366 patients (iAE group: n = 72 [19.7%] and non-iAE group: n = 294 [80.3%]). The proportion of ClassIntra grade II patients was the highest in the iAE group (54.2%). In total and distal gastrectomies, iAEs occurred most frequently in the suprapancreatic area (50.0% and 54.8%, respectively). In total gastrectomy, grade IV iAEs were most common during lymph node dissection in the splenic hilum area (once for bleeding [grade IV] and once for injury [grade IV]). The overall survival (OS) and disease-free survival of the non-iAE group were significantly better than those of the iAE group (Log rank P < 0.001). Uni- and multi-variate analyses showed that iAEs were key prognostic indicators, independent of tumor stage and adjuvant chemotherapy (P < 0.001).

CONCLUSION

iAEs in patients who underwent robotic radical gastrectomy significantly correlated with the occurrence of postoperative complications and a poor long-term prognosis. Therefore, utilization and inclusion of ClassIntra grading as a crucial surgical quality control and prognostic indicator in the routine surgical quality evaluation system are recommended.

Skill decay in surgeons deployed on military operations: a systematic review

INTRODUCTION

Decay of surgical skills due to paucity of opportunity to operate is a potential threat to patients being cared for by the Defence Medical Services while on operational deployment. Our aim was to review the literature regarding skill decay in the trained surgeon in order to understand how it may affect clinical performance and patient outcomes. We also wished to survey the likely causes of such decay and possible means of mitigation.

METHODS

A systematic review of the literature was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Study bias assessment was also undertaken. Content summaries for the papers included study design and methodology, participant level of experience, measures and magnitude of effect, duration of no practice, and study limitations.

RESULTS

Five papers met the selection criteria. There were insufficient quantitative data on the impact of surgical skill decay on patient outcome, surgeon performance or mitigation strategies, and a meaningful quantitative synthesis could not be undertaken.

CONCLUSIONS

This systematic review of the literature found very little specific evidence confirming or refuting surgical skill decay in trained surgeons, with measurement of decay hampered by the lack of an accepted methodology. Studying this in the deployed setting may offer a firmer evidence base from which to generate policy. Potential mitigation strategies are discussed. PROSPERO registration number ID260846.

The application of objective clinical human reliability analysis (OCHRA) in the assessment of basic robotic surgical skills

BACKGROUND

Using a validated, objective, and standardised assessment tool to assess progression and competency is essential for basic robotic surgical training programmes. Objective clinical human reliability analysis (OCHRA) is an error-based assessment tool that provides in-depth analysis of individual technical errors. We conducted a feasibility study to assess the concurrent validity and reliability of OCHRA when applied to basic, generic robotic technical skills assessment.

METHODS

Selected basic robotic surgical skill tasks, in virtual reality (VR) and dry lab equivalent, were performed by novice robotic surgeons during an intensive 5-day robotic surgical skills course on da Vinci® X and Xi surgical systems. For each task, we described a hierarchical task analysis. Our developed robotic surgical-specific OCHRA methodology was applied to error events in recorded videos with a standardised definition. Statistical analysis to assess concurrent validity with existing tools and inter-rater reliability were performed.

RESULTS

OCHRA methodology was applied to 272 basic robotic surgical skills tasks performed by 20 novice robotic surgeons. Performance scores improved from the start of the course to the end using all three assessment tools; Global Evaluative Assessment of Robotic Skills (GEARS) [VR: t(19) = - 9.33, p < 0.001] [dry lab: t(19) = - 10.17, p < 0.001], OCHRA [VR: t(19) = 6.33, p < 0.001] [dry lab: t(19) = 10.69, p < 0.001] and automated VR [VR: t(19) = - 8.26, p < 0.001]. Correlation analysis, for OCHRA compared to GEARS and automated VR scores, shows a significant and strong inverse correlation in every VR and dry lab task; OCHRA vs GEARS [VR: mean r = - 0.78, p < 0.001] [dry lab: mean r = - 0.82, p < 0.001] and OCHRA vs automated VR [VR: mean r = - 0.77, p < 0.001]. There is very strong and significant inter-rater reliability between two independent reviewers (r = 0.926, p < 0.001).

CONCLUSION

OCHRA methodology provides a detailed error analysis tool in basic robotic surgical skills with high reliability and concurrent validity with existing tools. OCHRA requires further evaluation in more advanced robotic surgical procedures.

Objective assessment for open surgical suturing training by finger tracking can discriminate novices from experts

It is difficult, time consuming and expensive to assess manual skills in open surgery. The aim of this study is to investigate the construct validity of a low-cost, easily accessible tracking technique for basic open suturing tasks. Medical master students, surgical residents, and surgeons at the Radboud University Medical Center were recruited between September 2020 until September 2021. The participants were divided, according to experience, in a novice group (≤10 sutures performed) and an expert group (>50 sutures performed). For objective tracking, a tablet with SurgTrac software was used, which tracked a blue and a red tag placed on respectively their left and right index finger. The participants executed four basic tasks on a suturing model: 1) knot tying by hand, 2) transcutaneous suturing with an instrument knot, 3) 'Donati' (vertical mattress suture) with an instrument knot and 4) continuous intracutaneous suturing without a knot. In total 76 participants were included: 57 novices and 19 experts. All four tasks showed significant differences between the novice group and expert group for the parameters time (p<0.001), distance (p<0.001 for Task 1, 2 and 3 and p=0.034 for Task 4) and smoothness (p<0.001). Additionally, Task 3 showed a significant difference for the parameter handedness (p=0.006) and Task 4 for speed (p=0.033). Tracking index finger movements using SurgTrac software on a tablet while executing basic open suturing skills on a simulator shows excellent construct validity for time, distance and motion smoothness in all four suturing tasks.

Intraoperative Adverse Events, Technical Performance, and Surgical Outcomes in Laparoscopic Radical Surgery for Gastric Cancer: A Pooled Analysis From 2 Randomized Trials

OBJECTIVE

To verify an intraoperative adverse event (iAE) classification (ClassIntra grade) to evaluate quality control and to predict the prognostic performance of laparoscopic radical surgery for gastric cancer.

BACKGROUND

Surgical quality control is a key factor in the evaluation of surgical treatment for tumors. And, there is no recognized iAE classification for gastric cancer.

METHODS

We performed a retrospective post hoc analysis of previously collected data from the FUGES-001 study (NCT02327481) and a subset of the CLASS-01 study (NCT01609309). Patients were classified into the iAE and non-iAE groups. And iAE was further classified into 5 subgrades according to the ClassIntra grade (with I-V severity categories). Technical performance was evaluated using the Objective Structured Assessment of Technical Skills tool and the Generic Error Rating Tool.

RESULTS

Overall, 528 gastric cancer patients were included in this study, with 105 patients (19.9%) in the iAE group and 423 (80.1%) in the non-iAE group. The survival curve showed that the overall, disease-specific, and recurrence-free survival of the non-iAE group were significantly better than those of the iAE group ( P =0.001). The prognosis of patients with ClassIntra grade ≥II was significantly worse than that of patients with ClassIntra grade ≤I. A higher ClassIntra grade, lower Objective Structured Assessment of Technical Skills score, and total gastrectomy were independent risk factors for severe postoperative complications. There was a significant increase in bleeding (grade IV) and injury with splenic hilar lymph node dissection during total gastrectomy.

CONCLUSIONS

The ClassIntra grade is an effective prognostic and surgical quality control index for laparoscopic radical surgery for gastric cancer; therefore, it could be included in routine hospital care and surgical quality control.

Video-based tools for surgical quality assessment of technical skills in laparoscopic procedures: a systematic review

BACKGROUND

Quality of surgery has substantial impact on both short- and long-term clinical outcomes. This stresses the need for objective surgical quality assessment (SQA) for education, clinical practice and research purposes. The aim of this systematic review was to provide a comprehensive overview of all video-based objective SQA tools in laparoscopic procedures and their validity to objectively assess surgical performance.

METHODS

PubMed, Embase.com and Web of Science were systematically searched by two reviewers to identify all studies focusing on video-based SQA tools of technical skills in laparoscopic surgery performed in a clinical setting. Evidence on validity was evaluated using a modified validation scoring system.

RESULTS

Fifty-five studies with a total of 41 video-based SQA tools were identified. These tools were used in 9 different fields of laparoscopic surgery and were divided into 4 categories: the global assessment scale (GAS), the error-based assessment scale (EBAS), the procedure-specific assessment tool (PSAT) and artificial intelligence (AI). The number of studies focusing on these four categories were 21, 6, 31 and 3, respectively. Twelve studies validated the SQA tool with clinical outcomes. In 11 of those studies, a positive association between surgical quality and clinical outcomes was found.

CONCLUSION

This systematic review included a total of 41 unique video-based SQA tools to assess surgical technical skills in various domains of laparoscopic surgery. This study suggests that validated SQA tools enable objective assessment of surgical performance with relevance for clinical outcomes, which can be used for training, research and quality improvement programs.

Factors affecting the quality of laparoscopic D2 lymph node dissection for gastric cancer: a cohort study from two randomized controlled trials

BACKGROUND

Laparoscopic D2 lymph node dissection (LND) for gastric cancer has a wide range and high difficulty. In the past, the quality of surgery was often judged by the time of the operation or the amount of blood loss, but the analysis based on surgical video was rarely reported. The purpose of this study was to analyze the relationship between the quality of laparoscopic D2 LND for gastric cancer and postoperative complications.

METHODS

The surgical video and clinicopathological data of 610 patients in two randomized controlled trials in our center from 2013 to 2016 were retrospectively analyzed. Klass-02-QC LND scale and general error score tool were used to quantitatively evaluate the intraoperative performance of D2 LND. Logistic regression was used to analyze the influencing factors of postoperative complications.

RESULTS

The overall incidence of complications (CD classification≥2) was 20.6%; the incidence of surgical complications was 6.9%. According to whether the LND score reached 44, patients were divided into a qualified group (73%) and a not-qualified group (27%). Event score (ES) by quartile was divided into grade 1 (21.7%), grade 2 (26%), grade 3 (28%), and grade 4 (24.3%) from low to high. Univariate logistic regression analysis showed that ES greater than or equal to 3, tumor size greater than or equal to 35 mm, and cTNM >II were independent risk factors for not-qualified LND. Male,tumor size greater than or equal to 35 mm and cTNM >II were independent risk factors for grade 4 ES. Not-qualified LND (OR=1.62, 95% CI: 1.16-3.89, P =0.021), grade 4 ES (OR=3.21, 95% CI: 1.52-3.90, P =0.035), and cTNM >II (OR=1.74, 95% CI: 1.39-7.33, P =0.041) were independent risk factors for postoperative surgical complications.

CONCLUSIONS

The qualification of LND and intraoperative events based on surgical video are the independent influencing factors of postoperative complications of laparoscopic gastric cancer surgery. Specialist training and teaching based on surgical video may help to improve the surgical skills of specialists and improve the postoperative outcome of patients.

Electroencephalography can provide advance warning of technical errors during laparoscopic surgery

BACKGROUND

Intraoperative adverse events lead to patient injury and death, and are increasing. Early warning systems (EWSs) have been used to detect patient deterioration and save lives. However, few studies have used EWSs to monitor surgical performance and caution about imminent technical errors. Previous (non-surgical) research has investigated neural activity to predict future motor errors using electroencephalography (EEG). The present proof-of-concept cohort study investigates whether EEG could predict technical errors in surgery.

METHODS

In a large academic hospital, three surgical fellows performed 12 elective laparoscopic general surgeries. Audiovisual data of the operating room and the surgeon's neural activity were recorded. Technical errors and epochs of good surgical performance were coded into events. Neural activity was observed 40 s prior and 10 s after errors and good events to determine how far in advance errors were detected. A hierarchical regression model was used to account for possible clustering within surgeons. This prospective, proof-of-concept, cohort study was conducted from July to November 2021, with a pilot period from February to March 2020 used to optimize the technique of data capture and included participants who were blinded from study hypotheses.

RESULTS

Forty-five technical errors, mainly due to too little force or distance (n = 39), and 27 good surgical events were coded during grasping and dissection. Neural activity representing error monitoring (p = .008) and motor uncertainty (p = .034) was detected 17 s prior to errors, but not prior to good surgical performance.

CONCLUSIONS

These results show that distinct neural signatures are predictive of technical error in laparoscopic surgery. If replicated with low false-alarm rates, an EEG-based EWS of technical errors could be used to improve individualized surgical training by flagging imminent unsafe actions-before errors occur and cause patient harm.

Validation study of a skill assessment tool for education and outcome prediction of laparoscopic distal gastrectomy

BACKGROUND

The Japanese operative-rating scale for laparoscopic distal gastrectomy (JORS-LDG) was developed through cognitive task analysis together with the Delphi method to measure intraoperative performance during laparoscopic distal gastrectomy. This study aimed to investigate the value of this rating scale as an educational tool and a surgical outcome predictor in laparoscopic distal gastrectomy.

METHODS

The surgical performance of laparoscopic distal gastrectomy was assessed by the first assistant, through self-evaluation in the operating room and by video raters blind to the case. We evaluated inter-rater reliability, internal consistency, and correlations between the JORS-LDG scores and the evaluation methods, patient characteristics, and surgical outcomes.

RESULTS

Fifty-four laparoscopic distal gastrectomy procedures performed by 40 surgeons at 16 institutions were evaluated in the operating room and with video recordings using the proposed rating scale. The video inter-rater reliability was > 0.8. Participating surgeons were divided into the low, intermediate, and high groups based on their total scores. The number of laparoscopic surgeries and laparoscopic gastrectomy procedures performed differed significantly among the groups according to laparoscopic distal gastrectomy skill levels. The low, intermediate, and high groups also differed in terms of median operating times (311, 266, and 229 min, respectively, P < 0.001), intraoperative complication rates (27.8, 11.8, and 0%, respectively, P = 0.01), and postoperative complication rates (22.2, 0, and 0%, respectively, P = 0.002).

CONCLUSIONS

The JORS-LDG is a reliable and valid measure for laparoscopic distal gastrectomy training and could be useful in predicting surgical outcomes.

Surgical Outcomes, Technical Performance, and Surgery Burden of Robotic Total Gastrectomy for Locally Advanced Gastric Cancer: A Prospective Study

OBJECTIVE

To compare the short-term outcomes, surgery burden, and technical performance of robotic total gastrectomy (RTG) and laparoscopic total gastrectomy (LTG) for gastric cancer (GC).

SUMMARY OF BACKGROUND DATA

The impact of robotic systems on total gastrectomy remains obscure.

METHODS

This prospective study included 50 patients with advanced proximal GC underwent RTG combined with spleen-preserving splenic hilar lymphadenectomy between March 2018 and February 2020. Patients who underwent LTG in the FUGES-002, http://links.lww.com/SLA/C929 study were enrolled to compare the outcomes between RTG and LTG.

RESULTS

After propensity score matching, 48 patients in the RTG group and 96 patients in the LTG group were included in the analysis. The RTG group had a lower volume of intraoperative blood loss than the LTG group (38.7 vs 66.4 mL, P = 0.042). Significantly more extraperigastric lymph nodes were retrieved in the RTG group than in the LTG group (20.2 vs 17.5, P = 0.039). The average number of errors was lower in the RTG group than in the LTG group (43.2 vs 53.8 times/case, P < 0.001). The RTG group had a higher technical skill score (30.2 vs 28.4, P < 0.001) and a lower surgery task load index (33.2 vs 39.8, P < 0.001) than the LTG group. No significant difference was found in terms of postoperative morbidity between the 2 groups (14.6% vs 16.7%, P = 0.748).

CONCLUSIONS

In complex total gastrectomy for GC, compared with traditional laparoscopic surgery, robotic surgery provides a technically superior operative environment and reduces surgeon workload at high-volume specialized institutions.

Robotic spleen-preserving total gastrectomy shows better short-term advantages: a comparative study with laparoscopic surgery

BACKGROUND

Robotic surgery may be advantageous for complex surgery. We aimed to compare the intraoperative and postoperative short-term outcomes of spleen-preserving splenic hilar lymphadenectomy (SPSHL) during robotic and laparoscopic total gastrectomy.

METHODS

From July 2016 to December 2020, the clinicopathological data of 115 patients who underwent robotic total gastrectomy combined with robotic SPSHL (RSPSHL) and 697 patients who underwent laparoscopic total gastrectomy combined with laparoscopic SPSHL (LSPSHL) were retrospectively analyzed. A 1:2 ratio propensity score matching (PSM) was used to balance the differences between the two groups to compare their outcomes. The Generic Error Rating Tool was used to evaluate the technical performance.

RESULTS

After PSM, the baseline preoperative characteristics of the 115 patients in the RSPSHL and 230 patients in the LSPSHL groups were balanced. The dissection time of the region of the splenic artery trunk (5.4 ± 1.9 min vs. 7.8 ± 3.6 min, P < 0.001), the estimated blood loss during SPSHL (9.6 ± 4.8 ml vs. 14.9 ± 7.8 ml, P < 0.001), and the average number of intraoperative technical errors during SPSHL (15.1 ± 3.4 times/case vs. 20.7 ± 4.3 times/case, P < 0.001) were significantly lower in the RSPSHL group than in the LSPSHL group. The RSPSHL group showed higher dissection rates of No. 10 (78.3% vs. 70.0%, P = 0.104) and No. 11d (54.8% vs. 40.4%, P = 0.012) lymph nodes and significantly improved postoperative recovery results in terms of times to ambulation, first flatus, and first intake (P < 0.05). The splenectomy rates of the two groups were similar (1.7% vs. 0.4%, P = 0.539), and there was no significant difference in morbidity and mortality within postoperative 30 days (13.0% vs. 15.2%, P = 0.589).

CONCLUSION

Compared to LSPSHL, RSPSHL has more advantages in terms of surgical qualities and postoperative recovery process with similar morbidity and mortality. For complex SPSHL, robotic surgery may be a better choice.

Analysis of executional and procedural errors in dry‐lab robotic surgery experiments

Background

Analysing kinematic and video data can help identify potentially erroneous motions that lead to sub‐optimal surgeon performance and safety‐critical events in robot‐assisted surgery.

Methods

We develop a rubric for identifying task and gesture‐specific executional and procedural errors and evaluate dry‐lab demonstrations of suturing and needle passing tasks from the JIGSAWS dataset. We characterise erroneous parts of demonstrations by labelling video data, and use distribution similarity analysis and trajectory averaging on kinematic data to identify parameters that distinguish erroneous gestures.

Results

Executional error frequency varies by task and gesture, and correlates with skill level. Some predominant error modes in each gesture are distinguishable by analysing error‐specific kinematic parameters. Procedural errors could lead to lower performance scores and increased demonstration times but also depend on surgical style.

Conclusions

This study provides insights into context‐dependent errors that can be used to design automated error detection mechanisms and improve training and skill assessment.

Step, Error, and Event Frameworks in Endovascular Aortic Repair

OBJECTIVE

Competency-based surgical education requires detailed and actionable feedback to ensure adequate and efficient skill development. Comprehensive operative capture systems such as the Operating Room Black Box (ORBB; Surgical Safety Technologies, Inc), which continuously records and synchronizes multiple sources of intraoperative data, have recently been integrated into hybrid rooms to provide targeted feedback to endovascular teams. The objective of this study is to develop step, error, and event frameworks to evaluate technical performance in elective endovascular aortic repair (EVAR) comprehensively captured by the ORBB (Surgical Safety Technologies, Inc; Toronto, Canada).

METHODS

This study is based upon a modified Delphi consensus process to create evaluation frameworks for steps, errors, and events in EVAR. International experts from Vascular Surgery and Interventional Radiology were identified, based on their records of publications and invited presentations, or serving on relevant journal editorial boards. In an initial open-ended survey round, experts were asked to volunteer a comprehensive list of steps, errors, and events for a standard EVAR of an infrarenal aorto-iliac aneurysm (AAA). In subsequent survey rounds, the identified items were presented to the expert panel to rate on a 5-point Likert scale. Delphi survey rounds were repeated until the process reached consensus with a predefined agreement threshold (Cronbach α>0.7). The final frameworks were constructed with items achieving an agreement (responses of 4 or 5) from greater than 70% of experts.

RESULTS

Of 98 invited proceduralists, 38 formed the expert consensus panel (39%), consisting of 29 vascular surgeons and 9 interventional radiologists, with 34% from North America and 66% from Europe. Consensus criteria were met following the third round of the Delphi consensus process (Cronbach α=0.82-0.93). There were 15, 32, and 25 items in the error, step, and event frameworks, respectively (within-item agreement=74%-100%).

CONCLUSION

A detailed evaluation tool for the procedural steps, errors, and events in infrarenal EVAR was developed. This tool will be validated on recorded procedures in future work: It may focus skill development on common errors and hazardous steps. This tool might be used to provide high-quality feedback on technical performance of trainees and experienced surgeons alike, thus promoting surgical mastery.

System Factors Affecting Patient Safety in the OR: An Analysis of Safety Threats and Resiliency

OBJECTIVE

The objective of this study is to determine the characteristics and frequency of intraoperative safety threats and resilience supports using a human factors measurement tool.

BACKGROUND

Human factors analysis can provide insight into how system elements contribute to intraoperative adverse events. Empiric evidence on safety threats and resilience in surgical practice is lacking.

METHODS

A cross-sectional study of 24 patients undergoing elective laparoscopic general surgery at a single center in the Netherlands from May to November, 2017 was conducted. Video, audio, and patient physiologic data from all included procedures were obtained through a multichannel synchronized recording device. Trained analysts reviewed the recordings and coded safety threats and resilience supports. The codes were categorized into 1 of 6 categories (person, task, tools and technology, physical environment, organization, and external environment).

RESULTS

A median of 14 safety threats [interquartile range (IQR) 11-16] and 12 resilience supports (IQR 11-16) were identified per case. Most safety threat codes (median 9, IQR 7-12) and resilience support codes (median 10, IQR 7-12) were classified in the person category. The organization category contained a median of 2 (IQR 1-2) safety threat codes and 2 (IQR 2-3) resilience support codes per case. The tools and technology category contributed a small number of safety threats (median 1 per case, IQR 0-1), but rarely provided resilience support.

CONCLUSIONS

Through a detailed human factors analysis of elective laparoscopic general surgery cases, this study provided a quantitative analysis of the existing safety threats and resilience supports in a modern endoscopic operating room.

Patient Safety in the Operating Room During Urologic Surgery: The OR Black Box Experience

PURPOSE

To mitigate intraoperative adverse events, it is important to understand the context in which these errors occur. The purpose of this study is to characterize the IAEs and potential distractions that occur in minimally invasive urologic procedures.

METHODS

We conducted a prospective cohort study in patients undergoing laparoscopic urologic surgery at an academic health center. The OR Black Box, a unique technology system which captures video and audio recordings of the operating room as well as the operative field, was used to collect data regarding procedure type, critical step, IAEs, and distractions.

RESULTS

Of a total of 80 cases analyzed, the majority of these cases were partial nephrectomy (n = 36; 45%), radical nephrectomy (n = 20; 25%), and adrenalectomy (n = 4; 5%). Across all cases, there were a total of 138 clinically significant IAEs, 10 of which (14%) were of the highest severity (five on the SEVerity of intraoperative Events and Rectification Tool (SEVERE) matrix). Of these, 70 (51%) occurred during an a priori defined critical step of the operation. Distractions were common across all cases. The median rate of external communication per case was 16 events (IQR 11-22); and per critical step was 4 (IQR 2.75-8), while median room traffic per case was 65 entries/exits (IQR 42-76); and per critical step was 17 (IQR 10-65).

CONCLUSION

Our data demonstrate that IAEs occur frequently during all phases of the operation at hand. Future study will be required to examine the role of distractions and IAE as well as IAE and their relationship to post-operative clinical outcomes.

Supporting laparoscopic general surgery training with digital technology: The United Kingdom and Ireland paradigm

Surgical training in the UK and Ireland has faced challenges following the implementation of the European Working Time Directive and postgraduate training reform. The health services are undergoing a digital transformation; digital technology is remodelling the delivery of surgical care and surgical training. This review aims to critically evaluate key issues in laparoscopic general surgical training and the digital technology such as virtual and augmented reality, telementoring and automated workflow analysis and surgical skills assessment. We include pre-clinical, proof of concept research and commercial systems that are being developed to provide solutions. Digital surgical technology is evolving through interdisciplinary collaboration to provide widespread access to high-quality laparoscopic general surgery training and assessment. In the future this could lead to integrated, context-aware systems that support surgical teams in providing safer surgical care.

Barriers to reporting near misses and adverse events among professionals performing laparoscopic surgeries: a mixed methodology approach

BACKGROUND

The literature has investigated barriers to reporting adverse events in surgery, but with less emphasis on near misses. No attempt was made to categorise near misses by type and reportability. This paper attempts to fill these two gaps in the literature.

METHODS

A mixed methodology approach was adopted. A sample of 16 laparoscopic surgeries were observed followed by a questionnaire distributed among professionals dealing with laparoscopies. Non-parametric tests and mediation-moderation analysis were used to compare responses and identify causal factors.

RESULTS

A total of 469 near misses were observed, and classified into two categories: reportable events and common events. Among 23 observed reportable events, only 9 events were reported. Out of 300 distributed questionnaires, we received 178 valid responses (response rate 59%). The professionals strongly disagreed that reporting near misses (Mean 4.09, STD 0.95) and adverse events (4.17, 1.02) makes little contribution to the quality of surgery. However, the results show that professionals were more willing to disclose adverse events than near misses, Heavy workload, privacy, lack of support, and fear from disciplinary actions negatively affected professionals' willingness to report near misses.

DISCUSSION

Error reporting should aim to promote safety, knowledge sharing and education. It is important to differentiate near misses that should be reported from voluntary reported events. Hospital's management might award professionals who frequently report errors and provide solutions, Quality rather than quantity of reports should be emphasised with flexibility in the way near misses are reported.

CONCLUSION

The outcome of this study has benefits of understanding the attitudes of surgical professionals towards error reporting. It provides healthcare management with tool for enhancing safety and providing suitable training for their professionals.

Constructivist Grounded Theory to Establish the Relationship Between Technical Error and Adverse Patient Outcome: Modeling Technical Error and Adverse Outcomes

BACKGROUND

Preventable intraoperative errors have the potential to lead to adverse events. Our objective was to build a conceptual model of the relationship between minute technical errors performed by the surgeon and adverse patient outcomes.

MATERIALS AND METHODS

We used constructivist grounded theory methodology to build a model for the avoidance of technical errors. We used the Observational Clinical Human Reliability Assessment system, which categorizes granular, technical intraoperative errors, as our conceptual framework. We iteratively interviewed surgeons from multiple adult and pediatric surgical specialties, refined our semi-structured interview, and developed a conceptual model. Our model remained stable after interviewing 11 surgeons, and we reviewed it with earlier interviewed surgeons.

RESULTS

Our conceptual model helps us understand how technical errors can be associated with adverse outcomes and is applicable to a broad range of surgical steps. Each technical error is defined by a unique improper technical motion that without a compensatory response, it may lead to 1 or more discreet adverse outcomes. Our model includes 5 primary defenses against an adverse outcome, including perfect technique, recognizing imperfect technique, adequately correcting imperfect technique, recognizing an adverse event, and adequately compensating for an adverse event. It includes multiple examples of compensating for a technical error, resulting in a near miss.

DISCUSSION

Our conceptual model suggests that adverse patient outcomes can be related to minute technical deviations in surgical technique and provides a basis to study these preventable errors. Our model can also be used to develop intraoperative strategies to prevent these technical surgical errors.

The effect of intraoperative distractions on severe technical events in laparoscopic bariatric surgery

BACKGROUND

Given the complexity of the operating room (OR), it is unsurprising that surgeons frequently feel distracted while performing operative tasks. However, this relationship is not well studied in live surgeries. The objective of this study is to investigate the relationship between intraoperative distractions and technical events using surgical data.

METHODS

Roux-en-Y gastric bypass operation data from three tertiary care hospitals in Toronto, Canada were collected prospectively between 2017 and 2019 by a comprehensive operative capture platform (OR Black Box) and analyzed retrospectively. Time-synchronized audiovisual recordings of the OR and laparoscopic videos of the operation were collected, along with clinical data from the electronic health record. Video data was labeled for technical data, non-technical data, and distractions by trained coders. Procedural steps were categorized based on criticality. The relationship between severe technical events (case having 0 or 1 events vs. 2 or more) and the rate of distractions (machine alarms, external communications, people entering/exiting) in critical procedural steps was assessed through logistic regression, adjusting for team factors (surgeons' technical skills, nurse changeovers).

RESULTS

60 Roux-en-Y cases were analyzed. Average case duration was 83.2 min (SD = 21.97). Distractions occurred 47.6 times/h (SD = 20.3), with most frequent distraction being machine alarms (4.45/10 min, SD = 2.88). For unadjusted analysis, alarms (OR = 1.29, 95% CI 1.05-1.66) and surgeon's technical skills (OR = 0.65, 95% CI 0.43-0.93) were found to be correlated with severe technical events. After adjusting for team factors, alarms were found to be positively related with the presence of severe technical events (OR = 1.58, 95% CI 1.18-2.33) during high-criticality procedural steps.

CONCLUSIONS

This study showed a significant association between intraoperative distractions, in particular machine alarms, and severe technical events during high-criticality procedural steps. Further investigation will assess the temporal relationship between distractions and technical events and assess mitigation strategies to create a safer surgical environment.

Technical Performance as a Predictor of Clinical Outcomes in Laparoscopic Gastric Cancer Surgery

OBJECTIVE

The purpose of this study was to evaluate the relationship between technical performance and patient outcomes in laparoscopic gastric cancer surgery.

BACKGROUND

Laparoscopic gastrectomy for cancer is an advanced procedure with high rate of postoperative morbidity and mortality. Many variables including patient, disease, and perioperative management factors have been shown to impact postoperative outcomes; however, the role of surgical performance is insufficiently investigated.

METHODS

A retrospective review was performed for all patients who had undergone laparoscopic gastrectomy for cancer at 3 teaching institutions between 2009 and 2015. Patients with available, unedited video-recording of their procedure were included in the study. Video files were rated for technical performance, using Objective Structured Assessments of Technical Skills (OSATS) and Generic Error Rating Tool instruments. The main outcome variable was major short-term complications. The effect of technical performance on patient outcomes was assessed using logistic regression analysis with backward selection strategy.

RESULTS

Sixty-one patients with available video recordings were included in the study. The overall complication rate was 29.5%. The mean Charlson comorbidity index, type of procedure, and the global OSATS score were included in the final predictive model. Lower performance score (OSATS ≤29) remained an independent predictor for major short-term outcomes (odds ratio 6.49), while adjusting for comorbidities and type of procedure.

CONCLUSIONS

Intraoperative technical performance predicts major short-term outcomes in laparoscopic gastrectomy for cancer. Ongoing assessment and enhancement of surgical skills using modern, evidence-based strategies might improve short-term patient outcomes. Future work should focus on developing and studying the effectiveness of such interventions in laparoscopic gastric cancer surgery.

Assessment of 3-Dimensional vs 2-Dimensional Imaging and Technical Performance Using a Multiport Intraoperative Data Capture and Analytic System for Patients Undergoing Laparoscopic Roux-en-Y Gastric Bypass Surgery

IMPORTANCE

Errors and adverse events occur frequently in health care. Three-dimensional (3-D) laparoscopic systems claim to provide more realistic depth perception and better spatial orientation compared with their 2-D counterparts.

OBJECTIVE

To compare the association of 3-D vs 2-D systems with technical performance during laparoscopic Roux-en-Y gastric bypass (LRYGB) procedures using a multiport intraoperative data capture system.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study was performed between May and December 2018, with a total of 50 LRYGB procedures performed in an academic tertiary care center; recordings of the operations were evaluated with a 30-day follow-up. All procedures were performed by the same surgical team.

EXPOSURE

Surgical teams used 2-D or 3-D laparoscopic systems.

MAIN OUTCOMES AND MEASURES

Technical performance was evaluated using the Objective Structured Assessment of Technical Skill and surgical errors and events using the Generic Error Rating Tool.

RESULTS

Of the 50 patients who underwent LRYGB procedures, 42 (86%) were women, with a median (interquartile range) age of 42 (35-47) years and a median (interquartile range) body mass index of 46 (42-48), with no significant demographic differences between the groups whose operations were performed using the 2-D and 3-D systems. The mean (SD) number of errors per case was significantly lower in procedures using the 3-D laparoscopic system than in those using the 2-D system (17 [6] vs 33 [2]; P < .001). The mean (SD) number of error-related events was significantly lower in procedures using the 3-D system than in those using the 2-D system (6 [2] vs 11 [4]; P < .001). Mean (SD) Objective Structured Assessment of Technical Skill scores were significantly higher when the 3-D system was used than when the 2-D system was used (28 [4] vs 22 [3]; P < .001).

CONCLUSIONS AND RELEVANCE

In this limited sample of LRYGB procedures, the use of a 3-D laparoscopic system was associated with a statistically significant reduction in errors and events as well as higher Objective Structured Assessment of Technical Skill scores compared with 2-D systems.

Video-based coaching in surgical education: a systematic review and meta-analysis

BACKGROUND

In the era of competency-based surgical education, VBC has gained increased attention and may enhance the efficacy of surgical education. The objective of this systematic review was to summarize the existing evidence of video-based coaching (VBC) and compare VBC to traditional master-apprentice-based surgical education.

METHODS

We performed a systematic review and meta-analysis of randomized controlled trials (RCT) assessing VBC according to the PRISMA and Cochrane guidelines. The MEDLINE, EMBASE, and COCHRANE and Researchgate databases were searched for eligible manuscripts. Standard mean difference (SMD) of performance scoring scales was used to assess the effect of VBC versus traditional training without VBC (control).

RESULTS

Of 627 studies identified, 24 RCTs were eligible and evaluated. The studies included 778 surgical trainees (n = 386 VBC vs. n = 392 control). 13 performance scoring scales were used to assess technical competence; OSATS-GRS was the most common (n = 15). VBC was provided preoperative (n = 11), intraoperative (n = 1), postoperative (n = 10), and perioperative (n = 2). The majority of studies were unstructured, where identified coaching frameworks were PRACTICE (n = 1), GROW (n = 2) and Wisconsin Coaching Framework (n = 1). There was an effect on performance scoring scales in favor of VBC coaching (SMD 0.87, p < 0.001). In subgroup analyses, the residents had a larger relative effect (SMD 1.13; 0.61-1.65, p < 0.001) of VBC compared to medical students (SMD 0.43, 0.06-0.81, p < 0.001). The greatest source of potential bias was absence of blinding of the participants and personnel (n = 20).

CONCLUSION

Video-based coaching increases technical performance of medical students and surgical residents. There exist significant study and intervention heterogeneity that warrants further exploration, showing the need to structure and standardize video-based coaching tools.

Video-Based Assessment in Surgical Education: A Scoping Review

BACKGROUND AND OBJECTIVE

Video-based assessment of residents' surgical skills may offer several advantages over direct observations of clinical performance in terms of objectivity, time-efficiency, and feasibility. Although video-based assessment is becoming more common in surgical training, a broad understanding of its utility is lacking. This scoping review explores video-based assessment in surgical training and presents the evidence supporting its use.

DESIGN

A literature search was conducted using the Web of Science database with key words related to video-based assessment and surgical training. Exclusion criteria included articles not published in English and articles on undergraduate medical education, continuing professional development, or non-surgical disciplines. Initially, 702 articles were identified; after title, abstract, and full-text screening by two independent reviewers (SM and VM), 199 articles remained.

RESULTS

We present the benefits of video-based assessment, including the ability to capture clinical ability in the operating room without decreasing intraoperative efficiency, as well as the potential to improve formative assessment and feedback practices. We describe the validity, reliability, and challenges of video-based assessment, as well as the use of video-based methods in clinical and simulated settings. We conclude by discussing questions that remain to be addressed.

CONCLUSIONS

Although further research and cost-benefit analyses are required, greater adoption of video-based assessment into surgical training may help meet increased assessment demands in an era of competency-based medical education.

Is three-dimensional laparoscopic spleen preserving splenic hilar lymphadenectomy for gastric cancer better than that of two-dimensional? Analysis of a prospective clinical research study

BACKGROUND

Three-dimensional (3D) systems for laparoscopy provide surgeons with additional information on spatial depth not found in two-dimensional (2D) systems.

METHODS

This study enrolled 156 spleen-preserving splenic hilar lymphadenectomy (LSPSHL) patients in a randomized controlled trial (ClinicalTrials.gov Identifier NCT02327481) at the department of gastric surgery at Fujian Medical University Union Hospital between January 2015 and April 2016. The short-term efficacies were compared between the treatment groups. The unedited videos of 80 LSPSHL (40 procedures each for 3D and 2D) were rated for technical performance using the Generic Error Rating Tool.

RESULTS

The data for 156 LSPSHL patients indicate that the estimated blood loss (EBL) (3D vs 2D = 66.3 vs. 99.0, P = 0.046) was significantly less in the 3D group. The postoperative recovery and complication rates were similar (P > 0.05). And there were no deaths within 30 days of surgery. Two observers analyzed 80 videos of LSPSHL. The results showed that there were fewer grasping-errors made in the 3D group than in the 2D group when dissecting the inferior pole region of spleen (IPRS) (P = 0.016) and the superior pole region of spleen (SPRS) (P = 0.022). Additionally, the inter-rater reliability was high regarding grasping-errors in the IPRS (intraclass correlation coefficient (ICC) 0.92) and in the SPRS (ICC 0.83). The ICC for the total number of errors was 0.82. The mean of errors in the 3D group (3D vs. 2D = 20.7 vs. 23.5, P = 0.022) was less than the 2D group.

CONCLUSIONS

Compared with 2D LSPSHL, 3D technology reduces EBL and technical errors during splenic hilar dissection.

Underreporting of Veress Needle Injuries: Comparing Direct Observation and Chart Review Methods

BACKGROUND

Adverse events in surgery occur frequently, increase likelihood of postoperative morbidity, and mostly take place in the operating rooms. Several surgeons have advocated for learning from adverse events and near misses to help improve patient safety. To do so, one must first understand how to accurately identify and report intraoperative events.

MATERIALS AND METHODS

Consecutive laparoscopic cases performed in a referral center were included in the cohort. Veress needle (VN) injuries were characterized according to a priori established criteria. Two methods were used to identify VN injuries: direct observation and patient chart review. For direct observation, trained surgeon assessors identified the outcomes using a comprehensive data capture platform called the operating room black box. On the other hand, operative reports and patient charts were reviewed by trained assessors to identify reported VN injuries.

RESULTS

Hundred thirty-one cases were analyzed. There were 12 (9%) VN injuries identified by direct observation compared to 3 (2%) identified in patient chart review method. Injuries to the liver and stomach were identified by both methods, whereas injuries to the omentum were not reported in patient charts even if they required rectification. There were seven VN injuries that required rectification, lasting up to 12% of the operating time. There were 47 (35%) near misses identified through direct observation, whereas none was reported in patient charts.

CONCLUSIONS

Direct observation enables characterization of VN injury and near misses with far greater detail and accuracy than patient chart review.

Acute mental stress and surgical performance

Background

Stress has been shown to impact adversely on multiple facets critical to optimal performance. Advancements in wearable technology can reduce barriers to observing stress during surgery. This study aimed to investigate the association between acute intraoperative mental stress and technical surgical performance.

Methods

Continuous electrocardiogram data for a single attending surgeon were captured during surgical procedures to obtain heart rate variability (HRV) measures that were used as a proxy for acute mental stress. Two different measures were used: root mean square of successive differences (RMSSD) and standard deviation of RR intervals (SDNN). Technical surgical performance was assessed on the Operating Room Black Box® platform using the Generic Error Rating Tool (GERT). Both HRV recording and procedure video recording were time‐stamped. Surgical procedures were fragmented to non‐overlapping intervals of 1, 2 and 5 min, and subjected to data analysis. An event was defined as any deviation that caused injury to the patient or posed a risk of harm.

Results

Rates of events were significantly higher (47–66 per cent higher) in the higher stress quantiles than in the lower stress quantiles for all measured interval lengths using both proxy measures for acute mental stress. The strongest association was observed using 1‐min intervals with RMSSD as the HRV measure (P < 0·001).

Conclusion

There is an association between measures of acute mental stress and worse technical surgical performance. Further study will help delineate the interdependence of these variables and identify triggers for increased stress levels to improve surgical safety.

A scoping review of assessment tools for laparoscopic suturing

BACKGROUND

A needs assessment identified a gap in teaching and assessment of laparoscopic suturing (LS) skills. The purpose of this review is to identify assessment tools that were used to assess LS skills, to evaluate validity evidence available, and to provide guidance for selecting the right assessment tool for specific assessment conditions.

METHODS

Bibliographic databases were searched till April 2017. Full-text articles were included if they reported on assessment tools used in the operating room/simulation to (1) assess procedures that require LS or (2) specifically assess LS skills.

RESULTS

Forty-two tools were identified, of which 26 were used for assessing LS skills specifically and 26 for procedures that require LS. Tools had the most evidence in internal structure and relationship to other variables, and least in consequences.

CONCLUSION

Through identification and evaluation of assessment tools, the results of this review could be used as a guideline when implementing assessment tools into training programs.

Relationship between intraoperative non-technical performance and technical events in bariatric surgery

Background

The operating theatre is a unique environment with complex team interactions, where technical and non-technical performance affect patient outcomes. The correlation between technical and non-technical performance, however, remains underinvestigated. The purpose of this study was to explore these interactions in the operating theatre.

Methods

A prospective single-centre observational study was conducted at a tertiary academic medical centre. One surgeon and three fellows participated as main operators. All patients who underwent a laparoscopic Roux-en-Y gastric bypass and had the procedures captured using the Operating Room Black Box® platform were included. Technical assessment was performed using the Objective Structured Assessment of Technical Skills and Generic Error Rating Tool instruments. For non-technical assessment, the Non-Technical Skills for Surgeons (NOTSS) and Scrub Practitioners' List of Intraoperative Non-Technical Skills (SPLINTS) tools were used. Spearman rank-order correlation and N-gram statistics were conducted.

Results

Fifty-six patients were included in the study and 90 procedural steps (gastrojejunostomy and jejunojejunostomy) were analysed. There was a moderate to strong correlation between technical adverse events (rs = 0·417–0·687), rectifications (rs = 0·380–0·768) and non-technical performance of the surgical and nursing teams (NOTSS and SPLINTS). N-gram statistics showed that after technical errors, events and prior rectifications, the staff surgeon and the scrub nurse exhibited the most positive non-technical behaviours, irrespective of operator (staff surgeon or fellow).

Conclusion

This study demonstrated that technical and non-technical performances are related, on both an individual and a team level. Valuable data can be obtained around intraoperative errors, events and rectifications.

A prospective comparison of live and video-based assessments of colonoscopy performance

BACKGROUND AND AIMS

Colonoscopy performance is typically assessed by a supervisor in the clinical setting. There are limitations of this approach, however, because it allows for rater bias and increases supervisor workload demand during the procedure. Video-based assessment of recorded procedures has been proposed as a complementary means by which to assess colonoscopy performance. This study sought to investigate the reliability, validity, and feasibility of video-based assessments of competence in performing colonoscopy compared with live assessment.

METHODS

Novice (<50 previous colonoscopies), intermediate (50-500), and experienced (>1000) endoscopists from 5 hospitals participated. Two views of each colonoscopy were videotaped: an endoscopic (intraluminal) view and a recording of the endoscopist's hand movements. Recorded procedures were independently assessed by 2 blinded experts using the Gastrointestinal Endoscopy Competency Assessment Tool (GiECAT), a validated procedure-specific assessment tool comprising a global rating scale (GRS) and checklist (CL). Live ratings were conducted by a non-blinded expert endoscopist. Outcomes included agreement between live and blinded video-based ratings of clinical colonoscopies, intra-rater reliability, inter-rater reliability and discriminative validity of video-based assessments, and perceived ease of assessment.

RESULTS

Forty endoscopists participated (20 novices, 10 intermediates, and 10 experienced). There was good agreement between the live and video-based ratings (total, intra-class correlation [ICC] = 0.847; GRS, ICC = 0.868; CL, ICC = 0.749). Intra-rater reliability was excellent (total, ICC = 0.99; GRS, ICC = 0.99; CL, ICC = 0.98). Inter-rater reliability between the 2 blinded video-based raters was high (total, ICC = 0.91; GRS, ICC = 0.918; CL, ICC = 0.862). GiECAT total, GRS, and CL scores differed significantly among novice, intermediate, and experienced endoscopists (P < .001). Video-based assessments were perceived as "fairly easy," although live assessments were rated as significantly easier (P < .001).

CONCLUSIONS

Video-based assessments of colonoscopy procedures using the GiECAT have strong evidence of reliability and validity. In addition, assessments using videos were feasible, although live assessments were easier.

Surgeon Performance Predicts Early Continence After Robot-Assisted Radical Prostatectomy

INTRODUCTION

There is limited, yet compelling evidence supporting the role of surgeon technical performance in influencing patient outcomes. To date, this concept has been underexplored in endourologic procedures. We hypothesized that a surgeon's technical performance plays a role in predicting an early return to continence after robot-assisted radical prostatectomy (RARP).

MATERIALS AND METHODS

We conducted a retrospective, matched case-control analysis of prospectively collected unedited RARP endoscopic videos performed by a single surgeon. A blinded observer with expertise in intraoperative video analysis evaluated clinically relevant steps of RARP using the global evaluative assessment of robotic skill (GEARS) and the generic error rating tool (GERT). The primary outcome was continence status at 3 months postoperatively, defined as patient use of less than or equal to a single precautionary pad. Mann-Whitney U tests examined differences in predictor variables between cases and controls, and multivariate analysis was conducted using binary logistic regression models.

RESULTS

Twenty-four incontinent patients were matched for age, body mass index, preoperative International Prostate Symptoms Score, use of posterior/anterior hitch, prostate weight, and learning curve position. No statistically significant difference in errors between groups was observed using the GERT. On multivariate analysis, overall case GEARS score was independently predictive of 3-month continence status (odds ratios [OR] = 0.55, 95% confidence interval [CI] 0.33-0.91), as were urethrovesical anastomosis (OR = 0.70, 95% CI 0.50-0.97) and bladder neck GEARS scores (OR = 0.69, 95% CI 0.51-0.94).

CONCLUSIONS

Our study generates the hypothesis that there may be a link between surgeon technical performance and functional outcomes in RARP. This relationship may have implications for the accreditation and training of future urologists and warrants further investigation.

What Are the Principles That Guide Behaviors in the Operating Room?: Creating a Framework to Define and Measure Performance

OBJECTIVE

To identify the core principles that guide expert intraoperative behaviors and to use these principles to develop a universal framework that defines intraoperative performance.

BACKGROUND

Surgical outcomes are associated with intraoperative cognitive skills. Yet, our understanding of factors that control intraoperative judgment and decision-making are limited. As a result, current methods for training and measuring performance are somewhat subjective-more task rather than procedure-oriented-and usually not standardized. They thus provide minimal insight into complex cognitive processes that are fundamental to patient safety.

METHODS

Cognitive task analyses for 6 diverse surgical procedures were performed using semistructured interviews and field observations to describe the thoughts, behaviors, and actions that characterize and guide expert performance. Verbal data were transcribed, supplemented with content from published literature, coded, thematically analyzed using grounded-theory by 4 independent reviewers, and synthesized into a list of items.

RESULTS

A conceptual framework was developed based on 42 semistructured interviews lasting 45 to 120 minutes, 5 expert panels and 51 field observations involving 35 experts, and 135 sources from the literature. Five domains of intraoperative performance were identified: psychomotor skills, declarative knowledge, advanced cognitive skills, interpersonal skills, and personal resourcefulness. Within the advanced cognitive skills domain, 21 themes were perceived to guide the behaviors of surgeons: 18 for surgical planning and error prevention, and 3 for error/injury recognition, rescue, and recovery. The application of these thought patterns was highly case-specific and variable amongst subspecialties, environments, and individuals.

CONCLUSIONS

This study provides a comprehensive definition of intraoperative expertise, with greater insight into the complex cognitive processes that seem to underlie optimal performance. This framework provides trainees and other nonexperts with the necessary information to use in deliberate practice and the creation of effective thought habits that characterize expert performance. It may help to identify gaps in performance, and to isolate root causes of surgical errors with the ultimate goal of improving patient safety.

Comprehensive simulation-enhanced training curriculum for an advanced minimally invasive procedure: a randomized controlled trial

BACKGROUND

There is no comprehensive simulation-enhanced training curriculum to address cognitive, psychomotor, and nontechnical skills for an advanced minimally invasive procedure.

OBJECTIVES

1) To develop and provide evidence of validity for a comprehensive simulation-enhanced training (SET) curriculum for an advanced minimally invasive procedure; (2) to demonstrate transfer of acquired psychomotor skills from a simulation laboratory to live porcine model; and (3) to compare training outcomes of SET curriculum group and chief resident group.

SETTING

University.

METHODS

This prospective single-blinded, randomized, controlled trial allocated 20 intermediate-level surgery residents to receive either conventional training (control) or SET curriculum training (intervention). The SET curriculum consisted of cognitive, psychomotor, and nontechnical training modules. Psychomotor skills in a live anesthetized porcine model in the OR was the primary outcome. Knowledge of advanced minimally invasive and bariatric surgery and nontechnical skills in a simulated OR crisis scenario were the secondary outcomes. Residents in the SET curriculum group went on to perform a laparoscopic jejunojejunostomy in the OR. Cognitive, psychomotor, and nontechnical skills of SET curriculum group were also compared to a group of 12 chief surgery residents.

RESULTS

SET curriculum group demonstrated superior psychomotor skills in a live porcine model (56 [47-62] versus 44 [38-53], P<.05) and superior nontechnical skills (41 [38-45] versus 31 [24-40], P<.01) compared with conventional training group. SET curriculum group and conventional training group demonstrated equivalent knowledge (14 [12-15] versus 13 [11-15], P = 0.47). SET curriculum group demonstrated equivalent psychomotor skills in the live porcine model and in the OR in a human patient (56 [47-62] versus 63 [61-68]; P = .21). SET curriculum group demonstrated inferior knowledge (13 [11-15] versus 16 [14-16]; P<.05), equivalent psychomotor skill (63 [61-68] versus 68 [62-74]; P = .50), and superior nontechnical skills (41 [38-45] versus 34 [27-35], P<.01) compared with chief resident group.

CONCLUSION

Completion of the SET curriculum resulted in superior training outcomes, compared with conventional surgery training. Implementation of the SET curriculum can standardize training for an advanced minimally invasive procedure and can ensure that comprehensive proficiency milestones are met before exposure to patient care.

Scientific Skill Assessment of Basic Surgical Dissection and Overall Laparoscopic Performance

To improve surgical education, objective and scientific skill assessments are required. There are two types of skill evaluations: assessments of basic surgical skills and assessments of overall surgical performance. To establish a reliable assessment method for surgical dissection, we measured the force applied on the tip of a surgical instrument during dissection of the renal vessels of pigs. The experiments revealed that, during surgical dissection, expert laparoscopic surgeons applied vertical force at the beginning of the stroke and then horizontal force, with minimum vertical force, at the end of the stroke. As an assessment of overall surgical performance, the Endoscopic Surgical Qualification system was developed and has been used for 12 years in Japan. More than 3700 surgeons, including urologists, were determined to have appropriate laparoscopic surgical skills after assessments of unedited videos by referees.