Developing a coaching mechanism for practicing surgeons

Characteristics of Surgical Coaching Interventions: A Systematic Review

OBJECTIVE

Coaching is increasingly utilized as an educational intervention for performance improvement in surgeons and surgical trainees. Surgical coaching has been utilized across a broad range of specialties, experience levels and outcomes with generally positive results. Coaching interventions are often developed by individual institutions for their own context which has resulted in a heterogenous group of interventions. This review aims to investigate surgical coaching interventions to identify common characteristics that comprise an effective coaching intervention.

METHODS

A systematic review was conducted to identify studies investigating surgical coaching interventions up to July 2024. Studies were limited to English language peer-reviewed studies that adequately described the characteristics and outcomes of the surgical coaching intervention. Data on the primary and secondary outcomes, study objective and participants' demographics were also recorded.

RESULTS

The search across 4 electronic databases generated 9538 citations. Following screening and review of full text articles 28 studies were included in the review. Surgical coaching interventions were carried out in 8 separate countries with the majority (22/28) in North America. Studies involved between 3 and 107 participants. Coaching interventions were markedly heterogenous, and specific details of the methods used were inconsistently documented. Study length ranged from 1 (9/28) to 14 (1/28) sessions and duration from less than 15 minutes (1/29) to greater than 3 hours (3/28). The most common themes were goal setting (10/28), feedback (7/28) and reflection (7/28). Outcomes were generally positive with 47 of 55 identified outcomes demonstrating benefit from surgical coaching. There were 3 key domains and 13 sub-domains that comprised the majority of coaching interventions.

CONCLUSIONS

Surgical coaching has been shown to be a promising intervention that requires more rigorous research to develop the field. We have identified 3 key domains which can be utilized to analyses and develop coaching interventions in the future.

Nontechnical Coaching in Academic Surgical Practice-Where Do We Stand and What's Next?

OBJECTIVE

To evaluate the potential of nontechnical coaching (NC) as an intervention to enhance professional development, reduce burnout, and improve patient outcomes among attending academic surgeons (AS) in high-pressure surgical environments.

DESIGN

A narrative review was performed using PubMed to identify and assess studies focused on NC in academic surgery. We evaluated articles addressing the impact, benefits, risks, and barriers associated with NC, with particular attention to coaching frameworks, training programs, and participant feedback.

SETTING

The review encompasses research conducted in various academic surgical settings.

PARTICIPANTS

Studies primarily involved attending academic surgeons across diverse surgical specialties, especially those experiencing high levels of burnout and decreased job satisfaction.

RESULTS

Findings indicate that NC offers several benefits for AS. Pilot studies and qualitative surveys suggest that NC can reduce burnout, enhance intraoperative decision-making, and improve patient engagement. Surgeons who participated in NC reported better stress management, increased self-awareness, and improved leadership skills. Moreover, NC appears to foster enhanced team dynamics and, in some cases, may yield fiscal benefits by reducing surgical errors and increasing operational efficiency. However, significant barriers to NC adoption remain, including cultural resistance within surgical departments, time constraints, and concerns regarding the efficacy of NC compared to traditional technical coaching. Additionally, the current evidence is limited by small sample sizes, selection bias, and a lack of standardized, quantitative measures.

CONCLUSION

Preliminary evidence supports NC as a promising intervention for enhancing surgeon well-being and patient outcomes. Future research should focus on establishing standardized guidelines for coach training, addressing misconceptions about NC, and designing larger, methodologically robust studies using validated outcomes. Expanding NC could foster a more resilient surgical workforce, ultimately benefiting both surgeons and patients through improved engagement, satisfaction, and quality of care.

Development and application of a non-technical skills coaching intervention framework for surgeons: A pilot quality improvement initiative

Non-technical skills (NTS) challenges experienced by surgeons may degrade performance, ultimately impacting the safety and quality of care delivered to patients. The objectives of this work were to develop a framework for NTS coaching for surgeons and implement a coaching program utilizing the developed NTS coaching framework. Leveraging adult learning and self-determination theories, a specialty-agnostic NTS coaching framework was developed for individual coaching sessions with robotic surgeons. The framework was used to deliver NTS coaching sessions to robotic surgeons. Surgeon's robotic procedures were recorded, and expert raters assessed their NTS using the Non-Technical Skills for Surgeons tool. Measures of surgeon satisfaction, learning outcomes, and performance improvement were determined. Cohen's d statistic was used to estimate the effect size of the coaching intervention. To pilot the program, ten robotic-assisted surgeries (five pre-coaching and five post-coaching) were observed from five practicing robotic surgeons who were recruited from a large academic healthcare system. Expert raters' assessment of surgeons' NTS revealed several exemplar and non-exemplar behaviors. Surgeons were satisfied with the coaching, rating its quality very highly on all NTS dimensions. On a Likert scale of 1 (strongly disagree) to 5 (strongly agree), surgeons had a stronger agreement that the coaching could improve their situation awareness (4.0±.5) and leadership (4.8±.2) skills compared to their decision making and communication (3.8±.7). From the post-coaching observations, coaching had medium-to-large effect on situation awareness (d = .65) and leadership (d = .41), small effect on communication and teamwork (d = .14), and no effect on decision-making. Overall, the coaching intervention had a medium effect on total NTS (d = .33). We presented a quality improvement initiative to enhance the NTS of surgeons by implementing a coaching program that leverages our developed NTS framework. Recognizing the importance of NTS in surgeries, our initiative shows a commitment to continuous improvement of patient safety and quality of care.

Video-Based Performance Analysis in Pituitary Surgery - Part 2: Artificial Intelligence Assisted Surgical Coaching

BACKGROUND

Superior surgical skill improves surgical outcomes in endoscopic pituitary adenoma surgery. Video-based coaching programs, pioneered in professional sports, have shown promise in surgical training. In this study, we developed and assessed a video-based coaching program using artificial intelligence (AI) assistance.

METHODS

An AI-assisted video-based surgical coaching was implemented over 6 months with the pituitary surgery team. The program consisted of 1) monthly random video analysis and review; and 2) quarterly 2-hour educational meetings discussing these videos and learning points. Each video was annotated for surgical phases and steps using AI, which improved video interactivity and allowed the calculation of quantitative metrics. Primary outcomes were program feasibility, acceptability, and appropriateness. Surgical performance (via modified Objective Structured Assessment of Technical Skills) and early surgical outcomes were recorded for every case during the 6-month coaching period, and a preceding 6-month control period. Beta and logistic regression were used to assess the change in modified Objective Structured Assessment of Technical Skills scores and surgical outcomes after the coaching program implementation.

RESULTS

All participants highly rated the program's feasibility, acceptability, and appropriateness. During the coaching program, 63 endoscopic pituitary adenoma cases were included, with 41 in the control group. Surgical performance across all operative phases improved during the coaching period (P < 0.001), with a reduction in new postoperative anterior pituitary hormone deficit (P = 0.01).

CONCLUSIONS

We have developed a novel AI-assisted video surgical coaching program for endoscopic pituitary adenoma surgery - demonstrating its viability and impact on surgical performance. Early results also suggest improvement in patient outcomes. Future studies should be multicenter and longer term.

Ergonomics in Spine Surgery: A Systematic Review

STUDY DESIGN

This study is a systematic review.

OBJECTIVE

This systematic review aims to synthesize existing studies and highlight the significance of ergonomic considerations for spine surgeons' well-being and the impact on patient outcomes.

SUMMARY OF BACKGROUND DATA

Spine surgery is a physically demanding field that poses several risks to surgeons, particularly with musculoskeletal disorders. Despite the well-documented consequences of musculoskeletal injuries endured by surgeons, surgical ergonomics in spine surgery has received limited attention.

METHODS

Following PRISMA guidelines, a comprehensive literature search was conducted in PubMed and Embase. Studies focusing on surgeon ergonomics in spine surgery were selected. Data extracted included study details, surgeon demographics, ergonomic factors, and outcomes. Qualitative analysis was performed due to the heterogeneous nature of study designs and criteria.

RESULTS

Eleven studies met the inclusion criteria. Six studies utilized surveys to explore physical challenges, prevalence rates of pain, work practices, and ergonomic tools. Two studies employed optoelectronic motion analysis to assess the spinal angles of the surgeon during surgery. Two studies assesed ergonomics in different visualization methods using rapid entire body assessment (REBA). One study applied video analysis to scrutinize surgeons' neck postures during the case. The results demonstrated a varying prevalence and diverse presentations of musculoskeletal disorders, varying impact on surgical performance, and nuanced relationships between experience, workload, and ergonomic concerns.

CONCLUSION

This systematic review summarizes the heterogeneous evaluations of ergonomics in spine surgery. Overall, upwards of three-quarters of spine surgeons have reported musculoskeletal discomfort, most commonly presented as back pain, neck pain, and hand/wrist discomfort. These symptoms are often exacerbated by the use of loupes, operating bed height, and extended periods of time in various positions. Studies demonstrate that physical discomfort is associated with the surgeons' mental and emotional well-being, leading to stress, burnout, and reduced job satisfaction, all of which impact patient care.

Current trends and barriers to video management and analytics as a tool for surgeon skilling

BACKGROUND

The benefits of intraoperative recording are well published in the literature; however, few studies have identified current practices, barriers, and subsequent solutions. The objective of this study was to better understand surgeon's current practices and perceptions of video management and gather blinded feedback on a new surgical video recording product with the potential to address these barriers effectively.

METHODS

A structured questionnaire was used to survey 230 surgeons (general, gynecologic, and urologic) and hospital administrators across the US and Europe regarding their current video recording practices. The same questionnaire was used to evaluate a blinded concept describing a new intraoperative recording solution.

RESULTS

54% of respondents reported recording eligible cases, with the majority recording less than 35% of their total eligible caseload. Reasons for not recording included finding no value in recording simple procedures, forgetting to record, lack of access to equipment, legal concerns, labor intensity, and difficulty accessing videos. Among non-recording surgeons, 65% reported considering recording cases to assess surgical techniques, document practice, submit to conferences, share with colleagues, and aid in training. 35% of surgeons rejected recording due to medico-legal concerns, lack of perceived benefit, concerns about secure storage, and price. Regarding the concept of a recording solution, 74% of all respondents were very likely or quite likely to recommend the product for adoption at their facility. Appealing features to current recorders included the product's ease of use, use of AI to maintain patient and staff privacy, lack of manual downloads, availability of full-length procedural videos, and ease of access and storage. Non-recorders found the immediate access to videos and maintenance of patient/staff privacy appealing.

CONCLUSION

Tools that address barriers to recording, accessing, and managing surgical case videos are critical for improving surgical skills. Touch Surgery Enterprise is a valuable tool that can help overcome these barriers.

Automated algorithm aided capacity and confidence boost in surgical decision-making training for inferior clivus

Objective

To assess the impact of automated algorithms on the trainees' decision-making capacity and confidence for individualized surgical planning.

Methods

At Chinese PLA General Hospital, trainees were enrolled to undergo decision-making capacity and confidence training through three alternative visual tasks of the inferior clivus model formed from an automated algorithm and given consecutively in three exemplars. The rationale of automated decision-making was used to instruct each trainee.

Results

Following automated decision-making calculation in 50 skull base models, we screened out three optimal plans, infra-tubercle approach (ITA), trans-tubercle approach (TTA), and supra-tubercle approach (STA) for 41 (82.00%), 8 (16.00%), and 1 (2.00%) subject, respectively. From September 1, 2023, through November 17, 2023, 62 trainees (median age [range]: 27 [26-28]; 28 [45.16%] female; 25 [40.32%] neurosurgeons) made a decision among the three plans for the three typical models (ITA, TTA, and STA exemplars). The confidence ratings had fine test-retest reliability (Spearman's rho: 0.979; 95% CI: 0.970 to 0.988) and criterion validity with time spent (Spearman's rho: -0.954; 95%CI: -0.963 to -0.945). Following instruction of automated decision-making, time spent (initial test: 24.02 vs. 7.13 in ITA; 30.24 vs. 7.06 in TTA; 34.21 vs. 12.82 in STA) and total hits (initial test: 30 vs. 16 in ITA; 37 vs. 17 in TTA; 42 vs. 28 in STA) reduced significantly; confidence ratings (initial test: 2 vs. 4 in ITA; 2 vs. 4 in TTA; 1 vs. 3 in STA) increased correspondingly. Statistically significant differences (P < 0.05) were observed for the above comparisons.

Conclusions

The education tool generated by automated decision-making considers surgical freedom and injury risk for the individualized risk-benefit assessment, which may provide explicit information to increase trainees' decision-making capacity and confidence.

Evaluation of objective tools and artificial intelligence in robotic surgery technical skills assessment: a systematic review

BACKGROUND

There is a need to standardize training in robotic surgery, including objective assessment for accreditation. This systematic review aimed to identify objective tools for technical skills assessment, providing evaluation statuses to guide research and inform implementation into training curricula.

METHODS

A systematic literature search was conducted in accordance with the PRISMA guidelines. Ovid Embase/Medline, PubMed and Web of Science were searched. Inclusion criterion: robotic surgery technical skills tools. Exclusion criteria: non-technical, laparoscopy or open skills only. Manual tools and automated performance metrics (APMs) were analysed using Messick's concept of validity and the Oxford Centre of Evidence-Based Medicine (OCEBM) Levels of Evidence and Recommendation (LoR). A bespoke tool analysed artificial intelligence (AI) studies. The Modified Downs-Black checklist was used to assess risk of bias.

RESULTS

Two hundred and forty-seven studies were analysed, identifying: 8 global rating scales, 26 procedure-/task-specific tools, 3 main error-based methods, 10 simulators, 28 studies analysing APMs and 53 AI studies. Global Evaluative Assessment of Robotic Skills and the da Vinci Skills Simulator were the most evaluated tools at LoR 1 (OCEBM). Three procedure-specific tools, 3 error-based methods and 1 non-simulator APMs reached LoR 2. AI models estimated outcomes (skill or clinical), demonstrating superior accuracy rates in the laboratory with 60 per cent of methods reporting accuracies over 90 per cent, compared to real surgery ranging from 67 to 100 per cent.

CONCLUSIONS

Manual and automated assessment tools for robotic surgery are not well validated and require further evaluation before use in accreditation processes.PROSPERO: registration ID CRD42022304901.

Coaching with audiovisual technology in acute-care hospital settings: systematic review

BACKGROUND

Surgical coaching programmes are a means of improving surgeon performance. Embedded audiovisual technology has the potential to further enhance participant benefit and scalability of coaching. The objective of this systematic review was to evaluate how audiovisual technology has augmented coaching in the acute-care hospital setting and to characterize its impact on outcomes.

METHODS

A systematic review was conducted, searching PubMed, Ovid MEDLINE, Embase, PsycInfo, and CINAHL databases using PRISMA. Eligible studies described a coaching programme that utilized audiovisual technology, involved at least one coach-coachee interaction, and included healthcare professionals from the acute-care hospital environment. The risk of bias 2 tool and grading of recommendations, assessment, development, and evaluations (GRADE) framework were used to evaluate studies. Synthesis without meta-analysis was performed, creating harvest plots of three coaching outcomes: technical skills, self-assessment/feedback, and non-technical skills.

RESULTS

Of 10 458 abstracts screened, 135 full texts were reviewed, and 21 studies identified for inclusion. Seventeen studies were conducted within surgical specialties and six classes of audiovisual technology were utilized. An overall positive direction of effect was demonstrated for studies measuring improvement of either technical skills or non-technical skills. Direction of effect for self-assessment/feedback was weakly positive.

CONCLUSION

Audiovisual technology has been used successfully in coaching programmes within acute-care hospital settings to facilitate or assess coaching, with a positive impact on outcome measures. Future studies may address the additive benefits of video over in-person observation and enhance the certainty of evidence that coaching impacts on surgeon performance, surgeon well-being, and patient outcomes.

Experience of practicing obstetrician-gynecologists in a surgical training program in total laparoscopic hysterectomy

BACKGROUND

Advanced surgical techniques, such as total laparoscopic hysterectomy, are often challenging to acquire beyond fellowship training programs for practicing obstetrician-gynecologists. A lack of formative data currently exist for continuing medical education programs, limiting our understanding of how improvement in surgical skills and training programs occur.

OBJECTIVE

This study aimed to investigate how practicing obstetrician-gynecologists acting as trainees experience a program that aims to teach them total laparoscopic hysterectomy, and to assess whether their surgical skills improve according to data from formative assessment tools and qualitative data from open-ended survey questions and in-depth interviews.

STUDY DESIGN

We report a process analysis of formative data collected during a pilot implementation trial of a surgical training program targeting practicing obstetrician-gynecologists. Eleven consultant obstetrician-gynecologists and 4 experienced surgical mentors participated in 4 hospitals in Queensland, Australia. Total laparoscopic hysterectomy was performed in 700 patients over the course of the study. A total laparoscopic hysterectomy surgical mentorship training program of 10 training days with up to 3 total laparoscopic hysterectomy procedures per day was performed. Both the obstetrician-gynecologists and the surgical mentor completed a formative assessment questionnaire analyzing the trainee's performance after each surgical procedure. Mentors were formatively assessed by the Structured Training Trainer Assessment Report (STTAR) and at the completion of the study by the mini-STTAR, a summative assessment of quality of mentorship. Obstetrician-gynecologists, mentors, hospital leaders, and surgical administrative staff participated in qualitative interviews about the training program.

RESULTS

Over time, there was a demonstrated improvement in trainee performance reported by both mentors and trainees in all competency assessment tool domains as the case number increased, with mentors consistently rating trainees' performance higher than the trainees themselves. Most trainees were satisfied with their mentor in all 31 areas during formative assessment, and at the end of the training, structure, attributes, and role modeling were all rated high (average score >4.5; range, 3.79-5.00), whereas training behavior was rated slightly lower at 4.1 (range, 3.79-4.45). Qualitative interviews demonstrated that the trainees found the training to be a beneficial, hands-on experience.

CONCLUSION

Formative assessment clearly documented improvement in surgical skills during a total laparoscopic hysterectomy training program for consultant obstetrician-gynecologists.

Improving surgical excellence: first experience of a video-based intervention in outpatients

BACKGROUND

There are limited opportunities for surgeons to engage in active learning programs once they achieve Fellowship, especially for non-technical skills such as communication. This study aims to address this gap by evaluating a peer-based coaching program in non-technical skill using video-recorded patient consultations from a routine outpatient clinic.

METHODS

Standard outpatient consultations between consultant surgeons and patients were video recorded. The surgeon viewed the videos with a peer-coach (senior surgeon) who helped identify areas of strength and areas for improvement. To test the effect of the coaching session, outpatient consultations were recorded roughly 1 month later. Pre and post-coaching videos were assessed using the Maastricht History-Taking and Advice Scoring - Global Rating List (MAAS), a common tool for evaluating non-technical skills in clinicians.

RESULTS

A total of 12 surgeons consented to participate. Coaching significantly improved MAAS scores (mean difference = -0.61; 95% CI (-0.88, -0.33); P < 0.0001). Surgeons were generally positive about the experience. All found the method of learning suitable, and most thought the process improved their skills. Most thought that coaching would improve patient outcomes and the majority thought they would participate in ongoing coaching as part of their employment.

CONCLUSION

This supports the concept of surgical coaching as an effective tool to improve communication skills and the quality of surgical consultation. The next step is to expand beyond a voluntary cohort and link surgical coaching to improved patient outcomes.

Reciprocal peer coaching for practice improvement in surgery: a pilot study

BACKGROUND

Peer coaching has been associated with much higher rates of practice changes and new skill implementation compared to common used modalities but bilateral peer coaching structures where seniority is not a requirement to coach have not been studied. The purpose of this study was to implement and evaluate a reciprocal peer coaching pilot program for practicing surgeons to inform future coaching program design.

METHODS

A multicenter reciprocal peer surgical coaching program was designed according to the framework developed from previous studies by our group. The coach-coachee matching process was voluntary and autonomous. All participants received basic coaching skills training. Pairs were instructed to complete two coaching sessions, alternating between the coach or coachee role for each session. Data were collected through questionnaires and structured interviews.

RESULTS

Twenty-two participants enrolled in the pilot study and completed the coach training (88% enrollment rate). During the first wave of COVID-19, 12 participants withdrew. Of the five pairs that completed the program, three pairs were composed of general surgeons, one of orthopedic surgeons, and one ophthalmologic surgeon. Three sessions were conducted live in the OR, five virtually, and one involved an in-person discussion. Overall satisfaction with the program was high and all participants expectations were met. Participants were significantly more likely to predict "routinely" asking for feedback from their partner after study completion (6, 66%) compared to pre-intervention (p = 0.02).

CONCLUSION

This pilot study supports the feasibility of a peer coaching model for surgeons in practice that emphasized reciprocity and participant autonomy. These key elements should be considered when designing future coaching programs.

Surgeons' Coaching Techniques in the Surgical Coaching for Operative Performance Enhancement (SCOPE) Program

OBJECTIVE

To evaluate coaching techniques used by practicing surgeons who underwent dedicated coach training in a peer surgical coaching program.

BACKGROUND

Surgical coaching is a developing strategy for improving surgeons' intraoperative performance. How to cultivate effective coaching skills among practicing surgeons is uncertain.

METHODS

Through the Surgical Coaching for Operative Performance Enhancement (SCOPE) program, 46 surgeons within 4 US academic medical centers were assigned 1:1 into coach/coachee pairs. All attended a 3-hour Surgical Coaching Workshop-developed using evidence from the fields of surgery and education-then received weekly reminders. We analyzed workshop evaluations and audio transcripts of postoperative debriefs between coach/coachee pairs, co-coding themes based on established principles of effective coaching: (i) self-identified goals, (ii) collaborative analysis, (iii) constructive feedback, and (iv) action planning. Coaching principles were cross-referenced with intraoperative performance topics: technical, nontechnical, and teaching skills.

RESULTS

For the 8 postoperative debriefs analyzed, mean duration was 24.4 min (range 7-47 minutes). Overall, 326 coaching examples were identified, demonstrating application of all 4 core principles of coaching. Constructive feedback (17.6 examples per debrief) and collaborative analysis (16.3) were utilized more frequently than goal-setting (3.9) and action planning (3.0). Debriefs focused more often on nontechnical skills (60%) than technical skills (32%) or teaching-specific skills (8%). Among surgeons who completed the workshop evaluation (82% completion rate), 90% rated the Surgical Coaching Workshop "good" or "excellent."

CONCLUSIONS

Short-course coach trainings can help practicing surgeons use effective coaching techniques to guide their peers' performance improvement in a way that aligns with surgical culture.

Coaching in Surgical Education: A Systematic Review

OBJECTIVE

The objectives of this study were to review the coaching literature to (1) characterize the criteria integral to the coaching process, specifically in surgery, and (2) describe how these criteria have been variably implemented in published studies.

BACKGROUND

Coaching is a distinct educational intervention, but within surgery the term is frequently used interchangeably with other more established terms such as teaching and mentoring.

METHODS

A systematic search was performed of the MEDLINE and Cochrane databases to identify studies that used coach/coaching as an intervention for surgeons for either technical or nontechnical skills. Study quality was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).

RESULTS

A total of 2280 articles were identified and after screening by title, abstract and full text, 35 remained. Thirteen coaching criteria (a-m) were identified in 4 general categories: 1. overarching goal (a. refine performance of an existing skill set), 2. the coach (b. trusting partnership, c. avoids assessment, d. 2-way communication), the coachee (e. voluntary participation, f. self-reflection, g. goal setting, h. action plan, i. outcome evaluation), and the coach-coachee rapport (j. coaching training, k. structured coaching model, l. non-directive, m. open ended questions). Adherence to these criteria ranged from as high of 73% of studies (voluntary participation of coach and coachee) to as low as 7% (use of open-ended questions).

CONCLUSIONS

Coaching is being used inconsistently within the surgical education literature. Our hope is that with establishing criteria for coaching, future studies will implement this intervention more consistently and allow for better comparison and generalization of results.

Coaching to enhance qualified surgeons' non-technical skills: a systematic review

INTRODUCTION

The lack of an effective continuing professional development programme for qualified surgeons, specifically one that enhances non-technical skills (NTS), is an issue receiving increased attention. Peer-based coaching, used in multiple professions, is a proposed method to deliver this. The aim of this study was to undertake a systematic review of the literature to summarize the quantity and quality of studies involving surgical coaching of NTS in qualified surgeons.

METHODS

A systematic search of the literature was performed through MEDLINE, EMBASE, Cochrane Collaboration and PsychINFO. Studies were selected based on predefined inclusion and exclusion criteria. Data for the included studies was independently extracted by two reviewers and the quality of the studies evaluated using the Medical Education and Research Study Quality Instrument (MERSQI).

RESULTS

Some 4319 articles were screened from which 19 met the inclusion criteria. Ten studies involved coaching of individual surgeons and nine looked at group coaching of surgeons as part of a team. Group coaching studies used non-surgeons as coaches, included objective assessment of NTS, and were of a higher quality (average MERSQI 13.58). Individual coaching studies focused on learner perception, used experienced surgeons as coaches and were of a lower quality (average MERSQI 11.58). Individual coaching did not show an objective improvement in NTS for qualified surgeons in any study.

CONCLUSION

Surgical coaching of qualified surgeons' NTS in a group setting was found to be effective. Coaching of individual surgeons revealed an overall positive learner perception but did not show an objective improvement in NTS for qualified surgeons.

Preceptoring, proctoring, mentoring, and coaching in surgery

Contemporary models of surgical education that are founded on sound educational theories and constructs need to be used across the continuum of professional development of surgeons starting with the first day of medical school, through surgery residency and fellowship training, to the last day of surgical practice. The highly learner-centered and individually-focused special interventions of preceptoring, proctoring, mentoring, and coaching should be linked to innovative competency-based education models to address the educational needs of learners at all levels, and especially of surgeons in practice to continually improve their knowledge, skills, and performance, with the aspirational goal of achieving expertise and mastery. Each of these interventions is distinct with its own unique characteristics, applications, and anticipated impact, which must be clearly recognized for the interventions to be used most effectively. Broad acceptance and adoption of the aforementioned special interventions require recognition of the value each brings to the learner and the educational program. Professional organizations should play a key role in designing innovative educational programs that include these interventions, supporting their integration into surgical education and surgical practice, and influencing changes in the cultures in surgery to facilitate broad adoption of these interventions.

Association of a Statewide Surgical Coaching Program With Clinical Outcomes and Surgeon Perceptions

OBJECTIVE

To assess risk-adjusted outcomes and participant perceptions following a statewide coaching program for bariatric surgeons.

SUMMARY OF BACKGROUND DATA

Coaching has emerged as a new approach for improving individual surgeon performance, but lacks evidence linking to clinical outcomes.

METHODS

This program took place between October 2015 and February 2018 in the Michigan Bariatric Surgery Collaborative. Surgeons were categorized as coach, participant, or nonparticipant for an interrupted time series analysis. Multilevel logistic regression models included patient characteristics, time trends, and number of sessions. Risk-adjusted overall and surgical complication rates are reported, as are within-group relative risk ratios and 95% confidence intervals. We also compared operative times and report risk differences and 95% confidence intervals. Iterative thematic analysis of semi-structured interviews examined participant and coach perceptions of the program.

RESULTS

The coaching program was viewed favorably by most surgeons and many participants described numerous technical and nontechnical practice changes. The program was not associated with significant change in risk-adjusted complications with relative risks for coaches, participants, and nonparticipants of 0.99 (0.62-1.37), 0.91 (0.64-1.17), and 1.15 (0.83-1.47), respectively. Operative times did improve for participants, but not coaches or nonparticipants, with risk differences of -14.0 (-22.3, -5.7), -1.0 (-4.5, 2.4), and -2.6 (-6.9, 1.7). Future coaching programmatic design should consider dose-complexity matching, hierarchical leveling, and optimizing video review.

CONCLUSIONS

This statewide surgical coaching program was perceived as valuable and surgeons reported numerous practice changes. Operative times improved, but there was no significant improvement in risk-adjusted outcomes.

Training for Minimally Invasive Surgery for IBD: A Current Need

Surgery for inflammatory bowel diseases (IBD) management has passed through an important evolution over the last decades, with innovative strategies and new technologies, especially in minimally invasive surgery (MIS) approaches. MIS procedures for IBD include multiport laparoscopy, single-port surgery, robotics, and the use of transanal platforms. These approaches can be used in the surgical management of both Crohn's disease (CD) and ulcerative colitis (UC). There are significant peculiarities in the surgical field in CD and UC, and their perfect understanding are directly related to better outcomes in IBD patients, as a consequence of improvement in knowledge by IBD surgeons. Different strategies to train colorectal surgeons were developed worldwide, for better application of MIS, usually for malignant or non-IBD benign diseases. There is a significant lack of evidence in specific training strategies for MIS in the IBD field. In this review, the authors outline the importance of adequate surgical training in IBD MIS, by discussing the current evidence on different approaches and emphasizing the need for better training protocols included in multidisciplinary teams in IBD centers throughout the globe.

Optimizing the Implementation of Surgical Coaching Through Feedback From Practicing Surgeons

Importance

Surgical coaching is maturing as a tangible strategy for surgeons' continuing professional development. Resources to spread this innovation are not yet widely available.

Objective

To identify surgeon-derived implementation recommendations for surgical coaching programs from participants' exit interviews and ratings of their coaching interactions.

Design, Setting, and Participants

This qualitative analysis of the Surgical Coaching for Operative Performance Enhancement (SCOPE) program, a quality improvement intervention, was conducted at 4 US academic medical centers. Participants included 46 practicing surgeons. The SCOPE program ran from December 7, 2018, to October 31, 2019. Data were analyzed from November 1, 2019, to January 31, 2020.

Interventions

Surgeons were assigned as either a coach or a coachee, and each coach was paired with 1 coachee by a local champion who knew the surgeons professionally. Coaching pairs underwent training and were instructed to complete 3 coaching sessions-consisting of preoperative goal setting, intraoperative observation, and postoperative debriefing-focused on intraoperative performance.

Main Outcomes and Measures

Themes from the participants' exit interviews covering 3 major domains: (1) describing the experience, (2) coach-coachee relationship, and (3) facilitators and barriers to implementing surgical coaching. Surgeons' responses were stratified by the net promoter score (NPS), a scale ranging from 0 to 10 points, indicating how likely they were to recommend their coaching session to others, with 9 to 10 indicating promoters; 7 to 8, passives; and 0 to 6, detractors.

Results

Among the 46 participants (36 men [78.3%]), 23 were interviewed (50.0%); thematic saturation was reached with 5 coach-coachee pairs (10 interviews). Overall, coaches and coachees agreed on key implementation recommendations for surgical coaching, including how to optimize coach-coachee relationships and facilitate productive coaching sessions. The NPS categories were associated with how participants experienced their own coaching sessions. Specifically, participants who reported excellent first sessions, had a coaching partner in the same clinical specialty, and were transparent about each other's intentions in the program tended to be promoters. Participants who described suboptimal first sessions, less clinical overlap, and unclear goals with their partner were more likely detractors.

Conclusions and Relevance

These exit interviews with practicing surgeons offer critical insights for addressing cultural barriers and practical challenges for successful implementation of peer coaching programs focused on surgical performance improvement. With empirical evidence on optimizing coach-coachee relationships and facilitating participants' experience, organizations can establish effective coaching programs that enable meaningful continuous professional development for surgeons and ultimately enhance patient care.

Implementation and Effectiveness of Coaching for Surgeons in Practice - A Mixed Studies Systematic Review

INTRODUCTION

Despite recent changes to medical education, surgical training remains largely based on the apprenticeship model. However, after completing training, there are few structured learning opportunities available for surgeons in practice to refine their skills or acquire new skills. Personalized observation with feedback is rarely a feature of traditional continuing medical education learning. Coaching has recently been proposed as a modality to meet these educational gaps; however, data are limited, and few coaching programs presently exist. The purpose of this study is to summarize the characteristics of coaching programs for surgeons in practice including participant satisfaction, program outcomes, and barriers to implementation, in the published literature.

METHODS

A mixed studies systematic review was conducted according to PRISMA guidelines to identify all original studies describing or investigating coaching for practicing surgeons up to 06/2019. Quantitative analysis was used to summarize numerical data, and qualitative analysis using grounded theory methodology for descriptive data was used to summarize the results into themes across studies.

RESULTS

After identification of articles, 27 were included in the final synthesis. Twenty-six articles described execution of a coaching program. Programs varied widely with 18/26 focusing on teaching new skills, and the remainder on refinement of skills. Thematic analysis identified 2 major data categories that guided deeper analysis: outcomes of and barriers to coaching. Of the 16 (62%) programs that reported outcomes of coaching, 42% to 100% of participants reported changes in clinical practice directly associated with coaching. Positive satisfaction after completion of a program was reported by 82% to 100% of participants. Reported barriers to participating in a coaching program emerged along 3 main themes: logistical constraints, surgical culture, and perceived lack of need.

CONCLUSIONS

Coaching for surgeons in practice is highly rated by participants and often results in clinical practice changes, while cultural and logistical issues were identified as barriers to implementation. A better understanding of these factors is required to guide coaching program development and implementation.

Surgical coaching to achieve the ABMS vision for the future of continuing board certification

In February 2019, the American Board of Medical Specialties (ABMS) released the final report of the Continuing Board Certification: Vision for the Future initiative, issuing strong recommendations to replace ineffective, traditional mechanisms for physicians' maintenance of certification with meaningful strategies that strengthen professional self-regulation and simultaneously engender public trust. The Vision report charges ABMS Member Boards, including the American Board of Surgery (ABS), to develop and implement a more formative, less summative approach to continuing certification. To realize the ABMS's Vision in surgery, new programs must support the assessment of surgeons' performance in practice, identification of individualized performance gaps, tailored goals to address those gaps, and execution of personalized action plans with accountability and longitudinal support. Peer surgical coaching, especially when paired with video-based assessment, provides a structured approach that can meet this need. Surgical coaching was one of the approaches to continuing professional development that was discussed at an ABS-sponsored retreat in January 2020; this commentary review provides an overview of that discussion. The professional surgical societies, in partnership with the ABS, are uniquely positioned to implement surgical coaching programs to support the continuing certification of their membership. In this article, we provide historical context for board certification in surgery, interpret how the ABMS's Vision applies to surgical performance, and highlight recent developments in video-based assessment and peer surgical coaching. We propose surgical coaching as a foundational strategy for accomplishing the ABMS's Vision for continuing board certification in surgery.

Video review for measuring and improving skill in urological surgery

Interest is growing within the urological surgery community for objective assessments of technical skill. Surgical video review relies on the use of objective assessment tools to evaluate both global and procedure-specific skill. These evaluations provide structured feedback to surgeons with the aim of improving technique, which has been associated with patient outcomes. Currently, skill assessments can be performed by using expert peer-review, crowdsourcing or computer-based methods. Given the relationship between skill and patient outcomes, surgeons might be required in the future to provide empirical evidence of their technical skill for certification, employment, credentialing and quality improvement. Interventions such as coaching and skills workshops incorporating video review might help surgeons improve their skill, with the ultimate goal of improving patient outcomes.

The System for Telementoring with Augmented Reality (STAR): A head-mounted display to improve surgical coaching and confidence in remote areas

BACKGROUND

The surgical workforce particularly in rural regions needs novel approaches to reinforce the skills and confidence of health practitioners. Although conventional telementoring systems have proven beneficial to address this gap, the benefits of platforms of augmented reality-based telementoring in the coaching and confidence of medical personnel are yet to be evaluated.

METHODS

A total of 20 participants were guided by remote expert surgeons to perform leg fasciotomies on cadavers under one of two conditions: (1) telementoring (with our System for Telementoring with Augmented Reality) or (2) independently reviewing the procedure beforehand. Using the Individual Performance Score and the Weighted Individual Performance Score, two on-site, expert surgeons evaluated the participants. Postexperiment metrics included number of errors, procedure completion time, and self-reported confidence scores. A total of six objective measurements were obtained to describe the self-reported confidence scores and the overall quality of the coaching. Additional analyses were performed based on the participants' expertise level.

RESULTS

Participants using the System for Telementoring with Augmented Reality received 10% greater Weighted Individual Performance Score (P = .03) and performed 67% fewer errors (P = .04). Moreover, participants with lower surgical expertise that used the System for Telementoring with Augmented Reality received 17% greater Individual Performance Score (P = .04), 32% greater Weighted Individual Performance Score (P < .01) and performed 92% fewer errors (P < .001). In addition, participants using the System for Telementoring with Augmented Reality reported 25% more confidence in all evaluated aspects (P < .03). On average, participants using the System for Telementoring with Augmented Reality received augmented reality guidance 19 times on average and received guidance for 47% of their total task completion time.

CONCLUSION

Participants using the System for Telementoring with Augmented Reality performed leg fasciotomies with fewer errors and received better performance scores. In addition, participants using the System for Telementoring with Augmented Reality reported being more confident when performing fasciotomies under telementoring. Augmented Reality Head-Mounted Display-based telementoring successfully provided confidence and coaching to medical personnel.

Video recording in ophthalmic surgery

Video recording in ophthalmic surgery has immense potential to drive quality improvement in patient care, ophthalmology training, and research. Not only do surgical videos permit introspective and critical analyses of surgical technique, they also allow for objective assessment, allow for more informative audits, and are an invaluable medium for surgical education. Unfortunately, medical-grade video recording equipment is often costly. Various novel methods of video recording that utilize commercially available products offer adequate alternatives. Certain ethical and legal issues also need to be considered before the commencement of video recording in the operating room to protect both the patient and surgeon. We review the current applications and methods of video recording in ophthalmic surgery described in the literature, as well as the potential ethical and legal issues surrounding video recording.

Do Not Blame the Resident: the Impact of Surgeon and Surgical Trainee Experience on the Occurrence of Intraoperative Adverse Events (iAEs) in Abdominal Surgery

OBJECTIVE

Intraoperative adverse events (iAEs) are defined as inadvertent injuries that occur during an operation and are associated with increased mortality, morbidity, and health care costs. We sought to study the impact of attending surgeon experience as well as resident training level on the occurrence of iAEs.

DESIGN

The institutional American College of Surgeons-National Surgical Quality Improvement Program and administrative databases for abdominal surgeries were linked and screened for iAEs using the International Classification of Diseases, Ninth Revision, Clinical Modification-based Patient Safety Indicator "accidental puncture/laceration." Each flagged record was systematically reviewed to confirm iAE occurrence and determine the number of years of independent practice of the attending surgeon and the postgraduate year (PGY) of the assisting resident at the time of the operation. The attending surgeon experience was divided into quartiles (<6 years, 6-13 years, 13-20 years, >20 years). The resident experience level was defined as Junior (PGY-1 to PGY-3) or Senior (PGY-4 or PGY-5). Univariate/bivariate then multivariable logistic regression analyses adjusting for patient demographics, comorbidities, and operation type and/or complexity (using RVUs as a proxy) were performed to assess the independent impact of resident and attending surgeon experience on the occurrence of iAEs.

SETTING

A large tertiary care teaching hospital.

PARTICIPANTS

Patients included in the 2007-2012 ACS-NSQIP that had an abdominal surgery performed by both an attending surgeon and a resident.

RESULTS

A total of 7685 operations were included and iAEs were detected in 159 of them (2.1%). Junior residents participated in 1680 cases (21.9%), while senior residents were involved in 6005 (78.1%). The iAE rates for attending surgeons with <6, 6-13, 13-20, and >20 years of experience were 2.7%, 1.7%, 2.4%, and 1.4%, respectively. In multivariable analyses, the risk of occurrence of an iAE was significantly decreased for surgeons with >20 years of experience compared to those with <6 years of experience (odds ratio=0.52, 95% confidence interval 0.32-0.86, p = 0.011). On bivariate analyses, iAEs occurred in 1.2% of junior resident cases, while senior residents had an iAE rate of 2.3%. However, after risk adjustment on multivariable analyses, the resident experience level did not significantly impact the rate of iAEs.

CONCLUSIONS

The surgeon's level of experience, but not the resident's, is associated with the occurrence of iAEs in abdominal surgery. Efforts to improve patient safety in surgery should explore the value of pairing junior surgeons with the more experienced ones thru formalized coaching programs, rather than focus on curbing resident operative autonomy.

Coaching Experts: Applications to Surgeons and Continuing Professional Development

Surgery is a science and an art, which is mastered through years of training and refined by the accumulation of individual experience and preference. Continuing professional development (CPD) is a concept that emphasizes a self-directed approach to education. Coaching is a process that leads to increased utilization of a person's current skills and resources without counselling or advising. Coaching in surgery could be used to facilitate and optimize feedback and reflection, thus enhancing performance and outcomes through elite performance of an operative procedure. Therefore, it can be applied under the umbrella of CPD. Ultimately also emphasizing that better quality surgery is not necessarily purely based on technical outcomes, it is a combination of both technical and nontechnical practice. Coaching of surgeons is a conceptually formidable tool in the successful implementation of effective CPD programs. CPD currently provides an opportunity for surgeons to gain access to constantly evolving medical knowledge and technique; however, there is no accountability to its understanding or implementation. Coaches have the potential to provide confidential appraisal and feedback in a constructive approach with the aim to eliminate any barriers to the transfer of technique and knowledge.

Port Placement for Laparoscopic Colonic Resections - Video Vignette

Laparoscopic colonic resections often require manipulation and surgical action in all abdominal quadrants. Port placement, a fundamental part of a successful procedure, often varies widely among surgeons and is currently dictated by individual experience and preference. This variability may be suboptimal for the operation at hand, can be confusing for trainees and many times provide inadequate working posture for the surgeons, resulting in discomfort due to muscular fatigue in the hands, arms, shoulders and cervical spine. This article is protected by copyright. All rights reserved.