Dissecting Attending Surgeons' Operating Room Guidance: Factors That Affect Guidance Decision Making

Behind the pattern: General surgery residsent autonomy in robotic surgery

Objective

Robotic surgery is increasingly utilized and common in general surgery training programs. This study sought to better understand the factors that influence resident operative autonomy in robotic surgery. We hypothesized that resident seniority, surgeon work experience, surgeon robotic-assisted surgery (RAS) case volume, and procedure type influence general surgery residents' opportunities for autonomy in RAS as measured by percentage of resident individual console time (ICT).

Methods

General surgery resident ICT data for robotic cholecystectomy (RC), inguinal hernia (RIH), and ventral hernia (RVH) operations performed on the dual-console Da Vinci surgical robotic system between July 2019 and June 2021 were extracted. Cases with postgraduate year (PGY) 2-5 residents participating as a console surgeon were included. A sequential explanatory mixed-methods approach was undertaken to explore the ICT results and we conducted secondary qualitative interviews with surgeons. Descriptive statistics and thematic analysis were applied.

Results

Resident ICT data from 420 robotic cases (IH 200, RC 121, and VH 99) performed by 20 junior residents (PGY2-3), 18 senior residents (PGY4-5), and 9 attending surgeons were extracted. The average ICT per case was 26.8 % for junior residents and 42.4 % for senior residents. Compared to early-career surgeons, surgeons with over 10 years' work experience gave less ICT to junior (18.2 % vs. 32.0 %) and senior residents (33.9 % vs. 56.6 %) respectively. Surgeons' RAS case volume had no correlation with resident ICT (r = 0.003, p = 0.0003). On average, residents had the most ICT in RC (45.8 %), followed by RIH (36.7 %) and RVH (28.6 %). Interviews with surgeons revealed two potential reasons for these resident ICT patterns: 1) Surgeon assessment of resident training year/experience influenced decisions to grant ICT; 2) Surgeons' perceived operative time pressure inversely affected resident ICT.

Conclusions

This study suggests resident ICT/autonomy in RC, RIH, and RVH are influenced by resident seniority level, surgeon work experience, and procedure type, but not related to surgeon RAS case volume. Design and implementation of an effective robotic training program must consider the external pressures at conflict with increased resident operative autonomy and seek to mitigate them.

Procedure-specific simulation for vaginal surgery training: A randomized controlled trial

INTRODUCTION

Vaginal surgery has a superior outcome profile compared with other surgical routes, yet skills are declining because of low case volumes. Graduating residents' confidence and preparedness for vaginal surgery has plummeted in the past decade. The objective of the present study was to investigate whether procedure-specific simulation skills, vs usual training, result in improved operative competence.

MATERIAL AND METHODS

We completed a randomized controlled trial of didactic and procedural training via low fidelity vaginal surgery models for anterior repair, posterior repair (PR), vaginal hysterectomy (VH), recruiting novice gynecology residents at three academic centers. We evaluated performance via global rating scale (GRS) in the real operating room and for corresponding procedures by attending surgeon blinded to group. Prespecified secondary outcomes included procedural steps knowledge, overall performance, satisfaction, self-confidence and intraoperative parameters. A priori sample size estimated 50 residents (20% absolute difference in GRS score, 25% SD, 80% power, alpha 0.05).

CLINICALTRIALS

gov: Registration no. NCT05887570.

RESULTS

We randomized 83 residents to intervention or control and 55 completed the trial (2011-23). Baseline characteristics were similar, except for more fourth-year control residents. After adjustment of confounders (age, level, baseline knowledge), GRS scores showed significant differences overall (mean difference 8.2; 95% confidence interval [CI]: 0.2-16.1; p = 0.044) and for VH (mean difference 12.0; 95% CI: 1.8-22.3; p = 0.02). The intervention group had significantly higher procedural steps knowledge and self-confidence for VH and/or PR (p < 0.05, adjusted analysis). Estimated blood loss, operative time and complications were similar between groups.

CONCLUSIONS

Compared to usual training, procedure-specific didactic and low fidelity simulation modules for vaginal surgery resulted in significant improvements in operative performance and several other skill parameters.

Perceptions and Guiding Strategies to Regulate Entrusted Autonomy of Residents in the Operating Room: A Systematic Literature Review

OBJECTIVE

To provide a systematic literature review of intraoperative entrusted autonomy for surgical residents. Specifically, perceptions from residents and supervising surgeons, supervising behavior and influencing factors on intraoperative teaching and learning are analyzed.

BACKGROUND

Increasing demands on surgical training and the need for effective development of technical skills, amplify the importance of making the most of intraoperative teaching and learning opportunities in the operating room. It is critical for residents to gain the greatest benefit from every surgical case and to achieve operative competence.

METHODS

A systematic literature search identified 921 articles from 2000 to 2022 that addressed surgical education/training, intraoperative supervision/teaching, autonomy and entrustment. 40 studies with heterogeneous designs and methodologies were included.

RESULTS

Four themes were established in the analysis: patient safety, learner, learning environment and supervising surgeon. The patient is identified as the primary responsibility during intraoperative teaching and learning. Supervisors continuously guard patient safety as well as the resident's learning process. Ideal intraoperative learning occurs when the resident has optimal entrusted autonomy during the procedure matching with the current surgical skills level. A safe learning environment with dedicated time for learning are prerequisites for both supervising surgeons and residents. Supervising surgeons' own preferences and confidence levels also play an important role.

CONCLUSIONS

This systematic literature review identifies patient safety as the overriding principle for supervising surgeons when regulating residents' entrusted autonomy. When the supervisor's responsibility toward the patient has been met, there is room for intraoperative teaching and learning. In this process the learner, the learning environment and the supervising surgeon's own preferences all intertwine, creating a triangular responsibility. This review outlines the challenge of establishing an equilibrium in this triangle and the broad arsenal of strategies supervising surgeons use to keep it in balance.

Cumulative Sum Chart as Complement to Objective Assessment of Graduating Surgical Resident Competency: An Exploratory Study

BACKGROUND

Rater-based assessment and objective assessment play an important role in evaluating residents' clinical competencies. We hypothesize that a cumulative sum (CUSUM) chart of operative time is a complement to the assessment of chief general surgery residents' competencies with ACGME Milestones, aiding residency programs' determination of graduating residents' practice readiness.

STUDY DESIGN

We extracted ACGME Milestone evaluations of performance of operations and procedures (POP) and 3 objective metrics (operative time, case type, and case complexity) from 3 procedures (cholecystectomy, colectomy, and inguinal hernia) performed by 3 cohorts of residents (N = 15) during their PGY4-5. CUSUM charts were computed for each resident on each procedure type. A learning plateau was defined as at least 4 cases consistently locating around the centerline (target performance) at the end of a CUSUM chart with minimal deviations (range 0 to 1).

RESULTS

All residents reached the ACGME graduation targets for the overall POP by the end of chief year. A total of 2,446 cases were included (cholecystectomy N = 1234, colectomy N = 507, and inguinal hernia N = 705), and 3 CUSUM chart patterns emerged: skewed distribution, bimodal distribution, and peaks and valleys distribution. Analysis of CUSUM charts revealed surgery residents' development processes in the operating room towards a learning plateau vary, and only 46.7% residents reach a learning plateau in all 3 procedures upon graduation.

CONCLUSIONS

CUSUM charts of operative time complement the ACGME Milestones evaluations. The use of both may enable residency programs to holistically determine graduating residents' practice readiness and provide recommendations for their upcoming career/practice transition.

Surgical Resident Perspectives on the Preferred Qualities of Effective Intraoperative Teachers: A Qualitative Analysis

PURPOSE

Intraoperative teaching is a critical component of surgery residents' education. Although prior studies have investigated best practices from the viewpoint of the expert educator, the perspective of the learner has been less explored. This study examined the ideal faculty teaching behaviors that optimize intraoperative teaching from the surgical residents' perspective.

METHOD

Using a grounded theory method, this study explored perspectives on intraoperative faculty teaching qualities of 5 focus groups of categorical clinical general surgical residents of the same postgraduate year from June to August 2021. Focus group discussions were recorded, transcribed, and coded. Emerging themes were identified, along with their corresponding subthemes.

RESULTS

Thirty-nine general surgery residents participated in the focus groups. Overall, 6 themes emerged regarding resident priorities of intraoperative teaching, with 10 subthemes. Themes included the following: (1) character, with subthemes of caring, respect for resident, and self-control; (2) intraoperative skill, with subthemes of clinical and operative skill and modeling leadership in the operating room; (3) instructional approach; (4) feedback, with subthemes of content of feedback and debriefing; (5) discernment of resident needs, with subthemes of managing expectations, individualizing instruction, and autonomy; and (6) variety of teachers.

CONCLUSIONS

Certain tangible strategies, such as demonstrating genuine care for the learner, using clear directional words, and giving actionable feedback, were considered vital by residents. In the development of great surgical educators, the emphasis should not be on conformity to a single idealized teaching style but should celebrate and encourage diversity of personas and teaching styles within a department or program.

The Supervisor's Toolkit: Strategies of Supervisors to Entrust and Regulate Autonomy of Residents in the Operating Room

OBJECTIVE

To identify what strategies supervisors use to entrust autonomy during surgical procedures and to clarify the consequences of each strategy for a resident's level of autonomy.

BACKGROUND

Entrusting autonomy is at the core of teaching and learning surgical procedures. The better the level of autonomy matches the learning needs of residents, the steeper their learning curves. However, entrusting too much autonomy endangers patient outcome, while entrusting too little autonomy results in expertise gaps at the end of training. Understanding how supervisors regulate autonomy during surgical procedures is essential to improve intraoperative learning without compromising patient outcome.

METHODS

In an observational study, all the verbal and nonverbal interactions of 6 different supervisors and residents were captured by cameras. Using the iterative inductive process of conversational analysis, each supervisor initiative to guide the resident was identified, categorized, and analyzed to determine how supervisors affect autonomy of residents.

RESULTS

In the end, all the 475 behaviors of supervisors to regulate autonomy in this study could be classified into 4 categories and nine strategies: I) Evaluate the progress of the procedure: inspection (1), request for information (2), and expressing their expert opinion (3); II) Influence decision-making: explore (4), suggest (5), or declare the next decision (6); III) Influence the manual ongoing action: adjust (7), or stop the resident's manual activity (8); IV) take over (9).

CONCLUSIONS

This study provides new insights into how supervisors regulate autonomy in the operating room. This insight is useful toward analyzing whether supervisors meet learning needs of residents as effectively as possible.

Fingerprints of Teaching Interactions: Capturing and Quantifying How Supervisor Regulate Autonomy of Residents in the Operating Room

OBJECTIVE

Supervisors and residents agree that entrusted autonomy is central to learning in the Operating Room (OR), but supervisors and residents hold different opinions about entrustment: residents regularly experience that they receive insufficient autonomy while supervisors feel their guiding is not appreciated as teaching. These opinions are commonly grounded on general experiences and perceptions, instead of real-time supervisors' regulatory behaviors as procedures unfold. To close that gap, we captured and analyzed when and to what level supervisors award or restrain autonomy during procedures. Furthermore, we constructed fingerprints, an instrument to visualize entrustment of autonomy by supervisors in the OR that allows us to reflect on regulation of autonomy and discuss teaching interactions.

DESIGN

All interactions between supervisors and residents were captured by video and transcribed. Subsequently a multistage analysis was performed: (1) the procedure was broken down into 10 steps, (2) for each step, type and frequency of strategies by supervisors to regulate autonomy were scored, (3) the scores for each step were plotted into fingerprints, and (4) fingerprints were analyzed and compared.

SETTING

University Medical Centre Groningen (the Netherlands).

PARTICIPANTS

Six different supervisor-resident dyads.

RESULTS

No fingerprint was alike: timing, frequency, and type of strategy that supervisors used to regulate autonomy varied within and between procedures. Comparing fingerprints revealed that supervisors B and D displayed more overall control over their program-year 5 residents than supervisors C and E over their program-year 4 residents. Furthermore, each supervisor restrained autonomy during steps 4 to 6 but with different intensities.

CONCLUSIONS

Fingerprints show a high definition view on the unique dynamics of real-time autonomy regulation in the OR. One fingerprint functions as a snapshot and serves a purpose in one-off teaching and learning. Multiple snapshots of one resident quantify autonomy development over time, while multiple snapshots of supervisors may capture best teaching practices to feed train-the-trainer programs.

Bronchoscopy Teaching Without a Gold Standard: Attending Pulmonologists' Assessment of Learners, Supervisory Styles, and Variation in Practice

BACKGROUND

Despite the growing role of simulation in procedural teaching, bronchoscopy training largely is experiential and occurs during patient care. The Accreditation Council for Graduate Medical Education sets a target of 100 bronchoscopies to be performed during pulmonary fellowship. Attending physicians must balance fellow autonomy with patient safety during these clinical teaching experiences. Few data on best practices for bronchoscopy teaching exist, and a better understanding of how bronchoscopy currently is supervised could allow for improvement in bronchoscopy teaching.

RESEARCH QUESTION

How do attending bronchoscopists supervise bronchoscopy, and in particular, how do attendings balance fellow autonomy with patient safety?

STUDY DESIGN AND METHODS

This was a focused ethnography conducted at a single center using audio recording of dialog between attendings and fellows during bronchoscopies, supplemented by observation of nonverbal teaching. Interviews with attending bronchoscopists and limited interviews of fellows also were recorded. Interviews were transcribed verbatim before analysis. We used constant comparative analysis to analyze data and qualitative research software to support data organization and thematic analysis. Education researchers from outside of pulmonary critical care joined the team to minimize bias.

RESULTS

We observed seven attending bronchoscopists supervising eight bronchoscopies. We noted distinct teaching behaviors, classified into themes, which then were grouped into four supervisory styles of modelling, coaching, scaffolding, and fading. Observation and interviews illuminated that assessing fellow skill was one tool used to choose a style, and attendings moved between styles. Attendings accepted some, but not all, variation in both performing and supervising bronchoscopy.

INTERPRETATION

Attending pulmonologists used a range of teaching microskills as they moved between different supervisory styles and selectively accepted variation in practice. These distinct approaches may create well-rounded bronchoscopists by the end of fellowship training and should be studied further.

Difference in Resident Versus Attending Perspective of Competency and Autonomy During Arthroscopic Rotator Cuff Repairs

A noted deficiency in orthopaedic resident education is a lack of intraoperative autonomy; however, no studies exist evaluating this issue. The purpose of this study was to determine whether there is a difference between resident and attending perception of resident competency and autonomy during arthroscopic rotator cuff repairs and whether increased perceived competency leads to more autonomy.

A Grounded Theory of Intraoperative Team Members' Decision Making Regarding Surgical Attire Guideline Adherence

Surgical attire guidelines (SAGs) assist perioperative nurses with minimizing the risk of patients developing surgical site infections. However, some intraoperative team members fail to fully adhere to SAGs, which may put patients at risk. Because there is a lack of published literature on the reasons for intraoperative team members' SAG nonadherence, I undertook a grounded theory study to explore the decision making of intraoperative team members related to the AORN SAG. The resulting model identifies the factors that affect decision making regarding SAG adherence, including personal identity needs, adherence anchoring activities, SAG awareness, direction from authority figures and organizations, guideline evidence strength, and resource availability. After weighing the influence of each factor, team members decide to what extent they will adhere to the SAG. The theory also provides guidance for enhancing adherence decisions.

Operative Self-Confidence, Hesitation, and Ability Assessment of Surgical Trainees in Rural Kenya

BACKGROUND

The education of surgical trainees is ideally designed to produce surgeons with both confidence and competence. This involves the development of autonomy in the operating room. Factors associated with autonomy and entrustment have been studied in high-resource settings. In a resource-limited context, where autonomy is solely at the discretion of faculty, and there are fewer external constraints to restrict it, we hypothesized that assessment of a trainee's performance would be dependent upon reported confidence levels of both faculty and trainees in those trainees' abilities.

MATERIALS AND METHODS

At a teaching hospital in rural Kenya, operative experience surveys were administered to eleven general surgery trainees (PGY1-5) and six faculty paired dyads immediately following operative procedures in May 2016 to elicit self-reported assessments of confidence, hesitation, and ability as measured by the Zwisch Scale. We examined factors related to learning and used dyadic structural equation models to understand factors related to the assessment of ability.

RESULTS

There were 107 paired surveys among 136 trainees and 130 faculty evaluations. Faculty scrubbed into 76 (72%) cases. In comparison to trainees, faculty were more likely to give a higher average score for confidence (4.08 versus 3.90; P value: 0.005), a lower score for hesitation (2.67 versus 2.84; P value: 0.001), and a lower score for the ability to perform the operation independently (2.73 versus 3.02; P value: 0.01). Faculty and trainee perceptions of hesitation influenced their ability scores. Trainee hesitation (OR 12.1; 1.2-127.6, P = 0.04) predicted whether trainees reported experiencing learning.

CONCLUSIONS

Between trainees and faculty at a teaching program in rural Kenya, assessment scores of confidence, hesitation, and ability differ in value but remain fairly correlated. Hesitation is predictive of ability assessment, as well as self-reported learning opportunities. Focus upon identifying when trainees hesitate to proceed with a case may yield important educational opportunities.

Development of a peer review of operative teaching process and assessment tool

BACKGROUND

While teaching evaluation systems are common in academia, very little information is available regarding formal coaching and peer review of teaching performance in surgery. This article is a report on the development and implementation of a peer review of operative teaching program.

METHODS

Our process was designed using a multistep sequential model which included developing a peer review of teaching instrument that was piloted to study the efficacy and utility of the tool.

RESULTS

Thirty-nine peer reviews of teaching were conducted. Among the most frequent challenges that faculty identified were allowing residents to struggle/give autonomy, judging when to take over the case, communicating effectively, being patient, balancing education and patient safety, and giving feedback.

CONCLUSIONS

Our peer review of teaching program is systematic, feasible, and can be adopted by other surgery departments. Faculty's identified strengths and challenges have been incorporated into our faculty development curricula.

Effect modification of resident autonomy and seniority on perioperative outcomes in laparoscopic cholecystectomy

BACKGROUND

Resident operative involvement is an integral aspect of general surgery residency training. However, current data examining the effect of resident autonomy on perioperative outcomes remain limited.

METHODS

Patient and operator-specific data were collected from 344 adult laparoscopic cholecystectomies at a tertiary academic institution and its regional affiliates between 2018 and 2019. Multivariate modeling compared postoperative outcomes between cases completed with or without resident involvement and its effect modification by resident seniority and autonomy per Zwisch scale. Outcomes include 30-day postoperative complications, hospital readmission rate, and operative time.

RESULTS

Multivariate analysis revealed resident involvement in laparoscopic cholecystectomy did not significantly change odds of 30-day postoperative complications (OR 2.52, p = 0.185, 95% CI 0.64-9.92) or hospital readmission (OR 1.61, p = 0.538, 95% CI 0.36-7.23). Operative time is significantly increased compared to faculty-only cases (IRR 1.37, p < 0.001, 95% CI 1.26-1.48). While accounting for case difficulty and resident performance evaluated by SIMPL criteria, stratification by resident autonomy measured by Zwisch scale or seniority reveal no effect modification on 30-day postoperative complications, readmissions, or operative time. The effect of resident involvement on longer relative rates of operative time loses its significance in supervision-only cases (IRR 1.18, p = 0.069, 95% CI 0.99-1.41).

CONCLUSION

While resident involvement and autonomy are associated with significantly longer operative times in laparoscopic cholecystectomy, their lack of significant effect on postoperative outcomes argues strongly for continued resident involvement and supervised operative independence.

Improving the Intraoperative Educational Experience: Understanding the Role of Confidence in the Resident-Attending Relationship

OBJECTIVE

With recent changes to graduate medical education, the balance between resident autonomy and need for supervision impacts the educational and training experience of residents. The objective of this study was to understand the relationship between the confidence of attendings and residents and their different perspectives of perceived educational experience and autonomy in the operating room (OR). We hypothesized that the attending's confidence in the resident would be an important factor in improving the educational experience and resident's autonomy in the OR.

DESIGN

Self-reported confidence-rating and operative experience surveys were administered to teams of post-graduate year (PGY 1) through PGY 5 surgical residents and attendings in two temporal sets (Early: Sept-Dec 2015, n = 20; Late: Jan-Apr 2016, n = 22). A second "end-of-year" survey was distributed to residents (n = 9, 37.5% response) and attendings (n = 10, 35% response) asking questions regarding their educational experience and operative experience during the past year.

SETTING

Large rural teaching hospital.

PARTICIPANTS

Nineteen general surgery residents (PGY 1 - 5) and 14 general surgery attendings.

RESULTS

Resident perception of confidence differs from junior to senior residents, and that there was discordance between resident's confidence and skill as perceived by attendings, particularly in senior residents. Results also showed that attending's confidence in residents was positively correlated with attending's perceived educational experience in the OR. Residents and attendings both indicated attending's confidence in residents as an important factor in increasing resident autonomy in the OR, thus the attending's confidence in residents could have a positive impact on resident autonomy and educational experience in the OR.

CONCLUSIONS

We have demonstrated a relationship between self-confidence for residents and improved confidence from attendings in residents' capabilities. Based on these findings, we would propose identifying methods to expand resident's awareness of surgical situations and develop attending's confidence in residents.

Resident Autonomy in the Operating Room: How Faculty Assess Real-time Entrustability

OBJECTIVE

This study aimed to identify the empirical processes and evidence that expert surgical teachers use to determine whether to take over certain steps or entrust the resident with autonomy to proceed during an operation.

BACKGROUND

Assessing real-time entrustability is inherent in attending surgeons' determinations of residents' intraoperative autonomy in the operating room. To promote residents' autonomy, it is necessary to understand how attending surgeons evaluate residents' performance and support opportunities for independent practice based on the assessment of their entrustability.

METHODS

We conducted qualitative semi-structured interviews with 43 expert surgical teachers from 21 institutions across 4 regions of the United States, using purposeful and snowball sampling. Participants represented a range of program types, program size, and clinical expertise. We applied the Framework Method of content analysis to iteratively analyze interview transcripts and identify emergent themes.

RESULTS

We identified a 3-phase process used by most expert surgical teachers in determining whether to take over intraoperatively or entrust the resident to proceed, including 1) monitoring performance and "red flags," 2) assessing entrustability, and 3) granting autonomy. Factors associated with individual surgeons (eg, level of comfort, experience, leadership role) and the context (eg, patient safety, case, and time) influenced expert surgical teachers' determinations of entrustability and residents' final autonomy.

CONCLUSION

Expert surgical teachers' 3-phase process of decisions on take-over provides a potential framework that may help surgeons identify appropriate opportunities to develop residents' progressive autonomy by engaging the resident in the determination of entrustability before deciding to take over.

Assessing Residents' Readiness for OR Autonomy: A Qualitative Descriptive Study of Expert Surgical Teachers' Best Practices

PURPOSE

Providing resident autonomy in the operating room (OR) is one of the major challenges for surgical educators today. The purpose of this study was to explore what approaches expert surgical teachers use to assess residents' readiness for autonomy in the OR. We particularly focused on the assessments that experts make prior to conducting the surgical time-out.

METHODS

We conducted semistructured in-depth interviews with expert surgical teachers from March 2016 to September 2016. Purposeful sampling and snowball sampling were applied to identify and recruit expert surgical teachers from general surgery residency programs across the United States to represent a range of clinical subspecialties. All interviews were audio-recorded, deidentified, and transcribed. We applied the Framework Method of content analysis, discussed and reached final consensus on the themes.

RESULTS

We interviewed 15 expert teachers from 9 institutions. The majority (13/15) were Program or Associate Program Directors; 47% (7/15) primarily performed complex surgical operations (e.g., endocrine surgery). Five themes regarding how expert surgical teachers determine residents' readiness for OR autonomy before the surgical time-out emerged. These included 3 domains of evidence elicited about the resident (resident characteristics, medical knowledge, and beyond the current OR case), 1 variable relating to attending characteristics, and 1 variable composed of contextual factors. Experts obtained one or more examples of evidence, and adjusted residents' initial autonomy using factors from the attending variable and the context variable.

CONCLUSIONS

Expert surgical teachers' assessments of residents' readiness for OR autonomy included 5 key components. Better understanding these inputs can contribute to both faculty and resident development, enabling increased resident autonomy and preparation for independent practice.

Teaching, Learning, and Performance in the Surgical Workplace: Insights From the Examination of Intraoperative Interactions

This Conversations Starter article presents a selected research abstract from the 2017 Association of American Medical Colleges Central Region Group on Educational Affairs annual spring meeting. The abstract is paired with the integrative commentary of three experts who shared their thoughts stimulated by the study. These thoughts explore the value of examining intraoperative interactions among attending surgeons and residents for enhancing instructional scaffolding; entrustment decision making; and distinguishing teaching, learning, and performance in the workplace.