How Supervisor Experience Influences Trust, Supervision, and Trainee Learning: A Qualitative Study

Effects of (de)motivating supervision styles on junior doctors' intrinsic motivation through basic psychological need frustration and satisfaction: an experimental vignette study

In clinical practice, junior doctors regularly receive supervision from consultants. Drawing on Basic Psychological Needs Theory, consultants' supervision styles are likely to affect junior doctors' intrinsic motivation differently in terms of psychological need frustration and psychological need satisfaction. To examine the effects of (de)motivating supervision styles, we conducted two experimental vignette studies among junior doctors. In Study 1 (N = 150, 73.3% female), we used a 2 (need support: high vs. low) x 2 (directiveness: high vs. low) between-subjects design and, in Study 2, a within-subjects design with the same factors (N = 46, 71.7% female). Both studies revealed a consistent positive effect of need-supportive supervision styles on psychological need satisfaction (+), need frustration (-), and intrinsic motivation (+). Particularly in Study 2, the main effect of need-supportive styles was strengthened by supervisor's directiveness. Moreover, in both studies, the effects of supervision styles on intrinsic motivation were explained through psychological need frustration and psychological need satisfaction. We discuss the implications of these findings for postgraduate clinical training.

Emotions and feelings in neuroscience education across career stages: a qualitative study with views from alumni, junior and senior academics

INTRODUCTION

Emotions and feelings are crucial components of our lives. However, their role in medical education scholarship, including in neuroscience education, has been overlooked. Moreover, their impact has been understudied in academia, especially across career stages. We explored emotions and feelings in the context of neuroscience education and across different career stages.

METHODS

This work is based on a project exploring the value of learning in postgraduate education, drawing on data from nineteen semi-structured interviews with university alumni and academics. Eight alumni (six females and two males) and eleven academics from a UK-based STEM-intensive institution participated in the study. Alumni refers to former students who have completed the MSc in neuroscience at a STEM-intense institution within the last six years. Lecturers and Senior Lecturers in neuroscience have been labelled as junior academics, whereas Readers and Professors have been labelled senior academics.

RESULTS

The alumni recognised their master experience was intense and challenging, yet acknowledged that enjoyment and stress are two faces of the same coin. Many cited their peers as an inspiration to go beyond the limits but only one student mentioned gratitude, which was never mentioned by the academics. At least one alumnus and one junior academic mentioned trust and confidence, but not the senior academics. Anxiety and confidence (and lack of) dominated the interviews with junior academics, who used intense words when discussing the pleasures of science. Conversely, the senior academics dedicated few words to emotions and feelings, never talked about anxiety, trust or gratitude, and very briefly mentioned the reward linked to sharing their knowledge with the next generations.

DISCUSSION

This work epitomises the importance of exploring emotions and feelings in neuroscience education. Talking more openly about emotions and reducing the pervasive narration of 'success stories' might be directions to follow, along with stressing the importance of cultivating self-efficacy, trust and gratitude since the early stages. Meetings between students and supervisors can play a key role in developing self-trust among the students. More focus should be placed on supporting the transition process between postgraduate studies and the subsequent steps of the academic ladder.

Trainee Autonomy and Supervision in the Inpatient Clinical Learning Environment

BACKGROUND

Balancing autonomy and supervision during medical residency is important for trainee development while ensuring patient safety. In the increasingly complex inpatient clinical learning environment, tension exists when this balance is skewed. In this study, we aimed to understand current and ideal states of autonomy and supervision and then describe factors that contribute to imbalance from both trainee and attending perspectives.

METHODS

A sequential mixed-methods design included surveys and focus groups of trainees and attendings at three institutionally affiliated hospitals between May 2019 and June 2020. Survey responses were compared using t-tests, chi-square tests or Fisher's exact tests. Open-ended survey and focus group data were analysed using thematic analysis.

FINDINGS

Survey response rate was 42% (76/182) for trainees and 49% (101/208) for attendings. Fourteen trainees and 32 attendings participated in 14 focus groups. Trainees perceived current culture to be significantly more autonomous than attendings; both groups described 'ideal' culture as more autonomous than current state. Focus group analysis revealed five core contributors to the balance of autonomy and supervision: attending, trainee, patient, interpersonal and institutional. These factors were found to be complex and interactive and require frequent adjustment to avoid tension.

CONCLUSIONS

Trainees and attendings agree that resident autonomy should be prioritized more than it currently is. Attendings, trainees and patients contribute to a complex dynamic between autonomy and supervision, further impacted by both interpersonal and institutional factors, in the inpatient clinical learning environment. Capturing complex interactions between individual factors that impact this dynamic is critical to understanding and optimization by both trainees and attending.

Cognitive biases in osteopathic diagnosis: a mixed study among French osteopaths

OBJECTIVES

Although cognitive biases are one of the most frequent causes of diagnostic errors, their influence remains underestimated in allied health professions, especially in osteopathy. Yet, a part of osteopathic clinical reasoning and diagnosis rely on the practitioner's intuition and subjective haptic perceptions. The aim of this study is to highlight links between the cognitive biases perceived by the practitioner to understand cognitive patterns during osteopathic diagnosis, and to suggest debiasing strategies.

METHODS

A mixed method based on an explanatory sequential type is used. (QUAN→QUAL). A quantitative cross-sectional survey of 272 French osteopaths and three focus groups including 24 osteopaths were carried out. The quantitative analysis includes multinominal logistic regression models and multiple correspondence analysis. The qualitative analysis is based on the framework method (within thematic analysis) and followed a step-by-step guide (Gale et al.).

RESULTS

Among 19 selected biases, osteopaths feel to be affected by 9.4 ± 0.28 biases (range [1-19], median=9). Some presumed biases would be associated, and socio-demographic (gender, age) and professional (experience and types of practice) factors would modify how practitioners perceive the presence of biases. Main debiasing solutions are supervision and transcultural clinical competences.

CONCLUSIONS

Osteopaths believe their diagnosis is impaired by the presence of cognitive biases as observed in clinical reality. Some biases are shared with medical doctors, but others are more specific to osteopaths, such as confirmation bias. To reduce their effect, the practitioner needs to be aware of these cognitive patterns of clinical reasoning, understand the patient and himself better, and use objective tests.

Faculty Decision Making in Ad Hoc Entrustment of Pediatric Critical Care Fellows: A National Case-Based Survey

Phenomenon: Ad hoc entrustment decisions reflect a clinical supervisor's estimation of the amount of supervision a trainee needs to successfully complete a task in the moment. These decisions have important consequences for patient safety, trainee learning, and preparation for independent practice. Determinants of these decisions have previously been described but have not been well described for acute care contexts such as critical care and emergency medicine. The ad hoc entrustment of trainees caring for vulnerable patient populations is a high-stakes decision that may differ from other contexts. Critically ill patients and children are vulnerable patient populations, making the ad hoc entrustment of a pediatric critical care medicine (PCCM) fellow a particularly high-stakes decision. This study sought to characterize how ad hoc entrustment decisions are made for PCCM fellows through faculty ratings of vignettes. The authors investigated how acuity, relationship, training level, and task interact to influence ad hoc entrustment decisions. Approach: A survey containing 16 vignettes that varied by four traits (acuity, relationship, training level, and task) was distributed to U.S. faculty of pediatric critical care fellowships in 2020. Respondents determined an entrustment level for each case and provided demographic data. Entrustment ratings were dichotomized by "high entrustment" versus "low entrustment" (direct supervision or observation only). The authors used logistic regression to evaluate the individual and interactive effects of the four traits on dichotomized entrustment ratings. Findings: One hundred seventy-eight respondents from 30 institutions completed the survey (44% institutional response rate). Acuity, relationship, and task all significantly influenced the entrustment level selected but did not interact. Faculty most frequently selected "direct supervision" as the entrustment level for vignettes, including for 24% of vignettes describing fellows in their final year of training. Faculty rated the majority of vignettes (61%) as "low entrustment." There was no relationship between faculty or institutional demographics and the entrustment level selected. Insights: As has been found in summative entrustment for pediatrics, internal medicine, and surgery trainees, PCCM fellows often rated at or below the "direct supervision" level of ad hoc entrustment. This may relate to declining opportunities to practice procedures, a culture of low trust propensity among the specialty, and/or variation in interpretation of entrustment scales.

Exploring the perceptions of faculty members about research courses in undergraduate pharmacy curriculum: A qualitative study

INTRODUCTION AND OBJECTIVE

The commitment of pharmacy graduates to patient care and research is crucial to advancing pharmaceutical science and practice. Consequently, the value of involving undergraduate pharmacy students in research has been increasingly recognized. Given that the College of Pharmacy at Qatar University offers two undergraduate pharmacy research courses, it is relevant to explore the perception of faculty members of the delivery, impact, facilitators, barriers, and suggested improvements in these courses. This exploration will help to improve the existing curriculum and to highlight the prospective impact of student involvement in undergraduate pharmacy research courses on the personal and professional growth of students, as well as on the progressive evolution of the pharmacy profession.

METHODS

A qualitative exploratory case study was performed in which five virtual focus groups were conducted. All eligible faculty members from the clinical pharmacy and pharmaceutical science departments with experience supervising students who had taken one or two undergraduate pharmacy research courses were invited to participate. The focus group questions were based on the Theoretical domain framework of behavioral determinants. Verbatim transcription was performed, and the collected data were thematically analyzed using the computer-assisted coding software NVivo®.

RESULTS

Of the 26 eligible faculty members, 21 participated in this study. Five deductive themes were identified: social professional role and influences, beliefs about capabilities, skills, beliefs about consequences and goals, and environmental resources and behavioral regulations. Overall, faculty members identified themselves as assessors and mentors. Participants expected students to possess independence, responsibility, and motivation. They believed that students generally required more practical research skills. Several benefits of incorporating students into undergraduate research have been highlighted, including increased publication productivity and quality. However, several hurdles to undergraduate research in pharmacy have been identified, including limited resources, limited timeframes, and sometimes delayed ethical approval.

CONCLUSION

Faculty members expressed optimism regarding the undergraduate research courses. However, some logistical concerns, including the lengthy ethical approval process and resource availability, must be addressed to optimize the effectiveness of these courses.

Scoping review: exploring residents' views of supervisor entrustment and its effect on learning and professional development

This scoping review aimed to systematically explore the complex and nuanced perceptions of residents entrusted with significant responsibilities by their supervisors in the clinical context. We conducted a comprehensive search strategy targeting six major electronic databases. Data were extracted using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist and a scoping review protocol. Resident perceptions regarding entrustment and its impact on learning and professional development were categorized. This review elucidated the role of supervisor entrustment in shaping residents' clinical performance, notably influencing autonomy, self-confidence, responsibility for patients, learning needs and goals, uncertainty management, and professional identity formation. Residents identified factors that promote and hinder performance and entrustment development resulting from supervisor entrustment and distinguished between appropriate supervision and over- or under-supervision. Our review suggests that residents' perceptions of supervisor entrustment, as bestowed by supervisors, serves as a catalyst for enhancing autonomy, thereby exerting a significant influence on clinical performance, and fostering the development of a professional identity. However, residents' views on appropriate supervision differ in some ways from supervisors' perspectives. Further research is needed to bridge the gap between residents' expectations of autonomy and what they are given, and to explore the intricate relationship between autonomy and entrustment.

A Qualitative Study of Drivers for Use of the Primary Care Exception Among Internal Medicine Teaching Faculty

BACKGROUND

The Primary Care Exception (PCE) is a billing rule from the Centers for Medicare and Medicaid Services (CMS) that allows supervising physicians to bill for ambulatory care provided by a resident without their direct supervision. There has been increased focus on entrustment as a method to assess readiness for unsupervised practice.

OBJECTIVE

To understand the factors influencing attending physicians' use of the PCE in ambulatory settings and identify common themes defining what motivates faculty preceptors to use the PCE.

APPROACH

This was a qualitative exploratory study. Participants were interviewed one-on-one using a semi-structured template informed by the entrustment literature. Analysis was conducted using a thematically framed, grounded theory-based approach to identify major themes and subthemes.

PARTICIPANTS

Twenty-seven internal medicine teaching faculty took part in a multi-institutional study representing four residency training programs across two academic medical centers in Connecticut.

KEY RESULTS

Four predominant categories of themes influencing PCE use were identified: (1) clinical environment factors, (2) attending attitudes, (3) resident characteristics, and (4) patient attributes. An attending's "internal rules" drawn from prior experiences served as a significant driver of PCE non-use regardless of the trainee, patient, or clinical context. A common conflict existed between using the PCE to promote resident autonomy versus waiving the PCE to promote safety.

CONCLUSIONS

The PCE can serve as a tool to support resident autonomy, confidence, and overall clinical efficiency. Choice of PCE use by attendings involved complex internal decision-making schema balancing internal, patient, resident, and environmental-related factors. The lack of standardized processes in competency evaluation may increase susceptibility to biases, which could be mitigated by applying standardized modes of assessment that encompass shared principles.

Residents as supervisors: How senior residents make ad hoc entrustment decisions

BACKGROUND

As residency programmes transition to competency-based medical education, there has been substantial inquiry into understanding how ad hoc entrustment decisions are made by attending supervisors in the clinical context. However, although attendings are ultimately responsible for the decisions and actions of resident trainees, senior residents are often the ones directly supervising junior residents enrolled in competency-based training programmes. This clinical dynamic has been largely overlooked in the ad hoc entrustment literature. The purpose of this study was to explore the considerations senior residents entertain when making ad hoc entrustment decisions for their junior resident colleagues.

METHODS

In semi-structured interviews, 11 senior resident supervisors (third, fourth and fifth year) in obstetrics and gynaecology described how they entrust junior residents with clinical activities in the moment. Following constructivist grounded theory methodology, data were iteratively collected and coded with constant comparison until theoretical sufficiency was determined.

RESULTS

Senior residents described many similar considerations as attendings regarding ad hoc entrustment of junior residents, including patient safety, desire to optimise the learning environment, junior resident qualities (such as discernment and communication skills), learner handover from colleagues, and situational factors. Uniquely, senior residents discussed how their role as a middle manager and their desire to protect the junior resident (from burnout, becoming a second victim and from attendings) impacts their decisions.

CONCLUSIONS

Although senior residents make ad hoc entrustment decisions with some similar considerations to attendings, they also seem to think about additional factors. It may be that these different considerations need to be accommodated in documentation of ad hoc entrustment decisions if these documents are to be used for high-stakes summative entrustment decisions made by competency committees.

Trainee Autonomy and Supervision in the Modern Clinical Learning Environment: A Mixed-Methods Study of Faculty and Trainee Perspectives

Background

Balancing autonomy and supervision during medical residency is important for trainee development while ensuring patient safety. In the modern clinical learning environment, tension exists when this balance is skewed. This study aimed to understand the current and ideal states of autonomy and supervision, then describe the factors that contribute to imbalance from both trainee and attending perspectives.

Methods

A mixed-methods design included surveys and focus groups of trainees and attendings at three institutionally affiliated hospitals between May 2019-June 2020. Survey responses were compared using chi-square tests or Fisher's exact tests. Open-ended survey and focus group questions were analyzed using thematic analysis.

Results

Surveys were sent to 182 trainees and 208 attendings; 76 trainees (42%) and 101 attendings (49%) completed the survey. Fourteen trainees (8%) and 32 attendings (32%) participated in focus groups. Trainees perceived the current culture to be significantly more autonomous than attendings; both groups described an "ideal" culture as more autonomous than the current state. Focus group analysis revealed five core contributors to the balance of autonomy and supervision: attending-, trainee-, patient-, interpersonal-, and institutional-related factors. These factors were found to be dynamic and interactive with each other. Additionally, we identified a cultural shift in how the modern inpatient environment is impacted by increased hospitalist attending supervision and emphasis on patient safety and health system improvement initiatives.

Conclusions

Trainees and attendings agree that the clinical learning environment should favor resident autonomy and that the current environment does not achieve the ideal balance. There are several factors contributing to autonomy and supervision, including attending-, resident-, patient-, interpersonal-, and institutional-related. These factors are complex, multifaceted, and dynamic. Cultural shifts towards supervision by primarily hospitalist attendings and increased attending accountability for patient safety and systems improvement outcomes further impacts trainee autonomy.

Trainees' perceptions of being allowed to fail in clinical training: A sense-making model

INTRODUCTION

Clinical supervisors allow trainees to fail during clinical situations when trainee learning outweighs concerns for patient safety. Trainees perceive failure as both educationally valuable and emotionally draining; however, the nuance of supervised failures has not been researched from the trainee perspective. This study explored trainees' awareness and their experience of failure and allowed failure to understand those events in-depth.

METHODS

We interviewed 15 postgraduate trainees from nine teaching sites in Europe and Canada. Participants were a purposive sample, representing 1-10 years of clinical training in various specialties. Consistent with constructivist grounded theory, data collection and analysis were iterative, supporting theoretical sampling to explore themes.

RESULTS

Trainees reported that failure was a common, valuable, and emotional experience. They perceived that supervisors allowed failure, but they reported never having it explicitly confirmed or discussed. Therefore, trainees tried to make sense of these events on their own. If they interpreted a failure as allowed by the supervisor, trainees sought to ascertain supervisory intentions. They described situations where they judged supervisor's intentions to be constructive or destructive.

DISCUSSION

Our results confirm that trainees perceive their failures as valuable learning opportunities. In the absence of explicit conversations with supervisors, trainees tried to make sense of failures themselves. When trainees judge that they have been allowed to fail, their interpretation of the event is coloured by their attribution of supervisor intentions. Perceived intentions might impact the educational benefit of the experience. In order to support trainees' sense-making, we suggest that supervisory conversations during and after failure events should use more explicit language to discuss failures and explain supervisory intentions.

Can Rater Training Improve the Quality and Accuracy of Workplace-Based Assessment Narrative Comments and Entrustment Ratings? A Randomized Controlled Trial

PURPOSE

Prior research evaluating workplace-based assessment (WBA) rater training effectiveness has not measured improvement in narrative comment quality and accuracy, nor accuracy of prospective entrustment-supervision ratings. The purpose of this study was to determine whether rater training, using performance dimension and frame of reference training, could improve WBA narrative comment quality and accuracy. A secondary aim was to assess impact on entrustment rating accuracy.

METHOD

This single-blind, multi-institution, randomized controlled trial of a multifaceted, longitudinal rater training intervention consisted of in-person training followed by asynchronous online spaced learning. In 2018, investigators randomized 94 internal medicine and family medicine physicians involved with resident education. Participants assessed 10 scripted standardized resident-patient videos at baseline and follow-up. Differences in holistic assessment of narrative comment accuracy and specificity, accuracy of individual scenario observations, and entrustment rating accuracy were evaluated with t tests. Linear regression assessed impact of participant demographics and baseline performance.

RESULTS

Seventy-seven participants completed the study. At follow-up, the intervention group (n = 41), compared with the control group (n = 36), had higher scores for narrative holistic specificity (2.76 vs 2.31, P < .001, Cohen V = .25), accuracy (2.37 vs 2.06, P < .001, Cohen V = .20) and mean quantity of accurate (6.14 vs 4.33, P < .001), inaccurate (3.53 vs 2.41, P < .001), and overall observations (2.61 vs 1.92, P = .002, Cohen V = .47). In aggregate, the intervention group had more accurate entrustment ratings (58.1% vs 49.7%, P = .006, Phi = .30). Baseline performance was significantly associated with performance on final assessments.

CONCLUSIONS

Quality and specificity of narrative comments improved with rater training; the effect was mitigated by inappropriate stringency. Training improved accuracy of prospective entrustment-supervision ratings, but the effect was more limited. Participants with lower baseline rating skill may benefit most from training.

Will Any Road Get You There? Examining Warranted and Unwarranted Variation in Medical Education

Undergraduate and graduate medical education have long embraced uniqueness and variability in curricular and assessment approaches. Some of this variability is justified (warranted or necessary variation), but a substantial portion represents unwarranted variation. A primary tenet of outcomes-based medical education is ensuring that all learners acquire essential competencies to be publicly accountable to meet societal needs. Unwarranted variation in curricular and assessment practices contributes to suboptimal and variable educational outcomes and, by extension, risks graduates delivering suboptimal health care quality. Medical education can use lessons from the decades of study on unwarranted variation in health care as part of efforts to continuously improve the quality of training programs. To accomplish this, medical educators will first need to recognize the difference between warranted and unwarranted variation in both clinical care and educational practices. Addressing unwarranted variation will require cooperation and collaboration between multiple levels of the health care and educational systems using a quality improvement mindset. These efforts at improvement should acknowledge that some aspects of variability are not scientifically informed and do not support desired outcomes or societal needs. This perspective examines the correlates of unwarranted variation of clinical care in medical education and the need to address the interdependency of unwarranted variation occurring between clinical and educational practices. The authors explore the challenges of variation across multiple levels: community, institution, program, and individual faculty members. The article concludes with recommendations to improve medical education by embracing the principles of continuous quality improvement to reduce the harmful effect of unwarranted variation.

How Trainees Come to Trust Supervisors in Workplace-Based Assessment: A Grounded Theory Study

PURPOSE

In competency-based medical education, workplace-based assessment provides trainees with an opportunity for guidance and supervisors the opportunity to judge the trainees' clinical practice. Learning from assessment is enhanced when trainees reveal their thinking and are open to critique, which requires trust in the assessor. If supervisors knew more about how trainees come to trust them in workplace-based assessment, they could better engender trainee trust and improve trainees' learning experience.

METHOD

From August 2018 to September 2019, semistructured interviews were conducted with 17 postgraduate anesthesia trainees across Australia and New Zealand. The transcripts were analyzed using constructivist grounded theory methods sensitized by a sociocultural view of learning informed by Wenger's communities of practice theory.

RESULTS

Participants described a continuum from a necessary initial trust to an experience-informed dynamic trust. Trainees assumed initial trust in supervisors based on accreditation, reputation, and a perceived obligation of trustworthiness inherent in the supervisor's role. With experience and time, trainees' trust evolved based on supervisor actions. Deeper levels of trainee trust arose in response to perceived supervisor investment and allowed trainees to devote more emotional and cognitive resources to patient care and learning rather than impression management. Across the continuum from initial trust to experience-informed trust, trainees made rapid trust judgments that were not preceded by conscious deliberation; instead, they represented a learned "feel for the game."

CONCLUSIONS

While other factors are involved, our results indicate that the trainee behavior observed in workplace-based assessment is a product of supervisor invitation. Supervisor trustworthiness and investment in trainee development invite trainees to work and present in authentic ways in workplace-based assessment. This authentic engagement, where learners "show themselves" to supervisors and take risks, creates assessment for learning.

How preceptors develop trust in continuity clinic residents and how trust influences supervision: A qualitative study

INTRODUCTION

To advance in their clinical roles, residents must earn supervisors' trust. Research on supervisor trust in the inpatient setting has identified learner, supervisor, relationship, context, and task factors that influence trust. However, trust in the continuity clinic setting, where resident roles, relationships, and context differ, is not well understood. We aimed to explore how preceptors in the continuity clinic setting develop trust in internal medicine residents and how trust influences supervision.

METHODS

In this qualitative study, we conducted semi-structured interviews with faculty preceptors from two continuity clinic sites in an internal medicine residency program at an urban academic medical center in the United States from August 2018-June 2020. We analyzed transcripts using thematic analysis with sensitizing concepts related to the theoretical framework of the five factors of trust.

RESULTS

Sixteen preceptors participated. We identified four key drivers of trust and supervision in the continuity clinic setting: 1) longitudinal resident-preceptor-patient relationships, 2) direct observations of continuity clinic skills, 3) resident attitude towards their primary care physician role, and 4) challenging context and task factors influencing supervision. Preceptors shared challenges to determining trust stemming from incomplete knowledge about patients and limited opportunities to directly observe and supervise between-visit care.

DISCUSSION

The continuity clinic setting offers unique supports and challenges to trust development and trust-supervision alignment. Maximizing resident-preceptor-patient continuity, promoting direct observation, and improving preceptor supervision of residents' provision of between-visit care may improve resident continuity clinic learning and patient care.

Trust, power and learning in workplace-based assessment: The trainee perspective

For trainees to participate meaningfully in workplace-based assessment (WBA), they must have trust in their assessor. However, the trainee's dependent position complicates such trust. Understanding how power and trust influence WBAs may help us make them more effective learning opportunities. We conducted semi-structured interviews with 17 postgraduate anaesthesia trainees across Australia and New Zealand. Sensitised by notions of power, we used constructivist grounded theory methodology to examine trainees' experiences with trusting their supervisors in WBAs. In our trainee accounts, we found that supervisors held significant power to mediate access to learning opportunities and influence trainee progress in training. All episodes where supervisors could observe trainees, from simply working together to formal WBAs, were seen to generate assessment information with potential consequences. In response, trainees actively acquiesced to a deferential role, which helped them access desirable expertise and minimise the risk of reputational harm. Trainees granted trust based on how they anticipated a supervisor would use the power inherent in their role. Trainees learned to ration exposure of their authentic practice to supervisors in proportion to their trust in them. Trainees were more trusting and open to learning when supervisors used their power for the trainee's benefit and avoided WBAs with supervisors they perceived as less trustworthy. If assessment for learning is to flourish, then the trainee-supervisor power dynamic must evolve. Enhancing supervisor behaviour through reflection and professional development to better reward trainee trust would invite more trainee participation in assessment for learning. Modifying the assessment system design to nudge the power balance towards the trainee may also help. Modifications could include designated formative and summative assessments or empowering trainees to select which assessments count towards progress decisions. Attending to power and trust in WBA may stimulate progress towards the previously aspirational goal of assessment for learning in the workplace.

What happens under the flag of direct observation, and how that matters: A qualitative study in general practice residency

INTRODUCTION

In competency-based medical education, direct observation (DO) of residents' skills is scarce, notwithstanding its undisputed importance for credible feedback and assessment. A growing body of research is investigating this discrepancy. Strikingly, in this research, DO as a concrete educational activity tends to remain vague. In this study, we concretised DO of technical skills in postgraduate longitudinal training relationships.

METHODS

Informed by constructivist grounded theory, we performed a focus group study among general practice residents. We asked residents about their experiences with different manifestations of DO of technical skills. A framework describing different DO patterns with their varied impact on learning and the training relationship was constructed and refined until theoretical sufficiency was reached.

RESULTS

The dominant DO pattern was ad hoc, one-way DO. Importantly, in this pattern, various unpredictable, and sometimes unwanted, scenarios could occur. Residents hesitated to discuss unwanted scenarios with their supervisors, sometimes instead refraining from future requests for DO or even for help. Planned bi-directional DO sessions, though seldom practiced, contributed much to collaborative learning in a psychologically safe training relationship.

DISCUSSION AND CONCLUSION

Patterns matter in DO. Residents and supervisors should be made aware of this and educated in maintaining an open dialogue on how to use DO for the benefit of learning and the training relationship.

Medical Students' Perspectives on Entrustment Decision Making in an Entrustable Professional Activity Assessment Framework: A Secondary Data Analysis

PURPOSE

Research on how entrustment decisions are made identifies 5 influential factors (supervisor, trainee, supervisor-trainee relationship, context, task). However, this literature primarily represents the perspective of supervisors in graduate medical education and is conducted outside of an assessment framework where entrustment decisions have consequences for trainees and for patients. To complement the literature, the authors explored how medical students in a pilot program that used an entrustable professional activity (EPA) assessment framework perceived factors influencing entrustment decisions.

METHOD

The authors conducted a secondary analysis of qualitative data from program evaluation of a pilot project using an EPA assessment framework to advance students through their curriculum and into residency. Data were derived from 8 focus groups conducted over 4 years (2015-2018) with 27 students who shared their experience of learning and supervision in the project. Sensitized by the entrustment literature, the authors coded and analyzed focus group transcripts according to principles of thematic analysis.

RESULTS

Components of the trainee and supervisor-trainee relationship factors predominated students' perceptions of entrustment decisions. Students directed their own learning by asking for feedback, seeking opportunities to engage in learning, sharing limitations of their knowledge with supervisors, and pushing supervisors to recalibrate assessments when appropriate. Students' agentic actions were facilitated by longitudinal supervisor-trainee relationships wherein they felt comfortable asking for help and built confidence in patient care. Students mentioned components of other factors that influenced entrustment decisions (supervisor, clinical task, clinical context), but did so less frequently and from a nonagentic vantage point.

CONCLUSIONS

Students' perspectives on entrustment decisions can be derived from their views on learning and supervision in an EPA assessment framework. Their perspectives complement the literature by highlighting students' agentic actions to influence entrustment decisions and promotion of agentic action through practices incorporating longitudinal supervisor-trainee relationships.

Entrustment Unpacked: Aligning Purposes, Stakes, and Processes to Enhance Learner Assessment

Educators use entrustment, a common framework in competency-based medical education, in multiple ways, including frontline assessment instruments, learner feedback tools, and group decision making within promotions or competence committees. Within these multiple contexts, entrustment decisions can vary in purpose (i.e., intended use), stakes (i.e., perceived risk or consequences), and process (i.e., how entrustment is rendered). Each of these characteristics can be conceptualized as having 2 distinct poles: (1) purpose has formative and summative, (2) stakes has low and high, and (3) process has ad hoc and structured. For each characteristic, entrustment decisions often do not fall squarely at one pole or the other, but rather lie somewhere along a spectrum. While distinct, these continua can, and sometimes should, influence one another, and can be manipulated to optimally integrate entrustment within a program of assessment. In this article, the authors describe each of these continua and depict how key alignments between them can help optimize value when using entrustment in programmatic assessment within competency-based medical education. As they think through these continua, the authors will begin and end with a case study to demonstrate the practical application as it might occur in the clinical learning environment.

An act of performance: Exploring residents' decision-making processes to seek help

CONTEXT

Residents are expected to ask for help when feeling insufficiently confident or competent to act in patients' best interests. While previous studies focused on the perspective of supervisor-resident relationships in residents' help-seeking decisions, attention for how the workplace environment and, more specifically, other health care team members influence these decisions is limited. Using a sociocultural lens, this study aimed to explore how residents' decision-making processes to seek help are shaped by their workplace environment.

METHODS

Through a constructivist grounded theory methodology, we purposively and theoretically sampled 18 residents: 9 juniors (postgraduate year 1/2) and 9 seniors (postgraduate year 5/6) at Amsterdam University Medical Centers. Using semi-structured interviews, participating residents' decision-making processes to seek help during patient care delivery were explored. Data collection and analysis were iterative; themes were identified using constant comparative analysis.

RESULTS

Residents described their help-seeking decision-making processes as an 'act of performance': they considered how asking for help could potentially impact their assessments. They described this act of performance as the product of an internal 'balancing act' with at its core the non-negotiable priority for providing safe and high-quality patient care. With this in mind, residents weighed up demonstrating the ability to work independently, maintaining credibility and becoming an accepted member of the health care team when deciding to seek help. This 'balancing act' was influenced by sociocultural characteristics of the learning environment, residents' relationships with supervisors and the perceived approachability of other health care team members.

CONCLUSIONS

This study suggests that sociocultural forces influence residents to experience help-seeking as an act of performance. Especially, a safe learning environment resulting from constructive relationships with supervisors and the approachability of other health care team members lowered the barriers to seek help. Supervisors could address these barriers by having regular conversations with residents about when to seek help.

Development of autonomy on placement: perceptions of physiotherapy students and educators in Australia and the United Kingdom

Objectives:This paper explores the decision-making processes involved in giving physiotherapy students responsibility on clinical placement and the impact on their developing professional autonomy. Methods: The qualitative study, using semi-structured interviews, involved physiotherapy students and clinical educators (CEs) from two higher education institutions, one in Australia, and the other in the United Kingdom (UK). Findings: Findings led to the development of a heuristic framework of 'graduated supervision,' a process of progressively less direct observation and monitoring of students as clinical proficiency improved. By focusing on the measured exposure of students to increasing complexity and inverse levels of supervision, the framework captures tacit practices, and consistent, yet varied facilitation strategies adopted across specialties, and evident in clinical education settings in both countries. The framework formalizes, for the first time, assumptions and expectations previously unacknowledged. Factors identified as affecting students' progress toward autonomy include the student/CE relationship, the development of mutual trust through ongoing dialogue, and the importance of formal discussions at the commencement of a clinical placement to establish learning goals, preferred supervision styles and learner responsibilities. Conclusion: Insights have significance for the CE community, and students who at times have to second-guess what is required of them and how they might excel on clinical placement.

The ingredients of a rich entrustment decision

Entrustment decision-making has become a topic of interest in workplace-based assessment in the health professions and is germane to the use of entrustable professional activities. Entrustment decisions stem from judgments of a trainee's competence and include the permission to act with a higher level of responsibility or autonomy and a lower level of supervision. Making entrustment decisions differs from regular assessment of trainees, which usually has no consequences beyond marking trainee progress. Studies show that clinicians generally weigh more factors in making an entrustment decision than when merely assessing trainee competence or performance without direct consequences for patient care. To synthesize the varying factors reported in literature, the authors performed a thematic analysis of key qualitative studies that investigated trainee features clinical supervisors find important when making entrustment decisions. Five themes emerged from the 13 publications: Capability (specific knowledge, skills, experience, situational awareness), Integrity (truthful, benevolent, patient-centered), Reliability (conscientious, predictable, accountable, responsible), Humility (recognizes limits, asks for help, receptive to feedback), Agency (proactive toward work, team, safety, personal development). Thoughtful entrustment decisions, made either by individual clinical supervisors or by clinical competency committees, may be enriched by taking into account these five features.

Explicit Dialogue About the Purpose of Hospital Admission Is Essential: How Different Perspectives Affect Teamwork, Trust, and Patient Care

PURPOSE

The authors previously found that attending physicians conceptualize hospital admission purpose according to 3 perspectives: one focused dominantly on discharge, one on monitoring and managing chronic conditions, and one on optimizing overall patient health. Given implications of varying perspectives for patient care and team collaboration, this study explored how purpose of admission is negotiated and enacted within clinical teaching teams.

METHOD

Direct observations and field interviews took place in 2 internal medicine teaching units at 2 teaching hospitals in Ontario, Canada, in summer 2017. A constructivist grounded theory approach was used to inform data collection and analysis.

RESULTS

The 54 participants included attendings, residents, and medical students. Management decisions were identified across 185 patients. Attendings and senior medical residents (second- and third-year residents) were each observed to enact one dominant perspective, while junior trainees (first-year residents and students) appeared less fixed in their perspectives. Teams were not observed discussing purpose of admission explicitly; however, differing perspectives were present and enacted. These differences became most noticeable when at the extremes (discharge focused vs optimization focused) or between senior medical residents and attendings. Attendings implicitly signaled and enforced their perspectives, using authority to shut down and redirect discussion. Trainees' maneuvers for enacting their perspectives ranged from direct advocacy to covert manipulation (passive avoidance/forgetting and delaying until attending changeover).

CONCLUSIONS

Failing to negotiate and explicitly label perspectives on purpose of admission may lead to attendings and senior medical residents working at cross-purposes and to trainees participating in covert maneuvers, potentially affecting trust and professional identify development.

Factors and Behaviors Related to the Promotion of Pediatric Hospital Medicine Fellow Autonomy: A Qualitative Study of Faculty

OBJECTIVE

To identify factors that influence faculty to promote or reduce the expression of autonomy for pediatric hospital medicine (PHM) fellows and describe behaviors faculty employ to support fellow autonomy in the clinical setting.

METHODS

This was a multicenter, qualitative study using semistructured interviews with core faculty in PHM fellowships. Data were transcribed verbatim and analyzed using a phenomenological approach. Each transcript was coded independently by 2 trained reviewers who then met to reconcile differences. Codes were identified using an iterative approach and organized into themes. Investigators engaged in peer debriefing during data collection, and member checking confirmed the results.

RESULTS

Interviews were conducted December 2016 to January 2017 with 20 faculty from 5 PHM fellowships. Most participants were female (12, 60%) and assistant (13, 65%) or associate (6, 30%) professors. Data analysis yielded 6 themes. Themes reflect the importance of faculty experience, style, and approach to balancing patient care with education in the provision of autonomy for PHM fellows. Faculty appreciation for the role of autonomy in medical education, investment in their roles as educators, and investment in PHM fellowship training are also influential factors. Finally, fellow clinical, educational, leadership, and communication skills influence the provision of autonomy. Faculty employ various levels of supervision, scaffolding techniques, and direct observation with feedback to support fellow autonomy. Professional development was considered essential for developing these skills.

CONCLUSIONS

We identified 6 themes related to faculty provision of autonomy to PHM fellows, as well as strategies employed by faculty to support fellow autonomy.

Justifications for Discrepancies Between Competency Committee and Program Director Recommended Resident Supervisory Roles

OBJECTIVE

To explore justifications for differences between summative entrustment decisions made about pediatric residents by individuals who are charged with the review of residents (clinical competency committee, or CCC, members) and those who ultimately make final summative decisions about resident performance (program directors, or PDs).

METHODS

Individual CCC member and PD supervisory role categorizations were made in the 2015 to 2016 academic year at 14 pediatric residency programs, placing residents into 1 of 5 progressive supervisory roles. When PD recommendations differed from CCC members, a free-text justification was requested. Free-text responses were analyzed using manifest content analysis.

RESULTS

In total, 801 supervisory role categorizations were made by both CCC members and PDs, with the same recommendations made in 685 cases. In the 116 instances of discrepancy, PDs assigned a lower level of supervisory responsibility (n = 73) more often than a greater one (n = 43). When moving residents to a greater supervisory role category, PDs had more justifications anchored in resident performance than experience. When moving residents to a lower supervisory role categorization, PDs conversely noted experience more than performance.

CONCLUSIONS

PDs provide more justifications anchored in resident performance when moving residents to a greater supervisory role category compared with CCC members. However, when moving residents to a lower supervisory role categorization, they note experience more than performance. These patterns may or may not be entirely consistent with a competency-based approach and should be explored further.

Trusted to Learn: a Qualitative Study of Clerkship Students' Perspectives on Trust in the Clinical Learning Environment

BACKGROUND

Trust informs supervision decisions in medical training. Factors that influence trust differ depending on learners' and supervisors' level. Research has focused on resident trainees; questions exist about how medical students experience entrustment.

OBJECTIVE

This study examines how clerkship students perceive supervisors' trust in them and its impact on their learning.

DESIGN

Qualitative study using individual semi-structured interviews.

PARTICIPANTS

Clerkship medical students at the University of California, San Francisco.

APPROACH

We invited 30 core clerkship students to participate in interviews (October 2017 to February 2018) eliciting examples of appropriate, over-, and under-trust. We coded and analyzed transcripts using thematic analysis.

KEY RESULTS

Sixteen (53%) students participated. Three major themes arose: trust as scaffolding for learning, effects of trust on the learning environment, and consequences of trust for patients. Appropriate trust usually involved coaching and close guidance, often with more junior supervisors (interns or residents). These situations fostered students' motivation to learn, sense of value on the team, and perceived benefits to patients. Over-trust was characterized by task assignment without clear instruction, supervision, or feedback. Over-trust prompted student anxiety and stress, and concerns for potential patient harm. Under-trust was characterized by lack of clarity about the student role, leading to frustration and discontent, with unclear impact on patients. Students attributed inappropriate trust to contextual and supervisor factors and did not feel empowered to intervene due to concerns about performance evaluations and hierarchy.

CONCLUSIONS

As early learners in the clinical workplace, students frame trust as entailing high levels of support. It is important for medical educators to consider ways to train resident and faculty supervisors to enact trust and supervision for students differently than for residents. Structures that encourage students and supervisors to discuss trust and supervision in a transparent way can enhance learning.

Key Studies in Medical Education from 2017: ANarrative Review

Education, like clinical medicine, should be based on the most current evidence in the field. Despite the overwhelming breadth of literature in medical education, pediatric educators desire and need to incorporate best practices into their educational approaches. This article provides an overview of 18 articles from the literature in 2017 that the authors consider to be key articles in the field of pediatric medical education. The 7 authors, all medical educators with combined leadership experience and expertise across the continuum of pediatric medical education, used an iterative, staged process to review more than 1682 abstracts published in 2017. This process aimed to identify a subset of articles that were most relevant to educational practice and most applicable to pediatric medical education. In the process, pairs of authors independently reviewed and scored abstracts in 13 medical education-related journals and reached consensus to identify the abstracts that best met these criteria. Selected abstracts were discussed using different pairs to select the final articles included in this review. This paper presents summaries of the 18 articles that were selected. The results revealed a cluster of studies related to feedback, coaching, and observation; trainee progression, educator development, trainee entrustment, culture, and climate; and the medical student experience. This narrative review offers a useful tool for educators interested in keeping informed about the most relevant and valuable information in the field of medical education.

Job Crafting to Persist in Surgical Training: A Qualitative Study From the Resident's Perspective

BACKGROUND

Attrition in surgical training, a result of poor well-being at work, continues to rise. Work engagement and persistence, the other side of the coin, depend on the proactivity of residents to optimize the demands and resources in the workplace to achieve a better fit with the environment. This type of proactivity refers to job-crafting. In this study, we sought to explore the specific mechanisms underlying residents' job-crafting to enhance work engagement and persistence, as well as the role of supervisors in this endeavor.

MATERIALS AND METHODS

We used a constructivist-grounded theory design. We conducted semistructured interviews of active residents. During the analysis of verbatim protocols, we developed codes and categories and identified the main themes (job-crafting mechanisms) related to work engagement and persistence. We anticipated procedures to engage in reflexivity.

RESULTS

The residents showed six job-crafting mechanisms (build trust with supervisors, manage proactively, seek help, see errors and frustrations as learning opportunities, find a suitable work-life balance, and seek challenges actively). The supervisors contributed to residents' job-crafting with four mechanisms (earning the trust of the residents, providing guidance and support, allowing residents to fulfill tasks befitting a surgeon in training, and offering increasingly challenging tasks to residents).

CONCLUSIONS

Work engagement and persistence in training are active processes that depend on the ability of residents to take advantage of resources and challenges and to diminish hindering demands at the workplace. Future research should focus on the perspectives of the supervisor, as well as on the effectiveness of job-crafting interventions, to enhance work engagement.

Key Factors in Clinical Competency Committee Members' Decisions Regarding Residents' Readiness to Serve as Supervisors: A National Study

PURPOSE

Entrustment has become a popular assessment framework in recent years. Most research in this area has focused on how frontline assessors determine when a learner can be entrusted. However, less work has focused on how these entrustment decisions are made. The authors sought to understand the key factors that pediatric residency program clinical competency committee (CCC) members consider when recommending residents to a supervisory role.

METHOD

CCC members at 14 pediatric residency programs recommended residents to one of five progressive supervisory roles (from not serving as a supervisory resident to serving as a supervisory resident in all settings). They then responded to a free-text prompt, describing the key factors that led them to that decision. The authors analyzed these responses, by role recommendation, using a thematic analysis.

RESULTS

Of the 155 CCC members at the participating programs, 84 completed 769 supervisory role recommendations during the 2015-2016 academic year. Four themes emerged from the thematic analysis: (1) Determining supervisory ability follows from demonstrated trustworthiness; (2) demonstrated performance matters, but so does experience; (3) ability to lead a team is considered; and (4) contextual considerations external to the resident are at play.

CONCLUSIONS

CCC members considered resident and environmental factors in their summative entrustment decision making. The interplay between these factors should be considered as CCC processes are optimized and studied further.

Beyond hands-on and hands-off: supervisory approaches and entrustment on the inpatient ward

CONTEXT

The concept of entrustment has garnered significant attention in medical specialties, despite variability in supervision styles and entrustment decisions. There is a need to further study the enactment of supervision on inpatient wards to inform competency-based assessment design.

METHODS

Attending physicians, while supervising on clinical teaching inpatient wards, were invited to describe a recent moment of enacting supervision with an internal medicine resident. Constructivist grounded theory guided data collection and analysis. Interview transcripts were analysed in iterative cycles to inform data collection. Constant comparison was used to build a theory of supervision from the identified themes.

RESULTS

In 2016-2017, 23 supervisors from two Canadian universities with supervision reputations ranging from very involved to less involved participated in one or two interviews (total: 28). Supervisors were not easily dichotomised into styles based on behaviour because all used similar oversight strategies. Supervisors described adjusting between 'hands-on' (e.g. detail oriented) and 'hands-off' (e.g. less visible on ward) styles depending on the context. All also contended with the competing roles of clinical teacher and care provider. Supervisors made a distinction between the terms `entrust' and `trust', and did not grant complete entrustment to senior residents.

CONCLUSIONS

We propose that a supervisor's perceived responsibility for the ward underlies adjustments between 'hands-on' (i.e. personal ward responsibility) and 'hands-off' (i.e. shared ward responsibility) styles. Our approaches to clinical supervision model combines this responsibility tension with the tension between patient care and teaching to illustrate four supervisory approaches, each with unique priorities influencing entrustment. Given the fluidity in supervision, documenting changes in oversight strategies, rather than absolute levels of entrustment, may be more informative for assessment purposes. Research is needed to determine if there is sufficient association between the supervision provided, the entrustment decision made and the supervisor's trust in a trainee to use these as proxies in assessing a trainee's competence.

Understanding Clerkship Student Roles in the Context of 21st-Century Healthcare Systems and Curricular Reform

Phenomenon: Preclerkship medical education has undergone extensive reform, and the clerkship years are growing targets for curricular innovation. As institutions implement new preclerkship curricula to better prepare medical students to practice medicine in the context of modern healthcare systems, the perspective of clerkship leaders regarding clerkship student roles and potential for change will facilitate redefining these roles so that preclerkship educational innovations can continue into clerkships. Approach: In this qualitative exploratory study, authors conducted semistructured interviews with clerkship and site directors for eight core clerkships from April to May 2016. Questions addressed how clerkship leaders perceive current student roles and the potential for change. Through iterative consensus building, authors identified themes describing current ideal clerkship student roles applicable to future roles. Findings: Twenty-three of 24 (96%) directors participated. Findings fell into four themes: factors influencing the clerkship role, clerkship student role archetypes, workplace authenticity and value, and potential for change. Student, supervisor, and context factors determine the clerkship student role. Three role archetypes emerged: the apprentice (an assistant completing concrete patient care tasks), the academic (a researcher bringing literature back to the team), and the communicator (an interdisciplinary and patient liaison). Each archetype was considered authentic and valuable. Positive attitudes toward preclerkship curricular changes were associated with openness to evolution of the clerkship students' role. These emerging roles mapped to the archetypes. Insights: Clerkship leaders perceive that student, supervisor, and context factors result in varying emphasis on role archetypes, which in turn lead to different types of learning. Medical educators can use the archetypes to articulate how expanded student roles align learning with clinical needs, particularly as they relate to health systems science and inquiry.

Faculty Development Revisited: A Systems-Based View of Stakeholder Development to Meet the Demands of Entrustable Professional Activity Implementation

In 2015, the Association of American Medical Colleges implemented an interinstitutional pilot of 13 core entrustable professional activities (EPAs) for entering residency, activities that entering residents should be expected to perform with indirect supervision. The pilot included a concept group on faculty development; this group previously offered a shared mental model focused on the development of faculty who devote their efforts to clinical teaching and assessment for learning and entrustment decision making. In this article, the authors draw from the literature of competency-based education to propose what is needed in overall approaches to faculty development to prepare institutions for undergraduate EPA implementation.Taking a systems-based view that defines the necessary tasks of EPA implementation, the authors move beyond the variably used term "faculty" and enumerate a comprehensive list of institutional stakeholders who can meaningfully support and/or engage in the relationships and organizational processes required for EPA learning and assessment. They consider each group's responsibilities and development needs according to five domains delineated by Steinert: teaching improvement, leadership and management, research-building capacity, academic career building, and organizational change.The authors argue that the EPA framework addresses barriers posed with the use of a competency-based framework. By facilitating the communication required for organizational change, enabling valid assessment with comprehensive yet feasible levels of faculty development, and incorporating all relevant data on student professional behavior into summative assessment decisions, EPAs may offer a clearer path toward the goal of competency-based education.

Supervised workplace learning in postgraduate training: a realist synthesis

Context

This paper presents a realist synthesis of the literature that began with the objective of developing a theory of workplace learning specific to postgraduate medical education (PME). As the review progressed, we focused on informal learning between trainee and senior doctor or supervisor, asking what mechanisms occur between trainee and senior doctor that lead to the outcomes of PME, and what contexts shape the operation of these mechanisms and the outcomes they produce?

Methods

We followed the procedures outlined in the RAMESES Publication Standards for Realist Synthesis. We searched the English‐language literature published between 1995 and 2017 for empirical papers related to informal workplace learning between supervisor and trainee, excluding formal interventions such as workplace‐based assessment. We made a pragmatic decision to exclude general practice training to keep the review within manageable limits.

Results

We reviewed 5197 papers and selected 90. Synthesis revealed three workplace learning processes occurring between supervisors and trainees, each underpinned by a pair of mechanisms: supervised participation in practice (entrustment and support seeking); mutual observation of practice (monitoring and modelling), and dialogue during practice (meaning making and feedback). These mechanisms result in outcomes of PME, including safe participation in practice, learning skills, attitudes and behaviours and professional identity development. Contexts shaping the outcomes of these mechanisms were identified at individual, interpersonal, local and systems levels.

Conclusions

Our realist theory of workplace learning between supervisors and trainees is informed by theory and empirical research. It highlights the two‐way nature of supervision, the importance of trainees’ agency in their own learning and the deleterious effect of fragmented working patterns on supervisor–trainee learning mechanisms. Further empirical research is required to test and refine this theory. In the meantime, it provides a useful framework for the design of supportive learning environments and for the preparation of supervisors and trainees for their roles in workplace learning.

The authors describe a realist theory of learning between supervisor and postgraduate trainee in the workplace, emphasising the role of individual, interpersonal, local and systems contexts in shaping key mechanisms and their outcomes.

New graduate doctors' preparedness for practice: a multistakeholder, multicentre narrative study

OBJECTIVE

While previous studies have begun to explore newly graduated junior doctors' preparedness for practice, findings are largely based on simplistic survey data or perceptions of newly graduated junior doctors and their clinical supervisors alone. This study explores, in a deeper manner, multiple stakeholders' conceptualisations of what it means to be prepared for practice and their perceptions about newly graduated junior doctors' preparedness (or unpreparedness) using innovative qualitative methods.

DESIGN

A multistakeholder, multicentre qualitative study including narrative interviews and longitudinal audio diaries.

SETTING

Four UK settings: England, Northern Ireland, Scotland and Wales.

PARTICIPANTS

Eight stakeholder groups comprising n=185 participants engaged in 101 narrative interviews (27 group and 84 individual). Twenty-six junior doctors in their first year postgraduation also provided audio diaries over a 3-month period.

RESULTS

We identified 2186 narratives across all participants (506 classified as 'prepared', 663 as 'unprepared', 951 as 'general'). Seven themes were identified; this paper focuses on two themes pertinent to our research questions: (1) explicit conceptualisations of preparedness for practice; and (2) newly graduated junior doctors' preparedness for the General Medical Council's (GMC) outcomes for graduates. Stakeholders' conceptualisations of preparedness for practice included short-term (hitting the ground running) and long-term preparedness, alongside being prepared for practical and emotional aspects. Stakeholders' perceptions of medical graduates' preparedness for practice varied across different GMC outcomes for graduates (eg, Doctor as Scholar and Scientist, as Practitioner, as Professional) and across stakeholders (eg, newly graduated doctors sometimes perceived themselves as prepared but others did not).

CONCLUSION

Our narrative findings highlight the complexities and nuances surrounding new medical graduates' preparedness for practice. We encourage stakeholders to develop a shared understanding (and realistic expectations) of new medical graduates' preparedness. We invite medical school leaders to increase the proportion of time that medical students spend participating meaningfully in multiprofessional teams during workplace learning.

Influence of Clinical Competency Committee Review Process on Summative Resident Assessment Decisions

BACKGROUND

Clinical Competency Committees (CCCs) are charged with making summative assessment decisions about residents.

OBJECTIVE

We explored how review processes CCC members utilize influence their decisions regarding residents' milestone levels and supervisory roles.

METHODS

We conducted a multisite longitudinal prospective observational cohort study at 14 pediatrics residency programs during academic year 2015-2016. Individual CCC members biannually reported characteristics of their review process and Accreditation Council for Graduate Medical Education milestone levels and recommended supervisory role categorizations assigned to residents. Relationships among characteristics of CCC member reviews, mean milestone levels, and supervisory role categorizations were analyzed using mixed-effects linear regression, reported as mean differences with 95% confidence intervals (CIs), and Bayesian mixed-effects ordinal regression, reported as odds ratios (ORs) and 95% credible intervals (CrIs).

RESULTS

A total of 155 CCC members participated. Members who provided milestones or other professional development feedback after CCC meetings assigned significantly lower mean milestone levels (mean 1.4 points; CI -2.2 to -0.6; P < .001) and were significantly less likely to recommend supervisory responsibility in any setting (OR = 0.23, CrI 0.05-0.83) compared with CCC members who did not. Members recommended less supervisory responsibility when they reviewed more residents (OR = 0.96, 95% CrI 0.94-0.99) and participated in more review cycles (OR = 0.22, 95% CrI 0.07-0.63).

CONCLUSIONS

This study explored the association between characteristics of individual CCC member reviews and their summative assessment decisions about residents. Further study is needed to gain deeper understanding of factors influencing CCC members' summative assessment decisions.

Patterns of direct observation and their impact during residency: general practice supervisors' views

CONTEXT

Direct observation (DO) of residents' performance, despite the importance that is ascribed to it, does not readily fit in with the practice of postgraduate medical education (PGME); it is infrequent and the quality of observation may be poor in spite of ongoing efforts towards improvement. In recent literature, DO is mostly portrayed as a means to gather information on the performance of residents for purposes of feedback and assessment. The role of DO in PGME is likely to be more complex and poorly understood in the era of outcome-based education. By exploring the possible complexity of DO in workplace learning, our research aims to contribute to a better use of DO in the practice of PGME.

METHODS

Constructivist grounded theory informed our data collection and analysis. Data collection involved focus group sessions with supervisors in Dutch general practice who were invited to discuss the manifestations, meanings and effects of DO of technical skills. Theoretical sufficiency was achieved after four focus groups, with a total of 28 participants being included.

RESULTS

We found four patterns of DO of technical skills: initial planned DO sessions; resident-initiated ad hoc DO; supervisor-initiated ad hoc DO, and continued planned DO sessions. Different patterns of DO related to varying meanings, such as checking or trusting, and effects, such as learning a new skill or experiencing emotional discomfort, all of them concerning the training relationship, patient safety or residents' learning.

CONCLUSIONS

Direct observation, to supervisors, means much more than gathering information for purposes of feedback and assessment. Planned DO sessions are an important routine during the initiation phase of a training relationship. Continued planned bidirectional DO sessions, although infrequently practised, potentially combine most benefits with least side-effects of DO. Ad hoc DO, although much relied upon, is often hampered by internal tensions in supervisors, residents or both.

Twelve tips for the implementation of EPAs for assessment and entrustment decisions

The concept of entrustable professional activities (EPAs) reframes the approach to assessment in competency-based medical education. Key to this concept is the linking of assessment to decision making about entrusting learners with clinical responsibilities. Based on recent literature and the authors' experiences with implementing EPAs, this article provides practical recommendations for how to implement EPAs for assessment and entrustment decisions in the workplace. Tips for supervising clinicians include talking to learners about trust, using EPA descriptions to guide learning and teaching, providing learners with greater ad hoc responsibilities, using EPAs to identify/create opportunities for assessment and feedback, including case-based discussions and acknowledging gut feelings about learner readiness for more autonomy. Tips for curriculum leaders entail enabling the trust development, applying trust decisions at all levels of the supervision scale, employing all available information sources for entrustment, empowering learner ownership of the assessment process and using technology for learner tracking and program evaluation.