Fostering a Feedback Mindset: A Qualitative Exploration of Medical Students' Feedback Experiences With Longitudinal Coaches

Evaluation of a Direct Observation, Coaching and Assessment Model for the Internal Medicine Clerkship

BACKGROUND

With a trend towards competency-based assessment in medical education, there is a need for increased direct observation, feedback and coaching of medical students during clinical rotations.

APPROACH

To increase observation and provide more coaching and feedback, we designed a model in which a faculty coach met with students longitudinally during the internal medicine clerkship. The first session included an observed history and physical (H&P), and the coach and student identified skill areas to focus on in remaining sessions. All sessions included a debrief with feedback.

EVALUATION

Students received a survey to rate the amount and quality of observation and feedback received, and we used ordinal logistic regression models to assess the intervention. We conducted thematic analysis to assess what students found most useful. Students in the intervention group reported more direct observation performing the H&P (OR = 9.17, 95% CI [1.86, 70.05], p = 0.01) and found the personalized feedback and increased opportunities to discuss clinical reasoning valuable.

IMPLICATIONS

With a growing need for longitudinal observation of clinical skills to allow for competency-based assessments, at a time in which there is often insufficient continuity between students and supervising physicians, this model helps address needs for increased direct observation, coaching and feedback on skill development over time.

Untangling feedback: Mapping the patterns behind the practice

Although feedback is widely recognized as essential to improving performance and learning outcomes, what feedback involves and what it achieves can vary significantly according to researchers and practitioners. This variability reflects the lack of a shared conceptual framework to unite feedback practices, theories, findings and recommendations. In this paper, the authors use a recently developed pattern system to compare different models of feedback as a way of building a more united perspective. The authors conducted a comparative case study and framework analysis of 11 feedback models across four categories of feedback (augmented sensorimotor feedback, coaching, audit and feedback and multisource feedback). Each model was analysed to identify which aspects of feedback it addressed, and which were overlooked or excluded. The analysis revealed both divergence and convergence in how feedback models mapped onto the pattern system. Divergence was evident in the variability of elements (pattern representations) across models and diversity in expression and granularity of those elements. Conversely, convergence was observed in recurring clusters of elements, such as Performance measurement, Sensor, Judgement and Assessment, which appeared consistently across categories. Overall, the mapping exercise showed significant variations in how feedback is conceptualized, even within specific subcategories such as "coaching," "audit and feedback" and "multisource feedback." These differences have important implications for advancing research and practice in these areas. Pattern theory and pattern mapping offer a promising framework for exploring and addressing the conceptually contested nature of feedback in medical education and may facilitate the future development of a pattern language of feedback.

Can Artificial Intelligence Coach Faculty to Utilize Growth Mindset Language? A Qualitative Analysis of Feedback Statements

INTRODUCTION

Feedback is at the core of competency-based medical education. Learner perceptions of the evaluation process influence how feedback is utilized. Systems emphasize a fixed mindset, prioritizing evaluation over growth. Embracing growth mindset culture, the belief that ability is acquired through effort and human capabilities can be developed over time, will allow learners to gain greater benefits from feedback. Transitioning from fixed mindset language (FML) to growth mindset language (GML) will require faculty training. Artificial intelligence (AI) can assist faculty with incorporating GML concepts in written feedback. The aim of this study was to assess the ability of AI to assist in changing FML feedback statements into statements with GML.

METHODS

A qualitative study was performed utilizing a sample of 83 summative and formative feedback statements provided to students (37) and residents (46) from surgery clerkship and national SIMPL-inguinal hernia evaluations. Of these 83 statements, a reviewer coded 41 statements as using GML and 42 using FML. Original statements identified as using FML were entered into the Google Chrome "Help me write" tool, a writing aid using Generative AI. The AI tool was prompted with the statement "rewrite using growth mindset language:," followed by an original FML statement. A dataset containing a combination of AI-altered and original statements, 99 statements in all, was provided to two additional blinded reviewers trained in GML concepts. Reviewers evaluated statements as predominantly GML or FML and commented on their perception of AI use in statements. Reviewer agreement was adjudicated by the original coder.

RESULTS

Of the 41 original GML statements, coders correctly identified 37 (90.2%) as using GML. Of the 26 original FML statements, coders correctly identified all 26 (100%) as using FML. Of the AI-modified FML to GML statements, coders correctly identified 17 of 18 (94.4%) as using GML. They correctly identified 56.3% as AI-modified and 44.8% as not AI-modified statements. They disagreed on AI use in 39.4% of statements. AI-assistance was unrecognized in 16 (8.1%) statements and mistaken for use in 47 (23.7%) statements.

CONCLUSIONS

AI was successful at modifying FML statements into feedback containing GML, and in a way that was not obviously AI-generated. This proof-of-concept study demonstrates that AI can be a helpful tool for faculty to increase the use of GML in written feedback. While AI cannot perfectly create GML feedback without initial input and understanding from faculty, it does serve as a promising educational aid. As the body of work on using GML in surgical education grows, the better AI can assist in the generation of quality feedback.

The safe practitioner framework: an imperative to incorporate a psychosocial sub-curriculum into dental education

A primary aim of dental schools is to produce competent and caring independent professionals, capable of developing themselves and serving the needs of their patients through reflective practice and self-regulated continuous learning. The General Dental Council has also explicitly recognised the importance of self-regulated learning, and other associated behaviours, in the new The safe practitioner framework. However, traditional learning designs focus on the development of academic and clinical skills, and assume that psychosocial skills, which support self-regulated learning and enable the management of personal challenging circumstances, are already present. Unfortunately, data suggest that the psychosocial skills in many students currently entering healthcare programmes are relatively underdeveloped, impacting upon their approaches to learning and their mental health, and potentially, patient safety. Therefore, there is a need to support students in their psychosocial development. This development starts with teachers understanding the societal, academic and environmental circumstances that their current students have experienced, followed by the consideration of the importance of psychosocial skills within their dental education. This paper discusses these matters and suggests a psychosocial sub-curriculum along with a suggested framework for its implementation.

Evaluating the Impact of Coaching Through the Transition to Residency

BACKGROUND

Coaching has been proposed to support the transition to residency. Clarifying its impact will help define its value and best use.

OBJECTIVE

To explore the experiences of residents working with coaches through the residency transition.

DESIGN

A cohort comparison survey compared experiences of a coached resident cohort with coaches to the prior, uncoached cohort.

PARTICIPANTS

Post-graduate year (PGY)-2 residents in internal medicine, obstetrics and gynecology, emergency medicine, and pathology at a single academic center.

INTERVENTIONS

Faculty trained as coaches had semi-structured meetings with graduating medical students and residents throughout the PGY-1 year.

MAIN MEASURES

An online anonymous survey assessed effects of coaching on measures of self-directed learning, professional development, program support and impact of coaching using existing scales (2-item Maslach Burnout Inventory, Brief Resilient Coping Scale, 2-item Connor-Davidson Resilience Scale, Stanford Professional Fulfillment Inventory), and novel measures adapted for this survey. Bivariate analyses (t-tests and chi-square tests) compared cohort responses. MANOVA assessed the effects of coaching, burnout and their interactions on the survey domains.

KEY RESULTS

Of 156 PGY2 residents, 86 (55%) completed the survey. More residents in the "un-coached" cohort reported burnout (69%) than the "coached" cohort (51%). Burnout was significantly and negatively associated (F = 3.97 (df 7, 75); p < .001) with the learning and professional development outcomes, while being coached was significantly and positively associated with those outcomes (F = 5.54 (df 9, 75); p < .001). Significant interaction effects were found for goal-setting attitudes, professional fulfillment, and perceived program career support such that the positive differences in these outcomes between coached and un-coached residents were greater among burned out residents. Coached residents reported a positive impact of coaching across many domains.

CONCLUSIONS

Residents experiencing coaching reported better professional fulfillment and development outcomes, with more pronounced differences in trainees experiencing burnout. Coaching is a promising tool to support a fraught professional transition.

An Experiential Approach to Training Medical Faculty to Coach: "The Total Experience was Much More Than the Sum of Its Parts"

Coaching in academic medicine may be used for performance improvement as well as personal and professional growth and development. Medical faculty used to advising and mentoring learners may find it challenging to transition to coaching. Limited information is available about educating physicians to take on the role of coaching. We investigated a faculty coach training program at an academic medical center, using qualitative methods to explore how participants' perceptions of the training aligned with the elements of Self-Determination Theory (SDT) and Intentional Change Theory (ICT) that were taught using the principles of Experiential Learning Theory (ELT). Based on findings that illuminated understanding and practice of coaching, it may be summarized that the application of experiential learning may be an effective approach in helping faculty embrace the principles of SDT and ICT and make the shift to transformational coaching.

Medical students', residents', and nurses's feedback to clinical educators in Taiwan: A qualitative study

BACKGROUND

Feedback is a crucial element in learning. While studies in the field of healthcare professions education have highlighted the process of educators feeding back to learners, relatively little investigation exists on learners feeding back to educators in Asian cultures. Studies show that recipients of effective feedback develop educational skills and reflective practice, but the process of giving feedback seems to have been mainly studied through surveys and questionnaires. Such research offers little to no insights on feedback providers' and recipients' experiences of feedback. To fill the gap, in the context of multi-source feedback, we investigate medical students, residents, and nurses feedback giving to clinical educators (and their receiving of this) following a case presentation training course. We aim to understand the facilitators and inhibitors that encourage and/or prevent feedback provision alongside educators' uptake and reactions.

METHODS

We used semi-structured group interviews. Participants comprised five different categories of participants: year-4 medical students (n = 6); residents (n = 5); nurses (n = 4); junior clinical educators (n = 9); senior clinical educators (n = 3). We asked them about their experiences of providing feedback to educators and educators receiving of feedback on their teaching. Group interviews were conducted in the largest healthcare institution in Taiwan. Data were analysed using thematic Framework Analysis and managed in ATLAS.ti 8.0.

RESULTS

We identified two major themes with respective sub-themes: (1) Factors affecting feedback giving (including desire for improvement, feedback content, process of feedback, feedback fears, feedback prevention and medical hierarchy); and (2) Educators' reactions to receiving feedback (including validity of feedback, face-saving and emotional reactions to receiving feedback).

CONCLUSIONS

Feedback provision to educators on their teaching, and educators' receiving of this feedback in an Asian culture brings forth issues around medical hierarchy, in-person feedback and face-saving, which have important implications for effective and optimal delivery of feedback. Curricular developers should consider the context of feedback (e.g. anonymously online), facilitating students as active participants for the development of educational quality, and educators' mindful practice when engaging with student feedback.

A retrospective feedback analysis of objective structured clinical examination performance of undergraduate medical students

Introduction

Feedback is an essential component of medical education, enhancing the quality of students' knowledge and skills. However, providing effective feedback, particularly in clinical skills assessments like Objective Structured Clinical Examinations [OSCEs], often poses challenges. This study aimed to evaluate the content of OSCE feedback given to undergraduate medical students over five years.

Methods

A retrospective analysis of 1034 anonymised medical students' OSCE performance was conducted, focusing on written feedback. The written feedback data were randomly selected from OSCE sessions, collected from university assessment records and anonymised for ethical considerations. R software was used to identify the most frequently repeated words in the examiners' feedback text, and word cloud charts were created to visualise the responses.

Results

Word clouds generated from the top 200 most frequently used terms provided visual insights into common descriptive words in feedback comments. The most frequently repeated word over five years was "good," indicative of potentially non-specific feedback.

Discussion

The high frequency of non-specific terms like "good" suggests a need for more specific, constructive feedback. However, such generic terms can offer some positive reinforcement, more than they may be needed to foster significant improvement. As previously proposed in the literature, adopting structured feedback forms may facilitate the delivery of more specific, actionable feedback.

Conclusion

This study emphasises the importance of providing specific, actionable feedback in medical education to facilitate meaningful student development. As medical education continues to evolve, refining feedback processes is crucial for effectively guiding students' growth and skill enhancement. Using structured feedback forms can be a beneficial strategy for improving feedback quality.

Dual Coaching of Medical Clerkship Students' History Taking Skills by Volunteer Inpatients at the Bedside and Faculty Physicians on Zoom During the COVID-19 Pandemic

Purpose

Coaching is a well-described means of providing real-time, actionable feedback to learners. We aimed to determine whether dual coaching from faculty physicians and real inpatients led to an improvement in history-taking skills of clerkship medical students.

Patients and Methods

Expert faculty physicians (on Zoom) directly observed 13 clerkship medical students as they obtained a history from 26 real, hospitalized inpatients (in person), after which students received immediate feedback from both the physician and the patient. De-identified audio-video recordings of all interviews were scored by independent judges using a previously validated clinical rating tool to assess for improvement in history-taking skills between the two interviews. Finally, all participants completed a survey with Likert scale questions and free-text prompts.

Results

Students' history-taking skills - specifically in the domains of communication, medical knowledge and professional conduct - on the validated rating tool, as evaluated by the independent judges, did not significantly improve between their first and second patient interviews. However, students rated the dual coaching as overwhelmingly positive (average score of 1.43, with 1 being Excellent and 5 being Poor), with many appreciating the specificity and timeliness of the feedback. Patients also rated the experience very highly (average score of 1.23, with 1 being Excellent and 5 being Poor), noting that they gained new insights into medical training.

Conclusion

Students value receiving immediate and specific feedback and real patients enjoy participating in the feedback process. Dual physician-patient coaching is a unique way to incorporate more direct observation into undergraduate medical education curricula.

'It's more like checking in with an old friend': A qualitative study of medical students' experiences with longitudinal coaches throughout medical school

PURPOSE

Coaching in medical education facilitates learners' growth and development through feedback, goal-setting and support. This study explored how coaching relationships evolve throughout medical school and the impact of longitudinal coaching relationships on medical students' approach to feedback and goal setting in the clinical years.

METHOD

In this qualitative study using a constructivist paradigm, authors purposively sampled 15 senior medical students at University of California, San Francisco, to participate in individual semi-structured interviews (October-November 2021). The authors used an inductive approach to thematic analysis.

RESULTS

The authors identified four themes: First, the student-coach relationship deepened over the course of medical school. Second, students identified factors that sustained and strengthened the student-coach relationship over time: a strong foundation to the relationship, the non-evaluative nature of the relationship, coach supportiveness and responsiveness, and coach knowledge of the institutional landscape. Third, coaches provided individualized advice, assessed trajectory, and guided feedback interpretation. Lastly, students applied skills of soliciting and responding to feedback and creating learning goals, originally learned through coaching experience.

CONCLUSIONS

Coaching relationships, grounded in trust, evolve to meet students' changing needs as they grow into physicians. Students apply feedback and goal-setting skills learned with the coach in clinical settings with other supervisors.

Translation and psychometric evaluation of composite feedback-seeking behavior questionnaire among Iranian medical residents

BACKGROUND

Proactively seeking feedback from clinical supervisors, peers or other healthcare professionals is a valuable mechanism for residents to obtain useful information about and improve their performance in clinical settings. Given the scant studies investigating the limited aspects of psychometrics properties of the feedback-seeking instruments in medical education, this study aimed to translate the feedback-seeking behavior scales (frequency of feedback-seeking, motives of feedback-seeking, and promotion of feedback-seeking by supervisors) into Persian and evaluate the psychometric properties of the composite questionnaire among medical residents at Tehran University of Medical Sciences in Iran.

METHODS

In this cross-sectional study, feedback-seeking behavior scales were translated through the forward-backward method, and its face validity and content validity were assessed by 10 medical residents and 18 experts. The test-retest reliability was evaluated by administering the questionnaire to 20 medical residents on two testing occasions. A convenience sample of 548 residents completed the questionnaire. Construct validity was examined by exploratory factor analysis and confirmatory factor analysis and concurrent validity was determined by Pearson's correlation coefficient.

RESULTS

Content validity assessment showed that the CVR (0.66 to 0.99) and CVI (0.82 to 0.99) values for items and S-CVI values (0.88 to 0.99) for scales were satisfactory. The exploratory and confirmatory factor analysis demonstrated that the models were confirmed with eight items and two factors (explaining 70.98% of the total variance) for the frequency of feedback-seeking scale, with 16 items and four factors (explaining 73.22% of the total variance) for the motives of feedback seeking scale and with four items and one factor (explaining 69.46% of the total variance) for promotion of feedback-seeking by supervisors. AVE values greater than 0.5 and discriminant validity correlations significantly less than 1.0 demonstrated that the total scores of the composite feedback-seeking behavior questionnaire had a favorable fit and the questions could fit their respective factors, and the latent variables were distinct. We found positive and significant correlations between the three scales and their subscales.

CONCLUSION

The results of the present study supported the validity and reliability of the Persian composite feedback-seeking behavior questionnaire for assessing feedback-seeking behaviors in medical residents. Applying the questionnaire in residency programs may enhance the quality of clinical education.

Competencies for Those Who Coach Physicians: A Modified Delphi Study

The rapidly evolving coaching profession has permeated the health care industry and is gaining ground as a viable solution for addressing physician burnout, turnover, and leadership crises that plague the industry. Although various coach credentialing bodies are established, the profession has no standardized competencies for physician coaching as a specialty practice area, creating a market of aspiring coaches with varying degrees of expertise. To address this gap, we employed a modified Delphi approach to arrive at expert consensus on competencies necessary for coaching physicians and physician leaders. Informed by the National Board of Medical Examiners' practice of rapid blueprinting, a group of 11 expert physician coaches generated an initial list of key thematic areas and specific competencies within them. The competency document was then distributed for agreement rating and comment to over 100 stakeholders involved in physician coaching. Our consensus threshold was defined at 70% agreement, and actual responses ranged from 80.5% to 95.6% agreement. Comments were discussed and addressed by 3 members of the original group, resulting in a final model of 129 specific competencies in the following areas: (1) physician-specific coaching, (2) understanding physician and health care context, culture, and career span, (3) coaching theory and science, (4) diversity, equity, inclusion, and other social dynamics, (5) well-being and burnout, and (6) physician leadership. This consensus on physician coaching competencies represents a critical step toward establishing standards that inform coach education, training, and certification programs, as well as guide the selection of coaches and evaluation of coaching in health care settings.

Identity influences on medical students' orientation to feedback during third year clinical rotations

Medical students' feedback orientation (their attitudes about and preferences for feedback from preceptors) may change over the course of the third year of medical school and is likely influenced by identity-related factors. This study proposed that both how students view themselves personally (i.e., impostor syndrome) and how they view themselves in relation to the group (i.e., identification with the profession) are identity factors related to related to feedback orientation during clinical rotations. 177 third-year medical students enrolled in a four-phase longitudinal survey study beginning at the start of clinical rotations and continuing every twelve weeks of the academic year thereafter. Feedback orientation was conceptualized and measured as comprising aspects of utility (i.e., feedback is valuable and useful), sensitivity (i.e., feeling intimidated or threatened by corrective feedback), confidentiality (i.e., public/private context of feedback), and retention (i.e., feedback remembered). Results indicated that these aspects of feedback orientation did not significantly change during the third year. Instead, impostor syndrome was at least marginally, significantly associated with all aspects of feedback orientation across phases. Group identity was associated with feedback utility and retention, and female-identifying students reported significantly greater feedback confidentiality and feedback retention. Interventions may be needed to improve medical students' attitudes about feedback, particularly for those who experience impostor syndrome. Fostering group cohesion among medical students may influence how well students remember feedback and find it useful.

Beware False Growth Mindset: Building Growth Mindset in Medical Education Is Essential but Complicated

ABSTRACT

Mindset theory aims to explain how learners' beliefs about intelligence and learning affect how they perceive effort, react to failure, and respond to feedback in challenging learning contexts. Mindset theory distinguishes between growth mindset (the belief that human capacities can be developed over time) and fixed mindset (the belief that human capacities are inherent and unchangeable). Efforts to develop growth mindset in learners have shown a wide range of benefits, including positive effects on students' resilience, commitment to lifelong learning, and persistence in a field of study, with notable impacts on learners who are struggling, learners from minoritized groups, and women in scientific fields. In recent years, mindset theory interventions have caught the interest of medical educators hoping to engage learners as partners in their own learning and progression to competence. Educators hoping to apply this theory to educational programs and learner-teacher interactions in ways that promote growth mindsets would benefit from awareness of the concept of false growth mindset , a term coined by Carol Dweck to refer to common pitfalls in the theory's application. In this article, the authors highlight important findings from mindset interventions in medical education, identify common pitfalls of false growth mindset in the context of medical learners, and offer suggestions for how educators and institutions can better instigate changes to promote growth mindsets within medical education.

Career coach preferences of medical students: coaching specialist or specialistic coach?

BACKGROUND

Medical students' demand for career coaching is growing. However, little is known about what type of career coach they prefer. Using the Warmth-Competence Framework, we investigated if and why medical students prefer physician coaches compared to career psychologist coaches. We also examined whether students' coach choice related to coaches' amount of experience with medical students.

METHODS

In a two-by-two between participants vignette study (n = 147), we manipulated coach occupational background (physician vs. psychologist) and experience with coaching medical students (limited vs. considerable). Participants read one coach description, rated the likelihood that they would choose the coach, and rated the coach on dimensions of warmth and competence.

RESULTS

Students who evaluated a physician career coach were more likely to choose the coach than students who evaluated a psychologist career coach. Students expected that a physician career coach would better understand their situation and be better able to provide career information, while they expected a psychologist career coach to have better conversation skills, all of which were relevant to choosing a coach. Coaches' experience with coaching medical students was unrelated to students' coach choice and their assessment of the coach's warmth and competence.

CONCLUSIONS

Our findings highlight the relevance of coaches' occupational background and have implications for the implementation of career coach interventions. Medical schools could help students choose a career coach by providing information about the coach qualities that students value. Future studies could investigate whether career coaches with different occupational backgrounds differ in coach behaviors and coaching effectiveness.

Undergraduate Learners' Receptiveness to Feedback in Medical Schools: A Scoping Review

Feedback from educators to learners is considered an important element of effective learning in medical school. While early studies were focused on the processes of providing feedback, recent work has showed that factors related to how learners receive feedback seems to be equally important. Considering that the literature on this topic is new in medical education, and studies are diverse and methodologically variable, we sought to conduct a scoping review to map the articles on receptiveness to feedback, to provide an overview of its related factors, to identify the types of research conducted in this area, and to document knowledge gaps in the existing literature. Using the Joanna Briggs Institute scoping review methodology, we searched four databases (CINAHL, Ovid, PubMed, and Web of Science) and screened 9120 abstracts, resulting in 98 articles for our final analysis. In this sample, 80% of studies on the feedback receiver were published in the last 10 years, and there is a vast variation in the studies' methodologies. The main factors that affect medical students' receptiveness to feedback are students' characteristics, feedback content, educators' credibility, and the learning environment. Feedback literacy is a very recent and rarely used term in medical education; therefore, an important area for further investigation. Lastly, we identified some gaps in the literature that might guide future research, such as studying receptiveness to feedback based on academic seniority and feedback literacy's long-term impacts on learning.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-023-01858-0.

"It's All About the Trust And Building A Foundation:" Evaluation of a Longitudinal Medical Student Coaching Program

Coaching is increasingly implemented in medical education to support learners' growth, learning, and wellbeing. Data demonstrating the impact of longitudinal coaching programs are needed.

We developed and evaluated a comprehensive longitudinal medical student coaching program designed to achieve three aims for students: fostering personal and professional development, advancing physician skills with a growth mindset, and promoting student wellbeing and belonging within an inclusive learning community. We also sought to advance coaches' development as faculty through satisfying education roles with structured training. Students meet with coaches weekly for the first 17 months of medical school for patient care and health systems skills learning, and at least twice yearly throughout the remainder of medical school for individual progress and planning meetings and small-group discussions about professional identity. Using the developmental evaluation framework, we iteratively evaluated the program over the first five years of implementation with multiple quantitative and qualitative measures of students' and coaches' experiences related to the three aims.

The University of California, San Francisco, School of Medicine, developed a longitudinal coaching program in 2016 for medical students alongside reform of the four-year curriculum. The coaching program addressed unmet student needs for a longitudinal, non-evaluative relationship with a coach to support their development, shape their approach to learning, and promote belonging and community.

In surveys and focus groups, students reported high satisfaction with coaching in measures of the three program aims. They appreciated coaches' availability and guidance for the range of academic, personal, career, and other questions they had throughout medical school. Students endorsed the value of a longitudinal relationship and coaches' ability to meet their changing needs over time. Students rated coaches' teaching of foundational clinical skills highly. Students observed coaches learning some clinical skills with them - skills outside a coach's daily practice. Students also raised some concerns about variability among coaches. Attention to wellbeing and belonging to a learning community were program highlights for students. Coaches benefited from relationships with students and other coaches and welcomed the professional development to equip them to support all student needs.

Students perceive that a comprehensive medical student coaching program can achieve aims to promote their development and provide support. Within a non-evaluative longitudinal coach relationship, students build skills in driving their own learning and improvement. Coaches experience a satisfying yet challenging role. Ongoing faculty development within a coach community and funding for the role seem essential for coaches to fulfill their responsibilities.

It Takes a Village: Optimal Graduate Medical Education Requires a Deliberately Developmental Organization

Coaching is proposed as a means of improving the learning culture of medicine. By fostering trusting teacher-learner relationships, learners are encouraged to embrace feedback and make the most of failure. This paper posits that a cultural shift is necessary to fully harness the potential of coaching in graduate medical education. We introduce the deliberately developmental organization framework, a conceptual model focusing on three core dimensions: developmental communities, developmental aspirations, and developmental practices. These dimensions broaden the scope of coaching interactions. Implementing this organizational change within graduate medical education might be challenging, yet we argue that embracing deliberately developmental principles can embed coaching into everyday interactions and foster a culture in which discussing failure to maximize learning becomes acceptable. By applying the dimensions of developmental communities, aspirations, and practices, we present a six-principle roadmap towards transforming graduate medical education training programs into deliberately developmental organizations.

Student Perceptions of Effective Simulation Instructor Teaching

SUMMARY STATEMENT

Twenty-three focus groups were held with 183 first-year medical students to assess student perceptions of effective simulation instructors during preclinical training in a medical school. Qualitative descriptive analysis guided the interpretation of focus group data. Students identified 6 areas of knowledge (schedule, student learning goals, session scenario, tasks and checklists, technique, and session purpose); 5 effective instructor skill categories (setting up the learning environment, teaching at the appropriate level, teaching technique, providing deeper context, and giving effective feedback); and 8 positive instructor attributes (enthusiasm, engaged, prepared, knowledgeable, patient, relational, transparent, and calm) instructors should have. Each category of instructor attributes, skills, and knowledge was also described in detail providing illustrative examples of what effective instruction would look like in practice from the students' perspective. Recommendations for instructor faculty development methods and topics/goals are given.

Intervening on impostor phenomenon: prospective evaluation of a workshop for health science students using a mixed-method design

BACKGROUND

Unaddressed impostor feelings that impede developing interest in science and self-efficacy in conducting research have a dispiriting effect that perpetuates unsatisfactory diversity in the health science workforce when such feelings are experienced more by those historically underrepresented in the workforce. This warrants effective interventions to reduce the impact of impostor feelings and related factors that diminish career resilience. We examined the effects of a 90-minute workshop on impostor perceptions and growth mindset to raise awareness of impostor phenomenon (IP) and develop skills to manage IP successfully for students attending a 10-week summer research experience program.

METHODS

Using a convergent mixed-methods design, data were analyzed from 51 racially and ethnically diverse students who participated in an interactive IP workshop. Using students' half-way and final progress reports about their summer experiences and pre- and post-summer online surveys, we identified how the workshop changed awareness of IP and helped students develop coping strategies.

RESULTS

Students strongly endorsed the workshop, remarking that its content and personal stories from peers validated their own IP experiences and relieved anxiety by revealing how common the experience was. Many reported applying mindset-changing solutions, including positive self-talk, focusing their thinking on facts about themselves and situation, and grounding themselves firmly against potentially persuasive and confidence-eroding impostor feelings. While students reported end-of-summer impostor feelings at levels similar to before the program, they described being able to manage their feelings better and persist towards goals and challenging tasks. One measure of IP appeared to be addressed through students' activation of a growth mindset, potentially explaining a specific mechanism for intervention. Discrepancies between qualitative responses and quantitative IP measures demand additional work on IP instruments.

CONCLUSIONS

A brief, theory-based IP workshop administered by research training programs, including those as short as 10-weeks, can have positive impact on subsequent IP experience and its successful management, with potential long-term impact on retention of a diverse biomedical research workforce.

Developing a feedback-rich culture in academic medicine: the effect of coaching and 360-feedback on physician leadership

BACKGROUND

This is a time of unprecedented change in healthcare. More physicians are being tasked with stepping into a variety of leadership roles without having received the training needed to be an effective leader. Previous data have demonstrated the effectiveness of both leadership coaching and 360-feedback tools to foster physician well-being and leadership growth. In this proof of concept study, we explore the combined effect of these two tools. The objective of this study was to examine the effect of a brief physician 360 leadership coaching intervention on perception of professional dynamics and acquired leadership skills.

METHODS

Participants completed a tailored 360-feedback tool to gather input on their leadership skills, then engaged in five bi-weekly leadership coaching sessions. We conducted a post-intervention semi-structured qualitative interview. Qualitative data were coded using an inductive thematic analysis approach.

RESULTS

Twenty-three primary care physicians at an academic medical center engaged in the 360 leadership coaching study. Participants reported that the intervention yielded valuable benefits in five coaching sessions. Two overarching themes emerged: a Shift in leadership awareness and Navigating their environment. Leadership awareness included increased clarity of purpose and role, and recognition that routine feedback is critical to leadership development. Navigating their environment included gaining relationship-building communication, organizational awareness and navigation strategies.

CONCLUSIONS

Combining a tailored 360-feedback tool with a five-session leadership coaching intervention provided physicians with valued support infrastructure for becoming more effective leaders. Physicians described a nuanced understanding of the leadership challenges physicians face, and identified the leadership tools needed to navigate the evolving healthcare delivery landscape. Curricula for physician leadership learning could consider this combination of a customized 360 plus targeted leadership coaching for training physician leaders.

A qualitative study of medical students' perceptions of resident feedback

CONTEXT

Residents play a pivotal role in medical students' clinical education. From a feedback lens, the near-peer relationship between student and resident holds the potential to foster an educational alliance that could influence learning. We undertook the current qualitative study to explore medical students' perceptions of feedback experiences with residents, addressing when, how and why (and conversely when not and why not) resident feedback plays a role in their clinical education.

METHODS

Our methodology was qualitative interpretive description, informed by phenomenology. We conducted 24 semi-structured interviews with third and fourth year medical students at one institution. The interviews aimed to foster rich discussion about students' feedback experiences with residents during clinical rotations. Data collection and analysis proceeded iteratively. Initial interviews were independently open-coded by three investigators and then collaboratively refined. Codes were applied to subsequent interviews, and new codes were developed. During the final stages of analysis, we organised our themes by drawing on a sociocultural perspective to examine students' perceptions of relationship-building with residents and when and how this influenced feedback and learning.

RESULTS

From the students' perspectives, when residents contributed to building interpersonal relationships with students, this in turn influenced students' receptivity to both encouraging and constructive feedback conversations. In the context of resident-student relationships that were perceived as supportive, resident feedback influenced how students approached learning and working in the clinical environment, as well as students' visions of their future selves. In unsupportive relationships, students were less inclined to engage in feedback with residents and students noted resident behaviours that they wanted to avoid in themselves.

CONCLUSION

Residents are uniquely positioned to create a strong educational alliance with students in which feedback conversations can flourish. Focusing educational efforts on resident feedback conversations has the potential to significantly impact the feedback culture of our clinical environments.

Beyond Checking Boxes: Exploring Tensions With Use of a Workplace-Based Assessment Tool for Formative Assessment in Clerkships

PURPOSE

To understand the role of a workplace-based assessment (WBA) tool in facilitating feedback for medical students, this study explored changes and tensions in a clerkship feedback activity system through the lens of cultural historical activity theory (CHAT) over 2 years of tool implementation.

METHOD

This qualitative study uses CHAT to explore WBA use in core clerkships by identifying feedback activity system elements (e.g., community, tools, rules, objects) and tensions among these elements. University of California, San Francisco core clerkship students were invited to participate in semistructured interviews eliciting experience with a WBA tool intended to enhance direct observation and feedback in year 1 (2019) and year 2 (2020) of implementation. In year 1, the WBA tool required supervisor completion in the school's evaluation system on a computer. In year 2, both students and supervisors had WBA completion abilities and could access the form via a smartphone separate from the school's evaluation system.

RESULTS

Thirty-five students participated in interviews. The authors identified tensions that shifted with time and tool iterations. Year 1 students described tensions related to cumbersome tool design, fear of burdening supervisors, confusion over WBA purpose, WBA as checking boxes, and WBA usefulness depending on clerkship context and culture. Students perceived dissatisfaction with the year 1 tool version among peers and supervisors. The year 2 mobile-based tool and student completion capabilities helped to reduce many of the tensions noted in year 1. Students expressed wider WBA acceptance among peers and supervisors in year 2 and reported understanding WBA to be for low-stakes feedback, thereby supporting formative assessment for learning.

CONCLUSIONS

Using CHAT to explore changes in a feedback activity system with WBA tool iterations revealed elements important to WBA implementation, including designing technology for tool efficiency and affording students autonomy to document feedback with WBAs.

Affecting Change: Enhancing Feedback Interactions with Radiology Trainees

Feedback is a critical part of the learning process and is a valuable tool to empower adult learners. Modern feedback theory places the learner at the center of the feedback encounter. Individual and institutional barriers to effective giving and receiving of feedback can be overcome through education and attention to the form and content of feedback. We review the elements of effective feedback and address issues of framing, environmental, and social factors which aid in providing psychological safety and trust, as necessary elements to create a culture of feedback in radiology training programs. We provide practical strategies to empower learners with the necessary skills to solicit, receive, and reflect on feedback.

Emotion as reflexive practice: A new discourse for feedback practice and research

INTRODUCTION

Like medicine and health care, feedback is a practice imbued with emotions: saturated with feelings relevant to one's identity and status within a given context. Often this emotional dimension of feedback is cast as an impediment to be ignored or managed. Such a perspective can be detrimental to feedback practices as emotions are fundamentally entwined with learning. In this critical review, we ask: What are the discourses of emotion in the feedback literature and what 'work' do they do?

METHODS

We conducted a critical literature review of emotion and feedback in the three top journals of the field: Academic Medicine, Medical Education and Advances in Health Sciences Education. Analysis was informed by a Foucauldian critical discourse approach and involved identifying discourses of emotion and interpreting how they shape feedback practices.

FINDINGS

Of 32 papers, four overlapping discourses of emotion were identified. Emotion as physiological casts emotion as internal, biological, ever-present, immutable and often problematic. Emotion as skill positions emotion as internal, mainly cognitive and amenable to regulation. A discourse of emotion as reflexive practice infers a social and interpersonal understanding of emotions, whereas emotion as socio-cultural discourse extends the reflexive practice discourse seeing emotion as circulating within learning environments as a political force.

DISCUSSION

Drawing on scholarship within the sociology of emotions, we suggest the merits of studying emotion as inevitable (not pathological), as potentially paralysing and motivating and as situated within (and often reinforcing) a hierarchical social health care landscape. For future feedback research, we suggest shifting towards recognising the discourse-theory-practice connection with emotion in health professional education drawing from reflexive and socio-cultural discourses of emotion.

Medical residents and attending physicians’ perceptions of feedback and teaching in the United States: a qualitative study

PURPOSE

Residents and attendings agree on the importance of feedback to resident education. However, while faculty report providing frequent feedback, residents often do not perceive receiving it, particularly in the context of teaching. Given the nuanced differences between feedback and teaching, we aimed to explore resident and attending perceptions of feedback and teaching in the clinical setting.

METHODS

We conducted a qualitative study of internal medicine residents and attendings from December 2018 through March 2019 at the Massachusetts General Hospital to investigate perceptions of feedback in the inpatient clinical setting. Residents and faculty were recruited to participate in focus groups. Data were analyzed using thematic analysis to explore perspectives and barriers to feedback provision and identification.

RESULTS

Five focus groups included 33 total participants in 3 attending (n=20) and 2 resident (n=13) groups. Thematic analysis of focus group transcripts identified 7 themes which organized into 3 thematic categories: (1) disentangling feedback and teaching, (2) delivering high-quality feedback, and (3) experiencing feedback in the group setting. Residents and attendings highlighted important themes in discriminating feedback from teaching. They indicated that while feedback is reactive in response to an action or behavior, teaching is proactive and oriented toward future endeavors.

CONCLUSION

Confusion between the critical concepts of teaching and feedback may be minimized by allowing them to each have their intended impact, either in response to prior events or aimed toward those yet to take place.

Feedback Credibility in Healthcare Education: a Systematic Review and Synthesis

PURPOSE

The purpose of this study was to systematically review and synthesize factors that influence learners' perceptions of credibility when feedback is provided by an authority figure in a healthcare environment.

METHODS

This study reviewed literature from medicine, psychology, and education using systematic review and qualitative synthesis methods. In a multi-step process, major electronic bibliographic databases were searched for relevant studies until October 2020.

RESULTS

The search identified 9216 articles. A total of 134 abstracts underwent full-text review. Of these, 22 articles met inclusion criteria. The studies were heterogenous and the majority utilized a qualitative design with interviews and focus groups. A few studies employed mixed methodology (n = 2) and two studies used a quantitative design. Four main themes were identified: feedback characteristics, context of feedback, source credibility, and recipient characteristics.

CONCLUSION

As programs implement major educational change initiatives to create more formative assessment practices, feedback will become even more crucial. The four main themes identified are important factors that contribute to the perception of feedback credibility. While the factors are described independently, they may be viewed as interrelated and the association between these factors and feedback may be driven more by learning culture than each characteristic.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-020-01167-w.

Resident impression management within feedback conversations: A qualitative study

INTRODUCTION

Medical education is moving to conceptualise feedback as a bidirectional learning conversation. Within this conversation, learners experience a tension between assessment and feedback. That perceived tension affects learners' outward performances. In this study, we aimed to characterise residents' experiences with this tension and its effect on learner authenticity within feedback conversations.

METHODS

In this constructivist grounded theory study, the authors were informed by Goffman's theory of impression management. During data analysis, Dweck's theory of mindset was adopted. The authors conducted semi-structured interviews with 15 internal medicine residents. Data collection and analysis were conducted iteratively, using constant comparison to identify themes coinciding with impression management and mindset, ultimately developing a theoretical model to help explain residents' responses to tensions within feedback conversations.

RESULTS

Residents constantly felt 'scrutinized', and this affected their engagement in feedback conversations. They staged a performance within those conversations, linked to their underlying mindset: growth or fixed. Growth mindset was characterised by a focus on development as a physician and was associated with asking questions and seeking opportunities for growth. Fixed mindset was characterised by a focus on achieving a favourable evaluation and was associated with a hesitation to ask questions when faced with uncertainty and admit opportunities for growth, because they were concerned about impression management. Context influenced mindset and impression management. Residents adopted a fixed mindset and managed impressions when they perceived the permanence or consequences of evaluations within feedback. Residents adopted a growth mindset when they trusted the supervisor.

DISCUSSION

Residents assess the context of feedback conversations, altering the authenticity of their behaviours. Context, including the perceptions of formal assessment and relationships with supervisors, affected residents' mindset and impression management. Providing space for relationship-building and clarifying the purpose and structure of assessment may be helpful in supporting effective learning conversations in graduate medical education.

Trainee and Program Director Perspectives on Meaningful Patient Attribution and Clinical Outcomes Data

BACKGROUND

The Accreditation Council for Graduate Medical Education specifies that trainees must receive clinical outcomes and quality benchmark data at specific levels related to institutional patient populations. Program directors (PDs) are challenged to identify meaningful data and provide them in formats acceptable to trainees.

OBJECTIVE

We sought to understand what types of patients, data/metrics, and data delivery systems trainees and PDs prefer for supplying trainees with clinical outcomes data.

METHODS

Trainees (n = 21) and PDs (n = 12) from multiple specialties participated in focus groups during academic year 2017-2018. They described key themes for providing clinical outcomes data to trainees.

RESULTS

Trainees and PDs differed in how they identified patients for clinical outcomes data for trainees. Trainees were interested in encounters where they felt a sense of responsibility or had autonomy/independent decision-making opportunities, continuity, or learned something new; PDs used broader criteria including all patients cared for by their trainees. Both groups thought trainees should be given trainee-level metrics and consistently highlighted the importance of comparison to peers and/or benchmarks. Both groups found value in "push" and "pull" data systems, although trainees wanted both, while PDs wanted one or the other. Both groups agreed that trainees should review data with specific faculty. Trainees expressed concern about being judged based on their patients' clinical outcomes.

CONCLUSIONS

Trainee and PD perspectives on which patients they would like outcomes data for differed, but they overlapped for types of metrics, formats, and review processes for the data.