Challenging feedback myths: Values, learner involvement and promoting effects beyond the immediate task

Navigating discourses of feedback: developing a pattern system of feedback

Although feedback is often presented as if it were a well-understood concept in health professions education, in practice it can mean many things. For some, feedback is a conversation about defining and improving performance, while for others it is the information generated by assessments and tools. Indeed, feedback has variously been defined as a process, as data, as a conversation, and as a reflective exercise. As a result, for a concept so central to what educators do, 'feedback' is ambiguous and has multiple meanings. Pattern theory affords opportunities to examine what scholars and practitioners mean when they use the term 'feedback'. Elaborating feedback as a pattern system can connect otherwise disjointed discourses of feedback. In this paper, the authors describe the development of a pattern system of feedback in medical education. Arksey & O'Malley's 5-stages of scoping reviews were adapted to enact a 6-step pattern system development methodology that included (1) Identifying the research question and scope of inquiry; (2) elaborating a strategy for pattern identification; (3) study selection; (4) abductive pattern representation development; (5) pattern system testing; and (6) summarizing and reporting the results. A pattern system of feedback was developed based on review of 218 full text articles and testing against an additional 2833 citations. This pattern system is made up of 36 pattern representations organized under 6 domains: feedback referent, feedback intentions, feedback information, feedback processing, feedback response, and feedback meta. The pattern system was applied to two models of feedback to demonstrate its utility as a lens through which to analyze various instances of feedback and to foreshadow its potential broader applicability as a tool to facilitate knowledge synthesis in the feedback problem space.

Best Practices in Formative Feedback in Resident Evaluations: A Narrative Review

BACKGROUND

Formative feedback is essential for the optimal development of a physician. The narrative portion of the evaluation is uniquely poised to help guide the resident. However, the quality of the feedback may be highly variable, and evaluators may be hampered by both a lack of formal training as well as time pressures.

OBJECTIVE

To determine best practices in providing narrative feedback for residents.

METHODS

We conducted a narrative review of the literature around formative feedback in residency using a Pubmed search of articles written in English over the 30 year span 1993-2023.

RESULTS

Several themes were identified. Comments should be specific, both to the task and to the individual. Commentary should also be actionable, rather than a statement of what cannot be changed by the learner. Ideally, the narration should be constructive, and strike the proper tone. There are additional operational items, such as the structure of the evaluation form itself, that may help optimize narrative commentary.

CONCLUSIONS

There is limited but compelling evidence that narrative commentary can be improved in educational value by being specific, actionable, constructive, and written with the proper tone. Changes in the evaluation form may optimize quality and improve timing of delivery.

Feedback, learning and becoming: Narratives of feedback in complex performance challenges

INTRODUCTION

Becoming a general practitioner (or family medicine specialist) is challenging, as trainees learn to manage complex and ambiguous situations. Feedback is a key component of this learning. Although research has tended to focus on feedback's momentary processes and impacts, there is value in seeking to understand the work it does over time and how trainees position themselves across multiple feedback encounters. We ask: how do newly qualified GPs narrate themselves and their experiences with complex performance challenges? Within these narratives, what is the role of feedback?

METHODS

The research adopts a holistic and sequential narrative analysis approach, with in-depth narrative interviews of 16 general practice trainees who had just completed their training requirements. The analysis involved restorying the participant narratives chronologically. Each narrative formed a unit of analysis where narrative commonalities across plots, characters, emotions and the role of feedback were interpreted.

RESULTS

Four plotlines within GP trainees' stories of complex performance challenges were identified: Journeyperson, Hero's Quest, Solo Journeyer and Endless Struggle. Trainees, supervisors and feedback are positioned differently within these plotlines. Narratives were saturated with emotions.

DISCUSSION

The plotlines bring together an alternative way of understanding how feedback, learning and becoming are woven together. They illustrate how multiple interactions with patients, supervisors, peers and systems thread together into an overall trajectory. How a trainee positions themselves as protagonists and who they characterise as their antagonists can help direct the focus of supervisors' feedback conversations.

Nurses' Perceptions of the Relevance of Their Role and Responsibilities for Adopting Evidence-Based Feedback Into Practice: An Implementation Study

AIMS

To evaluate the implementation process of a novel program focused on improving interactive (dialogic) feedback between clinicians and students during placement.

DESIGN

Quantitative cross-sectional hybrid type 3 effectiveness-implementation study driven by a federated model of social learning theory and implementation theory.

METHODS

From June to November 2018, feedback approaches supported by socio-constructive learning theory and Normalisation Process Theory were enacted in four clinical units of a healthcare facility in southeast Queensland, Australia. The study involved 16 clinical instructors/supervisors, 94 bedside nurses, and 85 final-year nursing students. Engagement was evaluated using the Normalisation Measure Development survey. Situated learning encounters were constructed based on the needs of each group.

RESULTS

Survey results of the four Normalisation Process Theory constructs identified variable adoption by participant groups. Engagement in situated learning encounters that facilitate dialogic feedback was greatest in clinical instructors/supervisors, followed by students. Bedside registered nurses, while indicating they understood purposeful feedback behaviours, did not demonstrate them in practice.

CONCLUSION

The extent to which each group practiced dialogic feedback depended on their perceptions of their influence, whether they saw it as part of their role, and the effort and time required, regardless of the activity's importance, role statements, and codes of conduct.

IMPLICATIONS FOR THE PROFESSION

Understanding the norms that shape communication, engagement, and nurses' role priorities is crucial for guiding practice and ongoing engagement with feedback.

IMPACT

The research provides valuable insights for leaders aiming to enhance the integration of evidence into practice. It guides leaders to understand that participants prioritise the reach, relevance, and resources of evidence over formal role descriptions, responsibilities, policies, and codes of conduct. This research encourages leaders to scrutinise existing beliefs, norms, and routines when implementing evidence-based practices.

REPORTING METHOD

Standards for Reporting Implementation Studies (StaRI) reporting guidelines were used.

NO PATIENT OR PUBLIC CONTRIBUTION

None.

"I Think Many of Them Want to Appear to Have a Growth Mindset": Exploring Supervisors' Perceptions of Feedback-Seeking Behavior

PURPOSE

Feedback seeking is an expected learner competency. Motivations to seek feedback are well explored, but we know little about how supervisors perceive such requests for feedback. These perceptions matter because how supervisors judge requests can affect the feedback they give. This study explores how supervisors perceive and attribute motivations behind feedback requests to better understand the benefits and hazards of feedback seeking.

METHOD

Constructivist grounded theory was used to interview supervisors at the Temerty Faculty of Medicine, University of Toronto, from February 2020 to September 2022. Supervisors were asked to describe instances when they perceived feedback requests as being sincere or insincere, what led to their opinions, and how they responded. Transcripts were analyzed and coded in parallel with data collection; data analysis was guided by constant comparison.

RESULTS

Seventeen faculty were interviewed. Participants perceived 4 motivations when learners sought feedback: affirmation or praise; a desire to improve; an administrative requirement, such as getting forms filled out; and hidden purposes, such as making a good impression. These perceptions were based on assumptions regarding the framing of the initial request; timing; preexisting relationship with the learner; learner characteristics, such as insecurity; and learner reactions to feedback, particularly defensiveness. Although being asked for feedback was generally well received, some participants reported irritation at requests that were repetitive, were poorly timed, or did not appear sincere.

CONCLUSIONS

Feedback seeking may prompt supervisors to consider learners' motivations, potentially resulting in a set of entangled attributions, assumptions, and reactions that shape the feedback conversation in invisible and potentially problematic ways. Learners should consider these implications as they frame their feedback requests and be explicit about what they want and why they want it. Supervisors should monitor their responses, ask questions to clarify requests, and err on the side of assuming feedback-seeking requests are sincere.

International medical students' experiences of psychological safety in feedback episodes: a focused ethnographic study

BACKGROUND

Feedback and psychological safety are well-established concepts within medical education, vital for student learning and progress. However, the concepts remain unexplored in the context of international students. This area deserves attention given the unique challenges faced by the overseas medical students due to cultural differences. The present study examines international students' experiences of psychological safety in feedback interactions in a Scottish undergraduate medical programme.

METHODS

A focused ethnographic approach was adopted to explore international students' experiences and perceptions of psychological safety in their feedback experiences. Data were collected in the form of field observations and semi-structured interviews, involving both student and faculty participants. Approximately 13hrs of fieldwork and a total of 11 interviews were conducted. These were analysed using a combination of inductive and deductive thematic analysis.

RESULTS

Data analysis identified four key themes: feedback delivery, educator attributes, cultural factors and longitudinal educational relationships. Both staff and student participants highlighted how environmental factors such as room design and group size functioned as enablers or barriers to psychological safety in feedback episodes. Additionally, students appreciated tutors who expressed vulnerability and demonstrated awareness of their cultural backgrounds. Students described significant differences between the feedback approaches in the host (UK) institute and that in their home country. Longitudinal associations fostered trust and familiarity with peers and tutors, enhancing students' receptivity to learning and feedback.

CONCLUSION

This present study highlights cultural differences in feedback practices across countries and their impact on psychological safety among international students. It stresses the importance of integrating overseas students by considering group dynamics, environment and diverse student needs. Staff awareness of cultural variability, openness to tutor vulnerability and fostering long-term educational relationships can greatly enhance psychological safety in learning and teaching activities. These insights are relevant amidst the growing globalisation of medical education and the mobility of students across borders, advocating for tailored integration to optimise their learning experience and achievement.

Surgical Residents' Perception of Feedback on Their Education: Protocol for a Scoping Review

BACKGROUND

Feedback is an essential tool for learning and improving performance in any sphere of education, including training of resident physicians. The learner's perception of the feedback they receive is extremely relevant to their learning progress, which must aim at providing qualified care for patients. Studies pertinent to the matter differ substantially with respect to methodology, population, context, and objective, which makes it even more difficult to achieve a clear understanding of the topic. A scoping review on this theme will unequivocally enhance and organize what is already known.

OBJECTIVE

The aim of this study is to identify and map out data from studies that report surgical residents' perception of the feedback received during their education.

METHODS

The review will consider studies on the feedback perception of resident physicians of any surgical specialty and age group, attending any year of residency, regardless of the type of feedback given and the way the perceptions were measured. Primary studies published in English, Spanish, and Portuguese since 2017 will be considered. The search will be carried out in 6 databases and reference lists will also be searched for additional studies. Duplicates will be removed, and 2 independent reviewers will screen the selected studies' titles, abstracts, and full texts. Data extraction will be performed through a tool developed by the researchers. Descriptive statistics and qualitative analysis (content analysis) will be used to analyze the data. A summary of the results will be presented in the form of diagrams, narratives, and tables.

RESULTS

The findings of this scoping review were submitted to an indexed journal in July 2024, currently awaiting reviewer approval. The search was executed on March 15, 2024, and resulted in 588 articles. After the exclusion of the duplicate articles and those that did not meet the eligibility criteria as well as the inclusion of articles through a manual search, 13 articles were included in the review.

CONCLUSIONS

Conducting a scoping review is the best way to map what is known about a subject. By focusing on the feedback perception more than the feedback itself, the results of this study will surely contribute to gaining a deeper understanding of how to proceed to enhance internal feedback and surgical residents' learning progress.

TRIAL REGISTRATION

Open Science Framework yexb; https://osf.io/yexkb.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/56727.

Health simulation through the lens of self-determination theory - opportunities and pathways for discovery

Health simulation is broadly viewed as an appealing, impactful, and innovative enhancement for the education and assessment of health professions students and practitioners. We have seen exponential and global growth in programmes implementing simulation techniques and technologies. Alongside this enthusiasm and growth, the theoretical underpinnings that might guide the efficacy of the field have not always been considered. Many of the principles that guide simulation design, development and practice have been intuited through practical trial and error. In considering how to retrofit theory to practice, we have at our disposal existing theories that may assist with building our practice, expertise, identity as a community of practice, authority and legitimacy as a field. Self-determination theory (SDT) is an established and evolving theory that examines the quality of motivation and human behaviours. It has been applied to a variety of contexts and provides evidence that may support and enhance the practice of health simulation. In this paper, SDT is outlined, and avenues for examining the fit of theory to practice are suggested. Promising links exist between SDT and health simulation. Opportunities and new pathways of discovery await.

Feedback practices in undergraduate clinical teaching in Sri Lanka - a qualitative study

BACKGROUND

Feedback is integral to medical education, enabling students to improve their knowledge, skills, and attitudes. Feedback practices may vary according to prevalent cultural and contextual factors. This study aimed to explore how feedback is conceptualized and practised in the clinical education of medical students in Sri Lanka.

METHODS

The study was conducted in three medical schools and affiliated hospitals that represent the cultural diversity of Sri Lanka. Purposive sampling was utilized to recruit clinical teachers and students who would provide rich information for the study. The study had three components: an observation study, interviews with clinical teachers and focus group discussions with clinical students. During the observation study, video recording was used as a data collection tool to observe feedback in real-life clinical teaching/learning settings. A constructivist grounded theory approach was adapted for analysis to explore current practices and perceptions inductively.

RESULTS

Feedback was conceptualised as spontaneous unidirectional provision of information for the improvement of students. It was often provided in public settings and in student groups. Error correction was the primary focus of feedback, but both teachers and students desired a balanced approach with reinforcement and reflection. Although the direct approach to corrective feedback was found beneficial for student learning, participants agreed that harsh feedback was to be avoided. The hierarchical culture and lack of programmed feedback in the curricula influenced feedback practices, suggesting the need for modification.

CONCLUSIONS

This study highlighted feedback practices in the local context, emphasizing the need to address the hierarchical gap in clinical settings, balance reinforcement and correction, and promote dialogue and reflection in the feedback processes. The findings will help clinical teachers from both the global south as well as the global north to recognize cultural and contextual differences in providing feedback.

The writer's voice repertoire: Exploring how health researchers accomplish a distinctive 'voice' in their writing

INTRODUCTION

Much published research writing is dull and dry at best, impenetrable and off-putting at worst. This state of affairs both frustrates readers and impedes research uptake. Scientific conventions of objectivity and neutrality contribute to the problem, implying that 'good' research writing should have no discernible authorial 'voice'. Yet some research writers have a distinctive voice in their work that may contribute to their scholarly influence. In this study, we explore this notion of voice, examining what strong research writers aim for with their voice and what strategies they use.

METHODS

Using a combination of purposive, snowball and theoretical sampling, we recruited 21 scholars working in health professions education or adjacent health research fields, representing varied career stages, research paradigms and geographical locations. We interviewed participants about their approaches to writing and asked each to provide one to three illustrative publications. Iterative data collection and analysis followed constructivist grounded theory principles. We analysed interview transcripts thematically and examined publications for evidence of the writers' described approaches.

RESULTS

Participants shared goals of a voice that was clear and logical, and that engaged readers and held their attention. They accomplished these goals using approaches both conventional and unconventional. Conventional approaches included attention to coherence through signposting, symmetry and metacommentary. Unconventional approaches included using language that was evocative (metaphor, imagery), provocative (pointed critique), plainspoken ('non-academic' phrasing), playful (including humour) and lyrical (attending to cadence and sound). Unconventional elements were more prominent in non-standard genres (e.g. commentaries), but also appeared in empiric papers.

DISCUSSION

What readers interpret as 'voice' reflects strategic use of a repertoire of writing techniques. Conventional techniques, used expertly, can make for compelling reading, but strong writers also draw on unconventional strategies. A broadened writing repertoire might assist health professions education research writers in effectively communicating their work.

The feedback dilemma in medical education: insights from medical residents' perspectives

BACKGROUND

Feedback is a critical component of the learning process in a clinical setting. This study aims to explore medical residents' perspectives on feedback delivery and identify potential barriers to feedback-seeking in clinical training.

METHODS

This cross-sectional study involved 180 medical residents across seventeen specialties. We employed the validated Residency Education Feedback Level Evaluation in Clinical Training (REFLECT) tool to assess residents' perspectives on their attitude toward feedback, quality of feedback, perceived importance, and reaction to feedback. Additionally, we explored barriers to feedback-seeking behavior among medical residents.

RESULTS

The majority of medical residents held positive attitudes toward feedback. They agreed that feedback improves their clinical performance (77.7%), professional behavior (67.2%), and academic motivation (56.7%), while also influencing them to become a better specialist in their future career (72.8%). However, the study revealed critical deficiencies in the feedback process. Only 25.6% of residents reported receiving regular feedback and less than half reported that feedback was consistently delivered at suitable times and locations, was sufficiently clear or included actionable plans for improvement. A minority (32.2%) agreed that faculty had sufficient skills to deliver feedback effectively. Moreover, peer-to-peer feedback appeared to be a primary source of feedback among residents. Negative feedback, though necessary, often triggered feelings of stress, embarrassment, or humiliation. Notably, there were no significant differences in feedback perceptions among different specialties. The absence of a feedback-seeking culture emerged as a central barrier to feedback-seeking behavior in the clinical setting.

CONCLUSIONS

Establishing shared expectations and promoting a culture of feedback-seeking could bridge the gap between residents' perceptions and faculty feedback delivery. Furthermore, recognizing the role of senior and peer residents as valuable feedback sources can contribute to more effective feedback processes in clinical training, ultimately benefiting resident development and patient care.

The one cloud on a sunny day: Using emotional intelligence to manage emotions from negative written feedback

Physician trainees receive anonymous written feedback about their clinical performance, which can be challenging to interpret. Negative written feedback can evoke a strong emotional response. An educational gap exists on how to handle receiving negative written feedback and the accompanying emotions. Teaching trainees the tenets of emotional intelligence, including emotional self-awareness and self-management, could be an avenue to improve the experience of receiving feedback. Face-to-face coaching may also help improve the emotional experience of receiving written feedback.

Reduction of discrepancies between students and instructors in the assessment of practical tasks through structured evaluation sheets and peer feedback

The aim of this study was to reduce discrepancies between students and instructors in a preclinical dental course by employing structured peer feedback based on a detailed evaluation sheet. In a crossover study of dental students (n = 32), which compared peer feedback using an evaluation sheet (test) with the traditional method (control), participants completed tasks involving cavity and partial crown preparation. The practical tasks were scored numerically on a scale ranging from one (excellent) to six (failure). The amount of feedback provided by the instructor was also recorded. Statistical analysis was conducted using Wilcoxon signed-rank tests (p < 0.05). Regarding cavity preparation, no statistically significant difference was observed (median (25th-75th percentile)) between the grades received by the test (2.00 (1.50-3.00)) and control groups (2.25 (2.00-3.00)). However, the grades pertaining to partial crown preparation exhibited a statistically significant difference between the test (2.25 (2.00-2.50)) and control (2.50 (2.00-3.00)) groups. LimeSurvey and five-finger feedback were used to assess satisfaction with the new method, revealing that most students found the evaluation sheet and peer feedback to be effective. Within the limitations of this study, structured peer feedback using the evaluation sheet positively impacted grades pertaining to partial crown preparation, requiring less instructor feedback.

Undergraduate Learners' Receptiveness to Feedback in Medical Schools: A Scoping Review

Feedback from educators to learners is considered an important element of effective learning in medical school. While early studies were focused on the processes of providing feedback, recent work has showed that factors related to how learners receive feedback seems to be equally important. Considering that the literature on this topic is new in medical education, and studies are diverse and methodologically variable, we sought to conduct a scoping review to map the articles on receptiveness to feedback, to provide an overview of its related factors, to identify the types of research conducted in this area, and to document knowledge gaps in the existing literature. Using the Joanna Briggs Institute scoping review methodology, we searched four databases (CINAHL, Ovid, PubMed, and Web of Science) and screened 9120 abstracts, resulting in 98 articles for our final analysis. In this sample, 80% of studies on the feedback receiver were published in the last 10 years, and there is a vast variation in the studies' methodologies. The main factors that affect medical students' receptiveness to feedback are students' characteristics, feedback content, educators' credibility, and the learning environment. Feedback literacy is a very recent and rarely used term in medical education; therefore, an important area for further investigation. Lastly, we identified some gaps in the literature that might guide future research, such as studying receptiveness to feedback based on academic seniority and feedback literacy's long-term impacts on learning.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-023-01858-0.

If we assess, will they learn? Students' perspectives on the complexities of assessment-for-learning

Introduction

Assessment can positively influence learning, however designing effective assessment-for-learning interventions has proved challenging. We implemented a mandatory assessment-for-learning system comprising a workplace-based assessment of non-medical expert competencies and a progress test in undergraduate medical education and evaluated its impact.

Methods

We conducted semi-structured interviews with year-3 and 4 medical students at McGill University to explore how the assessment system had influenced their learning in year 3. We conducted theory-informed thematic analysis of the data.

Results

Eleven students participated, revealing that the assessment influenced learning through several mechanisms. Some required little student engagement (i.e., feed-up, test-enhanced learning, looking things up after an exam). Others required substantial engagement (e.g., studying for tests, selecting raters for quality feedback, using feedback). Student engagement was moderated by the perceived credibility of the system and of the costs and benefits of engagement. Credibility was shaped by students' goals-in-context: becoming a good doctor, contributing to the healthcare team, succeeding in assessments.

Discussion

Our assessment system failed to engage students enough to leverage its full potential. We discuss the inherent flaws and external factors that hindered student engagement. Assessment designers should leverage easy-to-control mechanisms to support assessment-for-learning and anticipate significant collaborative work to modify learning cultures.

The integrative feedback tool: assessing a novel feedback tool among emergency medicine residents

OBJECTIVE

Feedback is critical to the growth of learners. However, feedback quality can be variable in practice. Most feedback tools are generic, with few targeting emergency medicine. We created a feedback tool designed for emergency medicine residents, and this study aimed to evaluate the effectiveness of this tool.

METHODS

This was a single-center, prospective cohort study comparing feedback quality before and after introducing a novel feedback tool. Residents and faculty completed a survey after each shift assessing feedback quality, feedback time, and the number of feedback episodes. Feedback quality was assessed using a composite score from seven questions, which were each scored 1 to 5 points (minimum total score, 7 points; maximum, 35 points). Preintervention and postintervention data were analyzed using a mixed-effects model that took into account the correlation of random effects between study participants.

RESULTS

Residents completed 182 surveys and faculty members completed 158 surveys. The use of the tool was associated with improved consistency in the summative score of effective feedback attributes as assessed by residents (P=0.040) but not by faculty (P=0.259). However, most of the individual scores for attributes of good feedback did not reach statistical significance. With the tool, residents perceived that faculty spent more time providing feedback (P=0.040) and that the delivery of feedback was more ongoing throughout the shift (P=0.020). Faculty felt that the tool allowed for more ongoing feedback (P=0.002), with no perceived increase in the time spent delivering feedback (P=0.833).

CONCLUSION

The use of a dedicated tool may help educators provide more meaningful and frequent feedback without impacting the perceived required time needed to provide feedback.

'Every Human Interaction Requires a Bit of Give and Take': Medical Students' Approaches to Pursuing Feedback in the Clinical Setting

PhenomenonStudents, alongside teachers, play a key role in feedback. Student behavior in feedback processes may impact feedback outcomes. Student feedback behavior includes recognizing, seeking, evaluating, and utilizing feedback. Student feedback behavior is influenced by numerous student attributes and environmental factors. ApproachWe aimed to explore influences on medical student feedback behavior during clinical attachments. We adopted a subjective inductive qualitative approach. We conducted 7 focus groups with 46 medical students undertaking pediatric hospital-based attachments. We based our discussion framework on existing characterizations of student feedback behavior and the educational alliance model with its focus on the relationship between learners and teachers, and the active role played by both. During initial data analysis, we identified that our results exhibited aspects of Bandura's model of Triadic Reciprocal Causation within Social Cognitive Theory. In line with our subjective inductive approach, we adopted Triadic Reciprocal Causation at this point for further analysis and interpretation. This allowed us to conceptualize the emerging interactions between influences on feedback behavior. Findings We identified three key determinants of student feedback behavior: Environmental influences, Student attributes and Relationships between teachers and students. Environmental influences encompassed factors external to the student, including Teacher attributes and behaviors and The clinical learning context. Through the lens of Triadic Reciprocal Causation, the interrelationships between the determinants of feedback behavior gave rise to five key themes: Interactions between student feedback behavior and environmental influences of the clinical learning context, Interactions between student feedback behavior and environmental influences of teacher attributes and behaviors, Interactions between student attributes and student feedback behavior, Interactions between student attributes and environmental influences of teacher attributes and behaviors, and Relationships and the determinants of student feedback behavior. Insights: We apply the Triadic Reciprocal Causation model of Social Cognitive Theory to understand the influences on student feedback behavior and the interactions between them. We extend the model by situating relationships between students and teachers as a central factor. Future interventions to facilitate students' role in feedback will need to address student attributes, environmental factors, and student-teacher relationships, appreciating the codependent nature of these influences.

The role of feedback in supporting trainees who underperform in clinical environments

Introduction

Underperformance in clinical environments can be costly and emotional for all stakeholders. Feedback is an important pedagogical strategy for working with underperformance - both formal and informal strategies can make a difference. Feedback is a typical feature of remediation programs, and yet there is little consensus on how feedback should unfold in the context of underperformance.

Methods

This narrative review synthesises literature at the intersections of feedback and underperformance in clinical environments where service, learning and safety need to be considered. We do so with a critical eye towards generating insights for working with underperformance in the clinical environment.

Synthesis and discussion

There are compounding and multi-level factors that contribute to underperformance and subsequent failure. This complexity overwrites simplistic notions of 'earned' failure through individual traits and deficit. Working with such complexity requires feedback that goes beyond educator input or 'telling'. When we shift beyond feedback as input to process, we recognise that these processes are fundamentally relational, where trust and safety are necessary for trainees to share their weaknesses and doubts. Emotions are always present and they signal action. Feedback literacy might help us consider how to engage trainees with feedback so that they take an active (autonomous) role in developing their evaluative judgements. Finally, feedback cultures can be influential and take effort to shift if at all. A key mechanism running through all these considerations of feedback is enabling internal motivation, and creating conditions for trainees to feel relatedness, competence and autonomy. Broadening our perceptions of feedback, beyond telling, might help create environments for learning to flourish.

'For the most part it works': Exploring how authors navigate peer review feedback

BACKGROUND

Peer review aims to provide meaningful feedback to research authors so that they may improve their work, and yet it constitutes a particularly challenging context for the exchange of feedback. We explore how research authors navigate the process of interpreting and responding to peer review feedback, in order to elaborate how feedback functions when some of the conditions thought to be necessary for it to be effective are not met.

METHODS

Using constructivist grounded theory methodology, we interviewed 17 recently published health professions education researchers about their experiences with the peer review process. Data collection and analysis were concurrent and iterative. We used constant comparison to identify themes and to develop a conceptual model of how feedback functions in this setting.

RESULTS

Although participants expressed faith in peer review, they acknowledged that the process was emotionally trying and raised concerns about its consistency and credibility. These potential threats were mitigated by factors including time, team support, experience and the exercise of autonomy. Additionally, the perceived engagement of reviewers and the cultural norms and expectations surrounding the process strengthened authors' willingness and capacity to respond productively. Our analysis suggests a model of feedback within which its perceived usefulness turns on the balance of threats and countermeasures.

CONCLUSIONS

Feedback is a balancing act. Although threats to the productive uptake of peer review feedback abound, these threats may be neutralised by a range of countermeasures. Among these, opportunities for autonomy and cultural normalisation of both the professional responsibility to engage with feedback and the challenge of doing so may be especially influential and may have implications beyond the peer review setting.

Measuring changes in nursing students' workplace performance following feedback encounters: A quasi-experimental study

BACKGROUND

Work-integrated learning and performance is intimately linked with assessment and feedback; however, empirical evidence concerning the impact of feedback on student performance in workplace settings is limited. A novel practice-based feedback intervention-the REMARK (nuRse fEedback iMplementAtion frameworRK) program-was developed and implemented. Sustainable feedback processes that involve both learners and learning partners can ultimately maximise learning outcomes, optimise self-regulation, and impact performance.

OBJECTIVES

To determine the impact of implementing an educational intervention based on best practice principles of feedback on undergraduate nursing student performance during clinical placements in acute healthcare settings.

METHODS

A non-equivalent, quasi-experimental design was used. A pre- and post-assessment strategy for both control and intervention groups was employed. The REMARK program was based on known attributes of effective feedback critiqued in the literature that foster interactions between a learner and learning partner and, hence, support dialogic feedback.

RESULTS

Clinical assessment data of 214 final-year nursing students collected at three time points were analysed. Using multivariate modelling, the results indicated that students participating in the REMARK programme (intervention group) had statistically higher performance scores than students in the control group when time and placement setting were controlled.

CONCLUSIONS

This research provides evidence that engagement with an intervention based on attributes of effective feedback improves nursing students' workplace performance during clinical placement. To achieve the greatest advantage, incorporating strategies that encourage students to adopt an active role in feedback conversations that relate to the student's learning goals are recommended.

"Maybe it's the first time somebody's been honest with you": exploring how residents reconcile feedback variability

BACKGROUND

Supervisors in postgraduate medical education may deliver different feedback for the same quality of performance. Residents may struggle to make sense of inconsistent and sometimes contradictory information. We sought to explore how residents experience feedback from different supervisors, how they process inconsistent information, and what factors influence their experiences.

METHODS

Eighteen residents participated in semi-structured interviews to explore their perspectives on feedback. Using a constructivist grounded theory approach, we engaged in iterative cycles of data collection and analysis, sampling until theoretical sufficiency was reached. Constant comparative analysis was used to identify and define themes.

RESULTS

We identified a central theme of reconciliation, which we defined as the act of processing inconsistent feedback and determining how to engage with it. This reconciliation was informed by the credibility of, and residents' relationship with, supervisors and was achieved through conversations with peers and mentors, observation of other supervisors' behavior toward their performance, and reflection on their own performance. Participants expressed a reluctance to discard feedback, even if they felt it was incongruent with previous feedback or their own self-concept and self-assessment.

CONCLUSION

The findings of this study show that while residents are regular consumers of feedback, not all feedback is used equally. Residents actively reconcile sometimes-contradictory feedback and must work to balance a general reluctance to discard feedback, while developing an understanding of its credibility. This work reinforces the importance of pedagogical relationships and identifies that facilitated reflection that explicitly acknowledges feedback inconsistencies may be important in the reconciliation process.

Australian occupational therapists' perspectives of consumers authentically contributing to student learning during practice placements: ‘It just makes sense!’ but ‘we need a process’

INTRODUCTION

Collaborating with consumers in designing, delivering, and evaluating curricula is an ongoing initiative within occupational therapy tertiary courses in Australia. Within the Australian educational context, consumers are involved in on-campus educational activities. Student occupational therapists must complete 1000 hours of practice placements as part of their education. To date, no research has explored how consumers could contribute to student occupational therapists' learning during practice placements. This study aimed to explore Australian occupational therapists' perceptions of consumers providing feedback to students during practice placements.

METHODS

A qualitative descriptive approach was adopted to engage with the diversity of practice contexts and gain a rich dataset from the occupational therapy profession. A qualitative questionnaire was developed and distributed using snowballing techniques. The questionnaire asked recipients to reflect on the risks, challenges, and benefits of consumers providing feedback to student occupational therapists from all stakeholders' perspectives. Demographic data were collated, and reflexive thematic analysis was used to construct themes.

FINDINGS

Responses were received from 81 participants. Most respondents identified as experienced occupational therapists from metropolitan locations across Australia. Reflective thematic analysis was used to construct three themes: Personal capability of consumers and students will enable, inhibit, and be developed by engaging in a feedback process; an educator-controlled process to ensure safety for all stakeholders is required for time-poor practice contexts; and us versus them: Shifting control to consumers can disempower practice educators.

CONCLUSION

Engaging with consumers throughout all aspects of student occupational therapists' educational programme is required, including practice placements. New educational initiatives need to consider all stakeholders' concerns to ensure that authentic contribution from consumers is made within the various practice contexts. A co-design approach that involves all stakeholders to develop a feedback process may result in high-quality learning experiences that assist students to become safer, consumer-centred health professionals.

The influence of psychological safety on feedback conversations in general practice training

INTRODUCTION

Fostering trainee psychological safety is increasingly being recognised as necessary for effective feedback conversations. Emerging literature has explored psychological safety in peer learning, formal feedback and simulation debrief. Yet, the conditions required for psychologically safe feedback conversations in clinical contexts, and the subsequent effects on feedback, have not been explored.

METHODS

We conducted a qualitative study using interviews and longitudinal audio-diaries with 12 rural general practice trainees. The data were analysed using framework thematic analysis to identify factors across the data and as individual participant case studies with illustrative vignettes of dynamic interleaving of factors in judgements about feedback conversations.

FINDINGS

Findings identify the influence of intrapersonal (e.g. confidence and comfort to seek help), interpersonal (e.g. trust and relationship) and sociocultural factors (e.g. living and working in a rural community) that contribute to psychological safety in the context of everyday feedback conversations. Multiple factors interplayed in feedback conversations where registrars could feel safe and unsafe within one location and even at the one time.

DISCUSSION

Participants felt psychologically safe to engage their educators in sanctioned systems of conversation related to the immediate care of the patient and yet unsafe to engage in less patient related performance conversations despite the presence of multiple positive interpersonal factors. The concept of a safe 'container' (contained space) is perhaps idealised when it comes to feedback conversations about performance in the informal and emergent spaces of postgraduate training. More research is needed into understanding how clinical environments can sanction feedback conversations in clinical environments.

Emotion as reflexive practice: A new discourse for feedback practice and research

INTRODUCTION

Like medicine and health care, feedback is a practice imbued with emotions: saturated with feelings relevant to one's identity and status within a given context. Often this emotional dimension of feedback is cast as an impediment to be ignored or managed. Such a perspective can be detrimental to feedback practices as emotions are fundamentally entwined with learning. In this critical review, we ask: What are the discourses of emotion in the feedback literature and what 'work' do they do?

METHODS

We conducted a critical literature review of emotion and feedback in the three top journals of the field: Academic Medicine, Medical Education and Advances in Health Sciences Education. Analysis was informed by a Foucauldian critical discourse approach and involved identifying discourses of emotion and interpreting how they shape feedback practices.

FINDINGS

Of 32 papers, four overlapping discourses of emotion were identified. Emotion as physiological casts emotion as internal, biological, ever-present, immutable and often problematic. Emotion as skill positions emotion as internal, mainly cognitive and amenable to regulation. A discourse of emotion as reflexive practice infers a social and interpersonal understanding of emotions, whereas emotion as socio-cultural discourse extends the reflexive practice discourse seeing emotion as circulating within learning environments as a political force.

DISCUSSION

Drawing on scholarship within the sociology of emotions, we suggest the merits of studying emotion as inevitable (not pathological), as potentially paralysing and motivating and as situated within (and often reinforcing) a hierarchical social health care landscape. For future feedback research, we suggest shifting towards recognising the discourse-theory-practice connection with emotion in health professional education drawing from reflexive and socio-cultural discourses of emotion.

How does a move towards a coaching approach impact the delivery of written feedback in undergraduate clinical education?

Feedback uptake relies on interactions between learners and educators Winstone (Educ Psychol 52: 17-37, 2017). Feedback that coaches using a feedforward approach, is considered to be more personal and emotionally literate Bussey (Bull R Coll Surg Engl 99: 180-182, 2017), Hattie (Rev Educ Res 77: 81-112, 2007). Many modes of feedback are employed in clinical teaching environments, however, written feedback is particularly important, as a component of feedback discourse, as significant time may elapse before a similar clinical situation is encountered. In practice, time constraints often result in brief or descriptive written feedback rather than longer coaching feedback. This study aimed to explore whether a change in ethos and staff development would encourage clinical dental tutors to utilise a coaching approach in their written feedback. Across two time-points, written feedback was categorised into either descriptive, evaluative or coaching approaches. Cross-sections of data from 2017 to 2019 were examined to determine whether changes in practice were noted and whether there were any alterations in the affective nature of the language used. Feedback moved significantly towards coaching and away from a descriptive approach. A shift towards the use of more positive language was seen overall, although this was solely driven by a change in the evaluative feedback category. Descriptive feedback generally used neutral language with coaching feedback using marginally more positive language. Both categories employed significantly lower levels of affective language than evaluative feedback. These data indicate a move towards feedback approaches and language that may support increased uptake and utilisation of feedback.

Learning to recognise what good practice looks like: how general practice trainees develop evaluative judgement

The nature of healthcare means doctors must continually calibrate the quality of their work within constantly changing standards of practice. As trainees move into working as fully qualified professionals, they can struggle to know how well they are practising in the absence of formal oversight. They therefore need to build their evaluative judgement: their capability to interpret cues and messages from the clinical environment, allowing them to judge quality of practice. This paper explores how Australian general practice (GP) trainees develop their evaluative judgement. We interviewed 16 GPs, who had recently completed certification requirements, asking them how they managed complex learning challenges across their training trajectory. A thematic analysis was sensitised by conceptualisations of evaluative judgement and feedback for future practice. Findings are reported via three themes: sources of performance relevant information; sense-making about progress within complex learning challenges; and changing practice as evaluative judgement develops. Trainees actively sought to understand what quality practice looked like within complex and ambiguous circumstances but often found it difficult to calibrate their performance. While reflective practice was key to developing evaluative judgment, feedback conversations could provide significant opportunities for trainees and supervisors to co-construct meaning. A 'feedback community' was available for frequent instances where supervisors were absent or not regarded as entirely credible, although feedback conversations in themselves did not necessarily assist trainees to develop evaluative judgement. There is room for a more active role for supervisors in assisting trainees to consider how to independently make sense of learning cues.

Autonomy and developing physicians: Reimagining supervision using self-determination theory

In this article, we address the question, 'What is the role of autonomy in physician development?' Medical education is a developmental process, and autonomy plays a motivational role in physician development. Calls for increased supervision of residents have raised concerns that the resulting decreased autonomy might interfere with resident development, leading the authors to explore the relationship between supervision and autonomy. The medical education literature posits a simple inverse relationship between supervision and autonomy. Within competency frameworks, autonomy is operationalised as independence and viewed as the end goal of training. Alternatively, there is emerging empirical literature describing autonomy and supervision as dynamic and developmental constructs and point towards more complex relationship between supervision and autonomy. Self-determination theory (SDT) presents a framework for understanding this dynamic relationship and the role of autonomy in physician development. Within SDT, autonomy is a fundamental psychological need, associated with motivation for learning, self-regulation and an internal locus of control. Supporting learner autonomy can afford learners the opportunity to internalise the values and norms of the profession, leading to an integrated regulation of their behaviours and actions. Conceptualising autonomy through the lens of SDT provides an avenue for education interventions and future research on supervision and autonomy. Educators can integrate supervision and autonomy support in the clinical setting, seeking to motivate learner development by balancing optimal challenge and support and integrating autonomy support with 'hands-on' approaches to supervision. SDT also provides a theoretical framework relevant to current discussions regarding feedback conversations and coaching in medical education. Lastly, conceptualising autonomy using SDT opens new avenues for investigation, exploring the complex relationship between supervision and autonomy and developing efforts to integrate autonomy support with clinical supervision.

Effective Methods of Clinical Education

OBJECTIVE

To provide an overview of key points and helpful tips related to engaging learners in different medical education settings including the virtual education environment.

DATA SOURCES

Searches were conducted in PubMed and Google Scholar for articles and review papers on the topic of Medical Education.

STUDY SELECTIONS

There was a focus on articles which reviewed best practices on a variety of topics related to medical education.

RESULTS

Medical Education is a critical part of any students or trainees' curriculum in their education/training program. There are different settings where medical education is provided, and both general and type specific best practices that can be considered. Those who spend time in medical education are continuously working on innovative ideas to enhance and improve how educators teach in both large and small group settings. More recently the presenter must also consider if the event will occur in a live or virtual setting as e-learning has become more popular, and at times required, which has both benefits and challenges in medical education.

CONCLUSION

It is the responsibility of all of those who work in medical education to provide interactive and engaging education to learners at all levels of training.

The active feedback program: bringing medical students out of the shadows

Despite many advances in medical education, medical students continue to mostly shadow on inpatient rotations like Neurology. They seldom receive face-to-face feedback or mentorship from attending physicians. This results from not training attending physicians how to integrate medical students into clinical activities in a way that does not detract from patient rounds. The 'active feedback program' is a framework for inpatient rotations that immerses medical students in clinical activities with the attending physician providing mentorship and feedback that emphasizes brevity. Expectations are laid out early. Students pick up 2-3 patients, performing daily oral reports and focused neurological exams with immediate feedback. Feedback includes items to not only correct the treatment plan, but also improve the student's oral presentation and neurological exam skills. Students also receive formal individual feedback twice during the rotation that includes constructive criticism and specific task-oriented praise. The active feedback program awaits formal testing, but seems to result in medical students learning at an accelerated rate. Neurology residents also appear to benefit by learning from critiques of the medical students and taking on higher level responsibilities. Patient rounds move quickly, leaving time for the attending physician to keep up with other obligations. As academic Neurologists we have a duty to transfer our skills to the next generation of physicians. If proven in future studies, wide adoption of the active feedback program will allow us to finally move medical students out of the shadows and come closer to achieving this noble goal.

Developing Physician Assistant Faculty Feedback Skills

ABSTRACT

Investing time in mastering the feedback process is an important skill for all faculty. With physician assistant (PA) programs growing rapidly worldwide, faculty need to devote time to the education theory behind the feedback process. Within the clinical area, feedback is an everyday occurrence for PAs. However, ensuring that the process of giving feedback reaps dividends, ie, closes the feedback loop and ensures that learning and change of behavior have occurred, requires an understanding of what theories and models have already been tested with students. This article focuses on key principles of providing feedback and uses an example of a model of feedback, which highlights the challenges. An application to practice of the principles and model used as examples is provided, with a focus on self and peer feedback.

The effect of peer modelling and discussing modelled feedback principles on medical students' feedback skills: a quasi-experimental study

BACKGROUND

Teaching is an important professional skill for physicians and providing feedback is an important part of teaching. Medical students can practice their feedback skills by giving each other peer feedback. Therefore, we developed a peer feedback training in which students observed a peer that modelled the use of good feedback principles. Students then elaborated on the modelled feedback principles through peer discussion. This combination of peer modelling and discussing the modelled feedback principles was expected to enhance emulation of the feedback principles compared to (1) only peer modelling and (2) discussing the feedback principles without previous modelling.

METHODS

In a quasi-experimental study design, 141 medical students were assigned randomly to three training conditions: peer modelling plus discussion (MD), non-peer modelled example (NM) or peer modelling without discussion (M). Before and after the training, they commented on papers written by peers. These comments served as a pre- and a post-measure of peer feedback. The comments were coded into different functions and aspects of the peer feedback. Non-parametrical Kruskall-Wallis tests were used to check for pre- and post-measure between-group differences in the functions and aspects.

RESULTS

Before the training, there were no significant between-group differences in feedback functions and aspects. After the training, the MD-condition gave significantly more positive peer feedback than the NM-condition. However, no other functions or aspects were significantly different between the three conditions, mainly because the within-group interquartile ranges were large.

CONCLUSIONS

The large interquartile ranges suggest that students differed substantially in the effort placed into giving peer feedback. Therefore, additional incentives may be needed to motivate students to give good feedback. Teachers could emphasise the utility value of peer feedback as an important professional skill and the importance of academic altruism and professional accountability in the peer feedback process. Such incentives may convince more students to put more effort into giving peer feedback.

[Education for resuscitation]

Diese Leitlinien des European Resuscitation Council basieren auf dem internationalen wissenschaftlichen Konsens 2020 zur kardiopulmonalen Reanimation mit Behandlungsempfehlungen (International Liaison Committee on Resuscitation 2020 International Consensus on Cardiopulmonary Resuscitation Science with Treatment Recommendations [ILCOR] 2020 CoSTR). Dieser Abschnitt bietet Bürgern und Angehörigen der Gesundheitsberufe Anleitungen zum Lehren und Lernen der Kenntnisse, der Fertigkeiten und der Einstellungen zur Reanimation mit dem Ziel, das Überleben von Patienten nach Kreislaufstillstand zu verbessern.

European Resuscitation Council Guidelines 2021: Education for resuscitation

These European Resuscitation Council education guidelines, are based on the 2020 International Consensus on Cardiopulmonary Resuscitation Science with Treatment Recommendations. This section provides guidance to citizens and healthcare professionals with regard to teaching and learning the knowledge, skills and attitudes of resuscitation with the ultimate aim of improving patient survival after cardiac arrest.

Structured work-based learning in undergraduate clinical radiology immersion experience

BACKGROUND

Practical courses in undergraduate medical training often lack a didactic concept. Active participation and learning success largely depend on chance. This study was initiated to evaluate a novel concept of structured work-based learning (WBL) in the course of students' half-day radiology immersion experience (IE).

METHODS

This prospective, single-centre cohort study included 228 third-year students of the 2019 summer semester who underwent the obligatory radiology IE at a university hospital. The course was based on a novel structured WBL concept that applied established didactic concepts including blended learning, the FAIR principles of feedback, activity, individualization, and relevance, and Peyton's four-step approach. Outcomes of equal weight were student and supervisor satisfaction with the clinical radiology IE assessed by paper-based- and online survey, respectively. Secondary outcome was achievement of intended learning outcomes assessed by means of mini clinical evaluation exercises and personal interviews.

RESULTS

Satisfaction with structured WBL was high in 99.0% of students. Students' expectations were exceeded, and they felt taken seriously at the professional level. Dissatisfaction was reasoned with quality of learning videos (0.6%), little support by supervisors (0.5%), or inadequate feedback (0.6%). Supervising resident physicians rated achievement of intended learning outcomes regarding cognitive and psychomotor competences as excellent for all students. Personal interviews revealed achievement of affective competence in some students. Twelve of 16 (75.0%) supervising physicians were satisfied with focussing on intended learning outcomes and student preparation for IE. Two of 15 (13.3%) supervisors were unsatisfied with time spent, and 4 of 16 (25%) with the approach of assessment.

CONCLUSIONS

This study demonstrated that both students and supervisors were satisfied with the novel concept of structured WBL within the scope of clinical radiology IE. Achievement of intended learning outcomes was promising.

Becoming clinical supervisors: identity learnings from a registrar faculty development program

This article shares our experiences and surprises as we developed, implemented and evaluated a 12-week faculty development program for registrars as clinical supervisors over three cohorts. The program has consistently been rated highly by participants. Yet, following a comprehensive curriculum review, we were surprised that our goal of encouraging identity development in clinical supervisors seemed to be unmet. Whilst our evaluation suggests that the program made important contributions to the registrars' knowledge, application and readiness as clinical supervisors, challenges linked to developing a supervisor identity and managing the dual identity of supervisor and clinician remain. In this article we describe our program and argue for the importance of designing faculty development programs to support professional identity formation. We present the findings from our program evaluation and discuss the surprising outcomes and ongoing challenges of developing a cohesive clinical educator identity. Informed by recent evidence and workplace learning theory we critically appraise our program, explain the mechanisms for the unintended outcomes and offer suggestions for improving curricular and pedagogic practices of embedded faculty development programs. A key recommendation is to not only consider identity formation of clinical supervisors from an individualist perspective but also from a social perspective.

Resident impression management within feedback conversations: A qualitative study

INTRODUCTION

Medical education is moving to conceptualise feedback as a bidirectional learning conversation. Within this conversation, learners experience a tension between assessment and feedback. That perceived tension affects learners' outward performances. In this study, we aimed to characterise residents' experiences with this tension and its effect on learner authenticity within feedback conversations.

METHODS

In this constructivist grounded theory study, the authors were informed by Goffman's theory of impression management. During data analysis, Dweck's theory of mindset was adopted. The authors conducted semi-structured interviews with 15 internal medicine residents. Data collection and analysis were conducted iteratively, using constant comparison to identify themes coinciding with impression management and mindset, ultimately developing a theoretical model to help explain residents' responses to tensions within feedback conversations.

RESULTS

Residents constantly felt 'scrutinized', and this affected their engagement in feedback conversations. They staged a performance within those conversations, linked to their underlying mindset: growth or fixed. Growth mindset was characterised by a focus on development as a physician and was associated with asking questions and seeking opportunities for growth. Fixed mindset was characterised by a focus on achieving a favourable evaluation and was associated with a hesitation to ask questions when faced with uncertainty and admit opportunities for growth, because they were concerned about impression management. Context influenced mindset and impression management. Residents adopted a fixed mindset and managed impressions when they perceived the permanence or consequences of evaluations within feedback. Residents adopted a growth mindset when they trusted the supervisor.

DISCUSSION

Residents assess the context of feedback conversations, altering the authenticity of their behaviours. Context, including the perceptions of formal assessment and relationships with supervisors, affected residents' mindset and impression management. Providing space for relationship-building and clarifying the purpose and structure of assessment may be helpful in supporting effective learning conversations in graduate medical education.

Junior doctor perceptions of education and feedback on ward rounds

AIM

The literature suggests that feedback is wanted and needed in clinical medicine and specifically on ward rounds, yet it is often lacking. This study aimed to examine junior doctor perceptions of education and feedback on ward rounds in one clinical department at a tertiary paediatric hospital and the key influences on these perceptions.

METHODS

Six semi-structured focus groups were conducted over a period of 9 months comprising of 20 participants (post-graduate year 1-5) in a general medical department of a tertiary paediatric hospital. Qualitative analysis was performed on focus group transcripts using an inductive approach and codes and themes were generated in an iterative fashion with checking of themes between two researchers.

RESULTS

Feedback experiences were largely positive compared to previous rotations. Three overarching themes were identified which influenced trainee perceptions of education and feedback on ward rounds. These were: consultant influences (e.g. educational engagement), trainee influences (e.g. active seeking of feedback), and structural factors (e.g. organisational constraints).

CONCLUSIONS

Despite positive feedback experiences, the need to improve feedback for our junior doctors is clear, but how to do this remains challenging when navigating work-learning tensions. The notion of the educational alliance between the consultant and trainee is a potential useful solution, but it requires deliberate effort and dedicated time to establish given our increasingly complex and busy clinical environments.

An educational intervention to increase student engagement in feedback

BACKGROUND

The learner has a central role in feedback. We developed a feedback workshop for medical students grounded in two concepts: (1) Student agency in feedback and its interplay in the context of brief clinical attachments; (2) The educational alliance.

AIMS

To determine whether a brief feedback training workshop prior to a series of two-week clinical attachments improves agentic student feedback behaviour (e.g. seeking, recognising, evaluating and utilising feedback) and student satisfaction with feedback.

METHODS

We conducted surveys among three consecutive student cohorts undertaking three fortnightly paediatric clinical attachments. We pilot tested a workshop with Cohort 1 and implemented it for the entire Cohorts 2 (n = 58) and 3 (n = 68). Participants completed the same survey at the start and end of term, with different free-text items. Quantitative and qualitative responses were compared between groups.

RESULTS

Student-reported agentic feedback behaviour increased across all outcomes except for feedback utilisation. Overall student satisfaction with feedback increased during the term in Cohorts 2 (23-65%, p = 0.002) and 3 (40-70%, p = 0.003) but not in Cohort 1 non-participating students (27-42%, p = 0.42).

CONCLUSIONS

A brief one-off student-directed feedback workshop may improve agentic student feedback behaviours (e.g. feedback-seeking) and student satisfaction with feedback.

The Influence of Relationship-Centered Coaching on Physician Perceptions of Peer Review in the Context of Mandated Regulatory Practices

PURPOSE

Medical regulatory authorities are legally mandated to protect patients by monitoring the practice of medicine. While principally a matter of public safety, many pursue this mission by establishing quality improvement initiatives that prioritize professional development for all rather than identification of substandard performers. Engaging practitioners in directed learning opportunities, however, is rife with challenge given inherent social complexities. This study was run to explore whether relationship-centered coaching could improve physicians' perceptions of the value of engaging with College-mandated peer review.

METHOD

A quasi-experimental analysis was performed on physician ratings of the effectiveness of peer assessor interactions and assessment processes during 3 time periods: (1) an historical control (March 2016-December 2016; n = 296); (2) a period after assessors were trained to deliver feedback using relationship-centered coaching (December 2016-March 2017; n = 96); and (3) after physicians were given more capacity to choose patient records for peer review and engage in discussion about multisource feedback results (March 2017-December 2018; n = 448).

RESULTS

Psychometric analyses supported the aggregation of survey items into assessor interaction and assessment process subscores. Training assessors to engage in relationship-centered coaching was related with higher assessor interaction scores (4.64 vs 4.47; P < .05; d = 0.37). Assessment process scores did not increase until after additional program enhancements were made in period 3 (4.33 vs 4.17, P < .05, d = 0.29).

CONCLUSIONS

Despite peer interactions being inherently stressful for physicians when they occur in the context of regulatory authority visits, efforts to establish a quality improvement culture that prioritizes learning can improve physicians' perceptions of peer review.

Improving junior doctor medicine prescribing and patient safety: An intervention using personalised, structured, video-enhanced feedback and deliberate practice

AIMS

This research investigated the effectiveness of an intervention for improving the prescribing and patient safety behaviour among Foundation Year doctors. The intervention consisted of simulated clinical encounters with subsequent personalised, structured, video-enhanced feedback and deliberate practice, undertaken at the start of four-month sub-specialty rotations.

METHODS

Three prospective, non-randomised control intervention studies were conducted, within two secondary care NHS Trusts in England. The primary outcome measure, error rate per prescriber, was calculated using daily prescribing data. Prescribers were grouped to enable a comparison between experimental and control conditions using regression analysis. A break-even analysis evaluated cost-effectiveness.

RESULTS

There was no significant difference in error rates of novice prescribers who received the intervention when compared with those of experienced prescribers. Novice prescribers not participating in the intervention had significantly higher error rates (P = .026, 95% confidence interval [CI] Wald 0.093 to 1.436; P = .026, 95% CI 0.031 to 0.397) and patients seen by them experienced significantly higher prescribing error rates (P = .007, 95% CI 0.025 to 0.157). Conversely, patients seen by the novice prescribers who received the intervention experienced a significantly lower rate of significant errors compared to patients seen by the experienced prescribers (P = .04, 95% CI -0.068 to -0.001). The break-even analysis demonstrates cost-effectiveness for the intervention.

CONCLUSION

Simulated clinical encounters using personalised, structured, video-enhanced feedback and deliberate practice improves the prescribing and patient safety behaviour of Foundation Year doctors. The intervention is cost-effective with potential to reduce avoidable harm.

Improving Student Feedback Quality: A Simple Model Using Peer Review and Feedback Rubrics

Constructive feedback is an important aspect of medical education to help students improve performance in cognitive and clinical skills assessments. However, for students to appropriately act on feedback, they must recognize quality feedback and have the opportunity to practice giving, receiving, and acting on feedback. We incorporated feedback literacy into a case-based concept mapping small group-learning course. Student groups engaged in peer review of group-constructed concept maps and provided written peer feedback. Faculty also provided written feedback on group concept maps and used a simple rubric to assess the quality of peer feedback. Groups were provided feedback on a weekly basis providing an opportunity for timely improvement. Precourse and postcourse evaluations along with peer-review feedback assessment scores were used to show improvement in both group and individual student feedback quality. Feedback quality was compared to a control student cohort that engaged in the identical course without implementing peer review or feedback assessment. Student feedback quality was significantly improved with feedback training compared to the control cohort. Furthermore, our analysis shows that this skill transferred to the quality of student feedback on course evaluations. Feedback training using a simple rubric along with opportunities to act on feedback greatly enhanced student feedback quality.

Debunking myths in medical education: The science of refutation

de Bruin argues that efforts to eradicate erroneous assumptions students and teachers hold about learning requires refutation, a process that combines both correct scientific knowledge and rejection of misconceptions.