Content and conceptual frameworks of preceptor feedback related to residents' educational needs

Development of complex pedagogical competencies and reflexivity in clinical teachers via distance learning: a mixed methods study

Clinical reasoning is the cornerstone to healthcare practice and teaching it appropriately is of utmost importance. Yet there is little formal training for clinical supervisors in supervising this reasoning process. Distance education provides interesting opportunities for continuous professional development of healthcare professionals. This mixed methods study aimed at gaining in-depth understanding about whether and how clinical teachers can develop complex pedagogical competencies through participation in a Massive Open Online Course on the supervision of clinical reasoning (MOOC SCR). Participants self-assed their clinical supervision skills before and after partaking in the MOOC SCR through the Maastricht Clinical Teachers Questionnaire. Item scores and the distribution of response proportions before and after participation were compared using paired t-tests and McNemar's tests respectively. In parallel, the evolution of a subset of MOOC participants' pedagogical practice and posture was explored via semi-structured interviews throughout and beyond their MOOC participation using simulated and personal situational recalls. The verbatim were analysed with standard thematic analysis. Quantitative and qualitative findings converged and their integration demonstrated that partaking in the MOOC SCR promoted the development of complex pedagogical competencies and reflexivity with the participants. This was quantitatively evidenced by significantly higher self-assessed supervision skills and corresponding attitudes after completing the MOOC. The qualitative data provided rich descriptions of how this progression in pedagogical practice and posture occurred in the field and how it was shaped by participants' interaction with the MOOC's content and their motivations to progress. Our findings provide evidence for the development of pedagogical skills and corresponding attitudes for the supervision of clinical reasoning through participation in the MOOC SCR and contribute to the literature body on the opportunities that distance learning provides for the development of pedagogical competencies. The extent to which the pedagogical underpinnings of the MOOC contributed to these developments remains to be determined.

[Feedback Guide for direct observation of family medicine residents in Canada: a francophone tool]

BACKGROUND

There is no CanMEDS-FM-based milestone tool to guide feedback during direct observation (DO). We have developed a guide to support documentation of feedback for direct observation (DO) in Canadian family medicine (FM) programs.

METHODS

The Guide was designed in three phases with the collaboration of five Canadian FM programs with at least a French-speaking teaching site: 1) literature review and needs assessment; 2) development of the DO Feedback Guide; 3) testing the Guide in a video simulation context with qualitative content analysis.

RESULTS

Phase 1 demonstrated the need for a narrative guide aimed at 1) specifying mutual expectations according to the resident's level of training and the clinical context, 2) providing the supervisor with tools and structure in his observations 3) to facilitate documentation of feedback. Phase 2 made it possible to develop the Guide, in paper and electronic formats, meeting the needs identified. In phase 3, 15 supervisors used the guide for three levels of residence. The Guide was adjusted following this testing to recall the phases of the clinical encounter that were often forgotten during feedback (before consultation, diagnosis and follow-up), and to suggest types of formulation to be favored (stimulating questions, questions of clarification, reflections).

CONCLUSION

Based on evidence and a collaborative approach, this Guide will equip French-speaking Canadian supervisors and residents performing DO in family medicine.

Analysis of Supervisors' Feedback to Residents on Communicator, Collaborator, and Professional Roles During Case Discussions

BACKGROUND

Literature examining the feedback supervisors give to residents during case discussions in the realms of communication, collaboration, and professional roles (intrinsic roles) focuses on analyses of written feedback and self-reporting.

OBJECTIVES

We quantified how much of the supervisors' verbal feedback time targeted residents' intrinsic roles and how well feedback time was aligned with the role targeted by each case. We analyzed the educational goals of this feedback. We assessed whether feedback content differed depending on whether the residents implied or explicitly expressed a need for particular feedback.

METHODS

This was a mixed-methods study conducted from 2017 to 2019. We created scripted cases for radiology and internal medicine residents to present to supervisors, then analyzed the feedback given both qualitatively and quantitatively. The cases were designed to highlight the CanMEDS intrinsic roles of communicator, collaborator, and professional.

RESULTS

Radiologists (n = 15) spent 22% of case discussions providing feedback on intrinsic roles (48% aligned): 28% when the case targeted the communicator role, 14% for collaborator, and 27% for professional. Internists (n = 15) spent 70% of discussions on intrinsic roles (56% aligned): 66% for communicator, 73% for collaborator, and 72% for professional. Radiologists' goals were to offer advice (66%), reflections (21%), and agreements (7%). Internists offered advice (41%), reflections (40%), and clarifying questions (10%). We saw no consistent effects when residents explicitly requested feedback on an intrinsic role.

CONCLUSIONS

Case discussions represent frequent opportunities for substantial feedback on intrinsic roles, largely aligned with the clinical case. Supervisors predominantly offered monologues of advice and agreements.

Just-in-time faculty development: a mobile application helps clinical teachers verify and describe clinical reasoning difficulties

BACKGROUND

Although clinical teachers can often identify struggling learners readily and reliably, they can be reluctant to act upon their impressions, resulting in failure to fail. In the absence of a clear process for identifying and remediating struggling learners, clinical teachers can be put off by the prospect of navigating the politically and personally charged waters of remediation and potential failing of students.

METHODS

To address this gap, we developed a problem-solving algorithm to support clinical teachers from the identification through the remediation of learners with clinical reasoning difficulties, which have significant implications for patient care. Based on this algorithm, a mobile application (Pdx) was developed and assessed in two emergency departments at a Canadian university, from 2015 to 2016, using interpretive description as our research design. Semi-structured interviews were conducted before and after a three-month trial with the application. Interviews were analysed both deductively, using pre-determined categories, and inductively, using emerging categories.

RESULTS

Twelve clinical teachers were interviewed. Their experience with the application revealed their need to first validate their impressions of difficulties in learners and to find the right words to describe them before difficulties could be addressed. The application was unanimously considered helpful regarding both these aspects, while the mobile format appeared instrumental in allowing clinical teachers to quickly access targeted information during clinical supervision.

CONCLUSIONS

The value placed on verifying impressions and finding the right words to pinpoint difficulties should be further explored in endeavours that aim to address the failure to fail phenomenon. Moreover, just-in-time mobile solutions, which mirror habitual clinical practices, may be used profitably for knowledge transfer in medical education, as an alternative form of faculty development.

The research contributions of predominantly North American Family Medicine educators to medical learner feedback: a descriptive analysis following a scoping review

BACKGROUND AND OBJECTIVES

In 2016, we performed a scoping review as a means of mapping what is known in the literature about feedback to medical learners. In this descriptive analysis, we explore a subset of the results to assess the contributions of predominantly North American family medicine educators to the feedback literature.

METHODS

Nineteen articles extracted from our original scoping review plus six articles identified from an additional search of the journal Family Medicine are described in-depth.

RESULTS

The proportion of articles involving family medicine educators identified in our scoping review is small (n=19/650, 3%) and the total remains low (25) after including additional articles (n=6) from a Family Medicine search. They encompass a broad range of feedback methods and content areas. They primarily originated in the United States (n=19) and Canada (n=3) within Family Medicine Departments (n=20) and encompass a variety of scientific and educational research methodologies.

CONCLUSIONS

The contributions of predominantly North American Family Medicine educators to the literature on feedback to learners are sparse in number and employ a variety of focus areas and methodological approaches. More studies are needed to assess for areas of education research where family physicians could make valuable contributions.

Diagnosis and management of clinical reasoning difficulties: Part II. Clinical reasoning difficulties: Management and remediation strategies. MEDICAL TEACHER 2017;39:797-801. [PMID: 28587511 DOI: 10.1080/0142159x.2017.1331034]

Part II of this AMEE Guide provides a detailed overview of the main difficulties in clinical reasoning, including the cues to look out for in clinical supervision, the root causes of each difficulty and targeted remediation strategies. Specific challenges and issues related to the management of clinical reasoning difficulties will also be discussed.

Diagnosis and management of clinical reasoning difficulties: Part I. Clinical reasoning supervision and educational diagnosis

There are many obstacles to the timely identification of clinical reasoning difficulties in health professions education. This guide aims to provide readers with a framework for supervising clinical reasoning and identifying the potential difficulties as they may occur at each step of the reasoning process.

Content and conceptual frameworks of psychology and social work preceptor feedback related to the educational requests of family medicine residents

OBJECTIVES

Supervision of communication competency in clinical settings in medicine is an important component of professional training. The purpose of this study was to describe the content and rationale of psychology and social work preceptor feedback to family medicine residents who express educational needs during case-based written vignettes.

METHODS

We conducted a qualitative study with 25 psychology and social work preceptors from family medicine departments of the three French-speaking universities in the province of Quebec, Canada. During an individual interview, preceptors were asked to respond to three short case-based written vignettes depicting resident educational issues regarding communication and to explain their responses. Authors analyzed the content of responses and the conceptual frameworks reported.

RESULTS

The three vignettes elicited 475 responses, including 58 distinct responses and 33 distinct conceptual frameworks. Therapeutic alliance and stages of grief were the two most reported conceptual frameworks.

CONCLUSION

The vignettes stimulated a wealth of responses and conceptual frameworks among psychology and social work preceptors in family medicine.

PRACTICAL IMPLICATIONS

The complete list of responses could be useful for faculty development activities by stimulating preceptors' reflexive practice with regard to their responses, the educational goals of these responses and the conceptual frameworks underlying their feedback.

The quality of feedback during formative OSCEs depends on the tutors' profile

BACKGROUND

During their pre-clinical years, medical students are given the opportunity to practice clinical skills with simulated patients. During these formative objective structured clinical encounters (OSCEs), tutors from various backgrounds give feedback on students' history taking, physical exam, and communication skills. The aim of the study was to evaluate whether the content and process of feedback varied according to the tutors' profile.

METHODS

During 2013, all 2^nd and 3^rd year medical students and tutors involved in three formative OSCEs were asked to fill in questionnaires, and their feedback sessions were audiotaped. Tutors were divided into two groups: 1) generalists: primary care, general internist and educationalist physicians 2) specialists involved in the OSCE related to their field of expertise. Outcome measures included the students' perceptions of feedback quality and utility and objective assessment of feedback quality.

RESULTS

Participants included 251 medical students and 38 tutors (22 generalists and 16 specialists). Students self-reported that feedback was useful to improve history taking, physical exam and communication skills. Objective assessment showed that feedback content essentially focused on history taking and physical exam skills, and that elaboration on clinical reasoning or communication/professionalism issues was uncommon. Multivariate analyses showed that generalist tutors used more learner-centered feedback skills than specialist tutors (stimulating student's self-assessment (p < .001; making the student active in finding solutions, p < .001; checking student's understanding, p < .001) and elaborated more on communication and professionalism issues (p < 0.001). Specialists reported less training in how to provide feedback than generalists.

CONCLUSION

These findings suggest that generalist tutors are more learner-centered and pay more attention to communication and professionalism during feedback than specialist tutors. Such differences may be explained by differences in feedback training but also by differences in practice styles and frames of references that should be further explored.

Towards a program of assessment for health professionals: from training into practice

Despite multifaceted attempts to "protect the public," including the implementation of various assessment practices designed to identify individuals at all stages of training and practice who underperform, profound deficiencies in quality and safety continue to plague the healthcare system. The purpose of this reflections paper is to cast a critical lens on current assessment practices and to offer insights into ways in which they might be adapted to ensure alignment with modern conceptions of health professional education for the ultimate goal of improved healthcare. Three dominant themes will be addressed: (1) The need to redress unintended consequences of competency-based assessment; (2) The potential to design assessment systems that facilitate performance improvement; and (3) The importance of ensuring authentic linkage between assessment and practice. Several principles cut across each of these themes and represent the foundational goals we would put forward as signposts for decision making about the continued evolution of assessment practices in the health professions: (1) Increasing opportunities to promote learning rather than simply measuring performance; (2) Enabling integration across stages of training and practice; and (3) Reinforcing point-in-time assessments with continuous professional development in a way that enhances shared responsibility and accountability between practitioners, educational programs, and testing organizations. Many of the ideas generated represent suggestions for strategies to pilot test, for infrastructure to build, and for harmonization across groups to be enabled. These include novel strategies for OSCE station development, formative (diagnostic) assessment protocols tailored to shed light on the practices of individual clinicians, the use of continuous workplace-based assessment, and broadening the focus of high-stakes decision making beyond determining who passes and who fails. We conclude with reflections on systemic (i.e., cultural) barriers that may need to be overcome to move towards a more integrated, efficient, and effective system of assessment.

Content and Rationale of Junior and Senior Preceptors Responding to Residents' Educational Needs Revisited

THEORY

Feedback and debriefing, as portrayed in expertise development and self-assessment, play critical roles in providing residents with useful information to foster their progress.

HYPOTHESES

Prior work has shown that clinical preceptors' use of conceptual frameworks (CFs; ways of thinking based on theories, best practices, or models) while giving feedback to residents was positively associated with a greater diversity of responses. Also, senior preceptors produced more responses, used more CFs, and asked more probing-challenging questions than junior preceptors. The purpose was to confirm the generalization of these initial findings with a broader and better defined sample of preceptors.

METHOD

We conducted a mixed-method study with 20 junior and 20 senior preceptors in a controlled environment to analyze their responses and rationales to residents' educational needs as portrayed in 6 written vignettes. The preceptors were recruited from 3 primary care specialties preceptors (family medicine, internal medicine, pediatrics) of the 3 French-speaking faculties of medicine in Québec, Canada.

RESULTS

The preceptors increased the 2012 list of response topics (96 to 126) and doubled the number of distinct CFs (16 to 32). The junior and senior preceptors expressed the same number and diversity of CFs. On average, senior preceptors asked more clarification questions and reflected more than juniors on the learning process that occurs during case discussions. Preceptor specialty and prior training in medical education did not influence the number and diversity of responses and CFs, except that preceptors with prior training generated more responses per vignette and were more reflective. Senior preceptors had a stronger positive relationship between the number of total and distinct CFs and the number of responses than the juniors.

CONCLUSIONS

Although senior preceptors did not give more responses or use more CFs compared to the prior study, they continue to probe residents more and reflected more. The positive relationship between responses and CFs has important implications for faculty development and calls for more research to better understand the specific contribution of CFs to feedback.

Content and timing of feedback and reflection: a multi-center qualitative study of experienced bedside teachers

BACKGROUND

Competency-based medical education increasingly recognizes the importance of observation, feedback, and reflection for trainee development. Although bedside rounds provide opportunities for authentic workplace-based implementation of feedback and team-based reflection strategies, this relationship has not been well described. The authors sought to understand the content and timing of feedback and team-based reflection provided by bedside teachers in the context of patient-centered bedside rounds.

METHODS

The authors conducted a thematic analysis qualitative study using transcripts from audio-recorded, semi-structured telephone interviews with internal medicine attending physicians (n= 34) identified as respected bedside teachers from 10 academic US institutions (2010-2011).

RESULTS

Half of the respondents (50%) were associate/full professors, with an average of 14 years of academic experience. In the context of bedside encounters, bedside teachers reported providing feedback on history-taking, physical-examination, and case-presentation skills, patient-centered communication, clinical decision-making, leadership, teaching skills, and professionalism. Positive feedback about physical-exam skills or clinical decision-making occurred during encounters, positive or constructive team-based feedback occurred immediately following encounters, and individualized constructive feedback occurred in one-on-one settings following rounding sessions. Compared to less frequent, emotionally-charged events, bedside teachers initiated team-based reflection on commonplace "teachable moments" related to patient characteristics or emotions, trainee actions and emotions, and attending physician role modeling.

CONCLUSIONS

Bedside teachers use bedside rounds as a workplace-based method to provide assessment, feedback, and reflection, which are aligned with the goals of competency-based medical education. Embedded in patient-centered activities, clinical teachers should be encouraged to incorporate these content- and timing-related feedback and reflection strategies into their bedside teaching.

A national questionnaire survey of consultants and middle grade doctors' perception of foundation doctors in obstetrics and gynaecology in the United Kingdom

AIM

The aim of this study was to compare foundation doctors in obstetrics and gynaecology to the former grade of senior house officer, as perceived by their consultant and middle grade colleagues.

METHODS

A self-construct questionnaire was sent to College District Tutors in obstetrics and gynaecology in all hospitals in the United Kingdom, for circulation to all consultants and middle grade doctors in obstetrics and gynaecology in their departments.

RESULTS

A total of 155 questionnaires were returned, 143 completed and 12 indicating not having foundation doctors. Whilst about 50 % of respondents ranked the competencies of foundation year doctors as similar to that of the former senior house officer grade, the ratings were down in areas specific to obstetrics and gynaecology, such as seeing new patients in antenatal clinic, and up in general terms such as communication. General comments highlighted differences in ability and role and suggested longer attachments and less frequent changes in training structure.

CONCLUSIONS

The study highlighted the need to focus on teaching generic skills in shorter durations and reflection on whole-patient management, which are relevant to all specialities. It underlined the impact of more frequent change of doctors on service delivery and recommended having a further look at foundation training programme before making any future changes.