Learner deficits and academic outcomes of medical students, residents, fellows, and attending physicians referred to a remediation program, 2006-2012

Validity Evidence for Using Virtual, Interactive Patient Encounters to Teach and Assess Clinical Reasoning for First-Year Medical Students

PURPOSE

Despite universal agreement on the importance of clinical reasoning skills, inadequate curricular attention to these skills remains a problem. To facilitate integration of clinical reasoning instruction and assessment into the preclerkship phase, the authors created a clinical reasoning curriculum using technology-enhanced patient simulations.

METHOD

In 2023, first-year medical students at Duke University School of Medicine were enrolled in a biomedical science course using diagnostic reasoning sessions and 16 virtual, interactive patient (VIP) encounters to teach and assess clinical reasoning. The encounters were enhanced with interactive pop-in windows that assessed multiple clinical reasoning domains. Student responses were independently evaluated by faculty. Cumulative VIP clinical reasoning composite (CRC) scores were calculated, and growth mixture modeling was used to define students by growth trajectory. Clinical reasoning was assessed in a summative objective structured clinical examination (OSCE).

RESULTS

Of the 118 students who participated in the curriculum, 1 was excluded from analysis for inadequate participation in the VIP encounters, leaving 117 students. The aggregate VIP encounter response rate was 95% (1,783 of 1,872 assessments completed). Clinical reasoning was assessed through cumulative performance across multiple domains. The mean (SD) scores were 58 (13) for information gathering, 46 (13) for illness script identification, 64 (14) for hypothesis generation, 59 (12) for differential diagnosis, and 77 (21) for management and plan. To identify latent classes of growth in cumulative VIP-CRC scores, growth mixture modeling was performed for 1-, 2-, and 3-class models. The 2-class model showed the best fit due to having the lowest bayesian information criterion (11,765.17) and Akaike information criteria (11,737.55).

CONCLUSIONS

Integrated clinical reasoning instruction and deliberate, formative practice through authentic simulations were effective at teaching and assessing clinical reasoning in the preclerkship phase. VIP and OSCE can be used to identify students at risk of low performance in the clerkship year.

Remediation in Pediatric Residency Training: A National Survey of Pediatric Program Directors

BACKGROUND

The goal of graduate medical education is for residents to achieve the skills and knowledge to practice medicine independently. While remediation is not uncommon in residency training, evidence is lacking to guide best practices.

METHODS

We conducted a national survey of pediatric residency programs regarding their remediation experiences identifying struggling residents, documentating the process, and monitoring progress during remediation.

RESULTS

A total of 50.8% (99/195) programs responded. Approximately 4.7% of residents underwent remediation, and 91% (262/288) of residents successfully completed remediation. Programs used data from the Clinical Competency Committee (CCC; 100%), rotation evaluations (98.9%) and direct observation (96.6%) to identify residents who need remediation. Most programs used an improvement plan to document resident progress (88.8%) and assigned a mentor or coach to support the resident (88.8%). Nearly all programs used rotation evaluations (93.3%) to monitor progress towards achieving the goals of remediation. Two-thirds (66.3%) felt their remediation process was either very effective or effective, and about half (56.2%) were very satisfied or satisfied with their remediation process. Programs with more residents who successfully completed remediation were more likely to feel satisfied with their program's remediation processess and effectiveness.

CONCLUSIONS

Nearly 5% of pediatrics residents undergo remediation, with 91% successfully remediating. Two-thirds of program leaders feel their remediation practices are effective, and only half are satisfied with remediation processes in their program. Opportunities exist to improve remediation processes for pediatric residents and for programs to ensure graduation of competent pediatricians.

Is "No News is Good News" Enough? A Thematic Analysis Exploring Clinical Reasoning Assessment in Pediatric Residency Programs

OBJECTIVE

Clinical reasoning (CR) includes numerous essential skills for clinicians, but how these skills are assessed in pediatric residency training is not well described. This study aimed to explore pediatric residency program leader perspectives on CR assessment and identification of trainee deficiencies in this area.

METHODS

Taking a social constructionist worldview, we conducted a thematic analysis of 20 semistructured interviews with pediatric residency program leaders. Interviews explored how pediatric residency programs assess CR and how deficiencies are identified. Recruitment and analysis continued iteratively until thematic sufficiency was reached. Member checking enhanced the trustworthiness of the results.

RESULTS

Participants noted a perceived lack of a shared mental model for CR assessment between program leaders and clinical supervisors. Four themes were generated to highlight CR assessment in pediatric residency programs: 1) Clinical supervisors escalate concerns about behaviors representing symptoms of CR deficits rather than diagnosing CR competency deficiencies and that CR assessment requires, 2) an outward display of autonomous decision-making, 3) psychologically safe environments for inquiry, and 4) longitudinal, individualized observation. Elements of pediatric residency programs that impede CR assessment were identified, including family-centered rounds and team-based clinical care.

CONCLUSIONS

This study identified key components necessary for CR assessment and barriers that may lead to missed identification of deficiencies. While no single solution can create an ideal environment for CR assessment, this study identifies elements for enhancing assessment opportunities for early identification of deficiencies.

Medical students' unprofessional behavior and educators' support

In recent years, professionalism education has been incorporated into medical education as an important part of the curriculum. Through receiving professionalism education, most medical students gradually acquire professionalism, including a professional attitude. However, some medical students demonstrate unprofessional behavior that raises concerns among faculty and other students. There are various stages to dealing with unprofessional behavior, as follows: definition, prevention, detection, evaluation, correction, and follow-up. However, it is often difficult to identify unprofessional behavior and respond appropriately. In this study, overview of medical students' unprofessional behavior from previous studies on medical students' unprofessionalism behavior, and how to identify and evaluate medical students' unprofessional behavior, and effective education that can correct medical students' unprofessional behavior was analyzed by reviewing 52 articles. Medical students' unprofessional behavior is classified into the following four categories: "lack of involvement," "lack of integrity," "lack of interaction," and "lack of introspection." The occurrence of unprofessional behavior was found to be attributed to personal problems, interpersonal problems, external factors, and environmental factors. Educators analyzed unprofessional behavior and its causes from four categories. Medical students should perform reflective writing to help them reflect on their unprofessional behavior. Educators should use this reflective writing to interact with medical students, and to investigate and analyze the students' unprofessional behavior. Furthermore, educators will need to assess unprofessional behavior using a roadmap to address unprofessionalism, and to respond appropriately to each stage of the roadmap. Individualized educational interventions should be provided to help students correct their unprofessional behavior.

Ethical issues in unprofessional behavior of residents who dispute dismissal: ten year analysis of case law in hospital-based specialties

BACKGROUND

Residents who do not internalize professional values may not be a good fit for their specialty and compromise the quality of their patient care. Research aimed at recognizing residents' shortcomings in professionalism may help to prevent future shortcomings towards patients. The aim of this study was to increase insight into residents' shortcomings in medical professionalism in light of professional values relevant within residency training.

METHODS

We analyzed all law cases from the Dutch national conciliation board from 2011 to 2020 on the unprofessional behaviors described.

RESULTS

During the period investigated, 61 dismissed residents challenged their dismissal. In 39 of 61 cases (64%), the program director named unprofessional behavior(s) as (one of the) reasons for dismissal. The most prevalent deficit of residents deemed unprofessional was poor self-awareness (80%); less prevalent deficits were: shortness of engagement and dishonest and disrespectful behavior (31% or less).

CONCLUSIONS

We describe perceived unprofessional behavior in residency, which was not about exceptional or abominable behaviors. For the most part, these behaviors concerned the accumulation of remediation-resistant day-to-day underperformance, discrediting trust and professional reliability. This finding encourages dedicated longitudinal assessment of professionalism and fuels the ethical debate about required professional values in hospital care.

Interventions for undergraduate and postgraduate medical learners with academic difficulties: A BEME systematic review update: BEME Guide No. 85

BACKGROUND

Clinical teachers often struggle to record trainee underperformance due to lacking evidence-based remediation options.

OBJECTIVES

To provide updated evidence-based recommendations for addressing academic difficulties among undergraduate and postgraduate medical learners.

METHODS

A systematic review searched databases including MEDLINE, CINAHL, EMBASE, ERIC, Education Source, and PsycINFO (2016-2021), replicating the original Best Evidence Medical Education 56 review strategy. Original research/innovation reports describing intervention(s) for medical learners with academic difficulties were included. Data extraction used Michie's Behaviour Change Techniques (BCT) Taxonomy and program evaluation models from Stufflebeam and Kirkpatrick. Quality appraised used the Mixed Methods Appraisal Tool (MMAT). Authors synthesized extracted evidence by adapting GRADE approach to formulate recommendations.

RESULTS

Eighteen articles met the inclusion criteria, primarily addressing knowledge (66.7%), skills (66.7%), attitudinal problems (50%) and learner's personal challenges (27.8%). Feedback and monitoring was the most frequently employed BCT. Study quality varied (MMAT 0-100%). We identified nineteen interventions (UG: n = 9, PG: n = 12), introducing twelve new thematic content. Newly thematic content addressed contemporary learning challenges such as academic procrastination, and use of technology-enhanced learning resources. Combined with previous interventions, the review offers a total dataset of 121 interventions.

CONCLUSION

This review offers additional evidence-based interventions for learners with academic difficulties, supporting teaching, learning, faculty development, and research efforts.

Is insufficient introspection a reason to terminate residency training? - Scrutinising introspection among residents who disputed dismissal

INTRODUCTION

Insufficient introspection as part of the 4I's model of medical professionalism (introspection, integrity, interaction, and involvement) is considered an important impediment in trainees. How insufficient introspection relates to decisions to terminate residency training remains unclear. Insights into this subject provide opportunities to improve the training of medical professionals.

METHODS

We analysed the Dutch Conciliation Board decisions regarding residents dismissed from training between 2011 and 2020. We selected the decisions on residents deemed 'insufficient' regarding introspection as part of the CanMEDS professional domain and compared their characteristics with the decisions about residents without reported insufficiencies on introspection.

RESULTS

Of the 120 decisions, 86 dismissed residents were unable to fulfil the requirements of the CanMEDS professional domain. Insufficient introspection was the most prominent insufficiency (73/86). These 73 decisions described more residents' insufficiencies in CanMEDS competency domains compared to the rest of the decisions (3.8 vs. 2.7 p < 0.001), without significant differences regarding gender or years of training.

CONCLUSIONS

Insufficient introspection in residents correlates with competency shortcomings programme directors reported in dismissal disputes. The 4I's model facilitates recognition and description of unprofessional behaviours, opening avenues for assessing and developing residents' introspection, but further research is needed for effective implementation in medical education.

Remediation of Preclinical Course Failures in a DVM Program and Its Impact on Program Outcomes: A 10-Year Descriptive Study

Remediation provides academically struggling students reasonable opportunities to correct deficiencies in knowledge or skills, achieve competence, and potentially reverse failures. At Purdue University College of Veterinary Medicine, a remediation policy in the preclinical years of the DVM program was implemented beginning with the class of 2014. We evaluated its impact on our DVM program and student outcomes. Using data from DVM classes of 2011 to 2023, we compared academic outcomes between remediating and non-remediating class cohorts and, within remediating cohorts, between students with and without academic difficulties. Despite changes in class size and admissions criteria, 4-year graduation and relative attrition rates were similar in remediating (92.2% and 4.2%) and non-remediating (92.3% and 4.8%) cohorts. Success at the North American Veterinary Licensing Examination (NAVLE) prior to graduation was lower in remediating than in non-remediating cohorts (94.5% vs. 97.0%). Among 815 students in remediating cohorts, 157 (19.3%) failed ≥1 courses. Of the 157 students, 134 (85.4%) attempted remediation of ≥1 failed courses, 125 (79.6%) successfully remediated ≥1 failed courses, and 96 (61.1%) successfully remediated all their failed courses. Remediation occurred more often in first-year than in second- or third-year courses. While 99% of the 96 successfully remediated students graduated in 4 years, 13.5% failed ≥1 clinical blocks and 18.7% did not pass NAVLE before DVM graduation. Our remediation policy enabled successfully remediated students to avoid delayed graduation, but some students struggled in the clinical year and at passing the NAVLE prior to graduation. Additional support systems are necessary to help students pass the NAVLE before graduation.

Students Needing Remediation in Preclinical Course Failures in a DVM Program: A 10-Year Analytic Study

Remediation of preclinical course failures in the DVM program at Purdue University College of Veterinary Medicine began in 2010. We set out to understand whether some students were more likely than others to use remediation opportunities and succeed. Student demographics, undergraduate (UG) experiences, including institution attended and major studied, UG performance as measured by grade point average (uGPA), and extent of academic difficulties in DVM years 1-3 were studied at univariate levels to determine which students more often failed ≥1 courses, remediated ≥1 courses, and were successful in all remediation attempts. Among 815 students in DVM Classes 2014-2023, 157 failed ≥1 courses. Risk factors associated with failing ≥1 courses and with unsuccessful remediation were identified using multiple logistic regression analysis. Unsuccessful remediation, resulting in student's academic attrition, was defined as not succeeding at remediation of all failed courses, including being ineligible for or not attempting remediation. Risk factors were considered statistically significant at P value <0.05. Lower uGPA, having attended a minority-serving institution, and being an underrepresented minority or an international student were associated with increased likelihood of failing ≥1 courses. However, the only factors associated with unsuccessful remediation were failing ≥3 courses in DVM years 1-3 and failing at least one course in DVM year 1. No demographic or UG educational background is associated with unsuccessful remediation. Taken together, our models suggest that being at risk of failing ≥1 courses in DVM years 1-3 did not inevitably put students at risk of attrition when remediation opportunities were provided. However, an increasing number of course failures and failures beginning in DVM year 1 increased the risk of unsuccessful remediation. Early intervention to minimize academic difficulties in DVM program may mitigate risk of student attrition.

Characteristics of ADHD in Struggling Residents and Fellows

Background Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental condition that often results in poor academic performance. Little is known about how ADHD manifests in residents and fellows. Objective To describe the prevalence and phenotype of ADHD among residents and fellows referred to a centralized remediation program. Methods We conducted a retrospective review of data obtained from referrals to a single-center centralized graduate medical education remediation program from 2017 to 2023. Data included demographic variables, ADHD and mental health history, and training performance characteristics. ADHD was determined by self-report, clinical diagnosis by mental health provider, or neuropsychological testing. Results A total of 173 trainees were referred in the study period. The prevalence of ADHD was 20% (35 of 173). ADHD was most commonly diagnosed in childhood (57%, 20 of 35); however, 26% (9 of 35) were diagnosed during or after medical school. Only 37% (13 of 35) were on medication, and 69% (24 of 35) disclosed at least one concomitant mental health diagnosis. Performance deficits were common in professionalism (69%, 24 of 35), organization/efficiency (O/E; 63%, 22 of 35), and medical knowledge (46%, 16 of 35). Repeated errors in patient care were made by 34% (12 of 35); 29% (10 of 35) failed at least one board examination, and 20% (7 of 35) required extension of residency or fellowship training. When compared to referrals without ADHD, residents and fellows with ADHD were more likely to struggle with O/E, failure to engage, and repeated errors. Conclusions One in 5 trainees referred to a GME remediation program had ADHD, and most were not being treated for ADHD when referred. The deficits identified suggest an ADHD phenotype in GME which may be considered for struggling residents and fellows.

A Pilot Longitudinal Clinical Reasoning Curriculum for Pediatric Residents

Introduction

Clinical reasoning (CR) is required for physicians. Pediatric residents often gain CR skills through experiential learning. Currently, deliberate education on CR targeted toward pediatric residents is inconsistent. Our objective was to implement a pilot CR curriculum, including five hour-long sessions, and evaluate its impact on self-identified CR Milestones and comfort with CR skills.

Methods

We used Kern's six steps for curriculum development to develop our curriculum. Five morning report sessions included didactics and small-group activities. Pre/post surveys assessed resident self-identified level on ACGME Milestones related to CR skills (Patient Care 4 [PC4] and Medical Knowledge 2 [MK2]) and comfort with CR skills. The postsurvey assessed resident attitudes toward the sessions. Paired samples for Milestone and comfort-based questions were analyzed using Wilcoxon signed rank tests. Attitude questions were reported with descriptive statistics.

Results

Each of the five curricular sessions was attended by 40-50 pediatric residents. Seventy-one trainees (58% of residency) and 51 trainees (42% of residency) completed the pre- and postsurveys, respectively, with 20 paired samples. Self-assessment of PC4 (p = .006) and resident comfort with all measured CR skills increased significantly. Of trainees who attended at least one session (n = 44), most reported finding the sessions helpful (97%), relevant to their clinical work (97%), and impactful on their clinical practice (73%).

Discussion

Following exposure to this CR curriculum, pediatric residents reported increased self-identified competency levels on the evaluated Milestones and improved comfort with CR skills. Dedicated CR education may advance pediatric resident understanding of and comfort with CR.

Learning Plan Use in Undergraduate Medical Education: A Scoping Review

PURPOSE

How to best support self-regulated learning (SRL) skills development and track trainees' progress along their competency-based medical education learning trajectory is unclear. Learning plans (LPs) may be the answer; however, information on their use in undergraduate medical education (UME) is limited. This study summarizes the literature regarding LP use in UME, explores the student's role in LP development and implementation, and identifies additional research areas.

METHOD

MEDLINE, Embase, PsycInfo, Education Source, and Web of Science databases were searched for articles published from database inception to March 6, 2024, and relevant reference lists were manually searched. The review included studies of undergraduate medical students, studies of LP use, and studies of the UME stage in any geographic setting. Data were analyzed using quantitative and qualitative content analyses.

RESULTS

The database search found 7,871 titles and abstracts with an additional 25 found from the manual search for a total of 7,896 articles, of which 39 met inclusion criteria. Many LPs lacked a guiding framework. LPs were associated with self-reported improved SRL skill development, learning structure, and learning outcomes. Barriers to their use for students and faculty were time to create and implement LPs, lack of training on LP development and implementation, and lack of engagement. Facilitators included SRL skill development, LP cocreation, and guidance by a trained mentor. Identified research gaps include objective outcome measures, longitudinal impact beyond UME, standardized framework for LP development and quality assessment, and training on SRL skills and LPs.

CONCLUSIONS

This review demonstrates variability of LP use in UME. LPs appear to have potential to support medical student education and facilitate translation of SRL skills into residency training. Successful use requires training and an experienced mentor. However, more research is required to determine whether benefits of LPs outweigh the resources required for their use.

Multifaceted Strategy That Improves Students' Achievement of Entrustable Professional Activities Across Advanced Pharmacy Practice Experiences

OBJECTIVE

To outline an approach to help students achieve Entrustable Professional Activities (EPAs) entrustment during a sequence of Advanced Pharmacy Practice Experiences (APPEs) by implementing longitudinal monitoring and individualized intervention and remediation strategies.

METHODS

Using the recommended EPAs within the core APPEs (acute care, ambulatory care, community, institutional), students were expected to achieve entrustment on all EPAs by graduation. A longitudinal monitoring approach, using an "EPA report card," was implemented to continuously identify students at risk of not meeting the EPA requirement of "Level 3" entrustment (perform with reactive supervision). Individualized interventions, including proactive outreach and in-sequence remediation, were incorporated into the APPE core and elective sequence to help ensure all students were entrusted by the end of APPEs without requiring further end-of-year remediation to graduate.

RESULTS

For the graduating classes of 2023 and 2024, 12% (8 of 69) and 16% (12 of 75) students, respectively, were identified as at risk of not meeting EPA entrustment. Proactive outreach, in-sequence remediation, or a combination of both strategies, were used to enhance learning and EPA performance. As a result, all students achieved "Level 3" entrustment on the deficient EPA(s) by the end of the APPE sequence. No student required further end-of-year remediation to graduate.

CONCLUSION

Utilizing a multifaceted strategy provided timely, real-world practice opportunities to improve the students' achievement of EPAs across the APPE curriculum and decreased the need for end-of-year remediation and potential graduation delays.

Personal career decisions during medical training are not complicated, they are complex

BACKGROUND

For medical training to be deemed successful, in addition to gaining the skills required to make appropriate clinical decisions, trainees must learn how to make good personal decisions. These decisions may affect satisfaction with career choice, work-life balance, and their ability to maintain/improve clinical performance over time-outcomes that can impact future wellness. Here, the authors introduce a decision-making framework with the goal of improving our understanding of personal decisions.

METHODS

Stemming from the business world, the Cynefin framework describes five decision-making domains: clear, complicated, complex, chaotic, and confusion, and a key inference of this framework is that decision-making can be improved by first identifying the decision-making domain. Personal decisions are largely complex-so applying linear decision-making strategies is unlikely to help in this domain.

RESULTS

The available data suggest that the outcomes of personal decisions are suboptimal, and the authors propose three mechanisms to explain these findings: (1) Complex decision is susceptible to attribute substitution where we subconsciously trade these decisions for easier decisions; (2) predictions are prone to cognitive biases, such as assuming our situation will remain constant (linear projection fallacy), believing that accomplishing a goal will deliver lasting happiness (arrival bias), or overestimating benefits and underestimating costs of future tasks (planning fallacy); and (3) complex decisions have an inherently higher failure rate than complicated decisions because they are the result of an ongoing, dynamic person-by-situation interaction and, as such, have more time to fail and more ways to do so.

DISCUSSION

Based upon their view that personal decisions are complex, the authors propose strategies to improve satisfaction with personal decisions, including increasing awareness of biases that may impact personal decisions. Recognising that the outcome of personal decisions can change over time, they also suggest additional interventions to manage these decisions, such as different forms of mentoring.

A Targeted Clinical Reasoning Remediation Program for Residents and Fellows in Need

Background There is no standardized, widely accepted process for individualized clinical reasoning remediation. Objective We describe a novel, targeted assessment and coaching process that allows for individualized intervention for residents and fellows struggling with clinical reasoning. Methods Residents and fellows at the University of Virginia with performance concerns are referred to COACH (Committee on Achieving Competence Through Help) and assessed by a remediation expert. A subset is referred to a clinical reasoning remediation coach who performs an additional assessment and cocreates an individualized remediation plan. Following remediation, residents and fellows are reassessed by their respective programs. We report the frequency of struggle, remediation time invested, and academic outcomes. Results From 2017 to 2022, 114 residents and fellows referred to COACH met inclusion criteria, of which 38 (33%) had a deficiency in clinical reasoning. Targeted assessment revealed the following microskill deficits: hypothesis generation (16 of 38, 42%); data gathering (6 of 38, 16%); problem representation (7 of 38, 18%); hypothesis refinement (3 of 38, 8%); and management (6 of 38, 16%). Remediation required a mean of nearly 23 hours per trainee. Of the 38 trainees, 33 (87%) are in good standing at the time of writing. Conclusions Our unique program offers a feasible, targeted approach to clinical reasoning remediation based on our current understanding of the clinical reasoning process. Early hypothesis generation was the most common microskill deficit identified.

Assessment of Clinical Reasoning in Undergraduate Medical Education: A Pragmatic Approach to Programmatic Assessment

PURPOSE

Clinical reasoning, a complex construct integral to the practice of medicine, has been challenging to define, teach, and assess. Programmatic assessment purports to overcome validity limitations of judgments made from individual assessments through proportionality and triangulation processes. This study explored a pragmatic approach to the programmatic assessment of clinical reasoning.

METHOD

The study analyzed data from 2 student cohorts from the University of Utah School of Medicine (UUSOM) (n = 113 in cohort 1 and 119 in cohort 2) and 1 cohort from the University of Colorado School of Medicine (CUSOM) using assessment data that spanned from 2017 to 2021 (n = 199). The study methods included the following: (1) asking faculty judges to categorize student clinical reasoning skills, (2) selecting institution-specific assessment data conceptually aligned with clinical reasoning, (3) calculating correlations between assessment data and faculty judgments, and (4) developing regression models between assessment data and faculty judgments.

RESULTS

Faculty judgments of student clinical reasoning skills were converted to a continuous variable of clinical reasoning struggles, with mean (SD) ratings of 2.93 (0.27) for the 232 UUSOM students and 2.96 (0.17) for the 199 CUSOM students. A total of 67 and 32 discrete assessment variables were included from the UUSOM and CUSOM, respectively. Pearson r correlations were moderate to strong between many individual and composite assessment variables and faculty judgments. Regression models demonstrated an overall adjusted R2 (standard error of the estimate) of 0.50 (0.19) for UUSOM cohort 1, 0.28 (0.15) for UUSOM cohort 2, and 0.30 (0.14) for CUSOM.

CONCLUSIONS

This study represents an early pragmatic exploration of regression analysis as a potential tool for operationalizing the proportionality and triangulation principles of programmatic assessment. The study found that programmatic assessment may be a useful framework for longitudinal assessment of complicated constructs, such as clinical reasoning.

Perceptions of Remediation Policies and Procedures in Pharmacy Education

OBJECTIVE

This study aimed to (1) explore the perceptions of current remediation processes among pharmacy program administrators and faculty, and (2) identify factors surrounding successful or unsuccessful remediation in a pharmacy program.

METHODS

This qualitative study used the following 3 stakeholder focus groups with distinct perspectives: didactic faculty, experiential faculty, and administrators. A screening survey was used to identify eligible participants, and quota sampling was used to represent various institution types and stakeholder experience. Focus groups were conducted using structured interview questions by an expert interviewer who was not part of the research team. Data were coded using the constant comparison method until consensus was achieved on the identified themes.

RESULTS

Three themes associated with remediation were identified with 12 coded categories. The codes discussed by all 3 stakeholder groups included methods to identify students who need remediation, types of remediation, remediation challenges, consequences of remediation, remediation effectiveness, and necessary improvements to the remediation process. The didactic and experiential faculty groups discussed the management of remediation plans, methods of remediation prevention, and lessons learned from remediation. The timing of remediation was discussed by didactic faculty. The experiential faculty noted the need for preceptor development to provide timely feedback and ensure successful remediation. All 3 groups mentioned having clear policies and procedures for successful remediation.

CONCLUSION

Overall, faculty and administrators had similar perceptions regarding remediation practices. The differences in concerns about remediation were most notable between the experiential and didactic faculty. While all 3 groups believed that remediation may be useful and necessary, challenges remain and monitoring is needed to determine the most effective practices, particularly in experiential education.

'The program director's word … it's stronger than the word of God': Epistemic injustice revealed through narratives of remediated graduate medical education residents

BACKGROUND

Though graduate medical education (GME) residency training provides positive experiences for many trainees, it may also result in major stressors and negative experiences, particularly for those requiring remediation. Residents requiring remediation may experience feelings of dismay, shame and guilt that can negatively affect their training, self-efficacy and their medical careers. Power differentials between educators and residents may set the stage for epistemic injustice, which is injustice resulting from the silencing or dismissing a speaker based on identity prejudice. This can lead to decreased willingness of trainees to engage with learning. There is a paucity of literature that explores GME experiences of remediation from the resident perspective.

OBJECTIVE

To synthesise the narratives of physician experiences of remediation during residency through the lens of epistemic injustice.

METHODS

Between January and July 2022, we interviewed US physicians who self-identified as having experienced remediation during residency. They shared events that led to remediation, personal perspectives and emotions about the process and resulting outcomes. Interviews were analysed using narrative analysis with attention to instances of epistemic injustice.

RESULTS

We interviewed 10 participants from diverse backgrounds, specialties and institutions. All participants described contextual factors that likely contributed to their remediation: (1) previous academic difficulty/nontraditional path into medicine, (2) medical disability or (3) minoritised race, gender or sexual identity. Participants felt that these backgrounds made them more vulnerable in their programmes despite attempts to express their needs. Participants reported instances of deflated credibility and epistemic injustices with important effects.

CONCLUSIONS

Participant narratives highlighted that deep power and epistemic imbalances between learners and educators can imperil GME trainees' psychological safety, resulting in instances of professional and personal harm. Our study suggests applying an existing framework to help programme directors (PDs) approach remediation with epistemic humility.

A Cycle of Reinforcing Challenges and Ideas for Action in Experiential Settings

Evidence suggests that both pharmacy students and preceptors are struggling in the experiential setting. Underlying this phenomenon is a potential interconnected and cyclic set of behaviors being reinforced between students and preceptors. These behaviors can contribute to or are the result of higher levels of burnout and a decrease in the development of student clinical skills and subsequent performance on rotation. In this review, the authors investigate various challenges commonly encountered in the experiential environment. These challenges can range from an observed decrease in student engagement, motivation, and critical thinking skills to an increase in preceptor burnout and culture shifts in the clinical practice environments. These factors all ultimately impact patient care and overall student performance. For each challenge identified, strategies will be presented that can be implemented by students, preceptors, and pharmacy programs to break the cyclic pattern identified.

Hiding in Plain Sight: Resident Remediation in Obstetrics and Gynecology

OBJECTIVE

Residents who are in need of remediation are prevalent across residency programs and often tend to be deficient in multiple competencies that the American Council for Graduate Medical Education (ACGME) has established. The purpose of this study was to determine the prevalence of residents requiring remediation, understand the scope of the challenges in resident remediation, and assess what resources were used to aid in remediation in obstetrics and gynecology programs.

DESIGN

An anonymous survey was emailed to obstetrics and gynecology program directors. Survey responses were summarized through descriptive statistics.

SETTING

Obstetrics and gynecology residency program directors were invited to respond to this survey.

PARTICIPANTS

Thirty-nine respondents out of 241 residency training programs responded (16%).

RESULTS

The majority (84.6%) of programs had placed a resident on remediation. The most common area requiring remediation was professionalism (75.8%), followed by medical knowledge (72.7%), interpersonal communication (60.6%), laparoscopic technical skills (54.6%), and inpatient care (42.4%). Residents who required remediation were identified in a number of ways, most commonly through feedback from the Clinical Competency Committee (87.8%) and faculty feedback (84.8%). Program directors utilized a variety of resources, most commonly prior remediation plans from the program, to create remediation plans. Sixty percent of programs had residents who failed remediation.

CONCLUSION

This study highlighted the prevalence of resident remediation in obstetrics and gynecology training programs and the importance of faculty in identifying residents in need of remediation, evaluating residents, and mentoring residents.

Implementation and Outcomes of an Academic Peer Coaching Program for Pediatric Residents

Introduction Academic coaching fosters self-directed learning and is growing in popularity within residency programs. Implementation is often limited by available faculty time and funding. Peer coaching is an emerging alternative but is not well studied. This study aims to demonstrate the acceptability, feasibility, and efficacy of a resident peer coaching program. Methodology In the 2021-2022 academic year, within a large pediatric residency program, we selected and trained senior residents as coaches and interns who opted in as coachees. Coaching dyads began meeting in the fall and worked toward individualized goals throughout the year; control interns participated in routine didactics. Outcomes included Accreditation Council for Graduate Medical Education (ACGME) milestone scores and a self-assessment survey (SAS). Results We enrolled 15/42 (36%) interns as coachees, with the remaining 27 (64%) as controls. Narrative feedback from coaches and coachees was overall positive, and time commitment was feasible for program staff (10-12 hours/month), coaches (three to four hours/month), and coachees (one to two hours/month) with minimal financial needs. Post-intervention, more coachees than controls scored ≥4.0 on ACGME milestones systems-based practice 3 (SBP3; 3/15, 20%, vs. 2/27, 7%), SBP4 (4/15, 27%, vs. 5/27, 19%), and practice-based learning and improvement 1 (4/15, 27%, vs. 3/27, 11%). SAS response rate was 8/15 (53%) for coachees and 5/27 (19%) for controls. More coachees than controls reported baseline difficulty with time management often (3/8, 38%, vs. 1/5, 20%); only coachees improved post-intervention, with 0/8 (0%) having difficulty often versus 2/5 (40%) of controls. Conclusions Resident peer coaching is acceptable and feasible to implement. Coachees reported more improvement in time management than controls, and ACGME milestone scores suggest improved use of evidence-based medicine and interprofessional care coordination among coachees.

Pre- and post-examination reflections of first-year medical students in an integrated medical anatomy course

Due to the rigor and pace of undergraduate medical anatomy courses, it is not uncommon for students to struggle and fail initially. However, repetition of coursework places an additional burden on the student, instructor, and institution. The purpose of this study was to compare the exam preparation strategies of repeating and non-repeating students to identify areas where struggling students can be supported prior to course failure. As part of their integrated anatomy course, first-year medical students at Indiana University completed a metacognitive Practice-Based Learning and Improvement (PBLI) assignment prior to and after their first exam. In the PBLIs, students were asked to reflect on their exam preparation strategies, confidence, and satisfaction, as well as their predicted and actual exam performance. PBLI responses from non-repeating and repeating students were then analyzed quantitatively and qualitatively. A total of 1802 medical students were included in this study, including 1751 non-repeating and 51 repeating students. Based on their PBLI responses, non-repeating students were appropriately confident, somewhat satisfied, and more accurate when predicting their exam performance. Repeating students were overconfident, dissatisfied, and inaccurate when predicting their first exam performance on their initial, unsuccessful attempt but were more successful on their second, repeat attempt. Qualitative analysis revealed that repeating students aimed to improve their studying by modifying their existing study strategies and managing their time more effectively. In conjunction with other known risk factors, these insights into repeater and non-repeater exam preparation practices can help anatomy educators better identify and support potential struggling students.

Development and Validation of a Formative Assessment Tool for Nephrology Fellows' Clinical Reasoning

BACKGROUND

Diagnostic errors are commonly driven by failures in clinical reasoning. Deficits in clinical reasoning are common among graduate medical learners, including nephrology fellows. We created and validated an instrument to assess clinical reasoning in a national cohort of nephrology fellows and established performance thresholds for remedial coaching.

METHODS

Experts in nephrology education and clinical reasoning remediation designed an instrument to measure clinical reasoning through a written patient encounter note from a web-based, simulated AKI consult. The instrument measured clinical reasoning in three domains: problem representation, differential diagnosis with justification, and diagnostic plan with justification. Inter-rater reliability was established in a pilot cohort ( n =7 raters) of first-year nephrology fellows using a two-way random effects agreement intraclass correlation coefficient model. The instrument was then administered to a larger cohort of first-year fellows to establish performance standards for coaching using the Hofstee method ( n =6 raters).

RESULTS

In the pilot cohort, there were 15 fellows from four training program, and in the study cohort, there were 61 fellows from 20 training programs. The intraclass correlation coefficients for problem representation, differential diagnosis, and diagnostic plan were 0.90, 0.70, and 0.50, respectively. Passing thresholds (% total points) in problem representation, differential diagnosis, and diagnostic plan were 59%, 57%, and 62%, respectively. Fifty-nine percent ( n =36) met the threshold for remedial coaching in at least one domain.

CONCLUSIONS

We provide validity evidence for a simulated AKI consult for formative assessment of clinical reasoning in nephrology fellows. Most fellows met criteria for coaching in at least one of three reasoning domains, demonstrating a need for learner assessment and instruction in clinical reasoning.

Exam prediction and the general Practice Registrar Competency Assessment Grid (GPR-CAG)

BACKGROUND

In GP training, identifying early predictors of poor summative examination performance can be challenging. We aimed to establish whether external clinical teaching visit (ECTV) performance, measured using a validated instrument (GP Registrar Competency Assessment Grid, GPR-CAG) is predictive of Royal Australian College of General Practitioners (RACGP) Fellowship examination performance.

METHODS

A retrospective cohort study including GP registrars in New South Wales/Australian Capital Territory with ECTV data recorded during their first training term (GPT1), between 2014 and 2018, who attempted at least one Fellowship examination. Independent variables of interest included the four GPR-CAG factors assessed in GPT1 ('patient-centredness/caring', 'formulating hypotheses/management plans', 'professional responsibilities', 'physical examination skills'). Outcomes of interest included individual scores of the three summative examinations (Applied Knowledge Test (AKT); Key Feature Problem (KFP); and the Objective Structured Clinical Examination (OSCE)) and overall Pass/Fail status. Univariable and multivariable regression analyses were performed.

RESULTS

Univariably, there were statistically significant associations (p < 0.01) between all four GPR-CAG factors and all four summative examination outcomes, except for 'formulating hypotheses/management plans' and OSCE score (p = 0.07). On multivariable analysis, each factor was significantly associated (p < 0.05) with at least one exam outcome, and 'physical examination skills' was significantly associated (p < 0.05) with all four exam outcomes.

DISCUSSION

ECTV performance, via GPR-CAG scores, is predictive of RACGP Fellowship exam performance. The univariable findings highlight the pragmatic utility of ECTVs in flagging registrars who are at-risk of poor exam performance, facilitating early intervention. The multivariable associations of GPR-CAG scores and examination performance suggest that these scores provide predictive ability beyond that of other known predictors.

Dismissed Psychiatry Residents Who Appeal: Exploring Unprofessional Behavior

OBJECTIVE

Dutch psychiatry residents who are dismissed from their training program have the opportunity to appeal the decision. Those appeals are publicly available. This report explores the appeals of residents dismissed for unprofessional behavior.

METHODS

The authors analyzed caselaw of dismissed psychiatry residents brought before the conciliation board of The Royal Dutch Medical Association and compared them to a control group of caselaw of dismissed family medicine residents.

RESULTS

From 2011 to 2020, 19 psychiatry residents were dismissed for failing to meet the competencies of the CanMEDS professional domain and matched with 19 family medicine residents. Most psychiatry residents deficient in professionalism were considered deficient in their attitude, in reliability of keeping agreements, or in their ability to profit from supervisors' feedback. Insufficient professional behavior overlapped with insufficient communication, collaboration, and management. Half of the psychiatry residents with deficits in professionalism went on sick leave at some time. Between residents in psychiatry and family medicine, or between psychiatry residents with and without a favorable conciliation board decision, no statistical differences were found regarding gender, year of residency, and number of insufficient competencies.

CONCLUSIONS

The deficiencies in the professionalism of residents who challenged their program director's decision to be dismissed mostly consisted of inadequate attitude or the inability to profit from feedback, suggesting that these residents lack empathy, introspection, or both.

WR, Farrell SE, Hundert EM, Dalrymple JL, Goldhamer MEJ. A pilot clinical skills coaching program to reimagine remediation: a cohort study

Background New approaches are needed to improve and destigmatize remediation in undergraduate medical education (UME).  The COVID-19 pandemic magnified the need to support struggling learners to ensure competency and readiness for graduate medical education (GME).  Clinical skills (CS) coaching is an underutilized approach that may mitigate the stigma of remedial learning. Methods A six-month CS coaching pilot was conducted at Harvard Medical School (HMS) as a destigmatized remedial learning environment for clerkship and post-clerkship students identified as 'at risk' based on objective structured clinical examinations (OSCE).  The pilot entailed individual and group coaching with five faculty, direct bedside observation of CS, and standardized patient encounters with video review. Strengths-based coaching principles and appreciative inquiry were emphasized.  Results Twenty-three students participated in the pilot: 14 clerkship students (cohort 1) and 9 post-clerkship students (cohort 2).  All clerkship students (cohort 1) demonstrated sustained improvement in CS across three OSCEs compared to baseline: at pilot close, at 6-months post pilot, and at 21-24 months post-pilot all currently graduating students (10/10, 100%) passed the summative OSCE, an HMS graduation requirement. All post-clerkship students (cohort 2) passed the HMS graduation OSCE (9/9,100%). Feedback survey results included clerkship students (9/14; 64%) and post-clerkship students (7/9; 78%); all respondents unanimously agreed that individual coaching was "impactful to my clinical learning and practice". Faculty and leadership fully supported the pilot as a destigmatized and effective approach to remediation.  Conclusion Remediation has an essential and growing role in medical schools.  CS coaching for remedial learning can reduce stigma, foster a growth mindset, and support sustained progress for 'at risk' early clerkship through final year students. An "implementation template" with suggested tools and timelines can be locally adapted to guide CS coaching for UME remediation. The CS coaching pilot model is feasible and can be generalized to many UME programs.

Do deficiencies in CanMEDS competencies of dismissed residents differ according to specialty?

INTRODUCTION

Program directors dismiss a small percentage of residents from residency training programs, presumably due to underperformance or lack of progress. Whether underperformance in competency domains differs by residents' specialty is unknown.

METHODS

In 2021, we analysed the case law of Dutch residents who were dismissed from training by the program director, and who challenged this dismissal before the national conciliation board between 2011 and 2020. Across medical specialties we compared which of the CanMEDS competency domains these residents failed to meet.

RESULTS

We found 116 cases of residents dismissed from their training programmes who challenged the decision of the program director before the board. In general, most residents were unable to meet the requirements of several CanMEDS competency domains (usually: medical expert, communicator, and professional). In surgery, all dismissed residents failed to meet the competency domain of the medical expert, while most of the dismissed psychiatry residents met this domain. In specialties with a primarily diagnostic task, more dismissed residents failed to meet the competency domain of the scholar, while dismissed general medicine residents (for example family medicine and nursing homecare) were less likely to do so. Residents in general medicine, more often than other specialties, however, failed to meet the competency domain of the professional.

CONCLUSION

Residents dismissed from training, who challenged their dismissal, failed to meet the requirements of multiple CanMEDS competency domains. Competency domain failures differ by specialty.

Changing the Landscape of Remediation: The Creation and Implementation of an Institution-Wide Graduate Medical Education Performance Enhancement Program

Purpose Remediation is a daunting process for both residency leadership and trainees due to several factors including limited time and resources, variable processes, and negative stigma. Our objective was to transform the remediation process by creating a transparent institution-wide program that collates tools/resources, interdepartmental faculty mentors, and positive rebranding. Methods Education leadership across seven specialties created a process for trainees with professionalism and interpersonal-communication skills deficiencies. Formalized departmental program-based improvement plan (PIP) and an institutional house staff performance enhancement plan (HPEP) were developed by consensus of triggers/behaviors. Utilizing published literature, a toolkit was created and implemented. Trainees were enrolled in HPEP if PIP was unsuccessful or exhibited ≥1 major trigger. Wellness evaluations were incorporated into the process to screen for external contributing factors. Surveys were sent to the program director (PD), faculty mentor, and trainee one month and six months after participation. Results Between 2018 and 2021, 12 trainees were enrolled. Overall feedback from PDs and the trainees was positive. The main challenge was finding mutual time for the faculty mentor and trainee to meet. Six-month surveys reported no relapses in unprofessionalism. One-year follow-up of the trainees was limited. Conclusions Utilizing an institution-wide standardized process of performance improvement with the removal of negative stereotyping is a unique approach to remediation. Initial feedback is promising, and future outcome data are necessary to assess the utility. The HPEP may be adopted by other academic institutions and may shift the attitudes about remediation and allow trainees to see the process as an opportunity for professional growth.

Pharmacy education and workforce: strategic recommendations based on expert consensus in Lebanon

Pharmacy in Lebanon has been taught for years, and the profession has known the golden ages in previous years. However, with the recent graduation of hundreds of pharmacists, without prior workforce planning, the oversupply of non-specialized pharmacists caused a mismatch with the needs of the market. The context of severe socioeconomic and sanitary crises has further exacerbated the situation, with hundreds of pharmacists leaving the country. A group of pharmacy experts joined to suggest strategic solutions to face such challenges, suggesting a clear strategy for education and the workforce, overarched by educational and professional values and based on six main pillars: (1) implement a national competency framework (including the core and specialized competency frameworks) to be used as a basis for licensure (colloquium); (2) implement a national pharmacy program accreditation, encompassing standards related to competencies adoption and assessment, curricula, teaching methods, research and innovation, instructors' and preceptors' skills, and experiential training; (3) organize training for students and early-career pharmacists; (4) optimize continuing education and implement continuous professional development, fostering innovation and specialization among working pharmacists; (5) develop and implement a pharmacy workforce strategy based on pharmacy intelligence, job market, and academic capacities; (6) develop and implement a legal framework for the above-mentioned pillars in collaboration with ministries and parliamentary commissions. Under the auspices of the relevant authorities, mainly the Order of Pharmacists of Lebanon and the Ministry of Education and Higher Education, the suggested strategy should be discussed and implemented for a better future for the pharmacy profession.

Best Practices for Remediation in Pulmonary and Critical Care Medicine Fellowship Training

Background

Remediation of struggling learners in pulmonary and critical care fellowship programs is a challenge, even for experienced medical educators.

Objective

This evidence-based narrative review provides a framework program leaders may use to address fellows having difficulty achieving competency during fellowship training.

Methods

The relevant evidence for approaches on the basis of each learner’s needs is reviewed and interpreted in the context of fellowship training in pulmonary medicine and critical care. Issues addressed include bias in fellow assessments and remediation, the impacts of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic, the specific challenges of pulmonary and critical care fellowship programs, a brief review of relevant legal issues, guidance on building and leveraging program resources, and a discussion of learner outcomes.

Results

This results in a concise, evidence-based toolkit for program leaders based around four pillars: early identification, fellow assessment, collaborative intervention, and reassessment. Important concepts also include the need for documentation, clear and written communication, and fellow-directed approaches to the creation of achievable goals.

Conclusion

Evidence-based remediation helps struggling learners in pulmonary and critical care fellowship to improve their ability to meet Accreditation Council for Graduate Medical Education (ACGME) milestones.

REACT: Rapid Evaluation Assessment of Clinical Reasoning Tool

INTRODUCTION

Clinical reasoning encompasses the process of data collection, synthesis, and interpretation to generate a working diagnosis and make management decisions. Situated cognition theory suggests that knowledge is relative to contextual factors, and clinical reasoning in urgent situations is framed by pressure of consequential, time-sensitive decision-making for diagnosis and management. These unique aspects of urgent clinical care may limit the effectiveness of traditional tools to assess, teach, and remediate clinical reasoning.

METHODS

Using two validated frameworks, a multidisciplinary group of clinicians trained to remediate clinical reasoning and with experience in urgent clinical care encounters designed the novel Rapid Evaluation Assessment of Clinical Reasoning Tool (REACT). REACT is a behaviorally anchored assessment tool scoring five domains used to provide formative feedback to learners evaluating patients during urgent clinical situations. A pilot study was performed to assess fourth-year medical students during simulated urgent clinical scenarios. Learners were scored using REACT by a separate, multidisciplinary group of clinician educators with no additional training in the clinical reasoning process. REACT scores were analyzed for internal consistency across raters and observations.

RESULTS

Overall internal consistency for the 41 patient simulations as measured by Cronbach's alpha was 0.86. A weighted kappa statistic was used to assess the overall score inter-rater reliability. Moderate reliability was observed at 0.56.

DISCUSSION

To our knowledge, REACT is the first tool designed specifically for formative assessment of a learner's clinical reasoning performance during simulated urgent clinical situations. With evidence of reliability and content validity, this tool guides feedback to learners during high-risk urgent clinical scenarios, with the goal of reducing diagnostic and management errors to limit patient harm.

Online Learning for Infectious Disease (ID) Fellows – a needs assessment

Background

Online resources and social media have become increasingly ubiquitous in medical education. Little is known about the need for educational resources aimed at infectious disease (ID) fellows.

Methods

We conducted an educational needs assessment through a survey that aimed to describe ID fellows’ current use of online and social media tools, assess the value of online learning, and identify the educational content preferred by ID fellows. We subsequently convened focus groups with ID fellows to explore how digital tools contribute to fellow learning.

Results

A total of 110 ID fellows responded to the survey. Over half were second-year fellows (61, 55%). Although many respondents were satisfied with the educational resources provided by their fellowship program (70, 64%), the majority were interested in an online collaborative educational resource (97, 88%). Twitter was the most popular social media platform for education and the most valued online resource for learning. Focus groups identified several themes regarding social medial learning: broadened community, low barrier to learning, technology-enhanced learning, and limitations of current tools. Overall, the focus groups suggest that fellows value social media and online learning.

Conclusions

ID fellows are currently using online and social media resources, which they view as valuable educational tools. Fellowship programs should consider these resources as complementary to traditional teaching and as a means to augment ID fellow education.

Associations between admissions factors and the need for remediation

This study examines the way in which student characteristics and pre-admissions measures are statistically associated with the likelihood a student will require remediation for academic and professionalism offenses. We anchor our inquiry within Irby and Hamstra's (2016) conceptual framework of constructs of professionalism. Data from five graduating cohorts (2014-2018) from McMaster University (Hamilton, Canada) (N = 1,021) were retroactively collected and analyzed using traditional and multinominal logistic regression analyses. The relationship among student characteristics, pre-admissions variables, and referral for potential remediation both by occurrence (yes/no) as well as type (academic/professional/no referral) were examined separately. Findings indicate that gender (OR = 0.519, 95% CI 0.326-0.827, p < 0.01) and undergraduate grade point average (GPA) (OR = 0.245, 95% CI 0.070-0.855, p < 0.05) were significantly associated with instances of referral for potential professionalism and academic remediation, respectively. Women were less likely than men to require remediation for professionalism (OR = 0.332, 95% CI 0.174-0.602, p < 0.001). Undergraduate GPAs (OR = 0.826, 95% CI 0.021-0.539, p < 0.01) were significantly associated with remediation for academic reasons. Lower undergraduate GPAs were associated with a higher likelihood of remediation. These findings point to the admissions variables that are associated with instances that prompt referral for potential remediation. Where associations are not significant, we consider the application of different conceptualizations of professionalism across periods of admissions and training. We encourage those involved in applicant selection and student remediation to emphasize the importance of the interactions that occur between personal and contextual factors to influence learner behaviour and professional identity formation.

Characterization of Clinical Skills Remediation: A National Survey of Medical Schools

OBJECTIVES

Clinical skills instruction is a standard part of medical school curricula, but how institutions address learners who struggle in this area is less clear. Although recommendations for the remediation of clinical skills at an institutional level have been published, how these recommendations are being implemented on a national scale is unknown. In this descriptive study, we characterize current clinical skills remediation practices at US medical schools and US-accredited Caribbean medical schools.

METHODS

We conducted a cross-sectional survey of medical educators who work with struggling students. From March 24, 2020 to April 9, 2020, the Directors of Clinical Skills Remediation Working Group conducted an e-mail survey incorporating four aspects of remediation program design and function: identification, assessment, active remediation, and ongoing evaluation.

RESULTS

In total, 92 individuals representing 45 institutions provided descriptive information about their respective remediation programs. The majority of respondents have a formal process of identifying (75%) and assessing (86%) students who are identified as struggling with clinical skills, but lack a standardized method of categorizing deficits. Fewer institutions have a standardized approach to active remediation and ongoing evaluation of struggling learners. Fifty-two percent of institutions provide training to faculty involved in the remediation process.

CONCLUSIONS

Although most institutions are able to identify struggling students, they lack a standardized approach to intervene. Remediation effectiveness is limited by a lack of student buy-in and institutional time, expertise, and resources. These findings highlight the need for more formalized structure and standardization in remediation program design and implementation.

Facing the "Fear of Failure": Veterinary Students in Clinical Rotations

Failing a student is difficult for both educator and student, but administering a failing grade is critical for protecting and ensuring adequate learning for an unsafe student. The failure to fail clinical students has been commonly reported and explored among educators in the human health professions but has not been formally addressed in veterinary education. Forty-three participants attending the Veterinary Educators Collaborative symposium were surveyed concerning their attitudes and experiences failing clinical veterinary students. Results indicated that the failure to fail phenomenon exists among veterinary educators, as the majority of veterinary educators often felt reluctant and unprepared to fail a student on clinical rotations. The most common barriers to failing students were institutional culture and unsatisfactory assessor development or evaluation tools. Veterinary educators must face this fear of failure and explore strategies to overcome existing barriers that can ultimately transform student failure into success.

Interactive Narrative Simulation as a Method for Preceptor Development

(1) Background: This proof-of-concept study assessed an interactive web-based tool simulating three challenging non-academic learning situations—student professionalism, cross-cultural interactions, and student well-being—as a means of preceptor development. (2) Methods: Three scripts focused on professionalism, cross-cultural interactions, and student well-being were developed and implemented using a commercial narrative tool with branching dialog. Delivered online, this tool presented each challenge to participants. Participants had up to four response options at each turn of the conversation; the choice of response influenced the subsequent conversation, including coaching provided at the resolution of the situation. Participants were invited to complete pre-activity, immediate post-activity, and one-month follow-up questionnaires to assess satisfaction, self-efficacy, engagement, and knowledge change with the tool. Knowledge was assessed through situational judgment tests (SJTs). (3) Results: Thirty-two pharmacist preceptors participated. The frequency of participants reflecting on challenging learning situations increased significantly one-month post-simulation. Participants affirmatively responded that the tool was time-efficient, represented similar challenges they encountered in precepting, was easily navigable, and resulted in learning. Self-efficacy with skills in managing challenging learning situations increased significantly immediately post-simulation and at a one-month follow-up. Knowledge as measured through SJTs was not significantly changed. (4) Conclusions: Preceptors found an interactive narrative simulation a relevant, time-efficient approach for preceptor development for challenging non-academic learning situations. Post-simulation, preceptors more frequently reflected on challenging learning situations, implying behavior change. Self-efficacy and self-report of knowledge increased. Future research is needed regarding knowledge assessments.

Emotion in remediation: A scoping review of the medical education literature

OBJECTIVES

Remediation can be crucial and high stakes for medical learners, and experts agree it is often not optimally conducted. Research from other fields indicates that explicit incorporation of emotion improves education because of emotion's documented impacts on learning. Because this could present an important opportunity for improving remediation, we aimed to investigate how the literature on remediation interventions in medical education discusses emotion.

METHODS

The authors used Arksey and O'Malley's framework to conduct a scoping literature review of records describing remediation interventions in medical education, using PubMed, CINAHL Complete, ERIC, Web of Science and APA PsycInfo databases, including all English-language publications through 1 May 2020 meeting search criteria. They included publications discussing remediation interventions either empirically or theoretically, pertaining to physicians or physician trainees of any level. Two independent reviewers used a standardised data extraction form to report descriptive information; they reviewed included records for the presence of mentions of emotion, described the mentions and analysed results thematically.

RESULTS

Of 1644 records, 199 met inclusion criteria and were reviewed in full. Of those, 112 (56%) mentioned emotion in some way; others focused solely on cognitive aspects of remediation. The mentions of emotion fell into three themes based on when the emotion was cited as present: during regular coursework or practice, upon referral for remediation and during remediation. One-quarter of records (50) indicated potential intentional incorporation of emotion into remediation programme design, but they were non-specific as to how emotions related to the learning process itself.

CONCLUSION

Even though emotion is omnipresent in remediation, medical educators frequently do not factor emotion into the design of remediation approaches and rarely explicitly utilise emotion to improve the learning process. Applications from other fields may help medical educators leverage emotion to improve learning in remediation, including strategies to frame and design remediation.

Optimising the delivery of remediation programmes for doctors: A realist review

CONTEXT

Medical underperformance puts patient safety at risk. Remediation, the process that seeks to 'remedy' underperformance and return a doctor to safe practice, is therefore a crucially important area of medical education. However, although remediation is used in health care systems globally, there is limited evidence for the particular models or strategies employed. The purpose of this study was to conduct a realist review to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety.

METHOD

We conducted a realist literature review consistent with RAMESES standards. We developed a programme theory of remediation by carrying out a systematic search of the literature and through regular engagement with a stakeholder group. We searched bibliographic databases (MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL, ERIC, ASSIA and DARE) and conducted purposive supplementary searches. Relevant sections of text relating to the programme theory were extracted and synthesised using a realist logic of analysis to identify context-mechanism-outcome configurations (CMOcs).

RESULTS

A 141 records were included. The majority of the studies were from North America (64%). 29 CMOcs were identified. Remediation programmes are effective when a doctor's insight and motivation are developed and behaviour change reinforced. Insight can be developed by providing safe spaces, using advocacy to promote trust and framing feedback sensitively. Motivation can be enhanced by involving the doctor in remediation planning, correcting causal attribution, goal setting and destigmatising remediation. Sustained change can be achieved by practising new behaviours and skills, and through guided reflection.

CONCLUSION

Remediation can work when it creates environments that trigger behaviour change mechanisms. Our evidence synthesis provides detailed recommendations on tailoring implementation and design strategies to improve remediation interventions for doctors.

Competence in Decision Making: Setting Performance Standards for Critical Care

BACKGROUND

Health care professionals must be able to make frequent and timely decisions that can alter the illness trajectory of intensive care patients. A competence standard for this ability is difficult to establish yet assuring practitioners can make appropriate judgments is an important step in advancing patient safety. We hypothesized that simulation can be used effectively to assess decision-making competence. To test our hypothesis, we used a "standard-setting" method to derive cut scores (standards) for 16 simulated ICU scenarios targeted at decision-making skills and applied them to a cohort of critical care trainees.

METHODS

Panelists (critical care experts) reviewed digital audio-video performances of critical care trainees managing simulated critical care scenarios. Based on their collectively agreed-upon definition of "readiness" to make decisions in an ICU setting, each panelist made an independent judgment (ready, not ready) for a large number of recorded performances. The association between the panelists' judgments and the assessment scores was used to derive scenario-specific performance standards.

RESULTS

For all 16 scenarios, the aggregate panelists' ratings (ready/not ready for independent decision making) were positively associated with the performance scores, permitting derivation of performance standards for each scenario.

CONCLUSIONS

Minimum competence standards for high-stakes decision making can be established through standard-setting techniques. We effectively identified "front-line" providers who are, or are not, ready to make independent decisions in an ICU setting. Our approach may be used to assure stakeholders that clinicians are competent to make appropriate judgments. Further work is needed to determine whether our approach is effective in simulation-based assessments in other domains.

Early Detection and Remediation of Problem Learners

There are myriad types of problem learners in surgical residency and most have difficulty in more than 1 competency. Programs that use a standard curriculum of study and assessment are most successful in identifying struggling learners early. Many problem learners lack appropriate systems for study; a multidisciplinary educational team that is separate from the team that evaluates the success of remediation is critical. Struggling residents who require formal remediation benefit from performance improvement plans that clearly outline the issues of concern, describe the steps required for remediation, define success of remediation, and outline consequences for failure to remediate appropriately.

Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review

Background

An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.

Objectives

To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.

Design

A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.

Data sources

Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.

Review methods

Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.

Results

A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.

Limitations

Limitations were the low quality of included literature and limited number of UK-based studies.

Future work

Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.

Study registration

This study is registered as PROSPERO CRD42018088779.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.

Developing a process to manage challenges encountered by experiential education administrators

INTRODUCTION

This study explored preceptor and student related issues reported in pharmacy experiential education settings and solutions that experiential education administrators (EEAs) applied to inform a process to manage these challenges.

METHODS

This mixed-methods study was conducted in two phases. In phase one, five EEAs from three schools of pharmacy collected quantitative and qualitative data over a two-year period on issues reported by students and preceptors and the solutions EEAs employed. Descriptive statistics and content analysis were used to analyze quantitative and qualitative data, respectively. Interviews with six EEAs from four schools were completed in phase two. An additional school was added in phase two. Open coding, pattern coding, and summative analysis were completed on interview data.

RESULTS

Preceptors and students reported 156 and 65 issues, respectively. The most common issues reported were student reliability/responsibility (22, 14%) and preceptor communication (13, 20%). The most frequently applied solutions were coach preceptor (51, 24%) and meet with student (20, 24%). Interviews revealed more information about the strategies EEAs used. Approaches included reactive responses such as talking to and coaching preceptors or students. Preventative strategies were desired, such as tracking data and training.

CONCLUSIONS

Results informed two approaches that EEAs can employ to resolve student and preceptor issues. In the proactive process, issues are tracked to inform student and preceptor development. The reactive approach involves meeting with the preceptor or student, gathering information from both parties, coaching the preceptor or student, and involving other administrators as needed for serious concerns.

The "Difficult Learner" in anesthesiology: Challenges, pitfalls, and recommendations

Struggling learners often require interventions that are time-consuming and emotionally exhausting for both the trainee and faculty. Numerous barriers, including lack of resources, faculty development, and fear of legal retribution, can impede medical educators from developing and implementing robust remediation plans. Despite the large volume of literature citing professionalism education and the "hidden curriculum" as problem areas in medical education, frontline educators lack practical tools and empowerment to address unprofessionalism in trainees. The paucity of resources in this arena has led to decreased job satisfaction, increased burnout, and an exodus from academic medicine. Department leadership acknowledgment and investment in training faculty on remediation strategies for learners in difficulty and providing tools to meet these challenging job demands will improve faculty's job satisfaction and overall well-being. The authors review salient literature and methodology for diagnosing learners in difficulty, with focus on a high-yield, pragmatic approach that can be taken by medical training programs, including those that lack a robust medical education infrastructure.