Situating Remediation: Accommodating Success and Failure in Medical Education Systems

Mapping Out Remediation: An Actionable Roadmap to Support Trainees Through Remediation

OBJECTIVE

The goal of graduate medical education is for trainees to develop the competence needed to practice independently; however, some residents struggle to achieve competency and require remediation. Evidence around how to best facilitate remediation is lacking. The objective of this study was to understand best practices for remediation in pediatrics.

METHODS

A national web-based survey of pediatric residency program directors (PDs) on remediation practices was performed. The survey included three open-ended questions about PDs' experiences with remediation. Self-reported barriers to and strategies for remediation were systematically analyzed using inductive thematic analysis to develop a theory of effective remediation in pediatric residency training.

RESULTS

A total of 99 out of 195 (50.8%) program directors responded. Two main themes emerged: developing a personalized plan that ensures competency attainment and fostering psychological safety. Twelve categories outline actionable steps that PDs can take to make the remediation process successful.

CONCLUSIONS

Built from insight from pediatric PDs, we propose a conceptual model for effective remediation that accounts for competency attainment while safeguarding the emotional health of the resident. The conceptual model breaks the remediation process down into four phases: identification of the learner who struggles, planning the remediation process, implementation of the plan, and assessing the outcome of the process.

ProFESS: Changing the Way Multidisciplinary Student's Professional Behaviour Lapses Are Identified and Managed. An Evaluation of Educators' Perspectives

BACKGROUND

Best practice evidence for identifying and managing professional behaviour lapses in a multidisciplinary context is lacking. This study aimed to evaluate multidisciplinary educators' attitudes and perceptions of the ProFESS (Professional standards, Ethical Behaviour and Student Support) framework and its companion Fitness for Practice model, designed and implemented at a large Australian university to address this using a behaviour change approach.

METHODS

A 72-item survey based on the Context, Input, Process, Product evaluation framework was completed by 92 multidisciplinary faculty educators and analysed using descriptive and inferential statistics. Content analysis of open text responses occurred.

FINDINGS

ProFESS and Fitness for Practice were found to be acceptable irrespective of the discipline using them, providing a supportive, transparent, consistent approach for identifying and managing a professional behaviour lapse. Other key strengths of the framework included its student-centredness and fostering a sense of safety for respondents with potential to improve student-educator relationships.

DISCUSSION

Our findings suggest that ProFESS enhances educators' confidence in managing professional behaviour lapses and that its structural flexibility and adaptability underpin its acceptability for multidisciplinary educators. Many of its positive attributes address the failure to fail barriers. The ProFESS method provides opportunities for greater consistency of application as it does not require individual interpretation of behaviour but does require education and training to apply consistently.

CONCLUSIONS

The acceptability of the ProFESS/FfP framework in a multidisciplinary healthcare education context is promising for integrating support and standards, fostering a safety culture for educators and reducing 'failure to fail' barriers.

Twelve tips to afford students agency in programmatic assessment

Programmatic assessment is gaining traction in health professions education, emphasizing continuous, integrated appraisal to support holistic student development. Despite its adoption, effectively affording student agency within programmatic assessment remains challenging due to longstanding educational practices, entrenched power dynamics and cultural norms favoring educator and institutional control. This article aims to provide strategies to promote student agency in programmatic assessments, essential for modernizing educational practices and preparing self-regulated, lifelong learners. The tips include establishing student-educator partnerships, making power dynamics transparent, designing purposeful and inclusive assessments, and normalizing bidirectional feedback conversations. The strategies emphasize the importance of a growth mindset, effective communication, and the role of coaches. The article also explores leveraging artificial intelligence to empower students. Affording students agency requires a significant cultural shift but holds the potential to transform health professions education. By promoting student autonomy and engagement, educators can better prepare students as capable, self-regulated professionals, enhancing the quality and effectiveness of health education programs.

Bridging the Gap: Implementing an Adjunct Faculty as a Remediation Specialist in a Physician Assistant/Associate Program

INTRODUCTION

Creating a successful remediation plan for physician assistant/associate students comes with its challenges, particularly because of the limited time available for both faculty and students. In an accelerated 24-month program, the pace of the curriculum leaves little time to fall behind in mastering knowledge and skills. One possible solution is appointing an adjunct faculty member to serve as a dedicated Remediation Specialist (RS) to focus solely on student remediation.

METHODS

The RS reviews assessments of failing students and develops a review session based on shared areas of weakness among them. This session is promptly offered postassessment to ensure timely review. While required for failing students, the session is open to all didactic students. In addition, students complete a remediation assignment of their choice.

RESULTS

Implementation of a RS demonstrated positive program outcomes. Students requiring remediation receive re-education in areas of deficiency within the curriculum. Furthermore, the time burden is shifted away from the core faculty. Students are remediated in targeted areas.

DISCUSSION

Dedicated remediation specialists are commonly used in health profession education programs. The utilization of these specialists often results in higher examination pass rates, licensure pass rates, and improved clinical skills. While some programs select a candidate training in education and pedagogy, our program's RS is a trained physician assistant/associate and able to provide discipline-specific support.

Impact and copying mechanisms towards retakes: A case study of five health training institutions in Sub Saharan Africa

Background

Academic examination retakes are significant challenges in health professions education. With rigorous clinical assessments and high-stakes examinations, many students struggle to meet academic requirements, resulting in retakes. The voices and experiences of such students have often been absent within the broader discussion of health professions education. This study aimed to assess the impact and copying mechanisms of medical and nursing students with retakes across five Sub-Saharan African universities.

Methods

This was a mixed-methods explanatory sequential study, integrating quantitative surveys and qualitative interviews. The study involved 764 medical and nursing clinical students from five universities across Sub Saharan Africa: Busitema University (Uganda), Mzuzu University (Malawi), University of Ibadan (Nigeria), Kwame Nkrumah University of Science and Technology (Ghana), and the University of Zambia. Quantitative data were analyzed using descriptive statistics. Qualitative data were explored through thematic analysis based on in-depth interviews with 15 purposively selected students who had experienced retakes.

Results

Overall, the proportion of students who had ever had a retake in clinical assessments was 12.6%. Thematic analysis revealed emotional and psychological challenges, such as shock, anxiety, fear and suicidal thoughts particularly due to insufficient institutional support and lack of feedback. Many students also reported a perceived sense of unfairness in their assessments.

Conclusions

The study highlights the multifaceted nature of retakes in health professions education in Sub-Saharan Africa. Recommendations for improvement include providing detailed feedback, transparency in assessments, and enhancing both academic and psychological support systems for students, particularly those at higher risk, such as older students and males. Further research is needed to investigate long-term academic and career outcomes and effective remediation strategies for students experiencing retakes.

Factors associated with retakes in health Professions Courses: A case study of Five selected Universities in Sub-Saharan Africa

Background

Academic examination retakes are significant challenges in health professions education. With rigorous clinical assessments, limited training resources and high-stakes examinations, students struggle to meet academic requirements which cab result in retakes. This study aimed to assess the proportion of medical and nursing students with retakes across five Sub-Saharan African universities and to explore factors contributing to the retakes.

Methods

This was a cross-sectional quantitative study. The study involved 764 medical and nursing clinical students from five universities across Sub Saharan Africa: Busitema University (Uganda), Mzuzu University (Malawi), University of Ibadan (Nigeria), Kwame Nkrumah University of Science and Technology (Ghana), and the University of Zambia. Data was analyzed using descriptive statistics and logistic regression to identify factors associated with retakes.

Results

Overall, the proportion of students who had ever had a retake in clinical assessments was 12.6%. Factors associated with retakes are age with students aged 25 and above showed a higher likelihood of failing compared to their younger counterparts (OR: 2.45, 95% CI: 1.06-5.64, P = 0.036) and gender with Male students more likely to get retakes compared to their female counterparts (OR: 1.91, 95% CI: 1.21-3.00, P = 0.005) at univariate, although this association was not statistically significant in multivariate analysis. OSCE was the most frequent examination format associated with retakes, accounting for 47.7% (P < 0.001).

Conclusions

The present study brings to light the proportion of students who experienced retakes and the factors associated with retakes among health professions students in Sub-Saharan Africa. This highlights the need for institutional interventions targeting at-risk populations: older and male students, and those with assessment problems related to the different modes of assessing clinical skills. Amelioration of these factors through appropriate support systems could minimize the proportion of students having to retake modules and create a more supportive academic environment. Further research might focus on exploring the proportion of students experiencing retakes in each country and thus determine factors that could contribute to high stakes towards retakes for each country so as to develop country specific solution and improved clinical skills assessment.

Multifaceted Strategy That Improves Students' Achievement of Entrustable Professional Activities Across Advanced Pharmacy Practice Experiences

OBJECTIVE

To outline an approach to help students achieve Entrustable Professional Activities (EPAs) entrustment during a sequence of Advanced Pharmacy Practice Experiences (APPEs) by implementing longitudinal monitoring and individualized intervention and remediation strategies.

METHODS

Using the recommended EPAs within the core APPEs (acute care, ambulatory care, community, institutional), students were expected to achieve entrustment on all EPAs by graduation. A longitudinal monitoring approach, using an "EPA report card," was implemented to continuously identify students at risk of not meeting the EPA requirement of "Level 3" entrustment (perform with reactive supervision). Individualized interventions, including proactive outreach and in-sequence remediation, were incorporated into the APPE core and elective sequence to help ensure all students were entrusted by the end of APPEs without requiring further end-of-year remediation to graduate.

RESULTS

For the graduating classes of 2023 and 2024, 12% (8 of 69) and 16% (12 of 75) students, respectively, were identified as at risk of not meeting EPA entrustment. Proactive outreach, in-sequence remediation, or a combination of both strategies, were used to enhance learning and EPA performance. As a result, all students achieved "Level 3" entrustment on the deficient EPA(s) by the end of the APPE sequence. No student required further end-of-year remediation to graduate.

CONCLUSION

Utilizing a multifaceted strategy provided timely, real-world practice opportunities to improve the students' achievement of EPAs across the APPE curriculum and decreased the need for end-of-year remediation and potential graduation delays.

Structured Intervention of Early Term Preclinical Veterinary Students Experiencing Academic Peril Improves Academic Performance

Veterinary medical students experiencing curricular challenges naturally look to their institution for resources to facilitate improvement in academic productivity. Academic remediation programs tend to be institution-specific, and their impact on student success is uncommonly interrogated using rigorous objective assessment. This study investigated the deployment of an academic development program (ADP) in the second semester of the Doctor of Veterinary Medicine (DVM) Program. The research focused on the impact of the ADP on student attrition, mean semester course grade improvements, and performance on the Veterinary Educational Assessment (VEA) examination. Performance metrics were compared between the ADP group and a control group (CG) of students from one semester ahead who were determined to be demographically equivalent and in the same class (bottom) quartile as the ADP group but did not have any structured academic remediation. The findings indicate that students participating in the ADP had less attrition and gradual increases in end-of-semester grades, such that by the beginning of their 5th semester, ADP students' grades were indistinguishable from upper quartiles in their class. This trend was not observed in the CG class with significant differences still present between the lower quartiles (i.e., CG) grades and the remainder of the class (p = .0046). ADP enrollment had a positive effect on VEA scores with mean scale score increased by 4.83 points (p = .017). This study provided the framework for a successful institutional academic remediation program that could be modeled at other institutions striving to bolster student support services.

Transforming remediation for competency-based medical education

We care about the future experiences of all health professions trainees as competency-based medical education evolves. It is an exciting new era with many possibilities for progress in learning and competency development. Yet we are concerned that remediation remains a troubled and stigmatized detour from routine learning that can persist as a feared off-ramp from competency development rather than a central avenue for improvement and competency achievement. We believe that it is time to acknowledge that all trainees struggle and to recognize that remediation is an essential aspect of individualized learning. Decisive steps are possible to revitalize remediation and to launch its transformation towards growth-oriented pathways for change.

Medical Professionalism and Its Association with Dropout Intention in Peruvian Medical Students during the COVID-19 Pandemic

BACKGROUND

The COVID-19 pandemic introduced unprecedented challenges to medical education systems and medical students worldwide, making it necessary to adapt teaching to a remote methodology during the academic year 2020-2021. The aim of this study was to characterize the association between medical professionalism and dropout intention during the pandemic in Peruvian medical schools.

METHODS

A cross-sectional online-survey-based study was performed in four Peruvian medical schools (two public) during the academic year 2020-2021. Medical students, attending classes from home, answered three scales measuring clinical empathy, teamwork, and lifelong learning abilities (three elements of medical professionalism) and four scales measuring loneliness, anxiety, depression, and subjective wellbeing. In addition, 15 demographic, epidemiological, and academic variables (including dropout intention) were collected. Variables were assessed using multiple logistic regression analysis.

RESULTS

The study sample was composed of 1107 students (390 male). Eight variables were included in an explanatory model (Nagelkerke-R2 = 0.35). Anxiety, depression, intention to work in the private sector, and teamwork abilities showed positive associations with dropout intention while learning abilities, subjective wellbeing, studying in a public medical school, and acquiring a better perception of medicine during the pandemic showed a negative association with dropout intention. No association was observed for empathy.

CONCLUSIONS

Each element measured showed a different role, providing new clues on the influence that medical professionalism had on dropout intention during the pandemic. This information can be useful for medical educators to have a better understanding of the influence that professionalism plays in dropout intention.

Enabling Factors for the Implementation of Competency-Based Curricula in Colleges and Schools of Pharmacy

OBJECTIVES

To review the implementation drivers of competency-based pharmacy education (CBPE) and provide recommendations for enablers.

FINDINGS

Competency-based education is an emerging model in the health professions, focusing on time-variable competency development and achievement compared with a time-bound, course-based, traditional model. CBPE is an outcomes-based organized framework of competencies enabling pharmacists to meet health care and societal needs. However, challenges need to be recognized and overcome for the successful implementation of CBPE. Competency drivers include defining the competencies and roles of stakeholders, developing transparent learning trajectories and aligned assessments, and establishing lifetime development programs for stakeholders. Organization drivers include developing support systems for stakeholders; facilitating connections between all educational experiences; and having transparent assessment plans, policies, and procedures that align with core CBPE precepts, including the sustainability of time-variability. Leadership drivers include establishing growth mindset and facilitating a culture of connection between workplace and educational environments, program advocacy by institutional leaders, accepting failures as part of the process, shifting the organizational culture away from learner differentiation toward competence, and maintaining sufficient administrative capability to support CBPE.

SUMMARY

The successful implementation of CBPE involves enabling the competency, organization, and leadership drivers that will lead to program success. More research is needed in the areas of creation, implementation, and assessment of CBPE to determine success in this model. We have reviewed and provided recommendations to enable the drivers of successful implementation of CBPE.

Incorporating a situational judgement test in residency selections: clinical, educational and organizational outcomes

BACKGROUND

Computer-based assessment for sampling personal characteristics (Casper), an online situational judgement test, is a broad measure of personal and professional qualities. We examined the impact of Casper in the residency selection process on professionalism concerns, learning interventions and resource utilization at an institution.

METHODS

In 2022, admissions data and information in the files of residents in difficulty (over three years pre- and post- Casper implementation) was used to determine the number of residents in difficulty, CanMEDS roles requiring a learning intervention, types of learning interventions (informal learning plans vs. formal remediation or probation), and impact on the utilization of institutional resource (costs and time). Professionalism concerns were mapped to the 4I domains of a professionalism framework, and their severity was considered in mild, moderate, and major categories. Descriptive statistics and between group comparisons were used for quantitative data.

RESULTS

In the pre- and post- Casper cohorts the number of residents in difficulty (16 vs. 15) and the number of learning interventions (18 vs. 16) were similar. Professionalism concerns as an outcome measure decreased by 35% from 12/16 to 6/15 (p < 0.05), were reduced in all 4I domains (involvement, integrity, interaction, introspection) and in their severity. Formal learning interventions (15 vs. 5) and informal learning plans (3 vs. 11) were significantly different in the pre- and post-Casper cohorts respectively (p < 0.05). This reduction in formal learning interventions was associated with a 96% reduction in costs f(rom hundreds to tens of thousands of dollars and a reduction in time for learning interventions (from years to months).

CONCLUSIONS

Justifiable from multiple stakeholder perspectives, use of an SJT (Casper) improves a clinical performance measure (professionalism concerns) and permits the institution to redirect its limited resources (cost savings and time) to enhance institutional endeavors and improve learner well-being and quality of programs.

Evaluation of an individual examination remediation policy in a professional pharmacy course

INTRODUCTION

Maintaining institutional remediation policies is required for pharmacy education accreditation, but specific policies and students' perceptions of remediation are not well described in the literature. The purpose of this research was to determine whether the individual examination remediation policy utilized in a biomedical literature evaluation course was a viable approach to ensuring positive student experiences and success.

METHODS

This study utilized a pre-/post-quantitative survey design. An 11-item pre-remediation questionnaire was offered to all students enrolled in the course in 2022. A matched post-survey was administered to students eligible to remediate individual examinations. Survey items were assessed using a five-point Likert rating. Remediation examination grades were analyzed in aggregate. Descriptive statistics were utilized as appropriate.

RESULTS

One hundred of the 108 (92.5%) enrolled students completed the pre-remediation survey. Students strongly agreed they would prefer to remediate individual examinations instead of taking one cumulative course remediation examination (median 5) and that remediating would improve their understanding of course material (median 5). Nineteen (44%) of 43 students eligible for individual examination remediation chose to remediate, and 16 (37%) responded to the post-remediation survey. Among those eligible, the most common reason for remediating was desire to receive a better score. Significantly more students improved their examination scores through remediation.

CONCLUSIONS

Students in the course preferred to remediate individual examinations, but only 44% of students eligible to remediate chose to do so. Future studies with larger sample sizes and course outcome data are warranted to further explore examination remediation in professional pharmacy courses.

Prompt identification of struggling candidates in near peer-led basic life support training: piloting an online performance scoring system

BACKGROUND

Bristol Medical School has adopted a near peer-led teaching approach to deliver Basic Life Support training to first year undergraduate medical students. Challenges arose when trying to identify early in the course which candidates were struggling with their learning, in sessions delivered to large cohorts. We developed and piloted a novel, online performance scoring system to better track and highlight candidate progress.

METHODS

During this pilot, a 10-point scale was used to evaluate candidate performance at six time-points during their training. The scores were collated and entered on an anonymised secure spreadsheet, which was conditionally formatted to provide a visual representation of the score. A One-Way ANOVA was performed on the scores and trends analysed during each course to review candidate trajectory. Descriptive statistics were assessed. Values are presented as mean scores with standard deviation (x̄±SD).

RESULTS

A significant linear trend was demonstrated (P < 0.001) for the progression of candidates over the course. The average session score increased from 4.61 ± 1.78 at the start to 7.92 ± 1.22 at the end of the final session. A threshold of less than 1SD below the mean was used to identify struggling candidates at any of the six given timepoints. This threshold enabled efficient highlighting of struggling candidates in real time.

CONCLUSIONS

Although the system will be subject to further validation, our pilot has shown the use of a simple 10-point scoring system in combination with a visual representation of performance helps to identify struggling candidates earlier across large cohorts of students undertaking skills training such as Basic Life Support. This early identification enables effective and efficient remedial support.

The role of feedback in supporting trainees who underperform in clinical environments

Introduction

Underperformance in clinical environments can be costly and emotional for all stakeholders. Feedback is an important pedagogical strategy for working with underperformance - both formal and informal strategies can make a difference. Feedback is a typical feature of remediation programs, and yet there is little consensus on how feedback should unfold in the context of underperformance.

Methods

This narrative review synthesises literature at the intersections of feedback and underperformance in clinical environments where service, learning and safety need to be considered. We do so with a critical eye towards generating insights for working with underperformance in the clinical environment.

Synthesis and discussion

There are compounding and multi-level factors that contribute to underperformance and subsequent failure. This complexity overwrites simplistic notions of 'earned' failure through individual traits and deficit. Working with such complexity requires feedback that goes beyond educator input or 'telling'. When we shift beyond feedback as input to process, we recognise that these processes are fundamentally relational, where trust and safety are necessary for trainees to share their weaknesses and doubts. Emotions are always present and they signal action. Feedback literacy might help us consider how to engage trainees with feedback so that they take an active (autonomous) role in developing their evaluative judgements. Finally, feedback cultures can be influential and take effort to shift if at all. A key mechanism running through all these considerations of feedback is enabling internal motivation, and creating conditions for trainees to feel relatedness, competence and autonomy. Broadening our perceptions of feedback, beyond telling, might help create environments for learning to flourish.

Shifting the narrative and practice of assessing professionalism in dietetics education: An Australasian qualitative study

AIM

We aimed to explore current approaches to assessing professionalism in dietetics education in Australia and New Zealand, and asked the questions what is working well and what needs to improve?

METHOD

We employed a qualitative interpretive approach and conducted interviews with academic and practitioner (workplace-based) educators (total sample n = 78) with a key stake in dietetics education across Australia and New Zealand. Data were analysed using team-based, framework analysis.

RESULTS

Our findings suggest significant shifts in dietetics education in the area of professionalism assessment. Professionalism assessment is embedded in formal curricula of dietetics programs and is occurring in university and placement settings. In particular, advances have been demonstrated in those programs assessing professionalism as part of the programmatic assessment. Progress has been enabled by philosophical and curricula shifts; clearer articulation and shared understandings of professionalism standards; enhanced learner agency and reduced power distance; early identification and intervention of professionalism lapses; and increased confidence and capabilities of educators.

CONCLUSIONS

These findings suggest there have been considerable advances in professionalism assessment in recent years with shifts in practice in approaching professionalism through a more interpretivist lens, holistically and more student-centred. Professionalism assessment in dietetics education is a shared responsibility and requires further development and transformation to more fully embed and strengthen curricula approaches across programs. Further work should investigate strategies to build safer learning cultures and capacity for professionalism conversations and in strengthening approaches to remediation.

A Practical Review of Mastery Learning

Objective. To review mastery learning and provide recommendations for implementation in a competency-based curriculum.Findings. Mastery learning, introduced in the 1960s, was developed to ensure all students reach a desired level of mastery or competency. In this model, students acquire knowledge, skills, or attitudes and then complete formative assessments on that learning. If they achieve the desired level, they can proceed to enrichment activities. Students who do not meet the desired level of mastery proceed through corrective activities and retesting. Evidence suggests students within a mastery learning model perform better academically than those in nonmastery learning models with moderate effect sizes. Mastery learning may result in better performance due to several theoretical reasons, including aspects of motivation, testing, and feedback.Conclusion. We make several recommendations on how to modernize mastery learning for apply it to the pharmacy education, including the recommendation to use more cumulative testing and assessment of baseline knowledge and skills. In addition, models of successive relearning may be applied to this model.

'Early identification of struggling pre-clerkship learners using formative clinical skills OSCEs: an assessment for learning program.'

Multiple experts in clinical skills remediation recommend early identification to support struggling learners, but there is minimal documentation on implementation of these programs. We share one school's outcomes-based research utilizing the formative assessment for learning model to early-identify pre-clerkship students struggling with clinical skills using formative OSCEs (F-OSCE). Student scores were monitored over longitudinal F-OSCE experiences as part of a curricular innovation. Points towards early identification accumulated when a student's score fell below the 80% threshold for each section of an OSCE. Students who accumulated enough points were advised of the need for intervention, and coaching was recommended. Students were surveyed about their experiences with the program. The objective was to explore whether this early identification program and coaching intervention had a positive impact on subsequent OSCE performance. Of 184 students in 2 cohorts who completed F-OSCEs, 38 (20.7%) were flagged for early identification. Of these, 17 (44.7%) sought additional help by voluntarily participating in the coaching program. Students who participated in extra clinical skills coaching demonstrated statistically significant improvements in performance on subsequent FOSCEs, as did the early identified students who did not participate in extra coaching. The greatest impact of coaching intervention was noted in the physical examination domain. This program was effective in identifying students struggling with clinical skills on formative OSCEs. Early identified students demonstrated improvements in subsequent OSCE performance, with those who sought coaching faring slightly better. Development of robust early identification programs as formative assessments of clinical skills and follow-up coaching programs to guide skills development are important implications of this work. Monitoring short- and long-term results for students identified through this approach to see if improvement is sustained is planned.

Research on Teaching Reform of Innovative and Entrepreneurial Talents Training Course in Local Undergraduate Universities Based on Intelligent Blended Learning

In order to make college development better accord with the development demand of regional society, the innovation and entrepreneurship (IE) training course reform in local undergraduate colleges is studied. To begin with, the research background as well as necessity of the teaching reform of basic courses in local undergraduate colleges for IE are analyzed. Moreover, the current situation of IE education (IEE) in the local undergraduate colleges in Shaanxi Province is investigated to understand the implementation status of IEE in local undergraduate colleges in Shaanxi Province. Then, the adverse factors affecting the IEE implementation process are studied. Finally, the adverse factors and the causes of the problems are analyzed. From the four aspects of educational philosophy, curriculum structure, curriculum content as well as teaching staff, the suggestions and programs of basic courses reform for IEE are provided. The survey results show that more than 50% of the students have their own unique understanding of IEE, and think that IEE is quite necessary and helpful for their own development. The school has also attached importance to IEE, but the effect is mediocre at present. It suggests that students’ demand for IEE cannot be satisfied now. The methods and survey results proposed give guidance as well as data support to the IEE reform in local undergraduate colleges.

Incorporation of Comprehensive Examinations for a Time-Efficient Remediation Method

BACKGROUND

Remediation in medical school should be a time-limited, and highly structured process that addresses student deficiencies and allows them to prove content competency before progressing in the curriculum. In this study, we analyze the use of a comprehensive end-of semester final examination in the remediation process for pre-clinical students at Kirk Kerkorian School of Medicine (KSOM). Faculty time utilized is analyzed and compared with the previously employed remediation process.

METHODS

Administered to all students at the end of each semester is a comprehensive examination consisting of a sufficient number of faculty-selected questions relating to each organ system covered with a 75% passing threshold. A student must also demonstrate competency of any failed system examination content to remediate successfully. The performance of those who did not exhibit competency was analyzed to identify areas of deficiency then an individualized exam would then be administered. The total remediation time spent by faculties and students was then analyzed.

RESULTS

KSOM Class of 2024 results showed that faculty were able to yield significant savings in time spent on remediation. Faculty spent 45 total remediation hours for the Class of 2024, compared to 400 hours remediating using the paper-based assignment method for the Class of 2021. With the transition to comprehensive end-of-semester final examinations, a total of 355 hours were saved. Furthermore, faculty used an average 1.07 hours/student with end-of-semester comprehensive examinations. The saved time allows faculty to work on improving the overall curriculum for all students rather than focusing on a limited number of students.

CONCLUSION

Utilizing comprehensive end-of-semester final examinations notably decreased the amount of faculty time spent per semester on remediation. Further evaluation is required to evaluate long-term effectiveness on content competency and would further be strengthened by a multi-institutional comparison.

Can a Situational Judgment Test Identify Trainees at Risk of Professionalism Issues? A Multi-Institutional, Prospective Cohort Study

PURPOSE

To determine whether overall situational judgment test (SJT) scores are associated with programs' clinical competency committee (CCC) ratings of trainee professionalism, any concerning behavior, and concerning behavior requiring active remediation at 2 time periods.

METHOD

In fall 2019, trainees from 17 U.S. programs (16 residency, 1 fellowship) took an online 15-scenario SJT developed to measure 7 dimensions of professionalism. CCC midyear and year-end (6 months and 1 year following SJT completion, respectively) professionalism scores and concern ratings were gathered for academic year 2019-2020. Analyses were conducted to determine whether overall SJT scores related to overall professionalism ratings, trainees displaying any concerns, and trainees requiring active remediation at both time periods.

RESULTS

Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings ( r = .21 and .14, P &lt; .001 and = .03, respectively). Holding gender and race/ethnicity constant, a 1 standard deviation (SD) increase in overall SJT score was associated with a .20 SD increase in overall professionalism ratings at midyear ( P = .005) and a .22 SD increase at year-end ( P = .001). Holding gender and race/ethnicity constant, a 1 SD increase in overall SJT score decreased the odds of a trainee displaying any concerns by 37% (odds ratio [OR] 95% confidence interval [CI]: [.44, .87], P = .006) at midyear and 34% (OR 95% CI: [.46, .95], P = .025) at year-end and decreased the odds of a trainee requiring active remediation by 51% (OR 95% CI: [.25, .90], P = .02) at midyear.

CONCLUSIONS

Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings and were associated with whether trainees exhibited any concerning behavior at midyear and year-end and whether trainees needed active remediation at midyear. Future research should investigate whether other potential professionalism measures are associated with concerning trainee behavior.

Learning, judgement and workforce tensions impact failure to fail in a medical postgraduate setting: A supervisor perspective

PURPOSE

Medical training organisations have a duty to prepare medical graduates for future safe, competent practice. Decisions about underperformance are high stakes at the postgraduate level and failure to fail can occur. We aimed to explore this concept from a systems and supervisor perspective.

METHOD

Supervisors of specialist physician trainees were invited to provide written feedback on failure to fail as part of a broader anonymous supervisor survey. They were provided with a trigger statement and responded in free-text format. A deductive content analysis was undertaken through the lenses of supervisor and institution.

RESULTS

Of 663 supervisors who responded to the broader survey, 373 (56%) provided feedback on the failure to fail trigger statement. Analyses indicated an interplay between trainee and supervisor characteristics, and broader system elements. System elements that contributed to failure to fail trainees included lack of longitudinal monitoring and quality of assessment information. Supervisor characteristics included confident, conflicted and avoidant behaviours towards underperforming trainees.

CONCLUSIONS

Individual and system challenges that contributed to failure to fail were identified in this study, and we propose a three-way tension among learning, judgement and workforce. Three potential mitigation strategies have been identified to reduce failure to fail, namely a stage-based approach to remediation, faculty development in supervisory skills and improved assessment-for-learning processes.

Warning: medical education is hazardous to your mental health. Medical students should make an informed decision to begin and continue training

For decades there has been ample evidence that training to become a physician and practicing medicine is hazardous to one's health and wellness. In the face of the extremely high rates of suicide, substance abuse, depression and burnout in the medical student, resident, and physician populations, it would be dishonest to suggest medical education and practice is all gain and no pain. This article is directed to members of the medical education community and challenges stakeholders to view their teaching and training of medical students as an intervention requiring free and informed consent. We hope this exercise shifts the paradigm of educators and enables students to enter medical training from a free and informed position.

Strangers in a strange land: The experience of physicians undergoing remediation

INTRODUCTION

The experience of remediation in practising physicians has not been widely studied. Remediatees frequently present negative emotions, but observers can only infer the underlying reasons behind these. Understanding remediatees' perspectives may help those mandating and organising remediation to structure the process in ways that improve the experience for all concerned parties and maximise chances of a successful outcome for remediatees.

METHODS

Seventeen physicians who had undergone remediation for clinical competence concerns were interviewed via telephone. Participant data were first iteratively analysed thematically and then reanalysed using a narrative mode of analysis for each participant in order to understand the stories as wholes. Figured worlds (FW) theory was used as a lens for analysing the data for this constructivist research study.

RESULTS

Participants entering the FW of remediation perceived that their position as a 'good doctor' was threatened. Lacking experience with this world and with little available support to help them navigate it, participants used their agency to draw on various discursive threads within the FW to construct a narrative account of their remediation. In their narratives, participants tended to position themselves either as victims of regulatory bodies or as resilient individuals who could make the best of a difficult situation. In both cases, the chosen discursive threads enabled them to maintain their self-identity as 'good doctor'.

CONCLUSION

Remediation poses a threat to a physician's professional and personal identity. Focusing mainly on the educational aspect of remediation-that is, the improvement in knowledge and skills-risks missing its impact on physician identity. We need to ensure not only that we support physicians in dealing with this identity threat but that our assessment and remediation processes do not inadvertently encourage remediatees to draw on discursive threads that lead them to see themselves as victims.

Post graduate remediation programs in medicine: a scoping review

BACKGROUND

Recognizing that physicians may struggle to achieve knowledge, skills, attitudes and or conduct at one or more stages during their training has highlighted the importance of the 'deliberate practice of improving performance through practising beyond one's comfort level under guidance'. However, variations in physician, program, contextual and healthcare and educational systems complicate efforts to create a consistent approach to remediation. Balancing the inevitable disparities in approaches and settings with the need for continuity and effective oversight of the remediation process, as well as the context and population specific nature of remediation, this review will scrutinise the remediation of physicians in training to better guide the design, structuring and oversight of new remediation programs.

METHODS

Krishna's Systematic Evidence Based Approach is adopted to guide this Systematic Scoping Review (SSR in SEBA) to enhance the transparency and reproducibility of this review. A structured search for articles on remediation programs for licenced physicians who have completed their pre-registration postings and who are in training positions published between 1st January 1990 and 31st December 2021 in PubMed, Scopus, ERIC, Google Scholar, PsycINFO, ASSIA, HMIC, DARE and Web of Science databases was carried out. The included articles were concurrently thematically and content analysed using SEBA's Split Approach. Similarities in the identified themes and categories were combined in the Jigsaw Perspective and compared with the tabulated summaries of included articles in the Funnelling Process to create the domains that will guide discussions.

RESULTS

The research team retrieved 5512 abstracts, reviewed 304 full-text articles and included 101 articles. The domains identified were characteristics, indications, frameworks, domains, enablers and barriers and unique features of remediation in licenced physicians in training programs.

CONCLUSION

Building upon our findings and guided by Hauer et al. approach to remediation and Taylor and Hamdy's Multi-theories Model, we proffer a theoretically grounded 7-stage evidence-based remediation framework to enhance understanding of remediation in licenced physicians in training programs. We believe this framework can guide program design and reframe remediation's role as an integral part of training programs and a source of support and professional, academic, research, interprofessional and personal development.

Clinical Skills Tutoring Program (CSTP): Developing a Curriculum for Medical Student Clinical Skills Peer Tutors

INTRODUCTION

There are few curriculum materials designed to provide training and support for peer tutors to become effective clinical skills teachers. We designed the Clinical Skills Tutoring Program (CSTP) curriculum to guide tutors to help their students reflect on clinical skills performance, create an individualized learning plan, and engage in improvement based on feedback to achieve clinical skills competencies.

METHODS

Curriculum content was delivered through an in-person training session, formal curriculum written content, online resources, and longitudinal support from faculty directors. Tutors (fourth-year medical students) received surveys to evaluate the in-person training session, curriculum resources, and overall program experience. Student participants (medical students of any year) completed a survey to rate their satisfaction in working with their tutors.

RESULTS

There were 12 tutors in cohort 1 and 18 tutors in cohort 2. Survey response rates ranged from 50% to 70% among tutors. The tutors were satisfied with the in-person training session, program experience, curriculum resources, support from directors, development of learning goals with the student, and clinical skills practice with the student (mean Likert ratings greater than 4 out of 5). Student participants were satisfied with their experience creating learning goals and receiving feedback from their tutors.

DISCUSSION

The tutor curriculum fills a gap by training and supporting tutors before and during their work with students needing further resources and remediation in one or more clinical skills domains. The curriculum can be implemented and further adapted by other tutoring programs locally and nationally.

Emotion in remediation: A scoping review of the medical education literature

OBJECTIVES

Remediation can be crucial and high stakes for medical learners, and experts agree it is often not optimally conducted. Research from other fields indicates that explicit incorporation of emotion improves education because of emotion's documented impacts on learning. Because this could present an important opportunity for improving remediation, we aimed to investigate how the literature on remediation interventions in medical education discusses emotion.

METHODS

The authors used Arksey and O'Malley's framework to conduct a scoping literature review of records describing remediation interventions in medical education, using PubMed, CINAHL Complete, ERIC, Web of Science and APA PsycInfo databases, including all English-language publications through 1 May 2020 meeting search criteria. They included publications discussing remediation interventions either empirically or theoretically, pertaining to physicians or physician trainees of any level. Two independent reviewers used a standardised data extraction form to report descriptive information; they reviewed included records for the presence of mentions of emotion, described the mentions and analysed results thematically.

RESULTS

Of 1644 records, 199 met inclusion criteria and were reviewed in full. Of those, 112 (56%) mentioned emotion in some way; others focused solely on cognitive aspects of remediation. The mentions of emotion fell into three themes based on when the emotion was cited as present: during regular coursework or practice, upon referral for remediation and during remediation. One-quarter of records (50) indicated potential intentional incorporation of emotion into remediation programme design, but they were non-specific as to how emotions related to the learning process itself.

CONCLUSION

Even though emotion is omnipresent in remediation, medical educators frequently do not factor emotion into the design of remediation approaches and rarely explicitly utilise emotion to improve the learning process. Applications from other fields may help medical educators leverage emotion to improve learning in remediation, including strategies to frame and design remediation.

Ottawa 2020 consensus statement for programmatic assessment - 1. Agreement on the principles

INTRODUCTION

In the Ottawa 2018 Consensus framework for good assessment, a set of criteria was presented for systems of assessment. Currently, programmatic assessment is being established in an increasing number of programmes. In this Ottawa 2020 consensus statement for programmatic assessment insights from practice and research are used to define the principles of programmatic assessment.

METHODS

For fifteen programmes in health professions education affiliated with members of an expert group (n = 20), an inventory was completed for the perceived components, rationale, and importance of a programmatic assessment design. Input from attendees of a programmatic assessment workshop and symposium at the 2020 Ottawa conference was included. The outcome is discussed in concurrence with current theory and research.

RESULTS AND DISCUSSION

Twelve principles are presented that are considered as important and recognisable facets of programmatic assessment. Overall these principles were used in the curriculum and assessment design, albeit with a range of approaches and rigor, suggesting that programmatic assessment is an achievable education and assessment model, embedded both in practice and research. Knowledge on and sharing how programmatic assessment is being operationalized may help support educators charting their own implementation journey of programmatic assessment in their respective programmes.

Optimising the delivery of remediation programmes for doctors: A realist review

CONTEXT

Medical underperformance puts patient safety at risk. Remediation, the process that seeks to 'remedy' underperformance and return a doctor to safe practice, is therefore a crucially important area of medical education. However, although remediation is used in health care systems globally, there is limited evidence for the particular models or strategies employed. The purpose of this study was to conduct a realist review to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety.

METHOD

We conducted a realist literature review consistent with RAMESES standards. We developed a programme theory of remediation by carrying out a systematic search of the literature and through regular engagement with a stakeholder group. We searched bibliographic databases (MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL, ERIC, ASSIA and DARE) and conducted purposive supplementary searches. Relevant sections of text relating to the programme theory were extracted and synthesised using a realist logic of analysis to identify context-mechanism-outcome configurations (CMOcs).

RESULTS

A 141 records were included. The majority of the studies were from North America (64%). 29 CMOcs were identified. Remediation programmes are effective when a doctor's insight and motivation are developed and behaviour change reinforced. Insight can be developed by providing safe spaces, using advocacy to promote trust and framing feedback sensitively. Motivation can be enhanced by involving the doctor in remediation planning, correcting causal attribution, goal setting and destigmatising remediation. Sustained change can be achieved by practising new behaviours and skills, and through guided reflection.

CONCLUSION

Remediation can work when it creates environments that trigger behaviour change mechanisms. Our evidence synthesis provides detailed recommendations on tailoring implementation and design strategies to improve remediation interventions for doctors.

Pharmacy student reflections and perceptions of competency and predictors of success in remediation

INTRODUCTION

Pharmacy programs employ a variety of remediation methods intended to bring underperforming students to a level of competency. Our objective was to evaluate pharmacy students' perceptions of eligibility criteria and academic outcomes of remediation and potential predictors for lack of success in the original and remediated course.

METHODS

Palm Beach Atlantic University School of Pharmacy revised its remediation policy in fall 2017, shifting from a course-centric to student-centric policy. Pharmacy students (N = 265) were surveyed in spring 2019 regarding eligibility criteria and academic outcomes of remediation. Enrolled students who remediated under the revised policy were surveyed on the lack of success in the original course and the remediation process.

RESULTS

Students viewed remediation as an opportunity to prevent delayed graduation. They agreed with the revised, student-centric eligibility criteria and with the new approach allowing all courses to be remediated. First-year students provided lower scores, whereas students who never failed a course gave higher scores. Students agreed that remediation produces proficient students who are as competent as those who passed the original course. The main reason for failing the original course was lack of study time. Students who failed remediation tended to spend more time on external activities and used less remediation resources.

CONCLUSIONS

A student-centric approach to remediation with active involvement from students and faculty support was successful in producing students who are viewed just as proficient and competent as students who passed the original course. Predictors for success were study time and the use of remediation resources.

Unheard Voices: A Qualitative Study of Resident Perspectives on Remediation

BACKGROUND

Remediation is an important component of residency training that ensures residents are progressing toward competency and unsupervised practice. There is literature describing educators' attitudes about remediation; however, little is known about residents' perspectives regarding peers who are struggling and remediation. Understanding this perspective is critical to supporting struggling residents and developing successful remediation programs.

OBJECTIVE

The objective of this study was to describe residents' perspectives on peers who are struggling and remediation processes within graduate medical education programs.

METHODS

In 2015, we conducted focus groups of residents in a multi-institutional exploratory qualitative study designed to investigate resident perspectives on remediation. Focus groups included questions on identification of residents who are struggling, reasons residents face difficulty in training, attitudes toward remediation, and understanding of the remediation process. Using conventional content analysis, we analyzed the focus group data to discover common themes.

RESULTS

Eight focus groups were performed at 3 geographically distinct institutions. A total of 68 residents participated, representing 12 distinct medical specialties. Four major themes emerged from the participants' discussion: lack of transparency, negative stigma, overwhelming emotions, and a need for change.

CONCLUSIONS

Resident perspectives on remediation are affected by communication, culture, and emotions. The resident participants called for change, seeking greater understanding and transparency about what it means to struggle and the process of remediation. The residents also believed that remediation can be embraced and normalized.

Growth mindset in competency-based medical education

The ongoing adoption of competency-based medical education (CBME) across health professions training draws focus to learner-centred educational design and the importance of fostering a growth mindset in learners, teachers, and educational programs. An emerging body of literature addresses the instructional practices and features of learning environments that foster the skills and strategies necessary for trainees to be partners in their own learning and progression to competence and to develop skills for lifelong learning. Aligned with this emerging area is an interest in Dweck's self theory and the concept of the growth mindset. The growth mindset is an implicit belief held by an individual that intelligence and abilities are changeable, rather than fixed and immutable. In this paper, we present an overview of the growth mindset and how it aligns with the goals of CBME. We describe the challenges associated with shifting away from the fixed mindset of most traditional medical education assumptions and practices and discuss potential solutions and strategies at the individual, relational, and systems levels. Finally, we present future directions for research to better understand the growth mindset in the context of CBME.

Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review

Background

An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.

Objectives

To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.

Design

A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.

Data sources

Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.

Review methods

Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.

Results

A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.

Limitations

Limitations were the low quality of included literature and limited number of UK-based studies.

Future work

Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.

Study registration

This study is registered as PROSPERO CRD42018088779.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.

Supporting students with academic difficulties

INTRODUCTION

Up 15% of health professions students experience academic difficulties. We describe an early tracking system that effectively identifies and supports students with performance deficiencies. The objectives of this study were to discuss changes made in an academic success system at our new college of pharmacy, describe effectiveness of the updated program after one-year of use, and present changes that are being discussed based on the faculty and student feedback.

METHODS

We conducted in-person faculty interviews using open-ended questions to evaluate the effectiveness of our original program for supporting students with academic difficulties called the Early Tracking System (ETS). We then developed a new program titled the Individualized Plan for Academic Success System (IPASS). We conducted more faculty interviews and a student survey after the implementation of IPASS to evaluate its effectiveness.

RESULTS

In the 2018-2019 academic year at our institution, IPASS was activated 291 times, of which there were 27 course failures. The results of our study indicated a pass rate of 90.72% post-IPASS for all pharmacy students.

CONCLUSIONS

The goal of this study was to revise and implement an early tracking system that all faculty members, students, and administrators can utilize efficiently and effectively. This study demonstrated that students with academic difficulties have the potential for progression if their deficiencies are detected early. We described a unique system by which we addressed the needs of the at-risk students. The interview of faculty and survey of students indicated satisfaction with IPASS.

Remediation for surgical trainees: recommendations from a narrative review

BACKGROUND

Remediation involves formalized support for surgical trainees with significant underperformance to return to expected standards. There is a need to understand current evidence of remediation for surgical trainees to inform practice and justify investment of resources.

METHODS

Following the principles of a systematic review, we conducted a narrative analysis to make recommendations for remediation of underperforming surgical trainees.

RESULTS

From a review of 55 articles on remediation of trainees in medical and surgical sub-specialities, we have identified system and process level recommendations. Remediation is reported as long-term, complex and resource-intensive. Establishing a defined and standardized remediation framework enables co-ordination of multi-modal interventions. System level recommendations aim to consolidate protocols via developing better assessment, intervention and re-evaluation modalities whilst also strengthening support to supervisors conducting the remediation. Process level recommendations should be tailored for the specific needs of each trainee, aiming to be proactive with interventions within a programmatic framework. Regular reassessment is required, and long-term follow-up shows that remediation efforts are often successful.

CONCLUSION

While remediation within a programmatic framework is complex, it is often a successful approach to return surgical trainees to their expected standard. Future directions involve applying learning theories, encouraging research methods and to develop integrated collaborate protocols and support to synergize efforts.

Using a Diagnostic OSCE to Discern Deficit From Disability in Struggling Students

PROBLEM

When medical students with disabilities fail, identifying the underlying cause is challenging. Faculty unfamiliar with disability-related barriers or accommodations may falsely attribute academic struggles to disability. Fear of legal action may prompt inappropriate promotion of students with disabilities who are struggling to meet competencies. Therefore, a clear understanding of the origin of difficulty is critical to determining an appropriate response to the student's failure, including revision of accommodations, academic remediation, probation, and dismissal.

APPROACH

A large Midwestern medical college created an innovative approach to differentiate between disability-related barriers and academic deficits by creating a diagnostic objective structured clinical examination (OSCE). The goal of this OSCE was to determine the need for additional or refined accommodations versus clinical remediation, and to guide future decision making about a student on academic probation. Using 3 simulated cases that drew on a cross section of clinical knowledge, a team of clinical and disability specialists observed a disabled student to determine the origin of that student's difficulties in a clinical rotation.

OUTCOMES

Using the diagnostic OSCE, the team quickly identified clinical reasoning and fund of knowledge deficits, and need for further accommodations. As a result, the team was able to remediate the clinical deficits, augment the current accommodations in vivo, and determine the potential impact on performance. The team approach was documented and facilitated the legally required interactive process for determining additional barriers, efficacy of existing accommodations, and need for additional reasonable accommodations. All parties reported a positive experience. The collective knowledge and expertise of the team helped confirm the origin of the deficit: a fundamental lack of knowledge and reasoning skills versus a disability-related barrier.

NEXT STEPS

The next step is to formalize this process to ensure appropriate evaluation of students with disabilities.

Medical students with performance difficulties need wide support: Initial results of an academic tutoring program

BACKGROUND

Even students with previous academic success may face challenges that affect their academic performance. Many medical schools offer programs to students at the risk of academic failure, to ensure that they succeed in the course.

OBJECTIVE AND METHODS

In this report we describe a pioneering academic tutoring program developed at a Brazilian medical school and discuss the initial results of the program based on the feedback from tutors and data regarding the progression of students in the medical course.

RESULTS

In 2018, 33 students enrolled into the program. Students' performance difficulties were mainly associated with mental health problems and socioeconomic vulnerability. Of the 33 students, 27 (81.8%) were assisted by the Mental Health Support Service and 16 (48.5%) were assisted by the Social Assistance Service. In addition to the planning academic activity class load, tutors were able to assist students in solving socioeconomic issues, carrying out personal support interventions with the promotion of self-esteem, and presenting suggestions for behavioral changes in their routine. For most students (72%), the action plan proposed by the tutors was successful. Eight of the 14 (57%) students in the fourth year progressed to the final two years of in-hospital practical training (internship).

CONCLUSIONS

The Academic Tutoring Program showed positive results for most of the students. Close monitoring and tutor intervention allowed students with poor academic performance to overcome the low performance cycle. These important tasks demand time and energy from tutors, and institutional recognition of these professionals is essential for the successful maintenance of the program.

Remediation and reassessment methods in pharmacy education: A systematic review

BACKGROUND

Colleges of pharmacy are currently required to implement a remediation program within their curricula, but no specifications are provided on the ideal methodology. While the need for successful remediation strategies continues to grow, literature describing positive or negative outcomes of different approaches is significantly lacking. The objective of this literature review was to describe and evaluate remediation methodologies in pharmacy education.

METHODS

This literature review was completed following PRISMA criteria. A search of the PubMed, Cochrane Library, Cumulative Index of Nursing and Allied Health, Academic Search Complete, PsycInfo, Scopus, and ProQuest Central databases was conducted in July 2019. Studies were included if they involved pharmacy student education and described either remediation or reassessment.

RESULTS

The evaluated studies discussed a range of course types being remediated, a large variety of remediation strategies and timeframes, and differing overall outcomes. No studies provided comparison of remediation techniques or provided details on the implementation of their chosen approaches. A consistent finding within the evaluated studies was the inclusion of prevention strategies to attempt to avoid the need for remediation preemptively. Overall outcomes for each remedial program were inconsistent and no clear patterns were evident other than an improvement in student performance following remediation.

IMPLICATIONS

Remediation strategies included course repetition, summer restudy, reassessment, and individualized plans. Outcomes varied significantly between studies, making methodology comparisons difficult. Future studies that include more detail and consistency in the reported outcomes would be beneficial to students and help clarify remediation for colleges of pharmacy.

Conflict between clinician teachers and their students: the clinician perspective

The relationship between clinician teachers and their students is of major importance in medical education. However, there is little known about the effects on clinicians when conflict occurs with their students. What do clinicians perceive to be major causes of these conflicts? How do they react when and after conflict occurs? A phenomenological inquiry exploring the lived experience of 12 clinician teachers in medical schools was performed. The clinicians were selected using purposeful sampling and snowballing techniques. The interviews revolved around discussions based on episodes of conflict with medical students that the clinicians considered significant. The analysis and emergent themes were partially constructed around and informed by theories of conflict, and conflict management. A number of themes emerged from this study. Clinicians experienced that significant psychological and behavioural problems of students had a dominant impact on the likelihood and severity of conflict; these conflicts had a significant emotional impact on clinicians; though the responses to conflict varied, "avoidance" was a mechanism commonly used by clinicians and thus the assessment of attitudinal and behavioural professional issues in the workplace was problematic. This study shows how the clinician perspective to challenging student/clinician encounters impacts on the quality of education they are able to provide. We recommend medical schools consider these issues when designing their programs in order to develop and maintain clinician-teacher engagement and participation.

How to identify, address and report students' unprofessional behaviour in medical school

This AMEE guide provides a research overview of the identification of, and responding to unprofessional behaviour in medical students. It is directed towards medical educators in preclinical and clinical undergraduate medical education. It aims to describe, clarify and categorize different types of unprofessional behaviours, highlighting students' unprofessional behaviour profiles and what they mean for further guidance. This facilitates identification, addressing, reporting and remediation of different types of unprofessional behaviour in different types of students in undergraduate medical education. Professionalism, professional behaviour and professional identity formation are three different viewpoints in medical education and research. Teaching and assessing professionalism, promoting professional identity formation, is the positive approach. An inevitable consequence is that teachers sometimes are confronted with unprofessional behaviour. When this happens, a complementary approach is needed. How to effectively respond to unprofessional behaviour deserves our attention, owing to the amount of time, effort and resources spent by teachers in managing unprofessional behaviour of medical students. Clinical and medical educators find it hard to address unprofessional behaviour and turn toward refraining from handling it, thus leading to the 'failure to fail' phenomenon. Finding the ways to describe and categorize observed unprofessional behaviour of students encourages teachers to take the appropriate actions.

A Systematic Approach to Working With Medical Learners in Difficulty: A Faculty Development Workshop

Introduction

For medical educators, applying a systematic approach to working with struggling learners (learners in difficulty) can improve faculty success and satisfaction with the remediation process. Use of the familiar SOAP diagnostic framework can ensure that faculty develop a thorough differential diagnosis and target their interventions to address underlying issues affecting learner success.

Methods

We developed a workshop to teach medical education faculty essential skills for supporting learners in difficulty. Teaching methods included didactic presentation, large-group discussion, and small-group work with role-plays. Over three 2-hour sessions, participants learned to assess a learner in difficulty, develop an initial remediation plan, and evaluate their learning system with the goal of improving support to learners in difficulty. Evaluation included pre- and postsession assessment of learner self-perceived confidence and skill with working with struggling learners, as well as brief postsession evaluation.

Results

Ninety-nine faculty participated in the Learners in Difficulty workshop over 7 years. Participants' overall rating of the workshop was 4.9 (1 = poor, 5 = outstanding). Pre- and postworkshop evaluation showed a statistically significant increase in perceived self-confidence to "Meet the needs of a struggling learner," from an average of 4.4 to 7.6 on a 10-point scale (mean Δ = 3.2; 95% confidence interval, 2.6-3.8; p < .001).

Discussion

This workshop provides a stepwise approach to working with learners in difficulty and assessing participants' educational systems to identify strengths and weaknesses. Evaluations indicated participants felt more confident in their ability to engage in this topic following completion of the workshop.

Guidelines: The dos, don'ts and don't knows of remediation in medical education

INTRODUCTION

Two developing forces have achieved prominence in medical education: the advent of competency-based assessments and a growing commitment to expand access to medicine for a broader range of learners with a wider array of preparation. Remediation is intended to support all learners to achieve sufficient competence. Therefore, it is timely to provide practical guidelines for remediation in medical education that clarify best practices, practices to avoid, and areas requiring further research, in order to guide work with both individual struggling learners and development of training program policies.

METHODS

Collectively, we generated an initial list of Do's, Don'ts, and Don't Knows for remediation in medical education, which was then iteratively refined through discussions and additional evidence-gathering. The final guidelines were then graded for the strength of the evidence by consensus.

RESULTS

We present 26 guidelines: two groupings of Do's (systems-level interventions and recommendations for individual learners), along with short lists of Don'ts and Don't Knows, and our interpretation of the strength of current evidence for each guideline.

CONCLUSIONS

Remediation is a high-stakes, highly complex process involving learners, faculty, systems, and societal factors. Our synthesis resulted in a list of guidelines that summarize the current state of educational theory and empirical evidence that can improve remediation processes at individual and institutional levels. Important unanswered questions remain; ongoing research can further improve remediation practices to ensure the appropriate support for learners, institutions, and society.

Early identification of struggling learners: using prematriculation and early academic performance data

INTRODUCTION

A perennial difficultly for remediation programmes in medical school is early identification of struggling learners so that resources and assistance can be applied as quickly as is practical. Our study investigated if early academic performance has predictive validity above and beyond pre-matriculation variables.

METHODS

Using three cohorts of medical students, we used logistic regression modelling and negative binomial regression modelling to assess the strength of the relationships between measures of early academic performance and outcomes-later referral to the academic review and performance committee and total module score.

RESULTS

We found performance on National Board of Medical Examiners (NBME) exams at approximately 5 months into the pre-clerkship curriculum was predictive of any referral as well as the total number of referrals to an academic review and performance committee during medical school (MS)1, MS2, MS3 and/or MS4 years.

DISCUSSION

NBME exams early in the curriculum may be an additional tool for early identification of struggling learners.

Developing a two-dimensional model of unprofessional behaviour profiles in medical students

Standardized narratives or profiles can facilitate identification of poor professional behaviour of medical students. If unprofessional behaviour is identified, educators can help the student to improve their professional performance. In an earlier study, based on opinions of frontline teachers from one institution, the authors identified three profiles of medical students' unprofessional behaviour: (1) Poor reliability, (2) Poor reliability and poor insight, and (3) Poor reliability, poor insight and poor adaptability. The distinguishing variable was Capacity for self-reflection and adaptability. The current study used Nominal Group Technique and thematic analysis to refine these findings by synthesizing experts' opinions from different medical schools, aiming to develop a model of unprofessional behaviour profiles in medical students. Thirty-one experienced faculty, purposively sampled for knowledge and experience in teaching and evaluation of professionalism, participated in five meetings at five medical schools in the Netherlands. In each group, participants generated ideas, discussed them, and independently ranked these ideas by allocating points to them. Experts suggested ten different ideas, from which the top 3 received 60% of all ranking points: (1) Reflectiveness and adaptability are two distinct distinguishing variables (25%), (2) The term reliability is too narrow to describe unprofessional behaviour (22%), and (3) Profiles are dynamic over time (12%). Incorporating these ideas yielded a model consisting of four profiles of medical students' unprofessional behaviour (accidental behaviour, struggling behaviour, gaming-the-system behaviour and disavowing behaviour) and two distinguishing variables (reflectiveness and adaptability). The findings could advance educators' insight into students' unprofessional behaviour, and provide information for future research on professionalism remediation.

A Road Map for Attending to Medical Students' Professionalism Lapses

PURPOSE

To develop a road map for educators attending to medical students' professionalism lapses, aiming to offer an empirical base for approaching students who display such lapses.

METHOD

Between October 2016 and January 2018, 23 in-depth interviews with 19 expert faculty responsible for remediation from 13 U.S. medical schools were conducted about the way they handle students' professionalism lapses. Three researchers independently completed three rounds of coding. Data collection, coding, and analysis were performed in a constant comparative process. A constructivist grounded theory approach was used to develop an explanatory model for attending to students' professionalism lapses.

RESULTS

Based on participants' descriptions, the authors developed a three-phase approach for attending to professionalism lapses. In phase 1, experts enacted the role of concerned teacher, exploring the lapse from the student's perspective. In phase 2, they functioned as supportive coach, providing feedback on professionalism values, improving skills, creating reflectiveness, and offering support. In phase 3, if the student did not demonstrate reflectiveness and improvement, and especially if (future) patient care was potentially compromised, participants assumed an opposite role: gatekeeper of the profession.

CONCLUSIONS

An explanatory model for attending to professionalism lapses that fits in the overarching "communities of practice" framework was created. Whereas phase 1 and 2 aim at keeping students in the medical community, phase 3 aims at guiding students out. These findings provide empirical support to earlier descriptive, opinion-based models and may offer medical educators an empirical base for attending to students who display professionalism lapses.