Problem neurology residents: a national survey

Hiding in Plain Sight: Resident Remediation in Obstetrics and Gynecology

OBJECTIVE

Residents who are in need of remediation are prevalent across residency programs and often tend to be deficient in multiple competencies that the American Council for Graduate Medical Education (ACGME) has established. The purpose of this study was to determine the prevalence of residents requiring remediation, understand the scope of the challenges in resident remediation, and assess what resources were used to aid in remediation in obstetrics and gynecology programs.

DESIGN

An anonymous survey was emailed to obstetrics and gynecology program directors. Survey responses were summarized through descriptive statistics.

SETTING

Obstetrics and gynecology residency program directors were invited to respond to this survey.

PARTICIPANTS

Thirty-nine respondents out of 241 residency training programs responded (16%).

RESULTS

The majority (84.6%) of programs had placed a resident on remediation. The most common area requiring remediation was professionalism (75.8%), followed by medical knowledge (72.7%), interpersonal communication (60.6%), laparoscopic technical skills (54.6%), and inpatient care (42.4%). Residents who required remediation were identified in a number of ways, most commonly through feedback from the Clinical Competency Committee (87.8%) and faculty feedback (84.8%). Program directors utilized a variety of resources, most commonly prior remediation plans from the program, to create remediation plans. Sixty percent of programs had residents who failed remediation.

CONCLUSION

This study highlighted the prevalence of resident remediation in obstetrics and gynecology training programs and the importance of faculty in identifying residents in need of remediation, evaluating residents, and mentoring residents.

Is insufficient introspection a reason to terminate residency training? - Scrutinising introspection among residents who disputed dismissal

INTRODUCTION

Insufficient introspection as part of the 4I's model of medical professionalism (introspection, integrity, interaction, and involvement) is considered an important impediment in trainees. How insufficient introspection relates to decisions to terminate residency training remains unclear. Insights into this subject provide opportunities to improve the training of medical professionals.

METHODS

We analysed the Dutch Conciliation Board decisions regarding residents dismissed from training between 2011 and 2020. We selected the decisions on residents deemed 'insufficient' regarding introspection as part of the CanMEDS professional domain and compared their characteristics with the decisions about residents without reported insufficiencies on introspection.

RESULTS

Of the 120 decisions, 86 dismissed residents were unable to fulfil the requirements of the CanMEDS professional domain. Insufficient introspection was the most prominent insufficiency (73/86). These 73 decisions described more residents' insufficiencies in CanMEDS competency domains compared to the rest of the decisions (3.8 vs. 2.7 p < 0.001), without significant differences regarding gender or years of training.

CONCLUSIONS

Insufficient introspection in residents correlates with competency shortcomings programme directors reported in dismissal disputes. The 4I's model facilitates recognition and description of unprofessional behaviours, opening avenues for assessing and developing residents' introspection, but further research is needed for effective implementation in medical education.

Using document phenomenology to investigate academic failure among year 1 undergraduate Malaysian medical students

BACKGROUND

Academic failure is common among medical schools worldwide. However, the process behind this failure itself is underexplored. A deeper understanding of this phenomenon may avert the vicious cycle of academic failure. Hence, this study investigated the process of academic failure among medical students in Year 1.

METHODS

This study employed a document phenomenological approach, which is a systematic process to examine documents, interpret them to attain understanding, and develop empirical knowledge of the phenomenon studied. Using document analysis, interview transcripts and reflective essays of 16 Year 1 medical students who experienced academic failure were analysed. Based on this analysis, codes were developed and further reduced into categories and themes. Thirty categories in eight themes were linked to make sense of the series of events leading to academic failure.

RESULTS

One or more critical incidents commenced during the academic year, which led to possible resulting events. The students had poor attitudes, ineffective learning methods, health problems or stress. Students progressed to mid-year assessments and reacted differently to their results in the assessments. Afterwards, the students tried different types of attempts, and they still failed the end-of-year assessments. The general process of academic failure is illustrated in a diagram describing chronological events.

CONCLUSION

Academic failure may be explained by a series of events (and consequences) of what students experience and do and how they respond to their experiences. Preventing a preceding event may prevent students from suffering these consequences.

Changing the Landscape of Remediation: The Creation and Implementation of an Institution-Wide Graduate Medical Education Performance Enhancement Program

Purpose Remediation is a daunting process for both residency leadership and trainees due to several factors including limited time and resources, variable processes, and negative stigma. Our objective was to transform the remediation process by creating a transparent institution-wide program that collates tools/resources, interdepartmental faculty mentors, and positive rebranding. Methods Education leadership across seven specialties created a process for trainees with professionalism and interpersonal-communication skills deficiencies. Formalized departmental program-based improvement plan (PIP) and an institutional house staff performance enhancement plan (HPEP) were developed by consensus of triggers/behaviors. Utilizing published literature, a toolkit was created and implemented. Trainees were enrolled in HPEP if PIP was unsuccessful or exhibited ≥1 major trigger. Wellness evaluations were incorporated into the process to screen for external contributing factors. Surveys were sent to the program director (PD), faculty mentor, and trainee one month and six months after participation. Results Between 2018 and 2021, 12 trainees were enrolled. Overall feedback from PDs and the trainees was positive. The main challenge was finding mutual time for the faculty mentor and trainee to meet. Six-month surveys reported no relapses in unprofessionalism. One-year follow-up of the trainees was limited. Conclusions Utilizing an institution-wide standardized process of performance improvement with the removal of negative stereotyping is a unique approach to remediation. Initial feedback is promising, and future outcome data are necessary to assess the utility. The HPEP may be adopted by other academic institutions and may shift the attitudes about remediation and allow trainees to see the process as an opportunity for professional growth.

Can a Situational Judgment Test Identify Trainees at Risk of Professionalism Issues? A Multi-Institutional, Prospective Cohort Study

PURPOSE

To determine whether overall situational judgment test (SJT) scores are associated with programs' clinical competency committee (CCC) ratings of trainee professionalism, any concerning behavior, and concerning behavior requiring active remediation at 2 time periods.

METHOD

In fall 2019, trainees from 17 U.S. programs (16 residency, 1 fellowship) took an online 15-scenario SJT developed to measure 7 dimensions of professionalism. CCC midyear and year-end (6 months and 1 year following SJT completion, respectively) professionalism scores and concern ratings were gathered for academic year 2019-2020. Analyses were conducted to determine whether overall SJT scores related to overall professionalism ratings, trainees displaying any concerns, and trainees requiring active remediation at both time periods.

RESULTS

Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings ( r = .21 and .14, P &lt; .001 and = .03, respectively). Holding gender and race/ethnicity constant, a 1 standard deviation (SD) increase in overall SJT score was associated with a .20 SD increase in overall professionalism ratings at midyear ( P = .005) and a .22 SD increase at year-end ( P = .001). Holding gender and race/ethnicity constant, a 1 SD increase in overall SJT score decreased the odds of a trainee displaying any concerns by 37% (odds ratio [OR] 95% confidence interval [CI]: [.44, .87], P = .006) at midyear and 34% (OR 95% CI: [.46, .95], P = .025) at year-end and decreased the odds of a trainee requiring active remediation by 51% (OR 95% CI: [.25, .90], P = .02) at midyear.

CONCLUSIONS

Overall SJT scores correlated positively with midyear and year-end overall professionalism ratings and were associated with whether trainees exhibited any concerning behavior at midyear and year-end and whether trainees needed active remediation at midyear. Future research should investigate whether other potential professionalism measures are associated with concerning trainee behavior.

Emotion in remediation: A scoping review of the medical education literature

OBJECTIVES

Remediation can be crucial and high stakes for medical learners, and experts agree it is often not optimally conducted. Research from other fields indicates that explicit incorporation of emotion improves education because of emotion's documented impacts on learning. Because this could present an important opportunity for improving remediation, we aimed to investigate how the literature on remediation interventions in medical education discusses emotion.

METHODS

The authors used Arksey and O'Malley's framework to conduct a scoping literature review of records describing remediation interventions in medical education, using PubMed, CINAHL Complete, ERIC, Web of Science and APA PsycInfo databases, including all English-language publications through 1 May 2020 meeting search criteria. They included publications discussing remediation interventions either empirically or theoretically, pertaining to physicians or physician trainees of any level. Two independent reviewers used a standardised data extraction form to report descriptive information; they reviewed included records for the presence of mentions of emotion, described the mentions and analysed results thematically.

RESULTS

Of 1644 records, 199 met inclusion criteria and were reviewed in full. Of those, 112 (56%) mentioned emotion in some way; others focused solely on cognitive aspects of remediation. The mentions of emotion fell into three themes based on when the emotion was cited as present: during regular coursework or practice, upon referral for remediation and during remediation. One-quarter of records (50) indicated potential intentional incorporation of emotion into remediation programme design, but they were non-specific as to how emotions related to the learning process itself.

CONCLUSION

Even though emotion is omnipresent in remediation, medical educators frequently do not factor emotion into the design of remediation approaches and rarely explicitly utilise emotion to improve the learning process. Applications from other fields may help medical educators leverage emotion to improve learning in remediation, including strategies to frame and design remediation.

Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review

Background

An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.

Objectives

To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.

Design

A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.

Data sources

Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.

Review methods

Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.

Results

A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.

Limitations

Limitations were the low quality of included literature and limited number of UK-based studies.

Future work

Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.

Study registration

This study is registered as PROSPERO CRD42018088779.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.

Mental Health Conditions Among Struggling GME Learners: Results From a Single Center Remediation Program

BACKGROUND

Graduate medical education (GME) learners may struggle with clinical performance during training. A subset of these trainees has mental health conditions (MHCs).

OBJECTIVE

To characterize the MHCs that underlie poor trainee performance and their relationship to specific clinical performance deficit (CPD).

METHODS

At the University of Virginia (UVA), GME learners not meeting appropriate milestones, or who request help, have the option to self-refer or be referred to COACH (Committee on Achieving Competence Through Help). A physician remediation expert assesses the learner and identifies a primary CPD. If there is concern for an MHC, referral is made to a psychologist with expertise in working with trainees. All learners are offered remediation for the CPD. Using descriptive statistics, we tracked the prevalence of MHC and their correlation with specific CPDs.

RESULTS

Between 2016 and 2019, COACH assessed 7% (61 of 820) of GME learners at UVA. Thirty-eight percent (23 of 61) had an MHC associated with the CPD. Anxiety was the most common MHC (48%), followed by depression (17%), cognitive dysfunction (17%), adjustment disorder (13%), and other (4%). Professionalism was the most identified CPD among learners with MHCs (52%). Of remediated learners, 47% have successfully finished remediation, 21% were terminated or voluntarily left their program, and 32% are still being remediated (83% of whom are in good standing).

CONCLUSIONS

MHCs were identified in nearly 40% of struggling learners referred to a centralized remediation program. Professionalism is the most identified CPD among learners with MHCs.

Defining the "Problem Resident" and the Implications of the Unfixable Problem: The Rationale for a "Front-door" Solution

Introduction

Problem residents are common in graduate medical education, yet little is known about their characteristics, deficits, and the consequences for emergency medicine (EM) residencies. The American Board of Internal Medicine (ABIM) defines a problem resident as “a trainee who demonstrates a significant enough problem that requires intervention by someone of authority, usually the program director [PD] or chief resident.” Although this is a comprehensive definition, it lacks specificity. Our study seeks to add granularity and nuance to the definition of “problem resident,” which can be used to guide the recruitment, selection, and training of residents.

Methods

We conducted semi-structured interviews with a convenience sample of EM PDs between 2011 and 2012. We performed qualitative analysis of the resulting transcripts with our thematic analysis based on the principles of grounded theory. We reached thematic sufficiency after 17 interviews. Interviews were coded as a team through consensus.

Results

The analysis identified diversity in the type, severity, fixability, and attribution of problems among problem residents. PDs applied a variety of thresholds to define a problem resident with many directly rejecting the ABIM definition. There was consistency in defining academic problems and some medical problems as “fixable.” In contrast, personality problems were consistently defined as “non-fixable.” Despite the diversity of the definition, there was consensus that residents who caused “turbulence” were problem residents.

Conclusion

The ABIM definition of the problem resident captures trainees who many PDs do not consider problem residents. We propose that an alternative definition of the problem resident would be “a resident with a negative sphere of influence beyond their personal struggle.” This combination acknowledges the identified themes of turbulence and the diversity of threshold. Further, the combination of PDs’ unwillingness to terminate trainees and the presence of non-fixable problems implies the need for a “front-door” solution that emphasizes personality issues at the potential expense of academic potential. This “front-door” solution depends on the commitment of all stakeholders including medical schools, the Association of American Medical Colleges, and PDs.

Prevalence, management, and outcome of problem residents among neurosurgical training programs in the United States

OBJECTIVE

The challenging nature of neurosurgical residency necessitates that appropriate measures are taken by training programs to ensure that residents are properly progressing through their education. Residents who display a pattern of performance deficiencies must be identified and promptly addressed by faculty and program directors to ensure that resident training and patient care are not affected. While studies have been conducted to characterize these so-called “problem residents” in other specialties, no current data regarding the prevalence and management of such residents in neurosurgery exist. The purpose of this study was to determine the rate and the outcome of problem residents in US neurosurgical residency programs and identify predictive risk factors that portend a resident’s departure from the program.

METHODS

An anonymous nationwide survey was sent to all 108 neurosurgical training programs in the US to assess a 20-year history of overall attrition as well as the management course of problem residents, including the specific deficiencies of the resident, management strategies used by faculty, and the eventual outcome of each resident’s training.

RESULTS

Responses were received from 36 centers covering a total of 1573 residents, with the programs providing a mean 17.4 years’ worth of data (95% CI 15.3–19.4 years). The mean prevalence of problem residents among training programs was 18.1% (95% CI 14.7%–21.6%). The most common deficiencies recognized by program directors were poor communication skills (59.9%), inefficiency in tasks (40.1%), and poor fund of medical knowledge (39.1%). The most common forms of program intervention were additional meetings to provide detailed feedback (93.9%), verbal warnings (78.7%), and formal written remediation plans (61.4%). Of the identified problem residents whose training status is known, 50% graduated or are on track to graduate, while the remaining 50% ultimately left their residency program for other endeavors. Of the 97 residents who departed their programs, 65% left voluntarily (most commonly for another specialty), and 35% were terminated (often ultimately training in another neurosurgery program). On multivariable logistic regression analysis, the following 3 factors were independently associated with departure of a problem resident from their residency program: dishonesty (OR 3.23, 95% CI 1.67–6.253), poor fund of medical knowledge (OR 2.54, 95% CI 1.47–4.40), and poor technical skill (OR 2.37, 95% CI 1.37–4.12).

CONCLUSIONS

The authors’ findings represent the first study to characterize the nature of problem residents within neurosurgery. Identification of predictive risk factors, such as dishonesty, poor medical knowledge, and/or technical skill, may enable program directors to preemptively act and address such deficiencies in residents before departure from the program occurs. As half of the problem residents departed their programs, there remains an unmet need for further research regarding effective remediation strategies.

The validity of student tutors' judgments in early detection of struggling in medical school. A prospective cohort study

Early identification and support of strugglers in medical education is generally recommended in the research literature, though very little evidence of the diagnostic qualities of early teacher judgments in medical education currently exists. The aim of this study was to examine the validity of early diagnosis of struggling in medical school based on informal teacher judgements of in-class behavior. The study design was a prospective cohort study and the outcomes/truth criteria were anatomy failure and medical school drop out. Six weeks into an anatomy course, student tutors attempted to identify medical students, who they reckoned would fail the anatomy course or drop out, based on their everyday experiences with students in a large group educational setting. In addition, they were asked to describe the indicators of struggling they observed. Sixteen student tutors evaluated 429 medical students for signs of struggling. By week six, the student tutors were able to detect approximately 1/4-1/3 of the students who eventually failed or dropped out, and for ¾ of the strugglers they identified, they were correct in their judgments. Informal student tutor's judgements showed incremental validity for both outcomes when controlling for grades obtained in preceeding exams. Lack of participation, lack of commitment, poor academic performance, poor social interactions and general signs of distress were the main indicators of struggling identified. Teachers' informal judgements of in-class behavior may be an untapped source of information in the early identification of struggling medical students with added value above and beyond formal testing.

Value of supervised learning events in predicting doctors in difficulty

CONTEXT

In the UK, supervised learning events (SLE) replaced traditional workplace-based assessments for foundation-year trainees in 2012. A key element of SLEs was to incorporate trainee reflection and assessor feedback in order to drive learning and identify training issues early. Few studies, however, have investigated the value of SLEs in predicting doctors in difficulty. This study aimed to identify principles that would inform understanding about how and why SLEs work or not in identifying doctors in difficulty (DiD).

METHODS

A retrospective case-control study of North West Foundation School trainees' electronic portfolios was conducted. Cases comprised all known DiD. Controls were randomly selected from the same cohort. Free-text supervisor comments from each SLE were assessed for the four domains defined in the General Medical Council's Good Medical Practice Guidelines and each scored blindly for level of concern using a three-point ordinal scale. Cumulative scores for each SLE were then analysed quantitatively for their predictive value of actual DiD. A qualitative thematic analysis was also conducted.

RESULTS

The prevalence of DiD in this sample was 6.5%. Receiver operator characteristic curve analysis showed that Team Assessment of Behaviour (TAB) was the only SLE strongly predictive of actual DiD status. The Educational Supervisor Report (ESR) was also strongly predictive of DiD status. Fisher's test showed significant associations of TAB and ESR for both predicted and actual DiD status and also the health and performance subtypes. None of the other SLEs showed significant associations. Qualitative data analysis revealed inadequate completion and lack of constructive, particularly negative, feedback. This indicated that SLEs were not used to their full potential.

CONCLUSIONS

TAB and the ESR are strongly predictive of DiD. However, SLEs are not being used to their full potential, and the quality of completion of reports on SLEs and feedback needs to be improved in order to better identify and manage DiD.

Are neurology residents interested in headache?

INTRODUCTION

The years of residency are the pillars of the subsequent practice in every medical specialty. The aim of our study is to evaluate the current situation, degree of involvement, main interests, and perceived quality of the training received by Spanish residents of neurology, specifically in the area of headache.

METHODS

A self-administered survey was designed by the Headache Study Group of the Spanish Society of Neurology (GECSEN) and was sent via e-mail to all residents who were members of the Society as of May 2015.

RESULTS

Fifty-three residents completed the survey (N = 426, 12.4%): 6% were first year residents, 25.5% second year, 23.5% third year, and 45% fourth year residents, all from 13 different Spanish autonomous communities. The areas of greatest interest are, in this order: Vascular neurology, headache, and epilepsy. Of them, 85% believe that the area of headache is undervalued. More than half of residents (52.8%) do not rotate in specific Headache Units and only 35.8% complete their training dominating anaesthetic block and toxin infiltration techniques. Of them, 81.1% believe that research is scarce or absent; 69.8% have never made a poster/presentation, 79.3% have not published and only 15% collaborate on research projects in this area. Lastly, 40% believe that they have not received adequate training.

CONCLUSIONS

Headache is among the areas that interest our residents the most; however, we believe that we must improve their training both at a patient healthcare level and as researchers. Thus, increasing the number of available courses, creating educational web pages, involving residents in research, and making a rotation in a specialised unit mandatory are among the fundamental objectives of the GECSEN.

Residents in difficulty: a mixed methods study on the prevalence, characteristics, and sociocultural challenges from the perspective of residency program directors

BACKGROUND

The majority of studies on prevalence and characteristics of residents in difficulty have been conducted in English-speaking countries and the existing literature may not reflect the prevalence and characteristics of residents in difficulty in other parts of the world such as the Scandinavian countries, where healthcare systems are slightly different. The aim of this study was to examine prevalence and characteristics of residents in difficulty in one out of three postgraduate medical training regions in Denmark, and to produce both a quantifiable overview and in-depth understanding of the topic.

METHODS

We performed a mixed methods study. All regional residency program directors (N = 157) were invited to participate in an e-survey about residents in difficulty. Survey data were combined with database data on demographical characteristics of the background population (N = 2399) of residents, and analyzed statistically (Chi-squared test (Χ (2)) or Fisher's exact test). Secondly, we performed a qualitative interview study involving three focus group interviews with residency program directors. The analysis of the interview data employed qualitative content analysis.

RESULTS

73.2 % of the residency program directors completed the e-survey and 22 participated in the focus group interviews. The prevalence of residents in difficulty was 6.8 %. We found no statistically significant differences in the prevalence of residents in difficulty by gender and type of specialty. The results also showed two important themes related to the workplace culture of the resident in difficulty: 1) belated and inconsistent feedback on the resident's inadequate performance, and 2) the perceived culturally rooted priority of efficient patient care before education in the workplace. These two themes were emphasized by the program directors as the primary underlying causes of the residents' difficulty.

CONCLUSIONS

More work is needed in order to clarify the link between, on the one hand, observable markers of residents in difficulty and, on the other hand, immanent processes and logics of practice in a healthcare system. From our perspective, further sociological and pedagogical investigations in educational cultures across settings and specialties could inform our understanding of and knowledge about pitfalls in residents' and doctors' socialization into the healthcare system.

The relationship between internal medicine residency graduate performance on the ABIM certifying examination, yearly in-service training examinations, and the USMLE Step 1 examination

PURPOSE

To explore the relationship between United States Medical Licensing Examination (USMLE) Step 1 scores, yearly in-service training exam (ITE) scores, and passing the American Board of Internal Medicine certifying examination (ABIM-CE).

METHOD

The authors conducted a retrospective database review of internal medicine residents from the Medical College of Wisconsin from 2004 through 2012. Residents' USMLE Step 1, ITE, and ABIM-CE scores were extracted. Pearson rho, chi-square, and logistic regression were used to determine whether relationships existed between the scores and if Step 1 and ITE scores correlate with passing the ABIM-CE.

RESULTS

There were 241 residents, who participated in 728 annual ITEs. There were Step 1 scores for 195 (81%) residents and ABIM-CE scores for 183 (76%). Step 1 and ABIM-CE scores had a modest correlation (rho: 0.59), as did ITE and ABIM-CE scores (rho: 0.48-0.67). Failing Step 1 or being in the bottom ITE quartile during any year of testing markedly increased likelihood of failing the boards (Step 1: relative risk [RR]: 2.4; 95% CI: 1.0-5.9; first-year residents' RR: 1.3; 95% CI: 1.0-1.6; second-year residents' RR: 1.3; 95% CI: 1.1-1.5; third-year residents' RR: 1.3; 95% CI: 1.1-1.5).

CONCLUSIONS

USMLE Step 1 and ITE scores have a modest correlation with board scores. Failing Step 1 or scoring in the bottom quartile of the ITE increased the risk of failing the boards. What effective intervention, if any, program directors may use with at-risk residents is a question deserving further research.

Residents in difficulty--just slower learners? A case-control study

BACKGROUND

Recent meta-analyses have found small-moderate positive associations between general performance in medical school and postgraduate medical education. In addition, a couple of studies have found an association between poor performance in medical school and disciplinary action against practicing doctors. The aim of this study was to examine if a sample of Danish residents in difficulty tended to struggle already in medical school, and to determine whether administratively observable performance indicators in medical school could predict difficulties in residency.

METHODS

The study design was a cumulative incidence matched case-control study. The source population was all active specialist trainees, who were medical school graduates from Aarhus University, in 2010 to June 2013 in two Danish regions. Cases were doctors who decelerated, transferred, or dropped out of residency. Cases and controls were matched for graduation year. Medical school exam failures, grades, completion time, and academic dispensations as predictors of case status were examined with conditional logistic regression.

RESULTS

In total 89 cases and 343 controls were identified. The total number of medical school re-examinations and the time it took to complete medical school were significant individual predictors of subsequent difficulties (deceleration, transferral or dropout) in residency whereas average medical school grades were not.

CONCLUSIONS

Residents in difficulty eventually reached similar competence levels as controls during medical school; however, they needed more exam attempts and longer time to complete their studies, and so seemed to be slower learners. A change from "fixed-length variable-outcome programmes" to "fixed-outcome variable-length programmes" has been proposed as a way of dealing with the fact that not all learners reach the same level of competence for all activities at exactly the same time. This study seems to support the logic of such an approach to these residents in difficulty.

Remediation in the context of the competencies: a survey of pediatrics residency program directors

BACKGROUND

The 6 competencies defined by the Accreditation Council for Graduate Medical Education provide the framework of assessment for trainees in the US graduate medical education system, but few studies have investigated their impact on remediation.

METHODS

We obtained data via an anonymous online survey of pediatrics residency program directors. For the purposes of the survey, remediation was defined as "any form of additional training, supervision, or assistance above that required for a typical resident." Respondents were asked to quantify 3 groups of residents: (1) residents requiring remediation; (2) residents whose training was extended for remediation purposes; and (3) residents whose training was terminated owing to issues related to remediation. For each group, the proportion of residents with deficiencies in each of the 6 competencies was calculated.

RESULTS

In all 3 groups, deficiencies in medical knowledge and patient care were most common; deficiencies in professionalism and communication were moderately common; and deficiencies in systems-based practice and practice-based learning and improvement were least common. Residents whose training was terminated were more likely to have deficiencies in multiple competencies.

CONCLUSION

Although medical knowledge and patient care are reported most frequently, deficiencies in any of the 6 competencies can lead to the need for remediation in pediatrics residents. Residents who are terminated are more likely to have deficits in multiple competencies. It will be critical to develop and refine tools to measure achievement in all 6 competencies as the graduate medical education community may be moving further toward individualized training schedules and competency-based, rather than time-based, training.