Racial Bias on the Emergency Medicine Standardized Letter of Evaluation

A Narrative Review of Key Studies in Medical Education in 2022: Applying the Current Literature to Educational Practice and Scholarship

The expectation of every academic pediatrician is to stay updated on current evidence in their field; this is especially true of pediatric clinician educators who are training the next generation of pediatricians. Since 2016, select members of the Academic Pediatric Association Education Committee have curated educational research articles in order to distill the increasing volume of research related to medical education. The purpose of this narrative review is to summarize 14 articles published in 2022 related to medical education that may impact the work of pediatric clinician educators and educational leadership. These articles are organized into 6 overarching domains: selection and recruitment, promoting learner growth and development, learning environment and wellness, curriculum development, assessment, and educator development.

Letters of recommendation for gynecologic oncology fellowship differ by gender and race

INTRODUCTION

Letters of recommendation (LOR) play a significant role in applicant selection for gynecologic oncology (GO) fellowship. LORs can be agentic, associated with competence, independence and strength, or communal, associated with being accommodating, cooperative and empathetic. Agentic LORs have been shown to reflect favorably on applicants, making them more likely to be selected for interview. The primary goal of this study was to determine linguistic differences in LORs for applicants applying to GO fellowship based on applicant gender and race.

METHODS

All applications to a single academic institution from the years 2018-2020 were analyzed. LORs were extracted from all applicants who self-reported their gender and race/ethnicity. Analysis was performed using Linguistic Inquiry Word Count (LIWC) in terms of agentic and communal language. All analysis was done using SAS version 9.4.

RESULTS

From 2018 to 2020, there were 239 GO fellowship applications to a single academic institution. There were 186 (78.1%) applicants who identified as female and 52 (21.8%) who identified as male. Female applicants were more likely to have more research (p = 0.047) and volunteer activities (p = 0.02) than male applicants. There were no differences between female and male applicants in terms of age, geographic location of residency, USMLE scores, AOA status, number of publications or attending a Doximitiy-rated top 20 residency program. There were 139 (60.7%) applicants who identified as White, 46 (20.1%) as Asian, 16 (7.0%) as Black, 19 (8.3%) as Latinx and 9 (3.9%) as other. On multivariable analysis, LORs written for male applicants had higher agentic scores compared to females (p < 0.05), and LORs of female applicants received higher communal scores (p < 0.05). LORs for applicants who identified as Black or Latinx were found to have lower agentic scores compared to individuals who identified as White(p < 0.05 for both).

CONCLUSION

There were demonstrated linguistic differences in LOR for GO fellowship based on applicant gender and race/ethnicity. LORs written for white, male applicants were more likely to have higher agentic scores compared to minority, female applicants. LORs written for female applicants were more likely to have higher communal scores. As LORs have been shown to be instrumental in GO fellowship interview selection and linguistic differences exist based on applicant gender and race/ethnicity, this study highlights the need for a more objective GO fellowship application process.

DISCLOSURES

Portion of this paper was presented at the Society for Gynecologic Oncology as part of a focus plenary.

The Utility of the Plastic Surgery Standardized Letter of Recommendation Form in Predicting Residency Match Outcomes

BACKGROUND

Letters of recommendation play an important role in resident selection. While plastic surgery's Standardized Letter of Recommendation (SLOR) form most commonly serves as an adjunct to narrative letters, the SLOR provides objective data in the review process and could eventually replace narrative letters. The utility of the SLOR in predicting Match outcomes has not been studied.

METHODS

Applicant data from 225 first-time residency applicants in 2020-21 were collected. Logistic regression modeling was used to predict Match outcomes. This model was validated using 100 randomly selected applicants from 2019-20.

RESULTS

Rank placement (SLOR Question 6) was the most important factor when predicting Match outcomes (p<0.0001). All other SLOR questions were not predictive and subject to notable score inflation. No SLOR score differences were noted based on race; female applicants were rated higher in two of ten domains (p<0.05).

CONCLUSIONS

One question on the plastic surgery SLOR was highly predictive of an applicant matching. However, the remaining SLOR questions had little utility and were subject to gross score inflation. Further work should be done to optimize the utility of the SLOR in differentiating applicants. This has important implications in ensuring the selection of professional, competent residents according to the aims of the Accreditation Council of Graduate Medical Education.

Approaches to address bias in letters of recommendation

Letters of recommendation are ubiquitous in the research enterprise. Requesting, writing, and reviewing letters of recommendation are all fraught with bias, especially for individuals from groups historically excluded from research environments. We detail how letter reviewers, requesters, and writers can make letters of recommendation a more equitable tool to evaluate scientists.