Assessment of Gender Differences in Letters of Recommendation for Physical Therapy Residency Applications

INTRODUCTION

Letters of recommendation (LOR) are an integral component of physical therapy residency applications. Identifying the influence of applicant and writer gender in LOR will help identify whether potential implicit gender bias exists in physical therapy residency application processes.

REVIEW OF LITERATURE

Several medical and surgical residency education programs have reported positive, neutral, or negative LOR female gender bias among applicants and writers. Little research exists on gender differences in LOR to physical therapy education programs or physical therapy residency programs.

SUBJECTS

Seven hundred sixty-eight LOR were analyzed from 256 applications to 3 physical therapy residency programs (neurologic, orthopaedic, sports) at one institution from 2014 to 2020.

METHODS

Thematic categories were developed to identify themes in a sample of LOR. Associations between writer and applicant gender were analyzed using summary statistics, word counts, thematic and psycholinguistic extraction, and rule-based and deep learning Natural Language Processing .

RESULTS

No significant difference in LOR word counts were found based on writer or applicant gender. Increased word counts were seen in sports residency LOR compared with the orthopaedic residency. Thematic analysis showed LOR gender differences with male applicants receiving more positive generalized recommendations and female applicants receiving more comments regarding interpersonal relationship skills. No thematic or psycholinguistic gender differences were seen by LOR writer. Male applicants were 1.9 times more likely to select all male LOR writers, whereas female applicants were 2.1 times more likely to choose all female LOR writers.

DISCUSSION AND CONCLUSION

Gender differences in LORs for physical therapy residencies were found using a comprehensive Natural Language Processing approach that identified both a positive recommendation male applicant gender bias and a positive interpersonal relationship skill female applicant gender bias. Applicants were not harmed nor helped by selecting LOR writers of the opposite gender. Admissions committees and LOR writers should be mindful of potential implicit gender biases in LOR submitted to physical therapy residency programs.

Navigating power dynamics between pharmacy preceptors and learners

Pharmacy preceptors are crucial in pharmacy experiential education. They help develop learners during didactic learning, experiential learning, and post-graduate training. Preceptors hold a position of authority over learners as they are responsible for providing feedback and ultimately completing evaluations that determine whether the student passes or does not pass the rotation. Preceptor status, behavior, and communication style may cause students to feel intimidated. Preceptors should be aware of this power differential and keep generational, gender, cultural, and other factors in mind when providing feedback. Preceptors should also receive training and be open to constructive feedback from learners to ensure the experience meets the needs of the learner and allow for adjustments on the experiential rotation. Students should be empowered to provide open and honest feedback to preceptors in a psychologically safe environment without fear of repercussions.

Assessment of gender differences in letters of recommendation for pharmacy residency applicants

Disclaimer

In an effort to expedite the publication of articles related to the COVID-19 pandemic, AJHP is posting these manuscripts online as soon as possible after acceptance. Accepted manuscripts have been peer-reviewed and copyedited, but are posted online before technical formatting and author proofing. These manuscripts are not the final version of record and will be replaced with the final article (formatted per AJHP style and proofed by the authors) at a later time.

Purpose

Letters of recommendation (LORs) are highly regarded components of pharmacy residency applications, as they provide insight into an applicant’s character and capabilities. In other medical fields, differences in language have been reported for letters written for female and male applicants; however, data on gender differences in LORs for pharmacy residency applications are currently lacking.

Methods

LORs for applicants to our institution’s postgraduate year 1 pharmacy residency program for the 2019-2020 academic year were extracted and processed by a natural language processing service. Words within 18 categories were identified and counted for each LOR. Total was also compared.

Results

Of the 473 LORs included for analysis, 320 (67.7%) were written for female applicants and 153 (32.3%) were written for male applicants. Approximately two-thirds of all writers were women for both female and male applicants. In comparing letters for women and men, there was a statistically significant difference in the percentage of LORs that contained terms in categories described as gendered, solitary/reserved, and desire. There was no statistically significant difference in total or in the presence of words in other categories such as grindstone, standout, agentic, or communal. When controlling for grade point average, writer gender, duration that the writer knew the applicant, and the writer’s professional position, there were no changes to the statistical findings.

Conclusion

Letters written for female and male applicants were largely similar with regard to length and word categories utilized. While no clear gender bias was found when evaluating pharmacy residency LORs, writers must continue to assess their implicit biases and how those biases might affect a candidate’s application.

Impact of PhORCAS references on overall application score for postgraduate year 1 pharmacy residency candidates

Purpose

The disparity between the number of applicants for postgraduate year 1 (PGY1) pharmacy residency positions and the number of available residency positions increases the need to optimize how applicants are evaluated. The purpose of the study described here was to evaluate the correlation of ratings of residency candidate characteristics by academic and professional references listed on residency applications with overall application score, applicant ranking, and the likelihood of candidates receiving an invitation to interview.

Methods

A multicenter, retrospective study was conducted to evaluate the correlation of reference writers’ ratings of 13 candidate characteristics and their overall recommendations with program-determined outcomes (eg, final application score, applicant ranking, and invitation to interview) through analysis of PGY1 applications submitted through the Pharmacy Online Residency Centralized Application System (PhORCAS) from 2015 through 2018. Keywords and themes within the open-ended section of letters of reference were also analyzed for correlation with overall application score.

Results

A total of 5,923 references listed on 1,867 applications to 4 PGY1 pharmacy residency programs processed by PhORCAS were included in the analysis. For the majority of applicant characteristic ratings (ie, 74% of 56,872 ratings overall), reference writers rated candidates as exceeding expectations, and applicants were “highly recommended” by these evaluators in 91% of cases. References’ average characteristic ratings and overall recommendations were poorly correlated with final application score (R2 = 0.12 [P < 0.0001] and R2 = 0.08 [P < 0.0001], respectively), final ranking (R2 = 0.02 [P < 0.0001] and R2 = 0.03 [P < 0.0001], respectively), and invitation to interview (R2 = 0.07 [P < 0.0001] and R2 = 0.04 [P < 0.0001], respectively). For the themes evaluated, references’ use of teaching words best correlated with normalized final application score, although the correlation was poor (R2 = 0.007, P = 0.0001).

Conclusion

Reference writers’ ratings of PGY1 residency candidate characteristics in PhORCAS are poorly correlated with application score, applicant ranking, and invitation to interview. The results of this study suggest that the existing PhORCAS standardized form for submitting references is of limited utility in its current state.