Changing the Status Quo: Developing a Virtual Sub-Internship in the Era of COVID-19

Association of Virtual Away Rotations With Residency Applicant Outcomes in Otolaryngology

Objective

To examine how virtual away rotations might influence interview and match outcomes in otolaryngology.

Study Design

Cross-sectional retrospective analysis of survey-based study.

Setting

United States medical students applying to otolaryngology residency in the 2020 to 2021 cycle.

Methods

The Texas Seeking Transparency in Application to Residency database was queried to identify otolaryngology applicants during the 2020 to 2021 cycle. The primary outcome was mean number of interview offers. χ 2 tests, 2-sided t tests, logistic regression models, and ordinary least squares regression models were used to examine associations with virtual away rotations.

Results

Among 115 otolaryngology applicants identified, 35 (30.4%) applicants reported completing 1 or more virtual away rotations. Applicants who completed at least 1 virtual away rotation received significantly more interview offers than their counterparts who did not participate in virtual away rotations (mean [SD], 14.9 [8.2] vs 11.6 [7.9]; P < .03). Each virtual away rotation completed was associated with an incremental increase of 2 additional interview offers (β coefficient: 2.29 [95% confidence interval, CI: 0.8-3.7; P < .01]). Applicants who completed a virtual away rotation were more likely to receive an interview from that program (62.7% vs 16.8%, P < .01) and to match there (odds ratio 7.7 [95% CI: 2.7-21.7]; P < .01) when compared to applicants who had not done the away rotation. Participation in virtual away rotations was not associated with significant improvement in match success (82.9% vs 67.5%; P = .09).

Conclusion

Virtual away rotations were associated with improved program-specific interview and match outcomes, as well as a higher overall number of interview offers.

The Impact of COVID-19 on the Urology Residency Match and Geographic Proximity of Applicants

OBJECTIVE

To determine the impacts of COVID-19 pandemic-related changes and program-specific characteristics on the geographic diversity of the 2021 and 2022 urology match classes.

METHODS

We gathered publicly available information to compare match outcomes in 2021 and 2022 to the previous 5 application cycles (2016-2020). Variables included residency program class size, program and resident AUA section, and program and resident medical school. Univariate comparisons were made with Fisher's t-tests. Odds ratios were calculated following multivariable analysis.

RESULTS

Comparing the previous 5 application cycles to the 2 pandemic years individually and together showed no significant changes in home or in-section matches. However, when comparisons were stratified by small (1-2 residents) vs large (3+ residents) programs, a significant increase in at-home and in-section matches was observed for small programs in 2021. Large programs did not experience significant changes in match patterns. Multivariate analysis showed that small programs had significantly lower odds of matching applicants from home institutions and within AUA sections. Additionally, certain AUA sections demonstrated significantly increased likelihood of accepting in-section applicants.

CONCLUSION

The changes from in-person to virtual application cycles during the pandemic particularly affected small residency programs in 2021. With easing restrictions and logistical improvements in the 2022 cycle, locoregional match rates partially shifted back to prepandemic patterns, though not completely. Although the pandemic did not affect geographic diversity in urology as much as in other surgical subspecialties, these findings and further study should be considered to optimize upcoming cycles.

Graduating Medical Students' Experiences with Away (In-Person and Virtual) Rotations During COVID-19: Analysis of the Association of American Medical Colleges (AAMC) 2021 Graduation Questionnaire (GQ)

OBJECTIVE

The COVID-19 pandemic disrupted students' opportunities for away rotations (ARs). Schools and specialty organizations innovated by supplementing in-person ARs (ipARs) with virtual ARs (vARs). We sought to determine how ipAR and vAR completion varied by intended specialty among 2021 graduates.

DESIGN

Using de-identified Association of American Medical Colleges 2021 Graduation Questionnaire (GQ) data, we examined AR completion by specialty and community-based school attendance (among other variables) in univariate analysis and multivariable logistic regression models.

SETTING

Students graduating from MD-degree granting U.S. medical schools were invited to complete the 2021 GQ, administered electronically on a confidential basis.

PARTICIPANTS

Our study included data for 15,451 GQ respondents (74% of all 2021 graduates).

RESULTS

Among GQ respondents, 18% (2,787/15,451) completed ARs: 8% (1,279/15,451) ipAR only, 8% (1,218/15,451) vAR only, and 2% (290/15,541) both. In univariate analysis, specialty and community-based school attendance (each p < 0.001), among other variables, were associated with ipAR and with vAR. In multivariable logistic regression, surgical specialties associated with greater odds of AR completion (vs. general surgery reference) included neurological surgery (ipAR: adjusted odds ratio [AOR]=1.9, 95% confidence interval [CI]=1.1-3.3; vAR AOR=3.1, 95% CI=1.9-4.9), ophthalmology (ipAR: AOR=2.3, 95% CI=1.6-3.3; vAR: AOR=2.5, 95% CI=1.7-3.7), orthopedic surgery (ipAR: AOR=2.5, 95% CI=1.8-3.4; vAR: AOR=12.4, 95%CI=9,2-16.5), otolaryngology (ipAR: AOR=1.8, 95% CI=1.2-2.8; vAR: AOR=4,8, 95% CI=3.4-6.9), plastic surgery (ipAR: AOR=2.1, 95% CI=1.2-3.5; vAR: AOR=13.9, 95% CI=9.3-20.7) and urology (ipAR: AOR=2,1, 95% CI=1.4-3.2; vAR: AOR=11.9, 95% CI=8.4-16.8). Community-based medical school attendance was also associated with greater odds of ipAR (AOR=4.6, 95% CI=3.1-6.7) and vAR (AOR=1.8, 95% CI=1.4-2.3).

CONCLUSIONS

The prevalence of AR completion was low. Differences we observed by specialty and medical school type aligned well with recommended circumstances for ipARs for the class of 2021. Substantial specialty-specific differences in vAR completion suggest that various surgical specialties were among the early innovators in this regard.

The Impact of COVID-19 on Surgical Training and Education

The COVID-19 pandemic disrupted conventional medical education for surgical trainees with respect to clinical training, didactics, and research. While the effects of the COVID-19 pandemic on surgical trainees were variable, some common themes are identifiable. As hordes of COVID-19 patients entered hospitals, many surgical trainees stepped away from their curricula and were redeployed to other hospital units to care for COVID-19 patients. Moreover, the need for social distancing limited traditional educational activities. Regarding clinical training, some trainees demonstrated reduced case logs and decreased surgical confidence. For residents, fellows, and medical students alike, most didactic education transitioned to virtual platforms, leading to an increase in remote educational resources and an increased emphasis on surgical simulation. Resident research productivity initially declined, although the onset of virtual conferences provided new opportunities for trainees to present their work. Finally, the pandemic was associated with increased anxiety, depression, and substance use for some trainees. Ultimately, we are still growing our understanding of how the COVID-19 pandemic has redefined surgical training and how to best implement the lessons we have learned.

Analyses of Orthopaedic Surgery Residency Interviews

Interviews are a critical component of orthopaedic surgery residency selection for both the applicant and the program. Some institutions no longer report Alpha Omega Alpha (AOA) designation or class rank, and US Medical Licensing Examination (USMLE) Step 1 recently switched to pass/fail scoring. During the coronavirus disease 2019 (COVID-19) pandemic, all Accreditation Council for Graduate Medical Education programs conducted virtual interviews and subinternship rotations were restricted. These changes offer significant challenges to the residency match process. The purpose of this study was to examine the residency applicant interview and ranking process at a large urban academic university setting. We hypothesized that large variability exists among evaluations submitted by faculty interviewers and also that applicant academic factors (i.e., USMLE Step 1 score) would show association with final ranking.

Methods

We retrospectively reviewed the 2020-2021 and 2021-2022 residency interview cycles, both conducted virtually due to the COVID-19 pandemic. Residency application (i.e., applicant demographic and academic backgrounds) and interview data (i.e., faculty interviewer scores) were recorded. Interobserver reliability among faculty interviewers was calculated. Statistical analysis was performed to determine factors associated with ranking of applicants.

Results

There were 195 included applicants from the 2020 and 2021 interview cycles. There was no true agreement of interviewers' scoring of shared applicants (kappa intraclass coefficient range 0-0.2). Applicant factors associated with being ranked include applying to the match for the first time, USMLE Step 1 and 2 scores, educational break (vs. consecutive completion of college and medical school in 4 years each), higher class rank, and greater interviewer scores. Factors associated with better rank included additional degrees (i.e., PhD or MBA), couples match, AOA designation, educational break, underrepresented minority status, and notable attributes (i.e., collegiate athletics or Eagle Scout participation). Factors associated with worse rank included male sex, international medical graduate, prior match history, science major, extended research (i.e., >1 year spent in a research role), and home medical school students.

Conclusions

There was significant variability and no reliability at our institution among faculty interviewers' applicant ratings. Being ranked was based more on academic record and interview performance while final rank number seemed based on applicant qualities. The removal of merit-based objective applicant measurements offers challenges to optimal residency applicant and program match.

Level of Evidence

III (retrospective cohort study).

Designing the "match of the future": challenges and proposed solutions in the interview and match phase of the UME-GME transition

This review focuses on the interview and match process with the purpose of broadly reviewing challenges in the current surgical residency selection process, detailing potential solutions, and identifying future avenues of investigation.

Life satisfaction, resilience and coping mechanisms among medical students during COVID-19

PURPOSE

Life satisfaction influences well-being. Medical students often experience more stress as compared to their counterparts in other disciplines as they are required to meet the demands of both academic workload and clinical responsibilities. However, during the current pandemic, in addition to academic changes, inability to complete clinical placements, loss of peer interaction and social connectedness and, deployment to areas in times of crisis could exacerbate their stress. This would impact their ability to cope with stress and eventually influence their life satisfaction. Students approach these challenges in various ways, either positively, religiously, or by avoiding. This study aimed to explore the association between resilience, coping mechanisms and life satisfaction in medical students during the pandemic.

METHODS

A cross-sectional web-based survey was conducted from undergraduate medical students from year 1 to year 5. Three instruments were used to measure life satisfaction, resilience, and coping, namely The Brief Resilience Scale, The Satisfaction with Life Scale and the COPE inventory. Mean and standard deviation were calculated for all continuous variables. Robust linear regression model was used for analysis. Hierarchical (forward) stepwise model building technique was used for final model. Alpha cut off was kept at 0.05.

RESULTS

A total of 351 students (out of 500 students) completed the questionnaires. A moderately negative, slightly linear correlation between life satisfaction and avoidant coping was reported. Life satisfaction showed moderately positive, slightly linear correlation with resilience score. Three variables stayed significant in the final model: Resilience, avoidant coping, and religion coping.

CONCLUSION

Life satisfaction can be improved among medical students by focusing on strategies which enhance resilience. Religion is identified as a significant coping strategy among medical students. Students coping mechanism can vary and more research is needed to assess which types of coping strategies could contribute positively to the quality of their personal and professional lives.

Effect of the COVID-19 pandemic on the residency match among surgical specialties

Background

Despite unprecedented changes to undergraduate medical education and the residency selection process during the COVID-19 pandemic, there is little objective evidence on how the pandemic affected match outcomes such as matched applicant characteristics, interview distribution, geographic clustering, and associated costs. We investigated COVID-19’s impact on the residency match by comparing surgery applicants’ characteristics, interview distribution, and related costs from 2018 to 2020 to 2021.

Methods

Data from the Texas Seeking Transparency in Applications to Residency initiative were analyzed. Descriptive statistics, bivariate testing, and sensitivity analysis were performed to compare matched applicants in surgical specialties from 2018–2020 to 2021.

Results

This study included 5,258 applicants who matched into 10 surgical specialties from 2018 to 2021. In 2021, there was a decrease in proportion of students who reported a geographic connection to their matched program (38.4% vs 42.1%; P = .021) and no significant difference in number of interviews attended (mean [SD], 13.1 [6.2] vs 13.3 [4.7]; P = .136) compared to prior years. Applicants in 2021 had more research experiences and fewer honored clerkships (both P < .001), and these associations persisted in sensitivity analysis. Matched applicants in 2021 reported significantly lower total costs associated with the residency application process compared to 2018 to 2020 (mean [SD] $1,959 [1,275] vs $6,756 [4,081]; P < .001).

Conclusion

Although COVID-19 appeared to result in a reduction in number of honored clerkships, it may have provided more opportunities for students to engage in research. Overall, the adoption of virtual interviews and away rotations may have successfully mitigated some of the adverse consequences of the pandemic on the residency match for surgical specialties.

Efficacy of an Online Blended Learning Curriculum to Improve Medical Student Urologic Education

OBJECTIVE

During the COVID-19 pandemic, limitations on in-person medical school clerkships created a deficit in urologic learning opportunities. We sought to develop and evaluate a blended curriculum of interactive online modules with small-group discussion to enhance the educational experience for medical students in urology.

MATERIALS AND METHODS

We created a curriculum of four online case-based urology modules. Between July and October 2020, 14 fourth-year medical students completed the modules. Students answered questions on a discussion board and engaged in asynchronous dialogue with 16 physicians, in addition to a weekly live review session. Students and physicians completed anonymous surveys to assess satisfaction and perceived learning outcomes, with questions scored on a 5-point Likert scale.

RESULTS

Thirteen students (93% response rate) and 12 physicians (75% response rate) completed the survey. Overall, 12/13 students and 11/12 physicians "strongly agree" or "somewhat agree" that the modules improved the rotation. Students and physicians perceived that the modules were effective for learning/teaching foundational knowledge (average ratings 4.8 and 4.5, respectively) and facilitating performance assessment (4.4 and 4.0). Students reported high learning scores across multiple Accreditation Council for Graduate Medical Education core competencies, and 12/13 students found the modules fun/engaging. The majority of students (12/13) and physicians (10/12) felt that the online modules should be incorporated into future urology electives.

CONCLUSIONS

A blended learning curriculum utilizing online modules is an effective tool for enhancing urologic education, improving perceived learning outcomes and facilitating performance assessment.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-021-01427-3.

National Implementation and Evaluation of a Virtual Subinternship in Urology

OBJECTIVES

To conduct a nationwide evaluation of student and program director (PD) perspectives of virtual subinternships that took place during the COVID-19 pandemic.

METHODS

In December 2020, we distributed anonymous surveys to all 534 urology residency applicants and 161 urology PDs at academic medical centers across the United States to evaluate virtual subinternships. Surveys assessed curriculum composition, goals, satisfaction, barriers, and future reusability. The primary outcome was overall satisfaction with the subinternship, evaluated on a 5-point Likert scale.

RESULTS

The survey was completed by 174 students (33%) and 82 PDs (51%), including 81 students (47%) and 32 PDs (41%) who participated in virtual subinternships at 29 institutions. Overall, 77% of students and 78% of PDs rated the electives "excellent" or "very good." On ordinal logistic regression, higher student ratings were associated with duration ≥3 weeks (OR 4.64, p=0.003) and class size ≤4 students (OR 3.33, p=0.015). Higher PD ratings were associated with full-time electives (OR 11.18, p=0.019), class size ≤4 students (OR 13.99, p=0.042), and utilization of the standardized Guidebook from the Society of Academic Urologists (OR 11.89, p=0.038). The most commonly reported challenge to the subinternship's efficacy was lack of hands-on learning (87% of students and 81% of PDs). Looking forward, 45% of students and 66% of PDs recommended incorporating virtual components into future electives.

CONCLUSIONS

The virtual subinternship was a coordinated nationwide initiative to provide urologic education to medical students during a pandemic. The most successful courses were structured with longer duration, full-time commitment, and small class size.

Home Field Advantage: Assessing the Geographic Trends of the Plastic Surgery Residency Match during the COVID-19 Pandemic

OBJECTIVE

In previous plastic surgery residency match cycles, in-person activities at other institutions, such as away rotations, have facilitated matches outside of an applicant's home program or region. The COVID-19 pandemic, however, limited these in-person opportunities. Therefore, we hypothesized that applicants of the 2021 cycle would be more likely to match into programs with which they have existing geographic connections when compared to previous years.

DESIGN

Residency websites and social media accounts were searched for resident names and educational information for those matching in 2021 and 2015 to 2020. Outcomes included proportion of applicants matching at the program affiliated with their medical school ("home program"), or matching in the same state or United States Census Map region as their medical school or undergraduate institution. Subgroup analyses were stratified by program region, incoming resident class size, and Doximity residency reputation ranking.

SETTING

Columbia University (New York).

PARTICIPANTS

For the 2015 to 2020 residency cycles, 963 residents were identified from 78 (95.1%) programs. For 2021, 159 incoming interns were identified from 70 (82.3%) programs.

RESULTS

2021 applicants matched into their home program at higher rates than 2015-2020 applicants (36.0% vs. 24.1%, p  = 0.019). This trend was similar regardless of program region or size. This increase was significant for programs ranked outside of the top 30 (41.5% vs. 26.4%, p = 0.032), but not for the top 30 programs (32.1% vs. 22.3%, p = 0.128). Excluding those who matched at their home program, 2015 to 2020 and 2021 applicants matched in the same state or region of their medical school or undergraduate institution at similar rates (p > 0.05 for all).

CONCLUSIONS

During the COVID-19 pandemic, plastic surgery residency programs matched more applicants from affiliated medical schools than in previous years. This may result from lack of in-person opportunities for applicants at other programs. Alternative relationship-building opportunities may facilitate broader geographic connections in the 2022 cycle.

A virtual sub-internship for otolaryngology-head and neck surgery

OBJECTIVE

During the COVID-19 pandemic, away rotations were suspended for safety purposes. This led to the development of online interactive learning modules for students, now known as virtual sub-internships (VSIs). To date, VSIs within otolaryngology-head and neck surgery (OHNS) have been limited in their description and design.

STUDY DESIGN

Cross-sectional survey.

SETTING

ACGME-accredited OHNS residency program.

METHODS

Our curriculum for an OHNS VSI is presented. Based on the model used by our OHNS residency program, the VSI consisted of a 2-week block of activities and interactive small-group discussions. A post-VSI feedback survey was distributed to participants; results are reported.

RESULTS

Six 2-week VSI sessions were administered. Twenty-one individuals participated from all US regions, median 4 individuals per session. Fifteen participants (71.4%) completed the feedback survey. Of survey respondents, 20% lacked a home OHNS residency program, and no respondents' home-programs featured a VSI. All respondents were satisfied with the schedule and organization of the VSI, and 73.3% (11 of 15) felt it was of appropriate duration. All respondents reported a high degree of familiarity with the program, with a greater (86.7%) or equal (13.3%) level of interest in applying to the residency program as a result of participating in the VSI.

CONCLUSION

This VSI curriculum offers a well-received virtual learning experience for medical students applying to OHNS residency. It provides an opportunity for programs to expand their appeal to potential applicants who may otherwise be restricted in their ability to travel.