Applicant Reactions to the AAMC Standardized Video Interview During the 2018 Application Cycle

Perspectives on virtual interviews for dental school admissions

INTRODUCTION

Admissions interviews are an integral part of the dental school application process. In light of the COVID-19 pandemic, interviews had to adapt and become a part of the virtual realm. The purpose of the study was to evaluate the perspectives of interviewees and interviewers in this process.

METHODS

Admission data for all prospective students were compiled for the classes of 2016 through 2025 to compare in-person to virtual interview scores. Additionally, surveys were sent to members of the admissions committee as well as interviewees asking questions regarding the virtual interview experience. A Likert scale was used for the majority of questions and free responses were also an option.

RESULTS

The comparison data showed that the virtual candidates may have had higher overall undergraduate and application scores, in addition to better interview scores compared to in-person candidates. Interviewees and interviewers both agreed in their top three rankings of what was enjoyable about the virtual interviews, specifically the lower cost for applicants, the convenience, and the safety during the pandemic. There was also agreement with their top three aspects that were least desirable in the interview process, specifically the absence of visual cues/lack of body language, lack of personal contact, and connectivity issues. Around 74% of committee members would recommend virtual interviews in the future whereas only 49% of interviewees would recommend virtual interviews in the future.

CONCLUSION

The pandemic brought about many changes, including the way admissions interviews were conducted. While this was a change made of necessity, it was valuable to explore the appropriateness of implementing virtual interviews in the future as a part of dental school admissions processes.

Video-based interviewing in medicine: a scoping review

BACKGROUND

The Coronavirus 2019 pandemic necessitated a rapid uptake of video-based interviewing within the personnel selection process in healthcare. While video-based interviews have been evaluated previously, we identified a gap in the literature on the implementation of video-based interviews and how they compare to their face-to-face counterparts.

METHODS

A scoping review was conducted to consolidate the available literature on the benefits and limitations of video-based interviews and to understand the perceived barriers associated with transitioning away from face-to-face interviews. A search strategy, developed in concert with an academic health sciences librarian, was run on Ovid MEDLINE, Embase, PsycInfo, and Cochrane Central. The search was performed on March 31, 2020, and updated on February 21, 2021. Studies that implemented and evaluated the impact of video-based interviewing in healthcare were included in our study. Review articles and editorials were excluded.

RESULTS

Forty-three studies were included in our scoping review, of which 17 were conference abstracts and 26 were peer-reviewed manuscripts. The risk of bias was moderate or high in most studies, with only four studies having a low risk of bias. Both financial costs and opportunity costs associated with the selection process were reported to be improved with video-based interviewing, while no studies explored the impact on environmental costs. Technical limitations, which were not prevalent, were easily managed during the interview process. Overall, video-based interviews were well received by both applicants and interviewers, although most participants still reported a preference for face-to-face interviews.

CONCLUSIONS

While video-based interviewing has become necessary during the Coronavirus 2019 era, there are benefits from a financial, opportunistic, and environmental point of view that argue for its continued use even after the pandemic. Despite its successful implementation with minimal technical issues, a preference still remains for face-to-face interviews. Reasons for this preference are not clear from the available literature. Future studies on the role of nonverbal communication during the video-based interview process are important to better understand how video-based interviewing can be optimized.

SYSTEMATIC REVIEW REGISTRATION

This scoping review was registered with Open Science Framework.

Reshaping Residency Recruitment: Achieving Alignment Between Applicants and Programs in Surgery

OBJECTIVE

The residency recruitment process has become increasingly challenging for both applicants and program directors, in part, due to the inflation in the number of applications per student. As a result, it has become more daunting for programs to design processes that evaluate applicants holistically. Furthermore, the existing methods used to evaluate and select applicants do not necessarily predict success in residency and may inadvertently lend to gender, racial, and ethnic bias. This narrative review aims to identify innovative tools used in residency recruitment that will allow programs and applicants to better determine concordance of interests and achieve value alignment while supporting improved, objective evaluation of an applicant's unique attributes and experiences.

DESIGN

PubMed was used to conduct a narrative review of recruitment strategies in admission processes of undergraduate and graduate medical education between 1975 and June 2021, using the designated Medical Subject Heading (MeSH0 terms. Inclusion criteria were established surrounding innovative tools to better objectively screen, evaluate, or select applicants. Strategies relying primarily on traditional metrics (United States Medical Licensing Examination (USMLE) scores, Alpha Omega Alpha status, and clerkship grades) were excluded.

RESULTS

Forty-two articles met specific inclusion criteria. Using these articles, a framework was created with two specific aims: (1) to allow applicants and programs to express or assess interest and (2) to foster objective review of unique applicant attributes, skills, experiences, and competencies that align with program mission and values. The following five innovative tools for recruitment were identified: preference signaling, secondary applications, standardized letters of recommendation, situational judgment testing, and surgical simulation.

CONCLUSIONS

As the number of applications continues to rise, strategies must be implemented to allow applicants and institutions to achieve better alignment or "fit," while also giving balanced consideration to all of an applicant's unique characteristics. A more holistic approach to applicant selection is a necessary tool in order to increase diversity and inclusion within the field of surgery.

Psychological Benefits and Challenges of Ph.D. Entrance Exam Virtual Interviews During COVID-19 Pandemic: Does Gender Play a Role?

This study aimed to investigate the reflections of Iranian students on Ph.D. entrance exam interviews held virtually nationwide during the Pandemic. Two hundred thirty-one Ph.D. applicants were invited to fill out an anonymous online survey designed in Google Forms, 36 out of whom volunteered to participate in follow-up semi-structured interviews. Two ANOVA measures were used to investigate the possible influences of gender and prior virtual interview experience on the applicants’ perceptions. Thematic analysis was also adopted to explore the participants’ attitudes and perceptions toward virtual interviews (VI). Quantitative findings showed that Iranian Ph.D. applicants perceived VI as a flexible and helpful procedure that provided them with satisfactory interpersonal treatment. Still, they did not favor the procedure’s perceived behavioral control and ability to communicate information to perform procedural justice. Moreover, neither their gender nor their prior experience of the virtual interview was a predictor of their perspectives’ discrepancies. The thematic analysis of the qualitative data revealed that despite having some cognitive, personal, and financial benefits, VI posed some technical, communicative, and personal challenges. This study provides implications for universities and applicants who will use VI for different purposes in higher education.

Resource Utilization and Emergency Medicine Advisors' Approach to Video Interview Preparation

Introduction The Standardized Video Interview (SVI) was a residency application component introduced by the Association of American Medical Colleges (AAMC) as a supplement to the existing process, which aimed to measure knowledge of professional behaviors and interpersonal skills. Given its novelty in both aim and execution, little advice or experience was available to inform preparation strategies. We sought to perform a cross-sectional analysis to explore advisors' practices in guiding students' preparation for the SVI. Methods An electronic questionnaire was developed and piloted for flow and usability, then distributed to all members of the Council of Residency Directors in Emergency Medicine (CORD EM), the professional society for emergency medicine educators, via listserv, comprised of 270 residency programs. Questions were both open- and closed-ended and therefore analyzed in a mixed-method fashion.  Results We received 56 responses from a listserv representing 270 residency programs. Respondents cited personal experience and consensus opinions from national organizations as the primary sources for their advice. The most common resources offered to students were space for completing the SVI (41%) or technical support for completing the SVI (47%). The time committed to student advising specifically for the SVI ranged from zero to 20 hours. Estimated associated costs of preparation ranged from zero up to $10,000 (time plus resources). Two individuals reported recommending commercial preparation resources to students.  Conclusion The SVI was a novel attempt to augment the resident application process. We found variability in resources and advice offered to students, including broad ranges of time dedicated, the monetary value of resources contributed, and the types of resources utilized. As the global COVID-19 pandemic has inspired a wave of innovation and process changes, we present this data for consideration as a snapshot of the variable responses to a single uniform process change.

Perceptions and lessons from web-based interviews for the reproductive endocrinology and infertility fellowship application cycle

OBJECTIVE

To evaluate the experience and perceptions of reproductive endocrinology and infertility fellowship applicants and program directors (PDs) regarding the current and future use of web-based interviews (WBIs).

DESIGN

Cross-sectional study.

SETTING

Nationwide cohort.

PATIENT(S)

Reproductive endocrinology and infertility fellowship applicants and PDs participating in the 2020 application cycle.

INTERVENTION(S)

Anonymous survey sent to applicants and PDs.

MAIN OUTCOME MEASURE(S)

Descriptive study evaluating the experience and satisfaction of applicants and PDs with WBIs.

RESULT(S)

Forty-six percent of applicants and eligible PDs responded to our survey. Most applicants and PDs responded that WBIs were adequate for conveying a sense of a program's strengths, faculty, diversity, clinical training, and research opportunities, but less than half responded that WBIs were adequate in providing a sense of the program's clinical site and facilities. After WBIs, both applicants (73%) and PDs (86%) were able to rank with confidence. The cost of WBIs was significantly lower for both applicants (median: $100) and programs (median: $100) than the costs previously reported for in-person interviews. The applicants interviewed at more programs than they would have if the interviews were on-site, and Zoom was the highest rated platform used. Most applicants and PDs responded that WBIs were an adequate substitute, and that they should continue after the coronavirus disease 2019 pandemic. Furthermore, most of the PDs were planning to continue to use WBIs in some capacity.

CONCLUSION(S)

Both applicants and PDs had favorable experiences with and perceptions of WBIs, and most endorse the continued use of this interview modality. The findings of this study can help guide and optimize future WBI practices.

Planning for Virtual Interviews: Residency Recruitment During a Pandemic

Recent directives from The Coalition for Physician Accountability, Association of Pediatric Program Directors, Council on Medical Student Education in Pediatrics, and Association of Medical School Pediatric Department Chairs recommend virtual recruitment for graduate medical education (GME) programs this year. Driven by concerns for safety, equity and financial pressures, virtual interviewing will require a thoughtful approach to achieve the desired goals of recruitment. Drawing on the fields of communication and human resources management, we examine the potential effects of web-based interviews on communication through the lens of several communication theories: media richness, media naturalness, and signaling. We then review the literature on virtual interviews in GME training programs. Finally, we will provide best practices compiled from the literature.

Preparing for the interviewing process during Coronavirus disease-19 pandemic: Virtual interviewing experiences of applicants and interviewers, a systematic review

Purpose

Coronavirus disease-19 (COVID-19) has forced upon all academic institutions to conduct virtual interviewing (VI) instead of face-to-face interviewing (FTFI) this interviewing cycle. The purpose of this systematic review was to understand the process of VI, its effectiveness as an alternative to FTFI, and the experiences of applicants and institutions with VI. We also share best practice strategies for applicants and institutions in VI preparation.

Method

PubMed/MEDLINE, Cochrane Library of Systematic Reviews, Web of Science Core Collection, Scopus and CINAHL databases were searched through May 2020. Articles in English evaluating the effectiveness of VI were included, without applying any date limits. Two reviewers selected articles and extracted data.

Results

Of the 934 articles screened, 22 articles underwent full-text article analysis to include 15 studies. There were 4 studies that reported the use of VI as a screening tool. 11 studies completely replaced FTFI with VI. Most applicants could appropriately convey themselves through VI. Most applicants and interviewing programs expressed reservations about VI’s use as an alternative to FTFI.

Conclusion

There is dearth of evidence supporting the efficacy of VI. There is an opportunity for potential research at multi-institutional level to gain better understanding of the efficacy of VI. The knowledge obtained from this systematic review has the potential of helping applicants and institutions in preparing for VI process. Additionally, authors propose supportive strategies to help prepare applicants and institutions for VI.

Videoconference Interviews: A Timely Primary Care Residency Selection Approach

BACKGROUND

Videoconference interviews (VCIs) are increasingly being used in the selection process of residency program candidates across a number of medical specialties, but nevertheless remain an underutilized approach, particularly in the field of primary care.

OBJECTIVE

This retrospective data review with cost analysis explores financial and acceptability outcomes of VCI implementation over a 9-year period.

METHODS

VCIs were incorporated into the recruitment process at a community-based academic family medicine residency program in 2011, whereby suitable candidates were selected for VCIs after Electronic Residency Application Service (ERAS) application review. Based on the outcome of VCI, candidates were invited via a structured interview tool for a subsequent in-person interviews to determine final rank decisions. Costs of the interview process were tracked, as well as perceptions of VCIs.

RESULTS

VCI implementation over 9 years demonstrated a median 48% reduction of in-person interviews-or 95 applicants eliminated out of a total 195 VCIs performed. This represents a mean annual direct cost savings estimated at $9,154, equating to a 55% reduction in allocated program costs, in addition to indirect cost savings to both applicants and the program.

CONCLUSIONS

Compared to exclusively in-person interviewing, the utilization of VCIs is potentially more cost-effective for residency programs and candidates, while creating a more personal experience for applicants early in the recruitment process. Limited data of acceptability among faculty and candidates is generally favorable but remains mixed.

The AAMC Standardized Video Interview: Lessons Learned From the Residency Selection Process

Calls to change the residency selection process have increased in recent years, with many focusing on the need for holistic review and alternatives to academic metrics. One aspect of applicant performance to consider in holistic review is proficiency in behavioral competencies. The Association of American Medical Colleges (AAMC) developed the AAMC Standardized Video Interview (SVI), an online, asynchronous video interview that assesses applicants' knowledge of professionalism and their interpersonal and communication skills. The AAMC worked with the emergency medicine community to pilot the SVI. Data from 4 years of research (Electronic Residency Application Service [ERAS] 2017-2020 cycles) show the SVI is a reliable, valid assessment of these behavioral competencies. It provides information not available in the ERAS application packet, and it does not disadvantage individuals or groups. Yet despite the SVI's psychometric properties, the AAMC elected not to renew or expand the pilot in residency selection.In this Invited Commentary, the authors share lessons learned from the AAMC SVI project about introducing a new tool for use in residency selection. They recommend that future projects endeavoring to find ways to support holistic review engage all stakeholders from the start; communicate the value of the new tool early and often; make direct comparisons with existing tools; give new tools time and space to succeed; strike a balance between early adopters and broad participation; help stakeholders understand the limitations of what a tool can do; and set clear expectations about both stakeholder input and pricing. They encourage the medical education community to learn from the SVI project and to consider future partnerships with the AAMC or other specialty organizations to develop new tools and approaches that prioritize the community's needs. Finding solutions to the challenges facing residency selection should be a priority for all stakeholders.

Postbaccalaureate and graduate applicants to dental school: An analysis of holistic review

Although they are valued for their perceived maturity, resiliency, and diverse insight into dentistry, postbaccalaureate and graduate (PBGR) applicants face significant challenges in the admissions process. This study looks at how PBGR applicants are evaluated during the selection process at a US dental school. An analysis of metrics associated with PBGR applicants was performed, focusing on the demographic makeup, academic performance, and total experience hours compared to traditional applicants. Our results suggest that PBGR applicants who are successful in their postbaccalaureate/graduate course of study are also more likely to be admitted if they have a history of strong undergraduate performance. Our results also suggest that PBGR applicants with high self-disclosed employment hours are strongly considered. Taken together, these results suggest that holistic review has helped PBGR applicants in the admissions process but that further adjustments need to be implemented.