What Regulatory Requirements and Existing Structures Must Change If Competency-Based, Time-Variable Training Is Introduced Into the Continuum of Medical Education in the United States?

The Inconspicuous Learner Handover: An Exploratory Study of U.S. Emergency Medicine Program Directors' Perceptions of Learner Handovers from Medical School to Residency

Phenomenon: Central to competency-based medical education is the need for a seamless developmental continuum of training and practice. Trainees currently experience significant discontinuity in the transition from undergraduate (UME) to graduate medical education (GME). The learner handover is intended to smooth this transition, but little is known about how well this is working from the GME perspective. In an attempt to gather preliminary evidence, this study explores U.S. program directors (PDs) perspective of the learner handover from UME to GME. Approach: Using exploratory qualitative methodology, we conducted semi-structured interviews with 12 Emergency Medicine PDs within the U.S. from October to November, 2020. We asked participants to describe their current perception of the learner handover from UME to GME. Then we performed thematic analysis using an inductive approach. Findings: We identified two main themes: The inconspicuous learner handover and barrier to creating a successful UME to GME learner handover. PDs described the current state of the learner handover as "nonexistent," yet acknowledged that information is transmitted from UME to GME. Participants also highlighted key challenges preventing a successful learner handover from UME to GME. These included: conflicting expectations, issues of trust and transparency, and a dearth of assessment data to actually hand over. Insights: PDs highlight the inconspicuous nature of learner handovers, suggesting that assessment information is not shared in the way it should be in the transition from UME to GME. Challenges with the learner handover demonstrate a lack of trust, transparency, and explicit communication between UME and GME. Our findings can inform how national organizations establish a unified approach to transmitting growth-oriented assessment data and formalize transparent learner handovers from UME to GME.

Competency-Based Time-Variable Anesthesiology Residency Training: Identification of Problems and Solutions

BACKGROUND

Global medical education is gradually moving toward more comprehensive implementations of a competency-based education (CBE) model. Elimination of standard time-based training and adoption of time-variable training (competency-based time-variable training [CB-TVT]) is one of the final stages of implementation of CBE. While CB-TVT has been implemented in some programs outside the United States, residency programs in the United States are still exploring this approach to training. The Accreditation Council for Graduate Medical Education (ACGME) and the American Board of Medical Specialties (ABMS) are encouraging member boards and residency review committees to consider innovative ways programs could implement CB-TVT. The goals of this study were to (1) identify potential problems with the implementation of CB-TVT in anesthesiology residency training, (2) rank the importance of the problems and the perceived difficulty of solving them, and (3) develop proposed solutions to the identified problems.

METHODS

Study participants were recruited from key stakeholder groups in anesthesiology education, including current or former program directors, department chairs, residents, fellows, American Board of Anesthesiology (ABA) board members, ACGME residency review committee members or ACGME leaders, designated institutional officials, residency program coordinators, clinical operations directors, and leaders of large anesthesiology community practice groups. This study was conducted in 2 phases. In phase 1, survey questionnaires were iteratively distributed to participants to identify problems with the implementation of CB-TVT. Participants were also asked to rank the perceived importance and difficulty of each problem and to identify relevant stakeholder groups that would be responsible for solving each problem. In phase 2, surveys focused on identifying potential solutions for problems identified in phase 1.

RESULTS

A total of 36 stakeholders identified 39 potential problems, grouped into 7 major categories, with the implementation of CB-TVT in anesthesiology residency training. Of the 39 problems, 19 (48.7%) were marked as important or very important on a 5-point scale and 12 of 19 (63.2%) of the important problems were marked as difficult or very difficult to solve on a 5-point scale. Stakeholders proposed 165 total solutions to the identified problems.

CONCLUSIONS

CB-TVT is a promising educational model for anesthesiology residency, which potentially results in learner flexibility, individualization of curricula, and utilization of competencies to determine learner advancement. Because of the potential problems with the implementation of CB-TVT, it is important for future pilot implementations of CB-TVT to document realized problems, efficacy of solutions, and effects on educational outcomes to justify the burden of implementing CB-TVT.

Enabling Factors for the Implementation of Competency-Based Curricula in Colleges and Schools of Pharmacy

OBJECTIVES

To review the implementation drivers of competency-based pharmacy education (CBPE) and provide recommendations for enablers.

FINDINGS

Competency-based education is an emerging model in the health professions, focusing on time-variable competency development and achievement compared with a time-bound, course-based, traditional model. CBPE is an outcomes-based organized framework of competencies enabling pharmacists to meet health care and societal needs. However, challenges need to be recognized and overcome for the successful implementation of CBPE. Competency drivers include defining the competencies and roles of stakeholders, developing transparent learning trajectories and aligned assessments, and establishing lifetime development programs for stakeholders. Organization drivers include developing support systems for stakeholders; facilitating connections between all educational experiences; and having transparent assessment plans, policies, and procedures that align with core CBPE precepts, including the sustainability of time-variability. Leadership drivers include establishing growth mindset and facilitating a culture of connection between workplace and educational environments, program advocacy by institutional leaders, accepting failures as part of the process, shifting the organizational culture away from learner differentiation toward competence, and maintaining sufficient administrative capability to support CBPE.

SUMMARY

The successful implementation of CBPE involves enabling the competency, organization, and leadership drivers that will lead to program success. More research is needed in the areas of creation, implementation, and assessment of CBPE to determine success in this model. We have reviewed and provided recommendations to enable the drivers of successful implementation of CBPE.

Rise of public e-learning opportunities in the context of COVID-19 pandemic-induced curtailment of face-to-face courses, exemplified by epidural catheterization on YouTube

BACKGROUND

In the context of the coronavirus pandemic, countless face-to-face events as well as medical trainings were cancelled or moved to online courses, which resulted in increased digitalization in many areas. In the context of medical education, videos provide tremendous benefit for visualizing skills before they are practised.

METHODS

Based on a previous investigation of video material addressing epidural catheterization available on the YouTube platform, we aimed to investigate new content produced in the context of the pandemic. Thus, a video search was conducted in May 2022.

RESULTS

We identified twelve new videos since the pandemic with a significant improvement in the new content in terms of procedural items (p = 0.03) compared to the prepandemic video content. Video content released in the course of the COVID-19 pandemic was more often created by private content creators and were significantly shorter in total runtime than those from university and medical societies (p = 0.04).

CONCLUSION

The profound changes in the learning and teaching of health care education in relation to the pandemic are largely unclear. We reveal improved procedural quality of predominantly privately uploaded content despite a shortened runtime compared to the prepandemic period. This might indicate that technical and financial hurdles to producing instructional videos by discipline experts have decreased. In addition to the teaching difficulties caused by the pandemic, this change is likely to be due to validated manuals on how to create such content. The awareness that medical education needs to be improved has grown, so platforms offer specialized sublevels for high-quality medical videos.

Impact of Students' Scheduling Choice on Clerkship Examination Score Performance in a Time-Varying Competency-Based Curriculum

PURPOSE

Standardized end-of-clerkship examinations typically occur on the last day of the clerkship. However, recent trends toward time-varying competency-based medical education have offered students more test scheduling flexibility, creating an opportunity to study the impact of student-selected examination timing.

METHOD

Starting with the graduating class of 2018, students took the required standardized end-of-core clerkship examinations at any available time they chose during their clinical years. Before this change, these examinations were administered to all students on the last day of the clerkship. Students' examination dates relative to clerkship completion were analyzed between 2017 and 2020 (inclusive of before and after flexible exam timing) to assess the impact that student-selected exam timing had on test performance on National Board of Medical Examiners shelf clinical science examinations for required core clerkships.

RESULTS

Data on 146 medical students in 2017 (fixed exam timing) and 466 medical students between 2018 and 2020 (flexible exam timing) were included. Among students offered flexible exam timing, between 2.7% (internal medicine) and 14.6% (psychiatry) took their exam before actually taking clerkship, while between 22.7% (psychiatry) and 40.0% (surgery) took their exam more than 90 days after the clerkship ended. Exam scores were statistically higher for those who took the exam at a time of their choosing compared with those who were required to take it at the end of individual rotations and when the exam scores were combined (fixed exam timing mean = 73.9, standard deviation [SD] = 7.8; flexible exam timing mean = 77.4, SD = 6.0, P < .001). The percent of students with passing scores was statistically higher in internal medicine, pediatrics, and psychiatry.

CONCLUSIONS

Self-selection of shelf exam timing appears to increase shelf exam scores. As more medical schools transition to competency-based medical education, providing scheduling flexibility appears not to negatively affect student achievement.

Competency-based medical education across the continuum: How well aligned are medical school EPAs to residency milestones?

INTRODUCTION

Competency-based medical education (CBME) provides a framework for describing learner progression throughout training. However, specific approaches to CBME implementation vary widely across educational settings. Alignment between various methods used across the continuum is critical to support transitions and assess learner performance. The purpose of this study was to investigate alignment between CBME frameworks used in undergraduate medical education (UME) and graduate medical education (GME) settings using the US context as a model.

METHOD

The authors analyzed content from the core entrustable professional activities for entering residency (Core EPAs; UME model) and residency milestones (GME model). From that analysis, they performed a series of cross-walk activities to investigate alignment between frameworks. After independent review, authors discussed findings until consensus was reached.

RESULTS

Some alignment was found for activities associated with history taking, physical examination, differential diagnosis, patient safety, and interprofessional care; however, there were far more examples of misalignment.

CONCLUSIONS

These findings highlight challenges creating alignment of assessment frameworks across the continuum of training. The importance of these findings includes implications for assessment and persistence of the educational gap across UME and GME. The authors provide four next steps to improve upon the continuum of education.

An innovative interprofessional dental clinical learning environment using entrustable professional activities

INTRODUCTION

Changes in society, new public demands for dental care and contemporary educational insights have influenced dental education worldwide and demand a renewed perspective. Following this perspective, an innovative interprofessional dental Master curriculum was developed at Radboud University Nijmegen in the Netherlands.

EDUCATIONAL PRINCIPLES

The curriculum is based on five contemporary educational principles and the core of the curriculum consists of a Student Run Dental Clinic that is fully run by students under professional supervision.

THE NEW CURRICULUM

In the Student Run Dental Clinic, Master dental students and Bachelor oral hygiene students are responsible for the care of approximately 750 patients. The students work within the same clinic for 3 years and patients receive oral health care from the same students over a long period. The clinic is a longitudinal cross-disciplinary clinic with different dental subdisciplines. Entrustable professional activities (also known as EPAs), to our knowledge not yet widely used in dental education, were introduced to facilitate learning and assessment. Fourteen EPAs have been developed to stimulate interprofessional education and learning. Of these, five EPAs are identical for the dental and oral hygiene curriculum, leading to extended interprofessional education and learning in the Student Run Dental Clinic.

DISCUSSION

Preliminary results show that EPAs are generally well received by supervisors and students.

CONCLUSION

To monitor and investigate the exact effect of the interventions and underlying mechanisms, a research programme on interprofessional learning, practice-based learning and EPAs and entrustment in dental education was recently set up.

Telehealth and Medical Student Education in the Time of COVID-19-and Beyond

The COVID-19 pandemic continues to limit medical students' full reintegration into clinical learning environments, thus exacerbating an ongoing challenge in identifying a robust number of clinical educational activities at excellent clinical sites for all students. Because medical students across the United States were removed from direct patient care activities in mid-March 2020 due to COVID-19, medical centers have prioritized and implemented changes to the process of patient care. As some barriers are being lifted in the face of a highly contagious and deadly infection, the use of telehealth (delivery of health services remotely via telephone, video, and secure messaging), although not new, is rapidly expanding into all aspects of patient care. Health care providers have been encouraged to conduct many interactions at a physical distance. Telehealth largely replaced face-to-face visits for nonemergency care in an attempt to slow viral transmission while enabling physicians to continue to deliver patient education, manage acute and chronic illness, and nurture caring doctor-patient relationships. Health care providers, many of whom were initially reluctant to embrace telehealth technology and logistics, are becoming nimbler and more aware of the many positive aspects of telehealth. The authors suggest that integrating medical students into telehealth activities would help maintain and improve patients' health, extend the capabilities of health care teams and systems during and after the pandemic, and increase medical students' opportunities for experiential learning and professional identity formation. The authors expand on these 3 goals, suggest several concrete student telehealth activities, propose a curricular strategy, and outline opportunities to overcome key barriers to full alignment of telehealth and undergraduate medical education.

The Implementation of Entrustable Professional Activities in Postgraduate Medical Education in the Netherlands: Rationale, Process, and Current Status

Postgraduate medical education in the Netherlands has adopted competency-based education since the turn of the century. In 2006, the CanMEDS competency framework was introduced. A 2013 government plan to reduce the length and budgets of training programs led the Dutch Association of Medical Specialists (DAMS) to respond with a proposal to create more flexibility and individualization rather than a blunt cut in the length across all training programs. DAMS launched a government-funded, nation-wide, 4-year project (2014-2018) to blueprint the reform of postgraduate medical education in this direction. To achieve competency-based individualization, the fixed duration of postgraduate programs was abandoned, and entrustable professional activities (EPAs) were introduced in all specialty programs. Implementation of this new generation of programs took place in 2017-2019 in all disciplines. The project focused on EPA-based individualization of all programs, while addressing issues of the continuity of patient care in time-variable programs and the legal and regulatory consequences of individualization. About 30 specialty programs were revised at national, regional, local, and individual levels to incorporate EPAs; portfolio systems were adapted, clinical competency committees were installed for all programs, and procedures for summative entrustment decision making were elaborated. This paper reports on the rationale and the process that led to a more time-variable postgraduate education landscape, and, on average, a shortening of training length by 3 months.

Competency-based time-variable training internationally: Ensuring practical next steps in the wake of the COVID-19 pandemic

Competency-based medical education has been advocated as the future of medical education for nearly a half-century. Inherent to this is the promise that advancement and transitions in training would be defined by readiness to practice rather than by time. Of the logistical problems facing competency-based, time-variable (CBTV) training, enacting time variability may be the largest hurdle to clear. Although it is true that an 'all or nothing' approach to CBTV training would require massive overhauls of both medical education and health care systems, the authors propose that training institutions should gradually evolve within their current environments to incrementally move toward the best version of CBTV training for learners, supervisors, and patients. In support of this evolution, the authors seek to demonstrate the feasibility of advancing toward the goal of realistic CBTV training by detailing examples of successful CBTV training and describing key features of initial steps toward CBTV training implementation.

Early procedural training increases anesthesiology residents' clinical production: a comparative pre-post study of the payoff in clinical training

BACKGROUND

Competency-based education has been shown to enhance clinical skills, improve patient care, and reduce number of complications resulting in a better return on investments. Residents constitute an important workforce at many hospitals. Yet, the effect of training on residents' contribution to production in patient care is scarcely studied. This study evaluated the effects of early competency-based procedural training on residents' contribution to patient care in central venous catheterization and spinal and epidural anesthesia.

METHODS

The design was a non-randomized cohort study of first-year anesthesiology residents. The intervention group received additional early focused skills training while three control groups received traditional competency-based education. The residents' contributions to patient care were compared between the intervention group (n = 20), a historical control group (n = 19), and between a contemporary control group (n = 7) and a historical control group (n = 7) from different departments. The residents' vs specialists' procedural production share was compared between years within each study group. We calculated specialist time saved compared to the time spent providing additional skills training in the intervention group.

RESULTS

We found statistically significant increases in residents' vs specialists' share of total production after the intervention for epidural anesthesia: 2015: 0.51 (0.23, 0.70) to 2017: 0.94 (0.78, 1.05), p = 0.011 and central venous catheterization: 2015: 0.30 (0.23, 0.36) to 2016: 0.46 (0.35, 0.55), p = .008; and to 2017: 0.64 (0.50, 0.79), p = 0.008. Comparison between residents and specialists on production of the three procedures before and after the intervention showed a surplus of 21 h of freed specialist time per year.

CONCLUSIONS

Early procedural training results in more productive residents and freed specialist time for additional supervision, other clinical tasks or research. This provides empirical support for a positive correlation between early focused training and increased independent production among residents.

Culture transformation by stealth: Leveraging incremental change to revamp the curriculum

INTRODUCTION

Reshaping an existing education program from traditional structures and processes into competency-based medical education (CBME) is formidable. Emory University School of Medicine applied organizational change theory to introduce CBME into an established MD program by employing 'sustainable innovation', which introduces change incrementally.

METHODS

Implementation of CBME began with the identification of core institutional values. Using the sustainable innovation approach, the first change was adoption of new program outcomes and student performance expectations. There were few changes that occurred to the structure of required courses and clerkships. This intentional approach allowed stakeholders to familiarize themselves with CBME prior to full implementation.

RESULTS

Existing assessment processes remained intact while the faculty was trained for innovative assessment uses. For example, the assessment process was augmented by tagging all exam items using a controlled taxonomy and students' performance was linked longitudinally. Using sustainable innovation allowed time for data collection and evaluation throughout the implementation of CBME.

DISCUSSION

Representing student achievement according to competencies, rather than as letter grades, is perceived as revolutionary by many stakeholders. Employing sustainable, incremental innovation facilitated stakeholder buy-in to the underlying principles of CBME. Fostering a new organizational culture will be the 'rate-limiting factor' for full implementation of CBME.

Moving Toward Summative Competency Assessment to Individualize the Postclerkship Phase

In the move toward competency-based medical education, leaders have called for standardization of learning outcomes and individualization of the learning process. Significant progress has been made in establishing defined expectations for the knowledge, skills, attitudes, and behaviors required for successful transition to residency training, but individualization of educational processes to assist learners in reaching these competencies has been predominantly conceptual to date. The traditional time-based structure of medical education has posed a challenge to individualization within the curriculum and has led to more attention on innovations that facilitate transition from medical school to residency. However, a shift of focus to the clerkship-to-postclerkship transition point in the undergraduate curriculum provides an opportunity to determine how longitudinal competency-based assessments can be used to facilitate intentional and individualized structuring of the long-debated fourth year.This Perspective demonstrates how 2 institutions-the University of Virginia School of Medicine and the University of Michigan Medical School-are using competency assessments and applying standardized outcomes in decisions about individualization of the postclerkship learning process. One institution assesses Core Entrustable Professional Activities for Entering Residency, whereas the other has incorporated Accreditation Council for Graduate Medical Education core competencies and student career interests to determine degrees of flexibility in the postclerkship phase. Individualization in addition to continued assessment of performance presents an opportunity for intentional use of curriculum time to develop each student to be competently prepared for the transition to residency.

Envisioning a True Continuum of Competency-Based Medical Education, Training, and Practice

The existing structure of physician education has developed in siloed stages, with consecutive degrees and certifications and progressively longer training programs. As further fragmentation of health care and training systems will not improve the quality of care and education, the authors argue that a new vision of education, training, and practice as a continuum is needed.They advocate for a model of competency-based medical education that merges with competency-based medical practice. In this system, education and training will result in individual, dynamic portfolios of valid entrustable professional activities (EPAs) for which physicians are certified. Physicians can maintain and renew that entrustment as long as the EPAs remain within their scope of practice. Entrustment occurs initially during training but is then granted for new activities as physicians' careers evolve.This model accounts for the need to keep pace with changes in population health needs and expectations of competence over time. It de-emphasizes the divides between the stages of training and views the continuum from undergraduate medical education until retirement as a whole. Key obligations of self-regulating medical professionals include both the reception and the provision of supervision from and for others, respectively. Learning must be embedded in practice to address expectations regarding new knowledge and skills as they evolve with scientific and technological advances.Entrusting physicians to deliver effective and safe care, based on their performance of the requisite EPAs without supervision, should ensure that they provide high-value, quality care to patients.

What to Do About the Transition to Residency? Exploring Problems and Solutions From Three Perspectives

Transitions are both a blessing and a curse for learning and professional development. While transitions can afford valuable opportunities for growth, they can also burden learners in ways that stymie performance and development. In this Invited Commentary, the author focuses on the transition from medical school to residency-a transition that many believe has tipped too far toward burden. The commentary explores three ways of problematizing the transition to residency. The first is as a transaction problem involving a complex exchange of information among programs and people. The second is as a transfer problem in which learners must apply knowledge in new contexts. The third is a trajectory problem concerning each learner's progression through medical education. The author describes current efforts aligned with each framing of the problem and discusses potential gaps in these efforts that might be addressed through an overarching framing of transitions in medical education as transformative processes. This framing may help the medical educational community think more holistically about the problems and solutions with transitions.

Competency-Based, Time-Variable Education in the Health Professions: Crossroads

Health care systems around the world are transforming to align with the needs of 21st-century patients and populations. Transformation must also occur in the educational systems that prepare the health professionals who deliver care, advance discovery, and educate the next generation of physicians in these evolving systems. Competency-based, time-variable education, a comprehensive educational strategy guided by the roles and responsibilities that health professionals must assume to meet the needs of contemporary patients and communities, has the potential to catalyze optimization of educational and health care delivery systems. By designing educational and assessment programs that require learners to meet specific competencies before transitioning between the stages of formal education and into practice, this framework assures the public that every physician is capable of providing high-quality care. By engaging learners as partners in assessment, competency-based, time-variable education prepares graduates for careers as lifelong learners. While the medical education community has embraced the notion of competencies as a guiding framework for educational institutions, the structure and conduct of formal educational programs remain more aligned with a time-based, competency-variable paradigm.The authors outline the rationale behind this recommended shift to a competency-based, time-variable education system. They then introduce the other articles included in this supplement to Academic Medicine, which summarize the history of, theories behind, examples demonstrating, and challenges associated with competency-based, time-variable education in the health professions.