Developing entrustable professional activities for doctoral graduates in health professions education: obtaining a national consensus in Iran

Development of entrustable professional activities for emergency medicine medical education fellowships: A modified Delphi study

Background

It is essential that medical education (MedEd) fellows achieve desired outcomes prior to graduation. Despite the increase in postgraduate MedEd fellowships in emergency medicine (EM), there is no consistently applied competency framework. We sought to develop entrustable professional activities (EPAs) for EM MedEd fellows.

Methods

From 2021 to 2022, we used a modified Delphi method to achieve consensus for EPAs. EM education experts generated an initial list of 173 EPAs after literature review. In each Delphi round, panelists were asked to make a binary choice of whether to include the EPA. We determined an inclusion threshold of 70% agreement a priori. After the first round, given the large number of EPAs meeting inclusion threshold, panelists were instructed to vote whether each EPA should be included in the "20 most important" EPAs for a MedEd fellowship. Modifications were made between rounds based on expert feedback. We calculated descriptive statistics.

Results

Seventeen experts completed four Delphi rounds each with 100% response. After Round 1, 87 EPAs were eliminated and two were combined. Following Round 2, 46 EPAs were eliminated, seven were combined, and three were included in the final list. After the third round, one EPA was eliminated and 13 were included. After the fourth round, 11 EPAs were eliminated. The final list consisted of 16 EPAs in domains of career development, education theory and methods, research and scholarship, and educational program administration.

Conclusions

We developed a list of 16 EPAs for EM MedEd fellowships, the first step in implementing competency-based MedEd.

Developing and validating a national set of standards for undergraduate medical education using the WFME framework: the experience of an accreditation system in Iran

BACKGROUND

Defining standards is the first step toward quality assurance and improvement of educational programs. This study aimed at developing and validating a set of national standards for the Undergraduate Medical Education (UME) program through an accreditation system in Iran using the World Federation for Medical Education (WFME) framework.

METHODS

The first draft of standards was prepared through consultative workshops with the participation of different UME program stakeholders. Subsequently, standards were sent to medical schools and UME directors were asked to complete a web-based survey. The content validity index at the item level (I-CVI) was computed using criteria including clarity, relevance, optimization and evaluability for each standard. Afterward, a full-day consultative workshop was held and a wide range of UME stakeholders across the country (n = 150) discussed the survey results and made corrections to standards.

RESULTS

Analysis of survey results showed that relevance criteria had the best CVI as only 15 (13%) standards demonstrated CVI < 0.78. More than two-thirds (71%) and a half (55%) of standards showed CVI < 0.78 for optimization and evaluability criteria. The final set of UME national standards was structured in 9 areas, 24 sub-areas, 82 basic and 40 quality development standards, and 84 annotations.

CONCLUSIONS

We developed and validated national standards as a framework to ensure the quality of UME training with input from UME stakeholders. We used WFME standards as a benchmark while addressing local requirements. The standards and participatory approach to developing standards may guide relevant institutions.

A continuing professional development imperative? Examining trends and characteristics of health professions education doctoral programs

BACKGROUND

Despite the long-standing faculty development initiatives for improving teaching skills in the health professions, there is still a growing need for educators who are formally trained in educational theory and practice as health professions schools experience dramatic demand and growth. Graduate programs in health professions education (HPE) provide an avenue for health professions' faculty continuing professional development to enhance their knowledge and skills for teaching and curriculum leadership roles. There has been a proliferation of certificate, master's, and doctoral programs in HPE over the last two decades to respond to the growing need for well-prepared faculty educators and program leadership. The purpose of this study was to identify and describe current HPE doctoral programs in United States (U.S.) and Canada.

METHODS

The study first examined doctoral programs in HPE identified in earlier studies. Next, we searched the literature and the web to identify new doctoral programs in the U.S. and Canada that had been established between 2014, when the prior study was conducted, and 2022. We then collated and described the characteristics of these programs, highlighting their similarities and differences.

RESULTS

We identified a total of 20 doctoral programs, 17 in the U.S. and 3 in Canada. Of these, 12 programs in the U.S. and 1 program in Canada were established in the last 8 years. There are many similarities and some notable differences across programs with respect to degree title, admission requirements, duration, delivery format, curriculum, and graduation requirements. Most programs are delivered in a hybrid format and the average time for completion is 4 years.

CONCLUSIONS

The workforce shortage facing health professional schools presents an opportunity, or perhaps imperative, for continuing professional development in HPE through certificate, master's, or doctoral programs. With the current exponential growth of new doctoral programs, there is a need to standardize the title, degree requirements, and further develop core competencies that guide the knowledge and skills HPE graduates are expected to have upon graduation.

Expectations for PhDs in health professions education: an international EPA-framed, modified Delphi study

Health professions education (HPE) has matured into field of study that employs and produces specialized educational scholars. Many academic institutions employ such scholars to support development and innovation in education. Simultaneously, the possibilities to obtain a PhD degree in HPE are expanding. Clarity in the expectations that such a degree brings along can be useful for scholars, employers and institutions. Anticipating that the views of what a PhD in HPE is or should be can vary between institutions, cultures and countries, we conducted an international Delphi study to identify EPAs for HPE PhDs. We used a framework of 24 EPAs resulted from a national consensus study in Iran as input to seek more generalized validity and a wider consensus of reasonably suitable activities. A three-round modified Delphi study was conducted with participation of 15 international experts. Final framework consisted of 17 relevant EPAs with a justification, specifications and limitations, and risks in case of failure per EPA (all had overall CVI > 0.8 for adequacy of description). Eleven EPAs were considered by the majority to be core to PhD training, 16 to be desirable for HPE PhDs as a capability to carry out without supervision, but the majority would trust current HPE PhDs to carry out only 5 of the 17 without supervision. The EPAs identified in this study arguably reflect the expectations of educators with a PhD degree in HPE. The framework has the potential to advance HPE training across countries and to inform personal development and employment decisions.