Beyond the CLAIM: A comprehensive needs assessment strategy for creating an Advanced Medical Education Research Training Program (ARMED-MedEd)

Incorporating implementation science principles into curricular design

Implementation science (IS) is an approach focused on increasing the application of evidence-based health interventions into practice, through purposive and thoughtful planning to maximize uptake, scalability, and sustainability. Many of these principles can be readily applied to medical education, to help augment traditional approaches to curriculum design. In this paper, we summarize key components of IS with an emphasis on application to the medical educator.

Precision medicine within health professions education: Defining a research agenda for emergency medicine using a foresight and strategy technique (FaST) review

Background

Precision medicine, sometimes referred to as personalized medicine, is rapidly changing the possibilities for how people will engage health care in the near future. As technology to support precision medicine exponentially develops, there is an urgent need to proactively improve our understanding of precision medicine and pose important research questions (RQs) related to its inclusion in the education and training of future emergency physicians.

Methods

A seven-step process was employed to develop a research agenda exploring the intersection of precision and emergency medicine education/training. A literature search of articles about precision medicine was conducted first, which informed the creation of future four scenarios in which trainees and practicing physicians regularly discuss and incorporate precision medicine tools into their discussions and work. Based on these futurist narratives, potential education RQs were generated by an expert panel. A total of 59 initial questions were subsequently categorized and refined to a priority list through a nominal group voting method. The top/priority questions were presented at the 2023 SAEM Consensus Conference on Precision Medicine, Austin, Texas, for further input.

Results

Eight high-value education RQs were developed, reflecting a holistic view of the challenges and opportunities for precision medicine education in the knowledge, skills, and attitudes relevant to emergency medicine. These questions contend with topics such as most effective pedagogical methods; intended resulting outcomes and behaviors; the generational differences between practicing emergency physicians, educators, and future trainees; and the desires and expectations of patients.

Conclusions

Emergency medicine and emergency physicians must be prepared to understand precision medicine and incorporate this information into their "toolbox" of thinking, problem solving, and communication with patients and colleagues. This research agenda on how best to educate future emergency physicians in the use of personalized data to provide optimal health care is the focus of this article.

Designing a Multidisciplinary Cardio-obstetrics Curriculum for General Cardiology and Obstetrics Residents: A National Survey of Educational Needs

Background

The increasing and potentially preventable cardiac events in pregnant patients have led to calls to enhance multidisciplinary cardio-obstetrics education. To design a multidisciplinary cardio-obstetrics curriculum for general cardiology and obstetrics and gynecology (OBGYN) residents, we need to define educational needs from the perspectives of both cardiology and OBGYN residents. Our study characterizes the educational needs of Canadian cardiology and OBGYN residents.

Methods

Canadian cardiology and OBGYN residents were surveyed on clinical exposures, perceived needs for topics, unperceived needs for topics (multiple-choice questions) and preferences for educational formats. High priorities were defined as ≥ 50% of responses indicating a perceived need or ≥ 50% indicating an unperceived need.

Results

A total of 154 residents participated (cardiology n = 44, OBGYN n = 110). Residents reported insufficient clinical exposure to nearly all cardiac disorders, with 33% of exposures occurring in multidisciplinary contexts. All topics aside from gestational hypertension were rated as high priority on perceived needs by both specialties. High-priority unperceived needs were congenital heart disease (both specialties), pre-existing acquired heart disease (both specialties), medication safety (OBGYN), peripartum management (OBGYN), and pregnancy-related heart disease (OBGYN). Cardiology and OBGYN residents shared preferences for in-person simulation, virtual simulation, and online modules.

Conclusions

Residents in both specialties reported low clinical exposure to most cardiac disorders during pregnancy, identified high-priority perceived needs in multiple topics, and shared 2 high-priority unperceived needs. OBGYN residents identified 3 additional high-priority unperceived needs. These data can inform design of multidisciplinary cardio-obstetrics curricula for general cardiology and OBGYN residents.

The next generation of researchers: One-year outcome data from the SAEM Advanced Research Methodology Evaluation and Design in Medical Education (ARMED MedEd) program

Introduction

As the field of medical education evolves, there is a need to increase the quality of education scholarship and develop a cadre of research scholars; however, clinician educators (CEs) considering this career transition have limited formal training in education research methodology to heed this call. Therefore, a program that provides more advanced training in education scholarship for CEs without the financial and resource barriers of fellowships and masters programs is needed.

Methods

The SAEM Advanced Research Methodology Evaluation and Design in Medical Education (ARMED MedEd) program is a longitudinal program for the beyond-beginner CE, seeking advanced training in education research. The program was created using a comprehensive needs assessment and included longitudinal training; small-group projects; dedicated project mentors; and integrated diversity, equity, and inclusion initiatives. Program participants applied for a grant upon program completion.

Results

Twenty-one participants completed the course with 100% completing the baseline survey and 67% (14/21) completing the end-of-program survey. Participants reported improved perception of knowledge across all of the topics with a medium to large effect size, ranging from 0.40 to 0.62. When asked about impact on their network of potential collaborators, participants reported a median of 7 (interquartile range [IQR] 5-8) out of 9. When asked about the impact on their community of practice, participants reported a median of 7 (IQR 5-7) out of 9. When asked about the impact on their professional identity, participants reported a median of 7 (IQR 4-9) out of 9. Participants also reported an increase in both the quantity (mean of 2 ± 1 new mentors) and the quality (median score 7 [IQR 5-8] out of 9) of new research mentorship as a result of the program. Open-ended feedback was generally positive, with 100% reporting they would advise others to take this program.

Conclusions

The SAEM ARMED MedEd program represents a proof of concept for an advanced education research program seeking to fill the research training gap for the beyond-beginner Clinician educators.

Creation of a novel course for the advanced emergency medicine ultrasound focused practice designation examination

Introduction

The American Board of Emergency Medicine recently established a new certification pathway in advanced emergency medicine ultrasound (AEMUS). Eligible applicants come from a wide range of experience but must pass the same examination to become certified. This study sought to evaluate a novel review course targeting a wide range of learners for a new examination.

Methods

This was a cross-sectional study evaluating the outcomes of the American College of Emergency Physicians (ACEP) AEMUS review course. The program evaluation survey was designed to collect outcomes across multiple Kirkpatrick levels, including overall satisfaction, topic-specific satisfaction, topic-specific coverage, topic-specific confidence before and after the course, topic-specific perceived knowledge before and after the course, and changes in practice.

Results

Seventy-four of 79 participants (93.7%) completed the survey. Mean course satisfaction was 4.59/5.00 (95% CI 4.47-4.72). Confidence to pass examination components increased for the following topics: administration, advanced left ventricle (LV), education, head and neck, hepatobiliary, male genitourinary, musculoskeletal, nonobstetric gynecology, pediatrics, physics, procedures, research, right ventricle, and venous/arterial. Perceived knowledge increased for the following topics: administration, advanced LV, education, head and neck, male genitourinary, musculoskeletal, pediatrics, physics, procedures, renal/bladder, research, right ventricle, and venous/arterial. Fifty-three of 74 participants (71.6%) stated they would change their practice based on the course. Examples of changes in practice include increased use of ultrasound for advanced abdominal, musculoskeletal, pediatric, and procedural applications. Future work will determine the impact on longer-term outcomes and focused practice designation (FPD) examination pass rates.

Conclusion

The ACEP AEMUS FPD review course demonstrated high levels of satisfaction, increased participant confidence, increased perceived knowledge, and several self-reported changes in participants' ultrasound practice.