Emergency medicine clerkship curriculum: an update and revision

IFEM model curriculum: emergency medicine learning outcomes for undergraduate medical education

BACKGROUND

The International Federation for Emergency Medicine (IFEM) published its model curriculum for medical student education in emergency medicine in 2009. Because of the evolving principles of emergency medicine and medical education, driven by societal, professional, and educational developments, there was a need for an update on IFEM recommendations. The main objective of the update process was creating Intended Learning Outcomes (ILOs) and providing tier-based recommendations.

METHOD

A consensus methodology combining nominal group and modified Delphi methods was used. The nominal group had 15 members representing eight countries in six regions. The process began with a review of the 2009 curriculum by IFEM Core Curriculum and Education Committee (CCEC) members, followed by a three-phase update process involving survey creation [The final survey document included 55 items in 4 sections, namely, participant & context information (16 items), intended learning outcomes (6 items), principles unique to emergency medicine (20 items), and content unique to emergency medicine (13 items)], participant selection from IFEM member countries and survey implementation, and data analysis to create the recommendations.

RESULTS

Out of 112 invitees (CCEC members and IFEM member country nominees), 57 (50.9%) participants from 27 countries participated. Eighteen (31.6%) participants were from LMICs, while 39 (68.4%) were from HICs. Forty-four (77.2%) participants have been involved with medical students' emergency medicine training for more than five years in their careers, and 56 (98.2%) have been involved with medical students' training in the last five years. Thirty-five (61.4%) participants have completed a form of training in medical education. The exercise resulted in the formulation of tiered ILO recommendations. Tier 1 ILOs are recommended for all medical schools, Tier 2 ILOs are recommended for medical schools based on perceived local healthcare system needs and/or adequate resources, and Tier 3 ILOs should be considered for medical schools based on perceived local healthcare system needs and/or adequate resources.

CONCLUSION

The updated IFEM ILO recommendations are designed to be applicable across diverse educational and healthcare settings. These recommendations aim to provide a clear framework for medical schools to prepare graduates with essential emergency care capabilities immediately after completing medical school. The successful distribution and implementation of these recommendations hinge on support from faculty and administrators, ensuring that future healthcare professionals are well-prepared for emergency medical care.

Taking More Society for Academic Emergency Medicine Practice Tests Does Not Lead to Improved National EM-M4 Exam Scores

INTRODUCTION

Emergency medicine (EM) is a required clerkship for third-year medical students, and an elective EM acting internship (AI) is available to fourth-year students at our institution. The Society for Academic Emergency Medicine's (SAEM) National Emergency Medicine M4 Examination (EM-M4) is administered to students at the end of the EM AI experience. To prepare for the exam, students gain access to 23 practice tests available from SAEM. In this study we investigate the correlation between the number of practice tests taken and EM-M4 performance.

METHODS

We collected data for EM-M4 and the US Medical Licensing Exam (USMLE) Step 2 Clinical Knowledge (CK) from students completing a MS4 EM clerkship in consecutive medical school classes from 2014-2017 at a private medical school. In addition, we collected data during the clerkship on the number of practice exams taken and whether a comprehensive practice exam was taken. We analyzed the study population three ways to determine whether the number of practice tests impacted final exam results: a binary distribution (1-11 or 12-23 tests taken); quaternary distribution (1-6, 7-12, 13-18, or 19-23 tests taken); and individual test variability (1,2,3,…22,23 tests taken). Complete data for 147 students was used for data analysis.

RESULTS

The EM-M4 showed moderate (r = 0.49) correlations with USMLE Step 2 CK. There was no significant difference in EM-M4 performance in the binary analysis (P ≤ 0.09), the quaternary analysis (P ≤ 0.09), or the continuous variable analysis (P ≤ 0.52). Inclusion of a comprehensive practice test also did not correlate with EM-M4 performance (P ≤ 0.78).

CONCLUSION

Degree of utilization of SAEM practice tests did not seem to correlate with performance on the EM-M4 examination at our institution. This could be due to many factors including that the question bank is composed of items that had poor item discrimination, possible inadequate coverage of EM curriculum, and/or use of alternative study methods. While further investigation is needed, if our conclusions prove generalizable, then using the SAEM practice tests is an extraneous cognitive load from a modality without proven benefit.

Filling the Core EPA 10 assessment void: A framework for individual assessment of Core Entrustable professional activity 10 competencies in medical students

Objectives

The goal of this study was to develop and evaluate a novel curriculum and assessment tool for Core Entrustable Professional Activity (EPA) 10 competencies and entrustment scoring in a cohort of medical students in their emergency medicine (EM) clerkship using a framework of individualized, ad hoc, formative assessment. Core EPA 10 is an observable workplace-based activity for graduating medical students to recognize a patient requiring urgent or emergent care and initiate evaluation and management.

Methods

This is a prospective, pretest-posttest study of medical students during their EM clerkship. Using the Thomas and Kern framework, we created a curriculum of simulation cases about chest pain/cardiac arrest and respiratory distress, which included novel assessment checklists, and instructional videos about recognizing and managing emergencies. Students were individually pretested on EPA 10 competencies using the simulation cases. Two raters scored students using standardized checklists. Students then watched instructional videos, underwent a posttest with the simulation cases, and were scored again by the two raters using the checklists. Differences between pretest and posttest scores were analyzed using paired t-tests and Wilcoxon signed-rank tests.

Results

Seventy-three out of 85 (86%) students completed the curriculum. Mean scores from pretest to final posttest in the chest pain/cardiac arrest and respiratory distress cases significantly improved from 14.8/19 (SD 1.91), to 17.1/19 (SD = 1.00), t(68) = 10.56, p < 0.001, and 8.5/13 (SD 1.79), to 11.1/13(SD 0.89), t(67) = 11.15, p < 0.001, respectively. The kappa coefficients were 0.909 (n = 2698, p < 0.001) and 0.931 (n = 1872, p < 0.001). Median modified Chen entrustment scores improved from 1b (i.e., "Watch me do this") to 2b (i.e., "I'll watch you") for the chest pain/cardiac arrest case (p < 0.001) and 1b/2a (i.e., "Watch me do this"/ "Let's do this together") to 3a (i.e. "You go ahead, and I'll double-check all of your findings") for the respiratory distress case (p < 0.001).

Conclusion

A new directed curriculum of standardized simulation cases and asynchronous instructional videos improved medical student performance in EPA 10 competencies and entrustment scores. This study provides a curricular framework to support formative individualized assessments for EPA 10.

Medical students' learning experience and participation in communities of practice at municipal emergency care units in the primary health care system: a qualitative study

BACKGROUND

Medical education has been criticised for not adapting to changes in society, health care and technology. Internationally, it is necessary to strengthen primary health care services to accommodate the growing number of patients. In Norway, emergency care patients are increasingly treated in municipal emergency care units in the primary health care system. This study explores medical students' learning experience and how they participated in communities of practice at two municipal emergency care units in the primary health care system.

METHODS

In this qualitative study, we collected data from March to May 2019 using semi-structured individual interviews and systematic observations of six ninth-semester medical students undergoing two-week clerkships at municipal emergency care units. The interview transcripts were thematically analysed with a social constructivist approach. A total of 102 systematic observations were used to triangulate the findings from the thematic analysis.

RESULTS

Three themes illuminated what the medical students learned and how they participated in communities of practice: (i) They took responsibility for emergency care patients while participating in the physicians' community of practice and thus received intensive training in the role of a physician. (ii) They learned the physician's role in interprofessional collaboration. Collaborating with nursing students and nurses led to training in clinical procedures and insight into the nurses' role, work tasks, and community of practice. (iii) They gained in-depth knowledge through shared reflections when time was allocated for that purpose. Ethical and medical topics were elucidated from an interprofessional perspective when nursing students, nurses, and physicians participated.

CONCLUSIONS

Our findings suggest that this was a form of clerkship in which medical students learned the physician's role by taking responsibility for emergency care patients and participating in multiple work tasks and clinical procedures associated with physicians' and nurses' communities of practice. Participating in an interprofessional community of practice for professional reflections contributed to in-depth knowledge of ethical and medical topics from the medical and nursing perspectives.

Consensus Development of a Core Content for a Standardized Medical Toxicology Curriculum for Medical Students

Background

Currently, no standardized core content in medical toxicology exists for medical students. The goals of this study were to (1) assess the current state and needs of medical toxicology clerkships and (2) develop a consensus-derived list of core topics that should be covered during a medical toxicology clerkship.

Methods

We assembled a task force established by the American College of Medical Toxicology (ACMT) of nine experts in medical toxicology or emergency medicine. We developed a needs assessment survey that was sent to all medical student clerkship directors in medical toxicology. Based on their responses, we used a modified Delphi process to develop a consensus of core topics that should be covered during a medical student clerkship.

Results

Nineteen out of 42 (45%) clerkship directors completed the survey; 18 met inclusion criteria. The majority of clerkships were 4 weeks in duration with an average of 15 students/year. The three most common teaching methods used were bedside teaching (n = 17/18), classroom teaching (n = 17/18), and journal club (n = 14/18). All the clerkship directors (n = 18/18) reported they would use a standardized curriculum as well as educational content developed by ACMT. There was overwhelming consensus on the core topics which included, but were not limited to, pharmacology/toxicology; drugs; drugs of abuse; natural products; pharmacological basis of antidote use; toxicologic syndromes; vital sign abnormalities; initial management; supportive and other care; withdrawal syndrome management; industrial, household, and environmental toxins; differential diagnosis by clinical findings; and ABCs-resuscitation.

Conclusion

The ACMT task force developed a medical toxicology clerkship core content. The task force also identified a need for shared resources among clerkships.

Self-efficacy beliefs and expectations during an Emergency Medicine Clerkship

Background

Undergraduate emergency medicine (EM) training is important because all medical graduates are expected to have basic emergency knowledge and skills regardless of their future speciality. EM clerkship should provide opportunities to improve not only knowledge and skills but also the self-efficacy of learners. This study aims to evaluate the expectations, opinions, and self-efficacy beliefs of medical students during a 4-week mandatory EM clerkship.

Methods

This study used a prospective longitudinal design with quantitative and qualitative survey methods. It includes final year medical students of the 2015–2016 academic year. Voluntary de-identified pre- and post-clerkship surveys included 25 statements. The post-clerkship survey included two open-ended questions asking participants to identify the best and worst three aspects of EM clerkship. Responses were analysed to determine themes or commonalities in participant comments indicative of the EM clerkship learning experiences and environment.

Results

Sixty-seven out of seventy-nine (85%) students responded to both pre- and post-clerkship surveys. Medical students’ expectations of EM clerkships’ effect on knowledge and skill acquisition were high, and a 4-week mandatory EM clerkship was able to meet their expectations. Medical students had very high expectations of EM clerkships’ educational environment. In most aspects, their experiences significantly exceeded their expectations (p value < 0.001). The only exception was the duration of clerkship, which was deemed insufficient both at the beginning and at the end (p value: 0.92). The students perceived that their self-efficacy improved significantly in the majority of basic EM skills and procedures (p value < 0.001). Emergent qualitative themes in the study also supported these results.

Conclusion

This study showed that a 4-week mandatory EM clerkship increased medical students' perceived self-efficacy in basic emergency management skills. The EM clerkship met students' expectations on knowledge and skill acquisition, and exceeded students’ expectations on educational environment.

Development of an intensive simulating training program in emergency medicine for medical students in China

BACKGROUND

A national standardized emergency medicine (EM) curriculum for medical students, including specific competencies in procedural skills, are absent in many countries. The development of an intensive simulating training program in EM, based on a tight schedule, is anticipated to enhance the competency of medical students.

METHODS

A 3-day intensive EM training program, consisting of four procedural skills and 8-hour case-based learning (CBL), was developed by experienced physicians from the EM department in Peking Union Medical College Hospital (PUMCH). Medical students from Peking Union Medical College (PUMC) and Tsinghua University (THU) participated in the training. Three written tests were cautiously designed to examine the short-term (immediately after the program) and long-term (6 months after the program) efficacy of the training. After completion of the training program, an online personal appraisal questionnaire was distributed to the students on WeChat (a mobile messaging App commonly used in China) to achieve anonymous self-evaluation.

RESULTS

Ninety-seven out of 101 students completed the intensive training and took all required tests. There was a significant increase in the average score after the intensive simulating training program (pre-training 13.84 vs. 15.57 post-training, P<0.001). Compared with the pre-training test, 63 (64.9%) students made progress. There was no significant difference in scores between the tests taken immediately after the program and 6 months later (15.57±2.22 vs. 15.38±2.37, P=0.157). Students rated a higher score in all diseases and procedural skills, and felt that their learning was fruitful.

CONCLUSIONS

The introduction of a standardized intensive training program in EM focusing on key competencies can improve clinical confidence, knowledge, and skills of medical students toward the specialty. In addition, having such a program can also enhance student's interest in EM as a career choice which may enhance recruitment into the specialty and workplace planning.

An Emergency Medicine Virtual Clerkship: Made for COVID, Here to Stay

Introduction: Safety concerns surrounding the coronavirus 2019 pandemic led to the prohibition of student rotations outside their home institutions. This resulted in emergency medicine (EM)-bound students having less specialty experience and exposure to outside programs and practice environments, and fewer opportunities to gain additional Standardized Letters of Evaluation, a cornerstone of the EM residency application. We filled this void by implementing a virtual clerkship. Methods: We created a two-week virtual, fourth-year visiting clerkship focused on advanced medical knowledge topics, social determinants of health, professional development, and professional identity formation. Students completed asynchronous assignments and participated in small group-facilitated didactic sessions. We evaluated the virtual clerkship with pre- and post-medical knowledge tests and evaluative surveys. Results: We hosted 26 senior medical students over two administrations of the same two-week virtual clerkship. Students had a statistically significant improvement on the medical knowledge post-tests compared to pre-tests (71.7% [21.5/30] to 76.3% [22.9/30]). Students reported being exposed to social determinants of health concepts they had not previously been exposed to. Students appreciated the interactive nature of the sessions; networking with other students, residents, and faculty; introduction to novel content regarding social determinants of health; and exposure to future career opportunities. Screen time, technological issues, and mismatch between volume of content and time allotted were identified as potential challenges and areas for improvement. Conclusion: We demonstrate that a virtual EM visiting clerkship is feasible to implement, supports knowledge acquisition, and is perceived as valuable by participants. The benefits seen and challenges faced in the development and implementation of our clerkship can serve to inform future virtual clerkships, which we feel is a complement to traditional visiting clerkships even though in-person clerkships have been re-established.

Current situation and expectation of emergency medicine education for 8-year Doctor of Medicine degree program in China

Background:

Appropriate lessons and formalized training concerning emergency medicine is becoming increasingly important in undergraduate medical education. There is an urgent need to evaluate undergraduate emergency medicine education of students enrolled on the 8-year Doctor of Medicine degree programs nationwide in China with the aim that the data extracted could ultimately be used to help develop a standardized emergency medicine curriculum in China.

Objectives:

The aim of the study is to accurately describe emergency medicine education of 8-year Doctor of Medicine program in China, including emergency medicine classes, clinical practice in emergency medicine department, and expectations toward emergency medicine education.

Methods:

An online questionnaire was distributed to all the medical students of 8-year Doctor of Medicine program who have attended emergency medicine education in 14 medical schools in China. Participation in the survey was voluntary and anonymized.

Results:

In total, 529 valid responses were collected. There was a clear difference between students with a career aspiration in emergency medicine and those without. Comparing to countries that have an established emergency medicine curriculum, shortage of classroom hours and clinical practice time is a major cause of unsatisfactory educational outcomes in China. A detailed uniform emergency medicine curriculum that outlines exact requirements for medical students is required as well.

Conclusion:

A consolidated syllabus and curriculum should be compiled by all the medical schools with the 8-year integrated Doctor of Medicine degree program in China. The specific diseases and skills that should be covered in emergency medical education remain up to debate.

Validity Evidence for the Emergency Medicine Standardized Letter of Evaluation

BACKGROUND

The standardized letter of evaluation (SLOE) is the application component that program directors value most when evaluating candidates to interview and rank for emergency medicine (EM) residency. Given its successful implementation, other specialties, including otolaryngology, dermatology, and orthopedics, have adopted similar SLOEs of their own, and more specialties are considering creating one. Unfortunately, for such a significant assessment tool, no study to date has comprehensively examined the validity evidence for the EM SLOE.

OBJECTIVE

We summarized the published evidence for validity for the EM SLOE using Messick's framework for validity evidence.

METHODS

A scoping review of the validity evidence of the EM SLOE was performed in 2020. A scoping review was chosen to identify gaps and future directions, and because the heterogeneity of the literature makes a systematic review difficult. Included articles were assigned to an aspect of Messick's framework and determined to provide evidence for or against validity.

RESULTS

There have been 22 articles published relating to validity evidence for the EM SLOE. There is evidence for content validity; however, there is a lack of evidence for internal structure, relation to other variables, and consequences. Additionally, the literature regarding response process demonstrates evidence against validity.

CONCLUSIONS

Overall, there is little published evidence in support of validity for the EM SLOE. Stakeholders need to consider changing the ranking system, improving standardization of clerkships, and further studying relation to other variables to improve validity. This will be important across GME as more specialties adopt a standardized letter.

Emergency medicine clerkship director experience adapting emergency remote learning during the onset of COVID-19 pandemic

OBJECTIVES

The recent outbreak of the COVID-19 altered the traditional paradigm of clinical medical education. While individual clerkships have shared their curricular adaptations via social and academic networking media, there is currently no organizational standard in establishing a nonclinical, emergency medicine (EM) virtual rotation (VR). The primary objective of this study was to describe EM clerkship directors' (CDs) perspectives on their experience adapting an EM VR curriculum during the onset of the COVID-19 pandemic.

METHODS

A 21-item survey with quantitative and qualitative questions was disseminated between June and August 2020 to EM CDs via the Clerkship Director of Emergency Medicine Listserv to describe their experience and perspectives in adapting a VR during spring 2020.

RESULTS

We analyzed 59 of 77 EM clerkship survey responses. Among respondents, 52% adapted a VR while 47.5% did not. Of those who adapted a VR, 71% of CDs had 2 weeks or less to develop the new curriculum, with 84% reporting usual or increased clinical load during that time. Clerkships significantly diversified their asynchronous educational content and utilized several instructional models to substitute the loss of clinical experience. Reflecting on the experience, 71% of CDs did not feel comfortable writing a standardized letter of evaluation for students based on the VR, with the majority citing inability to evaluate students' competencies in a clinical context.

CONCLUSION

A crisis such as COVID-19 necessitates change in all facets of medical education. While EM educators demonstrated the ability to create emergency remote learning with limited time, this was not equivalent to the formal development of preplanned VR experiences. Future faculty development and curriculum innovation are required to fully transition an in-person immersive experience to a noninferior virtual experience.

Multi-institutional Implementation of the National Clinical Assessment Tool in Emergency Medicine: Data From the First Year of Use

OBJECTIVES

Uniformly training physicians to provide safe, high-quality care requires reliable assessment tools to ensure learner competency. The consensus-derived National Clinical Assessment Tool in Emergency Medicine (NCAT-EM) has been adopted by clerkships across the country. Analysis of large-scale deidentified data from a consortium of users is reported.

METHODS

Thirteen sites entered data into a Web-based platform resulting in over 6,400 discrete NCAT-EM assessments from 748 students and 704 assessors. Reliability, internal consistency analysis, and factorial analysis of variance for hypothesis generation were performed.

RESULTS

All categories on the NCAT-EM rating scales and professionalism subdomains were used. Clinical rating scale and global assessment scores were positively skewed, similar to other assessments commonly used in emergency medicine (EM). Professionalism lapses were noted in <1% of assessments. Cronbach's alpha was >0.8 for each site; however, interinstitutional variability was significant. M4 students scored higher than M3 students, and EM-bound students scored higher than non-EM-bound students. There were site-specific differences based on number of prior EM rotations, but no overall association. There were differences in scores based on assessor faculty rank and resident training year, but not by years in practice. There were site-specific differences based on student sex, but overall no difference.

CONCLUSIONS

To our knowledge, this is the first large-scale multi-institutional implementation of a single clinical assessment tool. This study demonstrates the feasibility of a unified approach to clinical assessment across multiple diverse sites. Challenges remain in determining appropriate score distributions and improving consistency in scoring between sites.

Teaching Rapid Assessment Skills in Triage for the Emergency Medicine Clerkship

BACKGROUND

Rapidly assessing an undifferentiated patient and developing a gestalt for "sick vs. not sick" is a core component of emergency medicine (EM). Developing this skill requires clinical experience and pattern recognition, which can be difficult to attain during a typical EM clerkship.

OBJECTIVE

We developed a novel approach to teaching medical students rapid assessment skills in the emergency department (ED) by implementing a teaching shift in triage.

METHODS

Fourth-year medical students in our EM clerkship in fall 2019 were scheduled one shift in triage with a dedicated teaching attending. The students evaluated patients under direct supervision, discussed their immediate differential diagnosis, and proposed an initial workup. The attending gave real-time feedback using a standardized direct observation tool. Students completed an electronic pre and post survey (5-point Likert scale) to assess their comfort level in the following areas: performing a rapid triage assessment, determining "sick vs. not sick", performing a focused physical examination, developing a targeted differential diagnosis, and ordering an initial diagnostic workup.

RESULTS

Twenty-one students participated in the triage shifts. There was a significant improvement in self-assessed comfort with performing a rapid triage assessment, mean pre 2.76 and post 4.43 (p < 0.0001). There were also significant improvements in the four other survey areas (p < 0.004 or less).

CONCLUSIONS

A teaching shift in triage can increase medical students' self-assessed rapid assessment skills for patients in the ED. Benefits to the teaching attending included the opportunity to perform direct observation, give real-time feedback, and identify real-time teaching moments.

From the pandemic's front lines: A social responsibility initiative to develop an international free online emergency medicine course for medical students

The COVID-19 pandemic has disrupted medical education and forced medical schools to shift to remote teaching. However, in many institutions, this shift was complicated by the lack of previous experience and resources as well as the decreased educational time and effort due to increased clinical load. In April 2020, the International Emergency Medicine (iEM) Education Project embarked upon a social responsibility initiative to ease and facilitate this transition for emergency medicine clerkships. A 4-week open online emergency medicine core content course for medical students covering 11 lessons and 37 topics was created. This course contains a total of 25 hours of content, 66 chapters curated from the free iEM Education Project 2018 eBook and Society of Academic Emergency Medicine curriculum website and 131 videos granted freely by the commercial medical education resources provider, Lecturio. In the first 24 hours, the website was visited 3127 times from 57 countries in 6 continents. While online teaching is not a substitute for in-person clinical teaching, such initiatives can provide resources to clinical teachers who are overwhelmed with clinical duties and an opportunity for medical students from low-resource settings to continue their training safely during the pandemic.

A mandatory Emergency Medicine clerkship influences students' career choices in a developing system

BACKGROUND

Attracting medical students for a front-line specialty, Emergency Medicine, is challenging in many countries. The available literature is scarce and bounded to the mature emergency care and education systems. In the countries where emergency medicine is a new specialty and has different contextual needs, the perception of the students and their career interest in emergency medicine specialty is an unanswered question.

OBJECTIVE

We aimed to study the effects of a mandatory Emergency Medicine (EM) clerkship on students' perceptions and their future career choice to be emergency physicians.

METHODS

A voluntary de-identified survey was prospectively collected before and after the EM clerkship to capture students' perceptions in four domains (EM clerkship, EM physicians, EM patients, and EM specialty as a career choice). The survey included 24 statements having five-point Likert scale for each statement. Non-parametric Wilcoxon signed rank test was used for statistical analysis.

RESULTS

Sixty-seven students responded to both surveys (response rate of 85%). Students' perceptions have significantly improved on the EM physicians, and their job after attending the clerkship (p < 0.001). They found EM a respected (p = 0.038), flexible (p < 0.001), secure (p < 0.001), satisfying, and prestigious (p = 0.006) job. They found EM physicians compassionate (p < 0.011), have adequate patient contact (p < 0.045) and control on their time (0.004). Choosing EM as a future career has significantly increased after clerkship (p < 0.001).

CONCLUSIONS

Our mandatory EM clerkship significantly improved students' perceptions on EM specialty as a future career choice. A well-structured and mandatory EM clerkship can attract more students to be trained in the EM.

Establishment of an Undergraduate FOAM Initiative: International Emergency Medicine (iEM) Education Project for Medical Students

Introduction

Our goal was to describe the structure, process, platforms, and piloting period activities of the International Emergency Medicine (iEM) Education Project, which is a Free Open Access Medical Education (FOAM) initiative designed for medical students.

Methods

This was a descriptive study. We analyzed the activity data of iEM Education Project platforms (website and image, video, audio archives) in the piloting period (June 1, 2018–August 31, 2018). Studied variables included the total and monthly views, views by country and continents, the official languages of the countries where platforms were played, and their income levels.

Results

Platforms were viewed or played 38,517 times by users from 123 countries. The total views and plays were 8,185, 11,896, and 18,436 in June, July, and August, respectively. We observed a monthly increasing trend in all platforms. Image archive and website were viewed the most. All platforms were dominantly viewed from Asia and North America, high- and upper-middle-income countries, and non-English speaking countries. However, there were no statistically significant differences between continents, income levels, or language in platforms, except for the website, the project’s main hub, which showed a strong trend for difference between income levels (Kruskal-Wallis, P = 0.05). Website views were higher in high-income countries compared with low- and lower-middle income countries (Mann Whitney U test, P = 0.038 and P = 0.021, respectively).

Conclusion

The iEM Education Project was successfully established. Our encouraging initial results support the international expansion and increased collaboration of this project. Despite targeting developing countries with limited resources in this project, their engagement was suboptimal. Solutions to reach medical students in these countries should be investigated.

Converting to Connect: A Rapid RE-AIM Evaluation of the Digital Conversion of a Clerkship Curriculum in the Age of COVID-19

BACKGROUND

With the advent of the 2019 coronavirus pandemic, a decision was made to remove medical students from clinical rotations for their own safety. This forced students on a core emergency medicine (EM) rotation at McMaster University to immediately cease all in-person activities. An urgent need for a virtual curriculum emerged.

METHODS

A virtual curriculum consisting of asynchronous case-based learning on Slack, ask-me-anything webinars, and online e-modules was created to fill the need. We describe a program evaluation using the RE-AIM framework and a social networking analysis of participants.

RESULTS

Medical students (n = 23) and 11 facilitators (five residents, six faculty members) participated in this pilot study. Faculty members sent a mean (±SD) of 115 (±117) messages (n = 6), and mean (±SD) message counts for students and residents were 49.96 (±25; n = 23) and 39 (±38; n = 5), respectively. A total of 62,237 words were written by the participants, with a mean of 1,831 per person. Each message consisted of a mean (±SD) of 25 words (±29). Students rapidly acquitted themselves to digital technology. Using the RE-AIM framework we highlight the feasibility of a virtual curriculum, discuss demands on faculty time, and reflect on strategies to engage learners.

CONCLUSIONS

The use of asynchronous digital curricula creates opportunities for faculty-resident interaction and engagement. We report the successful deployment of a viable model for undergraduate EM training for senior medical students in the COVID-19 era of physical distancing.

Clerkships in Emergency Medicine

Planning for clerkships in emergency medicine (EM) can be stressful, prolonged, and challenging. Therefore, medical students should start planning for them early. In this article, we offer guidance regarding several issues pertinent to the EM clerkship, such as the best time to schedule one (or more) during medical school, the most appropriate institution or program to schedule it, the process of selecting and applying for the clerkship, and the number of EM clerkships to consider. We will explain why an EM clerkship should be scheduled between June and October and the reason that 2 EM clerkships at different sites are sufficient for the majority of students. Additionally, we emphasize that clerkships in emergency departments associated with EM residency programs or with reputations for outstanding student teaching tend to be most beneficial. Above all, students interested in EM should attempt to leave a great impression after completing their clerkships by providing stellar patient care, demonstrating enthusiasm at all times, and maintaining professionalism. In turn, they will gain knowledge and clinical experiences that should prove valuable in their future.

Clinical Procedure Experience of Medical Students Improves Their Objective Structured Clinical Examination Station Scores in Emergency Medicine Clerkship

OBJECTIVE

We aimed to study the correlation between procedure experiences in the clinical setting and objective structured clinical examination (OSCE) scores achieved at the end of an emergency medicine clerkship for the final-year medical students.

METHODS

This is a retrospective analysis of prospectively collected clinical data of 141 final-year medical students and their OSCE scores for the two consecutive academic years (2015-2017). The experience of practical skills including suturing, extended focused assessment sonography for trauma (EFAST), airway management, and cardiopulmonary resuscitation was correlated with the final OSCE scores in the same areas.

RESULTS

Weighted experiences of the four procedures were significantly correlated with the total OSCE station scores (p = 0.027, Spearman's rho = 0.19). Suturing OSCE scores were significantly higher than the other stations (p < 0.0001, Wilcoxon signed-rank test). There was a significant correlation between suturing experience and its OSCE score (p = 0.036, Spearman's rho = 0.18). There was also a strong trend in correlation between EFAST experience and its OSCE score (p = 0.063, Spearman's rho = 0.16). There was a significant difference in weighted experience between each of the four procedures (p < 0.0001, Wilcoxon signed-rank test). In all cut-off levels (75-95) of OSCE scores, students showed higher weighted procedure experience for those who had higher scores. Statistical significance was found only for students who scored more than 90% of the OSCE score.

CONCLUSION

Clinical experience of procedures improved OSCE scores of the same procedures. The top students showed significant higher weighted procedure experience.

A Delphi consensus study for teaching "Basic Trauma Management" to third-year medical students

Background

The Basic-Trauma Management (BTM) course has been taught to third-year medical students in small groups for many years without substantial changes. With the introduction of a new curriculum for Swiss medical students, it was necessary to revise the BTM content and re-align it. Our aim was to identify core competencies for the revised BTM course.

Methods

We applied a three-round step-wise Delphi consensus. First, we asked open-ended questions on what were the most important competencies to be taught for BTM; the second round used Likert scales to ensure agreement on the competencies; and the final round reached out for consensus on these BTM competencies. Stakeholders were selected based on their long-standing experience in teaching BTM and in managing trauma patients.

Results

Consensus was found on 29 competencies out of an initial 130 proposals. “Human Factors”, which had not been taught previously, scored relatively high, at 22%. The sole specific trauma skill agreed upon was the use of tourniquets.

Conclusions

This is an example of curricular revision of a clinical skills course after the introduction of a regulatory framework for undergraduate medical education. The revised course curriculum tailors the concepts and skills in trauma that fulfill stakeholder needs, and are in agreement with the new Swiss learning outcomes.

Pupil Prose Appraisal: Four Practical Solutions to Medical Student Documentation and Feedback in the Emergency Department

Documentation is part of a critical foundation of skills in the undergraduate medical education curriculum. New compliance rules from the Centers for Medicare and Medicaid Services will impact student documentation practices. Common barriers to student documentation include limited access to the electronic medical record, variable clerkship documentation expectations, variable advice regarding utilizing the electronic medical record, and limited time for feedback delivery. Potential solutions to these barriers are suggested to foster documentation skill development. Recommendations are also given to mitigate compliance and legal risk.

Team-based learning improves knowledge and retention in an emergency medicine clerkship

BACKGROUND

Team-based learning (TBL) as an instructional pedagogy is increasingly recognized to improve student engagement, value of teamwork, and performance on standardized assessments when compared to traditional lecture-based instruction. The aim of this study is to compare two educational modalities (TBL and didactic/case discussion) on knowledge-based outcome and student perceptions.

METHODS

Two emergency medicine clerkship academic years were studied. In the first year, all topics were delivered via didactic presentations along with case discussions. In the second year, eight topics were delivered using TBL while three topics were delivered via didactic/case discussions. Final exam marks were compared. Student satisfaction survey was also conducted and analyzed.

RESULTS

After adjusting for student past performance and exam difficulty, student marks improved in the second year for both TBL and didactic/case discussion topics. The average mark for topics taught via TBL in the second year was significantly higher than the average mark on the same topics taught didactically in the first year by 7.5% (T test, p < 0.001). The marks for topics taught via TBL showed better improvement comparing to topics taught via didactic/case discussion by 2.3% (ANOVA-RM, p = 0.042). Student marks related to TBL topics were significantly higher on the medical exit exam (paired t test, p = 0.007). Student response to TBL survey was positive.

CONCLUSIONS

TBL as part of a blended learning environment facilitated improved knowledge-based performance in an emergency medicine clerkship following end clerkship and medical school exit assessments, suggesting TBL stimulates long-term retention. The high acceptance of TBL among our students suggests a preference of this learning modality to didactic teaching.

White Paper-Geriatric Emergency Medicine Education: Current State, Challenges, and Recommendations to Enhance the Emergency Care of Older Adults

Older adults account for 25% of all emergency department (ED) patient encounters. One in five Americans will be 65 or older by 2030. In response to this need, geriatric emergency medicine (GEM) has developed into a robust area of academic and clinical interest, with extensive evidence-based research and guidelines, including clear undergraduate and postgraduate GEM competencies. Despite these developments, GEM content remains underrepresented in curricula and licensing examinations. The complex reasons for these deficits include a perception that care of older adults is not a core emergency medicine (EM) competency, a disjunction between traditional definitions of expertise and the GEM perspective, and lack of curricular capacity. This White Paper, prepared on behalf of the Academy of Geriatric Emergency Medicine, describes the state of GEM education, identifies the challenges it faces, and reviews innovations, including research presented at the 2018 Society for Academic Emergency Medicine (SAEM) Annual Scientific Meeting. The authors propose a number of recommendations. These include recognizing GEM as a core educational priority in EM, enhancing academic support for GEM clinician-educators, using social learning and practical problem solving to teach GEM concepts, emphasizing a whole-person multisystem approach to care of older adults, and identifying ageist attitudes as a hurdle to safe and effective GEM care.

Emergency medicine clerkship curriculum in a high-income developing country: methods for development and application

Background

The published recommendations for international emergency medicine curricula cover the content, but exclude teaching and learning methods, assessment, and evaluation. We aim to provide an overview on available emergency medicine clerkship curricula and report the development and application experience of our own curriculum.

Methods

Our curriculum is an outcome-based education, enriched by e-learning and various up-to-date pedagogic principles.

Results

Teaching and learning methods, assessment, and evaluation are described. The theory behind our practice in the light of recent literature is discussed aiming to help other colleagues from developing countries to have a clear map for developing and tailoring their own curricula depending on their needs. The details of our emergency medicine clerkship will serve as an example for developing and developed countries having immature undergraduate emergency medicine clerkship curricula. However, these recommendations will differ in various settings depending on available resources.

Conclusions

The main concept of curriculum development is to create a curriculum having learning outcomes and content relevant to the local context, and then align the teaching and learning activities, assessments, and evaluations to be in harmony. This may assure favorable educational outcome even in resource limited settings.

Electronic supplementary material

The online version of this article (10.1186/s12245-018-0190-y) contains supplementary material, which is available to authorized users.

Assessment of EFAST training for final year medical students in emergency medicine clerkship

Background

Extended Focused Assessment Sonography for Trauma (EFAST) is an important bedside tool for the management of multiple trauma patients. We aimed to evaluate the assessment of our EFAST education in the Emergency Medicine Clerkship (EMC) for final year medical students and the correlations of EFAST marks with other practical skill stations and the final multiple choice question (MCQ) exam marks.

Methods

Fifty-four final year medical students were trained on performing EFAST on human models during their 4-week clerkship. Students received an hour of didactic lecture, 4-hours practical sessions on human models, and completed a minimum of three EFAST examinations on trauma patients. Finally, the EFAST performance was evaluated on human models using a standard evaluation form during an Objective Structured Clinical Examination (OSCE). The marks of 51 students who completed the final exam were analyzed.

Results

The overall passing rate of the EFAST station was 88% (n: 45). EFAST station mark had significant weak correlations with other OSCE stations marks (p = 0.027, rho = 0.31), and with the final EMC mark (p = 0.032, rho = 0.3), but not with the final MCQ exam.

Conclusions

Final year medical students demonstrated effective EFAST learning as measured by their examination performance. One hour EFAST training and 4 -hours practice provide an acceptable level of skill for medical students. The EFAST final marks showed significant weak correlation with other OSCE station marks and final clerkship marks, but not with the final MCQ exam mark which assesses a different cognitive learning domain.

The role of emergency medicine clerkship e-Portfolio to monitor the learning experience of students in different settings: a prospective cohort study

Background

Although emergency departments provide acute care learning opportunities for medical students, student exposure to recommended curriculum presentations and procedures are limited. In this perspective, clinical environments providing learning opportunities for students should be monitored as part of an ongoing quality improvement process. This study aims to analyze student exposures and their involvement levels in two different hospitals (Tawam and Al Ain) so as to improve the teaching and learning activities.

Methods

This is a prospective study on all 76 final year medical students’ electronic logbooks (e-Portfolio) of the academic year 2016/2017.

Results

Students recorded 5087 chief complaints and 3721 procedures. The average patient and procedure exposure in a shift per student in Al Ain Hospital compared with Tawam Hospital were 7.2 vs 6.4 and 5.8 vs 4.3, respectively. The highest full involvement with presentations was seen in the pediatric unit (67.1%, P < 0.0001). Urgent care shifts demonstrated the highest area of “full involvement” with procedures for our students (73.2%, P < 0.0001). Students’ highest involvement with presentations and procedures were found during the night shifts (P < 0.0001, 66.5 and 75.1%, respectively).

Conclusions

The electronic portfolio has proven to be a very useful tool in defining the learning activities of final year medical students during their emergency medicine clerkship and in comparing activities in two different clinical settings. Data collected and analyzed using this e-Portfolio has the potential to help medical educators and curriculum designers improve emergency medicine teaching and learning activities.

Do senior medical students meet recommended emergency medicine curricula requirements?

BACKGROUND

Emergency departments (EDs) offer a variety of learning opportunities for undergraduate medical students. It is however, difficult to evaluate whether they are receiving recommended training during their emergency medicine (EM) clerkship without identifying their clinical activities. We aimed to evaluate the clinical exposure of the final year medical students at our College during their EM clerkship.

METHODS

This is a retrospective analysis of prospectively collected student logbooks. 75 students rotated in a 4-week EM clerkship during 2015-2016. The students rotated in EDs of two hospitals. Each ED treats more than 120,000 cases annually. The students completed 12 eight-hours shifts. Presentations and procedures seen were compared with EM curriculum recommendations.

RESULTS

Five thousand one hundred twenty-two patient presentations and 3246 procedures were recorded in the logbooks, an average (SD) of 68.3 (17.6) patients and 46.1 (14.0) procedures. None of the students encountered all ten recommended presentations. Two students (2.6%) logged all nine procedure categories of the EM curriculum.

CONCLUSION

Recommended presentations and procedures of the EM clerkship were not fully encountered by all our students. Different settings vary in the availability and type of patients and procedures. Each clinical clerkship should tailor their teaching methods based on the available learning opportunities.

The National Clinical Assessment Tool for Medical Students in the Emergency Department (NCAT-EM)

Introduction

Clinical assessment of medical students in emergency medicine (EM) clerkships is a highly variable process that presents unique challenges and opportunities. Currently, clerkship directors use institution-specific tools with unproven validity and reliability that may or may not address competencies valued most highly in the EM setting. Standardization of assessment practices and development of a common, valid, specialty-specific tool would benefit EM educators and students.

Methods

A two-day national consensus conference was held in March 2016 in the Clerkship Directors in Emergency Medicine (CDEM) track at the Council of Residency Directors in Emergency Medicine (CORD) Academic Assembly in Nashville, TN. The goal of this conference was to standardize assessment practices and to create a national clinical assessment tool for use in EM clerkships across the country. Conference leaders synthesized the literature, articulated major themes and questions pertinent to clinical assessment of students in EM, clarified the issues, and outlined the consensus-building process prior to consensus-building activities.

Results

The first day of the conference was dedicated to developing consensus on these key themes in clinical assessment. The second day of the conference was dedicated to discussing and voting on proposed domains to be included in the national clinical assessment tool. A modified Delphi process was initiated after the conference to reconcile questions and items that did not reach an a priori level of consensus.

Conclusion

The final tool, the National Clinical Assessment Tool for Medical Students in Emergency Medicine (NCAT-EM) is presented here.

Crowdsourced Curriculum Development for Online Medical Education

In recent years online educational content, efforts at quality appraisal, and integration of online material into institutional teaching initiatives have increased. However, medical education has yet to develop large-scale online learning centers. Crowd-sourced curriculum development may expedite the realization of this potential while providing opportunities for innovation and scholarship. This article describes the current landscape, best practices, and future directions for crowdsourced curriculum development using Kern's framework for curriculum development and the example topic of core content in emergency medicine. A scoping review of online educational content was performed by a panel of subject area experts for each step in Kern's framework. Best practices and recommendations for future development for each step were established by the same panel using a modified nominal group consensus process. The most prevalent curriculum design steps were (1) educational content and (2) needs assessments. Identified areas of potential innovation within these steps included targeting gaps in specific content areas and developing underrepresented instructional methods. Steps in curriculum development without significant representation included (1) articulation of goals and objectives and (2) tools for curricular evaluation. By leveraging the power of the community, crowd-sourced curriculum development offers a mechanism to diffuse the burden associated with creating comprehensive online learning centers. There is fertile ground for innovation and scholarship in each step along the continuum of curriculum development. Realization of this paradigm's full potential will require individual developers to strongly consider how their contributions will align with the work of others.

How do national specialty groups develop undergraduate guidelines for medical schools, and which are successful? A systematic review

PURPOSE

To better understand the steps undertaken by medical specialties to develop and implement undergraduate national, and international, educational guidelines for use in medical schools, and to find what makes them successful in terms of uptake and knowledge.

METHODS

Systematic review of databases to find inter- and nationally-created undergraduate medical specialty guidelines, and descriptions of development and analysis, from 1998 to January 2015.

RESULTS

Ninety six eligible papers were found, covering 59 different guidelines in 32 specialties. Five documented from development to revision. Development often required multiple stages and methods, 10 using the Delphi technique. Twenty two guidelines mapped to recommended government standards. Twenty papers analyzed curricula. No guideline was used in every relevant medical school.

CONCLUSIONS

This is a comprehensive review of the processes involved in creating international and national guidelines, with emphasis of key points for those considering similar undertakings. These include thorough needs analysis of multiple groups involved in the delivery of the curriculum; and engagement of relevant parties throughout development, to ensure relevance and increase buy-in. Flexibility is important, to allow use in medical schools with different methods of teaching. Ongoing evaluation and update are also critical steps that must not be forgotten.

Faculty Evaluations Correlate Poorly with Medical Student Examination Performance in a Fourth-Year Emergency Medicine Clerkship

BACKGROUND

Clerkship directors routinely evaluate medical students using multiple modalities, including faculty assessment of clinical performance and written examinations. Both forms of evaluation often play a prominent role in final clerkship grade. The degree to which these modalities correlate in an emergency medicine (EM) clerkship is unclear.

OBJECTIVE

We sought to correlate faculty clinical evaluations with medical student performance on a written, standardized EM examination of medical knowledge.

METHODS

This is a retrospective study of fourth-year medical students in a 4-week EM elective at one academic medical center. EM faculty performed end of shift evaluations of students via a blinded online system using a 5-point Likert scale for 8 domains: data acquisition, data interpretation, medical knowledge base, professionalism, patient care and communication, initiative/reliability/dependability, procedural skills, and overall evaluation. All students completed the National EM M4 Examination in EM. Means, medians, and standard deviations for end of shift evaluation scores were calculated, and correlations with examination scores were assessed using a Spearman's rank correlation coefficient.

RESULTS

Thirty-nine medical students with 224 discrete faculty evaluations were included. The median number of evaluations completed per student was 6. The mean score (±SD) on the examination was 78.6% ± 6.1%. The examination score correlated poorly with faculty evaluations across all 8 domains (ρ 0.074-0.316).

CONCLUSION

Faculty evaluations of medical students across multiple domains of competency correlate poorly with written examination performance during an EM clerkship. Educators need to consider the limitations of examination score in assessing students' ability to provide quality patient clinical care.

Medical Student Documentation in the Electronic Medical Record: Patterns of Use and Barriers

Introduction

Electronic health records (EHR) have become ubiquitous in emergency departments. Medical students rotating on emergency medicine (EM) clerkships at these sites have constant exposure to EHRs as they learn essential skills. The Association of American Medical Colleges (AAMC), the Liaison Committee on Medical Education (LCME), and the Alliance for Clinical Education (ACE) have determined that documentation of the patient encounter in the medical record is an essential skill that all medical students must learn. However, little is known about the current practices or perceived barriers to student documentation in EHRs on EM clerkships.

Methods

We performed a cross-sectional study of EM clerkship directors at United States medical schools between March and May 2016. A 13-question IRB-approved electronic survey on student documentation was sent to all EM clerkship directors. Only one response from each institution was permitted.

Results

We received survey responses from 100 institutions, yielding a response rate of 86%. Currently, 63% of EM clerkships allow medical students to document a patient encounter in the EHR. The most common reasons cited for not permitting students to document a patient encounter were hospital or medical school rule forbidding student documentation (80%), concern for medical liability (60%), and inability of student notes to support medical billing (53%). Almost 95% of respondents provided feedback on student documentation with supervising faculty being the most common group to deliver feedback (92%), followed by residents (64%).

Conclusion

Close to two-thirds of medical students are allowed to document in the EHR on EM clerkships. While this number is robust, many organizations such as the AAMC and ACE have issued statements and guidelines that would look to increase this number even further to ensure that students are prepared for residency as well as their future careers. Almost all EM clerkships provided feedback on student documentation indicating the importance for students to learn this skill.

Development of an Assessment for Entrustable Professional Activity (EPA) 10: Emergent Patient Management

INTRODUCTION

Medical schools in the United States are encouraged to prepare and certify the entrustment of medical students to perform 13 core entrustable professional activities (EPAs) prior to graduation. Entrustment is defined as the informed belief that the learner is qualified to autonomously perform specific patient-care activities. Core EPA-10 is the entrustment of a graduate to care for the emergent patient. The purpose of this project was to design a realistic performance assessment method for evaluating fourth-year medical students on EPA-10.

METHODS

First, we wrote five emergent patient case-scenarios that a medical trainee would likely confront in an acute care setting. Furthermore, we developed high-fidelity simulations to realistically portray these patient case scenarios. Finally, we designed a performance assessment instrument to evaluate the medical student's performance on executing critical actions related to EPA-10 competencies. Critical actions included the following: triage skills, mustering the medical team, identifying causes of patient decompensation, and initiating care. Up to four students were involved with each case scenario; however, only the team leader was evaluated using the assessment instruments developed for each case.

RESULTS

A total of 114 students participated in the EPA-10 assessment during their final year of medical school. Most students demonstrated competence in recognizing unstable vital signs (97%), engaging the team (93%), and making appropriate dispositions (92%). Almost 87% of the students were rated as having reached entrustment to manage the care of an emergent patient (99 of 114). Inter-rater reliability varied by case scenario, ranging from moderate to near-perfect agreement. Three of five case-scenario assessment instruments contained items that were internally consistent at measuring student performance. Additionally, the individual item scores for these case scenarios were highly correlated with the global entrustment decision.

CONCLUSION

High-fidelity simulation showed good potential for effective assessment of medical student entrustment of caring for the emergent patient. Preliminary evidence from this pilot project suggests content validity of most cases and associated checklist items. The assessments also demonstrated moderately strong faculty inter-rater reliability.

Entrustable Professional Activity 10: Recognizing the Acutely Ill Patient-A Delirium Simulated Case for Students in Emergency Medicine

INTRODUCTION

This simulation case was designed to evaluate the ability of third- and fourth-year emergency medicine clerkship students and acting interns to perform the tasks outlined in the Association of American Medical College's Core Entrustable Professional Activity 10, to "recognize a patient requiring urgent or emergent care and initiate evaluation and management." The overarching goal is to assess medical students' ability to recognize and take steps to stabilize a sick patient.

METHODS

In this case, students encounter a physician, simulated with a high-fidelity manikin, who has suddenly become confused. Students are expected to recognize that he is acutely ill, call for help, and begin the initial steps of resuscitation. Bedside testing reveals hypoglycemia, which students are expected to treat. Further examination, history gathering, and diagnostic tests reveal that the patient is suffering from gram-negative sepsis. Students are evaluated on their ability to recognize signs of serious illness, call for appropriate help, perform critical assessment and treatment tasks, communicate their findings to an attending physician, and determine the appropriate patient disposition. Outcomes are measured using critical action checklists.

RESULTS

Initial trials of this case demonstrated its feasibility. All 13 students who have participated in this session have identified all five critical actions.

DISCUSSION

In later iterations, the number of roles was streamlined in order to reduce how many personnel were required. As a result of the very high critical-actions success rates of the first two groups of students tested, our case-specific checklist was revised with the goal of improving its discriminatory power.

Creating a contemporary clerkship curriculum: the flipped classroom model in emergency medicine

Background

The teaching modality of “flipping the classroom” has garnered recent attention in medical education. In this model, the lecture and homework components are reversed. The flipped classroom lends itself to more interaction in “class” and theoretically improved clinical decision-making. Data is lacking for this model for students in emergency medicine clerkships. We trialed the flipped classroom in our fourth-year student clerkship. Our aim was to learn student and faculty facilitator perceptions of the experience, as it has not been done previously in this setting. We evaluated this in two ways: (1) participant perception of the experience and (2) facilitator (EM physician educator) perception of student preparation, participation, and knowledge synthesis.

Methods

With permission from its creators, we utilized an online video series derived from the Clerkship Directors in Emergency Medicine. Students were provided the link to these 1 week prior to the classroom experience as the “homework.” We developed patient cases generated from the videos that we discussed during class in small-group format. Afterward, students were surveyed about the experience using four-point Likert items and free-text comments and also were evaluated by the facilitator on a nine-point scale.

Results

Forty-six clerkship students participated. Students deemed the online modules useful at 2.9 (95 % CI 2.7–3.2). Further, they reported the in-class discussion to be of high value at 3.9 (95 % CI 3.8–4.0), much preferred the flipped classroom to traditional lecturing at 3.8 (95 % CI 3.6–3.9), and rated the overall experience highly at 3.8 (95 % CI 3.7–3.9). Based on preparation, participation, and knowledge synthesis, the facilitator judged participants favorably at 7.4 (95 % CI 7.0–7.8). Students commented that the interactivity, discussion, and medical decision-making were advantages of this format.

Conclusions

Students found high value in the flipped classroom and prefer it to traditional lecturing, citing interactivity and discussion as the main reasons. The facilitator also viewed that the students were not only well prepared for the flipped classroom but that they also actively participated in and synthesized knowledge adequately during this experience. This study supports the use of the flipped classroom for EM clerkship students as a valuable, preferable teaching technique.

Electronic supplementary material

The online version of this article (doi:10.1186/s12245-016-0123-6) contains supplementary material, which is available to authorized users.

Correlation of the National Emergency Medicine M4 Clerkship Examination with USMLE Examination Performance

Introduction

Assessment of medical students’ knowledge in clinical settings is complex yet essential to the learning process. Clinical clerkships use various types of written examinations to objectively test medical knowledge within a given discipline. Within emergency medicine (EM), a new national standardized exam was developed to test medical knowledge in this specialty. Evaluation of the psychometric properties of a new examination is an important issue to address during test development and use. Studies have shown that student performance on selected standardized exams will reveal students’ strengths and/or weaknesses, so that effective remedial efforts can be implemented. Our study sought to address these issues by examining the association of scores on the new EM national exam with other standardized exam scores.

Methods

From August 2011 to April 2013, average National EM M4 examination scores of fourth-year medical students taken at the end of a required EM clerkship were compiled. We examined the correlation of the National EM M4 examination with the scores of initial attempts of the United States Medical Licensing Exam (USMLE) Step 1 and Step 2 Clinical Knowledge (CK) examinations. Correlation coefficients and 95% confidence intervals of correlation coefficients are reported. We also examined the association between the national EM M4 examination score, final grades for the EM rotation, and USMLE Step 1 and Step 2 CK scores.

Results

133 students were included in the study and achieved a mean score of 79.5 SD 8.0 on the National EM M4 exam compared to a national mean of 79.7 SD 3.89. The mean USMLE Step 1 score was 226.8 SD 19.3. The mean USMLE Step 2 CK score was 238.5 SD 18.9. National EM M4 examination scores showed moderate correlation with both USMLE Step 1 (mean score=226.8; correlation coefficient=0.50; 95% CI [0.28–0.67]) and USMLE Step 2 CK (mean score=238.5; correlation coefficient=0.47; 95% CI [0.25–0.65]). Students scoring below the median on the national EM M4 exam also scored well below their colleagues on USMLE exams.

Conclusion

The moderate correlation of the national EM M4 examination and USMLE Step 1 and Step 2 CK scores provides support for the utilization of the CDEM National EM M4 examination as an effective means of assessing medical knowledge for fourth-year medical students. Identification of students scoring lower on standardized exams allows for effective remedial efforts to be undertaken throughout the medical education process.

Correlation of the National Board of Medical Examiners Emergency Medicine Advanced Clinical Examination Given in July to Intern American Board of Emergency Medicine in-training Examination Scores: A Predictor of Performance?

Introduction

There is great variation in the knowledge base of Emergency Medicine (EM) interns in July. The first objective knowledge assessment during residency does not occur until eight months later, in February, when the American Board of EM (ABEM) administers the in-training examination (ITE). In 2013, the National Board of Medical Examiners (NBME) released the EM Advanced Clinical Examination (EM-ACE), an assessment intended for fourth-year medical students. Administration of the EM-ACE to interns at the start of residency may provide an earlier opportunity to assess the new EM residents’ knowledge base. The primary objective of this study was to determine the correlation of the NBME EM-ACE, given early in residency, with the EM ITE. Secondary objectives included determination of the correlation of the United States Medical Licensing Examination (USMLE) Step 1 or 2 scores with early intern EM-ACE and ITE scores and the effect, if any, of clinical EM experience on examination correlation.

Methods

This was a multi-institutional, observational study. Entering EM interns at six residencies took the EM-ACE in July 2013 and the ABEM ITE in February 2014. We collected scores for the EM-ACE and ITE, age, gender, weeks of clinical EM experience in residency prior to the ITE, and USMLE Step 1 and 2 scores. Pearson’s correlation and linear regression were performed.

Results

Sixty-two interns took the EM-ACE and the ITE. The Pearson’s correlation coefficient between the ITE and the EM-ACE was 0.62. R-squared was 0.5 (adjusted 0.4). The coefficient of determination was 0.41 (95% CI [0.3–0.8]). For every increase of one in the scaled EM-ACE score, we observed a 0.4% increase in the EM in-training score. In a linear regression model using all available variables (EM-ACE, gender, age, clinical exposure to EM, and USMLE Step 1 and Step 2 scores), only the EM-ACE score was significantly associated with the ITE (p<0.05). We observed significant colinearity among the EM-ACE, ITE and USMLE scores. Gender, age and number of weeks of EM prior to the ITE had no effect on the relationship between EM-ACE and the ITE.

Conclusion

Given early during intern year, the EM-ACE score showed positive correlation with ITE. Clinical EM experience prior to the in-training exam did not affect the correlation.

Ultrasound Training in the Emergency Medicine Clerkship

Introduction

The curriculum in most emergency medicine (EM) clerkships includes very little formalized training in point-of-care ultrasound. Medical schools have begun to implement ultrasound training in the pre-clinical curriculum, and the EM clerkship is an appropriate place to build upon this training. The objectives are (1) to evaluate the effectiveness of implementing a focused ultrasound curriculum within an established EM clerkship and (2) to obtain feedback from medical students regarding the program.

Methods

We conducted a prospective cohort study of medical students during an EM clerkship year from July 1, 2011, to June 30, 2012. Participants included fourth-year medical students (n=45) enrolled in the EM clerkship at our institution. The students underwent a structured program focused on the focused assessment with sonography for trauma exam and ultrasound-guided vascular access. At the conclusion of the rotation, they took a 10-item multiple choice test assessing knowledge and image interpretation skills. A cohort of EM residents (n=20) also took the multiple choice test but did not participate in the training with the students. We used an independent samples t-test to examine differences in test scores between the groups.

Results

The medical students in the ultrasound training program scored significantly higher on the multiple-choice test than the EM residents, t(63)=2.3, p<0.05. The feedback from the students indicated that 82.8% were using ultrasound on their current rotations and the majority (55.2%) felt that the one-on-one scanning shift was the most valuable aspect of the curriculum.

Discussion

Our study demonstrates support for an ultrasound training program for medical students in the EM clerkship. After completing the training, students were able to perform similarly to EM residents on a knowledge-based exam.

Does the Concept of the "Flipped Classroom" Extend to the Emergency Medicine Clinical Clerkship?

Introduction

Linking educational objectives and clinical learning during clerkships can be difficult. Clinical shifts during emergency medicine (EM) clerkships provide a wide variety of experiences, some of which may not be relevant to recommended educational objectives. Students can be directed to standardize their clinical experiences, and this improves performance on examinations. We hypothesized that applying a “flipped classroom” model to the clinical clerkship would improve performance on multiple-choice testing when compared to standard learning.

Methods

Students at two institutions were randomized to complete two of four selected EM clerkship topics in a “flipped fashion,” and two others in a standard fashion. For flipped topics, students were directed to complete chief complaint-based asynchronous modules prior to a shift, during which they were directed to focus on the chief complaint. For the other two topics, modules were to be performed at the students’ discretion, and shifts would not have a theme. At the end of the four-week clerkship, a 40-question multiple-choice examination was administered with 10 questions per topic. We compared performance on flipped topics with those performed in standard fashion. Students were surveyed on perceived effectiveness, ability to follow the protocol, and willingness of preceptors to allow a chief-complaint focus.

Results

Sixty-nine students participated; examination scores for 56 were available for analysis. For the primary outcome, no difference was seen between the flipped method and standard (p=0.494.) A mixed model approach showed no effect of flipped status, protocol adherence, or site of rotation on the primary outcome of exam scores. Students rated the concept of the flipped clerkship highly (3.48/5). Almost one third (31.1%) of students stated that they were unable to adhere to the protocol.

Conclusion

Preparation for a clinical shift with pre-assigned, web-based learning modules followed by an attempt at chief-complaint-focused learning during a shift did not result in improvements in performance on a multiple-choice assessment of knowledge; however, one third of participants did not adhere strictly to the protocol. Future investigations should ensure performance of pre-assigned learning as well as clinical experiences, and consider alternate measures of knowledge.

Course Offerings in the Fourth Year of Medical School: How U.S. Medical Schools Are Preparing Students for Internship

The fourth year of medical school remains controversial, despite efforts to reform it. A committee from the Clerkship Directors in Internal Medicine and the Association of Program Directors in Internal Medicine examined transitions from medical school to internship with the goal of better academic advising for students. In 2013 and 2014, the committee examined published literature and the Web sites of 136 Liaison Committee on Medical Education-accredited schools for information on current course offerings for the fourth year of medical school. The authors summarized temporal trends and outcomes when available.Subinternships were required by 122 (90%) of the 136 schools and allow students to experience the intern's role. Capstone courses are increasingly used to fill curricular gaps. Revisiting basic sciences in fourth-year rotations helps to reinforce concepts from earlier years. Many schools require rotations in specific settings, like emergency departments, intensive care units, or ambulatory clinics. A growing number of schools require participation in research, including during the fourth year. Students traditionally take fourth-year clinical electives to improve skills, both within their chosen specialties and in other disciplines. Some students work with underserved populations or seek experiences that will be henceforth unavailable, whereas others use electives to "audition" at desired residency sites. Fourth-year requirements vary considerably among medical schools, reflecting different missions and varied student needs. Few objective outcomes data exist to guide students' choices. Nevertheless, both medical students and educators value the fourth year of medical school and feel it can fill diverse functions in preparing for residency.

Dual Learning in an Emergency Medicine Clerkship Improves Student Performance

BACKGROUND

The emergency department (ED) is an ideal environment to teach learners about the "undifferentiated patient." Student learning may be inconsistent because of inherent variability in the ED. Previous research has suggested that standardizing the emergency medicine (EM) clerkship by implementing didactics and requiring students to see patients with particular chief complaints improves educational outcomes.

OBJECTIVE

To compare knowledge acquisition after a new curriculum to the traditional curriculum.

METHODS

This was a prospective, quasiexperimental study of senior medical students in an EM clerkship. Students were assigned to the dual learning (DL) group or standard learning (SL) groups based on month of rotation. All were required to see patients with 10 specific chief complaints and were lent an EM textbook. The SL group was instructed to read about the required cases. The DL group attended a 2-hour didactic session covering 5 of the 10 required cases. All students completed an identical pre- and postclerkship multiple choice knowledge test.

RESULTS

Data from 51 medical students (DL = 27; SL = 24) were analyzed. Mean pretest scores were comparable between groups. A 2 (groups) by 2 (sessions) mixed-design analysis of variance yielded a significant group by session interaction effect (p < 0.001). The DL group significantly increased its mean score from 8.7 (standard deviation [SD] = 1.8) pretest to 11.6 (SD = 1.9) posttest; there was no improvement in the SL group (pretest: 9.3 [SD = 1.5], posttest: 10.0 [SD = 2.0]).

CONCLUSION

A DL model combining clinical and enhanced didactic requirements for an EM clerkship led to greater knowledge gain than the standard curriculum. This model may suggest ways to improve the educational experience in the EM clerkship.

The National Emergency Medicine Fourth-year Student (M4) Examinations: Updates and Performance

BACKGROUND

Version 1 (V1) of the National Emergency Medicine Fourth-year Student (EM M4) Examination was released in 2011 and revised along with release of V2 in 2012. Each examination contains 50 multiple-choice questions designed to assess knowledge in the EM M4 clerkship curriculum. Development and initial performance data were described previously.

OBJECTIVE

To provide updated V1 performance data, describe development and revision of V2, and to compare performance between academic years and examination forms, and within academic years.

METHODS

Examinations are administered at www.saemtests.org with ongoing performance data provided. After 1 year of use, nine questions on V2 were revised, five because of low discriminatory ability and four because of excessive difficulty. Revision or replacement was done in accordance with the National Board of Medical Examiners (NBME) Item Writing Guidelines. Mean scores were compared for V1 between academic years (i.e., July 2011-June 2012 vs. July 2012-June 2013), V2 compared with V1, and for each examination version for early and late test takers.

RESULTS

V1 has been administered >10,000 times since its release, and the current form mean is 81.5% (SD 3.7). Average discriminatory value (rpb) is 0.204. V2 has been administered >1500 times, with a mean score of 78.4% (SD 4.4) and average rpb 0.253. V1 and V2 current means differ statistically. Scores from examinees completing V1 or V2 early vs. late in the academic year differ statistically.

CONCLUSIONS

Performance data for V1 remain stable after 2 years. Revisions of poorly performing questions improved question performance on V2. Questions with low rpb or low pdiff will continue to be revised annually. While examination forms differ statistically, the practical utility of the differences is not defined.

Implementing a third-year emergency medicine medical student curriculum

BACKGROUND

Emergency medicine (EM) is commonly introduced in the fourth year of medical school because of a perceived need to have more experienced students in the complex and dynamic environment of the emergency department. However, there is no evidence supporting the optimal time or duration for an EM rotation, and a number of institutions offer third-year rotations.

OBJECTIVE

A recently published syllabus provides areas of knowledge, skills, and attitudes that third-year EM rotation directors can use to develop curricula. This article expands on that syllabus by providing a comprehensive curricular guide for the third-year medical student rotation with a focus on implementation.

DISCUSSION

Included are consensus-derived learning objectives, discussion of educational methods, considerations for implementation, and information on feedback and evaluation as proposed by the Clerkship Directors in Emergency Medicine Third-Year Curriculum Work Group. External validation results, derived from a survey of third-year rotation directors, are provided in the form of a content validity index for each content area.

CONCLUSIONS

This consensus-derived curricular guide can be used by faculty who are developing or revising a third-year EM medical student rotation and provide guidance for implementing this curriculum at their institution.

Correlation of the NBME advanced clinical examination in EM and the national EM M4 exams

Introduction

Since 2011 two online, validated exams for fourth-year emergency medicine (EM) students have been available (National EM M4 Exams). In 2013 the National Board of Medical Examiners offered the Advanced Clinical Examination in Emergency Medicine (EM-ACE). All of these exams are now in widespread use; however, there are no data on how they correlate. This study evaluated the correlation between the EM-ACE exam and the National EM M4 Exams.

Methods

From May 2013 to April 2014 the EM-ACE and one version of the EM M4 exam were administered sequentially to fourth-year EM students at five U.S. medical schools. Data collected included institution, gross and scaled scores and version of the EM M4 exam. We performed Pearson’s correlation and random effects linear regression.

Results

303 students took the EM-ACE and versions 1 (V1) or 2 (V2) of the EM M4 exams (279 and 24, respectively). The mean percent correct for the exams were as follows: EM-ACE 74.8 (SD-8.83), V1 83.0 (SD-6.41), V2 78.5 (SD-7.70). Pearson’s correlation coefficient for the V1/EM-ACE was 0.51 (0.42 scaled) and for the V2/EM-ACE was 0.59 (0.41 scaled). The coefficient of determination for V1/EM-ACE was 0.72 and for V2/EM-ACE = 0.71 (0.86 and 0.49 for scaled scores). The R-squared values were 0.25 and 0.30 (0.18 and 0.13, scaled), respectively. There was significant cluster effect by institution.

Conclusion

There was moderate positive correlation of student scores on the EM-ACE exam and the National EM M4 Exams.

Objective structured clinical examinations provide valid clinical skills assessment in emergency medicine education

INTRODUCTION

Evaluation of emergency medicine (EM) learners based on observed performance in the emergency department (ED) is limited by factors such as reproducibility and patient safety. EM educators depend on standardized and reproducible assessments such as the objective structured clinical examination (OSCE). The validity of the OSCE as an evaluation tool in EM education has not been previously studied. The objective was to assess the validity of a novel management-focused OSCE as an evaluation instrument in EM education through demonstration of performance correlation with established assessment methods and case item analysis.

METHODS

We conducted a prospective cohort study of fourth-year medical students enrolled in a required EM clerkship. Students enrolled in the clerkship completed a five-station EM OSCE. We used Pearson's coefficient to correlate OSCE performance with performance in the ED based on completed faculty evaluations. Indices of difficulty and discrimination were computed for each scoring item.

RESULTS

We found a moderate and statistically-significant correlation between OSCE score and ED performance score [r(239) =0.40, p<0.001]. Of the 34 OSCE testing items the mean index of difficulty was 63.0 (SD =23.0) and the mean index of discrimination was 0.52 (SD =0.21).

CONCLUSION

Student performance on the OSCE correlated with their observed performance in the ED, and indices of difficulty and differentiation demonstrated alignment with published best-practice testing standards. This evidence, along with other attributes of the OSCE, attest to its validity. Our OSCE can be further improved by modifying testing items that performed poorly and by examining and maximizing the inter-rater reliability of our evaluation instrument.

Consensus development of a pediatric emergency medicine clerkship curriculum

INTRODUCTION

As emergency medicine (EM) has become a more prominent feature in the clinical years of medical school training, national EM clerkship curricula have been published to address the need to standardize students' experiences in the field. However, current national student curricula in EM do not include core pediatric emergency medicine (PEM) concepts.

METHODS

A workgroup was formed by the Clerkship Directors in Emergency Medicine and the Pediatric Interest Group of the Society of Academic Emergency Medicine to develop a consensus on the content to be covered in EM and PEM student courses.

RESULTS

The consensus is presented with the goal of outlining principles of pediatric emergency care and prioritizing students' exposure to the most common and life-threatening illnesses and injuries.

CONCLUSION

This consensus curriculum can serve as a guide to directors of PEM and EM courses to optimize PEM knowledge and skills education.

Medical student education in emergency medicine: do students meet the national standards for clinical encounters of selected core conditions?

BACKGROUND

Establishing a core curriculum for undergraduate Emergency Medicine (EM) education is crucial to development of the specialty. The Clerkship Directors in Emergency Medicine (CDEM) National Curriculum Task Force recommended that all students in a 4(th)-year EM clerkship be exposed to 10 emergent clinical conditions.

OBJECTIVES

To evaluate the feasibility of encountering recommended core conditions in a clinical setting during a 4(th)-year EM clerkship.

METHODS

Students from three institutions participated in this ongoing, prospective observation study. Students' patient logs were collected during 4-week EM clerkships between July 2011 and June 2012. De-identified logs were reviewed and the number of patient encounters for each of the CDEM-identified emergent conditions was recorded. The percentage of students who saw each of the core complaints was calculated, as was the average number of core complaints seen by each.

RESULTS

Data from 130 students at three institutions were captured; 15.4% of students saw all 10 conditions during their rotation, and 76.9% saw at least eight. The average number of conditions seen per student was 8.4 (range of 7.0-8.6). The percentage of students who saw each condition varied, ranging from 100% (chest pain and abdominal pain) to 31% (cardiac arrest).

CONCLUSIONS

Most students do not encounter all 10 conditions during patient encounters throughout a 4-week EM rotation, although most have exposure to at least eight. Certain conditions are far less likely than others to be encountered, and may need to be taught in a nonclinical setting.

Creation and implementation of a national emergency medicine fourth-year student examination

BACKGROUND

A National Board of Medical Examiners examination does not exist for Emergency Medicine (EM) students. To fill this void, the Clerkship Directors in Emergency Medicine tasked a committee with development of an examination for 4th-year (M4) EM students, based on a published syllabus, and consisting of questions written according to published question-writing guidelines.

STUDY OBJECTIVES

Describe examination development and statistics at 9 months.

METHODS

The committee reviewed an existing EM student question database at www.saemtests.org for statistical performance, compliance with item-writing guidelines, and topic inclusion within the published EM M4 syllabus. For syllabus topics without existing questions, committee members wrote new items. LXR 6.0 software (Applied Measurement Professionals, Inc., Georgetown, SC) was used for examination administration. Data gathered included numbers of examinations completed, mean scores with SD, and point biserial correlation (rpb).

RESULTS

Of the 553 questions assessed, 157 questions met the stated criteria, and 37 were included in the examination. Thirteen new questions were written by committee members to cover all curriculum topics. The National EM M4 Examination was released online August 1, 2011. Nine months later, the examination had been completed 1642 times by students from 27 clerkships. Mean score was 79.69% (SD 3.89). Individual question difficulties ranged from 26% to 99%. Question rpbs ranged from 0.067 to 0.353, mean 0.213 (SD 0.066).

CONCLUSIONS

A national group of EM educators developed an examination to assess a published clerkship syllabus. The examination contains questions written according to published item-writing guidelines, and exhibits content validity, appropriate difficulty levels, and adequate question discriminatory ability.