1
|
Kumar S, Jensen EH, Watts S, Parsa M. Assessing Individual Competency Differences Between Third- and Fourth-Year Medical Students Using the National Clinical Assessment Tool for Medical Students in the Emergency Department. Cureus 2024; 16:e56486. [PMID: 38638768 PMCID: PMC11024878 DOI: 10.7759/cureus.56486] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 03/19/2024] [Indexed: 04/20/2024] Open
Abstract
Medical students rotating through emergency departments as part of their clinical education are typically evaluated using an on-shift evaluation tool. The National Clinical Assessment Tool for Medical Students in the Emergency Department (NCAT-EM) is the current standard of evaluation for medical students in the emergency department, regardless of level of training. This study aims to evaluate whether the NCAT-EM can detect differences in skill levels between third-year medical students (MS3s) and fourth-year medical students (MS4s) rotating at a level 1 trauma center and teaching institution. These authors hypothesized that MS4s should outperform MS3s across all assessment domains given their additional training. A total of 930 performance evaluations were gathered for MS3 and MS4 rotating between May 2022 and June 2023. There were 321 evaluations of MS3s and 609 evaluations of MS4s. Across the six assessment domains, MS4s had statistically significant higher performances in two domains - namely emergency recognition and management (fully entrustable: 37.4% vs. 23.8% (p = 0.03)) and communication (fully entrustable: 46.2% vs. 33.6% (p = 0.03)). These findings indicate that the use of the NCAT-EM at this institution reliably differentiated between MS3s and MS4s in these two assessment domains. There were trends suggesting MS4s outperform MS3s in the other four domains, which did not rise to the level of statistical significance, but are consistent with prior validation studies of the NCAT.
Collapse
Affiliation(s)
- Siddhant Kumar
- Emergency Medicine, Texas Tech University Health Sciences Center El Paso, El Paso, USA
| | - Elizabeth H Jensen
- Emergency Medicine, Texas Tech University Health Sciences Center El Paso, El Paso, USA
| | - Susan Watts
- Emergency Medicine, Texas Tech University Health Sciences Center El Paso, El Paso, USA
| | - Michael Parsa
- Emergency Medicine, Texas Tech University Health Sciences Center El Paso, El Paso, USA
| |
Collapse
|
2
|
Cevik AA, Cakal ED, Alao D, Elzubeir M, Shaban S, Abu-Zidan F. Self-efficacy beliefs and expectations during an Emergency Medicine Clerkship. Int J Emerg Med 2022; 15:4. [PMID: 35065608 PMCID: PMC8903584 DOI: 10.1186/s12245-021-00406-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Accepted: 12/27/2021] [Indexed: 11/30/2022] Open
Abstract
Background Undergraduate emergency medicine (EM) training is important because all medical graduates are expected to have basic emergency knowledge and skills regardless of their future speciality. EM clerkship should provide opportunities to improve not only knowledge and skills but also the self-efficacy of learners. This study aims to evaluate the expectations, opinions, and self-efficacy beliefs of medical students during a 4-week mandatory EM clerkship. Methods This study used a prospective longitudinal design with quantitative and qualitative survey methods. It includes final year medical students of the 2015–2016 academic year. Voluntary de-identified pre- and post-clerkship surveys included 25 statements. The post-clerkship survey included two open-ended questions asking participants to identify the best and worst three aspects of EM clerkship. Responses were analysed to determine themes or commonalities in participant comments indicative of the EM clerkship learning experiences and environment. Results Sixty-seven out of seventy-nine (85%) students responded to both pre- and post-clerkship surveys. Medical students’ expectations of EM clerkships’ effect on knowledge and skill acquisition were high, and a 4-week mandatory EM clerkship was able to meet their expectations. Medical students had very high expectations of EM clerkships’ educational environment. In most aspects, their experiences significantly exceeded their expectations (p value < 0.001). The only exception was the duration of clerkship, which was deemed insufficient both at the beginning and at the end (p value: 0.92). The students perceived that their self-efficacy improved significantly in the majority of basic EM skills and procedures (p value < 0.001). Emergent qualitative themes in the study also supported these results. Conclusion This study showed that a 4-week mandatory EM clerkship increased medical students' perceived self-efficacy in basic emergency management skills. The EM clerkship met students' expectations on knowledge and skill acquisition, and exceeded students’ expectations on educational environment.
Collapse
|
3
|
Ren R, Parekh K, Franzen D, Estes M, Camejo M, Olaf M, Zhang XC. Emergency medicine clerkship director experience adapting emergency remote learning during the onset of COVID-19 pandemic. AEM EDUCATION AND TRAINING 2021; 5:e10594. [PMID: 33786410 PMCID: PMC7994998 DOI: 10.1002/aet2.10594] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Revised: 02/12/2021] [Accepted: 02/28/2021] [Indexed: 06/12/2023]
Abstract
OBJECTIVES The recent outbreak of the COVID-19 altered the traditional paradigm of clinical medical education. While individual clerkships have shared their curricular adaptations via social and academic networking media, there is currently no organizational standard in establishing a nonclinical, emergency medicine (EM) virtual rotation (VR). The primary objective of this study was to describe EM clerkship directors' (CDs) perspectives on their experience adapting an EM VR curriculum during the onset of the COVID-19 pandemic. METHODS A 21-item survey with quantitative and qualitative questions was disseminated between June and August 2020 to EM CDs via the Clerkship Director of Emergency Medicine Listserv to describe their experience and perspectives in adapting a VR during spring 2020. RESULTS We analyzed 59 of 77 EM clerkship survey responses. Among respondents, 52% adapted a VR while 47.5% did not. Of those who adapted a VR, 71% of CDs had 2 weeks or less to develop the new curriculum, with 84% reporting usual or increased clinical load during that time. Clerkships significantly diversified their asynchronous educational content and utilized several instructional models to substitute the loss of clinical experience. Reflecting on the experience, 71% of CDs did not feel comfortable writing a standardized letter of evaluation for students based on the VR, with the majority citing inability to evaluate students' competencies in a clinical context. CONCLUSION A crisis such as COVID-19 necessitates change in all facets of medical education. While EM educators demonstrated the ability to create emergency remote learning with limited time, this was not equivalent to the formal development of preplanned VR experiences. Future faculty development and curriculum innovation are required to fully transition an in-person immersive experience to a noninferior virtual experience.
Collapse
Affiliation(s)
- Ronnie Ren
- Department of Emergency MedicineUniversity of Massachusetts Medical SchoolWorcesterMassachusettsUSA
| | - Kendra Parekh
- Department of Emergency MedicineVanderbilt UniversityNashvilleTennesseeUSA
| | - Doug Franzen
- Department of Emergency MedicineUniversity of WashingtonSeattleWashingtonUSA
| | - Molly Estes
- Department of Emergency MedicineLoma Linda UniversityLoma LindaCaliforniaUSA
| | - Melanie Camejo
- Department of Emergency MedicineUniversity of Missouri–Kansas CityKansas CityMissouriUSA
| | - Mark Olaf
- Department of Emergency MedicineGeisinger Commonwealth School of MedicineDanvillePennsylvaniaUSA
| | - Xiao Chi Zhang
- Department of Emergency MedicineThomas Jefferson UniversityPhiladelphiaPennsylvaniaUSA
| |
Collapse
|
4
|
Rudolf F, Oyama LC, Schwartz K, Fernandez JA, Hayden SR. Teaching Rapid Assessment Skills in Triage for the Emergency Medicine Clerkship. J Emerg Med 2021; 61:76-81. [PMID: 33789821 DOI: 10.1016/j.jemermed.2021.02.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 01/04/2021] [Accepted: 02/06/2021] [Indexed: 10/21/2022]
Abstract
BACKGROUND Rapidly assessing an undifferentiated patient and developing a gestalt for "sick vs. not sick" is a core component of emergency medicine (EM). Developing this skill requires clinical experience and pattern recognition, which can be difficult to attain during a typical EM clerkship. OBJECTIVE We developed a novel approach to teaching medical students rapid assessment skills in the emergency department (ED) by implementing a teaching shift in triage. METHODS Fourth-year medical students in our EM clerkship in fall 2019 were scheduled one shift in triage with a dedicated teaching attending. The students evaluated patients under direct supervision, discussed their immediate differential diagnosis, and proposed an initial workup. The attending gave real-time feedback using a standardized direct observation tool. Students completed an electronic pre and post survey (5-point Likert scale) to assess their comfort level in the following areas: performing a rapid triage assessment, determining "sick vs. not sick", performing a focused physical examination, developing a targeted differential diagnosis, and ordering an initial diagnostic workup. RESULTS Twenty-one students participated in the triage shifts. There was a significant improvement in self-assessed comfort with performing a rapid triage assessment, mean pre 2.76 and post 4.43 (p < 0.0001). There were also significant improvements in the four other survey areas (p < 0.004 or less). CONCLUSIONS A teaching shift in triage can increase medical students' self-assessed rapid assessment skills for patients in the ED. Benefits to the teaching attending included the opportunity to perform direct observation, give real-time feedback, and identify real-time teaching moments.
Collapse
Affiliation(s)
- Frances Rudolf
- Department of Emergency Medicine, University of California San Diego, San Diego, California
| | - Leslie C Oyama
- Department of Emergency Medicine, University of California San Diego, San Diego, California
| | - Kristy Schwartz
- Department of Emergency Medicine, University of California San Diego, San Diego, California
| | - Jorge A Fernandez
- Department of Emergency Medicine, University of California San Diego, San Diego, California
| | - Stephen R Hayden
- Department of Emergency Medicine, University of California San Diego, San Diego, California
| |
Collapse
|
5
|
A mandatory Emergency Medicine clerkship influences students' career choices in a developing system. Afr J Emerg Med 2021; 11:70-73. [PMID: 33680724 PMCID: PMC7910188 DOI: 10.1016/j.afjem.2020.08.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2020] [Revised: 07/29/2020] [Accepted: 08/09/2020] [Indexed: 11/21/2022] Open
Abstract
BACKGROUND Attracting medical students for a front-line specialty, Emergency Medicine, is challenging in many countries. The available literature is scarce and bounded to the mature emergency care and education systems. In the countries where emergency medicine is a new specialty and has different contextual needs, the perception of the students and their career interest in emergency medicine specialty is an unanswered question. OBJECTIVE We aimed to study the effects of a mandatory Emergency Medicine (EM) clerkship on students' perceptions and their future career choice to be emergency physicians. METHODS A voluntary de-identified survey was prospectively collected before and after the EM clerkship to capture students' perceptions in four domains (EM clerkship, EM physicians, EM patients, and EM specialty as a career choice). The survey included 24 statements having five-point Likert scale for each statement. Non-parametric Wilcoxon signed rank test was used for statistical analysis. RESULTS Sixty-seven students responded to both surveys (response rate of 85%). Students' perceptions have significantly improved on the EM physicians, and their job after attending the clerkship (p < 0.001). They found EM a respected (p = 0.038), flexible (p < 0.001), secure (p < 0.001), satisfying, and prestigious (p = 0.006) job. They found EM physicians compassionate (p < 0.011), have adequate patient contact (p < 0.045) and control on their time (0.004). Choosing EM as a future career has significantly increased after clerkship (p < 0.001). CONCLUSIONS Our mandatory EM clerkship significantly improved students' perceptions on EM specialty as a future career choice. A well-structured and mandatory EM clerkship can attract more students to be trained in the EM.
Collapse
|
6
|
Offenbacher J, Petti A, Xu H, Levine M, Manyapu M, Guha D, Quint M, Chertoff A, Restivo A, Friedman BW, Silverberg J. Learning Outcomes of High-fidelity versus Table-Top Simulation in Undergraduate Emergency Medicine Education: Prospective, Randomized, Crossover-Controlled Study. West J Emerg Med 2021; 23:20-25. [PMID: 35060855 PMCID: PMC8782127 DOI: 10.5811/westjem.2021.12.53926] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 12/04/2021] [Indexed: 11/11/2022] Open
Abstract
INTRODUCTION Over the last several decades simulation, in both graduate and undergraduate emergency medicine education, has continued to develop as a leading and highly effective teaching modality. Limited research exists to evaluate the efficacy of low-fidelity (table-top) simulation, as compared to high-fidelity standards, as it relates to medical knowledge learning outcomes. We sought to assess the efficacy of a low-fidelity simulation modality in undergraduate emergency medicine education, based on quantitative medical knowledge learning outcomes. METHODS A prospective, randomized, crossover-control study comparing objective medical knowledge learning outcomes between simulation modalities. Analysis was designed to evaluate for the statistical equivalence of learning outcomes between the two cohorts. This was done by comparing a calculated 95% confidence interval (CI) around the mean difference in post-test scores, between experimental and control modalities, to a pre-established equivalence margin. RESULTS Primary outcomes evaluating student performance on post-test examinations demonstrated a total cohort CI (95% CI, -0.22 and 0.68). Additional course-subject subgroup analysis demonstrated non-inferior CIs with: Shortness of Breath (95% CI, -0.35 and 1.27); Chest Pain (95% CI, -0.53 and.94); Abdominal Pain (95% CI, -0.88 and 1.17); Cardiovascular Shock (95% CI, -0.04 and 1.29). Secondary outcome analysis was done to evaluate medical knowledge acquisition by comparing the difference in pre and post-test examination between the cohorts. CI of the full cohort ranged from (95% CI, -0.14 and 0.96). CONCLUSION The student's performance on quantitative medical-knowledge assessment was equivalent between the high-fidelity control and low-fidelity experimental simulation groups. Analysis of knowledge acquisition between the two groups also demonstrated statistical equivalence.
Collapse
Affiliation(s)
- Joseph Offenbacher
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Alexander Petti
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Han Xu
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Michael Levine
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Mallika Manyapu
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Debayan Guha
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Maxim Quint
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Andrew Chertoff
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Andrew Restivo
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Benjamin W Friedman
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| | - Joshua Silverberg
- Albert Einstein College of Medicine, Department of Emergency Medicine at the Jacobi and Montefiore Hospitals, Bronx, New York
| |
Collapse
|
7
|
Burkhardt J, DesJardins S, Gruppen L. Diversity in Emergency Medicine: Are We Supporting a Career Interest in Emergency Medicine for Everyone? Ann Emerg Med 2019; 74:742-750. [PMID: 31229390 DOI: 10.1016/j.annemergmed.2019.04.008] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2018] [Revised: 03/26/2019] [Accepted: 04/08/2019] [Indexed: 11/18/2022]
Abstract
STUDY OBJECTIVE Women and students underrepresented in medicine are less likely to apply for residency in emergency medicine. The latter are from racial or ethnic populations that are underrepresented as physicians relative to the general population. The factors that result in lower application rates from women and groups underrepresented in medicine are inadequately described in the literature. This study's objective was to test whether female students and those underrepresented in medicine have lower interest in emergency medicine even after controlling for academic ability, student indebtedness, and common career values consistent with emergency medicine career interest. METHODS Secondary data analyses were conducted on a cross section of all residency applicants from 2005 to 2010. Data sources included American Medical College Application Service, the Electronic Residency Application Service, and the Graduating Questionnaire. Data linkage was by the Association of American Medical Colleges and provided deidentified to the authors. A binary logistic regression model was fitted with the outcome variable planned career into emergency medicine versus another specialty on the Graduating Questionnaire. The binary logistic regression model independent variables included demographics, student attitudes, debt, grade point average, standardized tests, and medical school experiences. RESULTS The binary logistic regression model included 17,067 individuals. Being a woman (odds ratio 0.75) and from a background underrepresented in medicine (odds ratio 0.68) independently correlated with lower emergency medicine interest. Age, medical debt, importance of work-life balance, confidence in specialty choice, and plan to care for underserved populations were positively associated with emergency medicine interest. Importance of specialty competitiveness and importance of mentorship advice were correlated with lower emergency medicine interest. CONCLUSION Female medical students and those underrepresented in medicine were less likely to plan for a career in emergency medicine. This correlation remained significant even when other previously identified factors that have predicted a career in emergency medicine were controlled for.
Collapse
Affiliation(s)
- John Burkhardt
- Department of Emergency Medicine, University of Michigan Medical School, Ann Arbor, MI; Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI.
| | - Stephen DesJardins
- School of Education Center for the Study of Higher and Postsecondary Education, University of Michigan, Ann Arbor, MI
| | - Larry Gruppen
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI
| |
Collapse
|
8
|
Warrington S, Beeson M, Bradford A. Inter-rater Agreement of End-of-shift Evaluations Based on a Single Encounter. West J Emerg Med 2017; 18:518-524. [PMID: 28435505 PMCID: PMC5391904 DOI: 10.5811/westjem.2016.12.32014] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2016] [Revised: 12/14/2016] [Accepted: 12/30/2016] [Indexed: 11/11/2022] Open
Abstract
INTRODUCTION End-of-shift evaluation (ESE) forms, also known as daily encounter cards, represent a subset of encounter-based assessment forms. Encounter cards have become prevalent for formative evaluation, with some suggesting a potential for summative evaluation. Our objective was to evaluate the inter-rater agreement of ESE forms using a single scripted encounter at a conference of emergency medicine (EM) educators. METHODS Following institutional review board exemption, we created a scripted video simulating an encounter between an intern and a patient with an ankle injury. That video was shown during a lecture at the Council of EM Residency Director's Academic Assembly with attendees asked to evaluate the "resident" using one of eight possible ESE forms randomly distributed. Descriptive statistics were used to analyze the results with Fleiss' kappa to evaluate inter-rater agreement. RESULTS Most of the 324 respondents were leadership in residency programs (66%), with a range of 29-47 responses per evaluation form. Few individuals (5%) felt they were experts in assessing residents based on EM milestones. Fleiss' kappa ranged from 0.157 - 0.308 and did not perform much better in two post-hoc subgroup analyses. CONCLUSION The kappa ranges found show only slight to fair inter-rater agreement and raise concerns about the use of ESE forms in assessment of EM residents. Despite limitations present in this study, these results and a lack of other studies on inter-rater agreement of encounter cards should prompt further studies of such methods of assessment. Additionally, EM educators should focus research on methods to improve inter-rater agreement of ESE forms or other evaluating other methods of assessment of EM residents.
Collapse
Affiliation(s)
- Steven Warrington
- Kaweah Delta Medical Center, Department of Emergency Medicine, Visalia, California
| | - Michael Beeson
- Akron General Medical Center, Department of Emergency Medicine, Akron, Ohio
| | - Amber Bradford
- Akron General Medical Center, Department of Emergency Medicine, Akron, Ohio
| |
Collapse
|
9
|
Conner BJ, Behar-Horenstein LS, Su Y. Comparison of Two Clinical Teaching Models for Veterinary Emergency and Critical Care Instruction. JOURNAL OF VETERINARY MEDICAL EDUCATION 2016; 43:58-63. [PMID: 26751912 DOI: 10.3138/jvme.0415-069r1] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Standards to oversee the implementation and assessment of clinical teaching of emergency and critical care for veterinary students do not exist. The purpose of this study was to assess differences in the learning environment between two veterinary emergency and critical care clinical rotations (one required, one elective) with respect to caseload, technical/procedural opportunities, direct faculty contact time, client communication opportunities, and students' perception of practice readiness. The authors designed a 22-item survey to assess differences in the learning environment between the two rotations. It was sent electronically to 35 third- and fourth-year veterinary medicine students. Bivariate analysis, including the Wilcoxon signed-rank test and the t-test, were used to compare differences between pre-test and post-test scores among students. Twenty-six students' responses were included from the required rotation and nine from the elective rotation. Findings showed that students preferred the elective community emergency department setting to the required academic setting and that there were statistically significantly more positive experiences related to the variables of interest. Students saw significantly more cases at the community emergency department setting. Findings from this study offer guidance to assess students' emergency department rotations, suggest how teaching interactions can be modified for optimal learning experiences, and ensure that students receive maximal opportunities to treat patients that are representative of what they would encounter in practice.
Collapse
|
10
|
Lawson LE, Musick D, Brewer K. Correlation of the National Emergency Medicine M4 Clerkship Examination with USMLE Examination Performance. West J Emerg Med 2015; 16:1159-65. [PMID: 26759671 PMCID: PMC4703161 DOI: 10.5811/westjem.2015.10.25496] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2015] [Revised: 09/17/2015] [Accepted: 09/23/2015] [Indexed: 11/25/2022] Open
Abstract
Introduction Assessment of medical students’ knowledge in clinical settings is complex yet essential to the learning process. Clinical clerkships use various types of written examinations to objectively test medical knowledge within a given discipline. Within emergency medicine (EM), a new national standardized exam was developed to test medical knowledge in this specialty. Evaluation of the psychometric properties of a new examination is an important issue to address during test development and use. Studies have shown that student performance on selected standardized exams will reveal students’ strengths and/or weaknesses, so that effective remedial efforts can be implemented. Our study sought to address these issues by examining the association of scores on the new EM national exam with other standardized exam scores. Methods From August 2011 to April 2013, average National EM M4 examination scores of fourth-year medical students taken at the end of a required EM clerkship were compiled. We examined the correlation of the National EM M4 examination with the scores of initial attempts of the United States Medical Licensing Exam (USMLE) Step 1 and Step 2 Clinical Knowledge (CK) examinations. Correlation coefficients and 95% confidence intervals of correlation coefficients are reported. We also examined the association between the national EM M4 examination score, final grades for the EM rotation, and USMLE Step 1 and Step 2 CK scores. Results 133 students were included in the study and achieved a mean score of 79.5 SD 8.0 on the National EM M4 exam compared to a national mean of 79.7 SD 3.89. The mean USMLE Step 1 score was 226.8 SD 19.3. The mean USMLE Step 2 CK score was 238.5 SD 18.9. National EM M4 examination scores showed moderate correlation with both USMLE Step 1 (mean score=226.8; correlation coefficient=0.50; 95% CI [0.28–0.67]) and USMLE Step 2 CK (mean score=238.5; correlation coefficient=0.47; 95% CI [0.25–0.65]). Students scoring below the median on the national EM M4 exam also scored well below their colleagues on USMLE exams. Conclusion The moderate correlation of the national EM M4 examination and USMLE Step 1 and Step 2 CK scores provides support for the utilization of the CDEM National EM M4 examination as an effective means of assessing medical knowledge for fourth-year medical students. Identification of students scoring lower on standardized exams allows for effective remedial efforts to be undertaken throughout the medical education process.
Collapse
Affiliation(s)
- Luan E Lawson
- East Carolina University, Brody School of Medicine, Department of Emergency Medicine, Greenville, North Carolina; East Carolina University, Brody School of Medicine, Department of Medical Education, Greenville, North Carolina
| | - Davis Musick
- Virginia Tech Carillion School of Medicine, Department of Internal Medicine, Roanoke, Virginia
| | - Kori Brewer
- East Carolina University, Brody School of Medicine, Department of Emergency Medicine, Greenville, North Carolina
| |
Collapse
|
11
|
Kiefer C, Turner JS, Layman SM, Davis SM, Besinger BR, Humbert A. Introducing Medical Students into the Emergency Department: The Impact upon Patient Satisfaction. West J Emerg Med 2015; 16:894-8. [PMID: 26594286 PMCID: PMC4651590 DOI: 10.5811/westjem.2015.9.27255] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2015] [Revised: 09/04/2015] [Accepted: 09/26/2015] [Indexed: 11/26/2022] Open
Abstract
Introduction Performance on patient satisfaction surveys is becoming increasingly important for practicing emergency physicians and the introduction of learners into a new clinical environment may impact such scores. This study aimed to quantify the impact of introducing fourth-year medical students on patient satisfaction in two university-affiliated community emergency departments (EDs). Methods Two community-based EDs in the Indiana University Health (IUH) system began hosting medical students in March 2011 and October 2013, respectively. We analyzed responses from patient satisfaction surveys at each site for seven months before and after the introduction of students. Two components of the survey, “Would you recommend this ED to your friends and family?” and “How would you rate this facility overall?” were selected for analysis, as they represent the primary questions reviewed by the Center for Medicare Services (CMS) as part of value-based purchasing. We evaluated the percentage of positive responses for adult, pediatric, and all patients combined. Results Analysis did not reveal a statistically significant difference in the percentage of positive response for the “would you recommend” question at both clinical sites with regards to the adult and pediatric subgroups, as well as the all-patient group. At one of the sites, there was significant improvement in the percentage of positive response to the “overall rating” question following the introduction of medical students when all patients were analyzed (60.3% to 68.2%, p=0.038). However, there was no statistically significant difference in the “overall rating” when the pediatric or adult subgroups were analyzed at this site and no significant difference was observed in any group at the second site. Conclusion The introduction of medical students in two community-based EDs is not associated with a statistically significant difference in overall patient satisfaction, but was associated with a significant positive effect on the overall rating of the ED at one of the two clinical sites studied. Further study is needed to evaluate the effect of medical student learners upon patient satisfaction in settings outside of a single health system.
Collapse
Affiliation(s)
- Christopher Kiefer
- West Virginia University School of Medicine, Department of Emergency Medicine, Morgantown, West Virginia
| | - Joseph S Turner
- Indiana University School of Medicine, Department of Emergency Medicine, Indianapolis, Indiana
| | - Shelley M Layman
- West Virginia University School of Medicine, Department of Emergency Medicine, Morgantown, West Virginia
| | - Stephen M Davis
- West Virginia University School of Medicine, Department of Emergency Medicine, Morgantown, West Virginia
| | - Bart R Besinger
- Indiana University School of Medicine, Department of Emergency Medicine, Indianapolis, Indiana
| | - Aloysius Humbert
- Indiana University School of Medicine, Department of Emergency Medicine, Indianapolis, Indiana
| |
Collapse
|
12
|
Wald DA, Khandelwal S, Manthey DE, Way DP, Ander DS, Thibodeau L. Emergency medicine clerkship directors: current workforce. West J Emerg Med 2015; 15:398-403. [PMID: 25035743 PMCID: PMC4100843 DOI: 10.5811/westjem.2014.1.20013] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2013] [Revised: 11/06/2013] [Accepted: 01/27/2014] [Indexed: 11/30/2022] Open
Abstract
Introduction The emergency medicine clerkship director serves an important role in the education of medical students. The authors sought to update the demographic and academic profile of the emergency medicine clerkship director. Methods We developed and implemented a comprehensive questionnaire, and used it to survey all emergency medicine clerkship directors at United States allopathic medical schools accredited by the Liaison Committee on Medical Education. We analyzed and interpreted data using descriptive statistics. Results One hundred seven of 133 (80.4%) emergency medicine clerkship directors completed the survey. Clerkship Director’s mean age was 39.7 years (SD-7.2), they were more commonly male 68.2%, of Caucasian racial backgrounds and at the instructor or assistant professor (71.3%) level. The mean number of years of experience as clerkship director was 5.5 (SD-4.5). The mean amount of protected time for clerkship administration reported by respondents was 7.3 hours weekly (SD-5.1), with the majority (53.8%) reporting 6 or more hours of protected time per week. However, 32.7% of emergency medicine clerkship directors reported not having any protected time for clerkship administration. Most clerkship directors (91.6%) held additional teaching responsibilities beyond their clerkship and many were involved in educational research (49.5%). The majority (79.8%), reported being somewhat or very satisfied with their job as clerkship director. Conclusion Most clerkship directors were junior faculty at the instructor or assistant professor rank and were involved with a variety of educational endeavors beyond the clerkship.
Collapse
Affiliation(s)
- David A Wald
- Temple University School of Medicine, Department of Emergency Medicine, Philadelphia, Pennsylvania
| | - Sorabh Khandelwal
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| | - David E Manthey
- Wake Forest University School of Medicine, Department of Emergency Medicine, Winston-Salem, North Carolina
| | - David P Way
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| | - Douglas S Ander
- Emory University School of Medicine, Department of Emergency Medicine, Atlanta, Georgia
| | - Lorraine Thibodeau
- Albany Medical Center, Department of Emergency Medicine, Albany, New York
| |
Collapse
|
13
|
Bernard AW, Martin DR, Moseley MG, Kman NE, Khandelwal S, Carpenter D, Way DP, Caterino JM. The Impact of Medical Student Participation in Emergency Medicine Patient Care on Departmental Press Ganey Scores. West J Emerg Med 2015; 16:830-8. [PMID: 26594274 PMCID: PMC4651578 DOI: 10.5811/westjem.2015.9.27321] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2015] [Revised: 09/16/2015] [Accepted: 09/26/2015] [Indexed: 11/23/2022] Open
Abstract
Introduction Press Ganey (PG) scores are used by public entities to gauge the quality of patient care from medical facilities in the United States. Academic health centers (AHCs) are charged with educating the new generation of doctors, but rely heavily on PG scores for their business operation. AHCs need to know what impact medical student involvement has on patient care and their PG scores. Purpose We sought to identify the impact students have on emergency department (ED) PG scores related to overall visit and the treating physician’s performance. Methods This was a retrospective, observational cohort study of discharged ED patients who completed PG satisfaction surveys at one academic, and one community-based ED. Outcomes were responses to questions about the overall visit assessment and doctor’s care, measured on a five-point scale. We compared the distribution of responses for each question through proportions with 95% confidence intervals (CIs) stratified by medical student participation. For each question, we constructed a multivariable ordinal logistic regression model including medical student involvement and other independent variables known to affect PG scores. Results We analyzed 2,753 encounters, of which 259 (9.4%) had medical student involvement. For all questions, there were no appreciable differences in patient responses when stratifying by medical student involvement. In regression models, medical student involvement was not associated with PG score for any outcome, including overall rating of care (odds ratio [OR] 1.10, 95% CI [0.90–1.34]) or likelihood of recommending our EDs (OR 1.07, 95% CI [0.86–1.32]). Findings were similar when each ED was analyzed individually. Conclusion We found that medical student involvement in patient care did not adversely impact ED PG scores in discharged patients. Neither overall scores nor physician-specific scores were impacted. Results were similar at both the academic medical center and the community teaching hospital at our institution.
Collapse
Affiliation(s)
- Aaron W Bernard
- Quinnipiac University, Frank H. Netter MD School of Medicine, Hamden, Connecticut
| | - Daniel R Martin
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| | - Mark G Moseley
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| | - Nicholas E Kman
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| | - Sorabh Khandelwal
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| | - Daniel Carpenter
- Ohio State University, Department of Biomedical Informatics, Columbus, Ohio
| | - David P Way
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| | - Jeffrey M Caterino
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| |
Collapse
|
14
|
Hiller K, Miller ES, Lawson L, Wald D, Beeson M, Heitz C, Morrissey T, House J, Poznanski S. Correlation of the NBME advanced clinical examination in EM and the national EM M4 exams. West J Emerg Med 2015; 16:138-42. [PMID: 25671023 PMCID: PMC4307698 DOI: 10.5811/westjem.2014.11.24189] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2014] [Revised: 11/14/2014] [Accepted: 11/18/2014] [Indexed: 11/18/2022] Open
Abstract
Introduction Since 2011 two online, validated exams for fourth-year emergency medicine (EM) students have been available (National EM M4 Exams). In 2013 the National Board of Medical Examiners offered the Advanced Clinical Examination in Emergency Medicine (EM-ACE). All of these exams are now in widespread use; however, there are no data on how they correlate. This study evaluated the correlation between the EM-ACE exam and the National EM M4 Exams. Methods From May 2013 to April 2014 the EM-ACE and one version of the EM M4 exam were administered sequentially to fourth-year EM students at five U.S. medical schools. Data collected included institution, gross and scaled scores and version of the EM M4 exam. We performed Pearson’s correlation and random effects linear regression. Results 303 students took the EM-ACE and versions 1 (V1) or 2 (V2) of the EM M4 exams (279 and 24, respectively). The mean percent correct for the exams were as follows: EM-ACE 74.8 (SD-8.83), V1 83.0 (SD-6.41), V2 78.5 (SD-7.70). Pearson’s correlation coefficient for the V1/EM-ACE was 0.51 (0.42 scaled) and for the V2/EM-ACE was 0.59 (0.41 scaled). The coefficient of determination for V1/EM-ACE was 0.72 and for V2/EM-ACE = 0.71 (0.86 and 0.49 for scaled scores). The R-squared values were 0.25 and 0.30 (0.18 and 0.13, scaled), respectively. There was significant cluster effect by institution. Conclusion There was moderate positive correlation of student scores on the EM-ACE exam and the National EM M4 Exams.
Collapse
Affiliation(s)
- Katherine Hiller
- University of Arizona, Department of Emergency Medicine, Tucson, Arizona
| | - Emily S Miller
- Harvard University, Department of Emergency Medicine, Boston, Massachusetts
| | - Luan Lawson
- Brody School of Medicine at East Carolina University, Department of Emergency Medicine, Greenville, North Carolina
| | - David Wald
- Temple University School of Medicine, Department of Emergency Medicine, Philadelphia, Pennsylvania
| | - Michael Beeson
- Northeastern Ohio Medical University, Department of Emergency Medicine, Rootstown, Ohio
| | - Corey Heitz
- Virginia Tech Carilion School of Medicine, Department of Emergency Medicine, Roanoke, Virginia
| | - Thomas Morrissey
- University of Florida Health Sciences Center, Department of Emergency Medicine, Jacksonville, Florida
| | - Joseph House
- University of Michigan School of Medicine, Department of Emergency Medicine, Ann Arbor, Michigan
| | - Stacey Poznanski
- Wright State University Boonshoft School of Medicine, Department of Emergency Medicine, Dayton, Ohio
| |
Collapse
|
15
|
Avegno JL, Murphy-Lavoie H, Lofaso DP, Moreno-Walton L. Medical students' perceptions of an emergency medicine clerkship: an analysis of self-assessment surveys. Int J Emerg Med 2012; 5:25. [PMID: 22647269 PMCID: PMC3419087 DOI: 10.1186/1865-1380-5-25] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2011] [Accepted: 05/31/2012] [Indexed: 12/05/2022] Open
Abstract
BACKGROUND No studies have been performed that evaluate the perceptions of medical students completing an emergency medicine (EM) clerkship. Given the variability of exposure to EM in medical schools nationwide, assessment of the student rotation may inform the structure and content of new and existing clerkships, particularly in relation to student's acquisition of the core competencies. OBJECTIVES To investigate whether undergraduate medical students rotating through an EM clerkship improved their understanding and abilities in core content areas and common procedural skills; to evaluate whether improvement was affected by rotation length. METHODS All students participating in an EM clerkship over a 12-month period were asked to complete an anonymous voluntary pre- and post-rotation survey. Confidence with patient assessment, diagnosis, and management plans; trauma and medical resuscitations; formal and informal presentations; basic procedure skills and understanding of the modern practice of EM were self assessed using a Likert scale. Group mean scores on each question on the pre- and post-clerkship surveys were calculated and compared. The mean scores on each survey item, both pre- and post-clerkship, were compared between 2- and 4-week clerkship rotation groups. RESULTS Two hundred thirty-nine students participated in the rotation during the 12 months of the study. One hundred sixty-one (161), or 67.4%, completed the pre-rotation survey, and 96 (40.2%) completed the post-rotation survey. Overall, students showed significant mean gains in confidence with initial patient assessment, diagnosis, and management plans (p < 0.01, 0.02, <0.01) and with basic procedure skills (p < 0.01 for all). Students completing a 2-week rotation did not differ significantly from f4week rotators in confidence levels, except in the area of formal presentation skills (p = 0.01), where the 4-week students demonstrated a statistically significant advantage. The 2-week clerkship participants were significantly less confident in all procedures except EKG interpretation, splinting, and venipuncture (p = 0.28, 0.22, 0.05). Regardless of rotation length, students generally felt they had sufficient exposure to patients and opportunities for hands-on learning and practice, and overwhelmingly would recommend the EM clerkship to a fellow student, regardless of their chosen specialty. CONCLUSIONS Medical students show significant gains in confidence with acute care knowledge, disease management, and procedure skills after completion of an EM clerkship. Although a 4-week clerkship may be preferable to expose students to the widest variety of patients and procedures, all students can benefit and improve in core competencies after an EM undergraduate experience.
Collapse
Affiliation(s)
- Jennifer L Avegno
- Section of Emergency Medicine, Louisiana State University Health Sciences Center, New Orleans, USA
| | - Heather Murphy-Lavoie
- Section of Emergency Medicine, Louisiana State University Health Sciences Center, New Orleans, USA
| | - Daryl P Lofaso
- The Learning Center, Louisiana State University Health Sciences Center, New Orleans, USA
| | - Lisa Moreno-Walton
- Section of Emergency Medicine, Louisiana State University Health Sciences Center, New Orleans, USA
| |
Collapse
|
16
|
Bernard AW, Kman NE, Khandelwal S. Feedback in the emergency medicine clerkship. West J Emerg Med 2011; 12:537-42. [PMID: 22224156 PMCID: PMC3236163 DOI: 10.5811/westjem.2010.9.2014] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2010] [Revised: 08/09/2010] [Accepted: 09/27/2010] [Indexed: 11/30/2022] Open
Abstract
OBJECTIVE Feedback is a technique used in medical education to help develop and improve clinical skills. A comprehensive review article specifically intended for the emergency medicine (EM) educator is lacking, and it is the intent of this article to provide the reader with an in-depth, up-to-date, and evidence-based review of feedback in the context of the EM clerkship. METHODS The review article is organized in a progressive manner, beginning with the definition of feedback, the importance of feedback in medical education, the obstacles limiting the effective delivery of feedback, and the techniques to overcome these obstacles then follows. The article concludes with practical recommendations to implement feedback in the EM clerkship. To advance the literature on feedback, the concept of receiving feedback is introduced. RESULTS The published literature regarding feedback is limited but generally supportive of its importance and effectiveness. Obstacles in the way of feedback include time constraints, lack of direct observation, and fear of negative emotional responses from students. Feedback should be timely, expected, focused, based on first-hand data, and limited to behaviors that are remediable. Faculty development and course structure can improve feedback in the EM clerkship. Teaching students to receive feedback is a novel educational technique that can improve the feedback process. CONCLUSION Feedback is an important educational technique necessary to improve clinical skills. Feedback can be delivered effectively in the EM clerkship.
Collapse
|
17
|
Kman NE, Bernard AW, Martin DR, Bahner D, Gorgas D, Nagel R, Khandelwal S. Advanced topics in emergency medicine: curriculum development and initial evaluation. West J Emerg Med 2011; 12:543-50. [PMID: 22224157 PMCID: PMC3236174 DOI: 10.5811/westjem.2011.2.2095] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2010] [Revised: 12/23/2010] [Accepted: 02/24/2011] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Emergency medicine (EM) is a young specialty and only recently has a recommended medical student curriculum been developed. Currently, many schools do not require students to complete a mandatory clerkship in EM, and if one is required, it is typically an overview of the specialty. OBJECTIVES We developed a 10-month longitudinal elective to teach subject matter and skills in EM to fourth-year medical students interested in the specialty. Our goal was producing EM residents with the knowledge and skills to excel at the onset of their residency. We hoped to prove that students participating in this rigorous 10-month longitudinal EM elective would feel well prepared for residency. METHODS We studied the program with an end-of-the-year, Internet-based, comprehensive course evaluation completed by each participant of the first 2 years of the course. Graduates rated each of the course components by using a 5-point Likert format from "strongly disagree" to "strongly agree," either in terms of whether the component was beneficial to them or whether the course expectations were appropriate, or their perceptions related to the course. RESULTS Graduates of this elective have reported feeling well prepared to start residency. The resident-led teaching shifts, Advanced Pediatric Life Support certification, Grand Rounds presentations, Advanced Cardiovascular Life Support proficiency testing, and ultrasound component, were found to be beneficial by all students. CONCLUSIONS Our faculty believes that participating students will be better prepared for an EM residency than those students just completing a 1-month clerkship. Our data, although limited, lead us to believe that a longitudinal, immersion-type experience assists fourth-year medical students in preparation for residency.
Collapse
Affiliation(s)
- Nicholas E Kman
- Ohio State University College of Medicine, Department of Emergency Medicine, Columbus, Ohio
| | | | | | | | | | | | | |
Collapse
|