Effect of the American Urological Association Annual Review Course on the Results of the Urology Qualifying Examination

Association between EMS Question Bank Completion and Passing Rates on the EMS Certification Examination

INTRODUCTION

A board review question bank was created to assist candidates in their preparation for the 2015 EMS certification examination. We aimed to describe the development of this question bank and evaluate its successes in preparing candidates to obtain EMS subspecialty board certification.

METHODS

An online question bank was developed by 13 subject matter experts who participated as item writers, representing eight different EMS fellowship programs. The online question bank consisted of four practice tests, with each of the tests comprised of 100 questions. The number of candidates who participated in and completed the question bank was calculated. The passing rate among candidates who completed the question bank was calculated and compared to the publicly reported statistics for all candidates. The relationship between candidates' performance on the question bank and subspecialty exam pass rates was determined.

RESULTS

A total of 252 candidates took at least one practice test and, of those, 225 candidates completed all four 100-question practice tests. The pass rate on the 2015 EMS certification exam was 79% (95%CI 74-85%) among candidates who completed the question bank, which is 12% higher than the overall pass rate (p = 0.003). Candidates' performance on the question bank was positively associated with overall success on the exam (X² = 75.8, p < 0.0001). Achieving a score of ≥ 70% on the question bank was associated with a higher likelihood of passing the exam (OR = 17.8; 95% CI: 8.0-39.6).

CONCLUSION

Completing the question bank program was associated with improved pass rates on the EMS certification exam. Strong performance on the question bank correlated with success on the exam.

Physician Preparation for the American Board of Emergency Medicine ConCert Examination

OBJECTIVES

To maintain certification by the American Board of Emergency Medicine (ABEM), physicians are required to pass the Continuous Certification (ConCert) examination at least every 10 years. On the 2014 ConCert postexamination survey, ABEM sought to understand the manner in which ABEM diplomates prepared for the test and to identify associations between test preparation approaches and performance on the ConCert examination.

METHODS

This was a cross-sectional survey study. The survey was administered at the end of the 2014 ConCert examination. Analyses included chi-square and linear regression to determine the association of preparation methods with performance.

RESULTS

Of the 2,431 on-time test-takers, 2,338 (96.2%) were included. The most commonly used study approach was the review of written materials designed for test preparation (1,585; 67.8%), followed by an online training course (1,006; 43.0%). There were 758 (32.4%) physicians who took a single onsite board review course, while 41 (1.8%) took two or more onsite courses. Most physicians (1,611; 68.9%) spent over 35 hours preparing for the ConCert examination. The study method that was most associated with favorable test scores was the review of written materials designed for test preparation (p < 0.001). Attending an onsite preparation course was associated with poorer performance (p < 0.001). There was a significant association between no additional preparation and failing the examination (chi-square with Yates correction; p = 0.001).

CONCLUSIONS

A substantial majority (97.8%) of physicians taking the 2014 ABEM ConCert examination prepared for it. The majority of physicians used written materials specifically designed for test preparation. Reviewing written materials designed for test preparation was associated with the highest performance.