Impact of a clinical scenario on accuracy of electrocardiogram interpretation

Bias Sensitivity in Diagnostic Decision-Making: Comparing ChatGPT with Residents

BACKGROUND

Diagnostic errors, often due to biases in clinical reasoning, significantly affect patient care. While artificial intelligence chatbots like ChatGPT could help mitigate such biases, their potential susceptibility to biases is unknown.

METHODS

This study evaluated diagnostic accuracy of ChatGPT against the performance of 265 medical residents in five previously published experiments aimed at inducing bias. The residents worked in several major teaching hospitals in the Netherlands. The biases studied were case-intrinsic (presence of salient distracting findings in the patient history, effects of disruptive patient behaviors) and situational (prior availability of a look-alike patient). ChatGPT's accuracy in identifying the most-likely diagnosis was measured.

RESULTS

Diagnostic accuracy of residents and ChatGPT was equivalent. For clinical cases involving case-intrinsic bias, both ChatGPT and the residents exhibited a decline in diagnostic accuracy. Residents' accuracy decreased on average 12%, while the accuracy of ChatGPT 4.0 decreased 21%. Accuracy of ChatGPT 3.5 decreased 9%. These findings suggest that, like human diagnosticians, ChatGPT is sensitive to bias when the biasing information is part of the patient history. When the biasing information was extrinsic to the case in the form of the prior availability of a look-alike case, residents' accuracy decreased by 15%. By contrast, ChatGPT's performance was not affected by the biasing information. Chi-square goodness-of-fit tests corroborated these outcomes.

CONCLUSIONS

It seems that, while ChatGPT is not sensitive to bias when biasing information is situational, it is sensitive to bias when the biasing information is part of the patient's disease history. Its utility in diagnostic support has potential, but caution is advised. Future research should enhance AI's bias detection and mitigation to make it truly useful for diagnostic support.

Deliberate Practice as an Effective Method for Reducing Diagnostic Error in Identifying Burn and Bruise Injuries Suspicious for an Abusive Injury

OBJECTIVE

To examine the effectiveness of an education intervention for reducing physician diagnostic error in identifying pediatric burn and bruise injuries suspicious for abuse, and to determine case-specific variables associated with an increased risk of diagnostic error.

STUDY DESIGN

This was a multicenter, prospective, cross-sectional study. A convenience sample of pediatricians and other front-line physicians who treat acutely injured children in the United States and Canada were eligible for participation. Using a web-based education and assessment platform, physicians deliberately practiced with a spectrum of 300 pediatric burn and bruise injury image-based cases. Participants were asked if there was a suspicion for abuse present or absent, were given corrective feedback after every case, and received summative diagnostic performance overall (accuracy), suspicion for abuse present (sensitivity), and absent (specificity).

RESULTS

Of the 93/137 (67.9%) physicians who completed all 300 cases, there was a significant reduction in diagnostic error (initial 16.7%, final 1.6%; delta -15.1%; 95% CI -13.5, -16.7), sensitivity error (initial 11.9%, final 0.7%; delta -11.2%; 95% CI -9.8, -12.5), and specificity error (initial 23.3%, final 6.6%; delta -16.7%; 95% CI -14.8, -18.6). Based on 35 627 case interpretations, variables associated with diagnostic error included patient age, sex, skin color, mechanism of injury, and size and pattern of injury.

CONCLUSIONS

The education intervention substantially reduced diagnostic error in differentiating the presence vs absence of a suspicion for abuse in children with burn and bruise injuries. Several case-based variables were associated with diagnostic error, and these data can be used to close specific skill gaps in this clinical domain.

Designing an ECG curriculum for residents: Evidence-based approaches to improving resident ECG interpretation skills

Residents enter their training with variable comfort and competency in electrocardiogram (ECG) interpretation. Accurately interpreting an ECG is a fundamental skill in medicine and resident physicians would benefit from a longitudinal, dedicated ECG curriculum as part of their training to enhance interpretation skills and improve patient outcomes. Educators currently employ a wide array of methodologies to teach their trainees proper ECG interpretation skills, with no single modality established as the gold-standard for teaching this crucial skill. We present evidence-based guidance on how educators may develop and implement an effective ECG interpretation curriculum as part of residency training.

Impact of automatic acquisition of key clinical information on the accuracy of electrocardiogram interpretation: a cross-sectional study

BACKGROUND

The accuracy of electrocardiogram (ECG) interpretation by doctors are affected by the available clinical information. However, having a complete set of clinical details before making a diagnosis is very difficult in the clinical setting especially in the early stages of the admission process. Therefore, we developed an artificial intelligence-assisted ECG diagnostic system (AI-ECG) using natural language processing to provide screened key clinical information during ECG interpretation.

METHODS

Doctors with varying levels of training were asked to make diagnoses from 50 ECGs using a common ECG diagnosis system that does not contain clinical information. After a two-week-blanking period, the same set of ECGs was reinterpreted by the same doctors with AI-ECG containing clinical information. Two cardiologists independently provided diagnostic criteria for 50 ECGs, and discrepancies were resolved by consensus or, if necessary, by a third cardiologist. The accuracy of ECG interpretation was assessed, with each response scored as correct/partially correct = 1 or incorrect = 0.

RESULTS

The mean accuracy of ECG interpretation was 30.2% and 36.2% with the common ECG system and AI-ECG system, respectively. Compared to the unaided ECG system, the accuracy of interpretation was significantly improved with the AI-ECG system (P for paired t-test = 0.002). For senior doctors, no improvement was found in ECG interpretation accuracy, while an AI-ECG system was associated with 27% higher mean scores (24.3 ± 9.4% vs. 30.9 ± 10.6%, P = 0.005) for junior doctors.

CONCLUSION

Intelligently screened key clinical information could improve the accuracy of ECG interpretation by doctors, especially for junior doctors.

Can Orthopaedic Surgeons adequately assess an Electrocardiogram (ECG) trace paper? A cross sectional study

Objectives

The primary objective was to evaluate the ECG trace paper evaluation current knowledge level in a group of Orthopaedic surgeons divided into juniors and seniors according to M.D. degree possession.

Methods

A cross sectional study through self-administered questionnaires at a university hospital Orthopaedic and Trauma Surgery Department. The questionnaire included five sections: 1-Basic participants' characteristics, 2-Participants' perception of their ECG evaluation current knowledge level, 3-The main body of the questionnaire was an ECG quiz (seven); the participant was asked to determine if it was normal and the possible diagnosis, 4-Participants' desired ECG evaluation knowledge level, and 5-Willingness to attend ECG evaluation workshops.

Results

Of the 121 actively working individuals in the department, 96 (97.3 %) finished the questionnaire, and 85 (77.3 %) were valid for final evaluation. The participants' mean age was 30.4 ± 6.92 years, 76.5 % juniors and 23.5 % seniors. 83.5 % of the participants perceived their current ECG evaluation knowledge as none or limited. For participants' ability to evaluate an ECG, higher scores were achieved when determining if the ECG was normal or abnormal, with a mean score percentage of 79.32 % ± 23.27. However, the scores were lower when trying to reach the diagnosis, with a mean score percentage of 43.02 % ± 27.48. There was a significant negative correlation between the participant's age and answering the normality question correctly (r = -0.277, p = 0.01); and a significant positive correlation between answering the diagnosis question correctly and the desired level of knowledge and the intention to attend a workshop about ECG evaluation, r = 0.355 (p = 0.001), and r = 0.223 (p = 0.04), respectively. Only 56.5 % of the participants desired to get more knowledge, and 81.2 % were interested in attending ECG evaluation workshops.

Conclusion

Orthopaedic surgeons showed sufficient knowledge when determining the normality of ECG trace papers; however, they could not reach the proper diagnosis, and Junior surgeons performed slightly better than their senior peers. Most surgeons are willing to attend ECG evaluation and interpretation workshops to improve their knowledge level.

The effect of the auditory signal on videolaryngostroboscopy ratings and interpretation

OBJECTIVE

The primary aim of this study was to examine the effect of the videolaryngostroboscopic auditory signal on videolaryngostroboscopy (VLS) ratings and interpretation in normophonic and dysphonic speakers.

STUDY DESIGN

Prospective repeated measures design METHOD: Eight speech-language pathologists evaluated rigid VLS exams obtained from 12 dysphonic speakers with vocal fold pathology and 4 normophonic speakers with normal VLS exams. VLS exams were evaluated with the auditory signal present and absent with a washout period between rating sessions. VLS measures were obtained using the Voice-vibratory Assessment of Laryngeal Imaging (VALI) and a 100mm visual analog scale (VAS). The effects of the auditory signal and its interaction with voice quality severity on 9 VLS ratings, diagnostic billing codes, and treatment recommendations were examined.

RESULTS

There was no effect of auditory information on VLS measures or overall severity of laryngeal function evaluated using the VAS (ps > 0.05). There was a main effect of auditory information and a significant interaction with voice quality severity for only one VLS measure (non-vibrating portion-left) evaluated using the VALI (P = 0.05). Post-hoc analysis for this rating showed significant increases (t-test adjusted P < 0.05) when voice quality severity was moderate-severe (M = 4.8%; SD = 1.65%) and auditory information was present. Agreement in individual clinician's selection of diagnostic codes (73%) and treatment recommendations (65.6%) when auditory cues were present and absent was moderate to high.

CONCLUSION

The presence of the videolaryngostroboscopic auditory signal had a minimal effect on VLS ratings, treatment recommendations, or diagnostic billing codes.

Evaluating a Blended Learning Model for Medical Student ECG Teaching

OBJECTIVES

The ability to interpret a 12-lead electrocardiogram (ECG) is an essential skill in inpatient and outpatient settings. In medical school, this skill is generally taught during the Internal Medicine clerkship. Blended learning is a pedagogical tool that combines different modes of information delivery, models of teaching, and learning styles combining face-to-face learning sessions with online learning. The objectives of this study were to develop a curriculum using a blended educational model including lecture, focused educational videos, flipped classroom, and team-based learning to teach a systematic approach to ECG interpretation and enhance the ability of students to identify common and life-threatening electrocardiographic abnormalities.

METHODS

Between 2016 and 2019, 349 medical students from the University of Colorado School of Medicine received the blended learning curriculum, which included an introductory lecture followed by five 30-minute sessions. These sessions encompassed preclass videos and team-based learning in a flipped-classroom design covering critical concepts in electrocardiography. A sample of 64 students completed a survey evaluating confidence in ECG interpretation skills before and after the curriculum. All of the students completed a 17-item pretest and posttest.

RESULTS

The new curriculum improved learner confidence in ECG interpretation (Wilcoxon signed rank-sum test, P < 0.001). Postcurriculum test scores showed statistically significant improvement in all of the diagnoses tested (paired Student t test, P < 0.01), the most significant gains occurring in the life-threatening tracings of ventricular fibrillation and in ventricular tachycardia.

CONCLUSIONS

Using a blended learning model with multiple educational modalities resulted in significant improvement in learners' performance and confidence in ECG interpretation.

Assessment of the competence in electrocardiographic interpretation among Arabic resident doctors at the emergency medicine and internal medicine departments: A multi-center online cross-sectional study

Background

This study aims to assess the electrocardiographic interpretation abilities of resident doctors at internal medicine and emergency medicine departments in eight Arabic countries.

Methods

An online cross-sectional study was conducted between October 7, 2022 and October 21, 2022 in eight Arabic countries. The questionnaire consisted of two main sections: the first section included sociodemographic information, while the second section contained 12 clinical case questions of the most severe cardiac abnormalities with their electrocardiography (ECG) recordings.

Results

Out of 2,509 responses, 630 were eligible for the data analysis. More than half of the participants were males (52.4%). Internal medicine residents were (n = 530, 84.1%), whereas emergency medicine residents were (n = 100, 15.9%). Almost participants were in their first or second years of residency (79.8%). Only 36.2% of the inquired resident doctors had attended an ECG course. Most participants, 85.6%, recognized the ECG wave order correctly, and 50.5% of the participants scored above 7.5/10 on the ECG interpretation scale. The proportions of participants who were properly diagnosed with atrial fibrillation, third-degree heart block, and atrial tachycardia were 71.1, 76.7, and 56.6%, respectively. No statistically significant difference was defined between the internal and emergency medicine residents regarding their knowledge of ECG interpretation (p value = 0.42). However, there was a significant correlation between ECG interpretation and medical residency year (p value < 0.001); the fourth-year resident doctors had the highest scores (mean = 9.24, SD = 1.6). As well, participants in the third and second years of postgraduate medical residency have a probability of adequate knowledge of ECG interpretation more than participants in the first year of residency (OR = 2.1, p value = 0.001) and (OR = 1.88, p value = 0.002), respectively.

Conclusion

According to our research findings, resident doctors in departments of internal medicine and emergency medicine in Arabic nations have adequate ECG interpretation abilities; nevertheless, additional development is required to avoid misconceptions about critical cardiac conditions.

Competency and confidence in ECG interpretation among medical students

Objectives

To assess competency and confidence in ECG interpretation in medical students across years of medical school and evaluate the associations of various factors, a curriculum change, and student confidence with ECG competency.

Methods

Four hundred and fourteen (414) third- to sixth-year medical students participated in this cross-sectional study conducted in 2019 in the Hebrew University of Jerusalem, Israel. A voluntary response sample of participants answered a validated, web-based questionnaire, composed of eight ECG strips. Participants were also asked about confidence and sources for ECG education and exposure. Competency and confidence across medical school years were compared using the ANOVA and chi-square tests.

Results

Competency was low overall (mean score, SD (standard deviation) 3.23±1.81 out of 8), and higher in sixth-year students compared to third-, fourth- and fifth-year students (4.37±1.69 vs. 2.90±1.82, 2.90±1.54, 2.50±1.56, respectively, F(3,337)=24.425, p<0.0001). There was no difference between students before and after the curriculum change. Work experience in medicine was associated with competency (odds ratio (OR), 7.97; 95% confidence interval (CI), 4.03-15.77, p<0.0001). The reported confidence level was low (median 2 out of 5) and was found to be correlated with the total score achieved (r(332)=0.5, p<0.0001).

Conclusions

Student competency was shown to be insufficient throughout medical school. Competency and confidence in ECG interpretation seem to be significantly improved by increased and repetitive exposure to ECG. Thus, strategies to facilitate better ECG skills should involve an extended focus on ECG in the undergraduate and graduate curricula and include competency-based educational programs.

The Effect of Information Presentation Order on Residents' Diagnostic Accuracy of Online Simulated Patients With Chest Pain

BACKGROUND

Physicians may receive diagnostic information in different orders, and there is a lack of empirical evidence that the order of presentation may influence clinical reasoning.

OBJECTIVE

We investigated whether diagnostic accuracy of chest pain cases is influenced by the order of presentation of the history and electrocardiogram (EKG) to cardiology residents.

METHODS

We conducted an experimental study during a resident training in 2019. Twelve clinical cases were presented in 2 diagnostic rounds. Residents were randomly allocated to seeing the EKG first (EKGF) or the history first (HF). The mean diagnostic accuracy scores (range 0-1) and confidence level (0-100) in each diagnostic round and time needed to make the diagnosis were evaluated.

RESULTS

The final diagnostic accuracy was higher than the initial in both groups. After the first round, diagnostic accuracy was higher in HF (n=24) than in EKGF (n=28). Time taken to judge the history was comparable in both groups. Time taken to judge the EKG was shorter in HF (40±11 vs 64±13 seconds; P<.01). Time invested in the second round was significantly correlated with changing the initial diagnosis. A significant difference was observed in confidence ratings after the initial diagnosis, with EKGF reporting less confidence relative to HF.

CONCLUSIONS

The order in which history and EKG are presented influences the clinical reasoning process.

Physician Training for Electrocardiogram Interpretation: A Systematic Review and Meta-Analysis

PURPOSE

Using electrocardiogram (ECG) interpretation as an example of a widely taught diagnostic skill, the authors conducted a systematic review and meta-analysis to demonstrate how research evidence on instruction in diagnosis can be synthesized to facilitate improvement of educational activities (instructional modalities, instructional methods, and interpretation approaches), guide the content and specificity of such activities, and provide direction for research.

METHOD

The authors searched PubMed/MEDLINE, Embase, Cochrane CENTRAL, PsycInfo, CINAHL, ERIC, and Web of Science databases through February 21, 2020, for empirical investigations of ECG interpretation training enrolling medical students, residents, or practicing physicians. They appraised study quality with the Medical Education Research Study Quality Instrument and pooled standardized mean differences (SMDs) using random effects meta-analysis.

RESULTS

Of 1,002 articles identified, 59 were included (enrolling 17,251 participants). Among 10 studies comparing instructional modalities, 8 compared computer-assisted and face-to-face instruction, with pooled SMD 0.23 (95% CI, 0.09, 0.36) indicating a small, statistically significant difference favoring computer-assisted instruction. Among 19 studies comparing instructional methods, 5 evaluated individual versus group training (pooled SMD -0.35 favoring group study [95% CI, -0.06, -0.63]), 4 evaluated peer-led versus faculty-led instruction (pooled SMD 0.38 favoring peer instruction [95% CI, 0.01, 0.74]), and 4 evaluated contrasting ECG features (e.g., QRS width) from 2 or more diagnostic categories versus routine examination of features within a single ECG or diagnosis (pooled SMD 0.23 not significantly favoring contrasting features [95% CI, -0.30, 0.76]). Eight studies compared ECG interpretation approaches, with pooled SMD 0.92 (95% CI, 0.48, 1.37) indicating a large, statistically significant effect favoring more systematic interpretation approaches.

CONCLUSIONS

Some instructional interventions appear to improve learning in ECG interpretation; however, many evidence-based instructional strategies are insufficiently investigated. The findings may have implications for future research and design of training to improve skills in ECG interpretation and other types of visual diagnosis.

Assessments of Physicians' Electrocardiogram Interpretation Skill: A Systematic Review

PURPOSE

To identify features of instruments, test procedures, study design, and validity evidence in published studies of electrocardiogram (ECG) skill assessments.

METHOD

The authors conducted a systematic review, searching MEDLINE, Embase, Cochrane CENTRAL, PsycINFO, CINAHL, ERIC, and Web of Science databases in February 2020 for studies that assessed the ECG interpretation skill of physicians or medical students. Two authors independently screened articles for inclusion and extracted information on test features, study design, risk of bias, and validity evidence.

RESULTS

The authors found 85 eligible studies. Participants included medical students (42 studies), postgraduate physicians (48 studies), and practicing physicians (13 studies). ECG selection criteria were infrequently reported: 25 studies (29%) selected single-diagnosis or straightforward ECGs; 5 (6%) selected complex cases. ECGs were selected by generalists (15 studies [18%]), cardiologists (10 studies [12%]), or unspecified experts (4 studies [5%]). The median number of ECGs per test was 10. The scoring rubric was defined by 2 or more experts in 32 studies (38%), by 1 expert in 5 (6%), and using clinical data in 5 (6%). Scoring was performed by a human rater in 34 studies (40%) and by computer in 7 (8%). Study methods were appraised as low risk of selection bias in 16 studies (19%), participant flow bias in 59 (69%), instrument conduct and scoring bias in 20 (24%), and applicability problems in 56 (66%). Evidence of test score validity was reported infrequently, namely evidence of content (39 studies [46%]), internal structure (11 [13%]), relations with other variables (10 [12%]), response process (2 [2%]), and consequences (3 [4%]).

CONCLUSIONS

ECG interpretation skill assessments consist of idiosyncratic instruments that are too short, composed of items of obscure provenance, with incompletely specified answers, graded by individuals with underreported credentials, yielding scores with limited interpretability. The authors suggest several best practices.

Diagnostic reasoning in cardiovascular medicine

Research in cognitive psychology shows that expert clinicians make a medical diagnosis through a two step process of hypothesis generation and hypothesis testing. Experts generate a list of possible diagnoses quickly and intuitively, drawing on previous experience. Experts remember specific examples of various disease categories as exemplars, which enables rapid access to diagnostic possibilities and gives them an intuitive sense of the base rates of various diagnoses. After generating diagnostic hypotheses, clinicians then test the hypotheses and subjectively estimate the probability of each diagnostic possibility by using a heuristic called anchoring and adjusting. Although both novices and experts use this two step diagnostic process, experts distinguish themselves as better diagnosticians through their ability to mobilize experiential knowledge in a manner that is content specific. Experience is clearly the best teacher, but some educational strategies have been shown to modestly improve diagnostic accuracy. Increased knowledge about the cognitive psychology of the diagnostic process and the pitfalls inherent in the process may inform clinical teachers and help learners and clinicians to improve the accuracy of diagnostic reasoning. This article reviews the literature on the cognitive psychology of diagnostic reasoning in the context of cardiovascular disease.

An algorithm to assist novices with electrocardiogram interpretation: Validation with the Delphi Method

PURPOSE

Electrocardiograms (ECG) are often poorly interpreted by novices and this can delay time-sensitive, critical intervention. This study aimed to assess, improve and validate a stepwise ECG algorithm designed to assist with ECG interpretation by novices by soliciting the opinions of an international cohort of expert cardiologists.

METHODS

The Delphi Method was used, and an online questionnaire was sent to an international panel of cardiologists. Experts were required to evaluate each step of the algorithm and offer comments. Feedback was analysed by the investigators, changes to the algorithm were made and these were sent back to the experts until a consensus was reached. Two rounds of the Delphi Method were required to achieve consensus.

RESULTS

Overall, 55 responses were achieved (round one = 33, round two = 22). The average agreement in round one was 90.2% with 25 changes from 124 comments. Round two achieved 93.4% agreement with 12 changes from 57 comments. The threshold for consensus was set at 90% and was confirmed as being reached by all four investigators of this study. A final algorithm was therefore established. The ECG algorithm was validated through a rigorous two-stage development and review process.

CONCLUSIONS

The algorithm was validated as a safe, informative tool for novices to use to improve ECG interpretation. Real-world user validation is now required to further improve the algorithm.

Clinically contextualised ECG interpretation: the impact of prior clinical exposure and case vignettes on ECG diagnostic accuracy

BACKGROUND

ECGs are often taught without clinical context. However, in the clinical setting, ECGs are rarely interpreted without knowing the clinical presentation. We aimed to determine whether ECG diagnostic accuracy was influenced by knowledge of the clinical context and/or prior clinical exposure to the ECG diagnosis.

METHODS

Fourth- (junior) and sixth-year (senior) medical students, as well as medical residents were invited to complete two multiple-choice question (MCQ) tests and a survey. Test 1 comprised 25 ECGs without case vignettes. Test 2, completed immediately thereafter, comprised the same 25 ECGs and MCQs, but with case vignettes for each ECG. Subsequently, participants indicated in the survey when last, during prior clinical clerkships, they have seen each of the 25 conditions tested. Eligible participants completed both tests and survey. We estimated that a minimum sample size of 165 participants would provide 80% power to detect a mean difference of 7% in test scores, considering a type 1 error of 5%.

RESULTS

This study comprised 176 participants (67 [38.1%] junior students, 55 [31.3%] senior students, 54 [30.7%] residents). Prior ECG exposure depended on their level of training, i.e., junior students were exposed to 52% of the conditions tested, senior students 63.4% and residents 96.9%. Overall, there was a marginal improvement in ECG diagnostic accuracy when the clinical context was known (Cohen's d = 0.35, p < 0.001). Gains in diagnostic accuracy were more pronounced amongst residents (Cohen's d = 0.59, p < 0.001), than senior (Cohen's d = 0.38, p < 0.001) or junior students (Cohen's d = 0.29, p < 0.001). All participants were more likely to make a correct ECG diagnosis if they reported having seen the condition during prior clinical training, whether they were provided with a case vignette (odds ratio [OR] 1.46, 95% confidence interval [CI] 1.24-1.71) or not (OR 1.58, 95% CI 1.35-1.84).

CONCLUSION

ECG interpretation using clinical vignettes devoid of real patient experiences does not appear to have as great an impact on ECG diagnostic accuracy as prior clinical exposure. However, exposure to ECGs during clinical training is largely opportunistic and haphazard. ECG training should therefore not rely on experiential learning alone, but instead be supplemented by other formal methods of instruction.

The Development of Visual Expertise in ECG Interpretation: An Eye-Tracking Augmented Re Situ Interview Approach

Phenomenon: Visual expertise in medicine involves a complex interplay between expert visual behavior patterns and higher-level cognitive processes. Previous studies of visual expertise in medicine have centered around traditionally visually intensive disciplines such as radiology and pathology. However, there is limited study of visual expertise in electrocardiogram (ECG) interpretation, a common clinical task that is associated with high error rates. This qualitatively driven multi-methods study aimed to describe differences in cognitive approaches to ECG interpretation between medical students, emergency medicine (EM) residents, and EM attending physicians. Approach: Ten medical students, 10 EM residents, and 10 EM attending physicians were recruited from one tertiary academic center to participate in this study. Participants interpreted 10 ECGs with a screen-based eye-tracking device, then underwent a subjective re situ interview augmented by playback of the participants' own gaze scan-paths via eye-tracking. Interviews were transcribed verbatim and an emergent thematic analysis was performed across participant groups. Diagnostic speed, accuracy, and heat maps of fixation distribution were collected to supplement the qualitative findings. Findings: Qualitative analysis demonstrated differences among the cohorts in three major themes: dual-process reasoning, ability to prioritize, and clinical implications. These qualitative findings were aligned with differences in visual behavior demonstrated by heat maps of fixation distribution across each ECG. More experienced participants completed ECG interpretation significantly faster and more accurately than less experienced participants. Insights: The cognitive processes related to ECG interpretation differed between novices and more experienced providers in EM. Understanding the differences in cognitive approaches to ECG interpretation between these groups may help inform best practices in teaching this ubiquitous diagnostic skill.

Determining electrocardiography training priorities for medical students using a modified Delphi method

BACKGROUND

Although electrocardiography is considered a core learning outcome for medical students, there is currently little curricular guidance for undergraduate ECG training. Owing to the absence of expert consensus on undergraduate ECG teaching, curricular content is subject to individual opinion. The aim of this modified Delphi study was to establish expert consensus amongst content and context experts on an ECG curriculum for medical students.

METHODS

The Delphi technique, an established method of obtaining consensus, was used to develop an undergraduate ECG curriculum. Specialists involved in ECG teaching were invited to complete three rounds of online surveys. An undergraduate ECG curriculum was formulated from the topics of ECG instruction for which consensus (i.e. ≥75% agreement) was achieved.

RESULTS

The panellists (n = 131) had a wide range of expertise (42.8% Internal Medicine, 22.9% Cardiology, 16% Family Medicine, 13.7% Emergency Medicine and 4.6% Health Professions Education). Topics that reached consensus to be included in the undergraduate ECG curriculum were classified under technical aspects of performing ECGs, basic ECG analysis, recognition of the normal ECG and abnormal rhythms and waveforms and using electrocardiography as part of a clinical diagnosis. This study emphasises that ECG teaching should be framed within the clinical context. Course conveners should not overload students with complex and voluminous content, but rather focus on commonly encountered and life-threatening conditions, where accurate diagnosis impacts on patient outcome. A list of 23 "must know" ECG diagnoses is therefore proposed.

CONCLUSION

A multidisciplinary expert panel reached consensus on the ECG training priorities for medical students.

Accuracy of Physicians' Electrocardiogram Interpretations: A Systematic Review and Meta-analysis

IMPORTANCE

The electrocardiogram (ECG) is the most common cardiovascular diagnostic test. Physicians' skill in ECG interpretation is incompletely understood.

OBJECTIVES

To identify and summarize published research on the accuracy of physicians' ECG interpretations.

DATA SOURCES

A search of PubMed/MEDLINE, Embase, Cochrane CENTRAL (Central Register of Controlled Trials), PsycINFO, CINAHL (Cumulative Index to Nursing and Allied Health), ERIC (Education Resources Information Center), and Web of Science was conducted for articles published from database inception to February 21, 2020.

STUDY SELECTION

Of 1138 articles initially identified, 78 studies that assessed the accuracy of physicians' or medical students' ECG interpretations in a test setting were selected.

DATA EXTRACTION AND SYNTHESIS

Data on study purpose, participants, assessment features, and outcomes were abstracted, and methodological quality was appraised with the Medical Education Research Study Quality Instrument. Results were pooled using random-effects meta-analysis.

MAIN OUTCOMES AND MEASURES

Accuracy of ECG interpretation.

RESULTS

Of 1138 studies initially identified, 78 assessed the accuracy of ECG interpretation. Across all training levels, the median accuracy was 54% (interquartile range [IQR], 40%-66%; n = 62 studies) on pretraining assessments and 67% (IQR, 55%-77%; n = 47 studies) on posttraining assessments. Accuracy varied widely across studies. The pooled accuracy for pretraining assessments was 42.0% (95% CI, 34.3%-49.6%; n = 24 studies; I2 = 99%) for medical students, 55.8% (95% CI, 48.1%-63.6%; n = 37 studies; I2 = 96%) for residents, 68.5% (95% CI, 57.6%-79.5%; n = 10 studies; I2 = 86%) for practicing physicians, and 74.9% (95% CI, 63.2%-86.7%; n = 8 studies; I2 = 22%) for cardiologists.

CONCLUSIONS AND RELEVANCE

Physicians at all training levels had deficiencies in ECG interpretation, even after educational interventions. Improved education across the practice continuum appears warranted. Wide variation in outcomes could reflect real differences in training or skill or differences in assessment design.

The Simulated Cardiology Clinic: A Standardized Patient Exercise Supporting Medical Students' Biomedical Knowledge and Clinical Skills Integration

INTRODUCTION

Development of cardiac disease-related diagnostic skills-including hypothesis-driven data gathering, heart sound interpretation, and ECG interpretation-is an important component of medical student training. Prior studies indicate trainees' performance of these skills is limited. Simulation provides students with opportunities to practice integrating their developing knowledge in a relevant clinical context. We developed a simulated clinic activity for second-year medical students consisting of standardized patient (SP) cases representing cardiovascular (CV) diseases.

METHODS

Student small groups rotated through four SP encounters. For each case, one student performed the history, after which the whole small group listened to audio files of heart sounds, interpreted an ECG, and collaboratively developed a prioritized differential diagnosis. The CV course director met with students for a large-group debrief, highlighting key learning points. We collected learners' evaluations of the event through an online survey.

RESULTS

Of students, 276 participated in this activity over the course of 2 years. Nearly all students assessed the activity as extremely or quite effective for applying learning content from the CV course (97%, 2018; 93%, 2019), and for practicing how to approach chest pain, shortness of breath, palpitations, and fatigue (100%, 2018; 95%, 2019). The most helpful aspects were reinforcement of CV disease illness scripts, hypothesis-driven data gathering practice, ECG interpretation, and applying knowledge and skills in a realistic context.

DISCUSSION

SP encounters representing CV conditions can effectively provide opportunities for students to integrate basic science knowledge and clinical skills. Students assessed the activity as helpful and engaging.

Understanding context specificity: the effect of contextual factors on clinical reasoning

Background Situated cognition theory argues that thinking is inextricably situated in a context. In clinical reasoning, this can lead to context specificity: a physician arriving at two different diagnoses for two patients with the same symptoms, findings, and diagnosis but different contextual factors (something beyond case content potentially influencing reasoning). This paper experimentally investigates the presence of and mechanisms behind context specificity by measuring differences in clinical reasoning performance in cases with and without contextual factors. Methods An experimental study was conducted in 2018-2019 with 39 resident and attending physicians in internal medicine. Participants viewed two outpatient clinic video cases (unstable angina and diabetes mellitus), one with distracting contextual factors and one without. After viewing each case, participants responded to six open-ended diagnostic items (e.g. problem list, leading diagnosis) and rated their cognitive load. Results Multivariate analysis of covariance (MANCOVA) results revealed significant differences in angina case performance with and without contextual factors [Pillai's trace = 0.72, F = 12.4, df =(6, 29), p < 0.001, η p 2 = 0.72 $\eta _{\rm p}^2 = 0.72$ ], with follow-up univariate analyses indicating that participants performed statistically significantly worse in cases with contextual factors on five of six items. There were no significant differences in diabetes cases between conditions. There was no statistically significant difference in cognitive load between conditions. Conclusions Using typical presentations of common diagnoses, and contextual factors typical for clinical practice, we provide ecologically valid evidence for the theoretically predicted negative effects of context specificity (i.e. for the angina case), with large effect sizes, offering insight into the persistence of diagnostic error.

The effect of prior experience on diagnostic reasoning: exploration of availability bias

Objectives Diagnostic reasoning has been shown to be influenced by a prior similar patient case. However, it is unclear whether this process influences diagnostic error rates or whether clinicians at all experience levels are equally susceptible. The present study measured the influence of specific prior exposure and experience level on diagnostic accuracy. Methods To create the experience of prior exposure, participants (pre-clerkship medical students, emergency medicine residents, and faculty) first verified diagnoses of clinical vignettes. The influence of prior exposures was measured using equiprobable clinical vignettes; indicating two diagnoses. Participants diagnosed equiprobable cases that were: 1) matched to exposure cases (in one of three conditions: a) similar patient features, similar clinical features; b) dissimilar patient features, similar clinical features; c) similar patient features, dissimilar clinical features), or 2) not matched to any prior case (d) no exposure). A diagnosis consistent with a matched exposure case was scored correct. Cases with no prior exposure had no matched cases, hence validated the equiprobable design. Results Diagnosis A represented 47% of responses in condition d, but there was no influence of specific similarity of patient characteristics for Diagnosis A, F(3,712)=7.28, p=0.28 or Diagnosis B, F(3,712)=4.87, p=0.19. When re-scored based on matching both equiprobable diagnoses, accuracy was high, but favored faculty (n=40) 98%, and residents (n=39) 98% over medical students (n=32) 85%, F(2,712)=35.6, p<0.0001. Accuracy for medical students was 84, 87, 94, and 73% for conditions a-d, respectively, interaction F(2,712)=3.55, p<0.002. Conclusions The differential diagnosis of pre-clerkship medical students improved with prior exposure, but this was unrelated to specific case or patient features. The accuracy of medical residents and staff was not influenced by prior exposure.

Why Physiology Is Critical to the Practice of Medicine: A 40-year Personal Perspective

Accuracy in diagnosis trumps all other elements in clinical decision making. If diagnosis is inaccurate, management is likely to prove futile if not dangerous. Knowledge of physiology provides a periscope for identifying abnormalities beneath the skin responsible for clinical manifestations on the surface. Expert diagnosticians suspect disorders based on pattern recognition and automatic retrieval of knowledge stored in memory. A superior diagnostician looks at the same findings other clinicians see but thinks of causes that others have not imagined. Solving clinical mysteries depends on a clinician's power of imagination, not the capacity to recite an algorithm or apply a protocol.

Immunising' physicians against availability bias in diagnostic reasoning: a randomised controlled experiment

Background

Diagnostic errors have often been attributed to biases in physicians’ reasoning. Interventions to ‘immunise’ physicians against bias have focused on improving reasoning processes and have largely failed.

Objective

To investigate the effect of increasing physicians’ relevant knowledge on their susceptibility to availability bias.

Design, settings and participants

Three-phase multicentre randomised experiment with second-year internal medicine residents from eight teaching hospitals in Brazil.

Interventions

Immunisation: Physicians diagnosed one of two sets of vignettes (either diseases associated with chronic diarrhoea or with jaundice) and compared/contrasted alternative diagnoses with feedback. Biasing phase (1 week later): Physicians were biased towards either inflammatory bowel disease or viral hepatitis. Diagnostic performance test: All physicians diagnosed three vignettes resembling inflammatory bowel disease, three resembling hepatitis (however, all with different diagnoses). Physicians who increased their knowledge of either chronic diarrhoea or jaundice 1 week earlier were expected to resist the bias attempt.

Main outcome measurements

Diagnostic accuracy, measured by test score (range 0–1), computed for subjected-to-bias and not-subjected-to-bias vignettes diagnosed by immunised and not-immunised physicians.

Results

Ninety-one residents participated in the experiment. Diagnostic accuracy differed on subjected-to-bias vignettes, with immunised physicians performing better than non-immunised physicians (0.40 vs 0.24; difference in accuracy 0.16 (95% CI 0.05 to 0.27); p=0.004), but not on not-subjected-to-bias vignettes (0.36 vs 0.41; difference −0.05 (95% CI −0.17 to 0.08); p=0.45). Bias only hampered non-immunised physicians, who performed worse on subjected-to-bias than not-subjected-to-bias vignettes (difference −0.17 (95% CI −0.28 to −0.05); p=0.005); immunised physicians’ accuracy did not differ (p=0.56).

Conclusions

An intervention directed at increasing knowledge of clinical findings that discriminate between similar-looking diseases decreased physicians’ susceptibility to availability bias, reducing diagnostic errors, in a simulated setting. Future research needs to examine the degree to which the intervention benefits other disease clusters and performance in clinical practice.

Trial registration number

68745917.1.1001.0068.

Is computer-assisted instruction more effective than other educational methods in achieving ECG competence amongst medical students and residents? A systematic review and meta-analysis

OBJECTIVES

It remains unclear whether computer-assisted instruction (CAI) is more effective than other teaching methods in acquiring and retaining ECG competence among medical students and residents.

DESIGN

This systematic review and meta-analysis followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

DATA SOURCES

Electronic literature searches of PubMed, databases via EBSCOhost, Scopus, Web of Science, Google Scholar and grey literature were conducted on 28 November 2017. We subsequently reviewed the citation indexes for articles identified by the search.

ELIGIBILITY CRITERIA

Studies were included if a comparative research design was used to evaluate the efficacy of CAI versus other methods of ECG instruction, as determined by the acquisition and/or retention of ECG competence of medical students and/or residents.

DATA EXTRACTION AND SYNTHESIS

Two reviewers independently extracted data from all eligible studies and assessed the risk of bias. After duplicates were removed, 559 papers were screened. Thirteen studies met the eligibility criteria. Eight studies reported sufficient data to be included in the meta-analysis.

RESULTS

In all studies, CAI was compared with face-to-face ECG instruction. There was a wide range of computer-assisted and face-to-face teaching methods. Overall, the meta-analysis found no significant difference in acquired ECG competence between those who received computer-assisted or face-to-face instruction. However, subanalyses showed that CAI in a blended learning context was better than face-to-face teaching alone, especially if trainees had unlimited access to teaching materials and/or deliberate practice with feedback. There was no conclusive evidence that CAI was better than face-to-face teaching for longer-term retention of ECG competence.

CONCLUSION

CAI was not better than face-to-face ECG teaching. However, this meta-analysis was constrained by significant heterogeneity amongst studies. Nevertheless, the finding that blended learning is more effective than face-to-face ECG teaching is important in the era of increased implementation of e-learning.

PROSPERO REGISTRATION NUMBER

CRD42017067054.

Quantifying the medical student learning curve for ECG rhythm strip interpretation using deliberate practice

Objectives: Obtaining competency in medical skills such as interpretation of electrocardiograms (ECGs) requires repeated practice and feedback. Structured repeated practice and feedback for ECGs is likely not provided to most medical students, so skill development is dependent on opportunistic training during clinical rotations. Our aim was to describe: the amount of deliberate practice completed for learning ECG rhythm strip diagnoses in first year medical students, the learning curve for rhythm strip diagnosis, and student experiences with deliberate practice. Methods: First year medical students from two medical schools were provided with online rhythm strip practice cases. Diagnostic accuracy was measured throughout practice, and students were provided feedback for every case they completed. Total cases practiced and time spent practicing were correlated with their performance during practice and on an exam. Results: 314 of 384 (82%) students consented. The mean number of ECGs each student practiced was 59 (range 0-280), representing 18,466 total instances of deliberate practice. We generated mathematical models that accurately correlated both the number of cases practiced and time spent practicing, with diagnostic accuracy on an exam (p<0.001). For example, students would need to spend on average of 112 minutes and complete 34 practice cases to obtain 75% on an ECG rhythm strip exam. Student satisfaction was high using the online cases. Conclusions: We succeeded in delivering deliberate practice for ECG rhythm strip interpretation to a large cohort of students at 2 medical schools. We quantified a learning curve that estimates the number of cases and practice time required to achieve pre-determined levels of diagnostic accuracy. This data can help inform a competency-based approach to curriculum development.

Investigating the effect of clinical history before electrocardiogram interpretation on the visual behavior and interpretation accuracy of clinicians

We examine the impact of the presentation of a patient's clinical history on subsequent visual appraisal and interpretation accuracy of electrocardiograms (ECGs). Healthcare-practitioners (N = 31) skilled in 12-lead ECG interpretation took part in a repeated-measures experiment with counterbalancing viewing 9 ECGs on a computer screen in two separate conditions: with/without an associated patient-history. A Hellinger-distance calculation was applied using a permutation test to eye-movement transitions at two granularity levels: between the ECG leads, and between smaller grid-cells, whose size was determined via data-driven clustering of the fixation points. Findings indicate that presentation of clinical-history does affect accuracy of interpretation in one ECG. Visual-behavior differed as a function of both history presentation and accuracy when considering transitions between the data-driven grid units (using a fine granularity, and able to show attention to parts of the waveform). Differences in visual-behavior at waveform level demonstrate an influence of patient-history and expertise that are not detected at the lead level. Visual-behaviour differs according to whether a patient-history is presented, and whether a clinician provides an accurate interpretation. This difference is evident in how the waveform itself is viewed, and is less present at the coarse granularity of visual transitions between leads. To understand how clinicians interpret ECGs, and potentially other medical images, visual transitions should be considered at a fine level of granularity, determined in a data-driven fashion.

Debiasing versus knowledge retrieval checklists to reduce diagnostic error in ECG interpretation

There is an ongoing debate regarding the cause of diagnostic errors. One view is that errors result from unconscious application of cognitive heuristics; the alternative is that errors are a consequence of knowledge deficits. The objective of this study was to compare the effectiveness of checklists that (a) identify and address cognitive biases or (b) promote knowledge retrieval, as a means to reduce errors in ECG interpretation. Novice postgraduate year (PGY) 1 emergency medicine and internal medicine residents (n = 40) and experienced cardiology fellows (PGY 4-6) (n = 21) were randomly allocated to three conditions: a debiasing checklist, a content (knowledge) checklist, or control (no checklist) to be used while interpreting 20 ECGs. Half of the ECGs were deliberately engineered to predispose to bias. Diagnostic performance under either checklist intervention was not significantly better than the control. As expected, more errors occurred when cases were designed to induce bias (F = 96.9, p < 0.0001). There was no significant interaction between the instructional condition and level of learner. Checklists attempting to help learners identify cognitive bias or mobilize domain-specific knowledge did not have an overall effect in reducing diagnostic errors in ECG interpretation, although they may help novices. Even when cognitive biases are deliberately inserted in cases, cognitive debiasing checklists did not improve participants' performance.

Subjective awareness of ultrasound expertise development: individual experience as a determinant of overconfidence

Medical decision-making requires years of experience in order to develop an adequate level of competence to successfully engage in safe practice. While diagnostic and technical skills are essential, an awareness of the extent and limits of our own knowledge and skills is critical. The present study examines clinicians' subjective awareness in a diagnostic cardiac ultrasound task. Clinicians answered diagnostic and treatment related questions for a range of pathologies. Following these questions, clinicians indicated their level of confidence in their response. A comparison of response accuracy and confidence revealed that clinicians were generally overconfident in their responses. Critically, we observed that a clinician's overconfidence was negatively correlated with prior experience: clinicians that had more prior experience expressed less overconfidence in their performance such that some clinicians were in fact underconfident. We discuss the implications for training in medical education and decision-making.

The 3 faces of clinical reasoning: Epistemological explorations of disparate error reduction strategies

There is general consensus that clinical reasoning involves 2 stages: a rapid stage where 1 or more diagnostic hypotheses are advanced and a slower stage where these hypotheses are tested or confirmed. The rapid hypothesis generation stage is considered inaccessible for analysis or observation. Consequently, recent research on clinical reasoning has focused specifically on improving the accuracy of the slower, hypothesis confirmation stage. Three perspectives have developed in this line of research, and each proposes different error reduction strategies for clinical reasoning. This paper considers these 3 perspectives and examines the underlying assumptions. Additionally, this paper reviews the evidence, or lack of, behind each class of error reduction strategies. The first perspective takes an epidemiological stance, appealing to the benefits of incorporating population data and evidence-based medicine in every day clinical reasoning. The second builds on the heuristic and bias research programme, appealing to a special class of dual process reasoning models that theorizes a rapid error prone cognitive process for problem solving with a slower more logical cognitive process capable of correcting those errors. Finally, the third perspective borrows from an exemplar model of categorization that explicitly relates clinical knowledge and experience to diagnostic accuracy.

eAppendicitis: Diagnostic uncertainty in appendicitis and the role of ehealth - does IT help?

The availability of medical information on the World Wide Web has grown as information technology has become more accessible. Patients seeking online information may be able to selfselect conditions having been adequately informed. This study evaluates the effect of eHealth information on those presenting to hospital with a suspected appendicitis and its effect on their management and clinical outcome. Patients who had performed online reading were more likely to go to theatre but were less likely to have a confirmed histological diagnosis of appendicitis.

Is computer-assisted instruction more effective than other educational methods in achieving ECG competence among medical students and residents? Protocol for a systematic review and meta-analysis

INTRODUCTION

Although ECG interpretation is an essential skill in clinical medicine, medical students and residents often lack ECG competence. Novel teaching methods are increasingly being implemented and investigated to improve ECG training. Computer-assisted instruction is one such method under investigation; however, its efficacy in achieving better ECG competence among medical students and residents remains uncertain.

METHODS AND ANALYSIS

This article describes the protocol for a systematic review and meta-analysis that will compare the effectiveness of computer-assisted instruction with other teaching methods used for the ECG training of medical students and residents. Only studies with a comparative research design will be considered. Articles will be searched for in electronic databases (PubMed, Scopus, Web of Science, Academic Search Premier, CINAHL, PsycINFO, Education Resources Information Center, Africa-Wide Information and Teacher Reference Center). In addition, we will review citation indexes and conduct a grey literature search. Data extraction will be done on articles that met the predefined eligibility criteria. A descriptive analysis of the different teaching modalities will be provided and their educational impact will be assessed in terms of effect size and the modified version of Kirkpatrick framework for the evaluation of educational interventions. This systematic review aims to provide evidence as to whether computer-assisted instruction is an effective teaching modality for ECG training. It is hoped that the information garnered from this systematic review will assist in future curricular development and improve ECG training.

ETHICS AND DISSEMINATION

As this research is a systematic review of published literature, ethical approval is not required. The results will be reported according to the Preferred Reporting Items for Systematic Review and Meta-Analysis statement and will be submitted to a peer-reviewed journal. The protocol and systematic review will be included in a PhD dissertation.

PROSPERO REGISTRATION NUMBER

CRD42017067054; Pre-results.

Teaching at the Bedside. Maximal Impact in Minimal Time

Academic physicians encounter many demands on their time including patient care, quality and performance requirements, research, and education. In an era when patient volume is prioritized and competition for research funding is intense, there is a risk that medical education will become marginalized. Bedside teaching, a responsibility of academic physicians regardless of professional track, is challenged in particular out of concern that it generates inefficiency, and distractions from direct patient care, and can distort physician-patient relationships. At the same time, the bedside is a powerful location for teaching as learners more easily engage with educational content when they can directly see its practical relevance for patient care. Also, bedside teaching enables patients and family members to engage directly in the educational process. Successful bedside teaching can be aided by consideration of four factors: climate, attention, reasoning, and evaluation. Creating a safe environment for learning and patient care is essential. We recommend that educators set expectations about use of medical jargon and engagement of the patient and family before they enter the patient room with trainees. Keep learners focused by asking relevant questions of all members of the team and by maintaining a collective leadership style. Assess and model clinical reasoning through a hypothesis-driven approach that explores the rationale for clinical decisions. Focused, specific, real-time feedback is essential for the learner to modify behaviors for future patient encounters. Together, these strategies may alleviate challenges associated with bedside teaching and ensure it remains a part of physician practice in academic medicine.

The Causes of Errors in Clinical Reasoning: Cognitive Biases, Knowledge Deficits, and Dual Process Thinking

Contemporary theories of clinical reasoning espouse a dual processing model, which consists of a rapid, intuitive component (Type 1) and a slower, logical and analytical component (Type 2). Although the general consensus is that this dual processing model is a valid representation of clinical reasoning, the causes of diagnostic errors remain unclear. Cognitive theories about human memory propose that such errors may arise from both Type 1 and Type 2 reasoning. Errors in Type 1 reasoning may be a consequence of the associative nature of memory, which can lead to cognitive biases. However, the literature indicates that, with increasing expertise (and knowledge), the likelihood of errors decreases. Errors in Type 2 reasoning may result from the limited capacity of working memory, which constrains computational processes. In this article, the authors review the medical literature to answer two substantial questions that arise from this work: (1) To what extent do diagnostic errors originate in Type 1 (intuitive) processes versus in Type 2 (analytical) processes? (2) To what extent are errors a consequence of cognitive biases versus a consequence of knowledge deficits?The literature suggests that both Type 1 and Type 2 processes contribute to errors. Although it is possible to experimentally induce cognitive biases, particularly availability bias, the extent to which these biases actually contribute to diagnostic errors is not well established. Educational strategies directed at the recognition of biases are ineffective in reducing errors; conversely, strategies focused on the reorganization of knowledge to reduce errors have small but consistent benefits.

Measuring Up to Expectation: Cognitive Bias in Wrist Range-of-Motion Measurement

Study Design Controlled laboratory study, cross-sectional design. Background The role of cognitive biases and their effect on a wide range of aspects relevant to clinical medicine has become the focus of a growing body of research, yet their effect in physical therapy is not well established. Objectives To test whether anchoring information provided to physical therapists prior to assessment of wrist range of motion (ROM) may induce bias in the measurement. Methods A total of 120 physical therapists participated in the study. Participants were asked to measure passive wrist extension ROM of a 65-year-old woman with no history of injury to the upper limb using a universal goniometer. Before initiating the measurement, some participants received a clinical description, which included sham information about the patient's health history. Three groups were differentiated according to the provided clinical content: no bias (n = 38), moderate bias (n = 41), and substantial bias (n = 41). An analysis of covariance was applied to test for differences between the 3 groups while controlling for any potential sex and experience effects. Results The analysis of covariance yielded a significant group effect (P = .009), with no significant effect for sex and experience. The adjusted mean wrist ROM was 80.2° for the no-bias group, 74.5° for the moderate-bias group, and 72.4° for the substantial-bias group. Post hoc tests demonstrated significant difference only between the group with no bias and the substantial-bias group (mean difference, 7.7°; P = .009). Conclusion Anchoring information was associated with differential results of an objective test. Physical therapists should increase their awareness of biases and consider employing debiasing strategies. J Orthop Sports Phys Ther 2016;46(12):1037-1041. Epub 30 Oct 2016. doi:10.2519/jospt.2016.6845.

A Novel Tool for Assessment of Emergency Medicine Resident Skill in Determining Diagnosis and Management for Emergent Electrocardiograms: A Multicenter Study

BACKGROUND

Reading emergent electrocardiograms (ECGs) is one of the emergency physician's most crucial tasks, yet no well-validated tool exists to measure resident competence in this skill.

OBJECTIVES

To assess validity of a novel tool measuring emergency medicine resident competency for interpreting, and responding to, critical ECGs. In addition, we aim to observe trends in this skill for resident physicians at different levels of training.

METHODS

This is a multi-center, prospective study of postgraduate year (PGY) 1-4 residents at five emergency medicine (EM) residency programs in the United States. An assessment tool was created that asks the physician to identify either the ECG diagnosis or the best immediate management.

RESULTS

One hundred thirteen EM residents from five EM residency programs submitted completed assessment surveys, including 43 PGY-1s, 33 PGY-2s, and 37 PGY-3/4s. PGY-3/4s averaged 74.6% correct (95% confidence interval [CI] 70.9-78.4) and performed significantly better than PGY-1s, who averaged 63.2% correct (95% CI 58.0-68.3). PGY-2s averaged 69.0% (95% CI 62.2-73.7). Year-to-year differences were more pronounced in management than in diagnosis.

CONCLUSIONS

Residency training in EM seems to be associated with improved ability to interpret "critical" ECGs as measured by our assessment tool. This lends validity evidence for the tool by correlating with a previously observed association between residency training and improved ECG interpretation. Resident skill in ECG interpretation remains less than ideal. Creation of this sort of tool may allow programs to assess resident performance as well as evaluate interventions designed to improve competency.

Teaching crucial skills: An electrocardiogram teaching module for medical students

BACKGROUND

Medical student performance in electrocardiogram (ECG) interpretation at our institution could be improved. Varied resources exist to teach students this essential skill.

METHODS

We created an ECG teaching module (ECGTM) of 75 cases representing 15 diagnoses to improve medical students' performance and confidence in ECG interpretation. Students underwent pre- and post-clerkship testing to assess ECG interpretation skills and confidence and also end-of-clinical-year testing in ECG and laboratory interpretation. Performance was compared for the years before and during ECGTM availability.

RESULTS

Eighty-four percent of students (total n=101) reported using the ECGTM; 98% of those who used it reported it was useful. Students' performance and confidence were higher on the post-test. Students with access to the ECGTM (n=101) performed significantly better than students from the previous year (n=90) on the end-of-year ECG test.

CONCLUSIONS

The continuous availability of an ECGTM was associated with improved confidence and ability in ECG interpretation. The ECGTM may be another available tool to help students as they learn to read ECGs.

Validation of a Novel Digital Tool in Automatic Scoring of an Online ECG Examination at an International Cardiology Meeting

BACKGROUND

We have previously developed a novel digital tool capable of automatically recognizing correct electrocardiography (ECG) diagnoses in an online exam and demonstrated a significant improvement in diagnostic accuracy when utilizing an inductive-deductive reasoning strategy over a pattern recognition strategy. In this study, we sought to validate these findings from participants at the International Winter Arrhythmia School meeting, one of the foremost electrophysiology events in Canada.

METHODS

Preregistration to the event was sent by e-mail. The exam was administered on day 1 of the conference. Results and analysis were presented the following morning to participants.

RESULTS

Twenty-five attendees completed the exam, providing a total of 500 responses to be marked. The online tool accurately identified 195 of a total of 395 (49%) correct responses (49%). In total, 305 responses required secondary manual review, of which 200 were added to the correct responses pool. The overall accuracy of correct ECG diagnosis for all participants was 69% and 84% when using pattern recognition or inductive-deductive strategies, respectively.

CONCLUSION

Utilization of a novel digital tool to evaluate ECG competency can be set up as a workshop at international meetings or educational events. Results can be presented during the sessions to ensure immediate feedback.

Errors in multidetector row computed tomography

Multidetector row computed tomography (MDCT) represents the technique of choice for the majority of pathologies today and is responsible for the majority of diagnoses. However, despite the low number of studies dedicated to errors in MDCT, CT reporting seems especially prone to generating errors and errors are an inevitable part of MDCT practice. Most of these arise during image interpretation but, differently from other radiological techniques, the awareness of radiologists regarding technical CT aspects and pathologies substantially contribute in generating errors, in particular because CT technology expands rapidly and radiologists do not routinely receive specific and appropriate training for its use and because CT examinations are not the same for each patient and each pathology and the choice of the most appropriate CT examination (including the dose exposure to the patient) presumes a very large awareness from radiologists. This review is aimed at increasing awareness regarding the type of errors in MDCT and in particular to also highlight technical and procedural errors.

Electrocardiographic practices: the current report of monitoring and education in Veterans Affairs facilities

In 2004, practice standards for electrocardiographic (ECG) monitoring were published to address the need for an expanded use of ECG monitoring beyond heart rate and basic rhythm determination. This article reports the data collected from a survey distributed throughout the Veterans Healthcare Administration hospitals to determine the extent to which practice standards have been adopted. Survey data were used to identify the differences between actual practice and evidence-based standards. The results were divided into ECG electrode application, lead selection, alarm limits, monitoring capabilities, monitoring during patient transport, and education and competencies. The results confirm the need for improvement, including a thorough evaluation of facility practices and education. The data demonstrate the differences among actual practice and evidence-based recommendations.

New ideas for teaching electrocardiogram interpretation and improving classroom teaching content

Background

Interpreting an electrocardiogram (ECG) is not only one of the most important parts of diagnostics but also one of the most difficult areas to teach. Owing to the abstract nature of the basic theoretical knowledge of the ECG, its scattered characteristics, and tedious and difficult-to-remember subject matter, teaching how to interpret ECGs is as difficult for teachers to teach as it is for students to learn. In order to enable medical students to master basic knowledge of ECG interpretation skills in a limited teaching time, we modified the content used for traditional ECG teaching and now propose a new ECG teaching method called the “graphics-sequence memory method.”

Methods

A prospective randomized controlled study was designed to measure the actual effectiveness of ECG learning by students. Two hundred students were randomly placed under a traditional teaching group and an innovative teaching group, with 100 participants in each group. The teachers in the traditional teaching group utilized the traditional teaching outline, whereas the teachers in the innovative teaching group received training in line with the proposed teaching method and syllabus. All the students took an examination in the final semester by analyzing 20 ECGs from real clinical cases and submitted their ECG reports.

Results

The average ECG reading time was 32 minutes for the traditional teaching group and 18 minutes for the innovative teaching group. The average ECG accuracy results were 43% for the traditional teaching group and 77% for the innovative teaching group.

Conclusion

Learning to accurately interpret ECGs is an important skill in the cardiac discipline, but the ECG’s mechanisms are intricate and the content is scattered. Textbooks tend to make the students feel confused owing to the restrictions of the length and the format of the syllabi, apart from many other limitations. The graphics-sequence memory method was found to be a useful method for ECG teaching.

Improving ECG Competence in Medical Trainees in a UK District General Hospital

Background

Competency in electrocardiogram (ECG) interpretation is central to undergraduate and postgraduate clinical training. Studies have demonstrated ECGs are interpreted sub-optimally. Our study compares the effectiveness of two learning strategies to improve competence and confidence.

Method

A 1-month prospective randomized study compared the strategies in two cohorts: undergraduate third year medical students and postgraduate foundation year one (FY1) doctors. Both had blinded randomization to one of these learning strategies: focused teaching program (FTP) and self-directed learning (SDL). All volunteers completed a confidence questionnaire before and after allocation learning strategy and an ECG recognition multiple choice question (MCQ) paper at the end of the learning period.

Results

The FTP group of undergraduates demonstrated a significant difference in successfully interpreting “ventricular tachycardia” (P = 0.046) and “narrow complex tachycardia” (P = 0.009) than the SDL group. Participant confidence increased in both learning strategies. FTP confidence demonstrated a greater improvement than SDL for both cohorts.

Conclusion

A dedicated teaching program can improve trainee confidence and competence in ECG interpretation. A larger benefit is observed in undergraduates and those undertaking a FTP.

Electrocardiogram interpretation by Canadian general paediatricians: Examining practice, accuracy and confidence

BACKGROUND

Paediatric electrocardiograms (ECGs) are ordered and interpreted by general paediatricians; however, no previous studies have evaluated the accuracy of their ECG interpretations.

OBJECTIVE

To determine general paediatricians' practice and opinions regarding ECG use, accuracy of their interpretation of paediatric ECGs, and the relationship between accuracy and self-perceived confidence.

METHODS

In the present cross-sectional study, Canadian general paediatricians were asked to complete a questionnaire and interpret 18 paediatric ECGs. The questionnaire assessed characteristics of ECG use, self-perceived confidence and opinions regarding ECG use in general paediatric practice. For the ECGs provided, respondents were asked whether the ECG was normal or abnormal, what abnormality the ECG demonstrated and how confident they were in this interpretation.

RESULTS

ECG interpretation was performed by 124 general paediatricians. General paediatricians frequently use ECGs in their practice and regard this investigation as useful in patient assessment. The mean (± SD) accuracy of identifying ECGs as normal or abnormal, and identifying the specific abnormality was 80±12% and 56±20%, respectively. The sensitivity and specificity of identifying abnormal ECGs were 80% (95% CI 78% to 82%) and 79% (95% CI 75% to 83%), respectively. Correct ECG interpretation for isolated rhythm disturbances (73%) was significantly better than for abnormalities in axis (25%), chamber hypertrophy (41%) and ECG intervals (49%) (P<0.001). Overall confidence in ECG interpretation correlated with and was the only significant predictor of interpretation accuracy (r=0.396, P<0.001).

CONCLUSION

General paediatricians were adept at detecting abnormal ECGs, but were less able to identify the abnormalities. Further education in ECG interpretation may be important for this population.