Understanding Cardiology Practitioners' Interpretations of Electrocardiograms: An Eye-Tracking Study

Artificial intelligence for direct-to-physician reporting of ambulatory electrocardiography

Developments in ambulatory electrocardiogram (ECG) technology have led to vast amounts of ECG data that currently need to be interpreted by human technicians. Here we tested an artificial intelligence (AI) algorithm for direct-to-physician reporting of ambulatory ECGs. Beat-by-beat annotation of 14,606 individual ambulatory ECG recordings (mean duration = 14 ± 10 days) was performed by certified ECG technicians (n = 167) and an ensemble AI model, called DeepRhythmAI. To compare the performance of the AI model and the technicians, a random sample of 5,235 rhythm events identified by the AI model or by technicians, of which 2,236 events were identified as critical arrhythmias, was selected for annotation by one of 17 cardiologist consensus panels. The mean sensitivity of the AI model for the identification of critical arrhythmias was 98.6% (95% confidence interval (CI) = 97.7-99.4), as compared to 80.3% (95% CI = 77.3-83.3%) for the technicians. False-negative findings were observed in 3.2/1,000 patients for the AI model versus 44.3/1,000 patients for the technicians. Accordingly, the relative risk of a missed diagnosis was 14.1 (95% CI = 10.4-19.0) times higher for the technicians. However, a higher false-positive event rate was observed for the AI model (12 (interquartile range (IQR) = 6-74)/1,000 patient days) as compared to the technicians (5 (IQR = 2-153)/1,000 patient days). We conclude that the DeepRhythmAI model has excellent negative predictive value for critical arrhythmias, substantially reducing false-negative findings, but at a modest cost of increased false-positive findings. AI-only analysis to facilitate direct-to-physician reporting could potentially reduce costs and improve access to care and outcomes in patients who need ambulatory ECG monitoring.

Evaluating the impacts of digital ECG denoising on the interpretive capabilities of healthcare professionals

Aims

Electrocardiogram (ECG) interpretation is an essential skill across multiple medical disciplines; yet, studies have consistently identified deficiencies in the interpretive performance of healthcare professionals linked to a variety of educational and technological factors. Despite the established correlation between noise interference and erroneous diagnoses, research evaluating the impacts of digital denoising software on clinical ECG interpretation proficiency is lacking.

Methods and results

Forty-eight participants from a variety of medical professions and experience levels were prospectively recruited for this study. Participants' capabilities in classifying common cardiac rhythms were evaluated using a sequential blinded and semi-blinded interpretation protocol on a challenging set of single-lead ECG signals (42 × 10 s) pre- and post-denoising with robust, cloud-based ECG processing software. Participants' ECG rhythm interpretation performance was greatest when raw and denoised signals were viewed in a combined format that enabled comparative evaluation. The combined view resulted in a 4.9% increase in mean rhythm classification accuracy (raw: 75.7% ± 14.5% vs. combined: 80.6% ± 12.5%, P = 0.0087), a 6.2% improvement in mean five-point graded confidence score (raw: 4.05 ± 0.58 vs. combined: 4.30 ± 0.48, P < 0.001), and 9.7% reduction in the mean proportion of undiagnosable data (raw: 14.2% ± 8.2% vs. combined: 4.5% ± 2.4%, P < 0.001), relative to raw signals alone. Participants also had a predominantly positive perception of denoising as it related to revealing previously unseen pathologies, improving ECG readability, and reducing time to diagnosis.

Conclusion

Our findings have demonstrated that digital denoising software improves the efficacy of rhythm interpretation on single-lead ECGs, particularly when raw and denoised signals are provided in a combined viewing format, warranting further investigation into the impact of such technology on clinical decision-making and patient outcomes.

Can Orthopaedic Surgeons adequately assess an Electrocardiogram (ECG) trace paper? A cross sectional study

OBJECTIVES

The primary objective was to evaluate the ECG trace paper evaluation current knowledge level in a group of Orthopaedic surgeons divided into juniors and seniors according to M.D. degree possession.

METHODS

A cross sectional study through self-administered questionnaires at a university hospital Orthopaedic and Trauma Surgery Department. The questionnaire included five sections: 1-Basic participants' characteristics, 2-Participants' perception of their ECG evaluation current knowledge level, 3-The main body of the questionnaire was an ECG quiz (seven); the participant was asked to determine if it was normal and the possible diagnosis, 4-Participants' desired ECG evaluation knowledge level, and 5-Willingness to attend ECG evaluation workshops.

RESULTS

Of the 121 actively working individuals in the department, 96 (97.3 %) finished the questionnaire, and 85 (77.3 %) were valid for final evaluation. The participants' mean age was 30.4 ± 6.92 years, 76.5 % juniors and 23.5 % seniors. 83.5 % of the participants perceived their current ECG evaluation knowledge as none or limited. For participants' ability to evaluate an ECG, higher scores were achieved when determining if the ECG was normal or abnormal, with a mean score percentage of 79.32 % ± 23.27. However, the scores were lower when trying to reach the diagnosis, with a mean score percentage of 43.02 % ± 27.48. There was a significant negative correlation between the participant's age and answering the normality question correctly (r = -0.277, p = 0.01); and a significant positive correlation between answering the diagnosis question correctly and the desired level of knowledge and the intention to attend a workshop about ECG evaluation, r = 0.355 (p = 0.001), and r = 0.223 (p = 0.04), respectively. Only 56.5 % of the participants desired to get more knowledge, and 81.2 % were interested in attending ECG evaluation workshops.

CONCLUSION

Orthopaedic surgeons showed sufficient knowledge when determining the normality of ECG trace papers; however, they could not reach the proper diagnosis, and Junior surgeons performed slightly better than their senior peers. Most surgeons are willing to attend ECG evaluation and interpretation workshops to improve their knowledge level.

Eye tracking technology in medical practice: a perspective on its diverse applications

Eye tracking technology has emerged as a valuable tool in the field of medicine, offering a wide range of applications across various disciplines. This perspective article aims to provide a comprehensive overview of the diverse applications of eye tracking technology in medical practice. By summarizing the latest research findings, this article explores the potential of eye tracking technology in enhancing diagnostic accuracy, assessing and improving medical performance, as well as improving rehabilitation outcomes. Additionally, it highlights the role of eye tracking in neurology, cardiology, pathology, surgery, as well as rehabilitation, offering objective measures for various medical conditions. Furthermore, the article discusses the utility of eye tracking in autism spectrum disorders, attention-deficit/hyperactivity disorder (ADHD), and human-computer interaction in medical simulations and training. Ultimately, this perspective article underscores the transformative impact of eye tracking technology on medical practice and suggests future directions for its continued development and integration.

Webcam-based eye-tracking to measure visual expertise of medical students during online histology training

Objectives

Visual expertise is essential for image-based tasks that rely on visual cues, such as in radiology or histology. Studies suggest that eye movements are related to visual expertise and can be measured by near-infrared eye-tracking. With the popularity of device-embedded webcam eye-tracking technology, cost-effective use in educational contexts has recently become amenable. This study investigated the feasibility of such methodology in a curricular online-only histology course during the 2021 summer term.

Methods

At two timepoints (t1 and t2), third-semester medical students were asked to diagnose a series of histological slides while their eye movements were recorded. Students' eye metrics, performance and behavioral measures were analyzed using variance analyses and multiple regression models.

Results

First, webcam-eye tracking provided eye movement data with satisfactory quality (mean accuracy=115.7 px±31.1). Second, the eye movement metrics reflected the students' proficiency in finding relevant image sections (fixation count on relevant areas=6.96±1.56 vs. irrelevant areas=4.50±1.25). Third, students' eye movement metrics successfully predicted their performance (R2adj=0.39, p<0.001).

Conclusion

This study supports the use of webcam-eye-tracking expanding the range of educational tools available in the (digital) classroom. As the students' interest in using the webcam eye-tracking was high, possible areas of implementation will be discussed.

A cardiologist-like computer-aided interpretation framework to improve arrhythmia diagnosis from imbalanced training datasets

Arrhythmias can pose a significant threat to cardiac health, potentially leading to serious consequences such as stroke, heart failure, cardiac arrest, shock, and sudden death. In computer-aided electrocardiogram interpretation systems, the inclusion of certain classes of arrhythmias, which we term "aggressive" or "bullying," can lead to the underdiagnosis of other "vulnerable" classes. To address this issue, a method for arrhythmia diagnosis is proposed in this study. This method combines morphological-characteristic-based waveform clustering with Bayesian theory, drawing inspiration from the diagnostic reasoning of experienced cardiologists. The proposed method achieved optimal performance in macro-recall and macro-precision through hyperparameter optimization, including spliced heartbeats and clusters. In addition, with increasing bullying by aggressive arrhythmias, our model obtained the highest average recall and the lowest average drop in recall on the nine vulnerable arrhythmias. Furthermore, the maximum cluster characteristics were found to be consistent with established arrhythmia diagnostic criteria, lending interpretability to the proposed method.

Humanizing AI in medical training: ethical framework for responsible design

The increasing use of artificial intelligence (AI) in healthcare has brought about numerous ethical considerations that push for reflection. Humanizing AI in medical training is crucial to ensure that the design and deployment of its algorithms align with ethical principles and promote equitable healthcare outcomes for both medical practitioners trainees and patients. This perspective article provides an ethical framework for responsibly designing AI systems in medical training, drawing on our own past research in the fields of electrocardiogram interpretation training and e-health wearable devices. The article proposes five pillars of responsible design: transparency, fairness and justice, safety and wellbeing, accountability, and collaboration. The transparency pillar highlights the crucial role of maintaining the explainabilty of AI algorithms, while the fairness and justice pillar emphasizes on addressing biases in healthcare data and designing models that prioritize equitable medical training outcomes. The safety and wellbeing pillar however, emphasizes on the need to prioritize patient safety and wellbeing in AI model design whether it is for training or simulation purposes, and the accountability pillar calls for establishing clear lines of responsibility and liability for AI-derived decisions. Finally, the collaboration pillar emphasizes interdisciplinary collaboration among stakeholders, including physicians, data scientists, patients, and educators. The proposed framework thus provides a practical guide for designing and deploying AI in medicine generally, and in medical training specifically in a responsible and ethical manner.