1
|
Nyström A, Olsson de Capretz P, Björkelund A, Lundager Forberg J, Ohlsson M, Björk J, Ekelund U. Prior electrocardiograms not useful for machine learning predictions of major adverse cardiac events in emergency department chest pain patients. J Electrocardiol 2024; 82:42-51. [PMID: 38006763 DOI: 10.1016/j.jelectrocard.2023.11.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Revised: 09/07/2023] [Accepted: 11/02/2023] [Indexed: 11/27/2023]
Abstract
At the emergency department (ED), it is important to quickly and accurately determine which patients are likely to have a major adverse cardiac event (MACE). Machine learning (ML) models can be used to aid physicians in detecting MACE, and improving the performance of such models is an active area of research. In this study, we sought to determine if ML models can be improved by including a prior electrocardiogram (ECG) from each patient. To that end, we trained several models to predict MACE within 30 days, both with and without prior ECGs, using data collected from 19,499 consecutive patients with chest pain, from five EDs in southern Sweden, between the years 2017 and 2018. Our results indicate no improvement in AUC from prior ECGs. This was consistent across models, both with and without additional clinical input variables, for different patient subgroups, and for different subsets of the outcome. While contradicting current best practices for manual ECG analysis, the results are positive in the sense that ML models with fewer inputs are more easily and widely applicable in practice.
Collapse
Affiliation(s)
- Axel Nyström
- Lund University, Department of Laboratory Medicine, Lund, Sweden.
| | - Pontus Olsson de Capretz
- Skåne University Hospital, Department of Internal and Emergency Medicine, Lund, Sweden; Lund University, Department of Clinical Sciences, Lund, Sweden
| | - Anders Björkelund
- Lund University, Center for Environmental and Climate Science, Lund, Sweden
| | - Jakob Lundager Forberg
- Lund University, Department of Clinical Sciences, Lund, Sweden; Helsingborg Hospital, Department of Emergency Medicine, Helsingborg, Sweden
| | - Mattias Ohlsson
- Lund University, Center for Environmental and Climate Science, Lund, Sweden; Halmstad University, Center for Applied Intelligent Systems Research (CAISR), Halmstad, Sweden
| | - Jonas Björk
- Lund University, Department of Laboratory Medicine, Lund, Sweden; Clinical Studies Sweden, Forum South, Skåne University Hospital, Lund, Sweden
| | - Ulf Ekelund
- Skåne University Hospital, Department of Internal and Emergency Medicine, Lund, Sweden; Lund University, Department of Clinical Sciences, Lund, Sweden
| |
Collapse
|
2
|
Swenne CA, Ter Haar CC. Context-independent identification of myocardial ischemia in the prehospital ECG of chest pain patients. J Electrocardiol 2024; 82:34-41. [PMID: 38006762 DOI: 10.1016/j.jelectrocard.2023.10.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 10/14/2023] [Accepted: 10/23/2023] [Indexed: 11/27/2023]
Abstract
Non-traumatic chest pain is a frequent reason for an urgent ambulance visit of a patient by the emergency medical services (EMS). Chest pain (or chest pain-equivalent symptoms) can be innocent, but it can also signal an acute form of severe pathology that may require prompt intervention. One of these pathologies is cardiac ischemia, resulting from a disbalance between blood supply and demand. One cause of a diminished blood supply to the heart is acute coronary syndrome (ACS, i.e., cardiac ischemia caused by a reduced blood supply to myocardial tissue due to plaque instability and thrombus formation in a coronary artery). ACS is dangerous due to the unpredictable process that drives the supply problem and the high chance of fast hemodynamic deterioration (i.e., cardiogenic shock, ventricular fibrillation). This is why an ECG is made at first medical contact in most chest pain patients to include or exclude ischemia as the cause of their complaints. For speedy and adequate triaging and treatment, immediate assessment of this prehospital ECG is necessary, still during the ambulance ride. Human diagnostic efforts supported by automated interpretation algorithms seek to answer questions regarding the urgency level, the decision if and towards which healthcare facility the patient should be transported, and the indicated acute treatment and further diagnostics after arrival in the healthcare facility. In the case of an ACS, a catheter intervention room may be activated during the ambulance ride to facilitate the earliest possible in-hospital treatment. Prehospital ECG assessment and the subsequent triaging decisions are complex because chest pain is not uniquely associated with ACS. The differential diagnosis includes other cardiac, pulmonary, vascular, gastrointestinal, orthopedic, and psychological conditions. Some of these conditions may also involve ECG abnormalities. In practice, only a limited fraction (order of magnitude 10%) of the patients who are urgently transported to the hospital because of chest pain are ACS patients. Given the relatively low prevalence of ACS in this patient mix, the specificity of the diagnostic ECG algorithms should be relatively high to prevent overtreatment and overflow of intervention facilities. On the other hand, only a sufficiently high sensitivity warrants adequate therapy when needed. Here, we review how the prehospital ECG can contribute to identifying the presence of myocardial ischemia in chest pain patients. We discuss the various mechanisms of myocardial ischemia and infarction, the typical patient mix of chest pain patients, the shortcomings of the ST-elevation myocardial infarction (STEMI) and non-ST-elevation myocardial infarction (NSTEMI) ECG criteria to detect a completely occluded culprit artery, the OMI ECG criteria (including the STEMI-equivalent ECG patterns) in detecting completely occluded culprit arteries, and the promise of neural networks in recognizing ECG patterns that represent complete occlusions. We also discuss the relevance of detecting any ACS/ischemia, not necessarily caused by a total occlusion, in the prehospital ECG. In addition, we discuss how serial prehospital ECGs can contribute to ischemia diagnosis. Finally, we discuss the diagnostic contribution of a serial comparison of the prehospital ECG with a previously made nonischemic ECG of the patient.
Collapse
Affiliation(s)
- Cees A Swenne
- Cardiology Department, Leiden University Medical Center, Leiden, the Netherlands.
| | - C Cato Ter Haar
- Cardiology Department, Amsterdam University Medical Center, Amsterdam, the Netherlands
| |
Collapse
|
3
|
Sbrollini A, Ter Haar CC, Leoni C, Morettini M, Burattini L, Swenne CA. Advanced repeated structuring and learning procedure to detect acute myocardial ischemia in serial 12-lead ECGs. Physiol Meas 2023; 44:084003. [PMID: 37376978 DOI: 10.1088/1361-6579/ace241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Accepted: 06/27/2023] [Indexed: 06/29/2023]
Abstract
Objectives. Acute myocardial ischemia in the setting of acute coronary syndrome (ACS) may lead to myocardial infarction. Therefore, timely decisions, already in the pre-hospital phase, are crucial to preserving cardiac function as much as possible. Serial electrocardiography, a comparison of the acute electrocardiogram with a previously recorded (reference) ECG of the same patient, aids in identifying ischemia-induced electrocardiographic changes by correcting for interindividual ECG variability. Recently, the combination of deep learning and serial electrocardiography provided promising results in detecting emerging cardiac diseases; thus, the aim of our current study is the application of our novel Advanced Repeated Structuring and Learning Procedure (AdvRS&LP), specifically designed for acute myocardial ischemia detection in the pre-hospital phase by using serial ECG features.Approach. Data belong to the SUBTRACT study, which includes 1425 ECG pairs, 194 (14%) ACS patients, and 1035 (73%) controls. Each ECG pair was characterized by 28 serial features that, with sex and age, constituted the inputs of the AdvRS&LP, an automatic constructive procedure for creating supervised neural networks (NN). We created 100 NNs to compensate for statistical fluctuations due to random data divisions of a limited dataset. We compared the performance of the obtained NNs to a logistic regression (LR) procedure and the Glasgow program (Uni-G) in terms of area-under-the-curve (AUC) of the receiver-operating-characteristic curve, sensitivity (SE), and specificity (SP).Main Results. NNs (median AUC = 83%, median SE = 77%, and median SP = 89%) presented a statistically (Pvalue lower than 0.05) higher testing performance than those presented by LR (median AUC = 80%, median SE = 67%, and median SP = 81%) and by the Uni-G algorithm (median SE = 72% and median SP = 82%).Significance. In conclusion, the positive results underscore the value of serial ECG comparison in ischemia detection, and NNs created by AdvRS&LP seem to be reliable tools in terms of generalization and clinical applicability.
Collapse
Affiliation(s)
- Agnese Sbrollini
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| | - C Cato Ter Haar
- Cardiology Department, Leiden University Medical Center, Leiden, the Netherlands
- Cardiology Department, Amsterdam University Medical Center, Amsterdam, the Netherlands
| | - Chiara Leoni
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| | - Micaela Morettini
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| | - Laura Burattini
- Department of Information Engineering, Università Politecnica delle Marche, Ancona, Italy
| | - Cees A Swenne
- Cardiology Department, Leiden University Medical Center, Leiden, the Netherlands
| |
Collapse
|
4
|
Sbrollini A, Barocci M, Mancinelli M, Paris M, Raffaelli S, Marcantoni I, Morettini M, Swenne CA, Burattini L. Automatic diagnosis of newly emerged heart failure from serial electrocardiography by repeated structuring & learning procedure. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
5
|
Sbrollini A, Marcantoni I, Morettini M, Swenne CA, Burattini L. Repeated Structuring & Learning Procedure for Detection of Myocardial Ischemia: a Robustness Analysis. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:467-470. [PMID: 34891334 DOI: 10.1109/embc46164.2021.9630569] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Myocardial ischemia, consisting in a reduction of blood flow to the heart, may cause sudden cardiac death by myocardial infarction or trigger serious abnormal rhythms. Thus, its timely identification is crucial. The Repeated Structuring and Learning Procedure (RS&LP), an innovative constructive algorithm able to dynamically create neural networks (NN) alternating structuring and learning phases, was previously found potentially useful for myocardial ischemia detection. However, performance of created NN depends on three parameters, the values of which need to be set a priori by the user: maximal number of layers (NL), maximal number of initializations (NI) and maximal number of confirmations (NC). A robustness analysis of RS&LP to varying values of NL, NI and NC is fundamental for clinical applications concerning myocardial ischemia detection but was never performed before; thus, it was the aim the present study. Thirteen serial ECG features were extracted by pairs of ECGs belonging to 84 cases (patients with induced myocardial ischemia) and 398 controls (patients with no myocardial ischemia) and used as inputs to learn (50% of population) and test (50% of population) NNs with varying values of NL (1,2,3,4,10), NI (50,250,500,1000,1500) and NC (2,5,10,20,50). Performance of obtained NNs was compared in terms of area under the curve (AUC) of the receiver operating characteristics. Overall, 13 NNs were considered; 12 (92%) were characterized by AUC≥80% and 4 (31%) by AUC≥85%. Thus, RS&LP proved to be robust when creating NNs for detecting of myocardial ischemia.
Collapse
|
6
|
Faramand Z, Helman S, Ahmad A, Martin-Gill C, Callaway C, Saba S, Gregg RE, Wang J, Al-Zaiti S. Performance and limitations of automated ECG interpretation statements in patients with suspected acute coronary syndrome. J Electrocardiol 2021; 69S:45-50. [PMID: 34465465 DOI: 10.1016/j.jelectrocard.2021.08.014] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2021] [Revised: 08/11/2021] [Accepted: 08/11/2021] [Indexed: 10/20/2022]
Abstract
BACKGROUND The 12‑lead ECG plays an important role in triaging patients with symptomatic coronary artery disease, making automated ECG interpretation statements of "Acute MI" or "Acute Ischemia" crucial, especially during prehospital transport when access to physician interpretation of the ECG is limited. However, it remains unknown how automated interpretation statements correspond to adjudicated clinical outcomes during hospitalization. We sought to evaluate the diagnostic performance of prehospital automated interpretation statements to four well-defined clinical outcomes of interest: confirmed ST- segment elevation myocardial infarction (STEMI); presence of actionable coronary culprit lesions, myocardial necrosis, or any acute coronary syndrome (ACS). METHODS An observational cohort study that enrolled consecutive patients with non-traumatic chest pain transported via ambulance. Prehospital ECGs were obtained with the Philips MRX monitor from the medical command center and re-processed using manufacturer-specific diagnostic algorithms to denote the likelihood of >>>Acute MI<<< or >>>Acute Ischemia<<<. Two independent reviewers retrospectively adjudicated the study outcomes and disagreements were resolved by a third reviewer. RESULTS Our study included 2400 patients (age 59 ± 16, 47% females, 41% Black), with 190 (8%) patients with documented automated diagnostic statements of acute MI or acute ischemia. The sensitivity/specificity of the automated algorithm for detecting confirmed STEMI (n = 143, 6%); presence of actionable coronary culprit lesions (n = 258, 11%), myocardial necrosis (n = 291, 12%), or any ACS (n = 378, 16%) were 62.9%/95.6%; 37.2%/95.6%; 38.5%/96.4%; and 30.7%/96.3%, respectively. CONCLUSION Although being very specific, automated interpretation statements of acute MI/acute ischemia on prehospital ECGs are not satisfactorily sensitive to exclude symptomatic coronary disease. Patients without these automated interpretation statements should be considered further for significant underlying coronary disease based on the clinical context. TRIAL REGISTRATION ClinicalTrials.gov # NCT04237688.
Collapse
Affiliation(s)
- Ziad Faramand
- Department of Acute & Tertiary Care Nursing at University of Pittsburgh, PA, USA; Department of Emergency Medicine at University of Pittsburgh, PA, USA; University of Pittsburgh Medical Center (UPMC), Pittsburgh, PA, USA
| | - Stephanie Helman
- Department of Acute & Tertiary Care Nursing at University of Pittsburgh, PA, USA
| | - Abdullah Ahmad
- Englewood Hospital and Medical Center, Englewood, NJ, USA
| | - Christian Martin-Gill
- Department of Emergency Medicine at University of Pittsburgh, PA, USA; University of Pittsburgh Medical Center (UPMC), Pittsburgh, PA, USA
| | - Clifton Callaway
- Department of Emergency Medicine at University of Pittsburgh, PA, USA; University of Pittsburgh Medical Center (UPMC), Pittsburgh, PA, USA
| | - Samir Saba
- Division of Cardiology at University of Pittsburgh, PA, USA; University of Pittsburgh Medical Center (UPMC), Pittsburgh, PA, USA
| | | | - John Wang
- Philips Healthcare, Andover, MA, USA
| | - Salah Al-Zaiti
- Department of Acute & Tertiary Care Nursing at University of Pittsburgh, PA, USA; Department of Emergency Medicine at University of Pittsburgh, PA, USA; Division of Cardiology at University of Pittsburgh, PA, USA.
| |
Collapse
|