1
|
Kasim S, Tang J, Malek S, Ibrahim KS, Shariff RER, Chima JK. Enhancing reginal wall abnormality detection accuracy: Integrating machine learning, optical flow algorithms, and temporal convolutional networks in multi-view echocardiography. PLoS One 2024; 19:e0310107. [PMID: 39264929 PMCID: PMC11392243 DOI: 10.1371/journal.pone.0310107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 08/24/2024] [Indexed: 09/14/2024] Open
Abstract
BACKGROUND Regional Wall Motion Abnormality (RWMA) serves as an early indicator of myocardial infarction (MI), the global leader in mortality. Accurate and early detection of RWMA is vital for the successful treatment of MI. Current automated echocardiography analyses typically concentrate on peak values from left ventricular (LV) displacement curves, based on LV contour annotations or key frames during the heart's systolic or diastolic phases within a single echocardiographic cycle. This approach may overlook the rich motion field features available in multi-cycle cardiac data, which could enhance RWMA detection. METHODS In this research, we put forward an innovative approach to detect RWMA by harnessing motion information across multiple echocardiographic cycles and multi-views. Our methodology synergizes U-Net-based segmentation with optical flow algorithms for detailed cardiac structure delineation, and Temporal Convolutional Networks (ConvNet) to extract nuanced motion features. We utilize a variety of machine learning and deep learning classifiers on both A2C and A4C views echocardiograms to enhance detection accuracy. A three-phase algorithm-originating from the HMC-QU dataset-incorporates U-Net for segmentation, followed by optical flow for cardiac wall motion field features. Temporal ConvNet, inspired by the Temporal Segment Network (TSN), is then applied to interpret these motion field features, independent of traditional cardiac parameter curves or specific key phase frame inputs. RESULTS Employing five-fold cross-validation, our SVM classifier demonstrated high performance, with a sensitivity of 93.13%, specificity of 83.61%, precision of 88.52%, and an F1 score of 90.39%. When compared with other studies using the HMC-QU datasets, these Fig s stand out, underlining our method's effectiveness. The classifier also attained an overall accuracy of 89.25% and Area Under the Curve (AUC) of 95%, reinforcing its potential for reliable RWMA detection in echocardiographic analysis. CONCLUSIONS This research not only demonstrates a novel technique but also contributes a more comprehensive and precise tool for early myocardial infarction diagnosis.
Collapse
Affiliation(s)
- Sazzli Kasim
- Faculty of Medicine, Universiti Teknologi MARA (UiTM), Sungai Buloh Campus, Sungai Buloh, Malaysia
- Cardiac Vascular and Lung Research Institute, Universiti Teknologi MARA (UiTM), Shah Alam, Malaysia
- National Heart Association of Malaysia, Heart House, Kuala Lumpur, Malaysia
- Faculty of Medicine, Cardiology Department, Universiti Teknologi MARA (UiTM), Shah Alam, Malaysia
| | - Junjie Tang
- Faculty of Science, Bioinformatics Division, Institute of Biological Sciences, University of Malaya, Kuala Lumpur, Malaysia
| | - Sorayya Malek
- Faculty of Science, Bioinformatics Division, Institute of Biological Sciences, University of Malaya, Kuala Lumpur, Malaysia
| | - Khairul Shafiq Ibrahim
- Faculty of Medicine, Universiti Teknologi MARA (UiTM), Sungai Buloh Campus, Sungai Buloh, Malaysia
- Cardiac Vascular and Lung Research Institute, Universiti Teknologi MARA (UiTM), Shah Alam, Malaysia
- National Heart Association of Malaysia, Heart House, Kuala Lumpur, Malaysia
| | - Raja Ezman Raja Shariff
- Faculty of Medicine, Universiti Teknologi MARA (UiTM), Sungai Buloh Campus, Sungai Buloh, Malaysia
- Cardiac Vascular and Lung Research Institute, Universiti Teknologi MARA (UiTM), Shah Alam, Malaysia
- National Heart Association of Malaysia, Heart House, Kuala Lumpur, Malaysia
- Faculty of Medicine, Cardiology Department, Universiti Teknologi MARA (UiTM), Shah Alam, Malaysia
| | - Jesvinna Kaur Chima
- Faculty of Medicine, Cardiology Department, Universiti Teknologi MARA (UiTM), Shah Alam, Malaysia
| |
Collapse
|
2
|
Aromiwura AA, Cavalcante JL, Kwong RY, Ghazipour A, Amini A, Bax J, Raman S, Pontone G, Kalra DK. The role of artificial intelligence in cardiovascular magnetic resonance imaging. Prog Cardiovasc Dis 2024; 86:13-25. [PMID: 38925255 DOI: 10.1016/j.pcad.2024.06.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/23/2024] [Accepted: 06/23/2024] [Indexed: 06/28/2024]
Abstract
Cardiovascular magnetic resonance (CMR) imaging is the gold standard test for myocardial tissue characterization and chamber volumetric and functional evaluation. However, manual CMR analysis can be time-consuming and is subject to intra- and inter-observer variability. Artificial intelligence (AI) is a field that permits automated task performance through the identification of high-level and complex data relationships. In this review, we review the rapidly growing role of AI in CMR, including image acquisition, sequence prescription, artifact detection, reconstruction, segmentation, and data reporting and analysis including quantification of volumes, function, myocardial infarction (MI) and scar detection, and prediction of outcomes. We conclude with a discussion of the emerging challenges to widespread adoption and solutions that will allow for successful, broader uptake of this powerful technology.
Collapse
Affiliation(s)
| | | | - Raymond Y Kwong
- Division of Cardiovascular Medicine, Brigham and Women's Hospital, Boston, MA, USA
| | - Aryan Ghazipour
- Medical Imaging Laboratory, Department of Electrical and Computer Engineering, University of Louisville, Louisville, KY, USA
| | - Amir Amini
- Medical Imaging Laboratory, Department of Electrical and Computer Engineering, University of Louisville, Louisville, KY, USA
| | - Jeroen Bax
- Department of Cardiology, Leiden University, Leiden, the Netherlands
| | - Subha Raman
- Division of Cardiology, Indiana University School of Medicine, Indianapolis, IN, USA
| | - Gianluca Pontone
- Department of Cardiology and Cardiovascular Imaging, Centro Cardiologico Monzino IRCCS, University of Milan, Milan, Italy
| | - Dinesh K Kalra
- Division of Cardiology, Department of Medicine, University of Louisville, Louisville, KY, USA; Center for Artificial Intelligence in Radiological Sciences (CAIRS), Department of Radiology, University of Louisville, Louisville, KY, USA.
| |
Collapse
|
3
|
Addison D, Neilan TG, Barac A, Scherrer-Crosbie M, Okwuosa TM, Plana JC, Reding KW, Taqueti VR, Yang EH, Zaha VG. Cardiovascular Imaging in Contemporary Cardio-Oncology: A Scientific Statement From the American Heart Association. Circulation 2023; 148:1271-1286. [PMID: 37732422 DOI: 10.1161/cir.0000000000001174] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/22/2023]
Abstract
Advances in cancer therapeutics have led to dramatic improvements in survival, now inclusive of nearly 20 million patients and rising. However, cardiovascular toxicities associated with specific cancer therapeutics adversely affect the outcomes of patients with cancer. Advances in cardiovascular imaging have solidified the critical role for robust methods for detecting, monitoring, and prognosticating cardiac risk among patients with cancer. However, decentralized evaluations have led to a lack of consensus on the optimal uses of imaging in contemporary cancer treatment (eg, immunotherapy, targeted, or biological therapy) settings. Similarly, available isolated preclinical and clinical studies have provided incomplete insights into the effectiveness of multiple modalities for cardiovascular imaging in cancer care. The aims of this scientific statement are to define the current state of evidence for cardiovascular imaging in the cancer treatment and survivorship settings and to propose novel methodological approaches to inform the optimal application of cardiovascular imaging in future clinical trials and registries. We also propose an evidence-based integrated approach to the use of cardiovascular imaging in routine clinical settings. This scientific statement summarizes and clarifies available evidence while providing guidance on the optimal uses of multimodality cardiovascular imaging in the era of emerging anticancer therapies.
Collapse
|
4
|
Kar J, Cohen MV, McQuiston SA, Malozzi CM. Can global longitudinal strain (GLS) with magnetic resonance prognosticate early cancer therapy-related cardiac dysfunction (CTRCD) in breast cancer patients, a prospective study? Magn Reson Imaging 2023; 97:68-81. [PMID: 36581216 PMCID: PMC10292191 DOI: 10.1016/j.mri.2022.12.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 12/20/2022] [Accepted: 12/23/2022] [Indexed: 12/27/2022]
Abstract
PURPOSE To determine if Artificial Intelligence-based computation of global longitudinal strain (GLS) from left ventricular (LV) MRI is an early prognostic factor of cancer therapy-related cardiac dysfunction (CTRCD) in breast cancer patients. The main hypothesis based on the patients receiving antineoplastic chemotherapy treatment was CTRCD risk analysis with GLS that was independent of LV ejection fraction (LVEF). METHODS Displacement Encoding with Stimulated Echoes (DENSE) MRI was acquired on 32 breast cancer patients at baseline and 3- and 6-month follow-ups after chemotherapy. Two DeepLabV3+ Fully Convolutional Networks (FCNs) were deployed to automate image segmentation for LV chamber quantification and phase-unwrapping for 3D strains, computed with the Radial Point Interpolation Method. CTRCD risk (cardiotoxicity and adverse cardiac events) was analyzed with Cox Proportional Hazards (PH) models with clinical and contractile prognostic factors. RESULTS GLS worsened from baseline to the 3- and 6-month follow-ups (-19.1 ± 2.1%, -16.0 ± 3.1%, -16.1 ± 3.0%; P < 0.001). Univariable Cox regression showed the 3-month GLS significantly associated as an agonist (hazard ratio [HR]-per-SD: 2.1; 95% CI: 1.4-3.1; P < 0.001) and LVEF as a protector (HR-per-SD: 0.8; 95% CI: 0.7-0.9; P = 0.001) for CTRCD occurrence. Bivariable regression showed the 3-month GLS (HR-per-SD: 2.0; 95% CI: 1.2-3.4; P = 0.01) as a CTRCD prognostic factor independent of other covariates, including LVEF (HR-per-SD: 1.0; 95% CI: 0.9-1.2; P = 0.9). CONCLUSIONS The end-point analyses proved the hypothesis that GLS is an early, independent prognosticator of incident CTRCD risk. This novel GLS-guided approach to CTRCD risk analysis could improve antineoplastic treatment with further validation in a larger clinical trial.
Collapse
Affiliation(s)
- Julia Kar
- Departments of Mechanical Engineering and Pharmacology, University of South Alabama, 150 Jaguar Drive, Mobile, AL 36688, USA.
| | - Michael V Cohen
- Division of Cardiology, Department of Medicine, University Hospital, 2451 USA Medical Center Drive, Mobile, AL 36617, USA; Department of Physiology and Cell Biology, College of Medicine, University of South Alabama, 5851 USA Dr N, Mobile, AL 36688, USA
| | - Samuel A McQuiston
- Department of Radiology, University Hospital, 2451 USA Medical Center Drive, Mobile, AL 36617, USA
| | - Christopher M Malozzi
- Division of Cardiology, Department of Medicine, University Hospital, 2451 USA Medical Center Drive, Mobile, AL 36617, USA
| |
Collapse
|
5
|
Barbaroux H, Kunze KP, Neji R, Nazir MS, Pennell DJ, Nielles-Vallespin S, Scott AD, Young AA. Automated segmentation of long and short axis DENSE cardiovascular magnetic resonance for myocardial strain analysis using spatio-temporal convolutional neural networks. J Cardiovasc Magn Reson 2023; 25:16. [PMID: 36991474 PMCID: PMC10061808 DOI: 10.1186/s12968-023-00927-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 02/01/2023] [Indexed: 03/31/2023] Open
Abstract
BACKGROUND Cine Displacement Encoding with Stimulated Echoes (DENSE) facilitates the quantification of myocardial deformation, by encoding tissue displacements in the cardiovascular magnetic resonance (CMR) image phase, from which myocardial strain can be estimated with high accuracy and reproducibility. Current methods for analyzing DENSE images still heavily rely on user input, making this process time-consuming and subject to inter-observer variability. The present study sought to develop a spatio-temporal deep learning model for segmentation of the left-ventricular (LV) myocardium, as spatial networks often fail due to contrast-related properties of DENSE images. METHODS 2D + time nnU-Net-based models have been trained to segment the LV myocardium from DENSE magnitude data in short- and long-axis images. A dataset of 360 short-axis and 124 long-axis slices was used to train the networks, from a combination of healthy subjects and patients with various conditions (hypertrophic and dilated cardiomyopathy, myocardial infarction, myocarditis). Segmentation performance was evaluated using ground-truth manual labels, and a strain analysis using conventional methods was performed to assess strain agreement with manual segmentation. Additional validation was performed using an externally acquired dataset to compare the inter- and intra-scanner reproducibility with respect to conventional methods. RESULTS Spatio-temporal models gave consistent segmentation performance throughout the cine sequence, while 2D architectures often failed to segment end-diastolic frames due to the limited blood-to-myocardium contrast. Our models achieved a DICE score of 0.83 ± 0.05 and a Hausdorff distance of 4.0 ± 1.1 mm for short-axis segmentation, and 0.82 ± 0.03 and 7.9 ± 3.9 mm respectively for long-axis segmentations. Strain measurements obtained from automatically estimated myocardial contours showed good to excellent agreement with manual pipelines, and remained within the limits of inter-user variability estimated in previous studies. CONCLUSION Spatio-temporal deep learning shows increased robustness for the segmentation of cine DENSE images. It provides excellent agreement with manual segmentation for strain extraction. Deep learning will facilitate the analysis of DENSE data, bringing it one step closer to clinical routine.
Collapse
Affiliation(s)
- Hugo Barbaroux
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK.
- Cardiovascular Magnetic Resonance Unit, The Royal Brompton Hospital (Guy's and St Thomas' NHS Foundation Trust), London, UK.
| | - Karl P Kunze
- MR Research Collaborations, Siemens Healthcare Limited, Camberley, UK
| | - Radhouene Neji
- MR Research Collaborations, Siemens Healthcare Limited, Camberley, UK
| | - Muhummad Sohaib Nazir
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| | - Dudley J Pennell
- Cardiovascular Magnetic Resonance Unit, The Royal Brompton Hospital (Guy's and St Thomas' NHS Foundation Trust), London, UK
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Sonia Nielles-Vallespin
- Cardiovascular Magnetic Resonance Unit, The Royal Brompton Hospital (Guy's and St Thomas' NHS Foundation Trust), London, UK
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Andrew D Scott
- Cardiovascular Magnetic Resonance Unit, The Royal Brompton Hospital (Guy's and St Thomas' NHS Foundation Trust), London, UK
- National Heart and Lung Institute, Imperial College London, London, UK
| | - Alistair A Young
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK
| |
Collapse
|