1
|
Li S, Kendrick J, Ebert MA, Hassan GM, Barry N, Wright K, Lee SC, Bellinge JW, Schultz C. Auto-segmentation, radiomic reproducibility, and comparison of radiomics between manual and AI-derived segmentations for coronary arteries in cardiac [ 18F]NaF PET/CT images. EJNMMI Phys 2025; 12:42. [PMID: 40287890 PMCID: PMC12034606 DOI: 10.1186/s40658-025-00751-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2024] [Accepted: 03/24/2025] [Indexed: 04/29/2025] Open
Abstract
BACKGROUND [18F]NaF is a potential biomarker for assessing cardiac risk. Automated analysis of [18F]NaF positron emission tomography (PET) images, specifically through quantitative image analysis ("radiomics"), can potentially enhance diagnostic accuracy and personalised patient management. However, it is essential to evaluate the reproducibility and reliability of radiomic features to ensure their clinical applicability. This study aimed to (i) develop and evaluate an automated model for coronary artery segmentation using [18F]NaF PET and calcium scoring computed tomography (CSCT) images, (ii) assess inter- and intra-observer radiomic reproducibility from manual segmentations, and (iii) evaluate the radiomics reliability from AI-derived segmentations by comparison with manual segmentations. RESULTS 141 patients from the "effects of Vitamin K and Colchicine on vascular calcification activity" (VikCoVac, ACTRN12616000024448) trial were included. 113 were used to train an auto-segmentation model using nnUNet on [18F]NaF PET and CSCT images. Reproducibility of inter- and intra-observer radiomics and reliability of radiomics from AI-derived segmentations was assessed using lower bound of intraclass correlation coefficient (ICC). The auto-segmentation model achieved an average Dice Similarity Coefficient of 0.61 ± 0.05, having no statistically significant difference compared to the intra-observer variability (p = 0.922). For the unfiltered images, 47(12.6%) CT and 25(7.5%) PET radiomics were inter-observer reproducible, while 133(35.8%) CT and 57(15.3%) PET radiomics were intra-observer reproducible. 7(9.7%) CT and 18(25.0%) PET first-order features, as well as 17(17.7%) CT GLCM features, were reproducible for both inter- and intra-observer analyses. 9.8% and 16.8% of radiomics from AI-derived segmentations showed excellent and good reliability. First-order features were most reliable (ICC > 0.75; 78/144[54.2%]) and shape features least (2/112[1.8%]). CT features demonstrated greater reliability (147/428[34.3%]) than PET (81/428 [18.9%]). Features from the left anterior descending (76/214[35.5%]) and right coronary artery (75/214[35.0%]) were more reliability than the circumflex (49/214[22.9%]) and left main (28/214[13.1%]) arteries. CONCLUSIONS An effective segmentation model for coronary arteries was developed and reproducible [18F]NaF PET/CSCT radiomics were identified through inter- and intra-observer assessments, supporting their clinical applicability. The reliability of radiomics from AI-derived segmentations compared to manual segmentations was highlighted. The novelty of [18F]NaF as a biomarker underscores its potential in providing unique insights into vascular calcification activity and cardiac risk assessment. CLINICAL TRIAL REGISTRATION VIKCOVAC trial ("effects of Vitamin K and Colchicine on vascular calcification activity"). Unique identifier: ACTRN12616000024448. URL: https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=368825 .
Collapse
Affiliation(s)
- Suning Li
- School of Physics, Mathematics and Computer Science, University of Western Australia, Crawley, WA, Australia.
- Department of Radiation Oncology, Sir Charles Gairdner Hospital, Nedlands, WA, Australia.
- Centre for Advanced Technologies in Cancer Research (CATCR), Perth, WA, Australia.
- Australian Centre for Quantitative Imaging, Medical School, University of Western Australia, Crawley, WA, Australia.
| | - Jake Kendrick
- School of Physics, Mathematics and Computer Science, University of Western Australia, Crawley, WA, Australia
- Centre for Advanced Technologies in Cancer Research (CATCR), Perth, WA, Australia
- Australian Centre for Quantitative Imaging, Medical School, University of Western Australia, Crawley, WA, Australia
| | - Martin A Ebert
- School of Physics, Mathematics and Computer Science, University of Western Australia, Crawley, WA, Australia
- Department of Radiation Oncology, Sir Charles Gairdner Hospital, Nedlands, WA, Australia
- Centre for Advanced Technologies in Cancer Research (CATCR), Perth, WA, Australia
- Australian Centre for Quantitative Imaging, Medical School, University of Western Australia, Crawley, WA, Australia
| | - Ghulam Mubashar Hassan
- School of Physics, Mathematics and Computer Science, University of Western Australia, Crawley, WA, Australia
- Australian Centre for Quantitative Imaging, Medical School, University of Western Australia, Crawley, WA, Australia
| | - Nathaniel Barry
- School of Physics, Mathematics and Computer Science, University of Western Australia, Crawley, WA, Australia
- Centre for Advanced Technologies in Cancer Research (CATCR), Perth, WA, Australia
| | - Keaton Wright
- Department of Electrical, Electronic and Computer Engineering, University of Western Australia, Crawley, WA, Australia
| | - Sing Ching Lee
- Department of Cardiology, Royal Perth Hospital, Perth, WA, Australia
| | - Jamie W Bellinge
- Medical School, University of Western Australia, Crawley, WA, Australia
- Department of Nuclear Medicine, Sir Charles Gairdner Hospital, Nedlands, WA, Australia
| | - Carl Schultz
- Medical School, University of Western Australia, Crawley, WA, Australia
- Department of Cardiology, Royal Perth Hospital, Perth, WA, Australia
| |
Collapse
|
2
|
Loap P, Monteil R, Kirova Y, Vu-Bezin J. Automated contouring for breast cancer radiotherapy in the isocentric lateral decubitus position: a neural network-based solution for enhanced precision and efficiency. Strahlenther Onkol 2025:10.1007/s00066-024-02364-x. [PMID: 39900818 DOI: 10.1007/s00066-024-02364-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Accepted: 12/18/2024] [Indexed: 02/05/2025]
Abstract
BACKGROUND Adjuvant radiotherapy is essential for reducing local recurrence and improving survival in breast cancer patients, but it carries a risk of ischemic cardiac toxicity, which increases with heart exposure. The isocentric lateral decubitus position, where the breast rests flat on a support, reduces heart exposure and leads to delivery of a more uniform dose. This position is particularly beneficial for patients with unique anatomies, such as those with pectus excavatum or larger breast sizes. While artificial intelligence (AI) algorithms for autocontouring have shown promise, they have not been tailored to this specific position. This study aimed to develop and evaluate a neural network-based autocontouring algorithm for patients treated in the isocentric lateral decubitus position. MATERIALS AND METHODS In this single-center study, 1189 breast cancer patients treated after breast-conserving surgery were included. Their simulation CT scans (1209 scans) were used to train and validate a neural network-based autocontouring algorithm (nnU-Net). Of these, 1087 scans were used for training, and 122 scans were reserved for validation. The algorithm's performance was assessed using the Dice similarity coefficient (DSC) to compare the automatically delineated volumes with manual contours. A clinical evaluation of the algorithm was performed on 30 additional patients, with contours rated by two expert radiation oncologists. RESULTS The neural network-based algorithm achieved a segmentation time of approximately 4 min, compared to 20 min for manual segmentation. The DSC values for the validation cohort were 0.88 for the treated breast, 0.90 for the heart, 0.98 for the right lung, and 0.97 for the left lung. In the clinical evaluation, 90% of the automatically contoured breast volumes were rated as acceptable without corrections, while the remaining 10% required minor adjustments. All lung contours were accepted without corrections, and heart contours were rated as acceptable in 93.3% of cases, with minor corrections needed in 6.6% of cases. CONCLUSION This neural network-based autocontouring algorithm offers a practical, time-saving solution for breast cancer radiotherapy planning in the isocentric lateral decubitus position. Its strong geometric performance, clinical acceptability, and significant time efficiency make it a valuable tool for modern radiotherapy practices, particularly in high-volume centers.
Collapse
Affiliation(s)
- Pierre Loap
- Department of radiation oncology, Institut Curie, Paris, France.
- Laboratoire d'imagerie translationnelle en oncologie, Institut Curie, Orsay, France.
| | - Rémi Monteil
- Department of radiation oncology, Institut Curie, Paris, France
| | - Youlia Kirova
- Department of radiation oncology, Institut Curie, Paris, France
| | - Jérémi Vu-Bezin
- Department of radiation oncology, Institut Curie, Paris, France
| |
Collapse
|
3
|
Finnegan RN, Quinn A, Booth J, Belous G, Hardcastle N, Stewart M, Griffiths B, Carroll S, Thwaites DI. Cardiac substructure delineation in radiation therapy - A state-of-the-art review. J Med Imaging Radiat Oncol 2024; 68:914-949. [PMID: 38757728 PMCID: PMC11686467 DOI: 10.1111/1754-9485.13668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Accepted: 04/29/2024] [Indexed: 05/18/2024]
Abstract
Delineation of cardiac substructures is crucial for a better understanding of radiation-related cardiotoxicities and to facilitate accurate and precise cardiac dose calculation for developing and applying risk models. This review examines recent advancements in cardiac substructure delineation in the radiation therapy (RT) context, aiming to provide a comprehensive overview of the current level of knowledge, challenges and future directions in this evolving field. Imaging used for RT planning presents challenges in reliably visualising cardiac anatomy. Although cardiac atlases and contouring guidelines aid in standardisation and reduction of variability, significant uncertainties remain in defining cardiac anatomy. Coupled with the inherent complexity of the heart, this necessitates auto-contouring for consistent large-scale data analysis and improved efficiency in prospective applications. Auto-contouring models, developed primarily for breast and lung cancer RT, have demonstrated performance comparable to manual contouring, marking a significant milestone in the evolution of cardiac delineation practices. Nevertheless, several key concerns require further investigation. There is an unmet need for expanding cardiac auto-contouring models to encompass a broader range of cancer sites. A shift in focus is needed from ensuring accuracy to enhancing the robustness and accessibility of auto-contouring models. Addressing these challenges is paramount for the integration of cardiac substructure delineation and associated risk models into routine clinical practice, thereby improving the safety of RT for future cancer patients.
Collapse
Affiliation(s)
- Robert N Finnegan
- Northern Sydney Cancer CentreRoyal North Shore HospitalSydneyNew South WalesAustralia
- Institute of Medical Physics, School of Physics, University of SydneySydneyNew South WalesAustralia
| | - Alexandra Quinn
- Northern Sydney Cancer CentreRoyal North Shore HospitalSydneyNew South WalesAustralia
| | - Jeremy Booth
- Northern Sydney Cancer CentreRoyal North Shore HospitalSydneyNew South WalesAustralia
- Institute of Medical Physics, School of Physics, University of SydneySydneyNew South WalesAustralia
| | - Gregg Belous
- Australian e‐Health Research CentreCommonwealth Scientific and Industrial Research OrganisationBrisbaneQueenslandAustralia
| | - Nicholas Hardcastle
- Department of Physical SciencesPeter MacCallum Cancer CentreMelbourneVictoriaAustralia
- Sir Peter MacCallum Department of OncologyUniversity of MelbourneMelbourneVictoriaAustralia
| | - Maegan Stewart
- Northern Sydney Cancer CentreRoyal North Shore HospitalSydneyNew South WalesAustralia
- School of Health Sciences, Faculty of Medicine and HealthUniversity of SydneySydneyNew South WalesAustralia
| | - Brooke Griffiths
- Northern Sydney Cancer CentreRoyal North Shore HospitalSydneyNew South WalesAustralia
| | - Susan Carroll
- Northern Sydney Cancer CentreRoyal North Shore HospitalSydneyNew South WalesAustralia
- School of Health Sciences, Faculty of Medicine and HealthUniversity of SydneySydneyNew South WalesAustralia
| | - David I Thwaites
- Institute of Medical Physics, School of Physics, University of SydneySydneyNew South WalesAustralia
- Radiotherapy Research GroupLeeds Institute of Medical Research, St James's Hospital and University of LeedsLeedsUK
| |
Collapse
|
4
|
Zhang SC, Nikolova AP, Kamrava M, Mak RH, Atkins KM. A roadmap for modelling radiation-induced cardiac disease. J Med Imaging Radiat Oncol 2024; 68:950-961. [PMID: 38985978 DOI: 10.1111/1754-9485.13716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 05/21/2024] [Indexed: 07/12/2024]
Abstract
Cardiac risk mitigation is a major priority in improving outcomes for cancer survivors as advances in cancer screening and treatments continue to decrease cancer mortality. More than half of adult cancer patients will be treated with radiotherapy (RT); therefore it is crucial to develop a framework for how to assess and predict radiation-induced cardiac disease (RICD). Historically, RICD was modelled solely using whole heart metrics such as mean heart dose. However, data over the past decade has identified cardiac substructures which outperform whole heart metrics in predicting for significant cardiac events. Additionally, non-RT factors such as pre-existing cardiovascular risk factors and toxicity from other therapies contribute to risk of future cardiac events. In this review, we aim to discuss the current evidence and knowledge gaps in predicting RICD and provide a roadmap for the development of comprehensive models based on three interrelated components, (1) baseline CV risk assessment, (2) cardiac substructure radiation dosimetry linked with cardiac-specific outcomes and (3) novel biomarker development.
Collapse
Affiliation(s)
- Samuel C Zhang
- Department of Radiation Oncology, Cedars-Sinai Medical Center, Los Angeles, California, USA
| | - Andriana P Nikolova
- Department of Cardiology, Cedars-Sinai Medical Center, Los Angeles, California, USA
| | - Mitchell Kamrava
- Department of Radiation Oncology, Cedars-Sinai Medical Center, Los Angeles, California, USA
| | - Raymond H Mak
- Department of Radiation Oncology, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Katelyn M Atkins
- Department of Radiation Oncology, Cedars-Sinai Medical Center, Los Angeles, California, USA
- Department of Cardiology, Cedars-Sinai Medical Center, Los Angeles, California, USA
| |
Collapse
|
5
|
Barcellini A, Rordorf R, Dusi V, Fontana G, Pepe A, Vai A, Schirinzi S, Vitolo V, Orlandi E, Greco A. Pilot study to assess the early cardiac safety of carbon ion radiotherapy for intra- and para-cardiac tumours. Strahlenther Onkol 2024; 200:1080-1087. [PMID: 39212688 DOI: 10.1007/s00066-024-02270-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Accepted: 07/03/2024] [Indexed: 09/04/2024]
Abstract
PURPOSE Modern photon radiotherapy effectively spares cardiac structures more than previous volumetric approaches. Still, it is related to non-negligible cardiac toxicity due to the low-dose bath of surrounding normal tissues. However, the dosimetric advantages of particle radiotherapy make it a promising treatment for para- and intra-cardiac tumours. In the current short report, we evaluate the cardiac safety profile of carbon ion radiotherapy (CIRT) for radioresistant intra- and para-cardiac malignancies in a real-world setting. METHODS We retrospectively analysed serum biomarkers (TnI, CRP and NT-proBNP), echocardiographic, and both 12-lead and 24-hour Holter electrocardiogram (ECG) data of consecutive patients with radioresistant intra- and para-cardiac tumours irradiated with CIRT between June 2019 and September 2022. In the CIRT planning optimization process, to minimize the delivered doses, we contoured and gave a high priority to the cardiac substructures. Weekly re-evaluative 4D computed tomography scans were carried out throughout the treatment. RESULTS A total of 16 patients with intra- and para-cardiac localizations of radioresistant tumours were treated up to a total dose of 70.4 Gy relative biological effectiveness (RBE) and a mean heart dose of 2.41 Gy(RBE). We did not record any significant variation of the analysed serum biomarkers after CIRT nor significant changes of echocardiographic features, biventricular strain, or 12-lead and 24-hour Holter ECG parameters during 6 months of follow-up. CONCLUSION Our pilot study suggests that carbon ion radiotherapy is a promising radiation technique capable of sparing off-target side effects at the cardiac level. A larger cohort, long-term follow-up and further prospective studies are needed to confirm these findings.
Collapse
Affiliation(s)
- Amelia Barcellini
- Department of Internal Medicine and Therapeutics, University of Pavia, 27100, Pavia, Italy
- Radiation Oncology Unit, Clinical Department, CNAO National Center for Oncological Hadrontherapy, 27100, Pavia, Italy
| | - Roberto Rordorf
- Division of Cardiology, Fondazione IRCCS Policlinico San Matteo, 27100, Pavia, Italy
- Arrhythmia and Electrophysiology Unit, Fondazione IRCCS Policlinico San Matteo, 27100, Pavia, Italy
| | - Veronica Dusi
- Division of Cardiology, Department of Medical Sciences, University of Turin, 10126, Torino, Italy
| | - Giulia Fontana
- Clinical Department, CNAO National Center for Oncological Hadrontherapy, Via Erminio Borloni 1, 27100, Pavia, Italy.
| | - Antonella Pepe
- Division of Cardiology, Fondazione IRCCS Policlinico San Matteo, 27100, Pavia, Italy
- Division of Cardiology, Cardio-Thoracic Department, San Carlo Borromeo Hospital (ASST Santi Paolo e Carlo), 20100, Milano, Italy
| | - Alessandro Vai
- Medical Physics Unit, Clinical Department, CNAO National Center for Oncological Hadrontherapy, 27100, Pavia, Italy
| | - Sandra Schirinzi
- Division of Cardiology, Fondazione IRCCS Policlinico San Matteo, 27100, Pavia, Italy
| | - Viviana Vitolo
- Radiation Oncology Unit, Clinical Department, CNAO National Center for Oncological Hadrontherapy, 27100, Pavia, Italy
| | - Ester Orlandi
- Radiation Oncology Unit, Clinical Department, CNAO National Center for Oncological Hadrontherapy, 27100, Pavia, Italy
- Department of Clinical, Surgical, Diagnostic, and Pediatric Sciences, University of Pavia, 27100, Pavia, Italy
| | - Alessandra Greco
- Division of Cardiology, Fondazione IRCCS Policlinico San Matteo, 27100, Pavia, Italy
| |
Collapse
|
6
|
Summerfield N, Morris E, Banerjee S, He Q, Ghanem AI, Zhu S, Zhao J, Dong M, Glide-Hurst C. Enhancing Precision in Cardiac Segmentation for Magnetic Resonance-Guided Radiation Therapy Through Deep Learning. Int J Radiat Oncol Biol Phys 2024; 120:904-914. [PMID: 38797498 PMCID: PMC11427143 DOI: 10.1016/j.ijrobp.2024.05.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Revised: 04/25/2024] [Accepted: 05/17/2024] [Indexed: 05/29/2024]
Abstract
PURPOSE Cardiac substructure dose metrics are more strongly linked to late cardiac morbidities than to whole-heart metrics. Magnetic resonance (MR)-guided radiation therapy (MRgRT) enables substructure visualization during daily localization, allowing potential for enhanced cardiac sparing. We extend a publicly available state-of-the-art deep learning framework, "No New" U-Net, to incorporate self-distillation (nnU-Net.wSD) for substructure segmentation for MRgRT. METHODS AND MATERIALS Eighteen (institute A) patients who underwent thoracic or abdominal radiation therapy on a 0.35 T MR-guided linear accelerator were retrospectively evaluated. On each image, 1 of 2 radiation oncologists delineated reference contours of 12 cardiac substructures (chambers, great vessels, and coronary arteries) used to train (n = 10), validate (n = 3), and test (n = 5) nnU-Net.wSD by leveraging a teacher-student network and comparing it to standard 3-dimensional U-Net. The impact of using simulation data or including 3 to 4 daily images for augmentation during training was evaluated for nnU-Net.wSD. Geometric metrics (Dice similarity coefficient, mean distance to agreement, and 95% Hausdorff distance), visual inspection, and clinical dose-volume histograms were evaluated. To determine generalizability, institute A's model was tested on an unlabeled data set from institute B (n = 22) and evaluated via consensus scoring and volume comparisons. RESULTS nnU-Net.wSD yielded a Dice similarity coefficient (reported mean ± SD) of 0.65 ± 0.25 across the 12 substructures (chambers, 0.85 ± 0.05; great vessels, 0.67 ± 0.19; and coronary arteries, 0.33 ± 0.16; mean distance to agreement, <3 mm; mean 95% Hausdorff distance, <9 mm) while outperforming the 3-dimensional U-Net (0.583 ± 0.28; P <.01). Leveraging fractionated data for augmentation improved over a single MR simulation time point (0.579 ± 0.29; P <.01). Predicted contours yielded dose-volume histograms that closely matched those of the clinical treatment plans where mean and maximum (ie, dose to 0.03 cc) doses deviated by 0.32 ± 0.5 Gy and 1.42 ± 2.6 Gy, respectively. There were no statistically significant differences between institute A and B volumes (P >.05) for 11 of 12 substructures, with larger volumes requiring minor changes and coronary arteries exhibiting more variability. CONCLUSIONS This work is a critical step toward rapid and reliable cardiac substructure segmentation to improve cardiac sparing in low-field MRgRT.
Collapse
Affiliation(s)
- Nicholas Summerfield
- Department of Medical Physics, University of Wisconsin – Madison
- Department of Human Oncology, University of Wisconsin – Madison
| | - Eric Morris
- Department of Radiation Oncology, Washington University of Medicine in St. Louis
| | | | - Qisheng He
- Department of Computer Science, Wayne State University
| | - Ahmed I Ghanem
- Department of Radiation Oncology, Henry Ford Cancer Institute
- Alexandria Department of Clinical Oncology, Faculty of Medicine, Alexandria University, Egypt
| | - Simeng Zhu
- Department of Radiation Oncology, The Ohio State University
| | - Jiwei Zhao
- Department of Biostatistics and Medical Informatics, University of Wisconsin – Madison
| | - Ming Dong
- Department of Computer Science, Wayne State University
| | - Carri Glide-Hurst
- Department of Medical Physics, University of Wisconsin – Madison
- Department of Human Oncology, University of Wisconsin – Madison
| |
Collapse
|
7
|
Szentimrey Z, Al-Hayali A, de Ribaupierre S, Fenster A, Ukwatta E. Semi-supervised learning framework with shape encoding for neonatal ventricular segmentation from 3D ultrasound. Med Phys 2024; 51:6134-6148. [PMID: 38857570 DOI: 10.1002/mp.17242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 05/27/2024] [Accepted: 05/27/2024] [Indexed: 06/12/2024] Open
Abstract
BACKGROUND Three-dimensional (3D) ultrasound (US) imaging has shown promise in non-invasive monitoring of changes in the lateral brain ventricles of neonates suffering from intraventricular hemorrhaging. Due to the poorly defined anatomical boundaries and low signal-to-noise ratio, fully supervised methods for segmentation of the lateral ventricles in 3D US images require a large dataset of annotated images by trained physicians, which is tedious, time-consuming, and expensive. Training fully supervised segmentation methods on a small dataset may lead to overfitting and hence reduce its generalizability. Semi-supervised learning (SSL) methods for 3D US segmentation may be able to address these challenges but most existing SSL methods have been developed for magnetic resonance or computed tomography (CT) images. PURPOSE To develop a fast, lightweight, and accurate SSL method, specifically for 3D US images, that will use unlabeled data towards improving segmentation performance. METHODS We propose an SSL framework that leverages the shape-encoding ability of an autoencoder network to enforce complex shape and size constraints on a 3D U-Net segmentation model. The autoencoder created pseudo-labels, based on the 3D U-Net predicted segmentations, that enforces shape constraints. An adversarial discriminator network then determined whether images came from the labeled or unlabeled data distributions. We used 887 3D US images, of which 87 had manually annotated labels and 800 images were unlabeled. Training/validation/testing sets of 25/12/50, 25/12/25 and 50/12/25 images were used for model experimentation. The Dice similarity coefficient (DSC), mean absolute surface distance (MAD), and absolute volumetric difference (VD) were used as metrics for comparing to other benchmarks. The baseline benchmark was the fully supervised vanilla 3D U-Net while dual task consistency, shape-aware semi-supervised network, correlation-aware mutual learning, and 3D U-Net Ensemble models were used as state-of-the-art benchmarks with DSC, MAD, and VD as comparison metrics. The Wilcoxon signed-rank test was used to test statistical significance between algorithms for DSC and VD with the threshold being p < 0.05 and corrected to p < 0.01 using the Bonferroni correction. The random-access memory (RAM) trace and number of trainable parameters were used to compare the computing efficiency between models. RESULTS Relative to the baseline 3D U-Net model, our shape-encoding SSL method reported a mean DSC improvement of 6.5%, 7.7%, and 4.1% with a 95% confidence interval of 4.2%, 5.7%, and 2.1% using image data splits of 25/12/50, 25/12/25, and 50/12/25, respectively. Our method only used a 1GB increase in RAM compared to the baseline 3D U-Net and required less than half the RAM and trainable parameters compared to the 3D U-Net ensemble method. CONCLUSIONS Based on our extensive literature survey, this is one of the first reported works to propose an SSL method designed for segmenting organs in 3D US images and specifically one that incorporates unlabeled data for segmenting neonatal cerebral lateral ventricles. When compared to the state-of-the-art SSL and fully supervised learning methods, our method yielded the highest DSC and lowest VD while being computationally efficient.
Collapse
Affiliation(s)
| | | | - Sandrine de Ribaupierre
- Department of Clinical Neurological Sciences, London Health Sciences Centre, London, Ontario, Canada
| | - Aaron Fenster
- Robarts Research Institute, University of Western Ontario, London, Ontario, Canada
| | - Eranga Ukwatta
- School of Engineering, University of Guelph, Guelph, Ontario, Canada
| |
Collapse
|
8
|
Chen X, Mumme RP, Corrigan KL, Mukai-Sasaki Y, Koutroumpakis E, Palaskas NL, Nguyen CM, Zhao Y, Huang K, Yu C, Xu T, Daniel A, Balter PA, Zhang X, Niedzielski JS, Shete SS, Deswal A, Court LE, Liao Z, Yang J. Deep learning-based automatic segmentation of cardiac substructures for lung cancers. Radiother Oncol 2024; 191:110061. [PMID: 38122850 PMCID: PMC12005477 DOI: 10.1016/j.radonc.2023.110061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 11/09/2023] [Accepted: 12/13/2023] [Indexed: 12/23/2023]
Abstract
PURPOSE Accurate and comprehensive segmentation of cardiac substructures is crucial for minimizing the risk of radiation-induced heart disease in lung cancer radiotherapy. We sought to develop and validate deep learning-based auto-segmentation models for cardiac substructures. MATERIALS AND METHODS Nineteen cardiac substructures (whole heart, 4 heart chambers, 6 great vessels, 4 valves, and 4 coronary arteries) in 100 patients treated for non-small cell lung cancer were manually delineated by two radiation oncologists. The valves and coronary arteries were delineated as planning risk volumes. An nnU-Net auto-segmentation model was trained, validated, and tested on this dataset with a split ratio of 75:5:20. The auto-segmented contours were evaluated by comparing them with manually drawn contours in terms of Dice similarity coefficient (DSC) and dose metrics extracted from clinical plans. An independent dataset of 42 patients was used for subjective evaluation of the auto-segmentation model by 4 physicians. RESULTS The average DSCs were 0.95 (+/- 0.01) for the whole heart, 0.91 (+/- 0.02) for 4 chambers, 0.86 (+/- 0.09) for 6 great vessels, 0.81 (+/- 0.09) for 4 valves, and 0.60 (+/- 0.14) for 4 coronary arteries. The average absolute errors in mean/max doses to all substructures were 1.04 (+/- 1.99) Gy and 2.20 (+/- 4.37) Gy. The subjective evaluation revealed that 94% of the auto-segmented contours were clinically acceptable. CONCLUSION We demonstrated the effectiveness of our nnU-Net model for delineating cardiac substructures, including coronary arteries. Our results indicate that this model has promise for studies regarding radiation dose to cardiac substructures.
Collapse
Affiliation(s)
- Xinru Chen
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States
| | - Raymond P Mumme
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Kelsey L Corrigan
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Yuki Mukai-Sasaki
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; Advanced Medical Center, Shonan Kamakura General Hospital, Kamakura, Japan
| | - Efstratios Koutroumpakis
- Department of Cardiology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Nicolas L Palaskas
- Department of Cardiology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Callistus M Nguyen
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Yao Zhao
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States
| | - Kai Huang
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States
| | - Cenji Yu
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States
| | - Ting Xu
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Aji Daniel
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Peter A Balter
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States
| | - Xiaodong Zhang
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States
| | - Joshua S Niedzielski
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States
| | - Sanjay S Shete
- The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States; Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Anita Deswal
- Department of Cardiology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Laurence E Court
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States
| | - Zhongxing Liao
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States
| | - Jinzhong Yang
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States; The University of Texas MD Anderson Cancer Center UTHealth Houston Graduate School of Biomedical Sciences, Houston, TX 77030, United States.
| |
Collapse
|
9
|
Eidex Z, Ding Y, Wang J, Abouei E, Qiu RLJ, Liu T, Wang T, Yang X. Deep learning in MRI-guided radiation therapy: A systematic review. J Appl Clin Med Phys 2024; 25:e14155. [PMID: 37712893 PMCID: PMC10860468 DOI: 10.1002/acm2.14155] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 05/10/2023] [Accepted: 08/21/2023] [Indexed: 09/16/2023] Open
Abstract
Recent advances in MRI-guided radiation therapy (MRgRT) and deep learning techniques encourage fully adaptive radiation therapy (ART), real-time MRI monitoring, and the MRI-only treatment planning workflow. Given the rapid growth and emergence of new state-of-the-art methods in these fields, we systematically review 197 studies written on or before December 31, 2022, and categorize the studies into the areas of image segmentation, image synthesis, radiomics, and real time MRI. Building from the underlying deep learning methods, we discuss their clinical importance and current challenges in facilitating small tumor segmentation, accurate x-ray attenuation information from MRI, tumor characterization and prognosis, and tumor motion tracking. In particular, we highlight the recent trends in deep learning such as the emergence of multi-modal, visual transformer, and diffusion models.
Collapse
Affiliation(s)
- Zach Eidex
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGeorgiaUSA
- School of Mechanical EngineeringGeorgia Institute of TechnologyAtlantaGeorgiaUSA
| | - Yifu Ding
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGeorgiaUSA
| | - Jing Wang
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGeorgiaUSA
| | - Elham Abouei
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGeorgiaUSA
| | - Richard L. J. Qiu
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGeorgiaUSA
| | - Tian Liu
- Department of Radiation OncologyIcahn School of Medicine at Mount SinaiNew YorkNew YorkUSA
| | - Tonghe Wang
- Department of Medical PhysicsMemorial Sloan Kettering Cancer CenterNew YorkNew YorkUSA
| | - Xiaofeng Yang
- Department of Radiation Oncology and Winship Cancer InstituteEmory UniversityAtlantaGeorgiaUSA
- School of Mechanical EngineeringGeorgia Institute of TechnologyAtlantaGeorgiaUSA
| |
Collapse
|
10
|
Kumari V, Kumar N, Kumar K S, Kumar A, Skandha SS, Saxena S, Khanna NN, Laird JR, Singh N, Fouda MM, Saba L, Singh R, Suri JS. Deep Learning Paradigm and Its Bias for Coronary Artery Wall Segmentation in Intravascular Ultrasound Scans: A Closer Look. J Cardiovasc Dev Dis 2023; 10:485. [PMID: 38132653 PMCID: PMC10743870 DOI: 10.3390/jcdd10120485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 10/15/2023] [Accepted: 11/07/2023] [Indexed: 12/23/2023] Open
Abstract
BACKGROUND AND MOTIVATION Coronary artery disease (CAD) has the highest mortality rate; therefore, its diagnosis is vital. Intravascular ultrasound (IVUS) is a high-resolution imaging solution that can image coronary arteries, but the diagnosis software via wall segmentation and quantification has been evolving. In this study, a deep learning (DL) paradigm was explored along with its bias. METHODS Using a PRISMA model, 145 best UNet-based and non-UNet-based methods for wall segmentation were selected and analyzed for their characteristics and scientific and clinical validation. This study computed the coronary wall thickness by estimating the inner and outer borders of the coronary artery IVUS cross-sectional scans. Further, the review explored the bias in the DL system for the first time when it comes to wall segmentation in IVUS scans. Three bias methods, namely (i) ranking, (ii) radial, and (iii) regional area, were applied and compared using a Venn diagram. Finally, the study presented explainable AI (XAI) paradigms in the DL framework. FINDINGS AND CONCLUSIONS UNet provides a powerful paradigm for the segmentation of coronary walls in IVUS scans due to its ability to extract automated features at different scales in encoders, reconstruct the segmented image using decoders, and embed the variants in skip connections. Most of the research was hampered by a lack of motivation for XAI and pruned AI (PAI) models. None of the UNet models met the criteria for bias-free design. For clinical assessment and settings, it is necessary to move from a paper-to-practice approach.
Collapse
Affiliation(s)
- Vandana Kumari
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (S.K.K.)
| | - Naresh Kumar
- Department of Applied Computational Science and Engineering, G L Bajaj Institute of Technology and Management, Greater Noida 201310, India
| | - Sampath Kumar K
- School of Computer Science and Engineering, Galgotias University, Greater Noida 201310, India; (V.K.); (S.K.K.)
| | - Ashish Kumar
- School of CSET, Bennett University, Greater Noida 201310, India;
| | - Sanagala S. Skandha
- Department of CSE, CMR College of Engineering and Technology, Hyderabad 501401, India;
| | - Sanjay Saxena
- Department of Computer Science and Engineering, IIT Bhubaneswar, Bhubaneswar 751003, India;
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110076, India;
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St Helena, CA 94574, USA;
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era, Deemed to be University, Dehradun 248002, India;
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09100 Cagliari, Italy;
| | - Rajesh Singh
- Department of Research and Innovation, Uttaranchal Institute of Technology, Uttaranchal University, Dehradun 248007, India;
| | - Jasjit S. Suri
- Stroke Diagnostics and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
- Department of Computer Science & Engineering, Graphic Era, Deemed to be University, Dehradun 248002, India
- Monitoring and Diagnosis Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
11
|
Wang X, Li X, Du R, Zhong Y, Lu Y, Song T. Anatomical Prior-Based Automatic Segmentation for Cardiac Substructures from Computed Tomography Images. Bioengineering (Basel) 2023; 10:1267. [PMID: 38002391 PMCID: PMC10669053 DOI: 10.3390/bioengineering10111267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 10/12/2023] [Accepted: 10/24/2023] [Indexed: 11/26/2023] Open
Abstract
Cardiac substructure segmentation is a prerequisite for cardiac diagnosis and treatment, providing a basis for accurate calculation, modeling, and analysis of the entire cardiac structure. CT (computed tomography) imaging can be used for a noninvasive qualitative and quantitative evaluation of the cardiac anatomy and function. Cardiac substructures have diverse grayscales, fuzzy boundaries, irregular shapes, and variable locations. We designed a deep learning-based framework to improve the accuracy of the automatic segmentation of cardiac substructures. This framework integrates cardiac anatomical knowledge; it uses prior knowledge of the location, shape, and scale of cardiac substructures and separately processes the structures of different scales. Through two successive segmentation steps with a coarse-to-fine cascaded network, the more easily segmented substructures were coarsely segmented first; then, the more difficult substructures were finely segmented. The coarse segmentation result was used as prior information and combined with the original image as the input for the model. Anatomical knowledge of the large-scale substructures was embedded into the fine segmentation network to guide and train the small-scale substructures, achieving efficient and accurate segmentation of ten cardiac substructures. Sixty cardiac CT images and ten substructures manually delineated by experienced radiologists were retrospectively collected; the model was evaluated using the DSC (Dice similarity coefficient), Recall, Precision, and the Hausdorff distance. Compared with current mainstream segmentation models, our approach demonstrated significantly higher segmentation accuracy, with accurate segmentation of ten substructures of different shapes and sizes, indicating that the segmentation framework fused with prior anatomical knowledge has superior segmentation performance and can better segment small targets in multi-target segmentation tasks.
Collapse
Grants
- Grant 12126610, Grant 81971691, Grant 81801809, Grant 81830052, Grant 81827802, and Grant U1811461,Grant 201804020053,Grant 2018B030312002,Grant 20190302108GX,grant 18DZ2260400, grant 2020B1212060032, Grant 2021B0101190003. Yao Lu
Collapse
Affiliation(s)
- Xuefang Wang
- Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511400, China;
| | - Xinyi Li
- Department of Radiology, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou 510150, China;
| | - Ruxu Du
- Guangzhou Janus Biotechnology Co., Ltd., Guangzhou 511400, China;
| | - Yong Zhong
- Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou 511400, China;
| | - Yao Lu
- School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510275, China
- Guangdong Province Key Laboratory of Computational Science, Sun Yat-sen University, Guangzhou 510275, China
- State Key Laboratory of Oncology in South China, Guangzhou 510060, China
| | - Ting Song
- Department of Radiology, The Third Affiliated Hospital of Guangzhou Medical University, Guangzhou 510150, China;
| |
Collapse
|
12
|
Morris E, Chin R, Wu T, Smith C, Nejad-Davarani S, Cao M. ASSET: Auto-Segmentation of the Seventeen SEgments for Ventricular Tachycardia Ablation in Radiation Therapy. Cancers (Basel) 2023; 15:4062. [PMID: 37627090 PMCID: PMC10452457 DOI: 10.3390/cancers15164062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 08/03/2023] [Accepted: 08/08/2023] [Indexed: 08/27/2023] Open
Abstract
There has been a recent effort to treat high-risk ventricular tachycardia (VT) patients through radio-ablation. However, manual segmentation of the VT target is complex and time-consuming. This work introduces ASSET, or Auto-segmentation of the Seventeen SEgments for Tachycardia ablation, to aid in radiation therapy (RT) planning. ASSET was retrospectively applied to CTs for 26 thoracic RT patients (13 undergoing VT ablation). The physician-defined parasternal long-axis of the left ventricle (LV) and the axes generated from principal component analysis (PCA) were compared using mean distance to agreement (MDA) and angle of separation. The manually selected right ventricle insertion point and LVs were used to apply the ASSET model to automatically generate the 17 segments of the LV myocardium (LVM). Physician-defined parasternal long-axis differed from PCA by 1.2 ± 0.3 mm MDA and 6.9 ± 0.7 degrees. Segments differed by 0.69 ± 0.29 mm MDA and 0.89 ± 0.03 Dice similarity coefficient. Running ASSET takes <5 min where manual segmentation took >2 h/patient. Agreement between ASSET and expert contours was comparable to inter-observer variability. Qualitative scoring conducted by three experts revealed automatically generated segmentations were clinically useable as-is. ASSET offers efficient and reliable automatic segmentations for the 17 segments of the LVM for target generation in RT planning.
Collapse
Affiliation(s)
- Eric Morris
- Department of Radiation Oncology, Washington University, St. Louis, MO 63110, USA
| | - Robert Chin
- Department of Radiation Oncology, UCLA Health, Los Angeles, CA 90095, USA; (R.C.); (T.W.); (C.S.)
| | - Trudy Wu
- Department of Radiation Oncology, UCLA Health, Los Angeles, CA 90095, USA; (R.C.); (T.W.); (C.S.)
| | - Clayton Smith
- Department of Radiation Oncology, UCLA Health, Los Angeles, CA 90095, USA; (R.C.); (T.W.); (C.S.)
| | - Siamak Nejad-Davarani
- Department of Radiation Oncology, University of Miami Miller School of Medicine, Miami, FL 33136, USA;
| | - Minsong Cao
- Department of Radiation Oncology, UCLA Health, Los Angeles, CA 90095, USA; (R.C.); (T.W.); (C.S.)
| |
Collapse
|
13
|
Varga-Szemes A, Maurovich-Horvat P, Schoepf UJ, Zsarnoczay E, Pelberg R, Stone GW, Budoff MJ. Computed Tomography Assessment of Coronary Atherosclerosis: From Threshold-Based Evaluation to Histologically Validated Plaque Quantification. J Thorac Imaging 2023; 38:226-234. [PMID: 37115957 PMCID: PMC10287054 DOI: 10.1097/rti.0000000000000711] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/30/2023]
Abstract
Arterial plaque rupture and thrombosis is the primary cause of major cardiovascular and neurovascular events. The identification of atherosclerosis, especially high-risk plaques, is therefore crucial to identify high-risk patients and to implement preventive therapies. Computed tomography angiography has the ability to visualize and characterize vascular plaques. The standard methods for plaque evaluation rely on the assessment of plaque burden, stenosis severity, the presence of positive remodeling, napkin ring sign, and spotty calcification, as well as Hounsfield Unit (HU)-based thresholding for plaque quantification; the latter with multiple shortcomings. Semiautomated threshold-based segmentation techniques with predefined HU ranges identify and quantify limited plaque characteristics, such as low attenuation, non-calcified, and calcified plaque components. Contrary to HU-based thresholds, histologically validated plaque characterization, and quantification, an emerging Artificial intelligence-based approach has the ability to differentiate specific tissue types based on a biological correlate, such as lipid-rich necrotic core and intraplaque hemorrhage that determine plaque vulnerability. In this article, we review the relevance of plaque characterization and quantification and discuss the benefits and limitations of the currently available plaque assessment and classification techniques.
Collapse
Affiliation(s)
- Akos Varga-Szemes
- Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC
| | - Pal Maurovich-Horvat
- MTA-SE Cardiovascular Imaging Research Group, Medical Imaging Centre, Semmelweis University, Budapest, Hungary
| | - U. Joseph Schoepf
- Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC
| | - Emese Zsarnoczay
- Division of Cardiovascular Imaging, Department of Radiology and Radiological Science, Medical University of South Carolina, Charleston, SC
- MTA-SE Cardiovascular Imaging Research Group, Medical Imaging Centre, Semmelweis University, Budapest, Hungary
| | - Robert Pelberg
- Heart and Vascular Institute at The Christ Hospital Health Network, Cincinnati, OH
| | - Gregg W. Stone
- Zena and Michael A. Wiener Cardiovascular Institute, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Matthew J. Budoff
- Department of Medicine, Lundquist Institute at Harbor-UCLA Medical Center, Torrance, CA
| |
Collapse
|
14
|
Eber J, Schmitt M, Dehaynin N, Le Fèvre C, Antoni D, Noël G. Evaluation of Cardiac Substructures Exposure of DIBH-3DCRT, FB-HT, and FB-3DCRT in Hypofractionated Radiotherapy for Left-Sided Breast Cancer after Breast-Conserving Surgery: An In Silico Planning Study. Cancers (Basel) 2023; 15:3406. [PMID: 37444516 DOI: 10.3390/cancers15133406] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 06/25/2023] [Accepted: 06/27/2023] [Indexed: 07/15/2023] Open
Abstract
Left-sided breast cancer radiotherapy can lead to late cardiovascular complications, including ischemic events. To mitigate these risks, cardiac-sparing techniques such as deep-inspiration breath-hold (DIBH) and intensity-modulated radiotherapy (IMRT) have been developed. However, recent studies have shown that mean heart dose is not a sufficient dosimetric parameter for assessing cardiac exposure. In this study, we aimed to compare the radiation exposure to cardiac substructures for ten patients who underwent hypofractionated radiotherapy using DIBH three-dimensional conformal radiation therapy (3DCRT), free-breathing (FB)-3DCRT, and FB helical tomotherapy (HT). Dosimetric parameters of cardiac substructures were analyzed, and the results were statistically compared using the Wilcoxon signed-rank test. This study found a significant reduction in the dose to the heart, left anterior descending coronary artery, and ventricles with DIBH-3DCRT and FB-HT compared to FB-3DCRT. While DIBH-3DCRT was very effective in sparing the heart, in some cases, it provided little or no cardiac sparing. FB-HT can be an interesting treatment modality to reduce the dose to major coronary vessels and ventricles and may be of interest for patients with cardiovascular risks who do not benefit from or cannot perform DIBH. These findings highlight the importance of cardiac-sparing techniques for precise delivery of radiation therapy.
Collapse
Affiliation(s)
- Jordan Eber
- Department of Radiation Oncology, Institut de Cancérologie Strasbourg Europe (ICANS), 67033 Strasbourg, France
| | - Martin Schmitt
- Department of Radiation Oncology, Institut de Cancérologie Strasbourg Europe (ICANS), 67033 Strasbourg, France
| | - Nicolas Dehaynin
- Department of Radiation Oncology, Institut de Cancérologie Strasbourg Europe (ICANS), 67033 Strasbourg, France
| | - Clara Le Fèvre
- Department of Radiation Oncology, Institut de Cancérologie Strasbourg Europe (ICANS), 67033 Strasbourg, France
| | - Delphine Antoni
- Department of Radiation Oncology, Institut de Cancérologie Strasbourg Europe (ICANS), 67033 Strasbourg, France
| | - Georges Noël
- Department of Radiation Oncology, Institut de Cancérologie Strasbourg Europe (ICANS), 67033 Strasbourg, France
- Centre Paul Strauss, Strasbourg University, CNRS, IPHC UMR 7178, UNICANCER, 67000 Strasbourg, France
| |
Collapse
|
15
|
Jafari M, Shoeibi A, Khodatars M, Ghassemi N, Moridian P, Alizadehsani R, Khosravi A, Ling SH, Delfan N, Zhang YD, Wang SH, Gorriz JM, Alinejad-Rokny H, Acharya UR. Automated diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging using deep learning models: A review. Comput Biol Med 2023; 160:106998. [PMID: 37182422 DOI: 10.1016/j.compbiomed.2023.106998] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 03/01/2023] [Accepted: 04/28/2023] [Indexed: 05/16/2023]
Abstract
In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. At early stages, CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMRI) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians as each scan has many slices of data, and the contrast of it might be low. To address these issues, deep learning (DL) techniques have been employed in the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. The following presents research to detect CVDs using CMR images and the most significant DL methods. Another section discussed the challenges in diagnosing CVDs from CMRI data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. Finally, the most important findings of this study are presented in the conclusion section.
Collapse
Affiliation(s)
- Mahboobeh Jafari
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Afshin Shoeibi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; Data Science and Computational Intelligence Institute, University of Granada, Spain.
| | - Marjane Khodatars
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Navid Ghassemi
- Internship in BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia
| | - Parisa Moridian
- Data Science and Computational Intelligence Institute, University of Granada, Spain
| | - Roohallah Alizadehsani
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Abbas Khosravi
- Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, Australia
| | - Sai Ho Ling
- Faculty of Engineering and IT, University of Technology Sydney (UTS), Australia
| | - Niloufar Delfan
- Faculty of Computer Engineering, Dept. of Artificial Intelligence Engineering, K. N. Toosi University of Technology, Tehran, Iran
| | - Yu-Dong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Shui-Hua Wang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester, UK
| | - Juan M Gorriz
- Data Science and Computational Intelligence Institute, University of Granada, Spain; Department of Psychiatry, University of Cambridge, UK
| | - Hamid Alinejad-Rokny
- BioMedical Machine Learning Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney, NSW, 2052, Australia; UNSW Data Science Hub, The University of New South Wales, Sydney, NSW, 2052, Australia; Health Data Analytics Program, Centre for Applied Artificial Intelligence, Macquarie University, Sydney, 2109, Australia
| | - U Rajendra Acharya
- School of Mathematics, Physics and Computing, University of Southern Queensland, Springfield, Australia; Dept. of Biomedical Informatics and Medical Engineering, Asia University, Taichung, Taiwan
| |
Collapse
|
16
|
Li YZ, Wang Y, Huang YH, Xiang P, Liu WX, Lai QQ, Gao YY, Xu MS, Guo YF. RSU-Net: U-net based on residual and self-attention mechanism in the segmentation of cardiac magnetic resonance images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 231:107437. [PMID: 36863157 DOI: 10.1016/j.cmpb.2023.107437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Revised: 11/20/2022] [Accepted: 02/18/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND Automated segmentation techniques for cardiac magnetic resonance imaging (MRI) are beneficial for evaluating cardiac functional parameters in clinical diagnosis. However, due to the characteristics of unclear image boundaries and anisotropic resolution anisotropy produced by cardiac magnetic resonance imaging technology, most of the existing methods still have the problems of intra-class uncertainty and inter-class uncertainty. However, due to the irregularity of the anatomical shape of the heart and the inhomogeneity of tissue density, the boundaries of its anatomical structures become uncertain and discontinuous. Therefore, fast and accurate segmentation of cardiac tissue remains a challenging problem in medical image processing. METHODOLOGY We collected cardiac MRI data from 195 patients as training set and 35patients from different medical centers as external validation set. Our research proposed a U-net network architecture with residual connections and a self-attentive mechanism (Residual Self-Attention U-net, RSU-Net). The network relies on the classic U-net network, adopts the U-shaped symmetric architecture of the encoding and decoding mode, improves the convolution module in the network, introduces skip connections, and improves the network's capacity for feature extraction. Then for solving locality defects of ordinary convolutional networks. To achieve a global receptive field, a self-attention mechanism is introduced at the bottom of the model. The loss function employs a combination of Cross Entropy Loss and Dice Loss to jointly guide network training, resulting in more stable network training. RESULTS In our study, we employ the Hausdorff distance (HD) and the Dice similarity coefficient (DSC) as metrics for assessing segmentation outcomes. Comparsion was made with the segmentation frameworks of other papers, and the comparison results prove that our RSU-Net network performs better and can make accurate segmentation of the heart. New ideas for scientific research. CONCLUSION Our proposed RSU-Net network combines the advantages of residual connections and self-attention. This paper uses the residual links to facilitate the training of the network. In this paper, a self-attention mechanism is introduced, and a bottom self-attention block (BSA Block) is used to aggregate global information. Self-attention aggregates global information, and has achieved good segmentation results on the cardiac segmentation dataset. It facilitates the diagnosis of cardiovascular patients in the future.
Collapse
Affiliation(s)
- Yuan-Zhe Li
- Department of CT/MRI, The Second Affiliated Hospital of Fujian Medical University, Quanzhou 362000, China
| | - Yi Wang
- Department of CT/MRI, The Second Affiliated Hospital of Fujian Medical University, Quanzhou 362000, China
| | - Yin-Hui Huang
- Department of Neurology, Jinjiang Municipal Hospital, Quanzhou 362000, China
| | - Ping Xiang
- Department of Radiology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou 310000, China
| | - Wen-Xi Liu
- Department of CT/MRI, The Second Affiliated Hospital of Fujian Medical University, Quanzhou 362000, China
| | - Qing-Quan Lai
- Department of CT/MRI, The Second Affiliated Hospital of Fujian Medical University, Quanzhou 362000, China
| | - Yi-Yuan Gao
- Department of Radiology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou 310000, China
| | - Mao-Sheng Xu
- Department of Radiology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou 310000, China.
| | - Yi-Fan Guo
- Department of Radiology, The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Traditional Chinese Medicine), Hangzhou 310000, China.
| |
Collapse
|
17
|
Eidex Z, Ding Y, Wang J, Abouei E, Qiu RL, Liu T, Wang T, Yang X. Deep Learning in MRI-guided Radiation Therapy: A Systematic Review. ARXIV 2023:arXiv:2303.11378v2. [PMID: 36994167 PMCID: PMC10055493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 03/31/2023]
Abstract
MRI-guided radiation therapy (MRgRT) offers a precise and adaptive approach to treatment planning. Deep learning applications which augment the capabilities of MRgRT are systematically reviewed. MRI-guided radiation therapy offers a precise, adaptive approach to treatment planning. Deep learning applications which augment the capabilities of MRgRT are systematically reviewed with emphasis placed on underlying methods. Studies are further categorized into the areas of segmentation, synthesis, radiomics, and real time MRI. Finally, clinical implications, current challenges, and future directions are discussed.
Collapse
Affiliation(s)
- Zach Eidex
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA
- School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA
| | - Yifu Ding
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA
| | - Jing Wang
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA
| | - Elham Abouei
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA
| | - Richard L.J. Qiu
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA
| | - Tian Liu
- Department of Radiation Oncology, Icahn School of Medicine at Mount Sinai, New York, NY
| | - Tonghe Wang
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Xiaofeng Yang
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA
- School of Mechanical Engineering, Georgia Institute of Technology, Atlanta, GA
| |
Collapse
|
18
|
Finnegan RN, Chin V, Chlap P, Haidar A, Otton J, Dowling J, Thwaites DI, Vinod SK, Delaney GP, Holloway L. Open-source, fully-automated hybrid cardiac substructure segmentation: development and optimisation. Phys Eng Sci Med 2023; 46:377-393. [PMID: 36780065 PMCID: PMC10030448 DOI: 10.1007/s13246-023-01231-w] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Accepted: 01/30/2023] [Indexed: 02/14/2023]
Abstract
Radiotherapy for thoracic and breast tumours is associated with a range of cardiotoxicities. Emerging evidence suggests cardiac substructure doses may be more predictive of specific outcomes, however, quantitative data necessary to develop clinical planning constraints is lacking. Retrospective analysis of patient data is required, which relies on accurate segmentation of cardiac substructures. In this study, a novel model was designed to deliver reliable, accurate, and anatomically consistent segmentation of 18 cardiac substructures on computed tomography (CT) scans. Thirty manually contoured CT scans were included. The proposed multi-stage method leverages deep learning (DL), multi-atlas mapping, and geometric modelling to automatically segment the whole heart, cardiac chambers, great vessels, heart valves, coronary arteries, and conduction nodes. Segmentation performance was evaluated using the Dice similarity coefficient (DSC), mean distance to agreement (MDA), Hausdorff distance (HD), and volume ratio. Performance was reliable, with no errors observed and acceptable variation in accuracy between cases, including in challenging cases with imaging artefacts and atypical patient anatomy. The median DSC range was 0.81-0.93 for whole heart and cardiac chambers, 0.43-0.76 for great vessels and conduction nodes, and 0.22-0.53 for heart valves. For all structures the median MDA was below 6 mm, median HD ranged 7.7-19.7 mm, and median volume ratio was close to one (0.95-1.49) for all structures except the left main coronary artery (2.07). The fully automatic algorithm takes between 9 and 23 min per case. The proposed fully-automatic method accurately delineates cardiac substructures on radiotherapy planning CT scans. Robust and anatomically consistent segmentations, particularly for smaller structures, represents a major advantage of the proposed segmentation approach. The open-source software will facilitate more precise evaluation of cardiac doses and risks from available clinical datasets.
Collapse
Affiliation(s)
- Robert N Finnegan
- Northern Sydney Cancer Centre, Royal North Shore Hospital, St Leonards, NSW, Australia.
- Institute of Medical Physics, School of Physics, University of Sydney, Sydney, NSW, Australia.
- Ingham Institute for Applied Medical Research, Liverpool, NSW, Australia.
| | - Vicky Chin
- Ingham Institute for Applied Medical Research, Liverpool, NSW, Australia
- Liverpool Cancer Therapy Centre, South Western Sydney Local Health District, Liverpool, NSW, Australia
- South Western Sydney Clinical School, University of New South Wales, Sydney, NSW, Australia
| | - Phillip Chlap
- Ingham Institute for Applied Medical Research, Liverpool, NSW, Australia
- Liverpool Cancer Therapy Centre, South Western Sydney Local Health District, Liverpool, NSW, Australia
- South Western Sydney Clinical School, University of New South Wales, Sydney, NSW, Australia
| | - Ali Haidar
- Ingham Institute for Applied Medical Research, Liverpool, NSW, Australia
- Liverpool Cancer Therapy Centre, South Western Sydney Local Health District, Liverpool, NSW, Australia
- South Western Sydney Clinical School, University of New South Wales, Sydney, NSW, Australia
| | - James Otton
- South Western Sydney Clinical School, University of New South Wales, Sydney, NSW, Australia
| | - Jason Dowling
- Institute of Medical Physics, School of Physics, University of Sydney, Sydney, NSW, Australia
- CSIRO Health and Biosecurity, The Australian e-Health and Research Centre, Herston, QLD, Australia
- School of Mathematical and Physical Sciences, University of Newcastle, Newcastle, NSW, Australia
| | - David I Thwaites
- Institute of Medical Physics, School of Physics, University of Sydney, Sydney, NSW, Australia
- Radiotherapy Research Group, Leeds Institute of Medical Research, St James's Hospital and University of Leeds, Leeds, UK
| | - Shalini K Vinod
- Ingham Institute for Applied Medical Research, Liverpool, NSW, Australia
- Liverpool Cancer Therapy Centre, South Western Sydney Local Health District, Liverpool, NSW, Australia
- South Western Sydney Clinical School, University of New South Wales, Sydney, NSW, Australia
| | - Geoff P Delaney
- Ingham Institute for Applied Medical Research, Liverpool, NSW, Australia
- Liverpool Cancer Therapy Centre, South Western Sydney Local Health District, Liverpool, NSW, Australia
- South Western Sydney Clinical School, University of New South Wales, Sydney, NSW, Australia
| | - Lois Holloway
- Institute of Medical Physics, School of Physics, University of Sydney, Sydney, NSW, Australia
- Ingham Institute for Applied Medical Research, Liverpool, NSW, Australia
- Liverpool Cancer Therapy Centre, South Western Sydney Local Health District, Liverpool, NSW, Australia
- South Western Sydney Clinical School, University of New South Wales, Sydney, NSW, Australia
- Centre for Medical Radiation Physics, University of Wollongong, Wollongong, NSW, Australia
| |
Collapse
|
19
|
Shen J, Gu P, Wang Y, Wang Z. Advances in automatic delineation of target volume and cardiac substructure in breast cancer radiotherapy (Review). Oncol Lett 2023; 25:110. [PMID: 36817059 PMCID: PMC9932716 DOI: 10.3892/ol.2023.13697] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Accepted: 01/06/2023] [Indexed: 02/05/2023] Open
Abstract
Postoperative adjuvant radiotherapy plays an important role in the treatment of patients with breast cancer. With the continuous development of radiotherapeutic technologies, the requirements for radiotherapeutic accuracy are increasingly high. The accuracy of target volume and organ at risk delineation significantly affects the effect of radiotherapy. Automatic delineation software has been continuously developed for the automatic delineation of target areas and organs at risk. Automatic segmentation based on an atlas and deep learning is a hot topic in current clinical research. Automatic delineation can not only reduce the workload and delineation times, but also establish a uniform delineation standard and reduce inter-observer and intra-observer differences. In patients with breast cancer, especially in patients who undergo left breast radiotherapy, the protection of the heart is particularly important. Treating the whole heart as an organ at risk cannot meet the clinical needs, and it is necessary to limit the dose to specific cardiac substructures. The present review discusses the importance of automatic delineation of target volume and cardiac substructure in radiotherapy for patients with breast cancer.
Collapse
Affiliation(s)
- Jingjing Shen
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai 200438, P.R. China
| | - Peihua Gu
- Department of Oncology and Radiotherapy, Shidong Hospital Affiliated to University of Shanghai for Science and Technology, Shanghai 200438, P.R. China
| | - Yun Wang
- Department of Oncology and Radiotherapy, Shidong Hospital Affiliated to University of Shanghai for Science and Technology, Shanghai 200438, P.R. China
| | - Zhongming Wang
- Department of Oncology and Radiotherapy, Shidong Hospital Affiliated to University of Shanghai for Science and Technology, Shanghai 200438, P.R. China
| |
Collapse
|
20
|
Momin S, Wolf J, Roper J, Lei Y, Liu T, Bradley JD, Higgins K, Yang X, Zhang J. Enhanced cardiac substructure sparing through knowledge-based treatment planning for non-small cell lung cancer radiotherapy. Front Oncol 2022; 12:1055428. [DOI: 10.3389/fonc.2022.1055428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Accepted: 11/10/2022] [Indexed: 12/03/2022] Open
Abstract
Radiotherapy (RT) doses to cardiac substructures from the definitive treatment of locally advanced non-small cell lung cancers (NSCLC) have been linked to post-RT cardiac toxicities. With modern treatment delivery techniques, it is possible to focus radiation doses to the planning target volume while reducing cardiac substructure doses. However, it is often challenging to design such treatment plans due to complex tradeoffs involving numerous cardiac substructures. Here, we built a cardiac-substructure-based knowledge-based planning (CS-KBP) model and retrospectively evaluated its performance against a cardiac-based KBP (C-KBP) model and manually optimized patient treatment plans. CS-KBP/C-KBP models were built with 27 previously-treated plans that preferentially spare the heart. While the C-KBP training plans were created with whole heart structures, the CS-KBP model training plans each have 15 cardiac substructures (coronary arteries, valves, great vessels, and chambers of the heart). CS-KBP training plans reflect cardiac-substructure sparing preferences. We evaluated both models on 28 additional patients. Three sets of treatment plans were compared: (1) manually optimized, (2) C-KBP model-generated, and (3) CS-KBP model-generated. Plans were normalized to receive the prescribed dose to at least 95% of the PTV. A two-tailed paired-sample t-test was performed for clinically relevant dose-volume metrics to evaluate the performance of the CS-KBP model against the C-KBP model and clinical plans, respectively. Overall results show significantly improved cardiac substructure sparing by CS-KBP in comparison to C-KBP and the clinical plans. For instance, the average left anterior descending artery volume receiving 15 Gy (V15 Gy) was significantly lower (p < 0.01) for CS-KBP (0.69 ± 1.57 cc) compared to the clinical plans (1.23 ± 1.76 cc) and C-KBP plans (1.05 ± 1.68 cc). In conclusion, the CS-KBP model significantly improved cardiac-substructure sparing without exceeding the tolerances of other OARs or compromising PTV coverage.
Collapse
|
21
|
Dong C, Xu S, Li Z. A novel end-to-end deep learning solution for coronary artery segmentation from CCTA. Med Phys 2022; 49:6945-6959. [PMID: 35770676 DOI: 10.1002/mp.15842] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2021] [Revised: 04/07/2022] [Accepted: 06/10/2022] [Indexed: 12/13/2022] Open
Abstract
PURPOSE Coronary computed tomographic angiography (CCTA) plays a vital role in the diagnosis of cardiovascular diseases, among which automatic coronary artery segmentation (CAS) serves as one of the most challenging tasks. To computationally assist the task, this paper proposes a novel end-to-end deep learning-based (DL) solution for automatic CAS. METHODS Inspired by the Di-Vnet network, a fully automatic multistage DL solution is proposed. The new solution aims to preserve the integrity of blood vessels in terms of both their shape details and continuity. The solution is developed using 338 CCTA cases, among which 133 cases (33865 axial images) have their ground-truth cardiac masks pre-annotated and 205 cases (53365 axial images) have their ground-truth coronary artery (CA) masks pre-annotated. The solution's accuracy is measured using dice similarity coefficient (DSC), 95th percentile Hausdorff Distance (95% HD), Recall, and Precision scores for CAS. RESULTS The proposed solution attains 90.29% in DSC, 2.11 mm in 95% HD, 97.02% in Recall, and 92.17% in Precision, respectively, which consumes 0.112 s per image and 30 s per case on average. Such performance of our method is superior to other state-of-the-art segmentation methods. CONCLUSIONS The novel DL solution is able to automatically learn to perform CAS in an end-to-end fashion, attaining a high accuracy, efficiency and robustness simultaneously.
Collapse
Affiliation(s)
- Caixia Dong
- Institute of Medical Artificial Intelligence, The Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shannxi, China
| | - Songhua Xu
- Institute of Medical Artificial Intelligence, The Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shannxi, China
| | - Zongfang Li
- Institute of Medical Artificial Intelligence, The Second Affiliated Hospital of Xi'an Jiaotong University, Xi'an, Shannxi, China
| |
Collapse
|
22
|
Li Y, Wu C, Qi H, Si D, Ding H, Chen H. Motion correction for native myocardial T 1 mapping using self-supervised deep learning registration with contrast separation. NMR IN BIOMEDICINE 2022; 35:e4775. [PMID: 35599351 DOI: 10.1002/nbm.4775] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Revised: 05/15/2022] [Accepted: 05/18/2022] [Indexed: 06/15/2023]
Abstract
In myocardial T1 mapping, undesirable motion poses significant challenges because uncorrected motion can affect T1 estimation accuracy and cause incorrect diagnosis. In this study, we propose and evaluate a motion correction method for myocardial T1 mapping using self-supervised deep learning based registration with contrast separation (SDRAP). A sparse coding based method was first proposed to separate the contrast component from T1 -weighted (T1w) images. Then, a self-supervised deep neural network with cross-correlation (SDRAP-CC) or mutual information as the registration similarity measurement was developed to register contrast separated images, after which signal fitting was performed on the motion corrected T1w images to generate motion corrected T1 maps. The registration network was trained and tested in 80 healthy volunteers with images acquired using the modified Look-Locker inversion recovery (MOLLI) sequence. The proposed SDRAP was compared with the free form deformation (FFD) registration method regarding (1) Dice similarity coefficient (DSC) and mean boundary error (MBE) of myocardium contours, (2) T1 value and standard deviation (SD) of T1 fitting, (3) subjective evaluation score for overall image quality and motion artifact level, and (4) computation time. Results showed that SDRAP-CC achieved the highest DSC of 85.0 ± 3.9% and the lowest MBE of 0.92 ± 0.25 mm among the methods compared. Additionally, SDRAP-CC performed the best by resulting in lower SD value (28.1 ± 17.6 ms) and higher subjective image quality scores (3.30 ± 0.79 for overall quality and 3.53 ± 0.68 for motion artifact) evaluated by a cardiologist. The proposed SDRAP took only 0.52 s to register one slice of MOLLI images, achieving about sevenfold acceleration over FFD (3.7 s/slice).
Collapse
Affiliation(s)
- Yuze Li
- Center for Biomedical Imaging Research (CBIR), School of Medicine, Tsinghua University, Beijing, China
| | - Chunyan Wu
- Center for Biomedical Imaging Research (CBIR), School of Medicine, Tsinghua University, Beijing, China
| | - Haikun Qi
- School of Biomedical Engineering, ShanghaiTech University, Shanghai, China
| | - Dongyue Si
- Center for Biomedical Imaging Research (CBIR), School of Medicine, Tsinghua University, Beijing, China
| | - Haiyan Ding
- Center for Biomedical Imaging Research (CBIR), School of Medicine, Tsinghua University, Beijing, China
| | - Huijun Chen
- Center for Biomedical Imaging Research (CBIR), School of Medicine, Tsinghua University, Beijing, China
| |
Collapse
|
23
|
Lin H, Dong L, Jimenez RB. Emerging Technologies in Mitigating the Risks of Cardiac Toxicity From Breast Radiotherapy. Semin Radiat Oncol 2022; 32:270-281. [DOI: 10.1016/j.semradonc.2022.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
24
|
Ellahham S, Khalouf A, Elkhazendar M, Dababo N, Manla Y. An overview of radiation-induced heart disease. Radiat Oncol J 2022; 40:89-102. [PMID: 35796112 PMCID: PMC9262704 DOI: 10.3857/roj.2021.00766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 05/19/2022] [Accepted: 05/20/2022] [Indexed: 11/03/2022] Open
Abstract
Radiation therapy (RT) has dramatically improved cancer survival, leading to several inevitable complications. Unintentional irradiation of the heart can lead to radiation-induced heart disease (RIHD), including cardiomyopathy, pericarditis, coronary artery disease, valvular heart disease, and conduction system abnormalities. Furthermore, the development of RIHD is aggravated with the addition of chemotherapy. The screening, diagnosis, and follow-up for RIHD in patients who have undergone RT are described by the consensus guidelines from the European Association of Cardiovascular Imaging (EACVI) and the American Society of Echocardiography (ASE). There is compelling evidence that chest RT can increase the risk of heart disease. Although the prevalence and severity of RIHD are likely to be reduced with modern RT techniques, the incidence of RIHD is expected to rise in cancer survivors who have been treated with old RT regimens. However, there remains a gap between guidelines and clinical practice. Currently, therapeutic modalities followed in the treatment of RIHD are similar to the non-irradiated population. Preventive measures mainly reduce the radiation dose and radiation volume of the heart. There is no concrete evidence to endorse the preventive role of statins, angiotensin-converting enzyme inhibitors, and antioxidants. This review summarizes the current evidence of RIHD subtypes and risk factors and suggests screening regimens, diagnosis, treatment, and preventive approaches.
Collapse
Affiliation(s)
- Samer Ellahham
- Cleveland Clinic, Lyndhurst, OH, USA
- Heart & Vascular Institute, Cleveland Clinic Abu Dhabi, Abu Dhabi, UAE
| | - Amani Khalouf
- Emergency Medicine Institute, Cleveland Clinic Abu Dhabi, UAE
| | - Mohammed Elkhazendar
- Heart & Vascular Institute, Cleveland Clinic Abu Dhabi, Abu Dhabi, UAE
- Pathology & Laboratory Medicine Institute, Cleveland Clinic Abu Dhabi, Abu Dhabi, UAE
| | - Nour Dababo
- Pathology & Laboratory Medicine Institute, Cleveland Clinic Abu Dhabi, Abu Dhabi, UAE
| | - Yosef Manla
- Heart & Vascular Institute, Cleveland Clinic Abu Dhabi, Abu Dhabi, UAE
| |
Collapse
|
25
|
Momin S, Lei Y, McCall NS, Zhang J, Roper J, Harms J, Tian S, Lloyd MS, Liu T, Bradley JD, Higgins K, Yang X. Mutual enhancing learning-based automatic segmentation of CT cardiac substructure. Phys Med Biol 2022; 67. [PMID: 35447610 PMCID: PMC9148580 DOI: 10.1088/1361-6560/ac692d] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Accepted: 04/21/2022] [Indexed: 11/12/2022]
Abstract
Abstract
Objective. Current segmentation practice for thoracic cancer RT considers the whole heart as a single organ despite increased risks of cardiac toxicities from irradiation of specific cardiac substructures. Segmenting up to 15 different cardiac substructures can be a very time-intensive process, especially due to their different volume sizes and anatomical variations amongst different patients. In this work, a new deep learning (DL)-based mutual enhancing strategy is introduced for accurate and automatic segmentation, especially of smaller substructures such as coronary arteries. Approach. Our proposed method consists of three subnetworks: retina U-net, classification module, and segmentation module. Retina U-net is used as a backbone network architecture that aims to learn deep features from the whole heart. Whole heart feature maps from retina U-net are then transferred to four different sets of classification modules to generate classification localization maps of coronary arteries, great vessels, chambers of the heart, and valves of the heart. Each classification module is in sync with its corresponding subsequent segmentation module in a bootstrapping manner, allowing them to share their encoding paths to generate a mutual enhancing strategy. We evaluated our method on three different datasets: institutional CT datasets (55 subjects) 2) publicly available Multi-Modality Whole Heart Segmentation (MM-WHS) challenge datasets (120 subjects), and Automated Cardiac Diagnosis Challenge (ACDC) datasets (100 subjects). For institutional datasets, we performed five-fold cross-validation on training data (45 subjects) and performed inference on separate hold-out data (10 subjects). For each subject, 15 cardiac substructures were manually contoured by a resident physician and evaluated by an attending radiation oncologist. For the MM-WHS dataset, we trained the network on 100 datasets and performed an inference on a separate hold-out dataset with 20 subjects, each with 7 cardiac substructures. For ACDC datasets, we performed five-fold cross-validation on 100 datasets, each with 3 cardiac substructures. We compared the proposed method against four different network architectures: 3D U-net, mask R-CNN, mask scoring R-CNN, and proposed network without classification module. Segmentation accuracies were statistically compared through dice similarity coefficient, Jaccard, 95% Hausdorff distance, mean surface distance, root mean square distance, center of mass distance, and volume difference. Main results. The proposed method generated cardiac substructure segmentations with significantly higher accuracy (P < 0.05) for small substructures, especially for coronary arteries such as left anterior descending artery (CA-LADA) and right coronary artery (CA-RCA) in comparison to four competing methods. For large substructures (i.e. chambers of the heart), our method yielded comparable results to mask scoring R-CNN method, resulting in significantly (P < 0.05) improved segmentation accuracy in comparison to 3D U-net and mask R-CNN. Significance. A new DL-based mutual enhancing strategy was introduced for automatic segmentation of cardiac substructures. Overall results of this work demonstrate the ability of the proposed method to improve segmentation accuracies of smaller substructures such as coronary arteries without largely compromising the segmentation accuracies of larger substructures. Fast and accurate segmentations of up to 15 substructures can possibly be used as a tool to rapidly generate substructure segmentations followed by physicians’ reviews to improve clinical workflow.
Collapse
|
26
|
Miller CR, Morris ED, Ghanem AI, Pantelic MV, Walker EM, Glide-Hurst CK. Characterizing Sensitive Cardiac Substructure Excursion Due to Respiration. Adv Radiat Oncol 2022; 7:100876. [PMID: 35243181 PMCID: PMC8858867 DOI: 10.1016/j.adro.2021.100876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Accepted: 11/29/2021] [Indexed: 11/12/2022] Open
Abstract
Purpose Whole-heart dose metrics are not as strongly linked to late cardiac morbidities as radiation doses to individual cardiac substructures. Our aim was to characterize the excursion and dosimetric variation throughout respiration of sensitive cardiac substructures for future robust safety margin design. Methods and Materials Eleven patients with cancer treatments in the thorax underwent 4-phase noncontrast 4-dimensional computed tomography (4DCT) with T2-weighted magnetic resonance imaging in end-exhale. The end-exhale phase of the 4DCT was rigidly registered with the magnetic resonance imaging and refined with an assisted alignment surrounding the heart from which 13 substructures (chambers, great vessels, coronary arteries, etc) were contoured by a radiation oncologist on the 4DCT. Contours were deformed to the other respiratory phases via an intensity-based deformable registration for radiation oncologist verification. Measurements of centroid and volume were evaluated between phases. Mean and maximum dose to substructures were evaluated across respiratory phases for the breast (n = 8) and thoracic cancer (n = 3) cohorts. Results Paired t tests revealed reasonable maintenance of geometric and anatomic properties (P < .05 for 4/39 volume comparisons). Maximum displacements >5 mm were found for 24.8%, 8.5%, and 64.5% of the cases in the left-right, anterior-posterior, and superior-inferior axes, respectively. Vector displacements were largest for the inferior vena cava and the right coronary artery, with displacements up to 17.9 mm. In breast, the left anterior descending artery Dmean varied 3.03 ± 1.75 Gy (range, 0.53-5.18 Gy) throughout respiration whereas lung showed patient-specific results. Across all patients, whole heart metrics were insensitive to breathing phase (mean and maximum dose variations <0.5 Gy). Conclusions This study characterized the intrafraction displacement of the cardiac substructures through the respiratory cycle and highlighted their increased dosimetric sensitivity to local dose changes not captured by whole heart metrics. Results suggest value of cardiac substructure margin generation to enable more robust cardiac sparing and to reduce the effect of respiration on overall treatment plan quality.
Collapse
|
27
|
Chun J, Chang JS, Oh C, Park I, Choi MS, Hong CS, Kim H, Yang G, Moon JY, Chung SY, Suh YJ, Kim JS. Synthetic contrast-enhanced computed tomography generation using a deep convolutional neural network for cardiac substructure delineation in breast cancer radiation therapy: a feasibility study. Radiat Oncol 2022; 17:83. [PMID: 35459221 PMCID: PMC9034542 DOI: 10.1186/s13014-022-02051-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Accepted: 04/11/2022] [Indexed: 12/25/2022] Open
Abstract
BACKGROUND Adjuvant radiation therapy improves the overall survival and loco-regional control in patients with breast cancer. However, radiation-induced heart disease, which occurs after treatment from incidental radiation exposure to the cardiac organ, is an emerging challenge. This study aimed to generate synthetic contrast-enhanced computed tomography (SCECT) from non-contrast CT (NCT) using deep learning (DL) and investigate its role in contouring cardiac substructures. We also aimed to determine its applicability for a retrospective study on the substructure volume-dose relationship for predicting radiation-induced heart disease. METHODS We prepared NCT-CECT cardiac scan pairs of 59 patients. Of these, 35, 4, and 20 pairs were used for training, validation, and testing, respectively. We adopted conditional generative adversarial network as a framework to generate SCECT. SCECT was validated in the following three stages: (1) The similarity between SCECT and CECT was evaluated; (2) Manual contouring was performed on SCECT and CECT with sufficient intervals and based on this, the geometric similarity of cardiac substructures was measured between them; (3) The treatment plan was quantitatively analyzed based on the contours of SCECT and CECT. RESULTS While the mean values (± standard deviation) of the mean absolute error, peak signal-to-noise ratio, and structural similarity index measure between SCECT and CECT were 20.66 ± 5.29, 21.57 ± 1.85, and 0.77 ± 0.06, those were 23.95 ± 6.98, 20.67 ± 2.34, and 0.76 ± 0.07 between NCT and CECT, respectively. The Dice similarity coefficients and mean surface distance between the contours of SCECT and CECT were 0.81 ± 0.06 and 2.44 ± 0.72, respectively. The dosimetry analysis displayed error rates of 0.13 ± 0.27 Gy and 0.71 ± 1.34% for the mean heart dose and V5Gy, respectively. CONCLUSION Our findings displayed the feasibility of SCECT generation from NCT and its potential for cardiac substructure delineation in patients who underwent breast radiation therapy.
Collapse
Affiliation(s)
- Jaehee Chun
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea.,Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea.,Oncosoft Inc, Seoul, South Korea
| | - Jee Suk Chang
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea.,Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea.,Oncosoft Inc, Seoul, South Korea
| | - Caleb Oh
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea.,Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea
| | - InKyung Park
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea.,Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea
| | - Min Seo Choi
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea.,Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea
| | - Chae-Seon Hong
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea.,Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea
| | - Hojin Kim
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea.,Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea
| | - Gowoon Yang
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea
| | - Jin Young Moon
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea
| | - Seung Yeun Chung
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea
| | - Young Joo Suh
- Department of Radiology, Yonsei University College of Medicine, Seoul, South Korea
| | - Jin Sung Kim
- Department of Radiation Oncology, Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, South Korea. .,Medical Physics and Biomedical Engineering Lab (MPBEL), Yonsei University College of Medicine, Seoul, South Korea. .,Oncosoft Inc, Seoul, South Korea.
| |
Collapse
|
28
|
Wang HJ, Chen LW, Lee HY, Chung YJ, Lin YT, Lee YC, Chen YC, Chen CM, Lin MW. Automated 3D Segmentation of the Aorta and Pulmonary Artery on Non-Contrast-Enhanced Chest Computed Tomography Images in Lung Cancer Patients. Diagnostics (Basel) 2022; 12:diagnostics12040967. [PMID: 35454015 PMCID: PMC9032785 DOI: 10.3390/diagnostics12040967] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 04/07/2022] [Accepted: 04/09/2022] [Indexed: 12/19/2022] Open
Abstract
Pulmonary hypertension should be preoperatively evaluated for optimal surgical planning to reduce surgical risk in lung cancer patients. Preoperative measurement of vascular diameter in computed tomography (CT) images is a noninvasive prediction method for pulmonary hypertension. However, the current estimation method, 2D manual arterial diameter measurement, may yield inaccurate results owing to low tissue contrast in non-contrast-enhanced CT (NECT). Furthermore, it provides an incomplete evaluation by measuring only the diameter of the arteries rather than the volume. To provide a more complete and accurate estimation, this study proposed a novel two-stage deep learning (DL) model for 3D aortic and pulmonary artery segmentation in NECT. In the first stage, a DL model was constructed to enhance the contrast of NECT; in the second stage, two DL models then applied the enhanced images for aorta and pulmonary artery segmentation. Overall, 179 patients were divided into contrast enhancement model (n = 59), segmentation model (n = 120), and testing (n = 20) groups. The performance of the proposed model was evaluated using Dice similarity coefficient (DSC). The proposed model could achieve 0.97 ± 0.007 and 0.93 ± 0.002 DSC for aortic and pulmonary artery segmentation, respectively. The proposed model may provide 3D diameter information of the arteries before surgery, facilitating the estimation of pulmonary hypertension and supporting preoperative surgical method selection based on the predicted surgical risks.
Collapse
Affiliation(s)
- Hao-Jen Wang
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Li-Wei Chen
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Hsin-Ying Lee
- Department of Medicine, National Taiwan University, Taipei 100, Taiwan; (H.-Y.L.); (Y.-C.L.)
| | - Yu-Jung Chung
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Yan-Ting Lin
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Yi-Chieh Lee
- Department of Medicine, National Taiwan University, Taipei 100, Taiwan; (H.-Y.L.); (Y.-C.L.)
| | - Yi-Chang Chen
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Chung-Ming Chen
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
- Correspondence: (C.-M.C.); (M.-W.L.)
| | - Mong-Wei Lin
- Department of Surgery, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei 100, Taiwan
- Correspondence: (C.-M.C.); (M.-W.L.)
| |
Collapse
|
29
|
Wang J, Wang S, Liang W, Zhang N, Zhang Y. The auto segmentation for cardiac structures using a dual-input deep learning network based on vision saliency and transformer. J Appl Clin Med Phys 2022; 23:e13597. [PMID: 35363415 PMCID: PMC9121042 DOI: 10.1002/acm2.13597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 02/23/2022] [Accepted: 03/09/2022] [Indexed: 11/25/2022] Open
Abstract
Purpose Accurate segmentation of cardiac structures on coronary CT angiography (CCTA) images is crucial for the morphological analysis, measurement, and functional evaluation. In this study, we achieve accurate automatic segmentation of cardiac structures on CCTA image by adopting an innovative deep learning method based on visual attention mechanism and transformer network, and its practical application value is discussed. Methods We developed a dual‐input deep learning network based on visual saliency and transformer (VST), which consists of self‐attention mechanism for cardiac structures segmentation. Sixty patients’ CCTA subjects were randomly selected as a development set, which were manual marked by an experienced technician. The proposed vision attention and transformer mode was trained on the patients CCTA images, with a manual contour‐derived binary mask used as the learning‐based target. We also used the deep supervision strategy by adding auxiliary losses. The loss function of our model was the sum of the Dice loss and cross‐entropy loss. To quantitatively evaluate the segmentation results, we calculated the Dice similarity coefficient (DSC) and Hausdorff distance (HD). Meanwhile, we compare the volume of automatic segmentation and manual segmentation to analyze whether there is statistical difference. Results Fivefold cross‐validation was used to benchmark the segmentation method. The results showed the left ventricular myocardium (LVM, DSC = 0.87), the left ventricular (LV, DSC = 0.94), the left atrial (LA, DSC = 0.90), the right ventricular (RV, DSC = 0.92), the right atrial (RA, DSC = 0.91), and the aortic (AO, DSC = 0.96). The average DSC was 0.92, and HD was 7.2 ± 2.1 mm. In volume comparison, except LVM and LA (p < 0.05), there was no significant statistical difference in other structures. Proposed method for structural segmentation fit well with the true profile of the cardiac substructure, and the model prediction results closed to the manual annotation. Conclusions
The adoption of the dual‐input and transformer architecture based on visual saliency has high sensitivity and specificity to cardiac structures segmentation, which can obviously improve the accuracy of automatic substructure segmentation. This is of gr
Collapse
Affiliation(s)
- Jing Wang
- Department of Electric Information Engineering, Shandong Youth University Of Political Science, Jinan, China
| | - Shuyu Wang
- Department of Electric Information Engineering, Shandong Youth University Of Political Science, Jinan, China
| | - Wei Liang
- Department of Ecological Environment Statistics, Ecological Environment Department of Shandong, Jinan, China
| | - Nan Zhang
- Department of Radiology, Beijing Anzhen Hospital, Capital Medical University, Beijing, China
| | - Yan Zhang
- Department of Radiology, Shandong Mental Health Center, Shandong University, Jinan, China
| |
Collapse
|
30
|
Shi T, Shahedi M, Caughlin K, Dormer JD, Ma L, Fei B. Semi-automated three-dimensional segmentation for cardiac CT images using deep learning and randomly distributed points. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2022; 12034:120341W. [PMID: 36793655 PMCID: PMC9928521 DOI: 10.1117/12.2611594] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Given the prevalence of cardiovascular diseases (CVDs), the segmentation of the heart on cardiac computed tomography (CT) remains of great importance. Manual segmentation is time-consuming and intra-and inter-observer variabilities yield inconsistent and inaccurate results. Computer-assisted, and in particular, deep learning approaches to segmentation continue to potentially offer an accurate, efficient alternative to manual segmentation. However, fully automated methods for cardiac segmentation have yet to achieve accurate enough results to compete with expert segmentation. Thus, we focus on a semi-automated deep learning approach to cardiac segmentation that bridges the divide between a higher accuracy from manual segmentation and higher efficiency from fully automated methods. In this approach, we selected a fixed number of points along the surface of the cardiac region to mimic user interaction. Points-distance maps were then generated from these points selections, and a three-dimensional (3D) fully convolutional neural network (FCNN) was trained using points-distance maps to provide a segmentation prediction. Testing our method with different numbers of selected points, we achieved a Dice score from 0.742 to 0.917 across the four chambers. Specifically. Dice scores averaged 0.846 ± 0.059, 0.857 ± 0.052, 0.826 ± 0.062, and 0.824 ± 0.062 for the left atrium, left ventricle, right atrium, and right ventricle, respectively across all points selections. This point-guided, image-independent, deep learning segmentation approach illustrated a promising performance for chamber-by-chamber delineation of the heart in CT images.
Collapse
Affiliation(s)
- Ted Shi
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX
| | - Maysam Shahedi
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, The University of Texas at Dallas, Richardson, TX
| | - Kayla Caughlin
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX
| | - James D. Dormer
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, The University of Texas at Dallas, Richardson, TX
| | - Ling Ma
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, The University of Texas at Dallas, Richardson, TX
| | - Baowei Fei
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, The University of Texas at Dallas, Richardson, TX
- Department of Radiology, University of Texas Southwestern Medical Center, Dallas, TX
| |
Collapse
|
31
|
Yassine IA, Ghanem AM, Metwalli NS, Hamimi A, Ouwerkerk R, Matta JR, Solomon MA, Elinoff JM, Gharib AM, Abd-Elmoniem KZ. Native-resolution myocardial principal Eulerian strain mapping using convolutional neural networks and Tagged Magnetic Resonance Imaging. Comput Biol Med 2022; 141:105041. [PMID: 34836627 PMCID: PMC8900530 DOI: 10.1016/j.compbiomed.2021.105041] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 11/12/2021] [Accepted: 11/13/2021] [Indexed: 02/03/2023]
Abstract
BACKGROUND Assessment of regional myocardial function at native pixel-level resolution can play a crucial role in recognizing the early signs of the decline in regional myocardial function. Extensive data processing in existing techniques limits the effective resolution and accuracy of the generated strain maps. The purpose of this study is to compute myocardial principal strain maps εp1 and εp2 from tagged MRI (tMRI) at the native image resolution using deep-learning local patch convolutional neural network (CNN) models (DeepStrain). METHODS For network training, validation, and testing, realistic tMRI datasets were generated and consisted of 53,606 cine images simulating the heart, the liver, blood pool, and backgrounds, including ranges of shapes, positions, motion patterns, noise, and strain. In addition, 102 in-vivo image datasets from three healthy subjects, and three Pulmonary Arterial Hypertension patients, were acquired and used to assess the network's in-vivo performance. Four convolutional neural networks were trained for mapping input tagging patterns to corresponding ground-truth principal strains using different cost functions. Strain maps using harmonic phase analysis (HARP) were obtained with various spectral filtering settings for comparison. CNN and HARP strain maps were compared at the pixel level versus the ground-truth and versus the least-loss in-vivo maps using Pearson correlation coefficients (R) and the median error and Inter-Quartile Range (IQR) histograms. RESULTS CNN-based local patch DeepStrain maps at a phantom resolution of 1.1mm × 1.1 mm and in-vivo resolution of 2.1mm × 1.6 mm were artifact-free with multiple fold improvement with εp1 ground-truth median error of 0.009(0.007) vs. 0.32(0.385) using HARP and εp2 ground-truth error of 0.016(0.021) vs. 0.181(0.08) using HARP. CNN-based strain maps showed substantially higher agreement with the ground-truth maps with correlation coefficients R > 0.91 for εp1 and εp2 compared to R < 0.21 and R < 0.82 for HARP-generated maps, respectively. CONCLUSION CNN-generated Eulerian strain mapping permits artifact-free visualization of myocardial function at the native image resolution.
Collapse
Affiliation(s)
- Inas A. Yassine
- Systems and Biomedical Engineering Department, Faculty of Engineering, Cairo University, Egypt
| | - Ahmed M. Ghanem
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Nader S. Metwalli
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Ahmed Hamimi
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Ronald Ouwerkerk
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Jatin R. Matta
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Michael A. Solomon
- Cardiovascular Branch of the National Heart, Lung, and Blood Institute (NHLBI), NIH, Bethesda, MD, USA.,Critical Care Medicine Department, NIH Clinical Center, Bethesda, MD, USA
| | - Jason M. Elinoff
- Critical Care Medicine Department, NIH Clinical Center, Bethesda, MD, USA
| | - Ahmed M. Gharib
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA
| | - Khaled Z. Abd-Elmoniem
- Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health, Bethesda, MD, USA,Corresponding author: Khaled Z Abd-Elmoniem, PhD, MHS, Biomedical and Metabolic Imaging Branch, National Institute of Diabetes and Digestive and Kidney Diseases, National Institutes of Health, 10 Center Drive, Bldg. 10, CRC, Rm. 3-5340, Bethesda, MD 20892, Tel: 301-451-8982/Fax: 301-480-3166,
| |
Collapse
|
32
|
Loap P, De Marzi L, Kirov K, Servois V, Fourquet A, Khoubeyb A, Kirova Y. Development of simplified auto-segmentable functional cardiac atlas. Pract Radiat Oncol 2022; 12:533-538. [DOI: 10.1016/j.prro.2022.02.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 02/02/2022] [Accepted: 02/09/2022] [Indexed: 10/19/2022]
|
33
|
Fu Y, Zhang H, Morris ED, Glide-Hurst CK, Pai S, Traverso A, Wee L, Hadzic I, Lønne PI, Shen C, Liu T, Yang X. Artificial Intelligence in Radiation Therapy. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2022; 6:158-181. [PMID: 35992632 PMCID: PMC9385128 DOI: 10.1109/trpms.2021.3107454] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
Artificial intelligence (AI) has great potential to transform the clinical workflow of radiotherapy. Since the introduction of deep neural networks, many AI-based methods have been proposed to address challenges in different aspects of radiotherapy. Commercial vendors have started to release AI-based tools that can be readily integrated to the established clinical workflow. To show the recent progress in AI-aided radiotherapy, we have reviewed AI-based studies in five major aspects of radiotherapy including image reconstruction, image registration, image segmentation, image synthesis, and automatic treatment planning. In each section, we summarized and categorized the recently published methods, followed by a discussion of the challenges, concerns, and future development. Given the rapid development of AI-aided radiotherapy, the efficiency and effectiveness of radiotherapy in the future could be substantially improved through intelligent automation of various aspects of radiotherapy.
Collapse
Affiliation(s)
- Yabo Fu
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA 30322, USA
| | - Hao Zhang
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Eric D. Morris
- Department of Radiation Oncology, University of California-Los Angeles, Los Angeles, CA 90095, USA
| | - Carri K. Glide-Hurst
- Department of Human Oncology, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI 53792, USA
| | - Suraj Pai
- Maastricht University Medical Centre, Netherlands
| | | | - Leonard Wee
- Maastricht University Medical Centre, Netherlands
| | | | - Per-Ivar Lønne
- Department of Medical Physics, Oslo University Hospital, PO Box 4953 Nydalen, 0424 Oslo, Norway
| | - Chenyang Shen
- Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75002, USA
| | - Tian Liu
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA 30322, USA
| | - Xiaofeng Yang
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA 30322, USA
| |
Collapse
|
34
|
Current and Future Applications of Artificial Intelligence in Coronary Artery Disease. Healthcare (Basel) 2022; 10:healthcare10020232. [PMID: 35206847 PMCID: PMC8872080 DOI: 10.3390/healthcare10020232] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 01/19/2022] [Accepted: 01/24/2022] [Indexed: 02/07/2023] Open
Abstract
Cardiovascular diseases (CVDs) carry significant morbidity and mortality and are associated with substantial economic burden on healthcare systems around the world. Coronary artery disease, as one disease entity under the CVDs umbrella, had a prevalence of 7.2% among adults in the United States and incurred a financial burden of 360 billion US dollars in the years 2016–2017. The introduction of artificial intelligence (AI) and machine learning over the last two decades has unlocked new dimensions in the field of cardiovascular medicine. From automatic interpretations of heart rhythm disorders via smartwatches, to assisting in complex decision-making, AI has quickly expanded its realms in medicine and has demonstrated itself as a promising tool in helping clinicians guide treatment decisions. Understanding complex genetic interactions and developing clinical risk prediction models, advanced cardiac imaging, and improving mortality outcomes are just a few areas where AI has been applied in the domain of coronary artery disease. Through this review, we sought to summarize the advances in AI relating to coronary artery disease, current limitations, and future perspectives.
Collapse
|
35
|
Chen M, Wu S, Zhao W, Zhou Y, Zhou Y, Wang G. Application of deep learning to auto-delineation of target volumes and organs at risk in radiotherapy. Cancer Radiother 2021; 26:494-501. [PMID: 34711488 DOI: 10.1016/j.canrad.2021.08.020] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2021] [Revised: 07/30/2021] [Accepted: 08/04/2021] [Indexed: 11/28/2022]
Abstract
The technological advancement heralded the arrival of precision radiotherapy (RT), thereby increasing the therapeutic ratio and decreasing the side effects from treatment. Contour of target volumes (TV) and organs at risk (OARs) in RT is a complicated process. In recent years, automatic contouring of TV and OARs has rapidly developed due to the advances in deep learning (DL). This technology has the potential to save time and to reduce intra- or inter-observer variability. In this paper, the authors provide an overview of RT, introduce the concept of DL, summarize the data characteristics of the included literature, summarize the possible challenges for DL in the future, and discuss the possible research directions.
Collapse
Affiliation(s)
- M Chen
- Department of Radiation Oncology, First Affiliated Hospital, Bengbu Medical College, Bengbu, Anhui 233004, China
| | - S Wu
- Department of Radiation Oncology, First Affiliated Hospital, Bengbu Medical College, Bengbu, Anhui 233004, China
| | - W Zhao
- Bengbu Medical College, Bengbu, Anhui 233030, China
| | - Y Zhou
- Department of Radiation Oncology, First Affiliated Hospital, Bengbu Medical College, Bengbu, Anhui 233004, China
| | - Y Zhou
- Department of Radiation Oncology, First Affiliated Hospital, Bengbu Medical College, Bengbu, Anhui 233004, China
| | - G Wang
- Department of Radiation Oncology, First Affiliated Hospital, Bengbu Medical College, Bengbu, Anhui 233004, China.
| |
Collapse
|
36
|
Garrett Fernandes M, Bussink J, Stam B, Wijsman R, Schinagl DAX, Monshouwer R, Teuwen J. Deep learning model for automatic contouring of cardiovascular substructures on radiotherapy planning CT images: Dosimetric validation and reader study based clinical acceptability testing. Radiother Oncol 2021; 165:52-59. [PMID: 34688808 DOI: 10.1016/j.radonc.2021.10.008] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Revised: 09/27/2021] [Accepted: 10/11/2021] [Indexed: 12/25/2022]
Abstract
BACKGROUND AND PURPOSE Large radiotherapy (RT) planning imaging datasets with consistently contoured cardiovascular structures are essential for robust cardiac radiotoxicity research in thoracic cancers. This study aims to develop and validate a highly accurate automatic contouring model for the heart, cardiac chambers, and great vessels for RT planning computed tomography (CT) images that can be used for dose-volume parameter estimation. MATERIALS AND METHODS A neural network model was trained using a dataset of 127 expertly contoured planning CT images from RT treatment of locally advanced non-small-cell lung cancer (NSCLC) patients. Evaluation of geometric accuracy and quality of dosimetric parameter estimation was performed on 50 independent scans with contrast and without contrast enhancement. The model was further evaluated regarding the clinical acceptability of the contours in 99 scans randomly sampled from the RTOG-0617 dataset by three experienced radiation oncologists. RESULTS Median surface dice at 3 mm tolerance for all dedicated thoracic structures was 90% in the test set. Median absolute difference between mean dose computed with model contours and expert contours was 0.45 Gy averaged over all structures. The mean clinical acceptability rate by majority vote in the RTOG-0617 scans was 91%. CONCLUSION This model can be used to contour the heart, cardiac chambers, and great vessels in large datasets of RT planning thoracic CT images accurately, quickly, and consistently. Additionally, the model can be used as a time-saving tool for contouring in clinic practice.
Collapse
Affiliation(s)
- Miguel Garrett Fernandes
- Department of Radiation Oncology, Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands; Department of Medical Imaging, Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands.
| | - Johan Bussink
- Department of Radiation Oncology, Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Barbara Stam
- Department of Radiation Oncology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| | - Robin Wijsman
- Department of Radiation Oncology, University Medical Center Groningen, Groningen, The Netherlands
| | - Dominic A X Schinagl
- Department of Radiation Oncology, Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands
| | - René Monshouwer
- Department of Radiation Oncology, Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Jonas Teuwen
- Department of Medical Imaging, Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands; Department of Radiation Oncology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| |
Collapse
|
37
|
van Velzen SGM, Gal R, Teske AJ, van der Leij F, van den Bongard DHJG, Viergever MA, Verkooijen HM, Išgum I. AI-Based Radiation Dose Quantification for Estimation of Heart Disease Risk in Breast Cancer Survivors After Radiation Therapy. Int J Radiat Oncol Biol Phys 2021; 112:621-632. [PMID: 34624460 DOI: 10.1016/j.ijrobp.2021.09.008] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Accepted: 09/08/2021] [Indexed: 11/18/2022]
Abstract
PURPOSE To investigate whether the dose planned for cardiac structures is associated with the risk of heart disease (HD) in patients with breast cancer treated with radiation therapy, and whether this association is modified by the presence of coronary artery calcification (CAC). METHODS AND MATERIALS Radiation therapy planning computed tomographic (CT) scans and corresponding dose distribution maps of 5561 patients were collected, 5300 patients remained after the exclusion of ineligible patients and duplicates; 1899 patients received their CT scan before 2011, allowing long follow-up. CAC was detected automatically. Using an artificial intelligence-based method, the cardiac structures (heart, cardiac chambers, large arteries, 3 main coronary arteries) were segmented. The planned radiation dose to each structure separately and to the whole heart were determined. Patients were assigned to a low-, medium-, or high-dose group based on the dose to the respective heart structure. Information on HD hospitalization and mortality was obtained for each patient. The association of planned radiation dose to cardiac structures with risk of HD was investigated in patients with and without CAC using Cox proportional hazard analysis in the long follow-up population. Tests for interaction were performed. RESULTS After a median follow-up of 96.0 months (interquartile range, 84.2-110.4 months) in the long follow-up group, 135 patients were hospitalized for HD or died of HD. If the dose to a structure increased 1 Gy, the relative HD risk increased by 3% to 11%. The absolute increase in HD risk was substantially higher in patients with CAC (event-ratelow-dose = 14-15 vs event-ratehigh-dose = 15-34 per 1000 person-years) than in patients without CAC (event-ratelow-dose = 6-8 vs event-ratehigh-dose = 5-17 per 1000 person-years). No interaction between CAC and radiation dose was found. CONCLUSIONS Radiation exposure of cardiac structures is associated with increased risk of HD. Automatic segmentation of cardiac structures enables spatially localized dose estimation, which can aid in the prevention of radiation therapy-induced cardiac damage. This could be especially valuable in patients with breast cancer and CAC.
Collapse
Affiliation(s)
- Sanne G M van Velzen
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, the Netherlands; Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers - Location AMC, University of Amsterdam, Amsterdam, the Netherlands.
| | - Roxanne Gal
- Division of Imaging and Oncology, University Medical Center Utrecht, University of Utrecht, Utrecht, the Netherlands
| | - Arco J Teske
- Department of Cardiology, University Medical Center Utrecht, University of Utrecht, Utrecht, the Netherlands
| | - Femke van der Leij
- Department of Radiation Oncology, University Medical Center Utrecht, University of Utrecht, Utrecht, the Netherlands
| | | | - Max A Viergever
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Helena M Verkooijen
- Division of Imaging and Oncology, University Medical Center Utrecht, University of Utrecht, Utrecht, the Netherlands
| | - Ivana Išgum
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, the Netherlands; Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers - Location AMC, University of Amsterdam, Amsterdam, the Netherlands; Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers - Location AMC, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centers - Location AMC, Amsterdam, the Netherlands
| |
Collapse
|
38
|
van Velzen SGM, Bruns S, Wolterink JM, Leiner T, Viergever MA, Verkooijen HM, Išgum I. AI-Based Quantification of Planned Radiation Therapy Dose to Cardiac Structures and Coronary Arteries in Patients With Breast Cancer. Int J Radiat Oncol Biol Phys 2021; 112:611-620. [PMID: 34547373 DOI: 10.1016/j.ijrobp.2021.09.009] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Revised: 08/30/2021] [Accepted: 09/01/2021] [Indexed: 12/25/2022]
Abstract
PURPOSE The purpose of this work is to develop and evaluate an automatic deep learning method for segmentation of cardiac chambers and large arteries, and localization of the 3 main coronary arteries in radiation therapy planning on computed tomography (CT). In addition, a second purpose is to determine the planned radiation therapy dose to cardiac structures for breast cancer therapy. METHODS AND MATERIALS Eighteen contrast-enhanced cardiac scans acquired with a dual-layer-detector CT scanner were included for method development. Manual reference annotations of cardiac chambers, large arteries, and coronary artery locations were made in the contrast scans and transferred to virtual noncontrast images, mimicking noncontrast-enhanced CT. In addition, 31 noncontrast-enhanced radiation therapy treatment planning CTs with corresponding dose-distribution maps of breast cancer cases were included for evaluation. For reference, cardiac chambers and large vessels were manually annotated in two 2-dimensional (2D) slices per scan (26 scans, totaling 52 slices) and in 3-dimensional (3D) scan volumes in 5 scans. Coronary artery locations were annotated on 3D imaging. The method uses an ensemble of convolutional neural networks with 2 output branches that perform 2 distinct tasks: (1) segmentation of the cardiac chambers and large arteries and (2) localization of coronary arteries. Training was performed using reference annotations and virtual noncontrast cardiac scans. Automatic segmentation of the cardiac chambers and large vessels and the coronary artery locations was evaluated in radiation therapy planning CT with Dice score (DSC) and average symmetrical surface distance (ASSD). The correlation between dosimetric parameters derived from the automatic and reference segmentations was evaluated with R2. RESULTS For cardiac chambers and large arteries, median DSC was 0.76 to 0.88, and the median ASSD was 0.17 to 0.27 cm in 2D slice evaluation. 3D evaluation found a DSC of 0.87 to 0.93 and an ASSD of 0.07 to 0.10 cm. Median DSC of the coronary artery locations ranged from 0.80 to 0.91. R2 values of dosimetric parameters were 0.77 to 1.00 for the cardiac chambers and large vessels, and 0.76 to 0.95 for the coronary arteries. CONCLUSIONS The developed and evaluated method can automatically obtain accurate estimates of planned radiation dose and dosimetric parameters for the cardiac chambers, large arteries, and coronary arteries.
Collapse
Affiliation(s)
- Sanne G M van Velzen
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, the Netherlands; Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers - Location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands.
| | - Steffen Bruns
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers - Location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Jelmer M Wolterink
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers - Location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands; Department of Applied Mathematics and Technical Medicine Center, University of Twente, Enschede, the Netherlands
| | - Tim Leiner
- Department of Radiology, Utrecht University Medical Center, University of Utrecht, Utrecht, the Netherlands
| | - Max A Viergever
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Helena M Verkooijen
- Division of Imaging and Oncology, University Medical Center Utrecht, University of Utrecht, Utrecht, the Netherlands
| | - Ivana Išgum
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, the Netherlands; Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers - Location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands; Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers - Location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centers - location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|
39
|
Speers C, Murthy VL, Walker EM, Glide-Hurst CK, Marsh R, Tang M, Morris EL, Schipper MJ, Weinberg RL, Gits HC, Hayman J, Feng M, Balter J, Moran J, Jagsi R, Pierce LJ. Cardiac Magnetic Resonance Imaging and Blood Biomarkers for Evaluation of Radiation-Induced Cardiotoxicity in Patients With Breast Cancer: Results of a Phase 2 Clinical Trial. Int J Radiat Oncol Biol Phys 2021; 112:417-425. [PMID: 34509552 DOI: 10.1016/j.ijrobp.2021.08.039] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 08/23/2021] [Accepted: 08/27/2021] [Indexed: 12/25/2022]
Abstract
PURPOSE Radiation therapy (RT) can increase the risk of cardiac events in patients with breast cancer (BC), but biomarkers predicting risk for developing RT-induced cardiac disease are currently lacking. We report results from a prospective clinical trial evaluating early magnetic resonance imaging (MRI) and serum biomarker changes as predictors of cardiac injury and risk of subsequent cardiac events after RT for left-sided disease. METHODS Women with node-negative and node-positive (N-/+) left-sided BC were enrolled on 2 institutional review board (IRB)-approved protocols at 2 institutions. MRI was conducted pretreatment (within 1 week of starting radiation), at the end of treatment (last day of treatment ±1 week), and 3 months after the last day of treatment (±2 weeks) to quantify left and right ventricular volumes and function, myocardial fibrosis, and edema. Perfusion changes during regadenoson stress perfusion were also assessed on a subset of patients (n = 28). Serum was collected at the same time points. Whole heart and cardiac substructures were contoured using CT and MRI. Models were constructed using baseline cardiac and clinical risk factors. Associations between MRI-measured changes and dose were evaluated. RESULTS Among 51 women enrolled, mean heart dose ranged from 0.80 to 4.7 Gy and mean left ventricular (LV) dose from 1.1 to 8.2 Gy, with mean heart dose 2.0 Gy. T1 time, a marker of fibrosis, and right ventricular (RV) ejection fraction (EF) significantly changed with treatment; these were not dose dependent. T2 (marker of edema) and LV EF did not significantly change. No risk factors were associated with baseline global perfusion. Prior receipt of doxorubicin was marginally associated with decreased myocardial perfusion after RT (P = .059), and mean MHD was not associated with perfusion changes. A significant correlation between baseline IL-6 and mean heart dose (MHD) at the end of RT (ρ 0.44, P = .007) and a strong trend between troponin I and MHD at 3 months post-treatment (ρ 0.33, P = .07) were observed. No other significant correlations were identified. CONCLUSIONS In this prospective study of women with left-sided breast cancer treated with contemporary treatment planning, cardiac radiation doses were very low relative to historical doses reported by Darby et al. Although we observed significant changes in T1 and RV EF shortly after RT, these changes were not correlated with whole heart or substructure doses. Serum biomarker analysis of cardiac injury demonstrates an interesting trend between markers and MHD that warrants further investigation.
Collapse
Affiliation(s)
- Corey Speers
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan; Comprehensive Cancer Center, University of Michigan, Ann Arbor, Michigan
| | - Venkatesh L Murthy
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Michigan, Ann Arbor, Michigan; Frankel Cardiovascular Center, University of Michigan, Ann Arbor, Michigan
| | - Eleanor M Walker
- Department of Radiation Oncology, Henry Ford Cancer Institute, Detroit, Michigan
| | - Carri K Glide-Hurst
- Department of Human Oncology, School of Medicine and Public Heath, University of Wisconsin-Madison, Madison, Wisconsin
| | - Robin Marsh
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan
| | - Ming Tang
- Department of Biostatistics, University of Michigan, Ann Arbor, Michigan
| | - Emily L Morris
- Department of Biostatistics, University of Michigan, Ann Arbor, Michigan
| | - Matthew J Schipper
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan; Department of Biostatistics, University of Michigan, Ann Arbor, Michigan
| | - Richard L Weinberg
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Michigan, Ann Arbor, Michigan; Frankel Cardiovascular Center, University of Michigan, Ann Arbor, Michigan
| | - Hunter C Gits
- Department of Radiation Oncology, Mayo Clinic, Rochester, Minnesota
| | - James Hayman
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan; Comprehensive Cancer Center, University of Michigan, Ann Arbor, Michigan
| | - Mary Feng
- Department of Radiation Oncology, University of California San Francisco, San Francisco, California
| | - James Balter
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan
| | - Jean Moran
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan
| | - Reshma Jagsi
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan; Comprehensive Cancer Center, University of Michigan, Ann Arbor, Michigan
| | - Lori J Pierce
- Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan; Comprehensive Cancer Center, University of Michigan, Ann Arbor, Michigan.
| |
Collapse
|
40
|
Douglass MJJ, Keal JA. DeepWL: Robust EPID based Winston-Lutz analysis using deep learning, synthetic image generation and optical path-tracing. Phys Med 2021; 89:306-316. [PMID: 34492498 DOI: 10.1016/j.ejmp.2021.08.012] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/02/2021] [Revised: 08/03/2021] [Accepted: 08/27/2021] [Indexed: 12/23/2022] Open
Abstract
Radiation therapy requires clinical linear accelerators to be mechanically and dosimetrically calibrated to a high standard. One important quality assurance test is the Winston-Lutz test which localises the radiation isocentre of the linac. In the current work we demonstrate a novel method of analysing EPID based Winston-Lutz QA images using a deep learning model trained only on synthetic image data. In addition, we propose a novel method of generating the synthetic WL images and associated 'ground-truth' masks using an optical path-tracing engine to 'fake' mega-voltage EPID images. The model called DeepWL was trained on 1500 synthetic WL images using data augmentation techniques for 180 epochs. The model was built using Keras with a TensorFlow backend on an Intel Core i5-6500T CPU and trained in approximately 15 h. DeepWL was shown to produce ball bearing and multi-leaf collimator field segmentations with a mean dice coefficient of 0.964 and 0.994 respectively on previously unseen synthetic testing data. When DeepWL was applied to WL data measured on an EPID, the predicted mean displacements were shown to be statistically similar to the Canny Edge detection method. However, the DeepWL predictions for the ball bearing locations were shown to correlate better with manual annotations compared with the Canny edge detection algorithm. DeepWL was demonstrated to analyse Winston-Lutz images with an accuracy suitable for routine linac quality assurance with some statistical evidence that it may outperform Canny Edge detection methods in terms of segmentation robustness and the resultant displacement predictions.
Collapse
Affiliation(s)
- Michael John James Douglass
- School of Physical Sciences, University of Adelaide, Adelaide 5005, South Australia, Australia; Department of Medical Physics, Royal Adelaide Hospital, Adelaide 5000, South Australia, Australia.
| | - James Alan Keal
- School of Physical Sciences, University of Adelaide, Adelaide 5005, South Australia, Australia
| |
Collapse
|
41
|
Jung JW, Mille MM, Ky B, Kenworthy W, Lee C, Yeom YS, Kwag A, Bosch W, MacDonald S, Cahlon O, Bekelman JE, Lee C, on behalf of the RadComp Consortium. Application of an automatic segmentation method for evaluating cardiac structure doses received by breast radiotherapy patients. PHYSICS & IMAGING IN RADIATION ONCOLOGY 2021; 19:138-144. [PMID: 34485719 PMCID: PMC8397890 DOI: 10.1016/j.phro.2021.08.005] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Revised: 08/12/2021] [Accepted: 08/13/2021] [Indexed: 12/16/2022]
Abstract
Atlas-based method for contouring heart substructures on breast radiotherapy CT. Excellent agreement between automatic and manual contours for most patients. Dice similarity coefficient for LAD was low (0.06) because a narrow, long structure. Doses derived from automatic and manual contours agree within observer variability. For left breast treatment, right ventricle and LAD dose most senstive to contour shift.
Background and purpose Quantifying radiation dose to cardiac substructures is important for research on the etiology and prevention of complications following radiotherapy; however, segmentation of substructures is challenging. In this study we demonstrate the application of our atlas-based automatic segmentation method to breast cancer radiotherapy plans for generating radiation doses in support of late effects research. Material and methods We applied our segmentation method to contour heart substructures on the computed tomography (CT) images of 70 breast cancer patients who received external photon radiotherapy. Two cardiologists provided manual segmentation of the whole heart (WH), left/right atria, left/right ventricles, and left anterior descending artery (LAD). The automatically contours were compared with manual delineations to evaluate similarity in terms of geometry and dose. Results The mean Dice similarity coefficient between manual and automatic segmentations was 0.96 for the WH, 0.65 to 0.82 for the atria and ventricles, and 0.06 for the LAD. The mean average surface distance was 1.2 mm for the WH, 3.4 to 4.1 mm for the atria and ventricles, and 6.4 mm for the LAD. We found the dose to the cardiac substructures based on our automatic segmentation agrees with manual segmentation within expected observer variability. For left breast patients, the mean absolute difference in mean dose was 0.1 Gy for the WH, 0.2 to 0.7 Gy for the atria and ventricles, and 1.8 Gy for the LAD. For right breast patients, these values were 0.0 Gy, 0.1 to 0.4 Gy, and 0.4 Gy, respectively. Conclusion Our automatic segmentation method will facilitate the development of radiotherapy prescriptive criteria for mitigating cardiovascular complications.
Collapse
Affiliation(s)
- Jae Won Jung
- Department of Physics, East Carolina University, Greenville, NC 27858, United States
| | - Matthew M. Mille
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD 20850, United States
| | - Bonnie Ky
- Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, United States
| | - Walter Kenworthy
- Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, United States
| | - Choonik Lee
- Department of Radiation Oncology, University of Michigan, Ann Arbor, MI 48109, United States
| | - Yeon Soo Yeom
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD 20850, United States
| | - Aaron Kwag
- Department of Neuroscience, Vanderbilt University, Nashville, TN 37240, United States
| | - Walter Bosch
- Department of Radiation Oncology, Washington University, St. Louis, MO 63130, United States
| | - Shannon MacDonald
- Department of Radiation Oncology, Massachusetts General Hospital, Boston, MA 02114, United States
| | - Oren Cahlon
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY 10065, United States
| | - Justin E. Bekelman
- Department of Radiation Oncology, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, United States
| | - Choonsik Lee
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Rockville, MD 20850, United States
- Corresponding author at: Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, 9609 Medical Center Drive, Rockville, MD 20850, United States.
| | | |
Collapse
|
42
|
Loap P, Tkatchenko N, Goudjil F, Ribeiro M, Baron B, Fourquet A, Kirova Y. Cardiac substructure exposure in breast radiotherapy: a comparison between intensity modulated proton therapy and volumetric modulated arc therapy. Acta Oncol 2021; 60:1038-1044. [PMID: 33788665 DOI: 10.1080/0284186x.2021.1907860] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
INTRODUCTION Proton therapy for breast cancer treatment reduces cardiac radiation exposure. Left-sided breast cancer patients with indication for internal mammary chain (IMC) irradiation are most at risk of radiation-induced cardiotoxicity. This study aims to evaluate in this situation the potential dosimetric benefit of intensity modulated proton therapy (IMPT) over volumetric modulated arc therapy (VMAT) at the cardiac substructure level. MATERIALS AND METHODS Cardiac substructures were retrospectively delineated according to ESTRO guidelines on the simulation CT scans of fourteen left-sided breast cancer patients having undergone conserving surgery and adjuvant locoregional free-breathing (FB-) or deep inspiration breath-hold (DIBH-) VMAT with internal mammary chain irradiation. IMPT treatment was re-planned on the simulation CT scans. Mean doses to cardiac substructures were retrieved and compared between VMAT treatment plans and IMPT simulation plans. Pearson correlation coefficients were calculated between mean doses delivered to cardiac substructures using these two techniques. RESULTS Mean doses to all cardiac substructures were significantly lower with IMPT than with VMAT. Regardless of the irradiation technique, the most exposed cardiac substructure was the mid segment of the left anterior descending coronary artery (LADCA). Pearson correlation coefficients between mean doses to cardiac substructures were usually weak and statistically non-significant for IMPT; mean heart dose (MHD) only correlated with mean doses delivered to the right ventricle, to the mid segment of the right coronary artery (RCA) and, to a lesser extent, to the LADCA. CONCLUSION The dosimetric benefit of IMPT over conformal photon therapy was consistently observed for all cardiac substructures. MHD may not be a reliable dosimetric parameter for precise cardiac exposure evaluation when planning IMPT.
Collapse
Affiliation(s)
- Pierre Loap
- Institut Curie, Department of Radiation Oncology, Paris, France
| | | | - Farid Goudjil
- Institut Curie, Department of Radiation Oncology, Paris, France
| | - Madison Ribeiro
- Institut Curie, Department of Radiation Oncology, Paris, France
| | - Brian Baron
- Institut Curie, Department of Radiation Oncology, Paris, France
| | - Alain Fourquet
- Institut Curie, Department of Radiation Oncology, Paris, France
| | - Youlia Kirova
- Institut Curie, Department of Radiation Oncology, Paris, France
| |
Collapse
|
43
|
Yang DH. Application of Artificial Intelligence to Cardiovascular Computed Tomography. Korean J Radiol 2021; 22:1597-1608. [PMID: 34402240 PMCID: PMC8484158 DOI: 10.3348/kjr.2020.1314] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Revised: 03/26/2021] [Accepted: 05/14/2021] [Indexed: 11/15/2022] Open
Abstract
Cardiovascular computed tomography (CT) is among the most active fields with ongoing technical innovation related to image acquisition and analysis. Artificial intelligence can be incorporated into various clinical applications of cardiovascular CT, including imaging of the heart valves and coronary arteries, as well as imaging to evaluate myocardial function and congenital heart disease. This review summarizes the latest research on the application of deep learning to cardiovascular CT. The areas covered range from image quality improvement to automatic analysis of CT images, including methods such as calcium scoring, image segmentation, and coronary artery evaluation.
Collapse
Affiliation(s)
- Dong Hyun Yang
- Department of Radiology and Research Institute of Radiology, Cardiac Imaging Center, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea.
| |
Collapse
|
44
|
Samarasinghe G, Jameson M, Vinod S, Field M, Dowling J, Sowmya A, Holloway L. Deep learning for segmentation in radiation therapy planning: a review. J Med Imaging Radiat Oncol 2021; 65:578-595. [PMID: 34313006 DOI: 10.1111/1754-9485.13286] [Citation(s) in RCA: 40] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2021] [Accepted: 06/29/2021] [Indexed: 12/21/2022]
Abstract
Segmentation of organs and structures, as either targets or organs-at-risk, has a significant influence on the success of radiation therapy. Manual segmentation is a tedious and time-consuming task for clinicians, and inter-observer variability can affect the outcomes of radiation therapy. The recent hype over deep neural networks has added many powerful auto-segmentation methods as variations of convolutional neural networks (CNN). This paper presents a descriptive review of the literature on deep learning techniques for segmentation in radiation therapy planning. The most common CNN architecture across the four clinical sub sites considered was U-net, with the majority of deep learning segmentation articles focussed on head and neck normal tissue structures. The most common data sets were CT images from an inhouse source, along with some public data sets. N-fold cross-validation was commonly employed; however, not all work separated training, test and validation data sets. This area of research is expanding rapidly. To facilitate comparisons of proposed methods and benchmarking, consistent use of appropriate metrics and independent validation should be carefully considered.
Collapse
Affiliation(s)
- Gihan Samarasinghe
- School of Computer Science and Engineering, University of New South Wales, Sydney, New South Wales, Australia.,Ingham Institute for Applied Medical Research and South Western Sydney Clinical School, UNSW, Liverpool, New South Wales, Australia
| | - Michael Jameson
- Genesiscare, Sydney, New South Wales, Australia.,St Vincent's Clinical School, University of New South Wales, Sydney, New South Wales, Australia
| | - Shalini Vinod
- Ingham Institute for Applied Medical Research and South Western Sydney Clinical School, UNSW, Liverpool, New South Wales, Australia.,Liverpool Cancer Therapy Centre, Liverpool Hospital, Liverpool, New South Wales, Australia
| | - Matthew Field
- Ingham Institute for Applied Medical Research and South Western Sydney Clinical School, UNSW, Liverpool, New South Wales, Australia.,Liverpool Cancer Therapy Centre, Liverpool Hospital, Liverpool, New South Wales, Australia
| | - Jason Dowling
- Commonwealth Scientific and Industrial Research Organisation, Australian E-Health Research Centre, Herston, Queensland, Australia
| | - Arcot Sowmya
- School of Computer Science and Engineering, University of New South Wales, Sydney, New South Wales, Australia
| | - Lois Holloway
- Ingham Institute for Applied Medical Research and South Western Sydney Clinical School, UNSW, Liverpool, New South Wales, Australia.,Liverpool Cancer Therapy Centre, Liverpool Hospital, Liverpool, New South Wales, Australia
| |
Collapse
|
45
|
Liu X, Li KW, Yang R, Geng LS. Review of Deep Learning Based Automatic Segmentation for Lung Cancer Radiotherapy. Front Oncol 2021; 11:717039. [PMID: 34336704 PMCID: PMC8323481 DOI: 10.3389/fonc.2021.717039] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2021] [Accepted: 06/21/2021] [Indexed: 12/14/2022] Open
Abstract
Lung cancer is the leading cause of cancer-related mortality for males and females. Radiation therapy (RT) is one of the primary treatment modalities for lung cancer. While delivering the prescribed dose to tumor targets, it is essential to spare the tissues near the targets-the so-called organs-at-risk (OARs). An optimal RT planning benefits from the accurate segmentation of the gross tumor volume and surrounding OARs. Manual segmentation is a time-consuming and tedious task for radiation oncologists. Therefore, it is crucial to develop automatic image segmentation to relieve radiation oncologists of the tedious contouring work. Currently, the atlas-based automatic segmentation technique is commonly used in clinical routines. However, this technique depends heavily on the similarity between the atlas and the image segmented. With significant advances made in computer vision, deep learning as a part of artificial intelligence attracts increasing attention in medical image automatic segmentation. In this article, we reviewed deep learning based automatic segmentation techniques related to lung cancer and compared them with the atlas-based automatic segmentation technique. At present, the auto-segmentation of OARs with relatively large volume such as lung and heart etc. outperforms the organs with small volume such as esophagus. The average Dice similarity coefficient (DSC) of lung, heart and liver are over 0.9, and the best DSC of spinal cord reaches 0.9. However, the DSC of esophagus ranges between 0.71 and 0.87 with a ragged performance. In terms of the gross tumor volume, the average DSC is below 0.8. Although deep learning based automatic segmentation techniques indicate significant superiority in many aspects compared to manual segmentation, various issues still need to be solved. We discussed the potential issues in deep learning based automatic segmentation including low contrast, dataset size, consensus guidelines, and network design. Clinical limitations and future research directions of deep learning based automatic segmentation were discussed as well.
Collapse
Affiliation(s)
- Xi Liu
- School of Physics, Beihang University, Beijing, China
| | - Kai-Wen Li
- School of Physics, Beihang University, Beijing, China
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine and Engineering, Key Laboratory of Big Data-Based Precision Medicine, Ministry of Industry and Information Technology, Beihang University, Beijing, China
| | - Ruijie Yang
- Department of Radiation Oncology, Peking University Third Hospital, Beijing, China
| | - Li-Sheng Geng
- School of Physics, Beihang University, Beijing, China
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine and Engineering, Key Laboratory of Big Data-Based Precision Medicine, Ministry of Industry and Information Technology, Beihang University, Beijing, China
- Beijing Key Laboratory of Advanced Nuclear Materials and Physics, Beihang University, Beijing, China
- School of Physics and Microelectronics, Zhengzhou University, Zhengzhou, China
| |
Collapse
|
46
|
Harms J, Lei Y, Tian S, McCall NS, Higgins KA, Bradley JD, Curran WJ, Liu T, Yang X. Automatic delineation of cardiac substructures using a region-based fully convolutional network. Med Phys 2021; 48:2867-2876. [PMID: 33655548 DOI: 10.1002/mp.14810] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 02/11/2021] [Accepted: 02/19/2021] [Indexed: 12/25/2022] Open
Abstract
PURPOSE Radiation dose to specific cardiac substructures, such as the atria and ventricles, has been linked to post-treatment toxicity and has shown to be more predictive of these toxicities than dose to the whole heart. A deep learning-based algorithm for automatic generation of these contours is proposed to aid in either retrospective or prospective dosimetric studies to better understand the relationship between radiation dose and toxicities. METHODS The proposed method uses a mask-scoring regional convolutional neural network (RCNN) which consists of five major subnetworks: backbone, regional proposal network (RPN), RCNN head, mask head, and mask-scoring head. Multiscale feature maps are learned from computed tomography (CT) via the backbone network. The RPN utilizes these feature maps to detect the location and region-of-interest (ROI) of all substructures, and the final three subnetworks work in series to extract structural information from these ROIs. The network is trained using 55 patient CT datasets, with 22 patients having contrast scans. Threefold cross validation (CV) is used for evaluation on 45 datasets, and a separate cohort of 10 patients are used for holdout evaluation. The proposed method is compared to a 3D UNet. RESULTS The proposed method produces contours that are qualitatively similar to the ground truth contours. Quantitatively, the proposed method achieved average Dice score coefficients (DSCs) for the whole heart, chambers, great vessels, coronary arteries, the valves of the heart of 0.96, 0.94, 0.93, 0.66, and 0.77 respectively, outperforming the 3D UNet, which achieved DSCs of 0.92, 0.87, 0.88, 0.48, and 0.59 for the corresponding substructure groups. Mean surface distances (MSDs) between substructures segmented by the proposed method and the ground truth were <2 mm except for the left anterior descending coronary artery and the mitral and tricuspid valves, and <5 mm for all substructures. When dividing results into noncontrast and contrast datasets, the model performed statistically significantly better in terms of DSC, MSD, centroid mean distance (CMD), and volume difference for the chambers and whole heart with contrast. Notably, the presence of contrast did not statistically significantly affect coronary artery segmentation DSC or MSD. After network training, all substructures and the whole heart can be segmented on new datasets in less than 5 s. CONCLUSIONS A deep learning network was trained for automatic delineation of cardiac substructures based on CT alone. The proposed method can be used as a tool to investigate the relationship between cardiac substructure dose and treatment toxicities.
Collapse
Affiliation(s)
- Joseph Harms
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| | - Yang Lei
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| | - Sibo Tian
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| | - Neal S McCall
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| | - Kristin A Higgins
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| | - Jeffrey D Bradley
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| | - Walter J Curran
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| | - Tian Liu
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| | - Xiaofeng Yang
- Department of Radiation Oncology and Winship Cancer Institute, Emory University, Atlanta, GA, USA
| |
Collapse
|
47
|
Liu X, Gao K, Liu B, Pan C, Liang K, Yan L, Ma J, He F, Zhang S, Pan S, Yu Y. Advances in Deep Learning-Based Medical Image Analysis. HEALTH DATA SCIENCE 2021; 2021:8786793. [PMID: 38487506 PMCID: PMC10880179 DOI: 10.34133/2021/8786793] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Accepted: 03/04/2021] [Indexed: 03/17/2024]
Abstract
Importance. With the booming growth of artificial intelligence (AI), especially the recent advancements of deep learning, utilizing advanced deep learning-based methods for medical image analysis has become an active research area both in medical industry and academia. This paper reviewed the recent progress of deep learning research in medical image analysis and clinical applications. It also discussed the existing problems in the field and provided possible solutions and future directions.Highlights. This paper reviewed the advancement of convolutional neural network-based techniques in clinical applications. More specifically, state-of-the-art clinical applications include four major human body systems: the nervous system, the cardiovascular system, the digestive system, and the skeletal system. Overall, according to the best available evidence, deep learning models performed well in medical image analysis, but what cannot be ignored are the algorithms derived from small-scale medical datasets impeding the clinical applicability. Future direction could include federated learning, benchmark dataset collection, and utilizing domain subject knowledge as priors.Conclusion. Recent advanced deep learning technologies have achieved great success in medical image analysis with high accuracy, efficiency, stability, and scalability. Technological advancements that can alleviate the high demands on high-quality large-scale datasets could be one of the future developments in this area.
Collapse
Affiliation(s)
| | | | - Bo Liu
- DeepWise AI Lab, BeijingChina
| | | | | | | | | | | | | | - Siyuan Pan
- Shanghai Jiaotong University, Shanghai, China
| | - Yizhou Yu
- DeepWise AI Lab, BeijingChina
- The University of Hong Kong, Hong Kong
| |
Collapse
|
48
|
Morris ED, Ghanem AI, Zhu S, Dong M, Pantelic MV, Glide-Hurst CK. Quantifying inter-fraction cardiac substructure displacement during radiotherapy via magnetic resonance imaging guidance. PHYSICS & IMAGING IN RADIATION ONCOLOGY 2021; 18:34-40. [PMID: 34258405 PMCID: PMC8254195 DOI: 10.1016/j.phro.2021.03.005] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Revised: 03/25/2021] [Accepted: 03/25/2021] [Indexed: 12/20/2022]
Abstract
Purpose Emerging evidence suggests cardiac substructures are highly radiosensitive during radiation therapy for cancer treatment. However, variability in substructure position after tumor localization has not been well characterized. This study quantifies inter-fraction displacement and planning organ at risk volumes (PRVs) of substructures by leveraging the excellent soft tissue contrast of magnetic resonance imaging (MRI). Methods Eighteen retrospectively evaluated patients underwent radiotherapy for intrathoracic tumors with a 0.35 T MRI-guided linear accelerator. Imaging was acquired at a 17–25 s breath-hold (resolution 1.5 × 1.5 × 3 mm3). Three to four daily MRIs per patient (n = 71) were rigidly registered to the planning MRI-simulation based on tumor matching. Deep learning or atlas-based segmentation propagated 13 substructures (e.g., chambers, coronary arteries, great vessels) to daily MRIs and were verified by two radiation oncologists. Daily centroid displacements from MRI-simulation were quantified and PRVs were calculated. Results Across substructures, inter-fraction displacements for 14% in the left–right, 18% in the anterior-posterior, and 21% of fractions in the superior-inferior were > 5 mm. Due to lack of breath-hold compliance, ~4% of all structures shifted > 10 mm in any axis. For the chambers, median displacements were 1.8, 1.9, and 2.2 mm in the left–right, anterior-posterior, and superior-inferior axis, respectively. Great vessels demonstrated larger displacements (> 3 mm) in the superior-inferior axis (43% of shifts) and were only 25% (left–right) and 29% (anterior-posterior) elsewhere. PRVs from 3 to 5 mm were determined as anisotropic substructure-specific margins. Conclusions This exploratory work derived substructure-specific safety margins to ensure highly effective cardiac sparing. Findings require validation in a larger cohort for robust margin derivation and for applications in prospective clinical trials.
Collapse
Affiliation(s)
- Eric D. Morris
- Department of Radiation Oncology, University of California—Los Angeles, Los Angeles, CA 90095, United States
| | - Ahmed I. Ghanem
- Department of Radiation Oncology, Henry Ford Cancer Institute, Detroit, MI 48202, United States
- Alexandria Clinical Oncology Department, Alexandria University, Alexandria, Egypt
| | - Simeng Zhu
- Department of Radiation Oncology, Henry Ford Cancer Institute, Detroit, MI 48202, United States
| | - Ming Dong
- Department of Computer Science, Wayne State University, Detroit, MI 48202, United States
| | - Milan V. Pantelic
- Department of Radiology, Henry Ford Cancer Institute, Detroit, MI 48202, United States
| | - Carri K. Glide-Hurst
- Department of Human Oncology, University of Wisconsin, Madison, Madison, WI 53792, United States
- Corresponding author at: Department of Human Oncology, School of Medicine and Public Heath, University of Wisconsin, Madison, 600 Highland Avenue, K4, Madison, Wisconsin 53792, United States.
| |
Collapse
|
49
|
Díaz-Gavela AA, Figueiras-Graillet L, Luis ÁM, Salas Segura J, Ciérvide R, del Cerro Peñalver E, Couñago F, Arenas M, López-Fernández T. Breast Radiotherapy-Related Cardiotoxicity. When, How, Why. Risk Prevention and Control Strategies. Cancers (Basel) 2021; 13:1712. [PMID: 33916644 PMCID: PMC8038596 DOI: 10.3390/cancers13071712] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Revised: 03/31/2021] [Accepted: 04/02/2021] [Indexed: 12/24/2022] Open
Abstract
In recent decades, improvements in breast cancer management have increased overall patient survival; however, many cancer therapies have been linked to an important risk of cardiovascular adverse events. Cardio-oncology has been proposed as an emerging specialty to coordinate preventive strategies that improve the cardiovascular health of oncologic patients. It employs the most suitable personalized multidisciplinary management approach for each patient to optimize their cardiovascular health and improve their survival and quality of life. Radiotherapy is an essential part of the therapeutic regimen in breast cancer patients but can also increase the risk of cardiovascular disease. Therefore, minimizing the negative impact of radiation therapy is an important challenge for radiotherapy oncologists and cardiologists specializing in this field. The aim of the present review is to update our knowledge about radiation-induced cardiotoxicity in breast cancer patients by undertaking a critical review of the relevant literature to determine risk prevention and control strategies currently available.
Collapse
Affiliation(s)
- Ana Aurora Díaz-Gavela
- Radiation Oncology, Hospital Universitario Quirónsalud Madrid, 28223 Madrid, Spain;
- Radiation Oncology, Hospital La Luz, 28003 Madrid, Spain
- Clinical Department, Faculty of Biomedicine, Universidad Europea de Madrid, 28670 Madrid, Spain
| | - Lourdes Figueiras-Graillet
- Cardiooncology Clinic, Centro Estatal de Cancerología Miguel Dorantes Mesa, Xalapa-Enríquez 91130, Mexico;
| | - Ángel Montero Luis
- Radiation Oncology Department, Hospital Universitario HM Sanchinarro, 28050 Madrid, Spain; (Á.M.L.); (R.C.)
| | - Juliana Salas Segura
- Cardio-oncology Unit, Hospital San Juan de Dios, San José 10103, Costa Rica;
- Cardiology Department, Hospital Clínica Bíblica. San José 10103, Costa Rica
| | - Raquel Ciérvide
- Radiation Oncology Department, Hospital Universitario HM Sanchinarro, 28050 Madrid, Spain; (Á.M.L.); (R.C.)
| | - Elia del Cerro Peñalver
- Radiation Oncology, Hospital Universitario Quirónsalud Madrid, 28223 Madrid, Spain;
- Radiation Oncology, Hospital La Luz, 28003 Madrid, Spain
- Clinical Department, Faculty of Biomedicine, Universidad Europea de Madrid, 28670 Madrid, Spain
| | - Felipe Couñago
- Radiation Oncology, Hospital Universitario Quirónsalud Madrid, 28223 Madrid, Spain;
- Radiation Oncology, Hospital La Luz, 28003 Madrid, Spain
- Clinical Department, Faculty of Biomedicine, Universidad Europea de Madrid, 28670 Madrid, Spain
| | - Meritxell Arenas
- Radiation Oncology, Hospital Universitari Sant Joan de Reus, 43204 Reus, Spain;
- Universitat Rovira i Virgili. IISPV, 43204 Reus, Spain
| | - Teresa López-Fernández
- Cardio-oncology Unit. Cardiology Department, Hospital Universitario La Paz, 28046 Madrid, Spain;
- Hospital La Paz Institute for Health Research—IdiPAZ, 28046 Madrid, Spain
| |
Collapse
|
50
|
Thorwarth D, Low DA. Technical Challenges of Real-Time Adaptive MR-Guided Radiotherapy. Front Oncol 2021; 11:634507. [PMID: 33763369 PMCID: PMC7982516 DOI: 10.3389/fonc.2021.634507] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2020] [Accepted: 01/26/2021] [Indexed: 12/18/2022] Open
Abstract
In the past few years, radiotherapy (RT) has experienced a major technological innovation with the development of hybrid machines combining magnetic resonance (MR) imaging and linear accelerators. This new technology for MR-guided cancer treatment has the potential to revolutionize the field of adaptive RT due to the opportunity to provide high-resolution, real-time MR imaging before and during treatment application. However, from a technical point of view, several challenges remain which need to be tackled to ensure safe and robust real-time adaptive MR-guided RT delivery. In this manuscript, several technical challenges to MR-guided RT are discussed. Starting with magnetic field strength tradeoffs, the potential and limitations for purely MR-based RT workflows are discussed. Furthermore, the current status of real-time 3D MR imaging and its potential for real-time RT are summarized. Finally, the potential of quantitative MR imaging for future biological RT adaptation is highlighted.
Collapse
Affiliation(s)
- Daniela Thorwarth
- Section for Biomedical Physics, Department of Radiation Oncology, University of Tübingen, Tübingen, Germany
| | - Daniel A Low
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, CA, United States
| |
Collapse
|