1
|
Abimouloud ML, Bensid K, Elleuch M, Ammar MB, Kherallah M. Advancing breast cancer diagnosis: token vision transformers for faster and accurate classification of histopathology images. Vis Comput Ind Biomed Art 2025; 8:1. [PMID: 39775534 PMCID: PMC11711433 DOI: 10.1186/s42492-024-00181-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2024] [Accepted: 11/20/2024] [Indexed: 01/11/2025] Open
Abstract
The vision transformer (ViT) architecture, with its attention mechanism based on multi-head attention layers, has been widely adopted in various computer-aided diagnosis tasks due to its effectiveness in processing medical image information. ViTs are notably recognized for their complex architecture, which requires high-performance GPUs or CPUs for efficient model training and deployment in real-world medical diagnostic devices. This renders them more intricate than convolutional neural networks (CNNs). This difficulty is also challenging in the context of histopathology image analysis, where the images are both limited and complex. In response to these challenges, this study proposes a TokenMixer hybrid-architecture that combines the strengths of CNNs and ViTs. This hybrid architecture aims to enhance feature extraction and classification accuracy with shorter training time and fewer parameters by minimizing the number of input patches employed during training, while incorporating tokenization of input patches using convolutional layers and encoder transformer layers to process patches across all network layers for fast and accurate breast cancer tumor subtype classification. The TokenMixer mechanism is inspired by the ConvMixer and TokenLearner models. First, the ConvMixer model dynamically generates spatial attention maps using convolutional layers, enabling the extraction of patches from input images to minimize the number of input patches used in training. Second, the TokenLearner model extracts relevant regions from the selected input patches, tokenizes them to improve feature extraction, and trains all tokenized patches in an encoder transformer network. We evaluated the TokenMixer model on the BreakHis public dataset, comparing it with ViT-based and other state-of-the-art methods. Our approach achieved impressive results for both binary and multi-classification of breast cancer subtypes across various magnification levels (40×, 100×, 200×, 400×). The model demonstrated accuracies of 97.02% for binary classification and 93.29% for multi-classification, with decision times of 391.71 and 1173.56 s, respectively. These results highlight the potential of our hybrid deep ViT-CNN architecture for advancing tumor classification in histopathological images. The source code is accessible: https://github.com/abimouloud/TokenMixer .
Collapse
Affiliation(s)
- Mouhamed Laid Abimouloud
- National Engineering School of Sfax, University of Sfax, Sfax, Tunisia.
- Advanced Technologies for Environment and Smart Cities (ATES Unit), Sfax University, Sfax, Tunisia.
| | - Khaled Bensid
- Laboratory of Electrical Engineering (LAGE), University of KASDI Merbah Ouargla, 30000, Ouargla, Algeria
| | - Mohamed Elleuch
- National School of Computer Science (ENSI), University of Manouba, Manouba, Tunisia
- Advanced Technologies for Environment and Smart Cities (ATES Unit), Sfax University, Sfax, Tunisia
| | - Mohamed Ben Ammar
- Department of Information Systems, Faculty of Computing and Information Technology, Northern Border University, Rafha, Saudi Arabia
| | - Monji Kherallah
- Faculty of Sciences, Sfax, Tunisia
- Advanced Technologies for Environment and Smart Cities (ATES Unit), Sfax University, Sfax, Tunisia
| |
Collapse
|
2
|
Deng Y, Qiu M, Li Y, Wang C, Zhong J, Xiao Z, Wang C, Chen R. A generalized model of cardiac surface motion for evaluating left anterior descending coronary artery dose in left breast cancer radiotherapy. Med Phys 2024; 51:7545-7560. [PMID: 38922708 DOI: 10.1002/mp.17261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Revised: 05/22/2024] [Accepted: 05/22/2024] [Indexed: 06/28/2024] Open
Abstract
BACKGROUND Retrospective studies indicate that radiation damage to left anterior descending coronary artery (LAD) may be critical for late-stage radiation-induced cardiac morbidity. Developing a method that accurately depicts LAD motion and perform dose assessment is crucial. PURPOSE To construct a generalized cardiac surface motion model for LAD dose assessment in left breast cancer radiotherapy. METHODS Cine MRI of 25 cases were divided into training and testing sets for model construction, and five external cases were gathered for generalization validation. Motion prediction from average intensity projection images (AIP) surface point cloud to that of each phase was realized by mapping the relationship between datum points and corresponding points with statistical shape modeling (SSM). Root mean square error (RMSE) for predicted corresponding points and Euclidean distance (ED) for predicted surface point cloud were used to assess model's accuracy. LAD dose assessment for 10 left breast cancer radiotherapy cases was perform by model application. RESULTS The RMSE in testing cases and external cases were 0.209 ± 0.020 mm to 0.841 ± 0.074 mm and 0.895 ± 0.093 mm to 1.912 ± 0.138 mm, respectively; while the ED were 1.399 ± 0.029 mm to 1.658 ± 0.100 mm, 1.571 ± 0.080 mm to 1.779 ± 0.104 mm, respectively, proving the generalized model's high accuracy. The volume of LAD characterizing motion range (WPLAD) (2.392 ± 0.639 cm3) was approximately twice that of LAD from superimposed images (SPLAD) (0.927 ± 0.326 cm3) with p < 0.05, and the former's Dmax (3582.06 ± 575.92 cGy) was significantly larger than latter's (3222.71 ± 665.37 cGy) (p < 0.05). While WPLAD's Dmean (1408.06 ± 413.06 cGy) was slightly smaller than that of SPLAD (1504.15 ± 448.03 cGy), the difference did not reach statistical significance (p > 0.05). WPLAD's V20 (23.42% ± 16.62%) was less than SPLAD's (29.18% ± 21.07%) with p < 0.05, but their comparison in V30 and V40 did not yield statistically significant results. It implies the conventional LAD dose assessment ignores motion impact and may not be justified. CONCLUSIONS The generalized cardiac surface motion model informs LAD dose accurate assessment in left breast cancer radiotherapy.
Collapse
Affiliation(s)
- Yongjin Deng
- The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong Province, PR China
| | - Minmin Qiu
- The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong Province, PR China
| | - Yangchan Li
- The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong Province, PR China
| | - Chaoyang Wang
- The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong Province, PR China
| | - Jiajian Zhong
- The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong Province, PR China
| | - Zhenhua Xiao
- The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong Province, PR China
| | - Chengtao Wang
- The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong Province, PR China
| | - Ruiwan Chen
- The First Affiliated Hospital, Sun Yat-Sen University, Guangzhou, Guangdong Province, PR China
| |
Collapse
|
3
|
Salih AM, Galazzo IB, Gkontra P, Rauseo E, Lee AM, Lekadir K, Radeva P, Petersen SE, Menegaz G. A review of evaluation approaches for explainable AI with applications in cardiology. Artif Intell Rev 2024; 57:240. [PMID: 39132011 PMCID: PMC11315784 DOI: 10.1007/s10462-024-10852-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/03/2024] [Indexed: 08/13/2024]
Abstract
Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This review details the evaluation of XAI in cardiac AI applications and has found that, of the studies examined, 37% evaluated XAI quality using literature results, 11% used clinicians as domain-experts, 11% used proxies or statistical analysis, with the remaining 43% not assessing the XAI used at all. We aim to inspire additional studies within healthcare, urging researchers not only to apply XAI methods but to systematically assess the resulting explanations, as a step towards developing trustworthy and safe models. Supplementary Information The online version contains supplementary material available at 10.1007/s10462-024-10852-w.
Collapse
Affiliation(s)
- Ahmed M. Salih
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ UK
- Department of Population Health Sciences, University of Leicester, University Rd, Leicester, LE1 7RH UK
- Department of Computer Science, University of Zakho, Duhok road, Zakho, Kurdistan Iraq
| | - Ilaria Boscolo Galazzo
- Department of Engineering for Innovative Medicine, University of Verona, S. Francesco, 22, 37129 Verona, Italy
| | - Polyxeni Gkontra
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Gran Via de les Corts Catalanes, 585, 08007 Barcelona, Spain
| | - Elisa Rauseo
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ UK
| | - Aaron Mark Lee
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ UK
| | - Karim Lekadir
- Artificial Intelligence in Medicine Lab (BCN-AIM), Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Gran Via de les Corts Catalanes, 585, 08007 Barcelona, Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Passeig Lluís Companys 23, Barcelona, Spain
| | - Petia Radeva
- Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Gran Via de les Corts Catalanes, 585, 08007 Barcelona, Spain
| | - Steffen E. Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, Charterhouse Square, London, EC1M 6BQ UK
- Barts Heart Centre, St Bartholomew’s Hospital, Barts Health NHS Trust, West Smithfield, London, UK
- Health Data Research, London, UK
- Alan Turing Institute, London, UK
| | - Gloria Menegaz
- Department of Engineering for Innovative Medicine, University of Verona, S. Francesco, 22, 37129 Verona, Italy
| |
Collapse
|
4
|
Vladimirov N, Brui E, Levchuk A, Al-Haidri W, Fokin V, Efimtcev A, Bendahan D. CNN-based fully automatic wrist cartilage volume quantification in MR images: A comparative analysis between different CNN architectures. Magn Reson Med 2023; 90:737-751. [PMID: 37094028 DOI: 10.1002/mrm.29671] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2022] [Revised: 03/17/2023] [Accepted: 03/26/2023] [Indexed: 04/26/2023]
Abstract
PURPOSE Automatic measurement of wrist cartilage volume in MR images. METHODS We assessed the performance of four manually optimized variants of the U-Net architecture, nnU-Net and Mask R-CNN frameworks for the segmentation of wrist cartilage. The results were compared to those from a patch-based convolutional neural network (CNN) we previously designed. The segmentation quality was assessed on the basis of a comparative analysis with manual segmentation. The best networks were compared using a cross-validation approach on a dataset of 33 3D VIBE images of mostly healthy volunteers. Influence of some image parameters on the segmentation reproducibility was assessed. RESULTS The U-Net-based networks outperformed the patch-based CNN in terms of segmentation homogeneity and quality, while Mask R-CNN did not show an acceptable performance. The median 3D DSC value computed with the U-Net_AL (0.817) was significantly larger than DSC values computed with the other networks. In addition, the U-Net_AL provided the lowest mean volume error (17%) and the highest Pearson correlation coefficient (0.765) with respect to the ground truth values. Of interest, the reproducibility computed using U-Net_AL was larger than the reproducibility of the manual segmentation. Moreover, the results indicate that the MRI-based wrist cartilage volume is strongly affected by the image resolution. CONCLUSIONS U-Net CNN with attention layers provided the best wrist cartilage segmentation performance. In order to be used in clinical conditions, the trained network can be fine-tuned on a dataset representing a group of specific patients. The error of cartilage volume measurement should be assessed independently using a non-MRI method.
Collapse
Affiliation(s)
- Nikita Vladimirov
- School of Physics and Engineering, ITMO University, Saint-Petersburg, Russia
| | - Ekaterina Brui
- School of Physics and Engineering, ITMO University, Saint-Petersburg, Russia
| | - Anatoliy Levchuk
- School of Physics and Engineering, ITMO University, Saint-Petersburg, Russia
- Department of Radiology, Federal Almazov North-West Medical Research Center, Saint-Petersburg, Russia
| | - Walid Al-Haidri
- School of Physics and Engineering, ITMO University, Saint-Petersburg, Russia
| | - Vladimir Fokin
- School of Physics and Engineering, ITMO University, Saint-Petersburg, Russia
- Department of Radiology, Federal Almazov North-West Medical Research Center, Saint-Petersburg, Russia
| | - Aleksandr Efimtcev
- School of Physics and Engineering, ITMO University, Saint-Petersburg, Russia
- Department of Radiology, Federal Almazov North-West Medical Research Center, Saint-Petersburg, Russia
| | - David Bendahan
- Centre de Résonance Magnétique Biologique et Médicale, Aix-Marseille Universite, CNRS, Marseille, France
| |
Collapse
|
5
|
Salih A, Boscolo Galazzo I, Gkontra P, Lee AM, Lekadir K, Raisi-Estabragh Z, Petersen SE. Explainable Artificial Intelligence and Cardiac Imaging: Toward More Interpretable Models. Circ Cardiovasc Imaging 2023; 16:e014519. [PMID: 37042240 DOI: 10.1161/circimaging.122.014519] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/13/2023]
Abstract
Artificial intelligence applications have shown success in different medical and health care domains, and cardiac imaging is no exception. However, some machine learning models, especially deep learning, are considered black box as they do not provide an explanation or rationale for model outcomes. Complexity and vagueness in these models necessitate a transition to explainable artificial intelligence (XAI) methods to ensure that model results are both transparent and understandable to end users. In cardiac imaging studies, there are a limited number of papers that use XAI methodologies. This article provides a comprehensive literature review of state-of-the-art works using XAI methods for cardiac imaging. Moreover, it provides simple and comprehensive guidelines on XAI. Finally, open issues and directions for XAI in cardiac imaging are discussed.
Collapse
Affiliation(s)
- Ahmed Salih
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
| | | | - Polyxeni Gkontra
- Department of de Matemàtiques i Informàtica, University of Barcelona, Spain (P.G., K.L.)
| | - Aaron Mark Lee
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
| | - Karim Lekadir
- Department of de Matemàtiques i Informàtica, University of Barcelona, Spain (P.G., K.L.)
| | - Zahra Raisi-Estabragh
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom (Z.R.-E., S.E.P.)
| | - Steffen E Petersen
- William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University of London, United Kingdom (A.S., A.M.L., Z.R.-E., S.E.P.)
- Barts Heart Centre, St Bartholomew's Hospital, Barts Health NHS Trust, London, United Kingdom (Z.R.-E., S.E.P.)
- Health Data Research UK, London (S.E.P.)
- Alan Turing Institute, London, United Kingdom (S.E.P.)
| |
Collapse
|
6
|
Wang S, Abdelaty AMSEK, Parke K, Arnold JR, McCann GP, Tyukin IY. MyI-Net: Fully Automatic Detection and Quantification of Myocardial Infarction from Cardiovascular MRI Images. ENTROPY (BASEL, SWITZERLAND) 2023; 25:431. [PMID: 36981320 PMCID: PMC10048138 DOI: 10.3390/e25030431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Revised: 02/17/2023] [Accepted: 02/22/2023] [Indexed: 06/18/2023]
Abstract
Myocardial infarction (MI) occurs when an artery supplying blood to the heart is abruptly occluded. The "gold standard" method for imaging MI is cardiovascular magnetic resonance imaging (MRI) with intravenously administered gadolinium-based contrast (with damaged areas apparent as late gadolinium enhancement [LGE]). However, no "gold standard" fully automated method for the quantification of MI exists. In this work, we propose an end-to-end fully automatic system (MyI-Net) for the detection and quantification of MI in MRI images. It has the potential to reduce uncertainty due to technical variability across labs and the inherent problems of data and labels. Our system consists of four processing stages designed to maintain the flow of information across scales. First, features from raw MRI images are generated using feature extractors built on ResNet and MoblieNet architectures. This is followed by atrous spatial pyramid pooling (ASPP) to produce spatial information at different scales to preserve more image context. High-level features from ASPP and initial low-level features are concatenated at the third stage and then passed to the fourth stage where spatial information is recovered via up-sampling to produce final image segmentation output into: (i) background, (ii) heart muscle, (iii) blood and (iv) LGE areas. Our experiments show that the model named MI-ResNet50-AC provides the best global accuracy (97.38%), mean accuracy (86.01%), weighted intersection over union (IoU) of 96.47%, and bfscore of 64.46% for the global segmentation. However, in detecting only LGE tissue, a smaller model, MI-ResNet18-AC, exhibited higher accuracy (74.41%) than MI-ResNet50-AC (64.29%). New models were compared with state-of-the-art models and manual quantification. Our models demonstrated favorable performance in global segmentation and LGE detection relative to the state-of-the-art, including a four-fold better performance in matching LGE pixels to contours produced by clinicians.
Collapse
Affiliation(s)
- Shuihua Wang
- Department of Cardiovascular Sciences, University of LeicesterGlenfield Hospital, Leicester LE3 9QP, UK
- The NIHR Leicester Biomedical Research Centre, Glenfield Hospital, Leicester LE3 9QP, UK
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
| | - Ahmed M. S. E. K. Abdelaty
- Department of Cardiovascular Sciences, University of LeicesterGlenfield Hospital, Leicester LE3 9QP, UK
- The NIHR Leicester Biomedical Research Centre, Glenfield Hospital, Leicester LE3 9QP, UK
| | - Kelly Parke
- Department of Cardiovascular Sciences, University of LeicesterGlenfield Hospital, Leicester LE3 9QP, UK
- The NIHR Leicester Biomedical Research Centre, Glenfield Hospital, Leicester LE3 9QP, UK
| | - Jayanth Ranjit Arnold
- Department of Cardiovascular Sciences, University of LeicesterGlenfield Hospital, Leicester LE3 9QP, UK
- The NIHR Leicester Biomedical Research Centre, Glenfield Hospital, Leicester LE3 9QP, UK
| | - Gerry P. McCann
- Department of Cardiovascular Sciences, University of LeicesterGlenfield Hospital, Leicester LE3 9QP, UK
- The NIHR Leicester Biomedical Research Centre, Glenfield Hospital, Leicester LE3 9QP, UK
| | - Ivan Y. Tyukin
- Department of Mathematics, King’s College London, London WC2R 2LS, UK
- Department of Geoscience and Petroleum, Norwegian University of Science and Technology, 7491 Trondheim, Norway
- Department of Automation and Control Processes, Saint-Petersburg State Electrotechnical University, 197022 Saint-Petersburg, Russia
- Laboratory of Advanced Methods for High-Dimensional Data Analysis, Lobachevsky University, 603105 Nizhni Novgorod, Russia
| |
Collapse
|
7
|
Bao H, Zhu Y, Li Q. Hybrid-scale contextual fusion network for medical image segmentation. Comput Biol Med 2023; 152:106439. [PMID: 36566623 DOI: 10.1016/j.compbiomed.2022.106439] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 11/24/2022] [Accepted: 12/15/2022] [Indexed: 12/24/2022]
Abstract
Medical image segmentation result is an essential reference for disease diagnosis. Recently, with the development and application of convolutional neural networks, medical image processing has significantly developed. However, most existing automatic segmentation tasks are still challenging due to various positions, sizes, and shapes, resulting in poor segmentation performance. In addition, most of the current methods use the encoder-decoder architecture for feature extraction, focusing on the acquisition of semantic information but ignoring the specific target and global context information. In this work, we propose a hybrid-scale contextual fusion network to capture the richer spatial and semantic information. First, a hybrid-scale embedding layer (HEL) is employed before the transformer. By mixing each embedding with multiple patches, the object information of different scales can be captured availably. Further, we present a standard transformer to model long-range dependencies in the first two skip connections. Meanwhile, the pooling transformer (PTrans) is employed to handle long input sequences in the following two skip connections. By leveraging the global average pooling operation and the corresponding transformer block, the spatial structure information of the target will be learned effectively. In the last, dual-branch channel attention module (DCA) is proposed to focus on crucial channel features and conduct multi-level features fusion simultaneously. By utilizing the fusion scheme, richer context and fine-grained features are captured and encoded efficiently. Extensive experiments on three public datasets demonstrate that the proposed method outperforms state-of-the-art methods.
Collapse
Affiliation(s)
- Hua Bao
- The Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education, Hefei 230601, China; The School of Artificial Intelligence, Anhui University, Hefei 230601, China.
| | - Yuqing Zhu
- The Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education, Hefei 230601, China; The School of Electrical Engineering and Automation, Anhui University, Hefei 230601, China
| | - Qing Li
- The Key Laboratory of Intelligent Computing and Signal Processing Ministry of Education, Hefei 230601, China; The School of Electrical Engineering and Automation, Anhui University, Hefei 230601, China
| |
Collapse
|
8
|
Multiresolution Mutual Assistance Network for Cardiac Magnetic Resonance Images Segmentation. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:5311825. [PMID: 36353681 PMCID: PMC9640236 DOI: 10.1155/2022/5311825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Accepted: 10/21/2022] [Indexed: 01/24/2023]
Abstract
The automatic segmentation of cardiac magnetic resonance (MR) images is the basis for the diagnosis of cardiac-related diseases. However, the segmentation of cardiac MR images is a challenging task due to the inhomogeneity of MR images intensity distribution and the unclear boundaries between adjacent tissues. In this paper, we propose a novel multiresolution mutual assistance network (MMA-Net) for cardiac MR images segmentation. It is mainly composed of multibranch input module, multiresolution mutual assistance module, and multilabel deep supervision. First, the multibranch input module helps the network to extract local and global features more pertinently. Then, the multiresolution mutual assistance module implements multiresolution feature interaction and progressively improves semantic features to more completely express the information of the tissue. Finally, the multilabel deep supervision is proposed to generate the final segmentation map. We compare with state-of-the-art medical image segmentation methods on the medical image computing and computer-assisted intervention (MICCAI) automated cardiac diagnosis challenge datasets and the MICCAI atrial segmentation challenge datasets. The mean dice scores of our method in the left atrium, right ventricle, myocardium, and left ventricle are 0.919, 0.920, 0.881, and 0.960, respectively. The analysis of evaluation indicators and segmentation results shows that our method achieves the best performance in cardiac magnetic resonance images segmentation.
Collapse
|
9
|
Chen Z, Wang Z, Zhao M, Zhao Q, Liang X, Li J, Song X. A new classification network for diagnosing Alzheimer's disease in class-imbalance MRI datasets. Front Neurosci 2022; 16:807085. [PMID: 36090283 PMCID: PMC9453266 DOI: 10.3389/fnins.2022.807085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 07/26/2022] [Indexed: 11/13/2022] Open
Abstract
Automatic identification of Alzheimer's Disease (AD) through magnetic resonance imaging (MRI) data can effectively assist to doctors diagnose and treat Alzheimer's. Current methods improve the accuracy of AD recognition, but they are insufficient to address the challenge of small interclass and large intraclass differences. Some studies attempt to embed patch-level structure in neural networks which enhance pathologic details, but the enormous size and time complexity render these methods unfavorable. Furthermore, several self-attention mechanisms fail to provide contextual information to represent discriminative regions, which limits the performance of these classifiers. In addition, the current loss function is adversely affected by outliers of class imbalance and may fall into local optimal values. Therefore, we propose a 3D Residual RepVGG Attention network (ResRepANet) stacked with several lightweight blocks to identify the MRI of brain disease, which can also trade off accuracy and flexibility. Specifically, we propose a Non-local Context Spatial Attention block (NCSA) and embed it in our proposed ResRepANet, which aggregates global contextual information in spatial features to improve semantic relevance in discriminative regions. In addition, in order to reduce the influence of outliers, we propose a Gradient Density Multiple-weighting Mechanism (GDMM) to automatically adjust the weights of each MRI image via a normalizing gradient norm. Experiments are conducted on datasets from the Alzheimer's Disease Neuroimaging Initiative (ADNI) and Australian Imaging, Biomarker and Lifestyle Flagship Study of Aging (AIBL). Experiments on both datasets show that the accuracy, sensitivity, specificity, and Area Under the Curve are consistently better than for state-of-the-art methods.
Collapse
Affiliation(s)
- Ziyang Chen
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Zhuowei Wang
- School of Computers, Guangdong University of Technology, Guangzhou, China
- *Correspondence: Zhuowei Wang
| | - Meng Zhao
- School of Computer Science and Engineering, Tianjin University of Technology, Tianjin, China
| | - Qin Zhao
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Xuehu Liang
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Jiajian Li
- School of Computers, Guangdong University of Technology, Guangzhou, China
| | - Xiaoyu Song
- Department of Electrical and Computer Engineering, Portland State University, Portland, OR, United States
| |
Collapse
|
10
|
Cardiac Disease Classification Using Two-Dimensional Thickness and Few-Shot Learning Based on Magnetic Resonance Imaging Image Segmentation. J Imaging 2022; 8:jimaging8070194. [PMID: 35877637 PMCID: PMC9318676 DOI: 10.3390/jimaging8070194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 07/02/2022] [Accepted: 07/06/2022] [Indexed: 12/10/2022] Open
Abstract
Cardiac cine magnetic resonance imaging (MRI) is a widely used technique for the noninvasive assessment of cardiac functions. Deep neural networks have achieved considerable progress in overcoming various challenges in cine MRI analysis. However, deep learning models cannot be used for classification because limited cine MRI data are available. To overcome this problem, features from cine image settings are derived by handcrafting and addition of other clinical features to the classical machine learning approach for ensuring the model fits the MRI device settings and image parameters required in the analysis. In this study, a novel method was proposed for classifying heart disease (cardiomyopathy patient groups) using only segmented output maps. In the encoder–decoder network, the fully convolutional EfficientNetB5-UNet was modified to perform the semantic segmentation of the MRI image slice. A two-dimensional thickness algorithm was used to combine the segmentation outputs for the 2D representation of images of the end-diastole (ED) and end-systole (ES) cardiac volumes. The thickness images were subsequently used for classification by using a few-shot model with an adaptive subspace classifier. Model performance was verified by applying the model to the 2017 MICCAI Medical Image Computing and Computer-Assisted Intervention dataset. High segmentation performance was achieved as follows: the average Dice coefficients of segmentation were 96.24% (ED) and 89.92% (ES) for the left ventricle (LV); the values for the right ventricle (RV) were 92.90% (ED) and 86.92% (ES). The values for myocardium were 88.90% (ED) and 90.48% (ES). An accuracy score of 92% was achieved in the classification of various cardiomyopathy groups without clinical features. A novel rapid analysis approach was proposed for heart disease diagnosis, especially for cardiomyopathy conditions using cine MRI based on segmented output maps.
Collapse
|
11
|
End-systole and end-diastole detection in short axis cine MRI using a fully convolutional neural network with dilated convolutions. Comput Med Imaging Graph 2022; 99:102085. [DOI: 10.1016/j.compmedimag.2022.102085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 03/17/2022] [Accepted: 05/30/2022] [Indexed: 11/19/2022]
|
12
|
Effect of Different Nursing Interventions on Discharged Patients with Cardiac Valve Replacement Evaluated by Deep Learning Algorithm-Based MRI Information. CONTRAST MEDIA & MOLECULAR IMAGING 2022; 2022:6331206. [PMID: 35360270 PMCID: PMC8960021 DOI: 10.1155/2022/6331206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Revised: 02/19/2022] [Accepted: 02/21/2022] [Indexed: 11/24/2022]
Abstract
This study was aimed to explore the application of cardiac magnetic resonance imaging (MRI) image segmentation model based on U-Net in the diagnosis of a valvular heart disease. The effect of continuous nursing on the survival of discharged patients with cardiac valve replacement was analyzed in this study. In this study, the filling completion operation, cross entropy loss function, and guidance unit were introduced and optimized based on the U-Net network. The heart MRI image segmentation model ML-Net was established. We compared the Dice, Hausdorff distance (HD), and percentage of area difference (PAD) values between ML-Net and other algorithms. The MRI image features of 82 patients with valvular heart disease who underwent cardiac valve replacement were analyzed. According to different nursing methods, they were randomly divided into the control group (routine nursing) and the intervention group (continuous nursing), with 41 cases in each group. The Glasgow Outcome Scale (GOS) score and the Self-rating Anxiety Scale (SAS) were compared between the two groups to assess the degree of anxiety of patients and the survival status at 6 months, 1 year, 2 years, and 3 years after discharge. The results showed that the Dice coefficient, HD, and PAD of the ML-Net algorithm were (0.896 ± 0.071), (5.66 ± 0.45) mm, and (15.34 ± 1.22) %, respectively. The Dice, HD, and PAD values of the ML-Net algorithm were all statistically different from those of the convolutional neural networks (CNN), fully convolutional networks (FCN), SegNet, and U-Net algorithms (P < 0.05). Atrial, ventricular, and aortic abnormalities can be seen in MRI images of patients with valvular heart disease. The cardiac blood flow signal will also be abnormal. The GOS score of the intervention group was significantly higher than that of the control group (P < 0.01). The SAS score was lower than that of the control group (P < 0.05). The survival rates of patients with valvular heart disease at 6 months, 1 year, 2 years, and 3 years after discharge were significantly higher than those in the control group (P < 0.05). The abovementioned results showed that an effective segmentation model for cardiac MRI images was established in this study. Continuous nursing played an important role in the postoperative recovery of discharged patients after cardiac valve replacement. This study provided a reference value for the diagnosis and prognosis of valvular heart disease.
Collapse
|
13
|
Performance of artificial intelligence for biventricular cardiovascular magnetic resonance volumetric analysis in the clinical setting. Int J Cardiovasc Imaging 2022; 38:2413-2424. [PMID: 36434343 PMCID: PMC9700578 DOI: 10.1007/s10554-022-02649-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/20/2022] [Accepted: 05/09/2022] [Indexed: 12/14/2022]
Abstract
Cardiovascular magnetic resonance (CMR) derived ventricular volumes and function guide clinical decision-making for various cardiac pathologies. We aimed to evaluate the efficiency and clinical applicability of a commercially available artificial intelligence (AI) method for performing biventricular volumetric analysis. Three-hundred CMR studies (100 with normal CMR findings, 50 dilated cardiomyopathy, 50 hypertrophic cardiomyopathy, 50 ischaemic heart disease and 50 congenital or valvular heart disease) were randomly selected from database. Manual biventricular volumetric analysis (CMRtools) results were derived from clinical reports and automated volumetric analyses were performed using short axis volumetry AI function of CircleCVI42 v5.12 software. For 20 studies, a combined method of manually adjusted AI contours was tested and all three methods were timed. Clinicians` confidence in AI method was assessed using an online survey. Although agreement was better for left ventricle than right ventricle, AI analysis results were comparable to manual method. Manual adjustment of AI contours further improved agreement: within subject coefficient of variation decreased from 5.0% to 4.5% for left ventricular ejection fraction (EF) and from 9.9% to 7.1% for right ventricular EF. Twenty manual analyses were performed in 250 min 12 s whereas same task took 5 min 48 s using AI method. Clinicians were open to adopt AI but concerns about accuracy and validity were raised. The AI method provides clinically valid outcomes and saves significant time. To address concerns raised by survey participants and overcome shortcomings of the automated myocardial segmentation, visual assessment of contours and performing manual corrections where necessary appears to be a practical approach.
Collapse
|
14
|
Non-contrast Cine Cardiac Magnetic Resonance image radiomics features and machine learning algorithms for myocardial infarction detection. Comput Biol Med 2021; 141:105145. [PMID: 34929466 DOI: 10.1016/j.compbiomed.2021.105145] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 12/13/2021] [Indexed: 12/22/2022]
Abstract
OBJECTIVE Robust differentiation between infarcted and normal tissue is important for clinical diagnosis and precision medicine. The aim of this work is to investigate the radiomic features and to develop a machine learning algorithm for the differentiation of myocardial infarction (MI) and viable tissues/normal cases in the left ventricular myocardium on non-contrast Cine Cardiac Magnetic Resonance (Cine-CMR) images. METHODS Seventy-two patients (52 with MI and 20 healthy control patients) were enrolled in this study. MR imaging was performed on a 1.5 T MRI using the following parameters: TR = 43.35 ms, TE = 1.22 ms, flip angle = 65°, temporal resolution of 30-40 ms. N4 bias field correction algorithm was applied to correct the inhomogeneity of images. All images were segmented and verified simultaneously by two cardiac imaging experts in consensus. Subsequently, features extraction was performed within the whole left ventricular myocardium (3D volume) in end-diastolic volume phase. Re-sampling to 1 × 1 × 1 mm3 voxels was performed for MR images. All intensities within the VOI of MR images were discretized to 64 bins. Radiomic features were normalized to obtain Z-scores, followed by Student's t-test statistical analysis for comparison. A p-value < 0.05 was used as a threshold for statistically significant differences and false discovery rate (FDR) correction performed to report q-value (FDR adjusted p-value). The extracted features were ranked using the MSVM-RFE algorithm, then Spearman correlation between features was performed to eliminate highly correlated features (R2 > 0.80). Ten different machine learning algorithms were used for classification and different metrics used for evaluation and various parameters used for models' evaluation. RESULTS In univariate analysis, the highest area under the curve (AUC) of receiver operating characteristic (ROC) value was achieved for the Maximum 2D diameter slice (M2DS) shape feature (AUC = 0.88, q-value = 1.02E-7), while the average of univariate AUCs was 0.62 ± 0.08. In multivariate analysis, Logistic Regression (AUC = 0.93 ± 0.03, Accuracy = 0.86 ± 0.05, Recall = 0.87 ± 0.1, Precision = 0.93 ± 0.03 and F1 Score = 0.90 ± 0.04) and SVM (AUC = 0.92 ± 0.05, Accuracy = 0.85 ± 0.04, Recall = 0.92 ± 0.01, Precision = 0.88 ± 0.04 and F1 Score = 0.90 ± 0.02) yielded optimal performance as the best machine learning algorithm for this radiomics analysis. CONCLUSION This study demonstrated that using radiomics analysis on non-contrast Cine-CMR images enables to accurately detect MI, which could potentially be used as an alternative diagnostic method for Late Gadolinium Enhancement Cardiac Magnetic Resonance (LGE-CMR).
Collapse
|
15
|
Pérez-Pelegrí M, Monmeneu JV, López-Lereu MP, Pérez-Pelegrí L, Maceira AM, Bodí V, Moratal D. Automatic left ventricle volume calculation with explainability through a deep learning weak-supervision methodology. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 208:106275. [PMID: 34274609 DOI: 10.1016/j.cmpb.2021.106275] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 07/02/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVE Magnetic resonance imaging is the most reliable imaging technique to assess the heart. More specifically there is great importance in the analysis of the left ventricle, as the main pathologies directly affect this region. In order to characterize the left ventricle, it is necessary to extract its volume. In this work we present a neural network architecture that is capable of directly estimating the left ventricle volume in short axis cine Magnetic Resonance Imaging in the end-diastolic frame and provide a segmentation of the region which is the basis of the volume calculation, thus offering explainability to the estimated value. METHODS The network was designed to directly target the volumes to estimate, not requiring any labeled segmentation on the images. The network was based on a 3D U-net with extra layers defined in a scanning module that learned features like the circularity of the objects and the volumes to estimate in a weakly-supervised manner. The only targets defined were the left ventricle volumes and the circularity of the object detected through the estimation of the π value derived from its shape. We had access to 397 cases corresponding to 397 different subjects. We randomly selected 98 cases to use as test set. RESULTS The results show a good match between the real and estimated volumes in the test set, with a mean relative error of 8% and a mean absolute error of 9.12 ml with a Pearson correlation coefficient of 0.95. The derived segmentations obtained by the network achieved Dice coefficients with a mean value of 0.79. CONCLUSIONS The proposed method is capable of obtaining the left ventricle volume biomarker in the end-diastole and offer an explanation of how it obtains the result in the form of a segmentation mask without the need of segmentation labels to train the algorithm, making it a potentially more trustworthy method for clinicians and a way to train neural networks more easily when segmentation labels are not readily available.
Collapse
Affiliation(s)
- Manuel Pérez-Pelegrí
- Center for Biomaterials and Tissue Engineering, Universitat Politècnica de València, Camí de Vera, s/n, 46022 Valencia, Spain
| | - José V Monmeneu
- Unidad de Imagen Cardíaca, ERESA-ASCIRES Grupo Biomédico, Valencia, Spain
| | | | - Lucía Pérez-Pelegrí
- Facultad de Enfermería, Universidad Católica de Valencia San Vicente Mártir, Valencia, Spain
| | - Alicia M Maceira
- Unidad de Imagen Cardíaca, ERESA-ASCIRES Grupo Biomédico, Valencia, Spain
| | - Vicente Bodí
- Departamento de Medicina, Universitat de València, Estudi General, Valencia, Spain; Servicio de Cardiología, Hospital Clínico Universitario de Valencia, INCLIVA, CIBERCV, Valencia, Spain
| | - David Moratal
- Center for Biomaterials and Tissue Engineering, Universitat Politècnica de València, Camí de Vera, s/n, 46022 Valencia, Spain.
| |
Collapse
|
16
|
Automatic cardiac cine MRI segmentation and heart disease classification. Comput Med Imaging Graph 2021; 88:101864. [PMID: 33485057 DOI: 10.1016/j.compmedimag.2021.101864] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 12/19/2020] [Accepted: 12/28/2020] [Indexed: 11/23/2022]
Abstract
Cardiac cine magnetic resonance imaging (MRI) continues to be recognized as an established modality for non-invasive assessment of the function and structure of the cardiovascular system. Making full use of fully convolutional neural networks CNNs ability to operate pixel-wise classification, cine MRI sequences can be segmented and volumetric features of three key heart structures are computed for disease prediction. The three key heart structures are the left ventricle cavity, right ventricle cavity and the left ventricle myocardium. In this paper, we suggest an automated pipeline for both cardiac segmentation and diagnosis. The study was conducted on a dataset of 150 patients from Dijon Hospital in the context of the post-2017 Medical Image Computing and Computer Assisted Intervention MICCAI, Automated Cardiac Diagnosis Challenge (ACDC). The challenge consists in two phases: (i) a segmentation contest, where performance is evaluated on dice overlap coefficient and Hausdorff distance metrics, and a (ii) diagnosis contest for heart disease classification. For this aim, we propose the use of a deep learning based network for segmentation of the three key cardiac structures within short-axis cine MRI sequences and a classifier ensemble for heart disease classification. The deep learning segmentation network is a UNet fully convolutional neural network variant with fewer trainable parameters. The classifier ensemble consists in combining three classifiers, namely a multilayer perceptron, a random forest and a support vector machine. Before feeding the segmentation network, a preliminary step consists in localizing heart region and cropping input images to a restricted region of interest (ROI). This is achieved by a signal processing based approach and aims at reducing multi-class imbalance and computational load. We achieved nearly state of the art accuracy performances for both the segmentation and disease classification challenges. Reporting a mean dice overlap coefficient of 0.92 for the three cardiac structures segmentation, along with good limits of agreement for the various derived clinical indices, leading to an accuracy of 0.92 for the disease classification on unseen data.
Collapse
|
17
|
Zhang Z, Gao S, Huang Z. An Automatic Glioma Segmentation System Using a Multilevel Attention Pyramid Scene Parsing Network. Curr Med Imaging 2020; 17:751-761. [PMID: 33390119 DOI: 10.2174/1573405616666201231100623] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Revised: 09/15/2020] [Accepted: 10/15/2020] [Indexed: 11/22/2022]
Abstract
BACKGROUND Due to the significant variances in their shape and size, it is a challenging task to automatically segment gliomas. To improve the performance of glioma segmentation tasks, this paper proposed a multilevel attention pyramid scene parsing network (MLAPSPNet) that aggregates the multiscale context and multilevel features. METHODS First, T1 pre-contrast, T2-weighted fluid-attenuated inversion recovery (FLAIR) and T1 post-contrast sequences of each slice are combined to form the input. Afterwards, image normalization and augmentation techniques are applied to accelerate the training process and avoid overfitting, respectively. Furthermore, the proposed MLAPSPNet that introduces multilevel pyramid pooling modules (PPMs) and attention gates is constructed. Eventually, the proposed network is compared with some existing networks. RESULTS The dice similarity coefficient (DSC), sensitivity and Jaccard score of the proposed system can reach 0.885, 0.933 and 0.8, respectively. The introduction of multilevel pyramid pooling modules and attention gates can improve the DSC by 0.029 and 0.022, respectively. Moreover, compared with Res-UNet, Dense-UNet, residual channel attention UNet (RCA-UNet), DeepLab V3+ and UNet++, the DSC is improved by 0.032, 0.026, 0.014, 0.041 and 0.011, respectively. CONCLUSION The proposed multilevel attention pyramid scene parsing network can achieve stateof- the-art performance, and the introduction of multilevel pyramid pooling modules and attention gates can improve the performance of glioma segmentation tasks.
Collapse
Affiliation(s)
- Zhenyu Zhang
- School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, China
| | - Shouwei Gao
- School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, China
| | - Zheng Huang
- State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang, China
| |
Collapse
|
18
|
Kawel-Boehm N, Hetzel SJ, Ambale-Venkatesh B, Captur G, Francois CJ, Jerosch-Herold M, Salerno M, Teague SD, Valsangiacomo-Buechel E, van der Geest RJ, Bluemke DA. Reference ranges ("normal values") for cardiovascular magnetic resonance (CMR) in adults and children: 2020 update. J Cardiovasc Magn Reson 2020; 22:87. [PMID: 33308262 PMCID: PMC7734766 DOI: 10.1186/s12968-020-00683-3] [Citation(s) in RCA: 347] [Impact Index Per Article: 69.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2020] [Accepted: 10/26/2020] [Indexed: 01/06/2023] Open
Abstract
Cardiovascular magnetic resonance (CMR) enables assessment and quantification of morphological and functional parameters of the heart, including chamber size and function, diameters of the aorta and pulmonary arteries, flow and myocardial relaxation times. Knowledge of reference ranges ("normal values") for quantitative CMR is crucial to interpretation of results and to distinguish normal from disease. Compared to the previous version of this review published in 2015, we present updated and expanded reference values for morphological and functional CMR parameters of the cardiovascular system based on the peer-reviewed literature and current CMR techniques. Further, databases and references for deep learning methods are included.
Collapse
Affiliation(s)
- Nadine Kawel-Boehm
- Department of Radiology, Kantonsspital Graubuenden, Loestrasse 170, 7000, Chur, Switzerland
- Institute for Diagnostic, Interventional and Pediatric Radiology (DIPR), Bern University Hospital, University of Bern, Freiburgstrasse 10, 3010, InselspitalBern, Switzerland
| | - Scott J Hetzel
- Department of Biostatistics and Medical Informatics, University of Wisconsin, 610 Walnut St, Madison, WI, 53726, USA
| | - Bharath Ambale-Venkatesh
- Department of Radiology, Johns Hopkins University, 600 N Wolfe Street, Baltimore, MD, 21287, USA
| | - Gabriella Captur
- MRC Unit of Lifelong Health and Ageing At UCL, 5-19 Torrington Place, Fitzrovia, London, WC1E 7HB, UK
- Inherited Heart Muscle Conditions Clinic, Royal Free Hospital NHS Foundation Trust, Hampstead, London, NW3 2QG, UK
| | - Christopher J Francois
- Department of Radiology, University of Wisconsin School of Medicine and Public Health, 600 Highland Avenue, Madison, WI, 53792, USA
| | - Michael Jerosch-Herold
- Department of Radiology, Brigham and Women's Hospital, 75 Francis Street, Boston, MA, 02115, USA
| | - Michael Salerno
- Cardiovascular Division, University of Virginia Health System, 1215 Lee Street, Charlottesville, VA, 22908, USA
| | - Shawn D Teague
- Department of Radiology, National Jewish Health, 1400 Jackson St, Denver, CO, 80206, USA
| | - Emanuela Valsangiacomo-Buechel
- Division of Paediatric Cardiology, University Children's Hospital Zurich, Steinwiesstrasse 75, 8032, Zurich, Switzerland
| | - Rob J van der Geest
- Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2333ZA, Leiden, The Netherlands
| | - David A Bluemke
- Department of Radiology, University of Wisconsin School of Medicine and Public Health, 600 Highland Avenue, Madison, WI, 53792, USA.
| |
Collapse
|
19
|
Liao X, Qian Y, Chen Y, Xiong X, Wang Q, Heng PA. MMTLNet: Multi-Modality Transfer Learning Network with adversarial training for 3D whole heart segmentation. Comput Med Imaging Graph 2020; 85:101785. [DOI: 10.1016/j.compmedimag.2020.101785] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2020] [Revised: 07/31/2020] [Accepted: 08/15/2020] [Indexed: 12/23/2022]
|
20
|
Semi-supervised generative adversarial networks for the segmentation of the left ventricle in pediatric MRI. Comput Biol Med 2020; 123:103884. [DOI: 10.1016/j.compbiomed.2020.103884] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Revised: 06/23/2020] [Accepted: 06/25/2020] [Indexed: 02/03/2023]
|