1
|
Zhang H, Meng Z, Ru J, Meng Y, Wang K. Application and prospects of AI-based radiomics in ultrasound diagnosis. Vis Comput Ind Biomed Art 2023; 6:20. [PMID: 37828411 PMCID: PMC10570254 DOI: 10.1186/s42492-023-00147-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 09/20/2023] [Indexed: 10/14/2023] Open
Abstract
Artificial intelligence (AI)-based radiomics has attracted considerable research attention in the field of medical imaging, including ultrasound diagnosis. Ultrasound imaging has unique advantages such as high temporal resolution, low cost, and no radiation exposure. This renders it a preferred imaging modality for several clinical scenarios. This review includes a detailed introduction to imaging modalities, including Brightness-mode ultrasound, color Doppler flow imaging, ultrasound elastography, contrast-enhanced ultrasound, and multi-modal fusion analysis. It provides an overview of the current status and prospects of AI-based radiomics in ultrasound diagnosis, highlighting the application of AI-based radiomics to static ultrasound images, dynamic ultrasound videos, and multi-modal ultrasound fusion analysis.
Collapse
Affiliation(s)
- Haoyan Zhang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Zheling Meng
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Jinyu Ru
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Yaqing Meng
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China
| | - Kun Wang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China.
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100190, China.
| |
Collapse
|
2
|
Ottakath N, Al-Maadeed S, Zughaier SM, Elharrouss O, Mohammed HH, Chowdhury MEH, Bouridane A. Ultrasound-Based Image Analysis for Predicting Carotid Artery Stenosis Risk: A Comprehensive Review of the Problem, Techniques, Datasets, and Future Directions. Diagnostics (Basel) 2023; 13:2614. [PMID: 37568976 PMCID: PMC10417708 DOI: 10.3390/diagnostics13152614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Revised: 07/25/2023] [Accepted: 07/25/2023] [Indexed: 08/13/2023] Open
Abstract
The carotid artery is a major blood vessel that supplies blood to the brain. Plaque buildup in the arteries can lead to cardiovascular diseases such as atherosclerosis, stroke, ruptured arteries, and even death. Both invasive and non-invasive methods are used to detect plaque buildup in the arteries, with ultrasound imaging being the first line of diagnosis. This paper presents a comprehensive review of the existing literature on ultrasound image analysis methods for detecting and characterizing plaque buildup in the carotid artery. The review includes an in-depth analysis of datasets; image segmentation techniques for the carotid artery plaque area, lumen area, and intima-media thickness (IMT); and plaque measurement, characterization, classification, and stenosis grading using deep learning and machine learning. Additionally, the paper provides an overview of the performance of these methods, including challenges in analysis, and future directions for research.
Collapse
Affiliation(s)
- Najmath Ottakath
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar; (S.A.-M.); (O.E.); (H.H.M.)
| | - Somaya Al-Maadeed
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar; (S.A.-M.); (O.E.); (H.H.M.)
| | | | - Omar Elharrouss
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar; (S.A.-M.); (O.E.); (H.H.M.)
| | - Hanadi Hassen Mohammed
- Department of Computer Science and Engineering, Qatar University, Doha 2713, Qatar; (S.A.-M.); (O.E.); (H.H.M.)
| | | | - Ahmed Bouridane
- Centre for Data Analytics and Cybersecurity, University of Sharjah, Sharjah 27272, United Arab Emirates;
| |
Collapse
|
3
|
Zhou S, Sridar P, Kennedy NJ, Quinton A, Ahn E, Nanan R, Kim J. A Deep-Learning Enabled Automatic Fetal Thalamus Diameter Measurement Algorithm. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-5. [PMID: 38083137 DOI: 10.1109/embc40787.2023.10340980] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
The analysis of maternal factors that impact the normal development of the fetal thalamus is an emerging field of research and requires the retrospective measurement of fetal thalamus diameter (FTD). Unfortunately, FTD is not measured in routine 2D ultrasound (2D-US) screenings of fetuses. Manual measurement of FTD is a laborious, difficult, and error-prone process because the thalamus lacks well-defined boundaries in 2D-US images of the fetal brain as it has a similar echogenicity to the surrounding brain tissue. Traditional methods based on statistical shape models (SSMs) perform poorly in measuring FTD due to the noisy textures and fuzzy edges of the fetal thalamus in 2D-US images of the fetal brain. To overcome these difficulties, we propose a deep learning-based automatic FTD measurement algorithm, FTDNet. FTDNet measures FTD by learning to directly detect the measurement landmarks through supervised learning. The algorithm first detects the region of the brain that contains the thalamus structure, and then focuses on processing that region for FTD landmark detection. Our FTD dataset, developed through a consensus between two ultrasonographers, contains 1,111 pairs of landmark coordinates for measuring FTD and verified bounding boxes surrounding the fetal thalamus. To assess FTDNet's measurement consistency compared to the ground truth, we used the intraclass correlation coefficient (ICC). FTDNet achieved an ICC score of 0.734, significantly outperforming the prior SSM method and other baseline comparison methods. Our findings are an important step forward in understanding the maternal factors which influence fetal brain development.Clinical relevance- This work proposes an end-to-end thalamus detection and measurement algorithm for measuring fetal thalamus diameter. Our work represents a significant step in the research of how maternal factors can impact fetal thalamus development. The development of an automatic and accurate method for measuring FTD through deep learning has the potential to greatly advance this field of study.
Collapse
|
4
|
Marzola F, Lochner P, Naldi A, Lemor R, Stögbauer J, Meiburger KM. Development of a Deep Learning-Based System for Optic Nerve Characterization in Transorbital Ultrasound Images on a Multicenter Data Set. ULTRASOUND IN MEDICINE & BIOLOGY 2023:S0301-5629(23)00169-2. [PMID: 37357081 DOI: 10.1016/j.ultrasmedbio.2023.05.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 05/16/2023] [Accepted: 05/21/2023] [Indexed: 06/27/2023]
Abstract
OBJECTIVE Characterization of the optic nerve through measurement of optic nerve diameter (OND) and optic nerve sheath diameter (ONSD) using transorbital sonography (TOS) has proven to be a useful tool for the evaluation of intracranial pressure (ICP) and multiple neurological conditions. We describe a deep learning-based system for automatic characterization of the optic nerve from B-mode TOS images by automatic measurement of the OND and ONSD. In addition, we determine how the signal-to-noise ratio in two different areas of the image influences system performance. METHODS A UNet was trained as the segmentation model. The training was performed on a multidevice, multicenter data set of 464 TOS images from 110 subjects. Fivefold cross-validation was performed, and the training process was repeated eight times. The final prediction was made as an ensemble of the predictions of the eight single models. Automatic OND and ONSD measurements were compared with the manual measurements taken by an expert with a graphical user interface that mimics a clinical setting. RESULTS A Dice score of 0.719 ± 0.139 was obtained on the whole data set merging the test folds. Pearson's correlation was 0.69 for both OND and ONSD parameters. The signal-to-noise ratio was found to influence segmentation performance, but no clear correlation with diameter measurement performance was determined. CONCLUSION The developed system has a good correlation with manual measurements, proving that it is feasible to create a model capable of automatically analyzing TOS images from multiple devices. The promising results encourage further definition of a standard protocol for the automatization of the OND and ONSD measurement process using deep learning-based methods. The image data and the manual measurements used in this work will be available at 10.17632/kw8gvp8m8x.1.
Collapse
Affiliation(s)
- Francesco Marzola
- Biolab, Department of Electronics and Communications, Politecnico di Torino, Torino, Italy.
| | | | - Andrea Naldi
- Neurology Unit, San Giovanni Bosco Hospital, Turin, Italy
| | - Robert Lemor
- Department of Biomedical Engineering, Saarland University of Applied Sciences, Saarbrücken, Germany
| | | | - Kristen M Meiburger
- Biolab, Department of Electronics and Communications, Politecnico di Torino, Torino, Italy
| |
Collapse
|
5
|
Mori S, Arakawa M, Kanai H. Lateral M-Mode: Ultrasound Visualization of Displacement Along Longitudinal Direction at Intima-Media Complex. ULTRASOUND IN MEDICINE & BIOLOGY 2023; 49:875-888. [PMID: 36623971 DOI: 10.1016/j.ultrasmedbio.2022.11.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 11/09/2022] [Accepted: 11/19/2022] [Indexed: 06/17/2023]
Abstract
Quantification of the dynamics of the carotid artery wall is useful in evaluating arteriosclerosis and atherosclerosis. As the carotid artery wall moves not only in the radial direction but also in the longitudinal direction, longitudinal movement should be considered in the analysis of the dynamic properties of the carotid artery wall. In this study, we propose a "lateral M-mode" method for visualizing the longitudinal movement of the intima-media complex (IMC). For the lateral M-mode, we set the target line in the longitudinal direction along the IMC and visualize the signals on the target line frame-by-frame by correcting the position of the target line along the radial displacement estimated by the phased tracking method. Differentiating the envelope signals between consecutive ultrasound beams was effective in visualizing the lateral movement of the IMC. The precision of the longitudinal displacement of the IMC estimated using the conventional block-matching method was validated by comparing it with the lateral M-mode. Because the conventional M-mode sequence plays an important role in evaluation of the dynamics of various tissues, the proposed "lateral M-mode" contributes to a detailed understanding of vascular dynamics and the development of diagnostic methods for vascular diseases.
Collapse
Affiliation(s)
- Shohei Mori
- Graduate School of Engineering, Tohoku University, Sendai, Japan.
| | - Mototaka Arakawa
- Graduate School of Engineering, Tohoku University, Sendai, Japan; Graduate School of Biomedical Engineering, Tohoku University, Sendai, Japan
| | - Hiroshi Kanai
- Graduate School of Engineering, Tohoku University, Sendai, Japan; Graduate School of Biomedical Engineering, Tohoku University, Sendai, Japan
| |
Collapse
|
6
|
Yuan Y, Li C, Xu L, Zhu S, Hua Y, Zhang J. CSM-Net: Automatic joint segmentation of intima-media complex and lumen in carotid artery ultrasound images. Comput Biol Med 2022; 150:106119. [PMID: 37859275 DOI: 10.1016/j.compbiomed.2022.106119] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 08/25/2022] [Accepted: 09/17/2022] [Indexed: 11/18/2022]
Abstract
The intima-media thickness (IMT) is an effective biomarker for atherosclerosis, which is commonly measured by ultrasound technique. However, the intima-media complex (IMC) segmentation for the IMT is challenging due to confused IMC boundaries and various noises. In this paper, we propose a flexible method CSM-Net for the joint segmentation of IMC and Lumen in carotid ultrasound images. Firstly, the cascaded dilated convolutions combined with the squeeze-excitation module are introduced for exploiting more contextual features on the highest-level layer of the encoder. Furthermore, a triple spatial attention module is utilized for emphasizing serviceable features on each decoder layer. Besides, a multi-scale weighted hybrid loss function is employed to resolve the class-imbalance issues. The experiments are conducted on a private dataset of 100 images for IMC and Lumen segmentation, as well as on two public datasets of 1600 images for IMC segmentation. For the private dataset, our method obtain the IMC Dice, Lumen Dice, Precision, Recall, and F1 score of 0.814 ± 0.061, 0.941 ± 0.024, 0.911 ± 0.044, 0.916 ± 0.039, and 0.913 ± 0.027, respectively. For the public datasets, we obtain the IMC Dice, Precision, Recall, and F1 score of 0.885 ± 0.067, 0.885 ± 0.070, 0.894 ± 0.089, and 0.885 ± 0.067, respectively. The results demonstrate that the proposed method precedes some cutting-edge methods, and the ablation experiments show the validity of each module. The proposed method may be useful for the IMC segmentation of carotid ultrasound images in the clinic. Our code is publicly available at https://github.com/yuanyc798/US-IMC-code.
Collapse
Affiliation(s)
- Yanchao Yuan
- School of Biological Science and Medical Engineering, Beihang University, Beijing, China; Hefei Innovation Research Institute, Beihang University, Hefei, China; Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing, China
| | - Cancheng Li
- School of Biological Science and Medical Engineering, Beihang University, Beijing, China; Hefei Innovation Research Institute, Beihang University, Hefei, China; Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing, China
| | - Lu Xu
- School of Biological Science and Medical Engineering, Beihang University, Beijing, China; Hefei Innovation Research Institute, Beihang University, Hefei, China; Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing, China
| | - Shangming Zhu
- School of Biological Science and Medical Engineering, Beihang University, Beijing, China; Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing, China
| | - Yang Hua
- Department of Vascular Ultrasonography, XuanWu Hospital, Capital Medical University, Beijing, China; Beijing Diagnostic Center of Vascular Ultrasound, Beijing, China; Center of Vascular Ultrasonography, Beijing Institute of Brain Disorders, Collaborative Innovation Center for Brain Disorders, Capital Medical University, Beijing, China.
| | - Jicong Zhang
- School of Biological Science and Medical Engineering, Beihang University, Beijing, China; Hefei Innovation Research Institute, Beihang University, Hefei, China; Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing, China.
| |
Collapse
|
7
|
Jain PK, Dubey A, Saba L, Khanna NN, Laird JR, Nicolaides A, Fouda MM, Suri JS, Sharma N. Attention-Based UNet Deep Learning Model for Plaque Segmentation in Carotid Ultrasound for Stroke Risk Stratification: An Artificial Intelligence Paradigm. J Cardiovasc Dev Dis 2022; 9:326. [PMID: 36286278 PMCID: PMC9604424 DOI: 10.3390/jcdd9100326] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2022] [Revised: 09/06/2022] [Accepted: 09/14/2022] [Indexed: 11/17/2022] Open
Abstract
Stroke and cardiovascular diseases (CVD) significantly affect the world population. The early detection of such events may prevent the burden of death and costly surgery. Conventional methods are neither automated nor clinically accurate. Artificial Intelligence-based methods of automatically detecting and predicting the severity of CVD and stroke in their early stages are of prime importance. This study proposes an attention-channel-based UNet deep learning (DL) model that identifies the carotid plaques in the internal carotid artery (ICA) and common carotid artery (CCA) images. Our experiments consist of 970 ICA images from the UK, 379 CCA images from diabetic Japanese patients, and 300 CCA images from post-menopausal women from Hong Kong. We combined both CCA images to form an integrated database of 679 images. A rotation transformation technique was applied to 679 CCA images, doubling the database for the experiments. The cross-validation K5 (80% training: 20% testing) protocol was applied for accuracy determination. The results of the Attention-UNet model are benchmarked against UNet, UNet++, and UNet3P models. Visual plaque segmentation showed improvement in the Attention-UNet results compared to the other three models. The correlation coefficient (CC) value for Attention-UNet is 0.96, compared to 0.93, 0.96, and 0.92 for UNet, UNet++, and UNet3P models. Similarly, the AUC value for Attention-UNet is 0.97, compared to 0.964, 0.966, and 0.965 for other models. Conclusively, the Attention-UNet model is beneficial in segmenting very bright and fuzzy plaque images that are hard to diagnose using other methods. Further, we present a multi-ethnic, multi-center, racial bias-free study of stroke risk assessment.
Collapse
Affiliation(s)
- Pankaj K. Jain
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India
| | - Abhishek Dubey
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India
- Department of Electronics and Communication, Shree Mata Vaishno Devi University, Jammu 182301, India
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09100 Cagliari, Italy
| | - Narender N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospital, New Delhi 110076, India
| | - John R. Laird
- Heart and Vascular Institute, Adventist Heath St. Helena, St. Helena, CA 94574, USA
| | - Andrew Nicolaides
- Vascular Screening and Diagnostic Centre and University of Nicosia Medical School, Nicosia 2409, Cyprus
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Neeraj Sharma
- Department of Electronics and Communication, Shree Mata Vaishno Devi University, Jammu 182301, India
| |
Collapse
|