1
|
Saeed MU, Bin W, Sheng J, Saleem S. 3D MFA: An automated 3D Multi-Feature Attention based approach for spine segmentation using a multi-stage network pruning. Comput Biol Med 2025; 185:109526. [PMID: 39708496 DOI: 10.1016/j.compbiomed.2024.109526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2024] [Revised: 11/13/2024] [Accepted: 12/03/2024] [Indexed: 12/23/2024]
Abstract
Spine segmentation poses significant challenges due to the complex anatomical structure of the spine and the variability in imaging modalities, which often results in unclear boundaries and overlaps with surrounding tissues. In this research, a novel 3D Multi-Feature Attention (MFA) model is proposed for spine segmentation. The standard MobileNetv3 is modified by adding the RCBAM (Reverse Convolution Block Attention Module) module, and FPP (Feature Pyramid Pooling) for feature enhancement. Each modified MobileNetv3 is trained separately on axial, coronal, and sagittal views of 3D images. The features are concatenated to form a 3D feature map and given to the decoder part for spine segmentation. The results show that the 3D MFA outperforms from state-of-the-art method with DCS (dice coefficient score), and IoU (Intersection over Union) of 96.52%, and 95.84% on VerSe 2020 dataset while 94.64% and 93.69% on VerSe 2019 dataset with less computational cost.
Collapse
Affiliation(s)
- Muhammad Usman Saeed
- School of Computer Science and Engineering, Central South University, Changsha, 410083, Hunan, China
| | - Wang Bin
- School of Computer Science and Engineering, Central South University, Changsha, 410083, Hunan, China.
| | - Jinfang Sheng
- School of Computer Science and Engineering, Central South University, Changsha, 410083, Hunan, China
| | - Salman Saleem
- Department of Mathematics, College of Science, King Khalid University, Abha, 61413, Saudi Arabia; Center for Artificial Intelligence (CAI), King Khalid University, Abha, 61421, Saudi Arabia
| |
Collapse
|
2
|
Saeed MU, Dikaios N, Dastgir A, Ali G, Hamid M, Hajjej F. An Automated Deep Learning Approach for Spine Segmentation and Vertebrae Recognition Using Computed Tomography Images. Diagnostics (Basel) 2023; 13:2658. [PMID: 37627917 PMCID: PMC10453471 DOI: 10.3390/diagnostics13162658] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2023] [Revised: 04/09/2023] [Accepted: 04/20/2023] [Indexed: 08/27/2023] Open
Abstract
Spine image analysis is based on the accurate segmentation and vertebrae recognition of the spine. Several deep learning models have been proposed for spine segmentation and vertebrae recognition, but they are very computationally demanding. In this research, a novel deep learning model is introduced for spine segmentation and vertebrae recognition using CT images. The proposed model works in two steps: (1) A cascaded hierarchical atrous spatial pyramid pooling residual attention U-Net (CHASPPRAU-Net), which is a modified version of U-Net, is used for the segmentation of the spine. Cascaded spatial pyramid pooling layers, along with residual blocks, are used for feature extraction, while the attention module is used for focusing on regions of interest. (2) A 3D mobile residual U-Net (MRU-Net) is used for vertebrae recognition. MobileNetv2 includes residual and attention modules to accurately extract features from the axial, sagittal, and coronal views of 3D spine images. The features from these three views are concatenated to form a 3D feature map. After that, a 3D deep learning model is used for vertebrae recognition. The VerSe 20 and VerSe 19 datasets were used to validate the proposed model. The model achieved more accurate results in spine segmentation and vertebrae recognition than the state-of-the-art methods.
Collapse
Affiliation(s)
- Muhammad Usman Saeed
- Department of Computer Science, University of Okara, Okara 56310, Pakistan; (A.D.); (G.A.)
| | - Nikolaos Dikaios
- Mathematics Research Centre, Academy of Athens, 10679 Athens, Greece
| | - Aqsa Dastgir
- Department of Computer Science, University of Okara, Okara 56310, Pakistan; (A.D.); (G.A.)
| | - Ghulam Ali
- Department of Computer Science, University of Okara, Okara 56310, Pakistan; (A.D.); (G.A.)
| | - Muhammad Hamid
- Department of Computer Science, Government College Women University, Sialkot 51310, Pakistan;
| | - Fahima Hajjej
- Department of Information Systems, College of Computer and Information Science, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia;
| |
Collapse
|
3
|
Automated segmentation of the fractured vertebrae on CT and its applicability in a radiomics model to predict fracture malignancy. Sci Rep 2022; 12:6735. [PMID: 35468985 PMCID: PMC9038736 DOI: 10.1038/s41598-022-10807-7] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Accepted: 04/13/2022] [Indexed: 11/08/2022] Open
Abstract
Although CT radiomics has shown promising results in the evaluation of vertebral fractures, the need for manual segmentation of fractured vertebrae limited the routine clinical implementation of radiomics. Therefore, automated segmentation of fractured vertebrae is needed for successful clinical use of radiomics. In this study, we aimed to develop and validate an automated algorithm for segmentation of fractured vertebral bodies on CT, and to evaluate the applicability of the algorithm in a radiomics prediction model to differentiate benign and malignant fractures. A convolutional neural network was trained to perform automated segmentation of fractured vertebral bodies using 341 vertebrae with benign or malignant fractures from 158 patients, and was validated on independent test sets (internal test, 86 vertebrae [59 patients]; external test, 102 vertebrae [59 patients]). Then, a radiomics model predicting fracture malignancy on CT was constructed, and the prediction performance was compared between automated and human expert segmentations. The algorithm achieved good agreement with human expert segmentation at testing (Dice similarity coefficient, 0.93-0.94; cross-sectional area error, 2.66-2.97%; average surface distance, 0.40-0.54 mm). The radiomics model demonstrated good performance in the training set (AUC, 0.93). In the test sets, automated and human expert segmentations showed comparable prediction performances (AUC, internal test, 0.80 vs 0.87, p = 0.044; external test, 0.83 vs 0.80, p = 0.37). In summary, we developed and validated an automated segmentation algorithm that showed comparable performance to human expert segmentation in a CT radiomics model to predict fracture malignancy, which may enable more practical clinical utilization of radiomics.
Collapse
|
4
|
Zhu G. SIMULATION FOR DAMAGED PARTS RECOGNITION OF SPORTS INJURY BIOLOGICAL IMAGES. REV BRAS MED ESPORTE 2021. [DOI: 10.1590/1517-8692202127032021_0079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
ABSTRACT Introduction To reduce or avoid injuries during high-intensity sports and help treat the injured part, the method of recognizing biological images of the damaged part is a crucial point of current research. Objective To reduce the damage caused by high-intensity sports and improve the efficiency of injury treatment, this article explores the method of identifying damaged parts in biological imaging of high-intensity sports injuries. Methods A method is proposed to recognize damaged parts of biological images of high-intensity sports injuries based on an improved regional growth algorithm. Results A rough segmented image developed in black and white is obtained with the main body as the objective and background. Based on approximate segmentation, the region growth algorithm is used to accurately recognize the damaged region by improving the selection of the hotspots and the growth rules. Conclusion The recognition accuracy is high, and the recognition time is shorter. The algorithm proposed in this work can improve the precision of recognizing the damaged parts of the biological image of the sports injury and shorten the recognition time. It has the feasibility to determine the damaged parts of sports injuries. Level of evidence II; Therapeutic studies: investigation of treatment results.
Collapse
Affiliation(s)
- Guozheng Zhu
- Henan Institute of Science and Technology, China
| |
Collapse
|
5
|
Ying F, Chen S, Pan G, He Z. Artificial Intelligence Pulse Coupled Neural Network Algorithm in the Diagnosis and Treatment of Severe Sepsis Complicated with Acute Kidney Injury under Ultrasound Image. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:6761364. [PMID: 34336164 PMCID: PMC8315850 DOI: 10.1155/2021/6761364] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 06/24/2021] [Accepted: 07/12/2021] [Indexed: 11/17/2022]
Abstract
The objective of this study was to explore the diagnosis of severe sepsis complicated with acute kidney injury (AKI) by ultrasonic image information based on the artificial intelligence pulse coupled neural network (PCNN) algorithm. In this study, an algorithm of ultrasonic image information enhancement based on the artificial intelligence PCNN was constructed and compared with the histogram equalization algorithm and linear transformation algorithm. After that, it was applied to the ultrasonic image diagnosis of 20 cases of severe sepsis combined with AKI in hospital. The condition of each patient was diagnosed by ultrasound image performance, change of renal resistance index (RRI), ultrasound score, and receiver operator characteristic curve (ROC) analysis. It was found that the histogram distribution of this algorithm was relatively uniform, and the information of each gray level was obviously retained and enhanced, which had the best effect in this algorithm; there was a marked individual difference in the values of RRI. Overall, the values of RRI showed a slight upward trend after admission to the intensive care unit (ICU). The RRI was taken as the dependent variable, time as the fixed-effect model, and patients as the random effect; the parameter value of time was between 0.012 and 0.015, p=0.000 < 0.05. Besides, there was no huge difference in the ultrasonic score among different time measurements (t = 1.348 and p=0.128 > 0.05). The area under the ROC curve of the RRI for the diagnosis of AKI at the 2nd day, 4th day, and 6th day was 0.758, 0.841, and 0.856, respectively, which was all greater than 0.5 (p < 0.05). In conclusion, the proposed algorithm in this study could significantly enhance the amount of information in ultrasound images. In addition, the change of RRI values measured by ultrasound images based on the artificial intelligence PCNN was associated with AKI.
Collapse
Affiliation(s)
- Fu Ying
- Department of Emergency Medicine, Changzhou Cancer Hospital, Changzhou 213000, Jiangsu, China
| | - Shuhua Chen
- Department of Intensive Care Unit, Changzhou Cancer Hospital, Changzhou 213000, Jiangsu, China
| | - Guojun Pan
- Department of Intensive Care Unit, Changzhou Cancer Hospital, Changzhou 213000, Jiangsu, China
| | - Zemin He
- Department of Emergency Medicine, Changzhou Cancer Hospital, Changzhou 213000, Jiangsu, China
| |
Collapse
|
6
|
Segmentation and Identification of Vertebrae in CT Scans Using CNN, k-Means Clustering and k-NN. INFORMATICS 2021. [DOI: 10.3390/informatics8020040] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023] Open
Abstract
The accurate segmentation and identification of vertebrae presents the foundations for spine analysis including fractures, malfunctions and other visual insights. The large-scale vertebrae segmentation challenge (VerSe), organized as a competition at the Medical Image Computing and Computer Assisted Intervention (MICCAI), is aimed at vertebrae segmentation and labeling. In this paper, we propose a framework that addresses the tasks of vertebrae segmentation and identification by exploiting both deep learning and classical machine learning methodologies. The proposed solution comprises two phases: a binary fully automated segmentation of the whole spine, which exploits a 3D convolutional neural network, and a semi-automated procedure that allows locating vertebrae centroids using traditional machine learning algorithms. Unlike other approaches, the proposed method comes with the added advantage of no requirement for single vertebrae-level annotations to be trained. A dataset of 214 CT scans has been extracted from VerSe’20 challenge data, for training, validating and testing the proposed approach. In addition, to evaluate the robustness of the segmentation and labeling algorithms, 12 CT scans from subjects affected by severe, moderate and mild scoliosis have been collected from a local medical clinic. On the designated test set from Verse’20 data, the binary spine segmentation stage allowed to obtain a binary Dice coefficient of 89.17%, whilst the vertebrae identification one reached an average multi-class Dice coefficient of 90.09%. In order to ensure the reproducibility of the algorithms hereby developed, the code has been made publicly available.
Collapse
|
7
|
Chen K, Zhai X, Sun K, Wang H, Yang C, Li M. A narrative review of machine learning as promising revolution in clinical practice of scoliosis. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:67. [PMID: 33553360 PMCID: PMC7859734 DOI: 10.21037/atm-20-5495] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Accepted: 11/27/2020] [Indexed: 11/06/2022]
Abstract
Machine learning (ML), as an advanced domain of artificial intelligence (AI), is progressively changing our view of the world. By implementing its algorithms, our ability to detect previously undiscoverable patterns in data has the potential to revolutionize predictive analytics. Scoliosis, as a relatively specialized branch in the spine field, mainly covers the pediatric, adult and the elderly populations, and its diagnosis and treatment remain difficult. With recent efforts and interdisciplinary cooperation, ML has been widely applied to investigate issues related to scoliosis, and surprisingly augment a surgeon's ability in clinical practice related to scoliosis. Meanwhile, ML models penetrate in every stage of the clinical practice procedure of scoliosis. In this review, we first present a brief description of the application of ML in the clinical practice procedures regarding scoliosis, including screening, diagnosis and classification, surgical decision making, intraoperative manipulation, complication prediction, prognosis prediction and rehabilitation. Meanwhile, the ML models and specific applications adopted are presented. Additionally, current limitations and future directions are briefly discussed regarding its use in the field of scoliosis. We believe that the implementation of ML is a promising revolution to assist surgeons in all aspects of clinical practice related to scoliosis in the near future.
Collapse
Affiliation(s)
- Kai Chen
- Department of Orthopedics, Shanghai Changhai Hospital, Shanghai, China
| | - Xiao Zhai
- Department of Orthopedics, Shanghai Changhai Hospital, Shanghai, China
| | - Kaiqiang Sun
- Department of Orthopedics, Shanghai Changzheng Hospital, Shanghai, China
| | - Haojue Wang
- Basic medicine college, Navy Medical University, Shanghai, China
| | - Changwei Yang
- Department of Orthopedics, Shanghai Changhai Hospital, Shanghai, China
| | - Ming Li
- Department of Orthopedics, Shanghai Changhai Hospital, Shanghai, China
| |
Collapse
|
8
|
Amirmoezzi Y, Salehi S, Parsaei H, Kazemi K, Torabi Jahromi A. A knowledge-based system for brain tumor segmentation using only 3D FLAIR images. AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE 2019; 42:529-540. [DOI: 10.1007/s13246-019-00754-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2018] [Accepted: 03/30/2019] [Indexed: 10/27/2022]
|