1
|
Shen X, Wu X, Liu R, Li H, Yin J, Wang L, Ma H. Accurate segmentation of breast tumor in ultrasound images through joint training and refined segmentation. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac8964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2021] [Accepted: 08/12/2022] [Indexed: 11/11/2022]
Abstract
Abstract
Objective. This paper proposes an automatic breast tumor segmentation method for two-dimensional (2D) ultrasound images, which is significantly more accurate, robust, and adaptable than common deep learning models on small datasets. Approach. A generalized joint training and refined segmentation framework (JR) was established, involving a joint training module (J
module
) and a refined segmentation module (R
module
). In J
module
, two segmentation networks are trained simultaneously, under the guidance of the proposed Jocor for Segmentation (JFS) algorithm. In R
module
, the output of J
module
is refined by the proposed area first (AF) algorithm, and marked watershed (MW) algorithm. The AF mainly reduces false positives, which arise easily from the inherent features of breast ultrasound images, in the light of the area, distance, average radical derivative (ARD) and radical gradient index (RGI) of candidate contours. Meanwhile, the MW avoids over-segmentation, and refines segmentation results. To verify its performance, the JR framework was evaluated on three breast ultrasound image datasets. Image dataset A contains 1036 images from local hospitals. Image datasets B and C are two public datasets, containing 562 images and 163 images, respectively. The evaluation was followed by related ablation experiments. Main results. The JR outperformed the other state-of-the-art (SOTA) methods on the three image datasets, especially on image dataset B. Compared with the SOTA methods, the JR improved true positive ratio (TPR) and Jaccard index (JI) by 1.5% and 3.2%, respectively, and reduces (false positive ratio) FPR by 3.7% on image dataset B. The results of the ablation experiments show that each component of the JR matters, and contributes to the segmentation accuracy, particularly in the reduction of false positives. Significance. This study successfully combines traditional segmentation methods with deep learning models. The proposed method can segment small-scale breast ultrasound image datasets efficiently and effectively, with excellent generalization performance.
Collapse
|
2
|
Al Noumah W, Jafar A, Al Joumaa K. Using parallel pre-trained types of DCNN model to predict breast cancer with color normalization. BMC Res Notes 2022; 15:14. [PMID: 35012681 PMCID: PMC8751220 DOI: 10.1186/s13104-021-05902-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 12/23/2021] [Indexed: 11/23/2022] Open
Abstract
Objective Breast cancer is the most common among women, and it causes many deaths every year. Early diagnosis increases the chance of cure through treatment. The traditional manual diagnosis requires effort and time from pathological experts, as it needs a joint experience of a number of pathologists. Diagnostic mistakes can lead to catastrophic results and endanger the lives of patients. The presence of an expert system that is able to specify whether the examined tissue is healthy or not, thus improves the quality of diagnosis and saves the time of experts. In this paper, a model capable of classifying breast cancer anatomy by making use of a pre-trained DCNN has been proposed. To build this model, first of all the image should be color stained by using Vahadane algorithm, then the model which combines three pre-trained DCNN (Xception, NASNet and Inceptoin_Resnet_V2) should be built in parallel, then the three branches should be aggregated to take advantage of each other. The suggested model was tested under different values of threshold ratios and also compared with other models. Results The proposed model on the BreaKHis dataset achieved 98% accuracy, which is better than the accuracy of other models used in this field. Supplementary Information The online version contains supplementary material available at 10.1186/s13104-021-05902-3.
Collapse
Affiliation(s)
- William Al Noumah
- Department of Informatics, Higher Institute for Applied Sciences and Technology, Damascus, Syria.
| | - Assef Jafar
- Department of Informatics, Higher Institute for Applied Sciences and Technology, Damascus, Syria
| | - Kadan Al Joumaa
- Department of Informatics, Higher Institute for Applied Sciences and Technology, Damascus, Syria
| |
Collapse
|
3
|
Mirniaharikandehei S, Heidari M, Danala G, Lakshmivarahan S, Zheng B. Applying a random projection algorithm to optimize machine learning model for predicting peritoneal metastasis in gastric cancer patients using CT images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 200:105937. [PMID: 33486339 PMCID: PMC7920928 DOI: 10.1016/j.cmpb.2021.105937] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Accepted: 01/06/2021] [Indexed: 05/14/2023]
Abstract
BACKGROUND AND OBJECTIVE Non-invasively predicting the risk of cancer metastasis before surgery can play an essential role in determining which patients can benefit from neoadjuvant chemotherapy. This study aims to investigate and test the advantages of applying a random projection algorithm to develop and optimize a radiomics-based machine learning model to predict peritoneal metastasis in gastric cancer patients using a small and imbalanced computed tomography (CT) image dataset. METHODS A retrospective dataset involving CT images acquired from 159 patients is assembled, including 121 and 38 cases with and without peritoneal metastasis, respectively. A computer-aided detection scheme is first applied to segment primary gastric tumor volumes and initially compute 315 image features. Then, five gradients boosting machine (GBM) models embedded with five feature selection methods (including random projection algorithm, principal component analysis, least absolute shrinkage, and selection operator, maximum relevance and minimum redundancy, and recursive feature elimination) along with a synthetic minority oversampling technique, are built to predict the risk of peritoneal metastasis. All GBM models are trained and tested using a leave-one-case-out cross-validation method. RESULTS Results show that the GBM model embedded with a random projection algorithm yields a significantly higher prediction accuracy (71.2%) than the other four GBM models (p<0.05). The precision, sensitivity, and specificity of this optimal GBM model are 65.78%, 43.10%, and 87.12%, respectively. CONCLUSIONS This study demonstrates that CT images of the primary gastric tumors contain discriminatory information to predict the risk of peritoneal metastasis, and a random projection algorithm is a promising method to generate optimal feature vector, improving the performance of machine learning based prediction models.
Collapse
Affiliation(s)
| | - Morteza Heidari
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK 73019, USA
| | - Gopichandh Danala
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK 73019, USA
| | | | - Bin Zheng
- School of Electrical and Computer Engineering, University of Oklahoma, Norman, OK 73019, USA
| |
Collapse
|
4
|
Rajasree R, Columbus CC, Shilaja C. Multiscale-based multimodal image classification of brain tumor using deep learning method. Neural Comput Appl 2020. [DOI: 10.1007/s00521-020-05332-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
5
|
Automatic nodule detection for lung cancer in CT images: A review. Comput Biol Med 2018; 103:287-300. [PMID: 30415174 DOI: 10.1016/j.compbiomed.2018.10.033] [Citation(s) in RCA: 61] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2018] [Revised: 10/29/2018] [Accepted: 10/29/2018] [Indexed: 12/18/2022]
Abstract
Automatic lung nodule detection has great significance for treating lung cancer and increasing patient survival. This work summarizes a critical review of recent techniques for automatic lung nodule detection in computed tomography images. This review indicates the current tendency and obtained progress as well as future challenges in this field. This research covered the databases including Web of Science, PubMed, and the Press, including IEEE Xplore and Science Direct, up to May 2018. Each part of the paper is summarized carefully in terms of the method and validation results for better comparison. Based on the results, some techniques show better performance for lung nodule detection. However, researchers should pay attention to the existing challenges, such as high sensitivity with a low false positive rate, large and different patient databases, developing or optimizing the detection technique of various types of lung nodules with different sizes, shapes, textures and locations, combining electronic medical records and picture archiving and communication systems, building efficient feature sets for better classification and promoting the cooperation and communication between academic institutions and medical organizations. We believe that automatic computer-aided detection systems will be developed with strong robustness, high efficiency and security assurance. This review will be helpful for professional researchers and radiologists to further learn about the latest techniques in computer-aided detection systems.
Collapse
|
6
|
Wang H, Zhou Z, Li Y, Chen Z, Lu P, Wang W, Liu W, Yu L. Comparison of machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer from 18F-FDG PET/CT images. EJNMMI Res 2017; 7:11. [PMID: 28130689 PMCID: PMC5272853 DOI: 10.1186/s13550-017-0260-9] [Citation(s) in RCA: 143] [Impact Index Per Article: 17.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2016] [Accepted: 01/19/2017] [Indexed: 02/07/2023] Open
Abstract
BACKGROUND This study aimed to compare one state-of-the-art deep learning method and four classical machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer (NSCLC) from 18F-FDG PET/CT images. Another objective was to compare the discriminative power of the recently popular PET/CT texture features with the widely used diagnostic features such as tumor size, CT value, SUV, image contrast, and intensity standard deviation. The four classical machine learning methods included random forests, support vector machines, adaptive boosting, and artificial neural network. The deep learning method was the convolutional neural networks (CNN). The five methods were evaluated using 1397 lymph nodes collected from PET/CT images of 168 patients, with corresponding pathology analysis results as gold standard. The comparison was conducted using 10 times 10-fold cross-validation based on the criterion of sensitivity, specificity, accuracy (ACC), and area under the ROC curve (AUC). For each classical method, different input features were compared to select the optimal feature set. Based on the optimal feature set, the classical methods were compared with CNN, as well as with human doctors from our institute. RESULTS For the classical methods, the diagnostic features resulted in 81~85% ACC and 0.87~0.92 AUC, which were significantly higher than the results of texture features. CNN's sensitivity, specificity, ACC, and AUC were 84, 88, 86, and 0.91, respectively. There was no significant difference between the results of CNN and the best classical method. The sensitivity, specificity, and ACC of human doctors were 73, 90, and 82, respectively. All the five machine learning methods had higher sensitivities but lower specificities than human doctors. CONCLUSIONS The present study shows that the performance of CNN is not significantly different from the best classical methods and human doctors for classifying mediastinal lymph node metastasis of NSCLC from PET/CT images. Because CNN does not need tumor segmentation or feature calculation, it is more convenient and more objective than the classical methods. However, CNN does not make use of the import diagnostic features, which have been proved more discriminative than the texture features for classifying small-sized lymph nodes. Therefore, incorporating the diagnostic features into CNN is a promising direction for future research.
Collapse
Affiliation(s)
- Hongkai Wang
- Department of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, No. 2 Linggong Street, Ganjingzi District, Dalian, Liaoning, 116024, China
| | - Zongwei Zhou
- Department of Biomedical Informatics and the College of Health Solutions, Arizona State University, 13212 East Shea Boulevard, Scottsdale, AZ, 85259, USA
| | - Yingci Li
- Center of PET/CT, The Affiliated Tumor Hospital of Harbin Medical University, 150 Haping Road, Nangang District, Harbin, Heilongjiang Province, 150081, China
| | - Zhonghua Chen
- Department of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, No. 2 Linggong Street, Ganjingzi District, Dalian, Liaoning, 116024, China
| | - Peiou Lu
- Center of PET/CT, The Affiliated Tumor Hospital of Harbin Medical University, 150 Haping Road, Nangang District, Harbin, Heilongjiang Province, 150081, China
| | - Wenzhi Wang
- Center of PET/CT, The Affiliated Tumor Hospital of Harbin Medical University, 150 Haping Road, Nangang District, Harbin, Heilongjiang Province, 150081, China
| | - Wanyu Liu
- HIT-INSA Sino French Research Centre for Biomedical Imaging, Harbin Institute of Technology, Harbin, Heilongjiang, 150001, China
| | - Lijuan Yu
- Center of PET/CT, The Affiliated Tumor Hospital of Harbin Medical University, 150 Haping Road, Nangang District, Harbin, Heilongjiang Province, 150081, China.
| |
Collapse
|
7
|
Gonçalves VM, Delamaro ME, Nunes FLS. Applying graphical oracles to evaluate image segmentation results. JOURNAL OF THE BRAZILIAN COMPUTER SOCIETY 2017. [DOI: 10.1186/s13173-016-0050-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
8
|
Bharti P, Mittal D, Ananthasivan R. Computer-aided Characterization and Diagnosis of Diffuse Liver Diseases Based on Ultrasound Imaging: A Review. ULTRASONIC IMAGING 2017; 39:33-61. [PMID: 27097589 DOI: 10.1177/0161734616639875] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Diffuse liver diseases, such as hepatitis, fatty liver, and cirrhosis, are becoming a leading cause of fatality and disability all over the world. Early detection and diagnosis of these diseases is extremely important to save lives and improve effectiveness of treatment. Ultrasound imaging, a noninvasive diagnostic technique, is the most commonly used modality for examining liver abnormalities. However, the accuracy of ultrasound-based diagnosis depends highly on expertise of radiologists. Computer-aided diagnosis systems based on ultrasound imaging assist in fast diagnosis, provide a reliable "second opinion" for experts, and act as an effective tool to measure response of treatment on patients undergoing clinical trials. In this review, we first describe appearance of liver abnormalities in ultrasound images and state the practical issues encountered in characterization of diffuse liver diseases that can be addressed by software algorithms. We then discuss computer-aided diagnosis in general with features and classifiers relevant to diffuse liver diseases. In later sections of this paper, we review the published studies and describe the key findings of those studies. A concise tabular summary comparing image database, features extraction, feature selection, and classification algorithms presented in the published studies is also exhibited. Finally, we conclude with a summary of key findings and directions for further improvements in the areas of accuracy and objectiveness of computer-aided diagnosis.
Collapse
Affiliation(s)
- Puja Bharti
- 1 Department of Electrical and Instrumentation Engineering, Thapar University, Patiala, India
| | - Deepti Mittal
- 1 Department of Electrical and Instrumentation Engineering, Thapar University, Patiala, India
| | | |
Collapse
|
9
|
Automated characterization of fatty liver disease and cirrhosis using curvelet transform and entropy features extracted from ultrasound images. Comput Biol Med 2016; 79:250-258. [PMID: 27825038 DOI: 10.1016/j.compbiomed.2016.10.022] [Citation(s) in RCA: 65] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2016] [Revised: 10/26/2016] [Accepted: 10/27/2016] [Indexed: 02/07/2023]
Abstract
Fatty liver disease (FLD) is reversible disease and can be treated, if it is identified at an early stage. However, if diagnosed at the later stage, it can progress to an advanced liver disease such as cirrhosis which may ultimately lead to death. Therefore, it is essential to detect it at an early stage before the disease progresses to an irreversible stage. Several non-invasive computer-aided techniques are proposed to assist in the early detection of FLD and cirrhosis using ultrasound images. In this work, we are proposing an algorithm to discriminate automatically the normal, FLD and cirrhosis ultrasound images using curvelet transform (CT) method. Higher order spectra (HOS) bispectrum, HOS phase, fuzzy, Kapoor, max, Renyi, Shannon, Vajda and Yager entropies are extracted from CT coefficients. These extracted features are subjected to locality sensitive discriminant analysis (LSDA) feature reduction method. Then these LSDA coefficients ranked based on F-value are fed to different classifiers to choose the best performing classifier using minimum number of features. Our proposed technique can characterize normal, FLD and cirrhosis using probabilistic neural network (PNN) classifier with an accuracy of 97.33%, specificity of 100.00% and sensitivity of 96.00% using only six features. In addition, these chosen features are used to develop a liver disease index (LDI) to differentiate the normal, FLD and cirrhosis classes using a single number. This can significantly help the radiologists to discriminate FLD and cirrhosis in their routine liver screening.
Collapse
|