Improving lung cancer prognosis assessment by incorporating synthetic minority oversampling technique and score fusion method

A multi-stage fusion framework to classify breast lesions using deep learning and radiomics features computed from four-view mammograms

BACKGROUND

Developing computer aided diagnosis (CAD) schemes of mammograms to classify between malignant and benign breast lesions has attracted a lot of research attention over the last several decades. However, unlike radiologists who make diagnostic decisions based on the fusion of image features extracted from multi-view mammograms, most CAD schemes are single-view-based schemes, which limit CAD performance and clinical utility.

PURPOSE

This study aims to develop and test a novel CAD framework that optimally fuses information extracted from ipsilateral views of bilateral mammograms using both deep transfer learning (DTL) and radiomics feature extraction methods.

METHODS

An image dataset containing 353 benign and 611 malignant cases is assembled. Each case contains four images: the craniocaudal (CC) and mediolateral oblique (MLO) view of the left and right breast. First, we extract four matching regions of interest (ROIs) from images that surround centers of two suspicious lesion regions seen in CC and MLO views, as well as matching ROIs in the contralateral breasts. Next, the handcrafted radiomics (HCRs) features and VGG16 model-generated automated features are extracted from each ROI resulting in eight feature vectors. Then, after reducing feature dimensionality and quantifying the bilateral and ipsilateral asymmetry of four ROIs to yield four new feature vectors, we test four fusion methods to build three support vector machine (SVM) classifiers by an optimal fusion of asymmetrical image features extracted from four view images.

RESULTS

Using a 10-fold cross-validation method, results show that a SVM classifier trained using an optimal fusion of four view images yields the highest classification performance (AUC = 0.876 ± 0.031), which significantly outperforms SVM classifiers trained using one projection view alone, AUC = 0.817 ± 0.026 and 0.792 ± 0.026 for the CC and MLO view of bilateral mammograms, respectively (p < 0.001).

CONCLUSIONS

The study demonstrates that the shift from single-view CAD to four-view CAD and the inclusion of both DTL and radiomics features significantly increases CAD performance in distinguishing between malignant and benign breast lesions.

Imbalanced data preprocessing techniques for machine learning: a systematic mapping study

Machine Learning (ML) algorithms have been increasingly replacing people in several application domains-in which the majority suffer from data imbalance. In order to solve this problem, published studies implement data preprocessing techniques, cost-sensitive and ensemble learning. These solutions reduce the naturally occurring bias towards the majority sample through ML. This study uses a systematic mapping methodology to assess 9927 papers related to sampling techniques for ML in imbalanced data applications from 7 digital libraries. A filtering process selected 35 representative papers from various domains, such as health, finance, and engineering. As a result of a thorough quantitative analysis of these papers, this study proposes two taxonomies-illustrating sampling techniques and ML models. The results indicate that oversampling and classical ML are the most common preprocessing techniques and models, respectively. However, solutions with neural networks and ensemble ML models have the best performance-with potentially better results through hybrid sampling techniques. Finally, none of the 35 works apply simulation-based synthetic oversampling, indicating a path for future preprocessing solutions.

Development of a radiomics and machine learning model for predicting occult cervical lymph node metastasis in patients with tongue cancer

OBJECTIVE

We aimed to develop a predictive model for occult cervical lymph node metastasis in patients with tongue cancer using radiomics and machine learning from pretreatment contrast-enhanced computed tomography.

STUDY DESIGN

This study included 161 patients with tongue cancer who received local treatment. Computed tomography images were transferred to a radiomics platform. The volume of interest was the total neck node level, including levels Ia, Ib, II, III, and IVa at the ipsilateral side, and each neck node level. The dimensionality of the radiomics features was reduced using least absolute shrinkage and selection operator logistic regression analysis. We compared 5 classifiers with or without the synthetic minority oversampling technique (SMOTE).

RESULTS

For the analysis at the total neck node level, random forest with SMOTE was the best model, with an accuracy of 0.85 and an area under the curve score of 0.92. For the analysis at each neck node level, a support vector machine with SMOTE was the best model, with an accuracy of 0.96 and an area under the curve score of 0.98.

CONCLUSIONS

Predictive models using radiomics and machine learning have potential as clinical decision support tools in the management of patients with tongue cancer for prediction of occult cervical lymph node metastasis.

Applying Quantitative Radiographic Image Markers to Predict Clinical Complications After Aneurysmal Subarachnoid Hemorrhage: A Pilot Study

Accurately predicting clinical outcome of aneurysmal subarachnoid hemorrhage (aSAH) patients is difficult. The purpose of this study was to develop and test a new fully-automated computer-aided detection (CAD) scheme of brain computed tomography (CT) images to predict prognosis of aSAH patients. A retrospective dataset of 59 aSAH patients was assembled. Each patient had 2 sets of CT images acquired at admission and prior-to-discharge. CAD scheme was applied to segment intracranial brain regions into four subregions, namely, cerebrospinal fluid (CSF), white matter (WM), gray matter (GM), and leaked extraparenchymal blood (EPB), respectively. CAD then detects sulci and computes 9 image features related to 5 volumes of the segmented sulci, EPB, CSF, WM, and GM and 4 volumetrical ratios to sulci. Subsequently, applying a leave-one-case-out cross-validation method embedded with a principal component analysis (PCA) algorithm to generate optimal feature vector, 16 support vector machine (SVM) models were built using CT images acquired either at admission or prior-to-discharge to predict each of eight clinically relevant parameters commonly used to assess patients' prognosis. Finally, a receiver operating characteristics (ROC) method was used to evaluate SVM model performance. Areas under ROC curves of 16 SVM models range from 0.62 ± 0.07 to 0.86 ± 0.07. In general, SVM models trained using CT images acquired at admission yielded higher accuracy to predict short-term clinical outcomes, while SVM models trained using CT images acquired prior-to-discharge demonstrated higher accuracy in predicting long-term clinical outcomes. This study demonstrates feasibility to predict prognosis of aSAH patients using new quantitative image markers generated by SVM models.

Learning from imbalanced fetal outcomes of systemic lupus erythematosus in artificial neural networks

OBJECTIVE

To explore an effective algorithm based on artificial neural network to pick correctly the minority of pregnant women with SLE suffering fetal loss outcomes from the majority with live birth and train a well behaved model as a clinical decision assistant.

METHODS

We integrated the thoughts of comparative and focused study into the artificial neural network and presented an effective algorithm aiming at imbalanced learning in small dataset.

RESULTS

We collected 469 non-trivial pregnant patients with SLE, where 420 had live-birth outcomes and the other 49 patients ended in fetal loss. A well trained imbalanced-learning model had a high sensitivity of 19/21 ([Formula: see text]) for the identification of patients with fetal loss outcomes.

DISCUSSION

The misprediction of the two patients was explainable. Algorithm improvements in artificial neural network framework enhanced the identification in imbalanced learning problems and the external validation increased the reliability of algorithm.

CONCLUSION

The well-trained model was fully qualified to assist healthcare providers to make timely and accurate decisions.

Applying a random projection algorithm to optimize machine learning model for predicting peritoneal metastasis in gastric cancer patients using CT images

BACKGROUND AND OBJECTIVE

Non-invasively predicting the risk of cancer metastasis before surgery can play an essential role in determining which patients can benefit from neoadjuvant chemotherapy. This study aims to investigate and test the advantages of applying a random projection algorithm to develop and optimize a radiomics-based machine learning model to predict peritoneal metastasis in gastric cancer patients using a small and imbalanced computed tomography (CT) image dataset.

METHODS

A retrospective dataset involving CT images acquired from 159 patients is assembled, including 121 and 38 cases with and without peritoneal metastasis, respectively. A computer-aided detection scheme is first applied to segment primary gastric tumor volumes and initially compute 315 image features. Then, five gradients boosting machine (GBM) models embedded with five feature selection methods (including random projection algorithm, principal component analysis, least absolute shrinkage, and selection operator, maximum relevance and minimum redundancy, and recursive feature elimination) along with a synthetic minority oversampling technique, are built to predict the risk of peritoneal metastasis. All GBM models are trained and tested using a leave-one-case-out cross-validation method.

RESULTS

Results show that the GBM model embedded with a random projection algorithm yields a significantly higher prediction accuracy (71.2%) than the other four GBM models (p<0.05). The precision, sensitivity, and specificity of this optimal GBM model are 65.78%, 43.10%, and 87.12%, respectively.

CONCLUSIONS

This study demonstrates that CT images of the primary gastric tumors contain discriminatory information to predict the risk of peritoneal metastasis, and a random projection algorithm is a promising method to generate optimal feature vector, improving the performance of machine learning based prediction models.

Enhanced computed tomography radiomics-based machine-learning methods for predicting the Fuhrman grades of renal clear cell carcinoma

OBJECTIVE

To develop and test an optimal machine learning model based on the enhanced computed tomography (CT) to preoperatively predict pathological grade of clear cell renal cell carcinoma (ccRCC).

METHODS

A retrospective analysis of 53 pathologically confirmed cases of ccRCC was performed and 25 consecutive ccRCC cases were selected as a prospective testing set. All patients underwent routine preoperative abdominal CT plain and enhanced scans. Renal tumor lesions were segmented on arterial phase images and 396 radiomics features were extracted. In the training set, seven discrimination classifiers for high- and low-grade ccRCCs were constructed based on seven different machine learning models, respectively, and their performance and stability for predicting ccRCC grades were evaluated through receiver operating characteristic (ROC) analysis and cross-validation. Prediction accuracy and area under ROC curve were used as evaluation indices. Finally, the diagnostic efficacy of the optimal model was verified in the testing set.

RESULTS

The accuracies and AUC values achieved by support vector machine with radial basis function kernel (svmRadial), random forest and naïve Bayesian models were 0.860±0.158 and 0.919±0.118, 0.840±0.160 and 0.915±0.138, 0.839±0.147 and 0.921±0.133, respectively, which showed high predictive performance, whereas K-nearest neighborhood model yielded lower accuracy of 0.720±0.188 and lower AUC value of 0.810±0.150. Additionally, svmRadial had smallest relative standard deviation (RSD, 0.13 for AUC, 0.17 for accuracy), which indicates higher stability.

CONCLUSION

svmRadial performs best in predicting pathological grades of ccRCC using radiomics features computed from the preoperative CT images, and thus may have high clinical potential in guiding preoperative decision.

A prognostic analysis method for non-small cell lung cancer based on the computed tomography radiomics

In order to assist doctors in arranging the postoperative treatments and re-examinations for non-small cell lung cancer (NSCLC) patients, this study was initiated to explore a prognostic analysis method for NSCLC based on computed tomography (CT) radiomics. The data of 173 NSCLC patients were collected retrospectively and the clinically meaningful 3-year survival was used as the predictive limit to predict the patient's prognosis survival time range. Firstly, lung tumors were segmented and the radiomics features were extracted. Secondly, the feature weighting algorithm was used to screen and optimize the extracted original feature data. Then, the selected feature data combining with the prognosis survival of patients were used to train machine learning classification models. Finally, a prognostic survival prediction model and radiomics prognostic factors were obtained to predict the prognosis survival time range of NSCLC patients. The classification accuracy rate under cross-validation was up to 88.7% in the prognosis survival analysis model. When verifying on an independent data set, the model also yielded a high prediction accuracy which is up to 79.6%. Inverse different moment, lobulation sign and angular second moment were NSCLC prognostic factors based on radiomics. This study proved that CT radiomics features could effectively assist doctors to make more accurate prognosis survival prediction for NSCLC patients, so as to help doctors to optimize treatment and re-examination for NSCLC patients to extend their survival time.

Computer-aided diagnosis of ground-glass opacity pulmonary nodules using radiomic features analysis

This study aims to develop a CT-based radiomic features analysis approach for diagnosis of ground-glass opacity (GGO) pulmonary nodules, and also assess whether computer-aided diagnosis (CADx) performance changes in classifying between benign and malignant nodules associated with histopathological subtypes namely, adenocarcinoma in situ (AIS), minimally invasive adenocarcinoma (MIA), and invasive adenocarcinoma (IAC), respectively. The study involves 182 histopathology-confirmed GGO nodules collected from two cancer centers. Among them, 59 are benign, 50 are AIS, 32 are MIA, and 41 are IAC nodules. Four training/testing data sets-(1) all nodules, (2) benign and AIS nodules, (3) benign and MIA nodules, (4) benign and IAC nodules-are assembled based on their histopathological subtypes. We first segment pulmonary nodules depicted in CT images by using a 3D region growing and geodesic active contour level set algorithm. Then, we computed and extracted 1117 quantitative imaging features based on the 3D segmented nodules. After conducting radiomic features normalization process, we apply a leave-one-out cross-validation (LOOCV) method to build models by embedding with a Relief feature selection, synthetic minority oversampling technique (SMOTE) and three machine-learning classifiers namely, support vector machine classifier, logistic regression classifier and Gaussian Naïve Bayes classifier. When separately using four data sets to train and test three classifiers, the average areas under receiver operating characteristic curves (AUC) are 0.75, 0.55, 0.77 and 0.93, respectively. When testing on an independent data set, our scheme yields higher accuracy than two radiologists (61.3% versus radiologist 1: 53.1% and radiologist 2: 56.3%). This study demonstrates that: (1) the feasibility of using CT-based radiomic features analysis approach to distinguish between benign and malignant GGO nodules, (2) higher performance of CADx scheme in diagnosing GGO nodules comparing with radiologist, and (3) a consistently positive trend between classification performance and invasive grade of GGO nodules. Thus, to improve the CADx performance in diagnosing of GGO nodules, one should assemble an optimal training data set dominated with more nodules associated with non-invasive lung adenocarcinoma (i.e. AIS and MIA).

Developing global image feature analysis models to predict cancer risk and prognosis

In order to develop precision or personalized medicine, identifying new quantitative imaging markers and building machine learning models to predict cancer risk and prognosis has been attracting broad research interest recently. Most of these research approaches use the similar concepts of the conventional computer-aided detection schemes of medical images, which include steps in detecting and segmenting suspicious regions or tumors, followed by training machine learning models based on the fusion of multiple image features computed from the segmented regions or tumors. However, due to the heterogeneity and boundary fuzziness of the suspicious regions or tumors, segmenting subtle regions is often difficult and unreliable. Additionally, ignoring global and/or background parenchymal tissue characteristics may also be a limitation of the conventional approaches. In our recent studies, we investigated the feasibility of developing new computer-aided schemes implemented with the machine learning models that are trained by global image features to predict cancer risk and prognosis. We trained and tested several models using images obtained from full-field digital mammography, magnetic resonance imaging, and computed tomography of breast, lung, and ovarian cancers. Study results showed that many of these new models yielded higher performance than other approaches used in current clinical practice. Furthermore, the computed global image features also contain complementary information from the features computed from the segmented regions or tumors in predicting cancer prognosis. Therefore, the global image features can be used alone to develop new case-based prediction models or can be added to current tumor-based models to increase their discriminatory power.

Prediction of breast cancer risk using a machine learning approach embedded with a locality preserving projection algorithm

In order to automatically identify a set of effective mammographic image features and build an optimal breast cancer risk stratification model, this study aims to investigate advantages of applying a machine learning approach embedded with a locally preserving projection (LPP) based feature combination and regeneration algorithm to predict short-term breast cancer risk. A dataset involving negative mammograms acquired from 500 women was assembled. This dataset was divided into two age-matched classes of 250 high risk cases in which cancer was detected in the next subsequent mammography screening and 250 low risk cases, which remained negative. First, a computer-aided image processing scheme was applied to segment fibro-glandular tissue depicted on mammograms and initially compute 44 features related to the bilateral asymmetry of mammographic tissue density distribution between left and right breasts. Next, a multi-feature fusion based machine learning classifier was built to predict the risk of cancer detection in the next mammography screening. A leave-one-case-out (LOCO) cross-validation method was applied to train and test the machine learning classifier embedded with a LLP algorithm, which generated a new operational vector with 4 features using a maximal variance approach in each LOCO process. Results showed a 9.7% increase in risk prediction accuracy when using this LPP-embedded machine learning approach. An increased trend of adjusted odds ratios was also detected in which odds ratios increased from 1.0 to 11.2. This study demonstrated that applying the LPP algorithm effectively reduced feature dimensionality, and yielded higher and potentially more robust performance in predicting short-term breast cancer risk.

Applying Quantitative CT Image Feature Analysis to Predict Response of Ovarian Cancer Patients to Chemotherapy

RATIONALE AND OBJECTIVES

The study aimed to investigate the role of applying quantitative image features computed from computed tomography (CT) images for early prediction of tumor response to chemotherapy in the clinical trials for treating ovarian cancer patients.

MATERIALS AND METHODS

A dataset involving 91 patients was retrospectively assembled. Each patient had two sets of pre- and post-therapy CT images. A computer-aided detection scheme was applied to segment metastatic tumors previously tracked by radiologists on CT images and computed image features. Two initial feature pools were built using image features computed from pre-therapy CT images only and image feature difference computed from both pre- and post-therapy images. A feature selection method was applied to select optimal features, and an equal-weighted fusion method was used to generate a new quantitative imaging marker from each pool to predict 6-month progression-free survival. The prediction accuracy between quantitative imaging markers and the Response Evaluation Criteria in Solid Tumors (RECIST) criteria was also compared.

RESULTS

The highest areas under the receiver operating characteristic curve are 0.684 ± 0.056 and 0.771 ± 0.050 when using a single image feature computed from pre-therapy CT images and feature difference computed from pre- and post-therapy CT images, respectively. Using two corresponding fusion-based image markers, the areas under the receiver operating characteristic curve significantly increased to 0.810 ± 0.045 and 0.829 ± 0.043 (P < 0.05), respectively. Overall prediction accuracy levels are 71.4%, 80.2%, and 74.7% when using two imaging markers and RECIST, respectively.

CONCLUSIONS

This study demonstrated the feasibility of predicting patients' response to chemotherapy using quantitative imaging markers computed from pre-therapy CT images. However, using image feature difference computed between pre- and post-therapy CT images yielded higher prediction accuracy.