Multi-modal magnetic resonance imaging-based grading analysis for gliomas by integrating radiomics and deep features

Preoperative Discrimination of CDKN2A/B Homozygous Deletion Status in Isocitrate Dehydrogenase-Mutant Astrocytoma: A Deep Learning-Based Radiomics Model Using MRI

BACKGROUND

Cyclin-dependent kinase inhibitor 2A/B (CDKN2A/B) homozygous deletion has been verified as an independent and critical biomarker of negative prognosis and short survival in isocitrate dehydrogenase (IDH)-mutant astrocytoma. Therefore, noninvasive and accurate discrimination of CDKN2A/B homozygous deletion status is essential for the clinical management of IDH-mutant astrocytoma patients.

PURPOSE

To develop a noninvasive, robust preoperative model based on MR image features for discriminating CDKN2A/B homozygous deletion status of IDH-mutant astrocytoma.

STUDY TYPE

Retrospective.

POPULATION

Two hundred fifty-one patients: 107 patients with CDKN2A/B homozygous deletion and 144 patients without CDKN2A/B homozygous deletion.

FIELD STRENGTH/SEQUENCE

3.0 T/1.5 T: Contrast-enhanced T1-weighted spin-echo inversion recovery sequence (CE-T1WI) and T2-weighted fluid-attenuation spin-echo inversion recovery sequence (T2FLAIR).

ASSESSMENT

A total of 1106 radiomics and 1000 deep learning features extracted from CE-T1WI and T2FLAIR were used to develop models to discriminate the CDKN2A/B homozygous deletion status. Radiomics models, deep learning-based radiomics (DLR) models and the final integrated model combining radiomics features with deep learning features were developed and compared their preoperative discrimination performance.

STATISTICAL TESTING

Pearson chi-square test and Mann Whitney U test were used for assessing the statistical differences in patients' clinical characteristics. The Delong test compared the statistical differences of receiver operating characteristic (ROC) curves and area under the curve (AUC) of different models. The significance threshold is P < 0.05.

RESULTS

The final combined model (training AUC = 0.966; validation AUC = 0.935; test group: AUC = 0.943) outperformed the optimal models based on only radiomics or DLR features (training: AUC = 0.916 and 0.952; validation: AUC = 0.886 and 0.912; test group: AUC = 0.862 and 0.902).

DATA CONCLUSION

Whether based on a single sequence or a combination of two sequences, radiomics and DLR models have achieved promising performance in assessing CDKN2A/B homozygous deletion status. However, the final model combining both deep learning and radiomics features from CE-T1WI and T2FLAIR outperformed the optimal radiomics or DLR model.

EVIDENCE LEVEL

4 TECHNICAL EFFICACY: Stage 2.

Multi-modal medical Transformers: A meta-analysis for medical image segmentation in oncology

Multi-modal medical image segmentation is a crucial task in oncology that enables the precise localization and quantification of tumors. The aim of this work is to present a meta-analysis of the use of multi-modal medical Transformers for medical image segmentation in oncology, specifically focusing on multi-parametric MR brain tumor segmentation (BraTS2021), and head and neck tumor segmentation using PET-CT images (HECKTOR2021). The multi-modal medical Transformer architectures presented in this work exploit the idea of modality interaction schemes based on visio-linguistic representations: (i) single-stream, where modalities are jointly processed by one Transformer encoder, and (ii) multiple-stream, where the inputs are encoded separately before being jointly modeled. A total of fourteen multi-modal architectures are evaluated using different ranking strategies based on dice similarity coefficient (DSC) and average symmetric surface distance (ASSD) metrics. In addition, cost indicators such as the number of trainable parameters and the number of multiply-accumulate operations (MACs) are reported. The results demonstrate that multi-path hybrid CNN-Transformer-based models improve segmentation accuracy when compared to traditional methods, but come at the cost of increased computation time and potentially larger model size.

Deep Learning Radiomics for the Assessment of Telomerase Reverse Transcriptase Promoter Mutation Status in Patients With Glioblastoma Using Multiparametric MRI

BACKGROUND

Studies have shown that magnetic resonance imaging (MRI)-based deep learning radiomics (DLR) has the potential to assess glioma grade; however, its role in predicting telomerase reverse transcriptase (TERT) promoter mutation status in patients with glioblastoma (GBM) remains unclear.

PURPOSE

To evaluate the value of deep learning (DL) in multiparametric MRI-based radiomics in identifying TERT promoter mutations in patients with GBM preoperatively.

STUDY TYPE

Retrospective.

POPULATION

A total of 274 patients with isocitrate dehydrogenase-wildtype GBM were included in the study. The training and external validation cohorts included 156 (54.3 ± 12.7 years; 96 males) and 118 (54 .2 ± 13.4 years; 73 males) patients, respectively.

FIELD STRENGTH/SEQUENCE

Axial contrast-enhanced T1-weighted spin-echo inversion recovery sequence (T1CE), T1-weighted spin-echo inversion recovery sequence (T1WI), and T2-weighted spin-echo inversion recovery sequence (T2WI) on 1.5-T and 3.0-T scanners were used in this study.

ASSESSMENT

Overall tumor area regions (the tumor core and edema) were segmented, and the radiomics and DL features were extracted from preprocessed multiparameter preoperative brain MRI images-T1WI, T1CE, and T2WI. A model based on the DLR signature, clinical signature, and clinical DLR (CDLR) nomogram was developed and validated to identify TERT promoter mutation status.

STATISTICAL TESTS

The Mann-Whitney U test, Pearson test, least absolute shrinkage and selection operator, and logistic regression analysis were applied for feature selection and construction of radiomics and DL signatures. Results were considered statistically significant at P-value <0.05.

RESULTS

The DLR signature showed the best discriminative power for predicting TERT promoter mutations, yielding an AUC of 0.990 and 0.890 in the training and external validation cohorts, respectively. Furthermore, the DLR signature outperformed CDLR nomogram (P = 0.670) and significantly outperformed clinical models in the validation cohort.

DATA CONCLUSION

The multiparameter MRI-based DLR signature exhibited a promising performance for the assessment of TERT promoter mutations in patients with GBM, which could provide information for individualized treatment.

LEVEL OF EVIDENCE

3 TECHNICAL EFFICACY: Stage 2.

Prediction of Glioma Grade by Tumor Heterogeneity Radiomic Analysis Based on Multiparametric MRI

Predicting glioma grade plays a pivotal role in treatment and prognosis. However, several current methods for grading depend on the characteristics of the whole tumor. Predicting grade by analyzing tumor subregions has not been thoroughly investigated, which aims to improve the prediction performance. To predict glioma grade via analysis of tumor heterogeneity with features extracted from tumor subregions, it is mainly divided into four magnetic resonance imaging (MRI) sequences, including T2-weighted (T2), fluid-attenuated inversion recovery (FLAIR), pre-gadolinium T1-weighted (T1), and post-gadolinium T1-weighted methods. This study included the data of 97 patients with glioblastomas and 42 patients with low-grade gliomas before surgery. Three subregions, including enhanced tumor (ET), non-enhanced tumor, and peritumoral edema, were obtained based on segmentation labels generated by the GLISTRBoost algorithm. One hundred radiomic features were extracted from each subregion. Feature selection was performed using the cross-validated recursive feature elimination with a support vector machine (SVM) algorithm. SVM classifiers with grid search were established to predict glioma grade based on unparametric and multiparametric MRI. The area under the receiver operating characteristic curve (AUC) was used to evaluate the performance of the classifiers, and the performance of the subregions was compared with the results of the whole tumor. In uniparametric analysis, the features from the ET subregion yielded a higher AUC value of 0.8697, 0.8474, and 0.8474 than those of the whole tumor of FLAIR, T1, and T2. In multiparametric analysis, the ET subregion achieved the best performance (AUC = 0.8755), which was higher than the uniparametric results. Radiomic features from the tumor subregion can potentially be used as clinical markers to improve the predictive accuracy of glioma grades.

Artificial Intelligence Technologies in the Microsurgical Operating Room (Review)

Surgery performed by a novice neurosurgeon under constant supervision of a senior surgeon with the experience of thousands of operations, able to handle any intraoperative complications and predict them in advance, and never getting tired, is currently an elusive dream, but can become a reality with the development of artificial intelligence methods. This paper has presented a review of the literature on the use of artificial intelligence technologies in the microsurgical operating room. Searching for sources was carried out in the PubMed text database of medical and biological publications. The key words used were "surgical procedures", "dexterity", "microsurgery" AND "artificial intelligence" OR "machine learning" OR "neural networks". Articles in English and Russian were considered with no limitation to publication date. The main directions of research on the use of artificial intelligence technologies in the microsurgical operating room have been highlighted. Despite the fact that in recent years machine learning has been increasingly introduced into the medical field, a small number of studies related to the problem of interest have been published, and their results have not proved to be of practical use yet. However, the social significance of this direction is an important argument for its development.

Recurrence risk stratification for locally advanced cervical cancer using multi-modality transformer network

Objectives

Recurrence risk evaluation is clinically significant for patients with locally advanced cervical cancer (LACC). We investigated the ability of transformer network in recurrence risk stratification of LACC based on computed tomography (CT) and magnetic resonance (MR) images.

Methods

A total of 104 patients with pathologically diagnosed LACC between July 2017 and December 2021 were enrolled in this study. All patients underwent CT and MR scanning, and their recurrence status was identified by the biopsy. We randomly divided patients into training cohort (48 cases, non-recurrence: recurrence = 37: 11), validation cohort (21 cases, non-recurrence: recurrence = 16: 5), and testing cohort (35 cases, non-recurrence: recurrence = 27: 8), upon which we extracted 1989, 882 and 315 patches for model's development, validation and evaluation, respectively. The transformer network consisted of three modality fusion modules to extract multi-modality and multi-scale information, and a fully-connected module to perform recurrence risk prediction. The model's prediction performance was assessed by six metrics, including the area under the receiver operating characteristic curve (AUC), accuracy, f1-score, sensitivity, specificity and precision. Univariate analysis with F-test and T-test were conducted for statistical analysis.

Results

The proposed transformer network is superior to conventional radiomics methods and other deep learning networks in both training, validation and testing cohorts. Particularly, in testing cohort, the transformer network achieved the highest AUC of 0.819 ± 0.038, while four conventional radiomics methods and two deep learning networks got the AUCs of 0.680 ± 0.050, 0.720 ± 0.068, 0.777 ± 0.048, 0.691 ± 0.103, 0.743 ± 0.022 and 0.733 ± 0.027, respectively.

Conclusions

The multi-modality transformer network showed promising performance in recurrence risk stratification of LACC and may be used as an effective tool to help clinicians make clinical decisions.

Differentiating Glioblastoma Multiforme from Brain Metastases Using Multidimensional Radiomics Features Derived from MRI and Multiple Machine Learning Models

Due to different treatment strategies, it is extremely important to differentiate between glioblastoma multiforme (GBM) and brain metastases (MET). It often proves difficult to distinguish between GBM and MET using MRI due to their similar appearance on the imaging modalities. Surgical methods are still necessary for definitive diagnosis, despite the importance of magnetic resonance imaging in detecting, characterizing, and monitoring brain tumors. We introduced an accurate, convenient, and user-friendly method to differentiate between GBM and MET through routine MRI sequence and radiomics analyses. We collected 91 patients from one institution, including 50 with GBM and 41 with MET, which were proven pathologically. The tumors separately were segmented on all MRI images (T1-weighted imaging (T1WI), contrast-enhanced T1-weighted imaging (T1C), T2-weighted imaging (T2WI), and fluid-attenuated inversion recovery (FLAIR)) to form the volume of interest (VOI). Eight ML models and feature reduction strategies were evaluated using routine MRI sequences (T1W, T2W, T1-CE, and FLAIR) in two methods with (second model) and without wavelet transform (first model) radiomics. The optimal model was selected based on each model’s accuracy, AUC-roc, and F1-score values. In this study, we have achieved the result of 0.98, 0.99, and 0.98 percent for accuracy, AUC-roc, and F1-score, respectively, which have yielded a better result than the first model. In most investigated models, there were significant improvements in the multidimensional wavelets model compared to the non-multidimensional wavelets model. Multidimensional discrete wavelet transform can analyze hidden features of the MRI from a different perspective and generate accurate features which are highly correlated with the model accuracy.

Performance of a generative adversarial network using ultrasound images to stage liver fibrosis and predict cirrhosis based on a deep-learning radiomics nomogram

AIM

To investigate the performance of a generative adversarial network (GAN) model for staging liver fibrosis and its radiomics-based nomogram for predicting cirrhosis.

MATERIALS AND METHODS

This two-centre retrospective study included 434 patients for whom input data of ultrasound images and histopathological data (obtained within 1 month of ultrasound examinations) were assigned to the training cohort (249 patients), the internal cohort (92 patients), and the external (93 patients) cohort. A data augmentation method based on a GAN model was used. The discriminative performance was evaluated for classifying fibrosis of S4 and ≥S3. Deep-learning radiomics features were extracted for the prediction of cirrhosis (S4). To perform feature reduction and selection, the least absolute shrinkage and selection operator (LASSO) algorithm was applied. Radiomics scores, along with clinical factors, were incorporated into a nomogram using multivariable logistic regression analysis. The performance of the models was estimated with respect to discrimination power, calibration, and clinical benefits.

RESULTS

The areas under the receiver operating characteristic curve (AUCs) values of the GAN were 0.832/0.762 (≥S3), and 0.867/0.835 (S4) for internal/external test sets, respectively. The radiomics nomogram that intergrated radiomics scores and clinical factors showed good calibration and discrimination ability of 0.922 (AUC) in the training dataset, 0.896 in the internal dataset, and 0.861 in the external dataset. Decision curve analysis (DCA) demonstrated that the nomogram outperformed radiologist and haematological indices in terms of the most clinical benefits.

CONCLUSIONS

The GAN model could be applied to discriminate fibrosis stages, and a favourable predictive accuracy for diagnosing cirrhosis was achieved using a deep-learning radiomics nomogram.

Differential diagnosis of thyroid nodules by the Demetics ultrasound-assisted diagnosis system and contrast-enhanced ultrasound combined with thyroid image reporting and data systems

BACKGROUND

More and more new ultrasound techniques with their own characteristics are applied in the differential diagnosis of thyroid nodules. This study amied to assess and compare the diagnostic value of the Demetics ultrasound-assisted diagnosis system and contrast-enhanced ultrasound (CEUS) combined with the Thyroid Image Reporting and Data Systems (TI-RADS) for thyroid nodules.

DESIGN AND PATIENTS

A total of 600 thyroid nodules with pathological findings were retrospectively analysed. Demetics and CEUS were performed for all nodules. The diagnostic efficacy of Demetics and CEUS for nodules of different sizes was evaluated and compared in terms of sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (LR+) and negative likelihood ratio (LR-). The characteristics of nodules diagnosed and misdiagnosed by Demetics were compared to analyse the factors affecting the diagnostic accuracy of Demetics. The necessity of CEUS for nodules that are prone to misdiagnosis in Demetics was assessed.

RESULTS

Both Demetics and CEUS can be used for the differential diagnosis of benign and malignant thyroid nodules of different sizes. The diagnostic agreement between Demetics and CEUS for thyroid nodules of different sizes was moderate, substantial and fair, respectively. The sensitivity and NPV of Demetics were higher than those of CEUS, and the specificity, PPV and LR+ of CEUS were higher than that of Demetics. The LR- of Demetics was lower than those of CEUS. There were significant differences in age, calcification and margin in analysing the factors affecting Demetics. CEUS correctly diagnosed 50 of the 101 nodules misdiagnosed by Demetics.

CONCLUSIONS

Demetics showed high sensitivity in diagnosing thyroid nodules, while CEUS showed high specificity. In clinical practice, CEUS can further improve the diagnostic accuracy for nodules that are easily misdiagnosed by Demetics.

A Survey of Radiomics in Precision Diagnosis and Treatment of Adult Gliomas

Glioma is the most common primary malignant tumor of the adult central nervous system (CNS), which mostly shows invasive growth. In most cases, surgery is often difficult to completely remove, and the recurrence rate and mortality of patients are high. With the continuous development of molecular genetics and the great progress of molecular biology technology, more and more molecular biomarkers have been proved to have important guiding significance in the individualized diagnosis, treatment, and prognosis evaluation of glioma. With the updates of the World Health Organization (WHO) classification of tumors of the CNS in 2021, the diagnosis and treatment of glioma has entered the era of precision medicine in the true sense. Due to its ability to non-invasively achieve accurate identification of glioma from other intracranial tumors, and to predict the grade, genotyping, treatment response, and prognosis of glioma, which provides a scientific basis for the clinical application of individualized diagnosis and treatment model of glioma, radiomics has become a research hotspot in the field of precision medicine. This paper reviewed the research related to radiomics of adult gliomas published in recent years and summarized the research proceedings of radiomics in differential diagnosis, preoperative grading and genotyping, treatment and efficacy evaluation, and survival prediction of adult gliomas.

Radiomics-guided radiation therapy: opportunities and challenges

Radiomics is an advanced image-processing framework, which extracts image features and considers them as biomarkers towards personalized medicine. Applications include disease detection, diagnosis, prognosis, and therapy response assessment/prediction. As radiation therapy aims for further individualized treatments, radiomics could play a critical role in various steps before, during and after treatment. Elucidation of the concept of radiomics-guided radiation therapy (RGRT) is the aim of this review, attempting to highlight opportunities and challenges underlying the use of radiomics to guide clinicians and physicists towards more effective radiation treatments. This work identifies the value of RGRT in various steps of radiotherapy from patient selection to follow-up, and subsequently provides recommendations to improve future radiotherapy using quantitative imaging features.

Clinical significance and molecular annotation of cellular morphometric subtypes in lower-grade gliomas discovered by machine learning

BACKGROUND

Lower-grade gliomas (LGG) are heterogeneous diseases by clinical, histological, and molecular criteria. We aimed to personalize the diagnosis and therapy of LGG patients by developing and validating robust cellular morphometric subtypes (CMS) and to uncover the molecular signatures underlying these subtypes.

METHODS

Cellular morphometric biomarkers (CMBs) were identified with artificial intelligence technique from TCGA-LGG cohort. Consensus clustering was used to define CMS. Survival analysis was performed to assess the clinical impact of CMBs and CMS. A nomogram was constructed to predict 3- and 5-year overall survival (OS) of LGG patients. Tumor mutational burden (TMB) and immune cell infiltration between subtypes were analyzed using the Mann-Whitney U test. The double-blinded validation for important immunotherapy-related biomarkers was executed using immunohistochemistry (IHC).

RESULTS

We developed a machine learning (ML) pipeline to extract CMBs from whole-slide images of tissue histology; identifying and externally validating robust CMS of LGGs in multicenter cohorts. The subtypes had independent predicted OS across all three independent cohorts. In the TCGA-LGG cohort, patients within the poor-prognosis subtype responded poorly to primary and follow-up therapies. LGGs within the poor-prognosis subtype were characterized by high mutational burden, high frequencies of copy number alterations, and high levels of tumor-infiltrating lymphocytes and immune checkpoint genes. Higher levels of PD-1/PD-L1/CTLA-4 were confirmed by IHC staining. In addition, the subtypes learned from LGG demonstrate translational impact on glioblastoma (GBM).

CONCLUSIONS

We developed and validated a framework (CMS-ML) for CMS discovery in LGG associated with specific molecular alterations, immune microenvironment, prognosis, and treatment response.

Application of Artificial Intelligence in Diagnosis of Craniopharyngioma

Craniopharyngioma is a congenital brain tumor with clinical characteristics of hypothalamic-pituitary dysfunction, increased intracranial pressure, and visual field disorder, among other injuries. Its clinical diagnosis mainly depends on radiological examinations (such as Computed Tomography, Magnetic Resonance Imaging). However, assessing numerous radiological images manually is a challenging task, and the experience of doctors has a great influence on the diagnosis result. The development of artificial intelligence has brought about a great transformation in the clinical diagnosis of craniopharyngioma. This study reviewed the application of artificial intelligence technology in the clinical diagnosis of craniopharyngioma from the aspects of differential classification, prediction of tissue invasion and gene mutation, prognosis prediction, and so on. Based on the reviews, the technical route of intelligent diagnosis based on the traditional machine learning model and deep learning model were further proposed. Additionally, in terms of the limitations and possibilities of the development of artificial intelligence in craniopharyngioma diagnosis, this study discussed the attentions required in future research, including few-shot learning, imbalanced data set, semi-supervised models, and multi-omics fusion.

AI-Driven Image Analysis in Central Nervous System Tumors-Traditional Machine Learning, Deep Learning and Hybrid Models

The interpretation of imaging in medicine in general and in oncology specifically remains problematic due to several limitations which include the need to incorporate detailed clinical history, patient and disease-specific history, clinical exam features, previous and ongoing treatment, and account for the dependency on reproducible human interpretation of multiple factors with incomplete data linkage. To standardize reporting, minimize bias, expedite management, and improve outcomes, the use of Artificial Intelligence (AI) has gained significant prominence in imaging analysis. In oncology, AI methods have as a result been explored in most cancer types with ongoing progress in employing AI towards imaging for oncology treatment, assessing treatment response, and understanding and communicating prognosis. Challenges remain with limited available data sets, variability in imaging changes over time augmented by a growing heterogeneity in analysis approaches. We review the imaging analysis workflow and examine how hand-crafted features also referred to as traditional Machine Learning (ML), Deep Learning (DL) approaches, and hybrid analyses, are being employed in AI-driven imaging analysis in central nervous system tumors. ML, DL, and hybrid approaches coexist, and their combination may produce superior results although data in this space is as yet novel, and conclusions and pitfalls have yet to be fully explored. We note the growing technical complexities that may become increasingly separated from the clinic and enforce the acute need for clinician engagement to guide progress and ensure that conclusions derived from AI-driven imaging analysis reflect that same level of scrutiny lent to other avenues of clinical research.

[MR-guided non-invasive typing of brain gliomas using machine learning]

Gliomas are the most common neuroepithelial brain tumors. The modern classification of tumors of central nervous system and treatment approaches are based on tissue and molecular features of a particular neoplasm. Today, histological and molecular genetic typing of tumors can only be carried out through invasive procedures. In this regard, non-invasive preoperative diagnosis in neurooncology is appreclated. One of the perspective areas is artificial intelligence applied for neuroimaging to identify significant patterns associated with histological and molecular profiles of tumors and not obvlous for a specialist.

OBJECTIVE

To evaluate diagnostic accuracy of deep learning methods for glioma typing according to the 2007 WHO classification based on preoperative magnetic resonance imaging (MRI) data.

MATERIAL AND METHODS

The study included MR scans of patients with glial tumors undergoing neurosurgical treatment at the Burdenko National Medical Research Center for Neurosurgery. All patients underwent preoperative contrast-enhanced MRI. 2D and 3D MR scans were used for learning of artificial neural networks with two architectures (Resnest200e and DenseNet, respectively) in classifying tumors into 4 categories (WHO grades I-IV). Learning was provided on 80% of random examinations. Classification quality metrics were evaluated in other 20% of examinations (validation and test samples).

RESULTS

Analysis included 707 contrast-enhanced T1 welghted images. 3D classification based on DenseNet model showed the best result in predicting WHO tumor grade (accuracy 83%, AUC 0.95). Other authors reported similar results for other methods.

CONCLUSION

The first results of our study confirmed the fundamental possibility of grading axial contrast-enhanced T1 images according to the 2007 WHO classes using deep learning models.

[Artificial intelligence technologies in clinical neurooncology]

Neurooncology in the 21st century is a complex discipline integrating achievements of fundamental and applied neurosciences. Complex processes and data in clinical neurooncology determine the necessity for advanced methods of mathematical modeling and predictive analytics to obtain new scientific knowledge. Such methods are currently being developed in computer science (artificial intelligence). This review is devoted to potential and range of possible applications of artificial intelligence technologies in neurooncology with a special emphasis on glial tumors. Our conclusions may be valid for other areas of clinical medicine.

Deep neural network for the determination of transformed foci in Bhas 42 cell transformation assay

Bhas 42 cell transformation assay (CTA) has been used to estimate the carcinogenic potential of chemicals by exposing Bhas 42 cells to carcinogenic stimuli to form colonies, referred to as transformed foci, on the confluent monolayer. Transformed foci are classified and quantified by trained experts using morphological criteria. Although the assay has been certified by international validation studies and issued as a guidance document by OECD, this classification process is laborious, time consuming, and subjective. We propose using deep neural network to classify foci more rapidly and objectively. To obtain datasets, Bhas 42 CTA was conducted with a potent tumor promotor, 12-O-tetradecanoylphorbol-13-acetate, and focus images were classified by experts (1405 images in total). The labeled focus images were augmented with random image processing and used to train a convolutional neural network (CNN). The trained CNN exhibited an area under the curve score of 0.95 on a test dataset significantly outperforming conventional classifiers by beginners of focus judgment. The generalization performance of unknown chemicals was assessed by applying CNN to other tumor promotors exhibiting an area under the curve score of 0.87. The CNN-based approach could support the assay for carcinogenicity as a fundamental tool in focus scoring.

Machine learning-based Radiomics analysis for differentiation degree and lymphatic node metastasis of extrahepatic cholangiocarcinoma

Background

Radiomics may provide more objective and accurate predictions for extrahepatic cholangiocarcinoma (ECC). In this study, we developed radiomics models based on magnetic resonance imaging (MRI) and machine learning to preoperatively predict differentiation degree (DD) and lymph node metastasis (LNM) of ECC.

Methods

A group of 100 patients diagnosed with ECC was included. The ECC status of all patients was confirmed by pathology. A total of 1200 radiomics features were extracted from axial T1 weighted imaging (T1WI), T2-weighted imaging (T2WI), diffusion weighted imaging (DWI), and apparent diffusion coefficient (ADC) images. A systematical framework considering combinations of five feature selection methods and ten machine learning classification algorithms (classifiers) was developed and investigated. The predictive capabilities for DD and LNM were evaluated in terms of area under precision recall curve (AUPRC), area under the receiver operating characteristic (ROC) curve (AUC), negative predictive value (NPV), accuracy (ACC), sensitivity, and specificity. The prediction performance among models was statistically compared using DeLong test.

Results

For DD prediction, the feature selection method joint mutual information (JMI) and Bagging Classifier achieved the best performance (AUPRC = 0.65, AUC = 0.90 (95% CI 0.75–1.00), ACC = 0.85 (95% CI 0.69–1.00), sensitivity = 0.75 (95% CI 0.30–0.95), and specificity = 0.88 (95% CI 0.64–0.97)), and the radiomics signature was composed of 5 selected features. For LNM prediction, the feature selection method minimum redundancy maximum relevance and classifier eXtreme Gradient Boosting achieved the best performance (AUPRC = 0.95, AUC = 0.98 (95% CI 0.94–1.00), ACC = 0.90 (95% CI 0.77–1.00), sensitivity = 0.75 (95% CI 0.30–0.95), and specificity = 0.94 (95% CI 0.72–0.99)), and the radiomics signature was composed of 30 selected features. However, these two chosen models were not significantly different to other models of higher AUC values in DeLong test, though they were significantly different to most of all models.

Conclusion

MRI radiomics analysis based on machine learning demonstrated good predictive accuracies for DD and LNM of ECC. This shed new light on the noninvasive diagnosis of ECC.

Hierarchical-order multimodal interaction fusion network for grading gliomas

Significance. Gliomas are the most common type of primary brain tumors and have different grades. Accurate grading of a glioma is therefore significant for its clinical treatment planning and prognostic assessment with multiple-modality magnetic resonance imaging (MRI).Objective and Approach. In this study, we developed a noninvasive deep-learning method based on multimodal MRI for grading gliomas by focusing on effective multimodal fusion via leveraging collaborative and diverse high-order statistical information. Specifically, a novel high-order multimodal interaction module was designed to promote interactive learning of multimodal knowledge for more efficient fusion. For more powerful feature expression and feature correlation learning, the high-order attention mechanism is embedded in the interaction module for modeling complex and high-order statistical information to enhance the classification capability of the network. Moreover, we applied increasing orders at different levels to hierarchically recalibrate each modality stream through diverse-order attention statistics, thus encouraging all-sided attention knowledge with lesser parameters.Main results. To evaluate the effectiveness of the proposed scheme, extensive experiments were conducted on The Cancer Imaging Archive (TCIA) and Multimodal Brain Tumor Image Segmentation Benchmark 2017 (BraTS2017) datasets with five-fold cross validation to demonstrate that the proposed method can achieve high prediction performance, with area under the receiver operating characteristic curve, accuracy, sensitivity, and specificity values of 95.2%, 94.28%, 95.24%, and 92.00% on the BraTS2017 and 93.50%, 92.86%, 97.14%, and 90.48% on TCIA datasets, respectively.