Accuracy of Machine Learning Algorithms for the Classification of Molecular Features of Gliomas on MRI: A Systematic Literature Review and Meta-Analysis

Artificial Intelligence Performance in Image-Based Cancer Identification: Umbrella Review of Systematic Reviews

BACKGROUND

Artificial intelligence (AI) has the potential to transform cancer diagnosis, ultimately leading to better patient outcomes.

OBJECTIVE

We performed an umbrella review to summarize and critically evaluate the evidence for the AI-based imaging diagnosis of cancers.

METHODS

PubMed, Embase, Web of Science, Cochrane, and IEEE databases were searched for relevant systematic reviews from inception to June 19, 2024. Two independent investigators abstracted data and assessed the quality of evidence, using the Joanna Briggs Institute (JBI) Critical Appraisal Checklist for Systematic Reviews and Research Syntheses. We further assessed the quality of evidence in each meta-analysis by applying the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) criteria. Diagnostic performance data were synthesized narratively.

RESULTS

In a comprehensive analysis of 158 included studies evaluating the performance of AI algorithms in noninvasive imaging diagnosis across 8 major human system cancers, the accuracy of the classifiers for central nervous system cancers varied widely (ranging from 48% to 100%). Similarities were observed in the diagnostic performance for cancers of the head and neck, respiratory system, digestive system, urinary system, female-related systems, skin, and other sites. Most meta-analyses demonstrated positive summary performance. For instance, 9 reviews meta-analyzed sensitivity and specificity for esophageal cancer, showing ranges of 90%-95% and 80%-93.8%, respectively. In the case of breast cancer detection, 8 reviews calculated the pooled sensitivity and specificity within the ranges of 75.4%-92% and 83%-90.6%, respectively. Four meta-analyses reported the ranges of sensitivity and specificity in ovarian cancer, and both were 75%-94%. Notably, in lung cancer, the pooled specificity was relatively low, primarily distributed between 65% and 80%. Furthermore, 80.4% (127/158) of the included studies were of high quality according to the JBI Critical Appraisal Checklist, with the remaining studies classified as medium quality. The GRADE assessment indicated that the overall quality of the evidence was moderate to low.

CONCLUSIONS

Although AI shows great potential for achieving accelerated, accurate, and more objective diagnoses of multiple cancers, there are still hurdles to overcome before its implementation in clinical settings. The present findings highlight that a concerted effort from the research community, clinicians, and policymakers is required to overcome existing hurdles and translate this potential into improved patient outcomes and health care delivery.

TRIAL REGISTRATION

PROSPERO CRD42022364278; https://www.crd.york.ac.uk/PROSPERO/view/CRD42022364278.

Clusterin-mediated polarization of M2 macrophages: a mechanism of temozolomide resistance in glioblastoma stem cells

Glioblastoma remains one of the most lethal malignancies, largely due to its resistance to standard chemotherapy such as temozolomide. This study investigates a novel resistance mechanism involving glioblastoma stem cells (GSCs) and the polarization of M2-type macrophages, mediated by the extracellular vesicle (EV)-based transfer of Clusterin. Using 6-week-old male CD34+ humanized huHSC-(M-NSG) mice (NM-NSG-017) and glioblastoma cell lines (T98G and U251), we demonstrated that GSC-derived EVs enriched with Clusterin induce M2 macrophage polarization, thereby enhancing temozolomide resistance in glioblastoma cells. Single-cell and transcriptome sequencing revealed close interactions between GSCs and M2 macrophages, highlighting Clusterin as a key mediator. Our findings indicate that Clusterin-rich EVs from GSCs drive glioblastoma cell proliferation and resistance to temozolomide by modulating macrophage phenotypes. Targeting this pathway could potentially reverse resistance mechanisms, offering a promising therapeutic approach for glioblastoma. This study not only sheds light on a critical pathway underpinning glioblastoma resistance but also lays the groundwork for developing therapies targeting the tumor microenvironment. Our results suggest a paradigm shift in understanding glioblastoma resistance, emphasizing the therapeutic potential of disrupting EV-mediated communication in the tumor microenvironment.

Diagnostic Accuracy of Deep Learning Models in Predicting Glioma Molecular Markers: A Systematic Review and Meta-Analysis

Background/Objectives: Integrating deep learning (DL) into radiomics offers a noninvasive approach to predicting molecular markers in gliomas, a crucial step toward personalized medicine. This study aimed to assess the diagnostic accuracy of DL models in predicting various glioma molecular markers using MRI. Methods: Following PRISMA guidelines, we systematically searched PubMed, Scopus, Ovid, and Web of Science until 27 February 2024 for studies employing DL algorithms to predict gliomas' molecular markers from MRI sequences. The publications were assessed for the risk of bias, applicability concerns, and quality using the QUADAS-2 tool and the radiomics quality score (RQS). A bivariate random-effects model estimated pooled sensitivity and specificity, accounting for inter-study heterogeneity. Results: Of 728 articles, 43 were qualified for qualitative analysis, and 30 were included in the meta-analysis. In the validation cohorts, MGMT methylation had a pooled sensitivity of 0.74 (95% CI: 0.66-0.80) and a pooled specificity of 0.75 (95% CI: 0.65-0.82), both with significant heterogeneity (p = 0.00, I2 = 80.90-84.50%). ATRX and TERT mutations had a pooled sensitivity of 0.79 (95% CI: 0.67-0.87) and 0.81 (95% CI: 0.72-0.87) and a pooled specificity of 0.85 (95% CI: 0.78-0.91) and 0.70 (95% CI: 0.61-0.77), respectively. Meta-regression analyses revealed that significant heterogeneity was influenced by data sources, MRI sequences, feature extraction methods, and validation techniques. Conclusions: While the DL models show promising prediction accuracy for glioma molecular markers, variability in the study settings complicates clinical translation. To bridge this gap, future efforts should focus on harmonizing multi-center MRI datasets, incorporating external validation, and promoting open-source studies and data sharing.

Deep learning classification of MGMT status of glioblastomas using multiparametric MRI with a novel domain knowledge augmented mask fusion approach

We aimed to build a robust classifier for the MGMT methylation status of glioblastoma in multiparametric MRI. We focused on multi-habitat deep image descriptors as our basic focus. A subset of the BRATS 2021 MGMT methylation dataset containing both MGMT class labels and segmentation masks was used. A comprehensive mask fusion approach was developed to select relevant image crops of diseased tissue. These fusion masks, which were guided by multiple sequences, helped collect information from the regions that seem disease-free to radiologists in standard MRI sequences while harboring pathology. Integrating the information in different MRI sequences and leveraging the high entropic capacity of deep neural networks, we built a 3D ROI-based custom CNN classifier for the automatic prediction of MGMT methylation status of glioblastoma in multi-parametric MRI. Single sequence-based classifiers reached intermediate predictive performance with 0.65, 0.71, 0.77, and 0.82 accuracy for T1W, T2W, T1 contrast-enhanced, and FLAIR sequences, respectively. The multiparametric classifier using T1 contrast-enhanced and FLAIR images reached 0.88 accuracy. The accuracy of the four-input model that used all sequences was 0.81. The best model reached 0.90 ROC AUC value. Integrating human knowledge in the form of relevant target selection was a useful approach in MGMT methylation status prediction in MRI. Exploration of means to integrate radiology knowledge into the models and achieve human-machine collaboration may help to develop better models. MGMT methylation status of glioblastoma is an important prognostic marker and is also important for treatment decisions. The preoperative non-invasive predictive ability and the explanation tools of the developed model may help clinicians to better understand imaging phenotypes of MGMT methylation status of glial tumors.

Advancements in Machine Learning and Artificial Intelligence in the Radiological Detection of Pulmonary Embolism

Pulmonary embolism (PE) is a clinically challenging diagnosis that varies from silent to life-threatening symptoms. Timely diagnosis of the condition is subject to clinical assessment, D-dimer testing and radiological imaging. Computed tomography pulmonary angiogram (CTPA) is considered the gold standard imaging modality, although some cases can be missed due to reader dependency, resulting in adverse patient outcomes. Hence, it is crucial to implement faster and precise diagnostic strategies to help clinicians diagnose and treat PE patients promptly and mitigate morbidity and mortality. Machine learning (ML) and artificial intelligence (AI) are the newly emerging tools in the medical field, including in radiological imaging, potentially improving diagnostic efficacy. Our review of the studies showed that computer-aided design (CAD) and AI tools displayed similar to superior sensitivity and specificity in identifying PE on CTPA as compared to radiologists. Several tools demonstrated the potential in identifying minor PE on radiological scans showing promising ability to aid clinicians in reducing missed cases substantially. However, it is imperative to design sophisticated tools and conduct large clinical trials to integrate AI use in everyday clinical setting and establish guidelines for its ethical applicability. ML and AI can also potentially help physicians in formulating individualized management strategies to enhance patient outcomes.

Quality assessment of critical and non-critical domains of systematic reviews on artificial intelligence in gliomas using AMSTAR II: A systematic review

INTRODUCTION

Gliomas are the most common primary malignant intraparenchymal brain tumors with a dismal prognosis. With growing advances in artificial intelligence, machine learning and deep learning models are being utilized for preoperative, intraoperative and postoperative neurological decision-making. We aimed to compile published literature in one format and evaluate the quality of level 1a evidence currently available.

METHODOLOGY

Using PRISMA guidelines, a comprehensive literature search was conducted within databases including Medline, Scopus, and Cochrane Library, and records with the application of artificial intelligence in glioma management were included. The AMSTAR 2 tool was used to assess the quality of systematic reviews and meta-analyses by two independent researchers.

RESULTS

From 812 studies, 23 studies were included. AMSTAR II appraised most reviews as either low or critically low in quality. Most reviews failed to deliver in critical domains related to the exclusion of studies, appropriateness of meta-analytical methods, and assessment of publication bias. Similarly, compliance was lowest in non-critical areas related to study design selection and the disclosure of funding sources in individual records. Evidence is moderate to low in quality in reviews on multiple neuro-oncological applications, low quality in glioma diagnosis and individual molecular markers like MGMT promoter methylation status, IDH, and 1p19q identification, and critically low in tumor segmentation, glioma grading, and multiple molecular markers identification.

CONCLUSION

AMSTAR 2 is a robust tool to identify high-quality systematic reviews. There is a paucity of high-quality systematic reviews on the utility of artificial intelligence in glioma management, with some demonstrating critically low quality. Therefore, caution must be exercised when drawing inferences from these results.

Predicting IDH and ATRX mutations in gliomas from radiomic features with machine learning: a systematic review and meta-analysis

Objective

This systematic review aims to evaluate the quality and accuracy of ML algorithms in predicting ATRX and IDH mutation status in patients with glioma through the analysis of radiomic features extracted from medical imaging. The potential clinical impacts and areas for further improvement in non-invasive glioma diagnosis, classification and prognosis are also identified and discussed.

Methods

The review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic and Test Accuracy (PRISMA-DTA) statement. Databases including PubMed, Science Direct, CINAHL, Academic Search Complete, Medline, and Google Scholar were searched from inception to April 2024. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool was used to assess the risk of bias and applicability concerns. Additionally, meta-regression identified covariates contributing to heterogeneity before a subgroup meta-analysis was conducted. Pooled sensitivities, specificities and area under the curve (AUC) values were calculated for the prediction of ATRX and IDH mutations.

Results

Eleven studies involving 1,685 patients with grade I-IV glioma were included. Primary contributors to heterogeneity included the MRI modalities utilised (conventional only vs. combined) and the types of ML models employed. The meta-analysis revealed pooled sensitivities of 0.682 for prediction of ATRX loss and 0.831 for IDH mutations, specificities of 0.874 and 0.828, and AUC values of 0.842 and 0.948, respectively. Interestingly, incorporating semantics and clinical data, including patient demographics, improved the diagnostic performance of ML models.

Conclusions

The high AUC in the prediction of both mutations demonstrates an overall robust diagnostic performance of ML, indicating the potential for accurate, non-invasive diagnosis and precise prognosis. Future research should focus on integrating diverse data types, including advanced imaging, semantics and clinical data while also aiming to standardise the collection and integration of multimodal data. This approach will enhance clinical applicability and consistency.

Amide proton transfer weighted and diffusion weighted imaging based radiomics classification algorithm for predicting 1p/19q co-deletion status in low grade gliomas

BACKGROUND

1p/19q co-deletion in low-grade gliomas (LGG, World Health Organization grade II and III) is of great significance in clinical decision making. We aim to use radiomics analysis to predict 1p/19q co-deletion in LGG based on amide proton transfer weighted (APTw), diffusion weighted imaging (DWI), and conventional MRI.

METHODS

This retrospective study included 90 patients histopathologically diagnosed with LGG. We performed a radiomics analysis by extracting 8454 MRI-based features form APTw, DWI and conventional MR images and applied a least absolute shrinkage and selection operator (LASSO) algorithm to select radiomics signature. A radiomics score (Rad-score) was generated using a linear combination of the values of the selected features weighted for each of the patients. Three neuroradiologists, including one experienced neuroradiologist and two resident physicians, independently evaluated the MR features of LGG and provided predictions on whether the tumor had 1p/19q co-deletion or 1p/19q intact status. A clinical model was then constructed based on the significant variables identified in this analysis. A combined model incorporating both the Rad-score and clinical factors was also constructed. The predictive performance was validated by receiver operating characteristic curve analysis, DeLong analysis and decision curve analysis. P < 0.05 was statistically significant.

RESULTS

The radiomics model and the combined model both exhibited excellent performance on both the training and test sets, achieving areas under the curve (AUCs) of 0.948 and 0.966, as well as 0.909 and 0.896, respectively. These results surpassed the performance of the clinical model, which achieved AUCs of 0.760 and 0.766 on the training and test sets, respectively. After performing Delong analysis, the clinical model did not significantly differ in predictive performance from three neuroradiologists. In the training set, both the radiomic and combined models performed better than all neuroradiologists. In the test set, the models exhibited higher AUCs than the neuroradiologists, with the radiomics model significantly outperforming resident physicians B and C, but not differing significantly from experienced neuroradiologist.

CONCLUSIONS

Our results suggest that our algorithm can noninvasively predict the 1p/19q co-deletion status of LGG. The predictive performance of radiomics model was comparable to that of experienced neuroradiologist, significantly outperforming the diagnostic accuracy of resident physicians, thereby offering the potential to facilitate non-invasive 1p/19q co-deletion prediction of LGG.

AI-driven estimation of O6 methylguanine-DNA-methyltransferase (MGMT) promoter methylation in glioblastoma patients: a systematic review with bias analysis

BACKGROUND

Accurate and non-invasive estimation of MGMT promoter methylation status in glioblastoma (GBM) patients is of paramount clinical importance, as it is a predictive biomarker associated with improved overall survival (OS). In response to the clinical need, recent studies have focused on the development of non-invasive artificial intelligence (AI)-based methods for MGMT estimation. In this systematic review, we not only delve into the technical aspects of these AI-driven MGMT estimation methods but also emphasize their profound clinical implications. Specifically, we explore the potential impact of accurate non-invasive MGMT estimation on GBM patient care and treatment decisions.

METHODS

Employing a PRISMA search strategy, we identified 33 relevant studies from reputable databases, including PubMed, ScienceDirect, Google Scholar, and IEEE Explore. These studies were comprehensively assessed using 21 diverse attributes, encompassing factors such as types of imaging modalities, machine learning (ML) methods, and cohort sizes, with clear rationales for attribute scoring. Subsequently, we ranked these studies and established a cutoff value to categorize them into low-bias and high-bias groups.

RESULTS

By analyzing the 'cumulative plot of mean score' and the 'frequency plot curve' of the studies, we determined a cutoff value of 6.00. A higher mean score indicated a lower risk of bias, with studies scoring above the cutoff mark categorized as low-bias (73%), while 27% fell into the high-bias category.

CONCLUSION

Our findings underscore the immense potential of AI-based machine learning (ML) and deep learning (DL) methods in non-invasively determining MGMT promoter methylation status. Importantly, the clinical significance of these AI-driven advancements lies in their capacity to transform GBM patient care by providing accurate and timely information for treatment decisions. However, the translation of these technical advancements into clinical practice presents challenges, including the need for large multi-institutional cohorts and the integration of diverse data types. Addressing these challenges will be critical in realizing the full potential of AI in improving the reliability and accessibility of MGMT estimation while lowering the risk of bias in clinical decision-making.

Machine Intelligence in Cerebrovascular and Endovascular Neurosurgery

The advent of different realms of computational neurosurgery-including not only machine intelligence but also visualization techniques such as mixed reality and robotic applications-is beginning to impact both open vascular as well as endovascular neurosurgery. Especially in this relatively common patient population of often very fragile patients, with potential for devastating complications and clinical outcomes and sometimes highly complex pathologies, computer assistance could prove particularly useful. In this chapter, state-of-the-art applications of machine learning toward vascular patients are elucidated: Beginning from simple clinical diagnostic, prognostic, and predictive modeling, to the interpretation of medical imaging (radiomics, segmentation, and diagnostic assistance) and synthetic imaging (image modality conversion, super-resolution, and 2D-to-3D-synthesis), up to intraoperative applications of computer vision (robotic steering, rapid intraoperative histopathology, and anatomical and surgical phase recognition), and natural language processing (enabling model training and big data, documentation, and large language models)-this chapter provides a "tour de force" of machine intelligence in the realm of neurovascular medicine.

Systematic reviews of machine learning in healthcare: a literature review

INTRODUCTION

The increasing availability of data and computing power has made machine learning (ML) a viable approach to faster, more efficient healthcare delivery.

METHODS

A systematic literature review (SLR) of published SLRs evaluating ML applications in healthcare settings published between1 January 2010 and 27 March 2023 was conducted.

RESULTS

In total 220 SLRs covering 10,462 ML algorithms were reviewed. The main application of AI in medicine related to the clinical prediction and disease prognosis in oncology and neurology with the use of imaging data. Accuracy, specificity, and sensitivity were provided in 56%, 28%, and 25% SLRs respectively. Internal and external validation was reported in 53% and less than 1% of the cases respectively. The most common modeling approach was neural networks (2,454 ML algorithms), followed by support vector machine and random forest/decision trees (1,578 and 1,522 ML algorithms, respectively).

EXPERT OPINION

The review indicated considerable reporting gaps in terms of the ML's performance, both internal and external validation. Greater accessibility to healthcare data for developers can ensure the faster adoption of ML algorithms into clinical practice.

Noninvasive grading of glioma brain tumors using magnetic resonance imaging and deep learning methods

PURPOSE

Convolutional Neural Networks (ConvNets) have quickly become popular machine learning techniques in recent years, particularly in the classification and segmentation of medical images. One of the most prevalent types of brain cancers is glioma, and early, accurate diagnosis is essential for both treatment and survival. In this study, MRI scans were examined utilizing deep learning techniques to examine glioma diagnosis studies.

METHODS

In this systematic review, keywords were used to obtain English-language studies from the Arxiv, IEEE, Springer, ScienceDirect, and PubMed databases for the years 2010-2022. The material needed for review was then collected from the articles once they had been chosen based on the entry and exit criteria and in accordance with the research's goal.

RESULTS

Finally, 77 different academic articles were chosen. According to a study of published articles, glioma brain tumors were discovered, categorized, and segmented utilizing a coordinated approach that included image collecting, pre-processing, model design and execution, and model output evaluation. The majority of investigations have used publicly accessible photo databases and already-trained algorithms. The bulk of studies have employed Dice's classification accuracy and similarity coefficient metrics to assess model performance.

CONCLUSION

The results of this study indicate that glioma segmentation has received more attention from researchers than glioma detection and classification. It is advised that more research be done in the areas of glioma detection and, particularly, grading in order to be included in systems that support medical diagnosis.

Advances in diffuse glial tumors diagnosis

In recent decades, there have been significant advances in the diagnosis of diffuse gliomas, driven by the integration of novel technologies. These advancements have deepened our understanding of tumor oncogenesis, enabling a more refined stratification of the biological behavior of these neoplasms. This progress culminated in the fifth edition of the WHO classification of central nervous system (CNS) tumors in 2021. This comprehensive review article aims to elucidate these advances within a multidisciplinary framework, contextualized within the backdrop of the new classification. This article will explore morphologic pathology and molecular/genetics techniques (immunohistochemistry, genetic sequencing, and methylation profiling), which are pivotal in diagnosis, besides the correlation of structural neuroimaging radiophenotypes to pathology and genetics. It briefly reviews the usefulness of tractography and functional neuroimaging in surgical planning. Additionally, the article addresses the value of other functional imaging techniques such as perfusion MRI, spectroscopy, and nuclear medicine in distinguishing tumor progression from treatment-related changes. Furthermore, it discusses the advantages of evolving diagnostic techniques in classifying these tumors, as well as their limitations in terms of availability and utilization. Moreover, the expanding domains of data processing, artificial intelligence, radiomics, and radiogenomics hold great promise and may soon exert a substantial influence on glioma diagnosis. These innovative technologies have the potential to revolutionize our approach to these tumors. Ultimately, this review underscores the fundamental importance of multidisciplinary collaboration in employing recent diagnostic advancements, thereby hoping to translate them into improved quality of life and extended survival for glioma patients.

Performance of deep learning algorithms to distinguish high-grade glioma from low-grade glioma: A systematic review and meta-analysis

This study aims to evaluate deep learning (DL) performance in differentiating low- and high-grade glioma. Search online database for studies continuously published from 1st January 2015 until 16th August 2022. The random-effects model was used for synthesis, based on pooled sensitivity (SE), specificity (SP), and area under the curve (AUC). Heterogeneity was estimated using the Higgins inconsistency index (I²). 33 were ultimately included in the meta-analysis. The overall pooled SE and SP were 94% and 93%, with an AUC of 0.98. There was great heterogeneity in this field. Our evidence-based study shows DL achieves high accuracy in glioma grading. Subgroup analysis reveals several limitations in this field: 1) Diagnostic trials require standard method for data merging for AI; 2) small sample size; 3) poor-quality image preprocessing; 4) not standard algorithm development; 5) not standard data report; 6) different definition of HGG and LGG; and 7) poor extrapolation.

Diagnostic performance of magnetic resonance imaging-based machine learning in Alzheimer's disease detection: a meta-analysis

PURPOSE

Advanced machine learning (ML) algorithms can assist rapid medical image recognition and realize automatic, efficient, noninvasive, and convenient diagnosis. We aim to further evaluate the diagnostic performance of ML to distinguish patients with probable Alzheimer's disease (AD) from normal older adults based on structural magnetic resonance imaging (MRI).

METHODS

The Medline, Embase, and Cochrane Library databases were searched for relevant literature published up until July 2021. We used the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool and Checklist for Artificial Intelligence in Medical Imaging (CLAIM) to evaluate all included studies' quality and potential bias. Random-effects models were used to calculate pooled sensitivity and specificity, and the Deeks' test was used to assess publication bias.

RESULTS

We included 24 models based on different brain features extracted by ML algorithms in 19 papers. The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio, and area under the summary receiver operating characteristic curve for ML in detecting AD were 0.85 (95%CI 0.81-0.89), 0.88 (95%CI 0.84-0.91), 7.15 (95%CI 5.40-9.47), 0.17 (95%CI 0.12-0.22), 43.34 (95%CI 26.89-69.84), and 0.93 (95%CI 0.91-0.95).

CONCLUSION

ML using structural MRI data performed well in diagnosing probable AD patients and normal elderly. However, more high-quality, large-scale prospective studies are needed to further enhance the reliability and generalizability of ML for clinical applications before it can be introduced into clinical practice.

Challenges and opportunities for advanced neuroimaging of glioblastoma

Glioblastoma is the most aggressive of glial tumours in adults. On conventional magnetic resonance (MR) imaging, these tumours are observed as irregular enhancing lesions with areas of infiltrating tumour and cortical expansion. More advanced imaging techniques including diffusion-weighted MRI, perfusion-weighted MRI, MR spectroscopy and positron emission tomography (PET) imaging have found widespread application to diagnostic challenges in the setting of first diagnosis, treatment planning and follow-up. This review aims to educate readers with regard to the strengths and weaknesses of the clinical application of these imaging techniques. For example, this review shows that the (semi)quantitative analysis of the mentioned advanced imaging tools was found useful for assessing tumour aggressiveness and tumour extent, and aids in the differentiation of tumour progression from treatment-related effects. Although these techniques may aid in the diagnostic work-up and (post-)treatment phase of glioblastoma, so far no unequivocal imaging strategy is available. Furthermore, the use and further development of artificial intelligence (AI)-based tools could greatly enhance neuroradiological practice by automating labour-intensive tasks such as tumour measurements, and by providing additional diagnostic information such as prediction of tumour genotype. Nevertheless, due to the fact that advanced imaging and AI-diagnostics is not part of response assessment criteria, there is no harmonised guidance on their use, while at the same time the lack of standardisation severely hampers the definition of uniform guidelines.

Deep learning for prediction of isocitrate dehydrogenase mutation in gliomas: a critical approach, systematic review and meta-analysis of the diagnostic test performance using a Bayesian approach

Background

Conventionally, identifying isocitrate dehydrogenase (IDH) mutation in gliomas is based on histopathological analysis of tissue specimens acquired via stereotactic biopsy or definitive resection. Accurate pre-treatment prediction of IDH mutation status using magnetic resonance imaging (MRI) can guide clinical decision-making. We aim to evaluate the diagnostic performance of deep learning (DL) to determine IDH mutation status in gliomas.

Methods

A systematic search of Cochrane Library, Web of Science, Medline, and Scopus was conducted to identify relevant publications until August 1, 2021. Articles were included if all the following criteria were met: (I) patients with histopathologically confirmed World Health Organization (WHO) grade II, III, or IV gliomas; (II) histopathological examination with the IDH mutation; (III) DL was used to predict the IDH mutation status; (IV) sufficient data for reconstruction of confusion matrices in terms of the diagnostic performance of the DL algorithms; and (V) original research articles. Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) and Checklist for Artificial Intelligence in Medical Imaging (CLAIM) was used to assess the studies' quality. Bayes theorem was utilized to calculate the posttest probability.

Results

Four studies with a total of 1,295 patients were included. In the training set, the pooled sensitivity, specificity, and area under the summary receiver operating characteristic (SROC) curve were 93.9%, 90.9% and 0.958, respectively. In the validation set, the pooled sensitivity, specificity, and area under the SROC curve were 90.8%, 85.5% and 0.939, respectively. With a known pretest probability of 80.2%, the Bayes theorem yielded a posttest probability of 97.6% and 96.0% for a positive test and 27.0% and 30.6% for a negative test for training sets and validation sets, respectively.

Discussion

This is the first meta-analysis that summarizes the diagnostic performance of DL in predicting IDH mutation status in gliomas via the Bayes theorem. DL algorithms demonstrate excellent diagnostic performance in predicting IDH mutation in gliomas. Radiomic features associated with IDH mutation, and its underlying pathophysiology extracted from advanced MRI may improve prediction probability. However, more studies are required to optimize and increase its reliability. Limitations include obtaining some data via email and lack of training and test sets statistics.

Diagnostic Accuracy of Machine Learning Models on Mammography in Breast Cancer Classification: A Meta-Analysis

In this meta-analysis, we aimed to estimate the diagnostic accuracy of machine learning models on digital mammograms and tomosynthesis in breast cancer classification and to assess the factors affecting its diagnostic accuracy. We searched for related studies in Web of Science, Scopus, PubMed, Google Scholar and Embase. The studies were screened in two stages to exclude the unrelated studies and duplicates. Finally, 36 studies containing 68 machine learning models were included in this meta-analysis. The area under the curve (AUC), hierarchical summary receiver operating characteristics (HSROC) curve, pooled sensitivity and pooled specificity were estimated using a bivariate Reitsma model. Overall AUC, pooled sensitivity and pooled specificity were 0.90 (95% CI: 0.85-0.90), 0.83 (95% CI: 0.78-0.87) and 0.84 (95% CI: 0.81-0.87), respectively. Additionally, the three significant covariates identified in this study were country (p = 0.003), source (p = 0.002) and classifier (p = 0.016). The type of data covariate was not statistically significant (p = 0.121). Additionally, Deeks' linear regression test indicated that there exists a publication bias in the included studies (p = 0.002). Thus, the results should be interpreted with caution.

Reliability of dynamic susceptibility contrast perfusion metrics in pre- and post-treatment glioma

Background

In neuro-oncology, dynamic susceptibility contrast magnetic resonance (DSC-MR) perfusion imaging emerged as a tool to aid in the diagnostic work-up and to surveil effectiveness of treatment. However, it is believed that a significant variability exists with regard to the measured in DSC-MR perfusion parameters. The aim of this study was to assess the observer variability in measured DSC-MR perfusion parameters in patients before and after treatment. In addition, we investigated whether region-of-interest (ROI) shape impacted the observer variability.

Materials and methods

Twenty non-treated patients and a matched group of twenty patients post-treatment (neurosurgical resection and post-chemoradiotherapy) were included. Six ROIs were independently placed by three readers: circular ROIs and polygonal ROIs covering 1) the tumor hotspot; 2) the peritumoral region (T2/FLAIR-hyperintense region) and 3) the whole tumor region. A two-way random Intra-class coefficient (ICC) model was used to assess variability in measured DSC-MRI perfusion parameters. The perfusion metrics as assessed by the circular and the polygonal ROI were compared by use of the dependent T-test.

Results

In the non-treated group, circular ROIs showed good–excellent overlap (ICC-values ranging from 0.741–0.963) with the exception of those representing the tumor hotspot. Polygonal ROIs showed lower ICC-values, ranging from 0.113 till 0.856. ROI-placement in the posttreatment group showed to be highly variable with a significant deterioration of ICC-values. Furthermore, perfusion metric assessment in similar tumor regions was not impacted by ROI shape.

Discussion

This study shows that posttreatment quantitative interpretation of DSC-MR perfusion imaging is highly variable and should be carried out with precaution. Pretreatment assessment of DSC-MR images, however, could be carried out be a single reader in order to provide valid data for further analyses.

• DSC-MR perfusion imaging measurements in non-treated glioma is highly reliable between readers, even readers with little experience.

• DSC-MR perfusion imaging measurements in treated glioma is show to be inconsistent between readers.

• When using DSC-MR perfusion imaging as a quantitative surveillance tool for the recurrence of glioma after treatment, double-reading should be preferred.

A systematic review and meta-analysis on the differentiation of glioma grade and mutational status by use of perfusion-based magnetic resonance imaging

Background

Molecular characterization plays a crucial role in glioma classification which impacts treatment strategy and patient outcome. Dynamic susceptibility contrast (DSC) and dynamic contrast enhanced (DCE) perfusion imaging have been suggested as methods to help characterize glioma in a non-invasive fashion. This study set out to review and meta-analyze the evidence on the accuracy of DSC and/or DCE perfusion MRI in predicting IDH genotype and 1p/19q integrity status.

Methods

After systematic literature search on Medline, EMBASE, Web of Science and the Cochrane Library, a qualitative meta-synthesis and quantitative meta-analysis were conducted. Meta-analysis was carried out on aggregated AUC data for different perfusion metrics.

Results

Of 680 papers, twelve were included for the qualitative meta-synthesis, totaling 1384 patients. It was observed that CBV, ktrans, Ve and Vp values were, in general, significantly higher in IDH wildtype compared to IDH mutated glioma. Meta-analysis comprising of five papers (totaling 316 patients) showed that the AUC of CBV, ktrans, Ve and Vp were 0.85 (95%-CI 0.75–0.93), 0.81 (95%-CI 0.74–0.89), 0.84 (95%-CI 0.71–0.97) and 0.76 (95%-CI 0.61–0.90), respectively. No conclusive data on the prediction of 1p/19q integrity was available from these studies.

Conclusions

Future research should aim to predict 1p/19q integrity based on perfusion MRI data. Additionally, correlations with other clinically relevant outcomes should be further investigated, including patient stratification for treatment and overall survival.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13244-022-01230-7.

Gaps and Opportunities of Artificial Intelligence Applications for Pediatric Oncology in European Research: A Systematic Review of Reviews and a Bibliometric Analysis

The application of artificial intelligence (AI) systems is emerging in many fields in recent years, due to the increased computing power available at lower cost. Although its applications in various branches of medicine, such as pediatric oncology, are many and promising, its use is still in an embryonic stage. The aim of this paper is to provide an overview of the state of the art regarding the AI application in pediatric oncology, through a systematic review of systematic reviews, and to analyze current trends in Europe, through a bibliometric analysis of publications written by European authors. Among 330 records found, 25 were included in the systematic review. All papers have been published since 2017, demonstrating only recent attention to this field. The total number of studies included in the selected reviews was 674, with a third including an author with a European affiliation. In bibliometric analysis, 304 out of the 978 records found were included. Similarly, the number of publications began to dramatically increase from 2017. Most explored AI applications regard the use of diagnostic images, particularly radiomics, as well as the group of neoplasms most involved are the central nervous system tumors. No evidence was found regarding the use of AI for process mining, clinical pathway modeling, or computer interpreted guidelines to improve the healthcare process. No robust evidence is yet available in any of the domains investigated by systematic reviews. However, the scientific production in Europe is significant and consistent with the topics covered in systematic reviews at the global level. The use of AI in pediatric oncology is developing rapidly with promising results, but numerous gaps and challenges persist to validate its utilization in clinical practice. An important limitation is the need for large datasets for training algorithms, calling for international collaborative studies.

Artificial Intelligence in Brain Tumour Surgery-An Emerging Paradigm

Artificial intelligence (AI) platforms have the potential to cause a paradigm shift in brain tumour surgery. Brain tumour surgery augmented with AI can result in safer and more effective treatment. In this review article, we explore the current and future role of AI in patients undergoing brain tumour surgery, including aiding diagnosis, optimising the surgical plan, providing support during the operation, and better predicting the prognosis. Finally, we discuss barriers to the successful clinical implementation, the ethical concerns, and we provide our perspective on how the field could be advanced.