A systematic review reporting quality of radiomics research in neuro-oncology: toward clinical utility and quality improvement using high-dimensional imaging features

The Quality and Accuracy of Radiomics Model in Diagnosing Osteoporosis: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

The purpose of this study is to conduct a meta-analysis to evaluate the diagnostic performance of current radiomics models for diagnosing osteoporosis, as well as to assess the methodology and reporting quality of these radiomics studies.

METHODS

According to PRISMA guidelines, four databases including MEDLINE, Web of Science, Embase and the Cochrane Library were searched systematically to select relevant studies published before July 18, 2024. The articles that used radiomics models for diagnosing osteoporosis were considered eligible. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool and radiomics quality score (RQS) were used to assess the quality of included studies. The pooled diagnostic odds ratio (DOR), sensitivity, specificity, area under the summary receiver operator characteristic curve (AUC) were calculated to estimated diagnostic efficiency of pooled model.

RESULTS

A total of 25 studies were included, of which 24 provided usable data that were utilized for the meta-analysis, including 1553 patients with osteoporosis and 2200 patients without osteoporosis. The mean RQS score of included studies was 11.48 ± 4.92, with an adherence rate of 31.89%. The pooled DOR, sensitivity and specificity for model to diagnose osteoporosis were 81.72 (95% CI: 51.08 - 130.73), 0.90 (95% CI: 0.87-0.93) and 0.90 (95% CI: 0.87-0.93), respectively. The AUC was 0.96, indicating a high diagnostic capability. Subgroup analysis revealed that the use of different imaging modalities to construct radiomics models might be one source of heterogeneity. Radiomics models built using CT images and deep learning algorithms demonstrated higher diagnostic accuracy for osteoporosis.

CONCLUSION

Radiomics models for the diagnosis of osteoporosis have high diagnostic efficacy. In the future, radiomics models for diagnosing osteoporosis will be an efficient instrument to assist clinical doctors in screening osteoporosis patients. However, relevant guidelines should be followed strictly to improve the quality of radiomics studies.

Radiomics of the Paranasal Sinuses: A Systematic Review of Computer-Assisted Techniques to Assess Computed Tomography Radiological Data

BACKGROUND

Radiomics is a quantitative approach to medical imaging, aimed to extract features into large datasets. By using artificial intelligence (AI) methodologies, large radiomic data can be analysed and translated into meaningful clinical applications. In rhinology, there is heavy reliance on computed tomography (CT) imaging of the paranasal sinus for diagnostics and assessment of treatment outcomes. Currently, there is an emergence of literature detailing radiomics use in rhinology.

OBJECTIVE

This systematic review aims to assess the current techniques used to analyze radiomic data from paranasal sinus CT imaging.

METHODS

A systematic search was performed using Ovid MEDLINE and EMBASE databases from January 1, 2019 until March 16, 2024 using the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) checklist and Cochrane Library Systematic Reviews for Diagnostic and Prognostic Studies. The QUADAS-2 and PROBAST tools were utilized to assess risk of bias.

RESULTS

Our search generated 1456 articles with 10 articles meeting eligibility criteria. Articles were divided into 2 categories, diagnostic (n = 7) and prognostic studies (n = 3). The number of radiomic features extracted ranged 4 to 1409, with analysis including non-AI-based statistical analyses (n = 3) or machine learning algorithms (n = 7). The diagnostic or prognostic utility of radiomics analyses were rated as excellent (n = 3), very good (n = 2), good (n = 2), or not reported (n = 3) based upon area under the curve receiver operating characteristic (AUC-ROC) or accuracy. The average radiomics quality score was 36.95%.

CONCLUSION

Radiomics is an evolving field which can augment our understanding of rhinology diseases, however there are currently only minimal quality studies with limited clinical utility.

Integrating ultrasound radiomics and clinicopathological features for machine learning-based survival prediction in patients with nonmetastatic triple-negative breast cancer

OBJECTIVE

This study aimed to evaluate the predictive value of implementing machine learning models based on ultrasound radiomics and clinicopathological features in the survival analysis of triple-negative breast cancer (TNBC) patients.

METHODS AND MATERIALS

All patients, including retrospective cohort (training cohort, n = 306; internal validation cohort, n = 77) and prospective external validation cohort (n = 82), were diagnosed as locoregional TNBC and underwent pre-intervention sonographic evaluation in this multi-center study. A thorough chart review was conducted for each patient to collect clinicopathological and sonographic features, and ultrasound radiomics features were obtained by PyRadiomics. Deep learning algorithms were utilized to delineate ROIs on ultrasound images. Radiomics analysis pipeline modules were developed for analyzing features. Radiomic scores, clinical scores, and combined nomograms were analyzed to predict 2-year, 3-year, and 5-year overall survival (OS) and disease-free survival (DFS). Receiver operating characteristic (ROC) curves, calibration curves, and decision curves were used to evaluate the prediction performance.

FINDINGS

Both clinical and radiomic scores showed good performance for overall survival and disease-free survival prediction in internal (median AUC of 0.82 and 0.72 respectively) and external validation (median AUC of 0.70 and 0.74 respectively). The combined nomograms had AUCs of 0.80-0.93 and 0.73-0.89 in the internal and external validation, which had best predictive performance in all tasks (p < 0.05), especially for 5-year OS (p < 0.01). For the overall evaluation of six tasks, combined models obtained better performance than clinical and radiomic scores [AUCs of 0.83 (0.73,0.93), 0.81 (0.72,0.93), and 0.70 (0.61,0.85) respectively].

INTERPRETATION

The combined nomograms based on pre-intervention ultrasound radiomics and clinicopathological features demonstrated exemplary performance in survival analysis. The new models may allow us to non-invasively classify TNBC patients with various disease outcome.

Recurrence-free survival prediction for anal squamous cell carcinoma after chemoradiotherapy using planning CT-based radiomics model

OBJECTIVES

Approximately 30% of non-metastatic anal squamous cell carcinoma (ASCC) patients will experience recurrence after chemoradiotherapy (CRT), and currently available clinical variables are poor predictors of treatment response. We aimed to develop a model leveraging information extracted from radiation pretreatment planning CT to predict recurrence-free survival (RFS) in ASCC patients after CRT.

METHODS

Radiomics features were extracted from planning CT images of 96 ASCC patients. Following pre-feature selection, the optimal feature set was selected via step-forward feature selection with a multivariate Cox proportional hazard model. The RFS prediction was generated from a radiomics-clinical combined model based on an optimal feature set with 5 repeats of nested 5-fold cross validation. The risk stratification ability of the proposed model was evaluated with Kaplan-Meier analysis.

RESULTS

Shape- and texture-based radiomics features significantly predicted RFS. Compared to a clinical-only model, radiomics-clinical combined model achieves better performance in the testing cohort with higher concordance index (0.80 vs 0.73) and AUC (0.84 vs 0.78 for 1-year RFS, 0.84 vs 0.79 for 2-year RFS, and 0.85 vs 0.81 for 3-year RFS), leading to distinctive high- and low-risk of recurrence groups (P < .001).

CONCLUSIONS

A treatment planning CT based radiomics and clinical combined model had improved prognostic performance in predicting RFS for ASCC patients treated with CRT as compared to a model using clinical features only.

ADVANCES IN KNOWLEDGE

The use of radiomics from planning CT is promising in assisting in personalized management in ASCC. The study outcomes support the role of planning CT-based radiomics as potential imaging biomarker.

Update report on the quality of gliomas radiomics: An integration of bibliometric and radiomics quality score

BACKGROUND

Despite the increasing number of publications on glioma radiomics, challenges persist in clinical translation.

AIM

To assess the development and reporting quality of radiomics in brain gliomas since 2019.

METHODS

A bibliometric analysis was conducted to reveal trends in brain glioma radiomics research. The Radiomics Quality Score (RQS), a metric for evaluating the quality of radiomics studies, was applied to assess the quality of adult-type diffuse glioma studies published since 2019. The total RQS score and the basic adherence rate for each item were calculated. Subgroup analysis by journal type and research objective was performed, correlating the total RQS score with journal impact factors.

RESULTS

The radiomics research in glioma was initiated in 2011 and has witnessed a surge since 2019. Among the 260 original studies, the median RQS score was 11, correlating with a basic compliance rate of 46.8%. Subgroup analysis revealed significant differences in domain 1 and its subitems (multiple segmentations) across journal types (P = 0.039 and P = 0.03, respectively). The Spearman correlation coefficients indicated that the total RQS score had a negative correlation with the Journal Citation Report category (-0.69) and a positive correlation with the five-year impact factors (0.318) of journals.

CONCLUSION

Glioma radiomics research quality has improved since 2019 but necessitates further advancement with higher publication standards.

-New frontiers in domain-inspired radiomics and radiogenomics: increasing role of molecular diagnostics in CNS tumor classification and grading following WHO CNS-5 updates

Gliomas and Glioblastomas represent a significant portion of central nervous system (CNS) tumors associated with high mortality rates and variable prognosis. In 2021, the World Health Organization (WHO) updated its Glioma classification criteria, most notably incorporating molecular markers including CDKN2A/B homozygous deletion, TERT promoter mutation, EGFR amplification, + 7/-10 chromosome copy number changes, and others into the grading and classification of adult and pediatric Gliomas. The inclusion of these markers and the corresponding introduction of new Glioma subtypes has allowed for more specific tailoring of clinical interventions and has inspired a new wave of Radiogenomic studies seeking to leverage medical imaging information to explore the diagnostic and prognostic implications of these new biomarkers. Radiomics, deep learning, and combined approaches have enabled the development of powerful computational tools for MRI analysis correlating imaging characteristics with various molecular biomarkers integrated into the updated WHO CNS-5 guidelines. Recent studies have leveraged these methods to accurately classify Gliomas in accordance with these updated molecular-based criteria based solely on non-invasive MRI, demonstrating the great promise of Radiogenomic tools. In this review, we explore the relative benefits and drawbacks of these computational frameworks and highlight the technical and clinical innovations presented by recent studies in the landscape of fast evolving molecular-based Glioma subtyping. Furthermore, the potential benefits and challenges of incorporating these tools into routine radiological workflows, aiming to enhance patient care and optimize clinical outcomes in the evolving field of CNS tumor management, have been highlighted.

Cone beam computed tomography (CBCT) and megavoltage computed tomography (MVCT)-based radiomics in head and neck cancers: a systematic review and radiomics quality score assessment

Background

Cone beam computed tomography (CBCT) and megavoltage computed tomography (MVCT)-based images demonstrate measurable radiomics features that are potentially prognostic. This study aims to systematically synthesize the current research applying radiomics in head and neck cancers for outcome prediction and to assess the radiomics quality score (RQS) of the studies.

Methods

A systematic search was performed to identify available studies on PubMed, Web of Science, and Scopus databases. Studies related to radiomics in oncology/radiotherapy fields and based on predefined Patient, Intervention, Comparator, Outcome, and Study design (PICOS) criteria were included. The methodological quality of the included study was evaluated independently by two reviewers according to the RQS. The Mann-Whitney U test was performed according to subgroups. The P values <0.05 were considered statistically significant. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 reporting guidelines were adhered to.

Results

From a total of 743 identified studies, six original studies were eligible for inclusion in the systematic review (median =97 patients). The intraclass correlation coefficient (ICC) for inter-reviewer on total RQS was excellent with 0.99 [95% confidence interval (CI) of 0.946< ICC <0.999]. There were no significant differences in the analyses between each RQS domain and subgroup components (P always >0.05). Numerically higher RQS domains score for publication year ≤2022 than 2023 and number of patients > median than ≤ median but not statistically significant.

Conclusions

The number of radiomics studies involving CBCT and MVCT is still very limited. Self-reported RQS assessments should be encouraged for all radiomics studies.

The prognostic role of MRI-based radiomics in tongue carcinoma: a multicentric validation study

PURPOSE

Radiomics is an emerging field that utilizes quantitative features extracted from medical images to predict clinically meaningful outcomes. Validating findings is crucial to assess radiomics applicability. We aimed to validate previously published magnetic resonance imaging (MRI) radiomics models to predict oncological outcomes in oral tongue squamous cell carcinoma (OTSCC).

MATERIALS AND METHODS

Retrospective multicentric study on OTSCC surgically treated from 2010 to 2019. All patients performed preoperative MRI, including contrast-enhanced T1-weighted (CE-T1), diffusion-weighted sequences and apparent diffusion coefficient map. We evaluated overall survival (OS), locoregional recurrence-free survival (LRRFS), cause-specific mortality (CSM). We elaborated different models based on clinical and radiomic data. C-indexes assessed the prediction accuracy of the models.

RESULTS

We collected 112 consecutive independent patients from three Italian Institutions to validate the previously published MRI radiomic models based on 79 different patients. The C-indexes for the hybrid clinical-radiomic models in the validation cohort were lower than those in the training cohort but remained > 0.5 in most cases. CE-T1 sequence provided the best fit to the models: the C-indexes obtained were 0.61, 0.59, 0.64 (pretreatment model) and 0.65, 0.69, 0.70 (posttreatment model) for OS, LRRFS and CSM, respectively.

CONCLUSION

Our clinical-radiomic models retain a potential to predict OS, LRRFS and CSM in heterogeneous cohorts across different centers. These findings encourage further research, aimed at overcoming current limitations, due to the variability of imaging acquisition, processing and tumor volume delineation.

Quality assessment of the MRI-radiomics studies for MGMT promoter methylation prediction in glioma: a systematic review and meta-analysis

OBJECTIVES

To evaluate the methodological quality and diagnostic accuracy of MRI-based radiomic studies predicting O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation status in gliomas.

METHODS

PubMed Medline, EMBASE, and Web of Science were searched to identify MRI-based radiomic studies on MGMT methylation in gliomas published until December 31, 2022. Three raters evaluated the study methodological quality with Radiomics Quality Score (RQS, 16 components) and Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis Or Diagnosis (TRIPOD, 22 items) scales. Risk of bias and applicability concerns were assessed with QUADAS-2 tool. A meta-analysis was performed to estimate the pooled area under the curve (AUC) and to assess inter-study heterogeneity.

RESULTS

We included 26 studies, published from 2016. The median RQS total score was 8 out of 36 (22%, range 8-44%). Thirteen studies performed external validation. All studies reported AUC or accuracy, but only 4 (15%) performed calibration and decision curve analysis. No studies performed phantom analysis, cost-effectiveness analysis, and prospective validation. The overall TRIPOD adherence score was between 50% and 70% in 16 studies and below 50% in 10 studies. The pooled AUC was 0.78 (95% CI, 0.73-0.83, I2 = 94.1%) with a high inter-study heterogeneity. Studies with external validation and including only WHO-grade IV gliomas had significantly lower AUC values (0.65; 95% CI, 0.57-0.73, p < 0.01).

CONCLUSIONS

Study RQS and adherence to TRIPOD guidelines was generally low. Radiomic prediction of MGMT methylation status showed great heterogeneity of results and lower performances in grade IV gliomas, which hinders its current implementation in clinical practice.

CLINICAL RELEVANCE STATEMENT

MGMT promoter methylation status appears to be variably correlated with MRI radiomic features; radiomic models are not sufficiently robust to be integrated into clinical practice to accurately predict MGMT promoter methylation status in patients with glioma before surgery.

KEY POINTS

• Adherence to the indications of TRIPOD guidelines was generally low, as was RQS total score. • MGMT promoter methylation status prediction with MRI radiomic features provided heterogeneous diagnostic accuracy results across studies. • Studies that included grade IV glioma only and performed external validation had significantly lower diagnostic accuracy than others.

Self-reported checklists and quality scoring tools in radiomics: a meta-research

OBJECTIVE

To evaluate the use of reporting checklists and quality scoring tools for self-reporting purposes in radiomics literature.

METHODS

Literature search was conducted in PubMed (date, April 23, 2023). The radiomics literature was sampled at random after a sample size calculation with a priori power analysis. A systematic assessment for self-reporting, including the use of documentation such as completed checklists or quality scoring tools, was conducted in original research papers. These eligible papers underwent independent evaluation by a panel of nine readers, with three readers assigned to each paper. Automatic annotation was used to assist in this process. Then, a detailed item-by-item confirmation analysis was carried out on papers with checklist documentation, with independent evaluation of two readers.

RESULTS

The sample size calculation yielded 117 papers. Most of the included papers were retrospective (94%; 110/117), single-center (68%; 80/117), based on their private data (89%; 104/117), and lacked external validation (79%; 93/117). Only seven papers (6%) had at least one self-reported document (Radiomics Quality Score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD), or Checklist for Artificial Intelligence in Medical Imaging (CLAIM)), with a statistically significant binomial test (p < 0.001). Median rate of confirmed items for all three documents was 81% (interquartile range, 6). For quality scoring tools, documented scores were higher than suggested scores, with a mean difference of - 7.2 (standard deviation, 6.8).

CONCLUSION

Radiomic publications often lack self-reported checklists or quality scoring tools. Even when such documents are provided, it is essential to be cautious, as the accuracy of the reported items or scores may be questionable.

CLINICAL RELEVANCE STATEMENT

Current state of radiomic literature reveals a notable absence of self-reporting with documentation and inaccurate reporting practices. This critical observation may serve as a catalyst for motivating the radiomics community to adopt and utilize such tools appropriately, thereby fostering rigor, transparency, and reproducibility of their research, moving the field forward.

KEY POINTS

• In radiomics literature, there has been a notable absence of self-reporting with documentation. • Even if such documents are provided, it is critical to exercise caution because the accuracy of the reported items or scores may be questionable. • Radiomics community needs to be motivated to adopt and appropriately utilize the reporting checklists and quality scoring tools.

Radiomics Studies on Ischemic Stroke and Carotid Atherosclerotic Disease: A Reporting Quality Assessment

Objective: To assess the reporting quality of radiomics studies on ischemic stroke, intracranial and carotid atherosclerotic disease using the Image Biomarker Standardization Initiative (IBSI) reporting guidelines with the aim of finding avenues of improvement for future publications. Method: PubMed database was searched to identify relevant radiomics studies. Of 560 articles, 41 original research articles were included in this analysis. Based on IBSI radiomics reporting guidelines, checklists for CT-based and MRI-based studies were created to allow a structured and comprehensive evaluation of each study's adherence to these guidelines. Results: The main topics covered included radiomics studies were ischemic stroke, intracranial artery disease, and carotid atherosclerotic disease. The reporting checklist median score was 17/40 for the 20 CT-based radiomics studies and 22.5/50 for the 20 MRI-based studies. Basic items like imaging modality, region of interest, and image biomarker set utilized were included in all studies. However, details regarding image acquisition and reconstruction, post-acquisition image processing, and image biomarkers computation were inconsistently detailed across studies. Conclusion: The overall reporting quality of the included radiomics studies was suboptimal. These findings underscore a pressing need for improved reporting practices in radiomics research, to ensure validation and reproducibility of results. Our study provides insights into current reporting standards and highlights specific areas where adherence to IBSI guidelines could be significantly improved.

The Current Diagnostic Performance of MRI-Based Radiomics for Glioma Grading: A Meta-Analysis

BACKGROUND

Multiple radiomics models have been proposed for grading glioma using different algorithms, features, and sequences of magnetic resonance imaging. The research seeks to assess the present overall performance of radiomics for grading glioma.

METHODS

A systematic literature review of the databases Ovid MEDLINE PubMed, and Ovid EMBASE for publications published on radiomics for glioma grading between 2012 and 2023 was performed. The systematic review was carried out following the criteria of Preferred Reporting Items for Systematic Reviews and Meta-Analysis.

RESULTS

In the meta-analysis, a total of 7654 patients from 40 articles, were assessed. R-package mada was used for modeling the joint estimates of specificity (SPE) and sensitivity (SEN). Pooled event rates across studies were performed with a random-effects meta-analysis. The heterogeneity of SPE and SEN were based on the χ2 test. Overall values for SPE and SEN in the differentiation between high-grade gliomas (HGGs) and low-grade gliomas (LGGs) were 84% and 91%, respectively. With regards to the discrimination between World Health Organization (WHO) grade 4 and WHO grade 3, the overall SPE was 81% and the SEN was 89%. The modern non-linear classifiers showed a better trend, whereas textural features tend to be the best-performing (29%) and the most used.

CONCLUSIONS

Our findings confirm that present radiomics' diagnostic performance for glioma grading is superior in terms of SEN and SPE for the HGGs vs. LGGs discrimination task when compared to the WHO grade 4 vs. 3 task.

AI-based classification of three common malignant tumors in neuro-oncology: A multi-institutional comparison of machine learning and deep learning methods

PURPOSE

To determine if machine learning (ML) or deep learning (DL) pipelines perform better in AI-based three-class classification of glioblastoma (GBM), intracranial metastatic disease (IMD) and primary CNS lymphoma (PCNSL).

METHODOLOGY

Retrospective analysis included 502 cases for training (208 GBM, 67 PCNSL and 227 IMD), with external validation on 86 cases (27:27:32). Multiparametric MRI images (T1W, T2W, FLAIR, DWI and T1-CE) were co-registered, resampled, denoised and intensity normalized, followed by semiautomatic 3D segmentation of the enhancing tumor (ET) and peritumoral region (PTR). Model performance was assessed using several ML pipelines and 3D-convolutional neural networks (3D-CNN) using sequence specific masks, as well as combination of masks. All pipelines were trained and evaluated with 5-fold nested cross-validation on internal data followed by external validation using multi-class AUC.

RESULTS

Two ML models achieved similar performance on test set, one using T2-ET and T2-PTR masks (AUC: 0.885, 95% CI: [0.816, 0.935] and another using T1-CE-ET and FLAIR-PTR mask (AUC: 0.878, CI: [0.804, 0.930]). The best performing DL models achieved an AUC of 0.854, (CI [0.774, 0.914]) on external data using T1-CE-ET and T2-PTR masks, followed by model derived from T1-CE-ET, ADC-ET and FLAIR-PTR masks (AUC: 0.851, CI [0.772, 0.909]).

CONCLUSION

Both ML and DL derived pipelines achieved similar performance. T1-CE mask was used in three of the top four overall models. Additionally, all four models had some mask derived from PTR, either T2WI or FLAIR.

Impact of signal intensity normalization of MRI on the generalizability of radiomic-based prediction of molecular glioma subtypes

OBJECTIVES

Radiomic features have demonstrated encouraging results for non-invasive detection of molecular biomarkers, but the lack of guidelines for pre-processing MRI-data has led to poor generalizability. Here, we assessed the influence of different MRI-intensity normalization techniques on the performance of radiomics-based models for predicting molecular glioma subtypes.

METHODS

Preoperative MRI-data from n = 615 patients with newly diagnosed glioma and known isocitrate dehydrogenase (IDH) and 1p/19q status were pre-processed using four different methods: no normalization (naive), N4 bias field correction (N4), N4 followed by either WhiteStripe (N4/WS), or z-score normalization (N4/z-score). A total of 377 Image-Biomarker-Standardisation-Initiative-compliant radiomic features were extracted from each normalized data, and 9 different machine-learning algorithms were trained for multiclass prediction of molecular glioma subtypes (IDH-mutant 1p/19q codeleted vs. IDH-mutant 1p/19q non-codeleted vs. IDH wild type). External testing was performed in public glioma datasets from UCSF (n = 410) and TCGA (n = 160).

RESULTS

Support vector machine yielded the best performance with macro-average AUCs of 0.84 (naive), 0.84 (N4), 0.87 (N4/WS), and 0.87 (N4/z-score) in the internal test set. Both N4/WS and z-score outperformed the other approaches in the external UCSF and TCGA test sets with macro-average AUCs ranging from 0.85 to 0.87, replicating the performance of the internal test set, in contrast to macro-average AUCs ranging from 0.19 to 0.45 for naive and 0.26 to 0.52 for N4 alone.

CONCLUSION

Intensity normalization of MRI data is essential for the generalizability of radiomic-based machine-learning models. Specifically, both N4/WS and N4/z-score approaches allow to preserve the high model performance, yielding generalizable performance when applying the developed radiomic-based machine-learning model in an external heterogeneous, multi-institutional setting.

CLINICAL RELEVANCE STATEMENT

Intensity normalization such as N4/WS or N4/z-score can be used to develop reliable radiomics-based machine learning models from heterogeneous multicentre MRI datasets and provide non-invasive prediction of glioma subtypes.

KEY POINTS

• MRI-intensity normalization increases the stability of radiomics-based models and leads to better generalizability. • Intensity normalization did not appear relevant when the developed model was applied to homogeneous data from the same institution. • Radiomic-based machine learning algorithms are a promising approach for simultaneous classification of IDH and 1p/19q status of glioma.

Artificial intelligence in neuro-oncology: advances and challenges in brain tumor diagnosis, prognosis, and precision treatment

This review delves into the most recent advancements in applying artificial intelligence (AI) within neuro-oncology, specifically emphasizing work on gliomas, a class of brain tumors that represent a significant global health issue. AI has brought transformative innovations to brain tumor management, utilizing imaging, histopathological, and genomic tools for efficient detection, categorization, outcome prediction, and treatment planning. Assessing its influence across all facets of malignant brain tumor management- diagnosis, prognosis, and therapy- AI models outperform human evaluations in terms of accuracy and specificity. Their ability to discern molecular aspects from imaging may reduce reliance on invasive diagnostics and may accelerate the time to molecular diagnoses. The review covers AI techniques, from classical machine learning to deep learning, highlighting current applications and challenges. Promising directions for future research include multimodal data integration, generative AI, large medical language models, precise tumor delineation and characterization, and addressing racial and gender disparities. Adaptive personalized treatment strategies are also emphasized for optimizing clinical outcomes. Ethical, legal, and social implications are discussed, advocating for transparency and fairness in AI integration for neuro-oncology and providing a holistic understanding of its transformative impact on patient care.

Current status of magnetic resonance imaging radiomics in hepatocellular carcinoma: A quantitative review with Radiomics Quality Score

BACKGROUND

Radiomics is a promising tool that may increase the value of magnetic resonance imaging (MRI) for different tasks related to the management of patients with hepatocellular carcinoma (HCC). However, its implementation in clinical practice is still far, with many issues related to the methodological quality of radiomic studies.

AIM

To systematically review the current status of MRI radiomic studies concerning HCC using the Radiomics Quality Score (RQS).

METHODS

A systematic literature search of PubMed, Google Scholar, and Web of Science databases was performed to identify original articles focusing on the use of MRI radiomics for HCC management published between 2017 and 2023. The methodological quality of radiomic studies was assessed using the RQS tool. Spearman's correlation (ρ) analysis was performed to explore if RQS was correlated with journal metrics and characteristics of the studies. The level of statistical signi-ficance was set at P < 0.05.

RESULTS

One hundred and twenty-seven articles were included, of which 43 focused on HCC prognosis, 39 on prediction of pathological findings, 16 on prediction of the expression of molecular markers outcomes, 18 had a diagnostic purpose, and 11 had multiple purposes. The mean RQS was 8 ± 6.22, and the corresponding percentage was 24.15% ± 15.25% (ranging from 0.0% to 58.33%). RQS was positively correlated with journal impact factor (IF; ρ = 0.36, P = 2.98 × 10-5), 5-years IF (ρ = 0.33, P = 1.56 × 10-4), number of patients included in the study (ρ = 0.51, P < 9.37 × 10-10) and number of radiomics features extracted in the study (ρ = 0.59, P < 4.59 × 10-13), and time of publication (ρ = -0.23, P < 0.0072).

CONCLUSION

Although MRI radiomics in HCC represents a promising tool to develop adequate personalized treatment as a noninvasive approach in HCC patients, our study revealed that studies in this field still lack the quality required to allow its introduction into clinical practice.

Accuracy of Radiomics in Predicting IDH Mutation Status in Diffuse Gliomas: A Bivariate Meta-Analysis

Purpose To perform a systematic review and meta-analysis assessing the predictive accuracy of radiomics in the noninvasive determination of isocitrate dehydrogenase (IDH) status in grade 4 and lower-grade diffuse gliomas. Materials and Methods A systematic search was performed in the PubMed, Scopus, Embase, Web of Science, and Cochrane Library databases for relevant articles published between January 1, 2010, and July 7, 2021. Pooled sensitivity and specificity across studies were estimated. Risk of bias was evaluated using Quality Assessment of Diagnostic Accuracy Studies-2, and methods were evaluated using the radiomics quality score (RQS). Additional subgroup analyses were performed according to tumor grade, RQS, and number of sequences used (PROSPERO ID: CRD42021268958). Results Twenty-six studies that included 3280 patients were included for analysis. The pooled sensitivity and specificity of radiomics for the detection of IDH mutation were 79% (95% CI: 76, 83) and 80% (95% CI: 76, 83), respectively. Low RQS scores were found overall for the included works. Subgroup analyses showed lower false-positive rates in very low RQS studies (RQS < 6) (meta-regression, z = -1.9; P = .02) compared with adequate RQS studies. No substantial differences were found in pooled sensitivity and specificity for the pure grade 4 gliomas group compared with the all-grade gliomas group (81% and 86% vs 79% and 79%, respectively) and for studies using single versus multiple sequences (80% and 77% vs 79% and 82%, respectively). Conclusion The pooled data showed that radiomics achieved good accuracy performance in distinguishing IDH mutation status in patients with grade 4 and lower-grade diffuse gliomas. The overall methodologic quality (RQS) was low and introduced potential bias. Keywords: Neuro-Oncology, Radiomics, Integration, Application Domain, Glioblastoma, IDH Mutation, Radiomics Quality Scoring Supplemental material is available for this article. Published under a CC BY 4.0 license.

Advancing noninvasive glioma classification with diffusion radiomics: Exploring the impact of signal intensity normalization

Background

This study investigates the influence of diffusion-weighted Magnetic Resonance Imaging (DWI-MRI) on radiomic-based prediction of glioma types according to molecular status and assesses the impact of DWI intensity normalization on model generalizability.

Methods

Radiomic features, compliant with image biomarker standardization initiative standards, were extracted from preoperative MRI of 549 patients with diffuse glioma, known IDH, and 1p19q-status. Anatomical sequences (T1, T1c, T2, FLAIR) underwent N4-Bias Field Correction (N4) and WhiteStripe normalization (N4/WS). Apparent diffusion coefficient (ADC) maps were normalized using N4 or N4/z-score. Nine machine-learning algorithms were trained for multiclass prediction of glioma types (IDH-mutant 1p/19q codeleted, IDH-mutant 1p/19q non-codeleted, IDH-wild type). Four approaches were compared: Anatomical, anatomical + ADC naive, anatomical + ADC N4, and anatomical + ADC N4/z-score. The University of California San Francisco (UCSF)-glioma dataset (n = 409) was used for external validation.

Results

Naïve-Bayes algorithms yielded overall the best performance on the internal test set. Adding ADC radiomics significantly improved AUC from 0.79 to 0.86 (P = .011) for the IDH-wild-type subgroup, but not for the other 2 glioma subgroups (P > .05). In the external UCSF dataset, the addition of ADC radiomics yielded a significantly higher AUC for the IDH-wild-type subgroup (P ≤ .001): 0.80 (N4/WS anatomical alone), 0.81 (anatomical + ADC naive), 0.81 (anatomical + ADC N4), and 0.88 (anatomical + ADC N4/z-score) as well as for the IDH-mutant 1p/19q non-codeleted subgroup (P < .012 each).

Conclusions

ADC radiomics can enhance the performance of conventional MRI-based radiomic models, particularly for IDH-wild-type glioma. The benefit of intensity normalization of ADC maps depends on the type and context of the used data.

A Short Review on the Impact of Artificial Intelligence in Diagnosis Diseases: Role of Radiomics In Neuro-Oncology

Artificial Intelligence (AI) is rapidly transforming various aspects of healthcare, including the field of diagnostics and treatment of diseases. This review article aimed to provide an in-depth analysis of the impact of AI, especially, radiomics in the diagnosis of neuro-oncology diseases. Indeed, it is a multidimensional task that requires the integration of clinical assessment, neuroimaging techniques, and emerging technologies like AI and radiomics. The advancements in these fields have the potential to revolutionize the accuracy, efficiency, and personalized approach to diagnosing neuro-oncology diseases, leading to improved patient outcomes and enhanced overall neurologic care. However, AI has some limitations, and ethical challenges should be addressed via future research.

The value of MRI in predicting hepatocellular carcinoma with cytokeratin 19 expression: a systematic review and meta-analysis

AIM

To evaluate the overall diagnostic performance of magnetic resonance imaging (MRI), different image features, and different image analysis methods in predicting hepatocellular carcinoma (HCC) with cytokeratin 19 (CK19) expression.

MATERIALS AND METHODS

A systematic literature search was performed to identify studies using MRI to predict HCC with CK19 expression between 2012 and 2023. Data were extracted to calculate the pooled sensitivity and specificity. Overall diagnostic performance was assessed using areas under the summary receiver operating characteristic curve (AUC). Subgroup analyses were conducted for specific image features and according to image analysis methods (traditional image feature, radiomics, and combined methods). Z-test statistics was used to analyse the differences in diagnostic performance between combined and individual methods.

RESULTS

Eleven studies with 14 datasets (1,278 lesions from 1,264 patients) were included. The overall pooled sensitivity, specificity, and AUC with corresponding 95% confidence intervals were estimated to be 0.72 (0.55, 0.85), 0.88 (0.80, 0.93), and 0.89 (0.86, 0.91) for MRI in predicting HCC with CK19 expression. Combined methods had higher sensitivity than image feature methods (0.86 versus 0.54, p=0.001), with no difference in specificity (0.85 versus 0.87, p=0.641). There were no significant differences between radiomics and combined methods regarding sensitivity (p=0.796) and specificity (p=0.535), respectively.

CONCLUSION

MRI shows moderate sensitivity and high specificity in identifying HCC with CK19 expression. The application of radiomics can improve the sensitivity of MRI in identifying HCC with CK19 expression.

Investigating the value of radiomics stemming from DSC quantitative biomarkers in IDH mutation prediction in gliomas

Objective

This study aims to assess the value of biomarker based radiomics to predict IDH mutation in gliomas. The patient cohort consists of 160 patients histopathologicaly proven of primary glioma (WHO grades 2-4) from 3 different centers.

Methods

To quantify the DSC perfusion signal two different mathematical modeling methods were used (Gamma fitting, leakage correction algorithms) considering the assumptions about the compartments contributing in the blood flow between the extra- and intra vascular space.

Results

The Mean slope of increase (MSI) and the K1 parameter of the bidirectional exchange model exhibited the highest performance with (ACC 74.3% AUROC 74.2%) and (ACC 75% AUROC 70.5%) respectively.

Conclusion

The proposed framework on DSC-MRI radiogenomics in gliomas has the potential of becoming a reliable diagnostic support tool exploiting the mathematical modeling of the DSC signal to characterize IDH mutation status through a more reproducible and standardized signal analysis scheme for facilitating clinical translation.

Radiomics diagnostic performance in predicting lymph node metastasis of papillary thyroid carcinoma: A systematic review and meta-analysis

PURPOSE

To evaluate the diagnostic performance of radiomics in lymph node metastasis (LNM) prediction in patients with papillary thyroid carcinoma (PTC) through a systematic review and meta-analysis.

METHOD

A literature search of PubMed, EMBASE, and Web of Science was conducted to find relevant studies published until February 18th, 2023. Studies that reported the accuracy of radiomics in different imaging modalities for LNM prediction in PTC patients were selected. The methodological quality of included studies was evaluated by radiomics quality score (RQS) and quality assessment of diagnostic accuracy studies (QUADAS-2) tools. General characteristics and radiomics accuracy were extracted. Overall sensitivity, specificity, and area under the curve (AUC) were calculated for diagnostic accuracy evaluation. Spearman correlation coefficient and subgroup analysis were performed for heterogeneity exploration.

RESULTS

In total, 25 studies were included, of which 22 studies provided adequate data for meta-analysis. We conducted two types of meta-analysis: one focused solely on radiomics features models and the other combined radiomics and non-radiomics features models in the analysis. The pooled sensitivity, specificity, and AUC of radiomics and combined models were 0.75 [0.68, 0.80] vs. 0.77 [0.74, 0.80], 0.77 [0.74, 0.81] vs. 0.83 [0.78, 0.87] and 0.80 [0.73, 0.85] vs 0.82 [0.75, 0.88], respectively. The analysis showed a high heterogeneity level among the included studies. There was no threshold effect. The subgroup analysis demonstrated that utilizing ultrasonography, 2D segmentation, central and lateral LNM detection, automatic segmentation, and PyRadiomics software could slightly improve diagnostic accuracy.

CONCLUSIONS

Our meta-analysis shows that the radiomics has the potential for pre-operative LNM prediction in PTC patients. Although methodological quality is sufficient but we still need more prospective studies with larger sample sizes from different centers.

Transparency in Artificial Intelligence Research: a Systematic Review of Availability Items Related to Open Science in Radiology and Nuclear Medicine

RATIONALE AND OBJECTIVES

Reproducibility of artificial intelligence (AI) research has become a growing concern. One of the fundamental reasons is the lack of transparency in data, code, and model. In this work, we aimed to systematically review the radiology and nuclear medicine papers on AI in terms of transparency and open science.

MATERIALS AND METHODS

A systematic literature search was performed in PubMed to identify original research studies on AI. The search was restricted to studies published in Q1 and Q2 journals that are also indexed on the Web of Science. A random sampling of the literature was performed. Besides six baseline study characteristics, a total of five availability items were evaluated. Two groups of independent readers including eight readers participated in the study. Inter-rater agreement was analyzed. Disagreements were resolved with consensus.

RESULTS

Following eligibility criteria, we included a final set of 194 papers. The raw data was available in about one-fifth of the papers (34/194; 18%). However, the authors made their private data available only in one paper (1/161; 1%). About one-tenth of the papers made their pre-modeling (25/194; 13%), modeling (28/194; 14%), or post-modeling files (15/194; 8%) available. Most of the papers (189/194; 97%) did not attempt to create a ready-to-use system for real-world usage. Data origin, use of deep learning, and external validation had statistically significantly different distributions. The use of private data alone was negatively associated with the availability of at least one item (p<0.001).

CONCLUSION

Overall rates of availability for items were poor, leaving room for substantial improvement.

Radiomics-based prediction of FIGO grade for placenta accreta spectrum

BACKGROUND

Placenta accreta spectrum (PAS) is a rare, life-threatening complication of pregnancy. Predicting PAS severity is critical to individualise care planning for the birth. We aim to explore whether radiomic analysis of T2-weighted magnetic resonance imaging (MRI) can predict severe cases by distinguishing between histopathological subtypes antenatally.

METHODS

This was a bi-centre retrospective analysis of a prospective cohort study conducted between 2018 and 2022. Women who underwent MRI during pregnancy and had histological confirmation of PAS were included. Radiomic features were extracted from T2-weighted images. Univariate regression and multivariate analyses were performed to build predictive models to differentiate between non-invasive (International Federation of Gynecology and Obstetrics [FIGO] grade 1 or 2) and invasive (FIGO grade 3) PAS using R software. Prediction performance was assessed based on several metrics including sensitivity, specificity, accuracy and area under the curve (AUC) at receiver operating characteristic analysis.

RESULTS

Forty-one women met the inclusion criteria. At univariate analysis, 0.64 sensitivity (95% confidence interval [CI] 0.0-1.00), specificity 0.93 (0.38-1.0), 0.58 accuracy (0.37-0.78) and 0.77 AUC (0.56-.097) was achieved for predicting severe FIGO grade 3 PAS. Using a multivariate approach, a support vector machine model yielded 0.30 sensitivity (95% CI 0.18-1.0]), 0.74 specificity (0.38-1.00), 0.58 accuracy (0.40-0.82), and 0.53 AUC (0.40-0.85).

CONCLUSION

Our results demonstrate a predictive potential of this machine learning pipeline for classifying severe PAS cases.

RELEVANCE STATEMENT

This study demonstrates the potential use of radiomics from MR images to identify severe cases of placenta accreta spectrum antenatally.

KEY POINTS

• Identifying severe cases of placenta accreta spectrum from imaging is challenging. • We present a methodological approach for radiomics-based prediction of placenta accreta. • We report certain radiomic features are able to predict severe PAS subtypes. • Identifying severe PAS subtypes ensures safe and individualised care planning for birth.

A primer on artificial intelligence in pancreatic imaging

Artificial Intelligence (AI) is set to transform medical imaging by leveraging the vast data contained in medical images. Deep learning and radiomics are the two main AI methods currently being applied within radiology. Deep learning uses a layered set of self-correcting algorithms to develop a mathematical model that best fits the data. Radiomics converts imaging data into mineable features such as signal intensity, shape, texture, and higher-order features. Both methods have the potential to improve disease detection, characterization, and prognostication. This article reviews the current status of artificial intelligence in pancreatic imaging and critically appraises the quality of existing evidence using the radiomics quality score.

Multiparametric MRI: From Simultaneous Rapid Acquisition Methods and Analysis Techniques Using Scoring, Machine Learning, Radiomics, and Deep Learning to the Generation of Novel Metrics

ABSTRACT

With the recent advancements in rapid imaging methods, higher numbers of contrasts and quantitative parameters can be acquired in less and less time. Some acquisition models simultaneously obtain multiparametric images and quantitative maps to reduce scan times and avoid potential issues associated with the registration of different images. Multiparametric magnetic resonance imaging (MRI) has the potential to provide complementary information on a target lesion and thus overcome the limitations of individual techniques. In this review, we introduce methods to acquire multiparametric MRI data in a clinically feasible scan time with a particular focus on simultaneous acquisition techniques, and we discuss how multiparametric MRI data can be analyzed as a whole rather than each parameter separately. Such data analysis approaches include clinical scoring systems, machine learning, radiomics, and deep learning. Other techniques combine multiple images to create new quantitative maps associated with meaningful aspects of human biology. They include the magnetic resonance g-ratio, the inner to the outer diameter of a nerve fiber, and the aerobic glycolytic index, which captures the metabolic status of tumor tissues.

A first look into radiomics application in testicular imaging: A systematic review

The aim of this systematic review was to evaluate the state of the art of radiomics in testicular imaging by assessing the quality of radiomic workflow using the Radiomics Quality Score (RQS) and the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2). A systematic literature search was performed to find potentially relevant articles on the applications of radiomics in testicular imaging, and 6 final articles were extracted. The mean RQS was 11,33 ± 3,88 resulting in a percentage of 31,48% ± 10,78%. Regarding QUADAS-2 criteria, no relevant biases were found in the included papers in the patient selection, index test, reference standard criteria and flow-and-timing domain. In conclusion, despite the publication of promising studies, radiomic research on testicular imaging is in its very beginning and still hindered by methodological limitations, and the potential applications of radiomics for this field are still largely unexplored.

Quality assessment of stroke radiomics studies: Promoting clinical application

PURPOSE

To evaluate the quality of radiomics studies on stroke using a radiomics quality score (RQS), Minimum Information for Medial AI reporting (MINIMAR) and Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) to promote clinical application.

METHODS

PubMed MEDLINE and Embase were searched to identify radiomics studies on stroke. Of 464 articles, 52 relevant original research articles were included. The RQS, MINIMAR and TRIPOD were scored to evaluate the quality of the studies by neuroradiologists.

RESULTS

Only four studies (7.7 %) performed external validation. The mean RQS was 3.2 of 36 (8.9 %), and the basic adherence rate was 24.9 %. The adherence rate was low for conducting phantom study (1.9 %), stating comparison to 'gold standard' (1.9 %), offering potential clinical utility (13.5 %) and performing cost-effectiveness analysis (1.9 %). None of the studies performed a test-retest, stated biologic correlation, conducted prospective studies, or opened codes and data to the public, resulting in low RQS. The total MINIMAR adherence rate was 47.4 %. The overall adherence rate for TRIPOD was 54.6 %, with low scores for reporting the title (2.0 %), key elements of the study setting (6.1 %), and explaining the sample size (2.0 %).

CONCLUSIONS

The overall radiomics reporting quality and reporting of published radiomics studies on stoke was suboptimal. More thorough validation and open data are needed to increase clinical applicability of radiomics studies.

QuantImage v2: a comprehensive and integrated physician-centered cloud platform for radiomics and machine learning research

BACKGROUND

Radiomics, the field of image-based computational medical biomarker research, has experienced rapid growth over the past decade due to its potential to revolutionize the development of personalized decision support models. However, despite its research momentum and important advances toward methodological standardization, the translation of radiomics prediction models into clinical practice only progresses slowly. The lack of physicians leading the development of radiomics models and insufficient integration of radiomics tools in the clinical workflow contributes to this slow uptake.

METHODS

We propose a physician-centered vision of radiomics research and derive minimal functional requirements for radiomics research software to support this vision. Free-to-access radiomics tools and frameworks were reviewed to identify best practices and reveal the shortcomings of existing software solutions to optimally support physician-driven radiomics research in a clinical environment.

RESULTS

Support for user-friendly development and evaluation of radiomics prediction models via machine learning was found to be missing in most tools. QuantImage v2 (QI2) was designed and implemented to address these shortcomings. QI2 relies on well-established existing tools and open-source libraries to realize and concretely demonstrate the potential of a one-stop tool for physician-driven radiomics research. It provides web-based access to cohort management, feature extraction, and visualization and supports "no-code" development and evaluation of machine learning models against patient-specific outcome data.

CONCLUSIONS

QI2 fills a gap in the radiomics software landscape by enabling "no-code" radiomics research, including model validation, in a clinical environment. Further information about QI2, a public instance of the system, and its source code is available at https://medgift.github.io/quantimage-v2-info/ . Key points As domain experts, physicians play a key role in the development of radiomics models. Existing software solutions do not support physician-driven research optimally. QuantImage v2 implements a physician-centered vision for radiomics research. QuantImage v2 is a web-based, "no-code" radiomics research platform.

Systematic review of the radiomics quality score applications: an EuSoMII Radiomics Auditing Group Initiative

OBJECTIVE

The main aim of the present systematic review was a comprehensive overview of the Radiomics Quality Score (RQS)-based systematic reviews to highlight common issues and challenges of radiomics research application and evaluate the relationship between RQS and review features.

METHODS

The literature search was performed on multiple medical literature archives according to PRISMA guidelines for systematic reviews that reported radiomic quality assessment through the RQS. Reported scores were converted to a 0-100% scale. The Mann-Whitney and Kruskal-Wallis tests were used to compare RQS scores and review features.

RESULTS

The literature research yielded 345 articles, from which 44 systematic reviews were finally included in the analysis. Overall, the median of RQS was 21.00% (IQR = 11.50). No significant differences of RQS were observed in subgroup analyses according to targets (oncological/not oncological target, neuroradiology/body imaging focus and one imaging technique/more than one imaging technique, characterization/prognosis/detection/other).

CONCLUSIONS

Our review did not reveal a significant difference of quality of radiomic articles reported in systematic reviews, divided in different subgroups. Furthermore, low overall methodological quality of radiomics research was found independent of specific application domains. While the RQS can serve as a reference tool to improve future study designs, future research should also be aimed at improving its reliability and developing new tools to meet an ever-evolving research space.

KEY POINTS

• Radiomics is a promising high-throughput method that may generate novel imaging biomarkers to improve clinical decision-making process, but it is an inherently complex analysis and often lacks reproducibility and generalizability. • The Radiomics Quality Score serves a necessary role as the de facto reference tool for assessing radiomics studies. • External auditing of radiomics studies, in addition to the standard peer-review process, is valuable to highlight common limitations and provide insights to improve future study designs and practical applicability of the radiomics models.

MRI Radiomics and Predictive Models in Assessing Ischemic Stroke Outcome-A Systematic Review

Stroke is a leading cause of disability and mortality, resulting in substantial socio-economic burden for healthcare systems. With advances in artificial intelligence, visual image information can be processed into numerous quantitative features in an objective, repeatable and high-throughput fashion, in a process known as radiomics analysis (RA). Recently, investigators have attempted to apply RA to stroke neuroimaging in the hope of promoting personalized precision medicine. This review aimed to evaluate the role of RA as an adjuvant tool in the prognosis of disability after stroke. We conducted a systematic review following the PRISMA guidelines, searching PubMed and Embase using the keywords: 'magnetic resonance imaging (MRI)', 'radiomics', and 'stroke'. The PROBAST tool was used to assess the risk of bias. Radiomics quality score (RQS) was also applied to evaluate the methodological quality of radiomics studies. Of the 150 abstracts returned by electronic literature research, 6 studies fulfilled the inclusion criteria. Five studies evaluated predictive value for different predictive models (PMs). In all studies, the combined PMs consisting of clinical and radiomics features have achieved the best predictive performance compared to PMs based only on clinical or radiomics features, the results varying from an area under the ROC curve (AUC) of 0.80 (95% CI, 0.75-0.86) to an AUC of 0.92 (95% CI, 0.87-0.97). The median RQS of the included studies was 15, reflecting a moderate methodological quality. Assessing the risk of bias using PROBAST, potential high risk of bias in participants selection was identified. Our findings suggest that combined models integrating both clinical and advanced imaging variables seem to better predict the patients' disability outcome group (favorable outcome: modified Rankin scale (mRS) ≤ 2 and unfavorable outcome: mRS > 2) at three and six months after stroke. Although radiomics studies' findings are significant in research field, these results should be validated in multiple clinical settings in order to help clinicians to provide individual patients with optimal tailor-made treatment.

Radiomics for Alzheimer's Disease: Fundamental Principles and Clinical Applications

Alzheimer's disease is a neurodegenerative disease with a huge impact on people's quality of life, life expectancy, and morbidity. The ongoing prevalence of the disease, in conjunction with an increased financial burden to healthcare services, necessitates the development of new technologies to be employed in this field. Hence, advanced computational methods have been developed to facilitate early and accurate diagnosis of the disease and improve all health outcomes. Artificial intelligence is now deeply involved in the fight against this disease, with many clinical applications in the field of medical imaging. Deep learning approaches have been tested for use in this domain, while radiomics, an emerging quantitative method, are already being evaluated to be used in various medical imaging modalities. This chapter aims to provide an insight into the fundamental principles behind radiomics, discuss the most common techniques alongside their strengths and weaknesses, and suggest ways forward for future research standardization and reproducibility.

Diagnostic performance of ADC values and MRI-based radiomics analysis for detecting lymph node metastasis in patients with cervical cancer: A systematic review and meta-analysis

OBJECTIVE

To evaluate and compare the diagnostic performance of apparent diffusion coefficient (ADC) values and MRI-based radiomics analysis for lymph node metastasis (LNM) detection in patients with cervical cancer (CC).

METHODS

We searched relevant databases for studies on ADC values and MRI-based radiomics analysis for LNM detection in CC between January 2001 and December 2021. Methodological quality assessment of risk of bias using Quality Assessment of Diagnostic Accuracy Studies 2 and radiomics quality score (RQS) of the studies was conducted. The pooled sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR-), diagnostic odds ratio (DOR), and area under the curve (AUC) were calculated. Diagnostic performance was compared between the two quantitative analyses using a two-sample Z-test.

RESULTS

In total, 22 studies including 2314 patients were included. Unclear risk of bias was observed in 4.5-36.4% of the studies. The 8 radiomics studies exhibited a median (interquartile range) RQS of 13.5 (5.5-15.75). The pooled sensitivity, specificity, LR+, LR-, DOR, and AUC of the ADC values vs radiomics analysis were 0.86 vs 0.84, 0.85 vs 0.73, 5.7 vs 3.1, 0.17 vs 0.22, 34 vs 14, and 0.91 vs 0.86, respectively. There was no threshold effect or publication bias, but significant heterogeneity existed among the studies. No significant difference was detected in the diagnostic performance of the two quantitative analyses using the Z-test.

CONCLUSION

ADC values are more clinically promising because they are more easily accessible and widely applied, and exhibit a non-statistically significant trend to outperform radiomics analysis.

Quality reporting of radiomics analysis in pituitary adenomas: promoting clinical translation

OBJECTIVE

To evaluate the quality of radiomics studies on pituitary adenoma according to the radiomics quality score (RQS) and Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD).

METHODS

PubMed MEDLINE and EMBASE were searched to identify radiomics studies on pituitary adenomas. From 138 articles, 20 relevant original research articles were included. Studies were scored based on RQS and TRIPOD guidelines.

RESULTS

Most included studies did not perform pre-processing; isovoxel resampling, signal intensity normalization, and N4 bias field correction were performed in only five (25%), eight (40%), and four (20%) studies, respectively. Only two (10%) studies performed external validation. The mean RQS and basic adherence rate were 2.8 (7.6%) and 26.6%, respectively. There was a low adherence rate for conducting comparison to "gold-standard" (20%), multiple segmentation (25%), and stating potential clinical utility (25%). No study stated the biological correlation, conducted a test-retest or phantom study, was a prospective study, conducted cost-effectiveness analysis, or provided open-source code and data, which resulted in low-level evidence. The overall adherence rate for TRIPOD was 54.6%, and it was low for reporting the title (5%), abstract (0%), explaining the sample size (10%), and suggesting a full prediction model (5%).

CONCLUSION

The radiomics reporting quality for pituitary adenoma is insufficient. Pre-processing is required for feature reproducibility and external validation is necessary. Feature reproducibility, clinical utility demonstration, higher evidence levels, and open science are required. Titles, abstracts, and full prediction model suggestions should be improved for transparent reporting.

ADVANCES IN KNOWLEDGE

Despite the rapidly increasing number of radiomics researches on pituitary adenoma, the quality of science in these researches is unknown. Our study indicates that the overall quality needs to be significantly improved in radiomics studies on pituitary adenoma, and since the concept of RQS and IBSI is still unfamiliar to clinicians and radiologist researchers, our study may help to reach higher technical and clinical impact in the future study.

Radiomics software comparison using digital phantom and patient data: IBSI-compliance does not guarantee concordance of feature values

Introduction Radiomics is a promising imaging-based tool which could enhance clinical observation and identify representative features. To avoid different interpretations, the Image Biomarker Standardisation Initiative (IBSI) imposed conditions for harmonisation. This study evaluates IBSI-compliant radiomics applications against a known benchmark and clinical datasets for agreements. Materials and methods The applications compared were RadiomiX Research Toolbox, LIFEx v7.0.0, and syngo.via Frontier Radiomics v1.2.5 (based on PyRadiomics v2.1). Basic assessment included comparing feature names and their formulas. The IBSI digital phantom was used for evaluation against reference values. For agreement evaluation (including same software but different versions), two clinical datasets were used: 27 contrast-enhanced computed tomography (CECT) of colorectal liver metastases and 39 magnetic resonance imaging (MRI) of breast cancer, including intravoxel incoherent motion and dynamic contrast-enhanced (DCE) MRI. The lower 95% confidence interval of intraclass correlation coefficient was used to define excellent agreement (>0.9). Results The three radiomics applications share 41 (3 shape, 8 intensity, 30 texture) out of 172, 84 and 110 features for RadiomiX, LIFEx and syngo.via, respectively, as well as wavelet filtering. The naming convention is, however, different between them. Syngo.via had excellent agreement with the IBSI benchmark, while LIFEx and RadiomiX showed slightly worse agreement. Excellent reproducibility was achieved for shape features only, while intensity and texture features varied considerably with the imaging type. For intensity, excellent agreement ranged from 46% for the DCE maps to 100% for CECT, while this lowered to 44% and 73% for texture features, respectively. Wavelet features produced the greatest variation between applications, with an excellent agreement for only 3% to 11% features. Conclusion Even with IBSI-compliance, the reproducibility of features between radiomics applications is not guaranteed. To evaluate variation, quality assurance of radiomics applications should be performed and repeated when updating to a new version or adding a new modality.

A systematic review of radiomics in pancreatitis: applying the evidence level rating tool for promoting clinical transferability

Background

Multiple tools have been applied to radiomics evaluation, while evidence rating tools for this field are still lacking. This study aims to assess the quality of pancreatitis radiomics research and test the feasibility of the evidence level rating tool.

Results

Thirty studies were included after a systematic search of pancreatitis radiomics studies until February 28, 2022, via five databases. Twenty-four studies employed radiomics for diagnostic purposes. The mean ± standard deviation of the adherence rate was 38.3 ± 13.3%, 61.3 ± 11.9%, and 37.1 ± 27.2% for the Radiomics Quality Score (RQS), the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist, and the Image Biomarker Standardization Initiative (IBSI) guideline for preprocessing steps, respectively. The median (range) of RQS was 7.0 (− 3.0 to 18.0). The risk of bias and application concerns were mainly related to the index test according to the modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. The meta-analysis on differential diagnosis of autoimmune pancreatitis versus pancreatic cancer by CT and mass-forming pancreatitis versus pancreatic cancer by MRI showed diagnostic odds ratios (95% confidence intervals) of, respectively, 189.63 (79.65–451.48) and 135.70 (36.17–509.13), both rated as weak evidence mainly due to the insufficient sample size.

Conclusions

More research on prognosis of acute pancreatitis is encouraged. The current pancreatitis radiomics studies have insufficient quality and share common scientific disadvantages. The evidence level rating is feasible and necessary for bringing the field of radiomics from preclinical research area to clinical stage.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13244-022-01279-4.

Challenges in Glioblastoma Radiomics and the Path to Clinical Implementation

Radiomics is a field of medical imaging analysis that focuses on the extraction of many quantitative imaging features related to shape, intensity and texture. These features are incorporated into models designed to predict important clinical or biological endpoints for patients. Attention for radiomics research has recently grown dramatically due to the increased use of imaging and the availability of large, publicly available imaging datasets. Glioblastoma multiforme (GBM) patients stand to benefit from this emerging research field as radiomics has the potential to assess the biological heterogeneity of the tumour, which contributes significantly to the inefficacy of current standard of care therapy. Radiomics models still require further development before they are implemented clinically in GBM patient management. Challenges relating to the standardisation of the radiomics process and the validation of radiomic models impede the progress of research towards clinical implementation. In this manuscript, we review the current state of radiomics in GBM, and we highlight the barriers to clinical implementation and discuss future validation studies needed to advance radiomics models towards clinical application.

Comparative Analysis for the Distinction of Chromophobe Renal Cell Carcinoma from Renal Oncocytoma in Computed Tomography Imaging Using Machine Learning Radiomics Analysis

Background: ChRCC and RO are two types of rarely occurring renal tumors that are difficult to distinguish from one another based on morphological features alone. They differ in prognosis, with ChRCC capable of progressing and metastasizing, but RO is benign. This means discrimination of the two tumors is of crucial importance. Objectives: The purpose of this research was to develop and comprehensively evaluate predictive models that can discriminate between ChRCC and RO tumors using Computed Tomography (CT) scans and ML-Radiomics texture analysis methods. Methods: Data were obtained from 78 pathologically confirmed renal masses, scanned at two institutions. Data from the two institutions were combined to form a third set resulting in three data cohorts, i.e., cohort 1, 2 and combined. Contrast-enhanced scans were used and the axial cross-sectional slices of each tumor were extracted from the 3D data using a semi-automatic segmentation technique for both 2D and 3D scans. Radiomics features were extracted before and after applying filters and the dimensions of the radiomic features reduced using the least absolute shrinkage and selection operator (LASSO) method. Synthetic minority oversampling technique (SMOTE) was applied to avoid class imbalance. Five ML algorithms were used to train models for predictive classification and evaluated using 5-fold cross-validation. Results: The number of selected features with good model performance was 20, 40 and 6 for cohorts 1, 2 and combined, respectively. The best model performance in cohorts 1, 2 and combined had an excellent Area Under the Curve (AUC) of 1.00 ± 0.000, 1.00 ± 0.000 and 0.87 ± 0.073, respectively. Conclusions: ML-based radiomics signatures are potentially useful for distinguishing ChRCC and RO tumors, with a reliable level of performance for both 2D and 3D scanning.

18F-FDG-PET/MRI texture analysis in rectal cancer after neoadjuvant chemoradiotherapy

OBJECTIVE

Reliable markers to predict the response to neoadjuvant chemoradiotherapy (nCRT) in locally advanced rectal cancer (LARC) are lacking. We aimed to assess the ability of 18F-FDG PET/MRI to predict response to nCRT among patients undergoing curative-intent surgery.

METHODS

Patients with histological-confirmed LARC who underwent curative-intent surgery following nCRT and restaging with 18F-FDG PET/MRI were included. Statistical correlation between radiomic features extracted in PET, apparent diffusion coefficient (ADC) and T2w images and patients' histopathologic response to chemoradiotherapy using a multivariable logistic regression model ROC-analysis.

RESULTS

Overall, 50 patients were included in the study. A pathological complete response was achieved in 28.0% of patients. Considering second-order textural features, nine parameters showed a statistically significant difference between the two groups in ADC images, six parameters in PET images and four parameters in T2w images. Combining all the features selected for the three techniques in the same multivariate ROC curve analysis, we obtained an area under ROC curve of 0.863 (95% CI, 0.760-0.966), showing a sensitivity, specificity and accuracy at the Youden's index of 100% (14/14), 64% (23/36) and 74% (37/50), respectively.

CONCLUSION

PET/MRI texture analysis seems to represent a valuable tool in the identification of rectal cancer patients with a complete pathological response to nCRT.

Diagnosis of Idiopathic Pulmonary Fibrosis in High-Resolution Computed Tomography Scans Using a Combination of Handcrafted Radiomics and Deep Learning

Purpose

To develop handcrafted radiomics (HCR) and deep learning (DL) based automated diagnostic tools that can differentiate between idiopathic pulmonary fibrosis (IPF) and non-IPF interstitial lung diseases (ILDs) in patients using high-resolution computed tomography (HRCT) scans.

Material and Methods

In this retrospective study, 474 HRCT scans were included (mean age, 64.10 years ± 9.57 [SD]). Five-fold cross-validation was performed on 365 HRCT scans. Furthermore, an external dataset comprising 109 patients was used as a test set. An HCR model, a DL model, and an ensemble of HCR and DL model were developed. A virtual in-silico trial was conducted with two radiologists and one pulmonologist on the same external test set for performance comparison. The performance was compared using DeLong method and McNemar test. Shapley Additive exPlanations (SHAP) plots and Grad-CAM heatmaps were used for the post-hoc interpretability of HCR and DL models, respectively.

Results

In five-fold cross-validation, the HCR model, DL model, and the ensemble of HCR and DL models achieved accuracies of 76.2 ± 6.8, 77.9 ± 4.6, and 85.2 ± 2.7%, respectively. For the diagnosis of IPF and non-IPF ILDs on the external test set, the HCR, DL, and the ensemble of HCR and DL models achieved accuracies of 76.1, 77.9, and 85.3%, respectively. The ensemble model outperformed the diagnostic performance of clinicians who achieved a mean accuracy of 66.3 ± 6.7% (p < 0.05) during the in-silico trial. The area under the receiver operating characteristic curve (AUC) for the ensemble model on the test set was 0.917 which was significantly higher than the HCR model (0.817, p = 0.02) and the DL model (0.823, p = 0.005). The agreement between HCR and DL models was 61.4%, and the accuracy and specificity for the predictions when both the models agree were 93 and 97%, respectively. SHAP analysis showed the texture features as the most important features for IPF diagnosis and Grad-CAM showed that the model focused on the clinically relevant part of the image.

Conclusion

Deep learning and HCR models can complement each other and serve as useful clinical aids for the diagnosis of IPF and non-IPF ILDs.

Radiomics-guided radiation therapy: opportunities and challenges

Radiomics is an advanced image-processing framework, which extracts image features and considers them as biomarkers towards personalized medicine. Applications include disease detection, diagnosis, prognosis, and therapy response assessment/prediction. As radiation therapy aims for further individualized treatments, radiomics could play a critical role in various steps before, during and after treatment. Elucidation of the concept of radiomics-guided radiation therapy (RGRT) is the aim of this review, attempting to highlight opportunities and challenges underlying the use of radiomics to guide clinicians and physicists towards more effective radiation treatments. This work identifies the value of RGRT in various steps of radiotherapy from patient selection to follow-up, and subsequently provides recommendations to improve future radiotherapy using quantitative imaging features.

Radiomic assessment of oesophageal adenocarcinoma: a critical review of 18F-FDG PET/CT, PET/MRI and CT

OBJECTIVES

Radiomic models present an avenue to improve oesophageal adenocarcinoma assessment through quantitative medical image analysis. However, model selection is complicated by the abundance of available predictors and the uncertainty of their relevance and reproducibility. This analysis reviews recent research to facilitate precedent-based model selection for prospective validation studies.

METHODS

This analysis reviews research on 18F-FDG PET/CT, PET/MRI and CT radiomics in oesophageal adenocarcinoma between 2016 and 2021. Model design, testing and reporting are evaluated according to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) score and Radiomics Quality Score (RQS). Key results and limitations are analysed to identify opportunities for future research in the area.

RESULTS

Radiomic models of stage and therapeutic response demonstrated discriminative capacity, though clinical applications require greater sensitivity. Although radiomic models predict survival within institutions, generalisability is limited. Few radiomic features have been recommended independently by multiple studies.

CONCLUSIONS

Future research must prioritise prospective validation of previously proposed models to further clinical translation.

Gaps and Opportunities of Artificial Intelligence Applications for Pediatric Oncology in European Research: A Systematic Review of Reviews and a Bibliometric Analysis

The application of artificial intelligence (AI) systems is emerging in many fields in recent years, due to the increased computing power available at lower cost. Although its applications in various branches of medicine, such as pediatric oncology, are many and promising, its use is still in an embryonic stage. The aim of this paper is to provide an overview of the state of the art regarding the AI application in pediatric oncology, through a systematic review of systematic reviews, and to analyze current trends in Europe, through a bibliometric analysis of publications written by European authors. Among 330 records found, 25 were included in the systematic review. All papers have been published since 2017, demonstrating only recent attention to this field. The total number of studies included in the selected reviews was 674, with a third including an author with a European affiliation. In bibliometric analysis, 304 out of the 978 records found were included. Similarly, the number of publications began to dramatically increase from 2017. Most explored AI applications regard the use of diagnostic images, particularly radiomics, as well as the group of neoplasms most involved are the central nervous system tumors. No evidence was found regarding the use of AI for process mining, clinical pathway modeling, or computer interpreted guidelines to improve the healthcare process. No robust evidence is yet available in any of the domains investigated by systematic reviews. However, the scientific production in Europe is significant and consistent with the topics covered in systematic reviews at the global level. The use of AI in pediatric oncology is developing rapidly with promising results, but numerous gaps and challenges persist to validate its utilization in clinical practice. An important limitation is the need for large datasets for training algorithms, calling for international collaborative studies.

A Systematic Review of the Current Status and Quality of Radiomics for Glioma Differential Diagnosis

Simple Summary

Gliomas can be difficult to discern clinically and radiologically from other brain lesions (either neoplastic or non-neoplastic) since their clinical manifestations as well as preoperative imaging features often overlap and appear misleading. Radiomics could be extremely helpful for non-invasive glioma differential diagnosis (DDx). However, implementation in clinical practice is still distant and concerns have been raised regarding the methodological quality of radiomic studies. In this context, we aimed to summarize the current status and quality of radiomic studies concerning glioma DDx in a systematic review. In total, 42 studies were selected and examined in our work. Our study revealed that, despite promising and encouraging results, current studies on radiomics for glioma DDx still lack the quality required to allow its introduction into clinical practice. This work could provide new insights and help to reach a consensus on the use of the radiomic approach for glioma DDx.

Abstract

Radiomics is a promising tool that may increase the value of imaging in differential diagnosis (DDx) of glioma. However, implementation in clinical practice is still distant and concerns have been raised regarding the methodological quality of radiomic studies. Therefore, we aimed to systematically review the current status of radiomic studies concerning glioma DDx, also using the radiomics quality score (RQS) to assess the quality of the methodology used in each study. A systematic literature search was performed to identify original articles focused on the use of radiomics for glioma DDx from 2015. Methodological quality was assessed using the RQS tool. Spearman’s correlation (ρ) analysis was performed to explore whether RQS was correlated with journal metrics and the characteristics of the studies. Finally, 42 articles were selected for the systematic qualitative analysis. Selected articles were grouped and summarized in terms of those on DDx between glioma and primary central nervous system lymphoma, those aiming at differentiating glioma from brain metastases, and those based on DDx of glioma and other brain diseases. Median RQS was 8.71 out 36, with a mean RQS of all studies of 24.21%. Our study revealed that, despite promising and encouraging results, current studies on radiomics for glioma DDx still lack the quality required to allow its introduction into clinical practice. This work could provide new insights and help to reach a consensus on the use of the radiomic approach for glioma DDx.

Machine Learning Tools for Image-Based Glioma Grading and the Quality of Their Reporting: Challenges and Opportunities

Technological innovation has enabled the development of machine learning (ML) tools that aim to improve the practice of radiologists. In the last decade, ML applications to neuro-oncology have expanded significantly, with the pre-operative prediction of glioma grade using medical imaging as a specific area of interest. We introduce the subject of ML models for glioma grade prediction by remarking upon the models reported in the literature as well as by describing their characteristic developmental workflow and widely used classifier algorithms. The challenges facing these models-including data sources, external validation, and glioma grade classification methods -are highlighted. We also discuss the quality of how these models are reported, explore the present and future of reporting guidelines and risk of bias tools, and provide suggestions for the reporting of prospective works. Finally, this review offers insights into next steps that the field of ML glioma grade prediction can take to facilitate clinical implementation.

Quality assessment of radiomics research in cardiac CT: a systematic review

OBJECTIVES

To assess the quality of current radiomics research on cardiac CT using radiomics quality score (RQS) and Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) systems.

METHODS

Systematic searches of PubMed and EMBASE were performed to identify all potentially relevant original research articles about cardiac CT radiomics. Fifteen original research articles were selected. Two cardiac radiologists assessed the quality of the methodology adopted in those studies according to the RQS and TRIPOD guidelines. Basic adherence rates for the following six key domains were evaluated: image protocol and reproducibility, feature reduction and validation, biologic/clinical utility, performance index, high level of evidence, and open science.

RESULTS

Among the 15 included articles, six (40%) were about coronary artery disease and six (40%) were about myocardial infarction. The mean RQS was 9.9 ± 7.3 (27.4% of the ideal score of 36), and the basic adherence rate was 44.6%. Fourteen (93.3%) and nine (60%) studies performed feature selection and validation, but only two (13.3%) of them performed external validation. Two studies (13.3%) were prospective, and only one study (6.7%) conducted calibration analysis and stated the potential clinical utility. None of the studies conducted phantom study and cost-effective analysis. The overall adherence rate for TRIPOD was 63%.

CONCLUSION

The quality of radiomics studies in cardiac CT is currently insufficient. A higher level of evidence is required, and analysis of clinical utility and calibration of model performance need to be improved.

KEY POINTS

• The quality of science of radiomics studies in cardiac CT is currently insufficient. • No study conducted a phantom study or cost-effective analysis, with further limitations being demonstrated in a high level of evidence for radiomics studies. • Analysis of clinical utility and calibration of model performance need to be improved, and a higher level of evidence is required.

The impact of radiomics for human papillomavirus status prediction in oropharyngeal cancer: systematic review and radiomics quality score assessment

Purpose

Human papillomavirus (HPV) status assessment is crucial for decision making in oropharyngeal cancer patients. In last years, several articles have been published investigating the possible role of radiomics in distinguishing HPV-positive from HPV-negative neoplasms. Aim of this review was to perform a systematic quality assessment of radiomic studies published on this topic.

Methods

Radiomics studies on HPV status prediction in oropharyngeal cancer patients were selected. The Radiomic Quality Score (RQS) was assessed by three readers to evaluate their methodological quality. In addition, possible correlations between RQS% and journal type, year of publication, impact factor, and journal rank were investigated.

Results

After the literature search, 19 articles were selected whose RQS median was 33% (range 0–42%). Overall, 16/19 studies included a well-documented imaging protocol, 13/19 demonstrated phenotypic differences, and all were compared with the current gold standard. No study included a public protocol, phantom study, or imaging at multiple time points. More than half (13/19) included feature selection and only 2 were comprehensive of non-radiomic features. Mean RQS was significantly higher in clinical journals.

Conclusion

Radiomics has been proposed for oropharyngeal cancer HPV status assessment, with promising results. However, these are supported by low methodological quality investigations. Further studies with higher methodological quality, appropriate standardization, and greater attention to validation are necessary prior to clinical adoption.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00234-022-02959-0.

Machine Learning Models for Classifying High- and Low-Grade Gliomas: A Systematic Review and Quality of Reporting Analysis

Objectives

To systematically review, assess the reporting quality of, and discuss improvement opportunities for studies describing machine learning (ML) models for glioma grade prediction.

Methods

This study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy (PRISMA-DTA) statement. A systematic search was performed in September 2020, and repeated in January 2021, on four databases: Embase, Medline, CENTRAL, and Web of Science Core Collection. Publications were screened in Covidence, and reporting quality was measured against the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) Statement. Descriptive statistics were calculated using GraphPad Prism 9.

Results

The search identified 11,727 candidate articles with 1,135 articles undergoing full text review and 85 included in analysis. 67 (79%) articles were published between 2018-2021. The mean prediction accuracy of the best performing model in each study was 0.89 ± 0.09. The most common algorithm for conventional machine learning studies was Support Vector Machine (mean accuracy: 0.90 ± 0.07) and for deep learning studies was Convolutional Neural Network (mean accuracy: 0.91 ± 0.10). Only one study used both a large training dataset (n>200) and external validation (accuracy: 0.72) for their model. The mean adherence rate to TRIPOD was 44.5% ± 11.1%, with poor reporting adherence for model performance (0%), abstracts (0%), and titles (0%).

Conclusions

The application of ML to glioma grade prediction has grown substantially, with ML model studies reporting high predictive accuracies but lacking essential metrics and characteristics for assessing model performance. Several domains, including generalizability and reproducibility, warrant further attention to enable translation into clinical practice.

Systematic Review Registration

PROSPERO, identifier CRD42020209938.