Radiomics Models for Predicting Microvascular Invasion in Hepatocellular Carcinoma: A Systematic Review and Radiomics Quality Score Assessment

Prediction of histopathologic grades of bladder cancer with radiomics based on MRI: Comparison with traditional MRI

PURPOSE

To compare biparametric magnetic resonance imaging (bp-MRI) radiomics signatures and traditional MRI model for the preoperative prediction of bladder cancer (BCa) grade.

MATERIALS AND METHODS

This retrospective study included 255 consecutive patients with pathologically confirmed 113 low-grade and 142 high-grade BCa. The traditional MRI nomogram model was developed using univariate and multivariate logistic regression by the mean apparent diffusion coefficient (ADC), vesical imaging reporting and data system, tumor size, and the number of tumors. Volumes of interest were manually drawn on T2-weighted imaging (T2WI) and ADC maps by 2 radiologists. Using one-way analysis of variance, correlation, and least absolute shrinkage and selection operator methods to select features. Then, a logistic regression classifier was used to develop the radiomics signatures. Receiver operating characteristic (ROC) analysis was used to compare the diagnostic abilities of the radiomics and traditional MRI models by the DeLong test. Finally, decision curve analysis was performed by estimating the clinical usefulness of the 2 models.

RESULTS

The area under the ROC curves (AUCs) of the traditional MRI model were 0.841 in the training cohort and 0.806 in the validation cohort. The AUCs of the 3 groups of radiomics model [ADC, T2WI, bp-MRI (ADC and T2WI)] were 0.888, 0.875, and 0.899 in the training cohort and 0.863, 0.805, and 0.867 in the validation cohort, respectively. The combined radiomics model achieved higher AUCs than the traditional MRI model. decision curve analysis indicated that the radiomics model had higher net benefits than the traditional MRI model.

CONCLUSION

The bp-MRI radiomics model may help distinguish high-grade and low-grade BCa and outperforming the traditional MRI model. Multicenter validation is needed to acquire high-level evidence for its clinical application.

Role of radiomics as a predictor of disease recurrence in ovarian cancer: a systematic review

Ovarian cancer is associated with high cancer-related mortality rate attributed to late-stage diagnosis, limited treatment options, and frequent disease recurrence. As a result, careful patient selection is important especially in setting of radical surgery. Radiomics is an emerging field in medical imaging, which may help provide vital prognostic evaluation and help patient selection for radical treatment strategies. This systematic review aims to assess the role of radiomics as a predictor of disease recurrence in ovarian cancer. A systematic search was conducted in Medline, EMBASE, and Web of Science databases. Studies meeting inclusion criteria investigating the use of radiomics to predict post-operative recurrence in ovarian cancer were included in our qualitative analysis. Study quality was assessed using the QUADAS-2 and Radiomics Quality Score tools. Six retrospective studies met the inclusion criteria, involving a total of 952 participants. Radiomic-based signatures demonstrated consistent performance in predicting disease recurrence, as evidenced by satisfactory area under the receiver operating characteristic curve values (AUC range 0.77-0.89). Radiomic-based signatures appear to good prognosticators of disease recurrence in ovarian cancer as estimated by AUC. The reviewed studies consistently reported the potential of radiomic features to enhance risk stratification and personalise treatment decisions in this complex cohort of patients. Further research is warranted to address limitations related to feature reliability, workflow heterogeneity, and the need for prospective validation studies.

Radiomics and liver: Where we are and where we are headed?

Hepatic diffuse conditions and focal liver lesions represent two of the most common scenarios to face in everyday radiological clinical practice. Thanks to the advances in technology, radiology has gained a central role in the management of patients with liver disease, especially due to its high sensitivity and specificity. Since the introduction of computed tomography (CT) and magnetic resonance imaging (MRI), radiology has been considered the non-invasive reference modality to assess and characterize liver pathologies. In recent years, clinical practice has moved forward to a quantitative approach to better evaluate and manage each patient with a more fitted approach. In this setting, radiomics has gained an important role in helping radiologists and clinicians characterize hepatic pathological entities, in managing patients, and in determining prognosis. Radiomics can extract a large amount of data from radiological images, which can be associated with different liver scenarios. Thanks to its wide applications in ultrasonography (US), CT, and MRI, different studies were focused on specific aspects related to liver diseases. Even if broadly applied, radiomics has some advantages and different pitfalls. This review aims to summarize the most important and robust studies published in the field of liver radiomics, underlying their main limitations and issues, and what they can add to the current and future clinical practice and literature.

Radiomics of Preoperative Multi-Sequence Magnetic Resonance Imaging Can Improve the Predictive Performance of Microvascular Invasion in Hepatocellular Carcinoma

Background

The aim of the study is to demonstrate that radiomics of preoperative multi-sequence magnetic resonance imaging (MRI) can indeed improve the predictive performance of microvascular invasion (MVI) in hepatocellular carcinoma (HCC).

Methods

A total of 206 patients with pathologically confirmed HCC who underwent preoperative enhanced MRI were retrospectively recruited. Univariate and multivariate logistic regression analysis identified the independent clinicoradiologic predictors of MVI present and constituted the clinicoradiologic model. Recursive feature elimination (RFE) was applied to select radiomics features (extracted from six sequence images) and constructed the radiomics model. Clinicoradiologic model plus radiomics model formed the clinicoradiomics model. Five-fold cross-validation was used to validate the three models. Discrimination, calibration, and clinical utility were used to evaluate the performance. Net reclassification improvement (NRI) and integrated discrimination improvement (IDI) were used to compare the prediction accuracy between models.

Results

The clinicoradiologic model contained alpha-fetoprotein (AFP)_lg10, radiological capsule enhancement, enhancement pattern and arterial peritumoral enhancement, which were independent risk factors of MVI. There were 18 radiomics features related to MVI constructed the radiomics model. The mean area under the receiver operating curve (AUC) of clinicoradiologic, radiomics and clinicoradiomics model were 0.849, 0.925 and 0.950 in the training cohort and 0.846, 0.907 and 0.933 in the validation cohort, respectively. The three models' calibration curves fitted well, and decision curve analysis (DCA) confirmed the clinical usefulness. Compared with the clinicoradiologic model, the NRI of radiomics and clinicoradiomics model increased significantly by 0.575 and 0.825, respectively, and the IDI increased significantly by 0.280 and 0.398, respectively.

Conclusions

Radiomics of preoperative multi-sequence MRI can improve the predictive performance of MVI in HCC.

Current status of magnetic resonance imaging radiomics in hepatocellular carcinoma: A quantitative review with Radiomics Quality Score

BACKGROUND

Radiomics is a promising tool that may increase the value of magnetic resonance imaging (MRI) for different tasks related to the management of patients with hepatocellular carcinoma (HCC). However, its implementation in clinical practice is still far, with many issues related to the methodological quality of radiomic studies.

AIM

To systematically review the current status of MRI radiomic studies concerning HCC using the Radiomics Quality Score (RQS).

METHODS

A systematic literature search of PubMed, Google Scholar, and Web of Science databases was performed to identify original articles focusing on the use of MRI radiomics for HCC management published between 2017 and 2023. The methodological quality of radiomic studies was assessed using the RQS tool. Spearman's correlation (ρ) analysis was performed to explore if RQS was correlated with journal metrics and characteristics of the studies. The level of statistical signi-ficance was set at P < 0.05.

RESULTS

One hundred and twenty-seven articles were included, of which 43 focused on HCC prognosis, 39 on prediction of pathological findings, 16 on prediction of the expression of molecular markers outcomes, 18 had a diagnostic purpose, and 11 had multiple purposes. The mean RQS was 8 ± 6.22, and the corresponding percentage was 24.15% ± 15.25% (ranging from 0.0% to 58.33%). RQS was positively correlated with journal impact factor (IF; ρ = 0.36, P = 2.98 × 10-5), 5-years IF (ρ = 0.33, P = 1.56 × 10-4), number of patients included in the study (ρ = 0.51, P < 9.37 × 10-10) and number of radiomics features extracted in the study (ρ = 0.59, P < 4.59 × 10-13), and time of publication (ρ = -0.23, P < 0.0072).

CONCLUSION

Although MRI radiomics in HCC represents a promising tool to develop adequate personalized treatment as a noninvasive approach in HCC patients, our study revealed that studies in this field still lack the quality required to allow its introduction into clinical practice.

The Value of LI-RADS and Radiomic Features From MRI for Predicting Microvascular Invasion in Hepatocellular Carcinoma within 5 cm

RATIONALE AND OBJECTIVES

To explore and compare the performance of LI-RADS® and radiomics from multiparametric MRI in predicting microvascular invasion (MVI) preoperatively in patients with solitary hepatocellular carcinoma (HCC)< 5 cm.

METHODS

We enrolled 143 patients with pathologically proven HCC and randomly stratified them into training (n = 100) and internal validation (n = 43) cohorts. Besides, 53 patients were enrolled to constitute an independent test cohort. Clinical factors and imaging features, including LI-RADS and three other features (non-smooth margin, incomplete capsule, and two-trait predictor of venous invasion), were reviewed and analyzed. Radiomic features from four MRI sequences were extracted. The independent clinic-imaging (clinical) and radiomics model for MVI-prediction were constructed by logistic regression and AdaBoost respectively. And the clinic-radiomics combined model was further constructed by logistic regression. We assessed the model discrimination, calibration, and clinical usefulness by using the area under the receiver operating characteristic curve (AUC), calibration curve, and decision-curve analysis respectively.

RESULTS

Incomplete tumor capsule, corona enhancement, and radiomic features were related to MVI in solitary HCC＜5 cm. The clinical model achieved AUC of 0.694/0.661 (training/internal validation). The single-sequence-based radiomic model's AUCs were 0.753-0.843/0.698-0.767 (training/internal validation). The combination model exhibited superior diagnostic performance to the clinical model (AUC: 0.895/0.848 [training/ internal validation]) and yielded an AUC of 0.858 in an independent test cohort.

CONCLUSION

Incomplete tumor capsule and corona enhancement on preoperative MRI were significantly related to MVI in solitary HCC＜5 cm. Multiple-sequence radiomic features potentially improve MVI-prediction-model performance, which could potentially help determining HCC's appropriate therapy.

Quality assessment of radiomics models in carotid plaque: a systematic review

Background

Although imaging techniques provide information about the morphology and stability of carotid plaque, they are operator dependent and may miss certain subtleties. A variety of radiomics models for carotid plaque have recently been proposed for identifying vulnerable plaques and predicting cardiovascular and cerebrovascular diseases. The purpose of this review was to assess the risk of bias, reporting, and methodological quality of radiomics models for carotid atherosclerosis plaques.

Methods

A systematic search was carried out to identify available literature published in PubMed, Web of Science, and the Cochrane Library up to March 2023. Studies that developed and/or validated machine learning models based on radiomics data to identify and/or predict unfavorable cerebral and cardiovascular events in carotid plaque were included. The basic information of each piece of included literature was identified, and the reporting quality, risk of bias, and radiomics methodology quality were assessed according the TRIPOD (Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis) checklist, the Prediction Model Risk of Bias Assessment Tool (PROBAST), and the radiomics quality score (RQS), respectively.

Results

A total of 2,738 patients from 19 studies were included. The mean overall TRIPOD adherence rate was 66.1% (standard deviation 12.8%), with a range of 45-87%. All studies had a high overall risk of bias, with the analysis domain being the most common source of bias. The mean RQS was 9.89 (standard deviation 5.70), accounting for 27.4% of the possible maximum value of 36. The mean area under the curve for diagnostic or predictive properties of these included radiomics models was 0.876±0.09, with a range of 0.741-0.989.

Conclusions

Radiomics models may have value in the assessment of carotid plaque, the overall scientific validity and reporting quality of current carotid plaque radiomics reports are still lacking, and many barriers must be overcome before these models can be applied in clinical practice.

Radiomics nomogram for the prediction of microvascular invasion of HCC and patients' benefit from postoperative adjuvant TACE: a multi-center study

OBJECTIVES

To evaluate the performance of a radiomics nomogram developed based on gadolinium-ethoxybenzyl-diethylenetriamine penta-acetic acid (Gd-EOB-DTPA) MRI for preoperative prediction of microvascular invasion (MVI) of hepatocellular carcinoma (HCC), and to identify patients who may benefit from the postoperative adjuvant transarterial chemoembolization (PA-TACE).

METHODS

A total of 260 eligible patients were retrospectively enrolled from three hospitals (140, 65, and 55 in training, standardized external, and non-standardized external validation cohort). Radiomics features and image characteristics were extracted from Gd-EOB-DTPA MRI image before hepatectomy for each lesion. In the training cohort, a radiomics nomogram which incorporated the radiomics signature and radiological predictors was developed. The performance of the radiomics nomogram was assessed with respect to discrimination calibration, and clinical usefulness with external validation. A score (m-score) was constructed to stratify the patients and explored whether it could accurately predict patient who benefit from PA-TACE.

RESULTS

A radiomics nomogram integrated with the radiomics signature, max-D(iameter)  > 5.1 cm, peritumoral low intensity (PTLI), incomplete capsule, and irregular morphology had favorable discrimination in the training cohort (AUC = 0.982), the standardized external validation cohort (AUC = 0.969), and the non-standardized external validation cohort (AUC = 0.981). Decision curve analysis confirmed the clinical usefulness of the novel radiomics nomogram. The log-rank test revealed that PA-TACE significantly decreased the early recurrence in the high-risk group (p = 0.006) with no significant effect in the low-risk group (p = 0.270).

CONCLUSIONS

The novel radiomics nomogram combining the radiomics signature and clinical radiological features achieved preoperative non-invasive MVI risk prediction and patient benefit assessment after PA-TACE, which may help clinicians implement more appropriate interventions.

CLINICAL RELEVANCE STATEMENT

Our radiomics nomogram could represent a novel biomarker to identify patients who may benefit from the postoperative adjuvant transarterial chemoembolization, which may help clinicians to implement more appropriate interventions and perform individualized precision therapies.

KEY POINTS

• The novel radiomics nomogram developed based on Gd-EOB-DTPA MRI achieved preoperative non-invasive MVI risk prediction. • An m-score based on the radiomics nomogram could stratify HCC patients and further identify individuals who may benefit from the PA-TACE. • The radiomics nomogram could help clinicians to implement more appropriate interventions and perform individualized precision therapies.

Radiomics in Carotid Plaque: A Systematic Review and Radiomics Quality Score Assessment

Imaging modalities provide information on plaque morphology and vulnerability; however, they are operator dependent and miss a great deal of microscopic information. Recently, many radiomics models for carotid plaque that identify unstable plaques and predict cardiovascular outcomes have been proposed. This systematic review was aimed at assessing whether radiomics is a reliable and reproducible method for the clinical prediction of carotid plaque. A systematic search was conducted to identify studies published in PubMed and Cochrane library from January 1, 2001, to September 30, 2022. Both retrospective and prospective studies that developed and/or validated machine learning models based on radiomics data to classify or predict carotid plaques were included. The general characteristics of each included study were selected, and the methodological quality of radiomics reports and risk of bias were evaluated using the radiomics quality score (RQS) tool and Quality Assessment of Diagnostic Accuracy Studies-2, respectively. Two investigators independently reviewed each study, and the consensus data were used for analysis. A total of 2429 patients from 16 studies were included. The mean area under the curve of radiomics models for diagnostic or predictive performance of the included studies was 0.88 ± 0.02, with a range of 0.741-0.989. The mean RQS was 9.25 (standard deviation: 6.04), representing 25.7% of the possible maximum value of 36, whereas the lowest point was -2, and the highest score was 22. Radiomics models have revealed additional information on patients with carotid plaque, but with respect to methodological quality, radiomics reports are still in their infancy, and many hurdles need to be overcome.

Performances and variability of CT radiomics for the prediction of microvascular invasion and survival in patients with HCC: a matter of chance or standardisation?

OBJECTIVES

To measure the performance and variability of a radiomics-based model for the prediction of microvascular invasion (MVI) and survival in patients with resected hepatocellular carcinoma (HCC), simulating its sequential development and application.

METHODS

This study included 230 patients with 242 surgically resected HCCs who underwent preoperative CT, of which 73/230 (31.7%) were scanned in external centres. The study cohort was split into training set (158 patients, 165 HCCs) and held-out test set (72 patients, 77 HCCs), stratified by random partitioning, which was repeated 100 times, and by a temporal partitioning to simulate the sequential development and clinical use of the radiomics model. A machine learning model for the prediction of MVI was developed with least absolute shrinkage and selection operator (LASSO). The concordance index (C-index) was used to assess the value to predict the recurrence-free (RFS) and overall survivals (OS).

RESULTS

In the 100-repetition random partitioning cohorts, the radiomics model demonstrated a mean AUC of 0.54 (range 0.44-0.68) for the prediction of MVI, mean C-index of 0.59 (range 0.44-0.73) for RFS, and 0.65 (range 0.46-0.86) for OS in the held-out test set. In the temporal partitioning cohort, the radiomics model yielded an AUC of 0.50 for the prediction of MVI, a C-index of 0.61 for RFS, and 0.61 for OS, in the held-out test set.

CONCLUSIONS

The radiomics models had a poor performance for the prediction of MVI with a large variability in the model performance depending on the random partitioning. Radiomics models demonstrated good performance in the prediction of patient outcomes.

CLINICAL RELEVANCE STATEMENT

Patient selection within the training set strongly influenced the performance of the radiomics models for predicting microvascular invasion; therefore, a random approach to partitioning a retrospective cohort into a training set and a held-out set seems inappropriate.

KEY POINTS

• The performance of the radiomics models for the prediction of microvascular invasion and survival widely ranged (AUC range 0.44-0.68) in the randomly partitioned cohorts. • The radiomics model for the prediction of microvascular invasion was unsatisfying when trying to simulate its sequential development and clinical use in a temporal partitioned cohort imaged with a variety of CT scanners. • The performance of the radiomics models for the prediction of survival was good with similar performances in the 100-repetition random partitioning and temporal partitioning cohorts.

A radiomics model based on preoperative gadoxetic acid-enhanced magnetic resonance imaging for predicting post-hepatectomy liver failure in patients with hepatocellular carcinoma

Background

Post-hepatectomy liver failure (PHLF) is a fatal complication after liver resection in patients with hepatocellular carcinoma (HCC). It is of clinical importance to estimate the risk of PHLF preoperatively.

Aims

This study aimed to develop and validate a prediction model based on preoperative gadoxetic acid-enhanced magnetic resonance imaging to estimate the risk of PHLF in patients with HCC.

Methods

A total of 276 patients were retrospectively included and randomly divided into training and test cohorts (194:82). Clinicopathological variables were assessed to identify significant indicators for PHLF prediction. Radiomics features were extracted from the normal liver parenchyma at the hepatobiliary phase and the reproducible, robust and non-redundant ones were filtered for modeling. Prediction models were developed using clinicopathological variables (Clin-model), radiomics features (Rad-model), and their combination.

Results

The PHLF incidence rate was 24% in the whole cohort. The combined model, consisting of albumin-bilirubin (ALBI) score, indocyanine green retention test at 15 min (ICG-R15), and Rad-score (derived from 16 radiomics features) outperformed the Clin-model and the Rad-model. It yielded an area under the receiver operating characteristic curve (AUC) of 0.84 (95% confidence interval (CI): 0.77-0.90) in the training cohort and 0.82 (95% CI: 0.72-0.91) in the test cohort. The model demonstrated a good consistency by the Hosmer-Lemeshow test and the calibration curve. The combined model was visualized as a nomogram for estimating individual risk of PHLF.

Conclusion

A model combining clinicopathological risk factors and radiomics signature can be applied to identify patients with high risk of PHLF and serve as a decision aid when planning surgery treatment in patients with HCC.

Systematic review of the radiomics quality score applications: an EuSoMII Radiomics Auditing Group Initiative

OBJECTIVE

The main aim of the present systematic review was a comprehensive overview of the Radiomics Quality Score (RQS)-based systematic reviews to highlight common issues and challenges of radiomics research application and evaluate the relationship between RQS and review features.

METHODS

The literature search was performed on multiple medical literature archives according to PRISMA guidelines for systematic reviews that reported radiomic quality assessment through the RQS. Reported scores were converted to a 0-100% scale. The Mann-Whitney and Kruskal-Wallis tests were used to compare RQS scores and review features.

RESULTS

The literature research yielded 345 articles, from which 44 systematic reviews were finally included in the analysis. Overall, the median of RQS was 21.00% (IQR = 11.50). No significant differences of RQS were observed in subgroup analyses according to targets (oncological/not oncological target, neuroradiology/body imaging focus and one imaging technique/more than one imaging technique, characterization/prognosis/detection/other).

CONCLUSIONS

Our review did not reveal a significant difference of quality of radiomic articles reported in systematic reviews, divided in different subgroups. Furthermore, low overall methodological quality of radiomics research was found independent of specific application domains. While the RQS can serve as a reference tool to improve future study designs, future research should also be aimed at improving its reliability and developing new tools to meet an ever-evolving research space.

KEY POINTS

• Radiomics is a promising high-throughput method that may generate novel imaging biomarkers to improve clinical decision-making process, but it is an inherently complex analysis and often lacks reproducibility and generalizability. • The Radiomics Quality Score serves a necessary role as the de facto reference tool for assessing radiomics studies. • External auditing of radiomics studies, in addition to the standard peer-review process, is valuable to highlight common limitations and provide insights to improve future study designs and practical applicability of the radiomics models.

Gadoxetic Acid-Enhanced MRI-Based Radiomics Signature: A Potential Imaging Biomarker for Identifying Cytokeratin 19-Positive Hepatocellular Carcinoma

Purpose

One subtype of hepatocellular carcinoma (HCC), with cytokeratin 19 expression (CK19+), has shown to be more aggressive and has a poor prognosis. However, CK19+ is determined by immunohistochemical examination using a surgically resected specimen. This study is aimed at establishing a radiomics signature based on preoperative gadoxetic acid-enhanced MRI for predicting CK19 status in HCC. Patients and Methods. Clinicopathological and imaging data were retrospectively collected from patients who underwent hepatectomy between February 2015 and December 2020. Patients who underwent gadoxetic acid-enhanced MRI and had CK19 results of histopathological examination were included. Radiomics features of the manually segmented lesion during the arterial, portal venous, and hepatobiliary phases were extracted. The 10 most reproducible and robust features at each phase were selected for construction of radiomics signatures, and their performance was evaluated by analyzing the area under the curve (AUC). The goodness of fit of the model was assessed by the Hosmer-Lemeshow test.

Results

A total of 110 patients were included. The incidence of CK19(+) HCC was 17% (19/110). Alpha fetoprotein was the only significant clinicopathological variable different between CK19(-) and CK19(+) groups. A majority of the selected radiomics features were wavelet filter-derived features. The AUCs of the three radiomics signatures based on arterial, portal venous, and hepatobiliary phases were 0.70 (95% CI: 0.56-0.83), 0.83 (95% CI: 0.73-0.92), and 0.89 (95% CI: 0.82-0.96), respectively. The three radiomics signatures were integrated, and the fusion signature yielded an AUC of 0.92 (95% CI: 0.86-0.98) and was used as the final model for CK19(+) prediction. The sensitivity, specificity, accuracy, positive predictive value, and negative predictive value of the fusion signature was 0.84, 0.89, 0.88, 0.62, and 0.96, respectively. The Hosmer-Lemeshow test showed a good fit of the fusion signature (p > 0.05).

Conclusion

The established radiomics signature based on preoperative gadoxetic acid-enhanced MRI could be an accurate and potential imaging biomarker for HCC CK19(+) prediction.

Quality of radiomics for predicting microvascular invasion in hepatocellular carcinoma: a systematic review

OBJECTIVES

To comprehensively evaluate the reporting quality, risk of bias, and radiomics methodology quality of radiomics models for predicting microvascular invasion in hepatocellular carcinoma.

METHODS

A systematic search of available literature was performed in PubMed, Embase, Web of Science, Scopus, and the Cochrane Library up to January 21, 2022. Studies that developed and/or validated machine learning models based on radiomics data to predict microvascular invasion in hepatocellular carcinoma were included. These studies were reviewed by two investigators and the consensus data were used for analyzing. The reporting quality, risk of bias, and radiomics methodological quality were evaluated by Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD), Prediction model Risk of Bias Assessment Tool, and Radiomics Quality Score (RQS), respectively.

RESULTS

A total of 30 studies met eligibility criteria with 24 model developing studies and 6 model developing and external validation studies. The median overall TRIPOD adherence was 75.4% (range 56.7-94.3%). All studies were at high risk of bias with at least 2 of 20 sources of bias. Furthermore, 28 studies showed unclear risks of bias in up to 5 signaling questions because of the lack of specified reports. The median RQS score was 37.5% (range 25-61.1%).

CONCLUSION

Current radiomic models for MVI-status prediction have moderate to good reporting quality, moderate radiomics methodology quality, and high risk of bias in model development and validation.

KEY POINTS

• Current microvascular invasion prediction radiomics studies have moderate to good reporting quality, moderate radiomics methodology quality, and high risk of bias in model development and validation. • Data representativeness, feature robustness, events-per-variable ratio, evaluation metrics, and appropriate validation are five main aspects futures studies should focus more on to improve the quality of radiomics. • Both Radiomics Quality Score and Prediction model Risk of Bias Assessment Tool are needed to comprehensively evaluate a radiomics study.

Systematic review with radiomics quality score of cholangiocarcinoma: an EuSoMII Radiomics Auditing Group Initiative

OBJECTIVES

To systematically review current research applications of radiomics in patients with cholangiocarcinoma and to assess the quality of CT and MRI radiomics studies.

METHODS

A systematic search was conducted on PubMed/Medline, Web of Science, and Scopus databases to identify original studies assessing radiomics of cholangiocarcinoma on CT and/or MRI. Three readers with different experience levels independently assessed quality of the studies using the radiomics quality score (RQS). Subgroup analyses were performed according to journal type, year of publication, quartile and impact factor (from the Journal Citation Report database), type of cholangiocarcinoma, imaging modality, and number of patients.

RESULTS

A total of 38 original studies including 6242 patients (median 134 patients) were selected. The median RQS was 9 (corresponding to 25.0% of the total RQS; IQR 1-13) for reader 1, 8 (22.2%, IQR 3-12) for reader 2, and 10 (27.8%; IQR 5-14) for reader 3. The inter-reader agreement was good with an ICC of 0.75 (95% CI 0.62-0.85) for the total RQS. All studies were retrospective and none of them had phantom assessment, imaging at multiple time points, nor performed cost-effectiveness analysis. The RQS was significantly higher in studies published in journals with impact factor > 4 (median 11 vs. 4, p = 0.048 for reader 1) and including more than 100 patients (median 11.5 vs. 0.5, p < 0.001 for reader 1).

CONCLUSIONS

Quality of radiomics studies on cholangiocarcinoma is insufficient based on the radiomics quality score. Future research should consider prospective studies with a standardized methodology, validation in multi-institutional external cohorts, and open science data.

The diagnostic performance of radiomics-based MRI in predicting microvascular invasion in hepatocellular carcinoma: A meta-analysis

Objective

The aim of this study was to assess the diagnostic performance of radiomics-based MRI in predicting microvascular invasion (MVI) in hepatocellular carcinoma (HCC).

Method

The databases of PubMed, Cochrane library, Embase, Web of Science, Ovid MEDLINE, Springer, and Science Direct were searched for original studies from their inception to 20 August 2022. The quality of each study included was assessed according to the Quality Assessment of Diagnostic Accuracy Studies 2 and the radiomics quality score. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and diagnostic odds ratio (DOR) were calculated. The summary receiver operating characteristic (SROC) curve was plotted and the area under the curve (AUC) was calculated to evaluate the diagnostic accuracy. Sensitivity analysis and subgroup analysis were performed to explore the source of the heterogeneity. Deeks' test was used to assess publication bias.

Results

A total of 15 studies involving 981 patients were included. The pooled sensitivity, specificity, PLR, NLR, DOR, and AUC were 0.79 (95%CI: 0.72-0.85), 0.81 (95%CI: 0.73-0.87), 4.1 (95%CI:2.9-5.9), 0.26 (95%CI: 0.19-0.35), 16 (95%CI: 9-28), and 0.87 (95%CI: 0.84-0.89), respectively. The results showed great heterogeneity among the included studies. Sensitivity analysis indicated that the results of this study were statistically reliable. The results of subgroup analysis showed that hepatocyte-specific contrast media (HSCM) had equivalent sensitivity and equivalent specificity compared to the other set. The least absolute shrinkage and selection operator method had high sensitivity and specificity than other methods, respectively. The investigated area of the region of interest had high specificity compared to the volume of interest. The imaging-to-surgery interval of 15 days had higher sensitivity and slightly low specificity than the others. Deeks' test indicates that there was no publication bias (P=0.71).

Conclusion

Radiomics-based MRI has high accuracy in predicting MVI in HCC, and it can be considered as a non-invasive method for assessing MVI in HCC.

Development and External Validation of a Radiomics Model Derived from Preoperative Gadoxetic Acid-Enhanced MRI for Predicting Histopathologic Grade of Hepatocellular Carcinoma

Histopathologic grade of hepatocellular carcinoma (HCC) is an important predictor of early recurrence and poor prognosis after curative treatments. This study aims to develop a radiomics model based on preoperative gadoxetic acid-enhanced MRI for predicting HCC histopathologic grade and to validate its predictive performance in an independent external cohort. Clinical and imaging data of 403 consecutive HCC patients were retrospectively collected from two hospitals (265 and 138, respectively). Patients were categorized into poorly differentiated HCC and non-poorly differentiated HCC groups. A total of 851 radiomics features were extracted from the segmented tumor at the hepatobiliary phase images. Three classifiers, logistic regression (LR), support vector machine, and Adaboost were adopted for modeling. The areas under the curve of the three models were 0.70, 0.67, and 0.61, respectively, in the external test cohort. Alpha-fetoprotein (AFP) was the only significant clinicopathological variable associated with HCC grading (odds ratio: 2.75). When combining AFP, the LR+AFP model showed the best performance, with an AUC of 0.71 (95%CI: 0.59-0.82) in the external test cohort. A radiomics model based on gadoxetic acid-enhanced MRI was constructed in this study to discriminate HCC with different histopathologic grades. Its good performance indicates a promise in the preoperative prediction of HCC differentiation levels.

Current status and quality of radiomic studies for predicting KRAS mutations in colorectal cancer patients: A systematic review and meta‑analysis

PURPOSE

The purpose of this study was to evaluate the methodological quality of radiomics-based studies for noninvasive, preoperative prediction of Kirsten rat sarcoma (KRAS) mutations in patients with colorectal cancer; furthermore, we systematically evaluate the diagnostic accuracy of predicting models.

METHODS

We systematically searched PubMed, Embase, Cochrane Library and Web of Science databases up to 20 April 2022 for eligible studies. The methodological quality of included studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools. A meta-analysis of studies on the prediction of KRAS status in colorectal cancer patients was performed.

RESULT

Twenty-nine studies were identified in the systematic review, including three studies on the prediction of KRAS status in colorectal cancer liver metastases. All studies had an average RQS score of 9.55 (26.5% of the total score), ranging from 3 to 17. Most studies demonstrated a low or unclear risk of bias in the domains of QUADAS-2. Nineteen studies were included in the meta-analysis, mostly imaged with magnetic resonance imaging (MRI), followed by computed tomography (CT), positron emission tomography-CT (PET/CT). With pooled sensitivity, specificity and area under the curve (AUC) of the training cohorts were 0.80(95% confidence interval(CI), 0.75-0.84), 0.80(95% CI, 0.74-0.85) and 0.87(95% CI, 0.84-0.90),respectively. The pooled sensitivity, specificity, and AUC for the validation cohorts (13 studies) were 0.78(95% CI, 0.71-0.84), 0.84(95% CI, 0.74-0.90), and 0.86(95% CI, 0.83-0.89), respectively.

CONCLUSION

Radiomics is a potential noninvasive technology that has a moderate preoperative diagnosis and prediction effect on KRAS mutations. However, it has not been implemented as a clinical decision-making tool. Future researchers should pay more attention to the methodological quality of the study and further externally validate the model using multicenter datasets.

A nomogram model integrating LI-RADS features and radiomics based on contrast-enhanced magnetic resonance imaging for predicting microvascular invasion in hepatocellular carcinoma falling the Milan criteria

PURPOSE

To establish and validate a nomogram model incorporating both liver imaging reporting and data system (LI-RADS) features and contrast enhanced magnetic resonance imaging (CEMRI)-based radiomics for predicting microvascular invasion (MVI) in hepatocellular carcinoma (HCC) falling the Milan criteria.

METHODS

In total, 161 patients with 165 HCCs diagnosed with MVI (n = 99) or without MVI (n = 66) were assigned to a training and a test group. MRI LI-RADS characteristics and radiomics features selected by the LASSO algorithm were used to establish the MRI and Rad-score models, respectively, and the independent features were integrated to develop the nomogram model. The predictive ability of the nomogram was evaluated with receiver operating characteristic (ROC) curves.

RESULTS

The risk factors associated with MVI (P<0.05) were related to larger tumor size, nonsmooth margin, mosaic architecture, corona enhancement and higher Rad-score. The areas under the ROC curve (AUCs) of the MRI feature model for predicting MVI were 0.85 (95% CI: 0.78-0.92) and 0.85 (95% CI: 0.74-0.95), and those for the Rad-score were 0.82 (95% CI: 0.73-0.90) and 0.80 (95% CI: 0.67-0.93) in the training and test groups, respectively. The nomogram presented improved AUC values of 0.87 (95% CI: 0.81-0.94) in the training group and 0.89 (95% CI: 0.81-0.98) in the test group (P<0.05) for predicting MVI. The calibration curve and decision curve analysis demonstrated that the nomogram model had high goodness-of-fit and clinical benefits.

CONCLUSIONS

The nomogram model can effectively predict MVI in patients with HCC falling within the Milan criteria and serves as a valuable imaging biomarker for facilitating individualized decision-making.

Radiomics in Abdominopelvic Solid-Organ Oncologic Imaging: Current Status

Radiomics is the process of extraction of high-throughput quantitative imaging features from medical images. These features represent noninvasive quantitative biomarkers that go beyond the traditional imaging features visible to the human eye. This article first reviews the steps of the radiomics pipeline, including image acquisition, ROI selection and image segmentation, image preprocessing, feature extraction, feature selection, and model development and application. Current evidence for the application of radiomics in abdominopelvic solid-organ cancers is then reviewed. Applications including diagnosis, subtype determination, treatment response assessment, and outcome prediction are explored within the context of hepatobiliary and pancreatic cancer, renal cell carcinoma, prostate cancer, gynecologic cancer, and adrenal masses. This literature review focuses on the strongest available evidence, including systematic reviews, meta-analyses, and large multicenter studies. Limitations of the available literature are highlighted, including marked heterogeneity in radiomics methodology, frequent use of small sample sizes with high risk of overfitting, and lack of prospective design, external validation, and standardized radiomics workflow. Thus, although studies have laid a foundation that supports continued investigation into radiomics models, stronger evidence is needed before clinical adoption.

Radiomics nomogram for prediction of microvascular invasion in hepatocellular carcinoma based on MR imaging with Gd-EOB-DTPA

OBJECTIVE

To develop a radiomics nomogram for predicting microvascular invasion (MVI) before surgery in hepatocellular carcinoma (HCC) patients.

MATERIALS AND METHODS

The data from a total of 189 HCC patients (training cohort: n = 141; validation cohort: n = 48) were collected, involving the clinical data and imaging characteristics. Radiomics features of all patients were extracted from hepatobiliary phase (HBP) in 15 min. Least absolute shrinkage selection operator (LASSO) regression and logistic regression were utilized to reduce data dimensions, feature selection, and to construct a radiomics signature. Clinicoradiological factors were identified according to the univariate and multivariate analyses, which were incorporated into the final predicted nomogram. A nomogram was developed to predict MVI of HCC by combining radiomics signatures and clinicoradiological factors. Radiomics nomograms were evaluated for their discrimination capability, calibration, and clinical usefulness.

RESULTS

In the clinicoradiological factors, gender, alpha-fetoprotein (AFP) level, tumor shape and halo sign served as the independent risk factors of MVI, with which the area under the curve (AUC) is 0.802. Radiomics signatures covering 14 features at HBP 15 min can effectively predict MVI in HCC, to construct radiomics signature model, with the AUC of 0.732. In the final nomogram model the clinicoradiological factors and radiomics signatures were integrated, outperforming the clinicoradiological model (AUC 0.884 vs. 0.802; p <0.001) and radiomics signatures model (AUC 0.884 vs. 0.732; p < 0.001) according to Delong test results. A robust calibration and discrimination were demonstrated in the nomogram model. The results of decision curve analysis (DCA) showed more significantly clinical efficiency of the nomogram model in comparison to the clinicoradiological model and the radiomic signature model.

CONCLUSIONS

Depending on the clinicoradiological factors and radiological features on HBP 15 min images, nomograms can effectively predict MVI status in HCC patients.

Radiomics quality score in renal masses: a systematic assessment on current literature

OBJECTIVE

To perform a systematic assessment and analyze the quality of radiomics methodology in current literature in the evaluation of renal masses using the Radiomics Quality Score (RQS) approach.

METHODS

We systematically reviewed recent radiomics literature in renal masses published in PubMed, EMBASE, Elsevier, and Web of Science. Two reviewers blinded by each other's scores evaluated the quality of radiomics methodology in studies published from 2015 to August 2021 using the RQS approach. Owing to the diversity in the imaging modalities and radiomics applications, a meta-analysis could not be performed.

RESULTS

Based on our inclusion/exclusion criteria, a total of 87 published studies were included in our study. The highest RQS was noted in three categories: reporting of clinical utility, gold standard, and feature reduction. The average RQS of the two reviewers ranged from 5 ≤ RQS≤19, with the maximum attainable RQS being 36. Very few (7/87 i.e., 8%) studies received an average RQS that ranged from 17 < RQS≤19, which represents studies with the highest RQS in our study. Many (39/87 i.e., 45%) studies received an average RQS that ranged from 13 < RQS≤15. No significant interreviewer scoring differences were observed.

CONCLUSIONS

We report that the overall scientific quality and reporting of radiomics studies in renal masses is suboptimal, and subsequent studies should bolster current deficiencies to improve reporting of radiomics methodologies.

ADVANCES IN KNOWLEDGE

The RQS approach is a meaningful quantitative scoring system to assess radiomics methodology quality and supports a comprehensive evaluation of the radiomics approach before its incorporation into clinical practice.

A Radiomics Model Based on Gd-EOB-DTPA-Enhanced MRI for the Prediction of Microvascular Invasion in Solitary Hepatocellular Carcinoma ≤ 5 cm

Aim

The aim of this study is to establish and validate a radiomics-based model using preoperative Gd-EOB-DTPA-enhanced MRI to predict microvascular invasion (MVI) in patients with hepatocellular carcinoma ≤ 5 cm.

Methods

Clinicopathologic and MRI data of 178 patients with solitary hepatocellular carcinoma (HCC) (≤5 cm) were retrospectively collected from a single medical center between May 2017 and November 2020. Patients were randomly assigned into training and test subsets by a ratio of 7:3. Imaging features were extracted from the segmented tumor volume of interest with 1-cm expansion on arterial phase (AP) and hepatobiliary phase (HBP) images. Different models based on the significant clinical risk factors and/or selected imaging features were established and the predictive performance of the models was evaluated.

Results

Three radiomics models, the AP_model, the HBP_model, and the AP+HBP_model, were constructed for MVI prediction. Among them, the AP+HBP_model outperformed the other two. When it was combined with a clinical model, consisting of tumor size and alpha-fetoprotein (AFP), the combined model (AP+HBP+Clin_model) showed an area under the curve of 0.90 and 0.70 in the training and test subsets, respectively. Its sensitivity and specificity were 0.91 and 0.76 in the training subset and 0.60 and 0.79 in the test subset, respectively. The calibration curve illustrated that the combined model possessed a good agreement between the predicted and the actual probabilities.

Conclusions

The radiomics-based model combining imaging features from the arterial and hepatobiliary phases of Gd-EOB-DTPA-enhanced MRI and clinical risk factors provides an effective and reliable tool for the preoperative prediction of MVI in patients with HCC ≤ 5 cm.

A Multi-Parametric Radiomics Nomogram for Preoperative Prediction of Microvascular Invasion Status in Intrahepatic Cholangiocarcinoma

Background

Intrahepatic cholangiocarcinoma (ICC) is the second most common primary liver cancer with increasing incidence in the last decades. Microvascular invasion (MVI) is a poor prognostic factor for patients with ICC, which correlates early recurrence and poor prognosis, and it can affect the selection of personalized therapeutic regime.

Purpose

This study aimed to develop and validate a radiomics-based nomogram for predicting MVI in ICC patients preoperatively.

Methods

A total of 163 pathologically confirmed ICC patients (training cohort: n = 130; validation cohort: n = 33) with postoperative Ga-DTPA-enhanced MR examination were enrolled, and a time-independent test cohort (n = 24) was collected for external validation. Univariate and multivariate analyses were used to determine the independent predictors of MVI status, which were then incorporated into the MVI prediction nomogram. Least absolute shrinkage and selection operator logistic regression was performed to select optimal features and construct radiomics models. The prediction performances of models were assessed by receiver operating characteristic (ROC) curve analysis. The performance of the MVI prediction nomogram was evaluated by its calibration, discrimination, and clinical utility.

Results

Larger tumor size (p = 0.003) and intrahepatic duct dilatation (p = 0.002) are independent predictors of MVI. The final radiomics model shows desirable and stable prediction performance in the training cohort (AUC = 0.950), validation cohort (AUC = 0.883), and test cohort (AUC = 0.812). The MVI prediction nomogram incorporates tumor size, intrahepatic duct dilatation, and the final radiomics model and achieves excellent predictive efficacy in training cohort (AUC = 0.953), validation cohort (AUC = 0.861), and test cohort (AUC = 0.819), fitting well in calibration curves (p > 0.05). Decision curve and clinical impact curve further confirm the clinical usefulness of the nomogram.

Conclusion

The nomogram incorporating tumor size, intrahepatic duct dilatation, and the final radiomics model is a potential biomarker for preoperative prediction of the MVI status in ICC patients.