Diagnostic Accuracy of Artificial Intelligence Based on Imaging Data for Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma: A Systematic Review and Meta-Analysis

Machine learning for the prediction of diabetes-related amputation: a systematic review and meta-analysis of diagnostic test accuracy

Although machine learning is frequently used in medicine for predictive purposes, its accuracy in diabetes-related amputation (DRA) remains unclear. From establishing the database until December 2024, we conducted a comprehensive search of PubMed, Web of Science (WoS), Embase, Scopus, Cochrane Library, Wanfang, and the China National Knowledge Index (CNKI). The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), area under the curve (AUC), and Fagan plot analysis were used to assess the overall test performance of machine learning. Moreover, subgroup analysis and meta-regression were performed to search for possible sources of heterogeneity. Finally, sensitivity analysis and Deeks' funnel plot asymmetry test were used to evaluate the stability and publication bias, respectively. In the end, seven publications were included in this meta-analysis. The overall pooled diagnostic data were as follows: sensitivity, 0.72 (95% CI 0.69-0.75); specificity, 0.89 (95% CI 0.84-0.93); PLR, 3.62 (95% CI 3.36-3.89); NLR, 0.32 (95% CI 0.30-0.35); DOR, 13.55 (95% CI 11.72-15.67). The AUC was 0.81 (95% CI 0.77-0.84). The Fagan plot analysis showed that the positive post-test probability is 62% and the negative post-test probability is 7%. Subgroup analysis and meta-regression showed that both the level of bias and the year of publication were sources of heterogeneity in sensitivity and specificity. Sensitivity analysis confirmed the robustness of the results after excluding three outlier studies. The Deeks' funnel plot suggests that publication bias has no statistical significance (P > 0.05). In summary, our results suggest the moderate accuracy of machine learning in predicting DRA.

Diagnostic Performance of Radiomics Modeling in Predicting the Human Papillomavirus Status of Oropharyngeal Cancer: A Systematic Review and Meta-Analysis

In this review, we sought to assess the diagnostic performance and methodological quality of studies utilizing radiomics for the prediction of human papillomavirus (HPV) status in patients with oropharyngeal squamous cell carcinoma. A comprehensive literature search of PubMed, Ovid, Cochrane, Web of Science, and Scopus from inception until June 7, 2022, was performed to identify eligible studies. Strict inclusion and exclusion criteria were applied to the identified studies. Data collection was performed by two independent reviewers with disagreements resolved by consensus review with a third reviewer. In total, 14 articles were chosen, with a total of 15 radiomics models. Of the included studies, 12 models reported sensitivity, with a mean of 0.778 (standard deviation (SD) = 0.073). Similarly, 12 models reported specificity, with a mean of 0.751 (SD = 0.111). The area under the curve (AUC) was reported by all 15 models, with a mean of 0.814 (SD = 0.081). Finally, accuracy was reported by eight models, with a mean of 0.768 (SD = 0.044). A meta-analysis was performed on eight studies that reported AUCs with confidence intervals (CIs), returning a pooled AUC of 0.764 (95% CI = 0.758 to 0.770). The Radiomics Quality Score (RQS) was applied to each included study as a measure of quality. RQS ranged from -1 to 22, with a mean of 13.4 and an intraclass coefficient of 0.874. Radiomics modeling has shown promise in serving as a diagnostic indicator for HPV status in patients with oropharyngeal cancer. Nevertheless, the quality of research methodologies in this area is a limiting factor for its broader clinical application and highlights the need for enhanced funding to support further research efforts.

Artificial Intelligence Application for Anti-tumor Drug Synergy Prediction

Currently, the main therapeutic methods for cancer include surgery, radiation therapy, and chemotherapy. However, chemotherapy still plays an important role in tumor therapy. Due to the variety of pathogenic factors, the development process of tumors is complex and regulated by many factors, and the treatment of a single drug is easy to cause the human body to produce a drug-resistant phenotype to specific drugs and eventually leads to treatment failure. In the process of clinical tumor treatment, the combination of multiple drugs can produce stronger anti-tumor effects by regulating multiple mechanisms and can reduce the problem of tumor drug resistance while reducing the toxic side effects of drugs. Therefore, it is still a great challenge to construct an efficient and accurate screening method that can systematically consider the synergistic anti- tumor effects of multiple drugs. However, anti-tumor drug synergy prediction is of importance in improving cancer treatment outcomes. However, identifying effective drug combinations remains a complex and challenging task. This review provides a comprehensive overview of cancer drug synergy therapy and the application of artificial intelligence (AI) techniques in cancer drug synergy prediction. In addition, we discuss the challenges and perspectives associated with deep learning approaches. In conclusion, the review of the AI techniques' application in cancer drug synergy prediction can further advance our understanding of cancer drug synergy and provide more effective treatment plans and reasonable drug use strategies for clinical guidance.

A Systematic Review and Meta-Analysis of MRI Radiomics for Predicting Microvascular Invasion in Patients with Hepatocellular Carcinoma

BACKGROUND

The prediction power of MRI radiomics for microvascular invasion (MVI) in patients with hepatocellular carcinoma (HCC) remains uncertain.

OBJECTIVE

To investigate the prediction performance of MRI radiomics for MVI in HCC.

METHODS

Original studies focusing on preoperative prediction performance of MRI radiomics for MVI in HCC, were systematically searched from databases of PubMed, Embase, Web of Science and Cochrane Library. Radiomics quality score (RQS) and risk of bias of involved studies were evaluated. Meta-analysis was carried out to demonstrate the value of MRI radiomics for MVI prediction in HCC. Influencing factors of the prediction performance of MRI radiomics were identified by subgroup analyses.

RESULTS

13 studies classified as type 2a or above according to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis statement were eligible for this systematic review and meta-analysis. The studies achieved an average RQS of 14 (ranging from 11 to 17), accounting for 38.9% of the total points. MRI radiomics achieved a pooled sensitivity of 0.82 (95%CI: 0.78 - 0.86), specificity of 0.79 (95%CI: 0.76 - 0.83) and area under the summary receiver operator characteristic curve (AUC) of 0.88 (95%CI: 0.84 - 0.91) to predict MVI in HCC. Radiomics models combined with clinical features achieved superior performances compared to models without the combination (AUC: 0.90 vs 0.85, P < 0.05).

CONCLUSION

MRI radiomics has the potential for preoperative prediction of MVI in HCC. Further studies with high methodological quality should be designed to improve the reliability and reproducibility of the radiomics models for clinical application. The systematic review and meta-analysis was registered prospectively in the International Prospective Register of Systematic Reviews (No. CRD42022333822).

Deep Learning Methods in Medical Image-Based Hepatocellular Carcinoma Diagnosis: A Systematic Review and Meta-Analysis

(1) Background: The aim of our research was to systematically review papers specifically focused on the hepatocellular carcinoma (HCC) diagnostic performance of DL methods based on medical images. (2) Materials: To identify related studies, a comprehensive search was conducted in prominent databases, including Embase, IEEE, PubMed, Web of Science, and the Cochrane Library. The search was limited to studies published before 3 July 2023. The inclusion criteria consisted of studies that either developed or utilized DL methods to diagnose HCC using medical images. To extract data, binary information on diagnostic accuracy was collected to determine the outcomes of interest, namely, the sensitivity, specificity, and area under the curve (AUC). (3) Results: Among the forty-eight initially identified eligible studies, thirty studies were included in the meta-analysis. The pooled sensitivity was 89% (95% CI: 87-91), the specificity was 90% (95% CI: 87-92), and the AUC was 0.95 (95% CI: 0.93-0.97). Analyses of subgroups based on medical image methods (contrast-enhanced and non-contrast-enhanced images), imaging modalities (ultrasound, magnetic resonance imaging, and computed tomography), and comparisons between DL methods and clinicians consistently showed the acceptable diagnostic performance of DL models. The publication bias and high heterogeneity observed between studies and subgroups can potentially result in an overestimation of the diagnostic accuracy of DL methods in medical imaging. (4) Conclusions: To improve future studies, it would be advantageous to establish more rigorous reporting standards that specifically address the challenges associated with DL research in this particular field.

Machine learning methods for accurately predicting survival and guiding treatment in stage I and II hepatocellular carcinoma

Accurately predicting survival in patients with early hepatocellular carcinoma (HCC) is essential for making informed decisions about treatment and prognosis. Herein, we have developed a machine learning (ML) model that can predict patient survival and guide treatment decisions. We obtained patient demographic information, tumor characteristics, and treatment details from the SEER database. To analyze the data, we employed a Cox proportional hazards (CoxPH) model as well as 3 ML algorithms: neural network multitask logistic regression (N-MLTR), DeepSurv, and random survival forest (RSF). Our evaluation relied on the concordance index (C-index) and Integrated Brier Score (IBS). Additionally, we provided personalized treatment recommendations regarding surgery and chemotherapy choices and validated models' efficacy. A total of 1136 patients with early-stage (I, II) hepatocellular carcinoma (HCC) who underwent liver resection or transplantation were randomly divided into training and validation cohorts at a ratio of 3:7. Feature selection was conducted using Cox regression analyses. The ML models (NMLTR: C-index = 0.6793; DeepSurv: C-index = 0.7028; RSF: C-index = 0.6890) showed better discrimination in predicting survival than the standard CoxPH model (C-index = 0.6696). Patients who received recommended treatments had higher survival rates than those who received unrecommended treatments. ML-based surgery treatment recommendations yielded higher hazard ratios (HRs): NMTLR HR = 0.36 (95% CI: 0.25-0.51, P < .001), DeepSurv HR = 0.34 (95% CI: 0.24-0.49, P < .001), and RSF HR = 0.37 (95% CI: 0.26-0.52, P = <.001). Chemotherapy treatment recommendations were associated with significantly improved survival for DeepSurv (HR: 0.57; 95% CI: 0.4-0.82, P = .002) and RSF (HR: 0.66; 95% CI: 0.46-0.94, P = .020). The ML survival model has the potential to benefit prognostic evaluation and treatment of HCC. This novel analytical approach could provide reliable information on individual survival and treatment recommendations.

Prognostic value of consolidation-to-tumor ratio on computed tomography in NSCLC: a meta-analysis

BACKGROUND

Although several studies have confirmed the prognostic value of the consolidation to tumor ratio (CTR) in non-small cell lung cancer (NSCLC), there still remains controversial about it.

METHODS

We systematically searched the PubMed, Embase, and Web of Science databases from inception to April, 2022 for eligible studies that reported the correlation between CTR and prognosis in NSCLC. Hazard ratios (HRs) with 95% confidence intervals (95% CIs) were extracted and pooled to assess the overall effects. Heterogeneity was estimated by I2 statistics. Subgroup analysis based on the cut-off value of CTR, country, source of HR and histology type was conducted to detect the sources of heterogeneity. Statistical analyses were performed using STATA version 12.0.

RESULTS

A total of 29 studies published between 2001 and 2022 with 10,347 patients were enrolled. The pooled results demonstrated that elevated CTR was associated with poorer overall survival (HR = 1.88, 95% CI 1.42-2.50, P < 0.01) and disease-free survival (DFS)/recurrence-free survival (RFS)/progression-free survival (PFS) (HR = 1.42, 95% CI 1.27-1.59, P < 0.01) in NSCLC. According to subgroup analysis by the cut-off value of CTR and histology type, both lung adenocarcinoma and NSCLC patients who had a higher CTR showed worse survival. Subgroup analysis stratified by country revealed that CTR was a prognostic factor for OS and DFS/RFS/PFS in Chinese, Japanese, and Turkish patients.

CONCLUSIONS

In NSCLC patients with high CTR, the prognosis was worse than that with low CTR, indicating that CTR may be a prognostic factor.

An overview of meta-analyses on radiomics: more evidence is needed to support clinical translation

OBJECTIVE

To conduct an overview of meta-analyses of radiomics studies assessing their study quality and evidence level.

METHODS

A systematical search was updated via peer-reviewed electronic databases, preprint servers, and systematic review protocol registers until 15 November 2022. Systematic reviews with meta-analysis of primary radiomics studies were included. Their reporting transparency, methodological quality, and risk of bias were assessed by PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 checklist, AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) tool, and ROBIS (Risk Of Bias In Systematic reviews) tool, respectively. The evidence level supporting the radiomics for clinical use was rated.

RESULTS

We identified 44 systematic reviews with meta-analyses on radiomics research. The mean ± standard deviation of PRISMA adherence rate was 65 ± 9%. The AMSTAR-2 tool rated 5 and 39 systematic reviews as low and critically low confidence, respectively. The ROBIS assessment resulted low, unclear and high risk in 5, 11, and 28 systematic reviews, respectively. We reperformed 53 meta-analyses in 38 included systematic reviews. There were 3, 7, and 43 meta-analyses rated as convincing, highly suggestive, and weak levels of evidence, respectively. The convincing level of evidence was rated in (1) T2-FLAIR radiomics for IDH-mutant vs IDH-wide type differentiation in low-grade glioma, (2) CT radiomics for COVID-19 vs other viral pneumonia differentiation, and (3) MRI radiomics for high-grade glioma vs brain metastasis differentiation.

CONCLUSIONS

The systematic reviews on radiomics were with suboptimal quality. A limited number of radiomics approaches were supported by convincing level of evidence.

CLINICAL RELEVANCE STATEMENT

The evidence supporting the clinical application of radiomics are insufficient, calling for researches translating radiomics from an academic tool to a practicable adjunct towards clinical deployment.

Liver Transplant in Patients with Hepatocarcinoma: Imaging Guidelines and Future Perspectives Using Artificial Intelligence

Hepatocellular carcinoma is the most common primary malignant hepatic tumor and occurs most often in the setting of chronic liver disease. Liver transplantation is a curative treatment option and is an ideal solution because it solves the chronic underlying liver disorder while removing the malignant lesion. However, due to organ shortages, this treatment can only be applied to carefully selected patients according to clinical guidelines. Artificial intelligence is an emerging technology with multiple applications in medicine with a predilection for domains that work with medical imaging, like radiology. With the help of these technologies, laborious tasks can be automated, and new lesion imaging criteria can be developed based on pixel-level analysis. Our objectives are to review the developing AI applications that could be implemented to better stratify liver transplant candidates. The papers analysed applied AI for liver segmentation, evaluation of steatosis, sarcopenia assessment, lesion detection, segmentation, and characterization. A liver transplant is an optimal treatment for patients with hepatocellular carcinoma in the setting of chronic liver disease. Furthermore, AI could provide solutions for improving the management of liver transplant candidates to improve survival.

Preoperative and Prognostic Prediction of Microvascular Invasion in Hepatocellular Carcinoma: A Review Based on Artificial Intelligence

Microvascular invasion of hepatocellular carcinoma is an important factor affecting tumor recurrence after liver resection and liver transplantation. There are many ways to classify microvascular invasion, however, an international consensus is urgently needed. Recently, artificial intelligence has emerged as an important tool for improving the clinical management of hepatocellular carcinoma. Many studies about microvascular invasion currently focus on preoperative and prognosis prediction of microvascular invasion using artificial intelligence. In this paper, we review the definition and staging of microvascular invasion, especially the diagnosis of it by using artificial intelligence. In preoperative prediction, deep learning based on multimodal data modeling of radiomics-screened features, clinical features, and medical images is currently the most effective means. In prognostic prediction, pathology is the gold standard, and the techniques used should more effectively utilize the global features of the pathology images.

The Role of Radiomics and AI Technologies in the Segmentation, Detection, and Management of Hepatocellular Carcinoma

Hepatocellular carcinoma (HCC) is the most common primary hepatic neoplasm. Thanks to recent advances in computed tomography (CT) and magnetic resonance imaging (MRI), there is potential to improve detection, segmentation, discrimination from HCC mimics, and monitoring of therapeutic response. Radiomics, artificial intelligence (AI), and derived tools have already been applied in other areas of diagnostic imaging with promising results. In this review, we briefly discuss the current clinical applications of radiomics and AI in the detection, segmentation, and management of HCC. Moreover, we investigate their potential to reach a more accurate diagnosis of HCC and to guide proper treatment planning.

A preoperative model based on gadobenate-enhanced MRI for predicting microvascular invasion in hepatocellular carcinomas (≤ 5 cm)

Purpose

The present study aimed to develop and validate a preoperative model based on gadobenate-enhanced magnetic resonance imaging (MRI) for predicting microvascular invasion (MVI) in patients with hepatocellular carcinoma (HCC) size of ≤5 cm. In order to provide preoperative guidance for clinicians to optimize treatment options.

Methods

164 patients with pathologically confirmed HCC and preoperative gadobenate-enhanced MRI from July 2016 to December 2020 were retrospectively included. Univariate and multivariate logistic regression (forward LR) analyses were used to determine the predictors of MVI and the model was established. Four-fold cross validation was used to verify the model, which was visualized by nomograms. The predictive performance of the model was evaluated based on discrimination, calibration, and clinical utility.

Results

Elevated alpha-fetoprotein (HR 1.849, 95% CI: 1.193, 2.867, P=0.006), atypical enhancement pattern (HR 3.441, 95% CI: 1.523, 7.772, P=0.003), peritumoral hypointensity on HBP (HR 7.822, 95% CI: 3.317, 18.445, P<0.001), and HBP hypointensity (HR 3.258, 95% CI: 1.381, 7.687, P=0.007) were independent risk factors to MVI and constituted the HBP model. The mean area under the curve (AUC), sensitivity, specificity, and accuracy values for the HBP model were as follows: 0.830 (95% CI: 0.784, 0.876), 0.71, 0.78, 0.81 in training set; 0.826 (95% CI:0.765, 0.887), 0.8, 0.7, 0.79 in test set. The decision curve analysis (DCA) curve showed that the HBP model achieved great clinical benefits.

Conclusion

In conclusion, the HBP imaging features of Gd-BOPTA-enhanced MRI play an important role in predicting MVI for HCC. A preoperative model, mainly based on HBP imaging features of gadobenate-enhanced MRI, was able to excellently predict the MVI for HCC size of ≤5cm. The model may help clinicians preoperatively assess the risk of MVI in HCC patients so as to guide clinicians to optimize treatment options.

MVI-Mind: A Novel Deep-Learning Strategy Using Computed Tomography (CT)-Based Radiomics for End-to-End High Efficiency Prediction of Microvascular Invasion in Hepatocellular Carcinoma

Simple Summary

Microvascular invasion is an important indicator for reflecting the prognosis of hepatocellular carcinoma, but the traditional diagnosis requires a postoperative pathological examination. This study is the first to propose an end-to-end deep learning architecture for predicting microvascular invasion in hepatocellular carcinoma by collecting retrospective data. This method can achieve noninvasive, accurate and efficient preoperative prediction only through the patient’s radiomic data, which is very beneficial to doctors for clinical decision making in HCC patients.

Abstract

Microvascular invasion (MVI) in hepatocellular carcinoma (HCC) directly affects a patient’s prognosis. The development of preoperative noninvasive diagnostic methods is significant for guiding optimal treatment plans. In this study, we investigated 138 patients with HCC and presented a novel end-to-end deep learning strategy based on computed tomography (CT) radiomics (MVI-Mind), which integrates data preprocessing, automatic segmentation of lesions and other regions, automatic feature extraction, and MVI prediction. A lightweight transformer and a convolutional neural network (CNN) were proposed for the segmentation and prediction modules, respectively. To demonstrate the superiority of MVI-Mind, we compared the framework’s performance with that of current, mainstream segmentation, and classification models. The test results showed that MVI-Mind returned the best performance in both segmentation and prediction. The mean intersection over union (mIoU) of the segmentation module was 0.9006, and the area under the receiver operating characteristic curve (AUC) of the prediction module reached 0.9223. Additionally, it only took approximately 1 min to output a prediction for each patient, end-to-end using our computing device, which indicated that MVI-Mind could noninvasively, efficiently, and accurately predict the presence of MVI in HCC patients before surgery. This result will be helpful for doctors to make rational clinical decisions.