Prognostic Value of Transfer Learning Based Features in Resectable Pancreatic Ductal Adenocarcinoma

Multiscale deep learning radiomics for predicting recurrence-free survival in pancreatic cancer: A multicenter study

PURPOSE

This multicenter study aimed to develop and validate a multiscale deep learning radiomics nomogram for predicting recurrence-free survival (RFS) in patients with pancreatic ductal adenocarcinoma (PDAC).

MATERIALS AND METHODS

A total of 469 PDAC patients from four hospitals were divided into training and test sets. Handcrafted radiomics and deep learning (DL) features were extracted from optimal regions of interest, encompassing both intratumoral and peritumoral areas. Univariate Cox regression, LASSO regression, and multivariate Cox regression selected features for three image signatures (intratumoral, peritumoral radiomics, and DL). A multiscale nomogram was constructed and validated against the 8th AJCC staging system.

RESULTS

The 4 mm peritumoral VOI yielded the best radiomics prediction, while a 15 mm expansion was optimal for deep learning. The multiscale nomogram demonstrated a C-index of 0.82 (95 % CI: 0.78-0.85) in the training set and 0.70 (95 % CI: 0.64-0.76) in the external test 1 (high-volume hospital), with the external test 2 (low-volume hospital) showing a C-index of 0.78 (95 % CI: 0.65-0.91). These outperformed the AJCC system's C-index (0.54-0.57). The area under the curve (AUC) for recurrence prediction at 0.5, 1, and 2 years was 0.89, 0.94, and 0.89 in the training set, with AUC values ranging from 0.75 to 0.97 in the external validation sets, consistently surpassing the AJCC system across all sets. Kaplan-Meier analysis confirmed significant differences in prognosis between high- and low-risk groups (P < 0.01 across all cohorts).

CONCLUSION

The multiscale nomogram effectively stratifies recurrence risk in PDAC patients, enhancing presurgical clinical decision-making and potentially improving patient outcomes.

Deep Learning Radiomics for Survival Prediction in Non-Small-Cell Lung Cancer Patients from CT Images

This study aims to apply a multi-modal approach of the deep learning method for survival prediction in patients with non-small-cell lung cancer (NSCLC) using CT-based radiomics. We utilized two public data sets from the Cancer Imaging Archive (TCIA) comprising NSCLC patients, 420 patients and 516 patients for Lung 1 training and Lung 2 testing, respectively. A 3D convolutional neural network (CNN) survival was applied to extract 256 deep-radiomics features for each patient from a CT scan. Feature selection steps are used to choose the radiomics signatures highly associated with overall survival. Deep-radiomics and traditional-radiomics signatures, and clinical parameters were fed into the DeepSurv neural network. The C-index was used to evaluate the model's effectiveness. In the Lung 1 training set, the model combining traditional-radiomics and deep-radiomics performs better than the single parameter models, and models that combine all three markers (traditional-radiomics, deep-radiomics, and clinical) are most effective with C-index 0.641 for Cox proportional hazards (Cox-PH) and 0.733 for DeepSurv approach. In the Lung 2 testing set, the model combining traditional-radiomics, deep-radiomics, and clinical obtained a C-index of 0.746 for Cox-PH and 0.751 for DeepSurv approach. The DeepSurv method improves the model's prediction compared to the Cox-PH, and models that combine all three parameters with the DeepSurv have the highest efficiency in training and testing data sets (C-index: 0.733 and 0.751, respectively). DeepSurv CT-based deep-radiomics method outperformed Cox-PH in survival prediction of patients with NSCLC patients. Models' efficiency is increased when combining multi parameters.

Radiomics analysis with three-dimensional and two-dimensional segmentation to predict survival outcomes in pancreatic cancer

BACKGROUND

Radiomics can assess prognostic factors in several types of tumors, but considering its prognostic ability in pancreatic cancer has been lacking.

AIM

To evaluate the performance of two different radiomics software in assessing survival outcomes in pancreatic cancer patients.

METHODS

We retrospectively reviewed pretreatment contrast-enhanced dual-energy computed tomography images from 48 patients with biopsy-confirmed pancreatic ductal adenocarcinoma who later underwent neoadjuvant chemoradiation and surgery. Tumors were segmented using TexRad software for 2-dimensional (2D) analysis and MIM software for 3D analysis, followed by radiomic feature extraction. Cox proportional hazard modeling correlated texture features with overall survival (OS) and progression-free survival (PFS). Cox regression was used to detect differences in OS related to pretreatment tumor size and residual tumor following treatment. The Wilcoxon test was used to show the relationship between tumor volume and the percent of residual tumor. Kaplan-Meier analysis was used to compare survival in patients with different tumor densities in Hounsfield units for both 2D and 3D analysis.

RESULTS

3D analysis showed that higher mean tumor density [hazard ratio (HR) = 0.971, P = 0.041)] and higher median tumor density (HR = 0.970, P = 0.037) correlated with better OS. 2D analysis showed that higher mean tumor density (HR = 0.963, P = 0.014) and higher mean positive pixels (HR = 0.962, P = 0.014) correlated with better OS; higher skewness (HR = 3.067, P = 0.008) and higher kurtosis (HR = 1.176, P = 0.029) correlated with worse OS. Higher entropy correlated with better PFS (HR = 0.056, P = 0.036). Models determined that patients with increased tumor size greater than 1.35 cm were likely to have a higher percentage of residual tumors of over 10%.

CONCLUSION

Several radiomics features can be used as prognostic tools for pancreatic cancer. However, results vary between 2D and 3D analyses. Mean tumor density was the only variable that could reliably predict OS, irrespective of the analysis used.

AI-enabled routine H&E image based prognostic marker for early-stage luminal breast cancer

Breast cancer (BC) grade is a well-established subjective prognostic indicator of tumour aggressiveness. Tumour heterogeneity and subjective assessment result in high degree of variability among observers in BC grading. Here we propose an objective Haematoxylin & Eosin (H&E) image-based prognostic marker for early-stage luminal/Her2-negative BReAst CancEr that we term as the BRACE marker. The proposed BRACE marker is derived from AI based assessment of heterogeneity in BC at a detailed level using the power of deep learning. The prognostic ability of the marker is validated in two well-annotated cohorts (Cohort-A/Nottingham: n = 2122 and Cohort-B/Coventry: n = 311) on early-stage luminal/HER2-negative BC patients treated with endocrine therapy and with long-term follow-up. The BRACE marker is able to stratify patients for both distant metastasis free survival (p = 0.001, C-index: 0.73) and BC specific survival (p < 0.0001, C-index: 0.84) showing comparable prediction accuracy to Nottingham Prognostic Index and Magee scores, which are both derived from manual histopathological assessment, to identify luminal BC patients that may be likely to benefit from adjuvant chemotherapy.

CT classification model of pancreatic serous cystic neoplasm and mucinous cystic neoplasm based on deep transfer learning

BACKGROUND

Pancreatic cancer is a highly lethal disease. The preoperative distinction between pancreatic serous cystic neoplasm (SCN) and mucinous cystic neoplasm (MCN) remains a clinical challenge.

OBJECTIVE

The goal of this study is to provide clinicians with supportive advice and avoid overtreatment by constructing a convolutional neural network (CNN) classifier to automatically identify pancreatic cancer using computed tomography (CT) images.

METHODS

We construct a CNN model using a dataset of 6,173 CT images obtained from 107 pathologically confirmed pancreatic cancer patients at Shanghai Changhai Hospital from January 2017 to February 2022. We divide CT slices into three categories namely, SCN, MCN, and no tumor, to train the DenseNet201-based CNN model with multi-head spatial attention mechanism (MSAM-DenseNet201). The attention module enhances the network's attention to local features and effectively improves the network performance. The trained model is applied to process all CT image slices and finally realize the two categories classification of MCN and SCN patients through a joint voting strategy.

RESULTS

Using a 10-fold cross validation method, this new MSAM-DenseNet201 model achieves a classification accuracy of 92.52%, a precision of 92.16%, a sensitivity of 92.16%, and a specificity of 92.86%, respectively.

CONCLUSIONS

This study demonstrates the feasibility of using a deep learning network or classification model to help diagnose MCN and SCN cases. This, the new method has great potential for developing new computer-aided diagnosis systems and applying in future clinical practice.

Bladder Cancer Radiation Oncology of the Future: Prognostic Modelling, Radiomics, and Treatment Planning With Artificial Intelligence

Machine learning (ML) and artificial intelligence (AI) have demonstrated potential to improve the care of radiation oncology patients. Here we review recent advances applicable to the care of bladder cancer, with an eye towards studies that may suggest next steps in clinical implementation. Algorithms have been applied to clinical records, pathology, and radiology data to generate accurate predictive models for prognosis and clinical outcomes. AI has also shown increasing utility for auto-contouring and efficient creation of workflows involving multiple treatment plans. As technologies progress towards routine clinical use for bladder cancer patients, we also discuss emerging methods to improve interpretability and reliability of algorithms.

Deep learning based radiomics for gastrointestinal cancer diagnosis and treatment: A minireview

Gastrointestinal (GI) cancers are the major cause of cancer-related mortality globally. Medical imaging is an important auxiliary means for the diagnosis, assessment and prognostic prediction of GI cancers. Radiomics is an emerging and effective technology to decipher the encoded information within medical images, and traditional machine learning is the most commonly used tool. Recent advances in deep learning technology have further promoted the development of radiomics. In the field of GI cancer, although there are several surveys on radiomics, there is no specific review on the application of deep-learning-based radiomics (DLR). In this review, a search was conducted on Web of Science, PubMed, and Google Scholar with an emphasis on the application of DLR for GI cancers, including esophageal, gastric, liver, pancreatic, and colorectal cancers. Besides, the challenges and recommendations based on the findings of the review are comprehensively analyzed to advance DLR.

Radiomics-based Machine-learning Models Can Detect Pancreatic Cancer on Prediagnostic Computed Tomography Scans at a Substantial Lead Time Before Clinical Diagnosis

BACKGROUND & AIMS

Our purpose was to detect pancreatic ductal adenocarcinoma (PDAC) at the prediagnostic stage (3-36 months before clinical diagnosis) using radiomics-based machine-learning (ML) models, and to compare performance against radiologists in a case-control study.

METHODS

Volumetric pancreas segmentation was performed on prediagnostic computed tomography scans (CTs) (median interval between CT and PDAC diagnosis: 398 days) of 155 patients and an age-matched cohort of 265 subjects with normal pancreas. A total of 88 first-order and gray-level radiomic features were extracted and 34 features were selected through the least absolute shrinkage and selection operator-based feature selection method. The dataset was randomly divided into training (292 CTs: 110 prediagnostic and 182 controls) and test subsets (128 CTs: 45 prediagnostic and 83 controls). Four ML classifiers, k-nearest neighbor (KNN), support vector machine (SVM), random forest (RM), and extreme gradient boosting (XGBoost), were evaluated. Specificity of model with highest accuracy was further validated on an independent internal dataset (n = 176) and the public National Institutes of Health dataset (n = 80). Two radiologists (R4 and R5) independently evaluated the pancreas on a 5-point diagnostic scale.

RESULTS

Median (range) time between prediagnostic CTs of the test subset and PDAC diagnosis was 386 (97-1092) days. SVM had the highest sensitivity (mean; 95% confidence interval) (95.5; 85.5-100.0), specificity (90.3; 84.3-91.5), F1-score (89.5; 82.3-91.7), area under the curve (AUC) (0.98; 0.94-0.98), and accuracy (92.2%; 86.7-93.7) for classification of CTs into prediagnostic versus normal. All 3 other ML models, KNN, RF, and XGBoost, had comparable AUCs (0.95, 0.95, and 0.96, respectively). The high specificity of SVM was generalizable to both the independent internal (92.6%) and the National Institutes of Health dataset (96.2%). In contrast, interreader radiologist agreement was only fair (Cohen's kappa 0.3) and their mean AUC (0.66; 0.46-0.86) was lower than each of the 4 ML models (AUCs: 0.95-0.98) (P < .001). Radiologists also recorded false positive indirect findings of PDAC in control subjects (n = 83) (7% R4, 18% R5).

CONCLUSIONS

Radiomics-based ML models can detect PDAC from normal pancreas when it is beyond human interrogation capability at a substantial lead time before clinical diagnosis. Prospective validation and integration of such models with complementary fluid-based biomarkers has the potential for PDAC detection at a stage when surgical cure is a possibility.

Pancreatic cancer, radiomics and artificial intelligence

Patients with pancreatic ductal adenocarcinoma (PDAC) are generally classified into four categories based on contrast-enhanced CT at diagnosis: resectable, borderline resectable, unresectable, and metastatic disease. In the initial grading and staging of PDAC, structured radiological templates are useful but limited, as there is a need to define the aggressiveness and microscopic disease stage of these tumours to ensure adequate treatment allocation. Quantitative imaging analysis allows radiomics and dynamic imaging features to provide information of clinical outcomes, and to construct clinical models based on radiomics signatures or imaging phenotypes. These quantitative features may be used as prognostic and predictive biomarkers in clinical decision-making, enabling personalised management of advanced PDAC. Deep learning and convolutional neural networks also provide high level bioinformatics tools that can help define features associated with a given aspect of PDAC biology and aggressiveness, paving the way to define outcomes based on these features. Thus, the prediction of tumour phenotype, treatment response and patient prognosis may be feasible by using such comprehensive and integrated radiomics models. Despite these promising results, quantitative imaging is not ready for clinical implementation in PDAC. Limitations include the instability of metrics and lack of external validation. Large properly annotated datasets, including relevant semantic features (demographics, blood markers, genomics), image harmonisation, robust radiomics analysis, clinically significant tasks as outputs, comparisons with gold-standards (such as TNM or pretreatment classifications) and fully independent validation cohorts, will be required for the development of trustworthy radiomics and artificial intelligence solutions to predict PDAC aggressiveness in a clinical setting.

Using Quantitative Imaging for Personalized Medicine in Pancreatic Cancer: A Review of Radiomics and Deep Learning Applications

Simple Summary

With a five-year survival rate of only 3% for the majority of patients, pancreatic cancer is a global healthcare challenge. Radiomics and deep learning, two novel quantitative imaging methods that treat medical images as minable data instead of just pictures, have shown promise in advancing personalized management of pancreatic cancer through diagnosing precursor diseases, early detection, accurate diagnosis, and treatment personalization. Radiomics and deep learning methods aim to collect hidden information in medical images that is missed by conventional radiology practices through expanding the data search and comparing information across different patients. Both methods have been studied and applied in pancreatic cancer. In this review, we focus on the current progress of these two methods in pancreatic cancer and provide a comprehensive narrative review on the topic. With better regulation, enhanced workflow, and larger prospective patient datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through personalized precision medicine.

Abstract

As the most lethal major cancer, pancreatic cancer is a global healthcare challenge. Personalized medicine utilizing cutting-edge multi-omics data holds potential for major breakthroughs in tackling this critical problem. Radiomics and deep learning, two trendy quantitative imaging methods that take advantage of data science and modern medical imaging, have shown increasing promise in advancing the precision management of pancreatic cancer via diagnosing of precursor diseases, early detection, accurate diagnosis, and treatment personalization and optimization. Radiomics employs manually-crafted features, while deep learning applies computer-generated automatic features. These two methods aim to mine hidden information in medical images that is missed by conventional radiology and gain insights by systematically comparing the quantitative image information across different patients in order to characterize unique imaging phenotypes. Both methods have been studied and applied in various pancreatic cancer clinical applications. In this review, we begin with an introduction to the clinical problems and the technology. After providing technical overviews of the two methods, this review focuses on the current progress of clinical applications in precancerous lesion diagnosis, pancreatic cancer detection and diagnosis, prognosis prediction, treatment stratification, and radiogenomics. The limitations of current studies and methods are discussed, along with future directions. With better standardization and optimization of the workflow from image acquisition to analysis and with larger and especially prospective high-quality datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through big data-based high-precision personalization.

Improving prognostic performance in resectable pancreatic ductal adenocarcinoma using radiomics and deep learning features fusion in CT images

As an analytic pipeline for quantitative imaging feature extraction and analysis, radiomics has grown rapidly in the past decade. On the other hand, recent advances in deep learning and transfer learning have shown significant potential in the quantitative medical imaging field, raising the research question of whether deep transfer learning features have predictive information in addition to radiomics features. In this study, using CT images from Pancreatic Ductal Adenocarcinoma (PDAC) patients recruited in two independent hospitals, we discovered most transfer learning features have weak linear relationships with radiomics features, suggesting a potential complementary relationship between these two feature sets. We also tested the prognostic performance for overall survival using four feature fusion and reduction methods for combining radiomics and transfer learning features and compared the results with our proposed risk score-based feature fusion method. It was shown that the risk score-based feature fusion method significantly improves the prognosis performance for predicting overall survival in PDAC patients compared to other traditional feature reduction methods used in previous radiomics studies (40% increase in area under ROC curve (AUC) yielding AUC of 0.84).