Diagnostic performance of commercially available vs. in-house radiomics software in classification of CT images from patients with pancreatic ductal adenocarcinoma vs. healthy controls

Diagnostic Accuracy of Radiomics in the Early Detection of Pancreatic Cancer: A Systematic Review and Qualitative Assessment Using the Methodological Radiomics Score (METRICS)

BACKGROUND/OBJECTIVES

Pancreatic ductal adenocarcinoma (PDAC) is an aggressive and lethal malignancy with increasing incidence and low survival rate, primarily due to the late detection of the disease. Radiomics has demonstrated its utility in recognizing patterns and anomalies not perceptible to the human eye. This systematic literature review aims to assess the application of radiomics in the analysis of pancreatic parenchyma images to identify early indicators predictive of PDAC.

METHODS

A systematic search of original research papers was performed on three databases: PubMed, Embase, and Scopus. Two reviewers applied the inclusion and exclusion criteria, and one expert solved conflicts for selecting the articles. After extraction and analysis of the data, there was a quality assessment of these articles using the Methodological Radiomics Score (METRICS) tool. The METRICS assessment was carried out by two raters, and conflicts were solved by a third reviewer.

RESULTS

Ten articles for analysis were retrieved. CT scan was the diagnostic imaging used in all the articles. All the studies were retrospective and published between 2019 and 2024. The main objective of the articles was to generate radiomics-based machine learning models able to differentiate pancreatic tumors from healthy tissue. The reported diagnostic performance of the model chosen yielded very high results, with a diagnostic accuracy between 86.5% and 99.2%. Texture and shape features were the most frequently implemented. The METRICS scoring assessment demonstrated that three articles obtained a moderate quality, five a good quality, and, finally, two articles yielded excellent quality. The lack of external validation and available model, code, and data were the major limitations according to the qualitative assessment.

CONCLUSIONS

There is high heterogeneity in the research question regarding radiomics and pancreatic cancer. The principal limitations of the studies were mainly due to the nature of the trials and the considerable heterogeneity of the radiomic features reported. Nonetheless, the work in this field is promising, and further studies are still required to adopt radiomics in the early detection of PDAC.

A Radiomics-Based Nomogram Using Ultrasound Carotid Plaque Evaluation For Predicting Cerebro-Cardiovascular Events In Asymptomatic Patients

RATIONALE AND OBJECTIVES

This study aims to assess whether a radiomics-based nomogram correlates with a higher risk of future cerebro-cardiovascular events in patients with asymptomatic carotid plaques. Additionally, it investigates the nomogram's contribution to the revised Framingham Stroke Risk Profile (rFSRP) for predicting cerebro-cardiovascular risk.

MATERIALS AND METHODS

Predictive models aimed at identifying an increased risk of future cerebro-cardiovascular events were developed and internally validated at one center, then externally validated at two other centers. Survival curves, constructed using the Kaplan-Meier method, were compared through the log-rank test.

RESULTS

This study included a total of 2009 patients (3946 images). The final nomogram was generated using multivariate Cox regression variables, including dyslipidemia, lumen diameter, plaque echogenicity, and ultrasonography (US)-based radiomics risk. The Harrell's concordance index (C-index) for predicting events-free survival (EFS) was 0.708 in the training cohort, 0.574 in the external validation cohort 1, 0.632 in the internal validation cohort, and 0.639 in the external validation cohort 2. The final nomogram showed a significant increase in C-index compared to the clinical, conventional US, and US-based radiomics models (all P < 0.05). Furthermore, the final nomogram-assisted method significantly improved the sensitivity and accuracy of radiologists' visual qualitative score of plaque (both P < 0.001). Among 1058 patients with corresponding 1588 plaque US images classified as low-risk by the rFSRP, 75 (7.1%) patients with corresponding 93 (5.9%) carotid plaque images were appropriately reclassified to the high-risk category by the final nomogram.

CONCLUSION

The radiomics-based nomogram demonstrated accurate prediction of cerebro-cardiovascular events in patients with asymptomatic carotid plaques. It also improved the sensitivity and accuracy of radiologists' visual qualitative score of carotid plaque and enhanced the risk stratification ability of rFSRP.

SUMMARY

The radiomics-based nomogram allowed accurate prediction of cerebro-cardiovascular events, especially ipsilateral ischemic stroke in patients with asymptomatic carotid atherosclerotic plaques.

KEY RESULTS

The radiomics-based nomogram allowed accurate prediction of cerebro-cardiovascular events, especially ipsilateral ischemic stroke in patients with asymptomatic carotid atherosclerotic plaques. The radiomics-based nomogram improved the sensitivity and accuracy of radiologists' visual qualitative score of carotid plaque. The radiomics-based nomogram improved the discrimination of high-risk populations from low-risk populations in asymptomatic patients with carotid atherosclerotic plaques and the risk stratification capability of the rFSRP.

Pancreatic Adenocarcinoma: Imaging Modalities and the Role of Artificial Intelligence in Analyzing CT and MRI Images

Pancreatic ductal adenocarcinoma (PDAC) stands out as the predominant malignant neoplasm affecting the pancreas, characterized by a poor prognosis, in most cases patients being diagnosed in a nonresectable stage. Image-based artificial intelligence (AI) models implemented in tumor detection, segmentation, and classification could improve diagnosis with better treatment options and increased survival. This review included papers published in the last five years and describes the current trends in AI algorithms used in PDAC. We analyzed the applications of AI in the detection of PDAC, segmentation of the lesion, and classification algorithms used in differential diagnosis, prognosis, and histopathological and genomic prediction. The results show a lack of multi-institutional collaboration and stresses the need for bigger datasets in order for AI models to be implemented in a clinically relevant manner.

Setting the Research Agenda for Clinical Artificial Intelligence in Pancreatic Adenocarcinoma Imaging

Simple Summary

Pancreatic ductal adenocarcinoma (PDAC) is one of the deadliest cancers worldwide, associated with a 98% loss of life expectancy and a 30% increase in disability-adjusted life years. Image-based artificial intelligence (AI) can help improve outcomes for PDAC given that current clinical guidelines are non-uniform and lack evidence-based consensus. However, research on image-based AI for PDAC is too scattered and lacking in sufficient quality to be incorporated into clinical workflows. In this review, an international, multi-disciplinary team of the world’s leading experts in pancreatic cancer breaks down the patient pathway and pinpoints the current clinical touchpoints in each stage. The available PDAC imaging AI literature addressing each pathway stage is then rigorously analyzed, and current performance and pitfalls are identified in a comprehensive overview. Finally, the future research agenda for clinically relevant, image-driven AI in PDAC is proposed.

Abstract

Pancreatic ductal adenocarcinoma (PDAC), estimated to become the second leading cause of cancer deaths in western societies by 2030, was flagged as a neglected cancer by the European Commission and the United States Congress. Due to lack of investment in research and development, combined with a complex and aggressive tumour biology, PDAC overall survival has not significantly improved the past decades. Cross-sectional imaging and histopathology play a crucial role throughout the patient pathway. However, current clinical guidelines for diagnostic workup, patient stratification, treatment response assessment, and follow-up are non-uniform and lack evidence-based consensus. Artificial Intelligence (AI) can leverage multimodal data to improve patient outcomes, but PDAC AI research is too scattered and lacking in quality to be incorporated into clinical workflows. This review describes the patient pathway and derives touchpoints for image-based AI research in collaboration with a multi-disciplinary, multi-institutional expert panel. The literature exploring AI to address these touchpoints is thoroughly retrieved and analysed to identify the existing trends and knowledge gaps. The results show absence of multi-institutional, well-curated datasets, an essential building block for robust AI applications. Furthermore, most research is unimodal, does not use state-of-the-art AI techniques, and lacks reliable ground truth. Based on this, the future research agenda for clinically relevant, image-driven AI in PDAC is proposed.

Application of Unenhanced Computed Tomography Texture Analysis to Differentiate Pancreatic Adenosquamous Carcinoma from Pancreatic Ductal Adenocarcinoma

OBJECTIVE

The objective of this study was to investigate the application of unenhanced computed tomography (CT) texture analysis in differentiating pancreatic adenosquamous carcinoma (PASC) from pancreatic ductal adenocarcinoma (PDAC).

METHODS

Preoperative CT images of 112 patients (31 with PASC, 81 with PDAC) were retrospectively reviewed. A total of 396 texture parameters were extracted from AnalysisKit software for further texture analysis. Texture features were selected for the differentiation of PASC and PDAC by the Mann-Whitney U test, univariate logistic regression analysis, and the minimum redundancy maximum relevance algorithm. Furthermore, receiver operating characteristic (ROC) curve analysis was performed to evaluate the diagnostic performance of the texture feature-based model by the random forest (RF) method. Finally, the robustness and reproducibility of the predictive model were assessed by the 10-times leave-group-out cross-validation (LGOCV) method.

RESULTS

In the present study, 10 texture features to differentiate PASC from PDAC were eventually retained for RF model construction after feature selection. The predictive model had a good classification performance in differentiating PASC from PDAC, with the following characteristics: sensitivity, 95.7%; specificity, 92.5%; accuracy, 94.3%; positive predictive value (PPV), 94.3%; negative predictive value (NPV), 94.3%; and area under the ROC curve (AUC), 0.98. Moreover, the predictive model was proved to be robust and reproducible using the 10-times LGOCV algorithm (sensitivity, 90.0%; specificity, 71.3%; accuracy, 76.8%; PPV, 59.0%; NPV, 95.2%; and AUC, 0.80).

CONCLUSION

The unenhanced CT texture analysis has great potential for differentiating PASC from PDAC.

The impact of radiomics in diagnosis and staging of pancreatic cancer

INTRODUCTION

Pancreatic cancer (PC) is one of the most aggressive tumours, and better risk stratification among patients is required to provide tailored treatment. The meaning of radiomics and texture analysis as predictive techniques are not already systematically assessed. The aim of this study is to assess the role of radiomics in PC.

METHODS

A PubMed/MEDLINE and Embase systematic review was conducted to assess the role of radiomics in PC. The search strategy was 'radiomics [All Fields] AND ("pancreas" [MeSH Terms] OR "pancreas" [All Fields] OR "pancreatic" [All Fields])' and only original articles referred to PC in humans in the English language were considered.

RESULTS

A total of 123 studies and 183 studies were obtained using the mentioned search strategy on PubMed and Embase, respectively. After the complete selection process, a total of 56 papers were considered eligible for the analysis of the results. Radiomics methods were applied in PC for assessment technical feasibility and reproducibility aspects analysis, risk stratification, biologic or genomic status prediction and treatment response prediction.

DISCUSSION

Radiomics seems to be a promising approach to evaluate PC from diagnosis to treatment response prediction. Further and larger studies are required to confirm the role and allowed to include radiomics parameter in a comprehensive decision support system.

Pre-operative radiomics model for prognostication in resectable pancreatic adenocarcinoma with external validation

OBJECTIVES

In resectable pancreatic ductal adenocarcinoma (PDAC), few pre-operative prognostic biomarkers are available. Radiomics has demonstrated potential but lacks external validation. We aimed to develop and externally validate a pre-operative clinical-radiomic prognostic model.

METHODS

Retrospective international, multi-center study in resectable PDAC. The training cohort included 352 patients (pre-operative CTs from five Canadian hospitals). Cox models incorporated (a) pre-operative clinical variables (clinical), (b) clinical plus CT-radiomics, and (c) post-operative TNM model, which served as the reference. Outcomes were overall (OS)/disease-free survival (DFS). Models were assessed in the validation cohort from Ireland (n = 215, CTs from 34 hospitals), using C-statistic, calibration, and decision curve analyses.

RESULTS

The radiomic signature was predictive of OS/DFS in the validation cohort, with adjusted hazard ratios (HR) 2.87 (95% CI: 1.40-5.87, p < 0.001)/5.28 (95% CI 2.35-11.86, p < 0.001), respectively, along with age 1.02 (1.01-1.04, p = 0.01)/1.02 (1.00-1.04, p = 0.03). In the validation cohort, median OS was 22.9/37 months (p = 0.0092) and DFS 14.2/29.8 (p = 0.0023) for high-/low-risk groups and calibration was moderate (mean absolute errors 7%/13% for OS at 3/5 years). The clinical-radiomic model discrimination (C = 0.545, 95%: 0.543-0.546) was higher than the clinical model alone (C = 0.497, 95% CI 0.496-0.499, p < 0.001) or TNM (C = 0.525, 95% CI: 0.524-0.526, p < 0.001). Despite superior net benefit compared to the clinical model, the clinical-radiomic model was not clinically useful for most threshold probabilities.

CONCLUSION

A multi-institutional pre-operative clinical-radiomic model for resectable PDAC prognostication demonstrated superior net benefit compared to a clinical model but limited clinical utility at external validation. This reflects inherent limitations of radiomics for PDAC prognostication, when deployed in real-world settings.

KEY POINTS

• At external validation, a pre-operative clinical-radiomics prognostic model for pancreatic ductal adenocarcinoma (PDAC) outperformed pre-operative clinical variables alone or pathological TNM staging. • Discrimination and clinical utility of the clinical-radiomic model for treatment decisions remained low, likely due to heterogeneity of CT acquisition parameters. • Despite small improvements, prognosis in PDAC using state-of-the-art radiomics methodology remains challenging, mostly owing to its low discriminative ability. Future research should focus on standardization of CT protocols and acquisition parameters.

Preoperative differentiation of serous cystic neoplasms from mucin-producing pancreatic cystic neoplasms using a CT-based radiomics nomogram

PURPOSE

To develop and validate a CT-based radiomics nomogram in preoperative differential diagnosis of SCNs from mucin-producing PCNs.

MATERIAL AND METHODS

A total of 89 patients consisting of 31 SCNs, 30 IPMNs, and 28 MCNs who underwent preoperative CT were analyzed. A total of 710 radiomics features were extracted from each case. Patients were divided into training (n = 63) and validation cohorts (n = 26) with a ratio of 7:3. Least absolute shrinkage and selection operator (LASSO) method and logistic regression analysis were used for feature selection and model construction. A nomogram was created from a comprehensive model consisting of clinical features and the fusion radiomics signature. A decision curve analysis was used for clinical decisions.

RESULTS

The radiomics features extracted from CT could assist with the differentiation of SCNs from mucin-producing PCNs in both the training and validation cohorts. The signature of the combination of the plain, late arterial, and venous phases had the largest areas under the curve (AUCs) of 0.960 (95% CI 0.910-1) in the training cohort and 0.817 (95% CI 0.651-0.983) in the validation cohort with good calibration. The value and efficacy of the nomogram was verified using decision curve analysis.

CONCLUSION

A comprehensive nomogram incorporating clinical features and fusion radiomics signature can differentiate SCNs from mucin-producing PCNs.

Pancreas adenocarcinoma CT texture analysis: comparison of 3D and 2D tumor segmentation techniques

PURPOSE

To determine equivalency of multi-slice 3D CTTA and single slice 2D CTTA of pancreas adenocarcinoma.

METHODS

This retrospective study was research ethics board approved. Untreated pancreas adenocarcinomas were segmented on CT in 128 consecutive patients. Tumor segmentation was compared using two techniques: 3D segmentation by contouring all visible tumor in a 3D volume, and 2D segmentation using only a single axial image. First-order CTTA features including mean, minimum, maximum Hounsfield units (HU), standard deviation, skewness, kurtosis, entropy, and second-order gray-level co-occurrence matrix (GLCM) features homogeneity, contrast, correlation, entropy and dissimilarity were extracted. Median values were compared using the Mann-Whitney U test with Holm-Bonferroni correction. Kendall's Rank Correlation Tau assessed for correlation, and agreement was calculated using intraclass correlation coefficients (ICC) using a two-way model with single rating and absolute agreement. Statistical significance defined as P < 0.05.

RESULTS

The median values of CTTA features differed significantly between 3 and 2D segmentations for all of the evaluated features except for mean attenuation, standard deviation and skewness (P = 0.2979 each). 3D and 2D segmentations had moderate correlation for mean attenuation (R = 0.69, P < 0.01), while all other features demonstrated poor to fair correlation. Agreement between 3 and 2D segmentations was good for mean attenuation (ICC: 0.87, P < 0.01), moderate for minimum (ICC: 0.65, P < 0.01) and standard deviation (ICC: 0.56, P < 0.01), and poor for all other features.

CONCLUSION

While pancreas adenocarcinoma CTTA features obtained using 3D and 2D segmentation have multiple associations with clinically relevant outcomes, these segmentation techniques are likely not interchangeable other than for mean HU.

CT and MRI of pancreatic tumors: an update in the era of radiomics

Radiomics is a relatively new approach for image analysis. As a part of radiomics, texture analysis, which consists in extracting a great amount of quantitative data from original images, can be used to identify specific features that can help determining the actual nature of a pancreatic lesion and providing other information such as resectability, tumor grade, tumor response to neoadjuvant therapy or survival after surgery. In this review, the basic of radiomics, recent developments and the results of texture analysis using computed tomography and magnetic resonance imaging in the field of pancreatic tumors are presented. Future applications of radiomics, such as artificial intelligence, are discussed.

Defining best practices for tissue procurement in immuno-oncology clinical trials: consensus statement from the Society for Immunotherapy of Cancer Surgery Committee

Immunotherapy is now a cornerstone for cancer treatment, and much attention has been placed on the identification of prognostic and predictive biomarkers. The success of biomarker development is dependent on accurate and timely collection of biospecimens and high-quality processing, storage and shipping. Tumors are also increasingly used as source material for the generation of therapeutic T cells. There have been few guidelines or consensus statements on how to optimally collect and manage biospecimens and source material being used for immunotherapy and related research. The Society for Immunotherapy of Cancer Surgery Committee has brought together surgical experts from multiple subspecialty disciplines to identify best practices and to provide consensus on how best to access and manage specific tissues for immuno-oncology treatments and clinical investigation. In addition, the committee recommends early integration of surgeons and other interventional physicians with expertise in biospecimen collection, especially in clinical trials, to optimize the quality of tissue and the validity of correlative clinical studies in cancer immunotherapy.

Pancreatic Cancer Imaging: A New Look at an Old Problem

Computed tomography is the most commonly used imaging modality to detect and stage pancreatic cancer. Previous advances in pancreatic cancer imaging have focused on optimizing image acquisition parameters and reporting standards. However, current state-of-the-art imaging approaches still misdiagnose some potentially curable pancreatic cancers and do not provide prognostic information or inform optimal management strategies beyond stage. Several recent developments in pancreatic cancer imaging, including artificial intelligence and advanced visualization techniques, are rapidly changing the field. The purpose of this article is to review how these recent advances have the potential to revolutionize pancreatic cancer imaging.