A Novel Multiresolution-Statistical Texture Analysis Architecture: Radiomics-Aided Diagnosis of PDAC Based on Plain CT Images

Radiomics in early detection of bilio-pancreatic lesions: A narrative review

Radiomics is transforming the field of early detection of bilio-pancreatic lesions, offering significant advancements in diagnostic accuracy and personalized treatment planning. By extracting high-dimensional data from medical images such as computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET), radiomics reveals complex patterns that remain undetectable through traditional imaging evaluation. This review synthesizes recent developments in radiomics, particularly its application to early detection of pancreatic cancer (PC) and biliary duct cancer (BDC). It highlights the role of machine learning algorithms and multi-parametric models in improving diagnostic performance and discusses challenges such as standardization, reproducibility, and the need for larger, multicenter datasets. The integration of radiomics with genomic data and liquid biopsies also presents future opportunities for more individualized patient care.

A time-dependent explainable radiomic analysis from the multi-omic cohort of CPTAC-Pancreatic Ductal Adenocarcinoma

BACKGROUND AND OBJECTIVE

In Pancreatic Ductal Adenocarcinoma (PDA), multi-omic models are emerging to answer unmet clinical needs to derive novel quantitative prognostic factors. We realized a pipeline that relies on survival machine-learning (SML) classifiers and explainability based on patients' follow-up (FU) to stratify prognosis from the public-available multi-omic datasets of the CPTAC-PDA project.

MATERIALS AND METHODS

Analyzed datasets included tumor-annotated radiologic images, clinical, and mutational data. A feature selection was based on univariate (UV) and multivariate (MV) survival analyses according to Overall Survival (OS) and recurrence (REC). In this study, we considered seven multi-omic datasets and compared four SML classifiers: Cox, survival random forest, generalized boosted, and support vector machines (SVM). For each classifier, we assessed the concordance (C) index on the validation set. The best classifiers for the validation set on both OS and REC underwent explainability analyses using SurvSHAP(t), which extends SHapley Additive exPlanations (SHAP).

RESULTS

According to OS, after UV and MV analyses we selected 18/37 and 10/37 multi-omic features, respectively. According to REC, based on UV and MV analyses we selected 10/35 and 5/35 determinants, respectively. Generally, SML classifiers including radiomics outperformed those modelled on clinical or mutational predictors. For OS, the Cox model encompassing radiomic, clinical, and mutational features reached 75 % of C index, outperforming other classifiers. On the other hand, for REC, the SVM model including only radiomics emerged as the best-performing, with 68 % of C index. For OS, SurvSHAP(t) identified the first order Median Gray Level (GL) intensities, the gender, the tumor grade, the Joint Energy GL Co-occurrence Matrix (GLCM), and the GLCM Informational Measures of Correlations of type 1 as the most important features. For REC, the first order Median GL intensities, the GL size zone matrix Small Area Low GL Emphasis, and first order variance of GL intensities emerged as the most discriminative.

CONCLUSIONS

In this work, radiomics showed the potential for improving patients' risk stratification in PDA. Furthermore, a deeper understanding of how radiomics can contribute to prognosis in PDA was achieved with a time-dependent explainability of the top multi-omic predictors.

[Identifying Novel Coronavirus Pneumonia With CT Images: A Deep Learning Approach With Detail Upsampling and Attention Guidance]

Objective

To construct a deep learning-based target detection method to help radiologists perform rapid diagnosis of lesions in the CT images of patients with novel coronavirus pneumonia (NCP) by restoring detailed information and mining local information.

Methods

We present a deep learning approach that integrates detail upsampling and attention guidance. A linear upsampling algorithm based on bicubic interpolation algorithm was adopted to improve the restoration of detailed information within feature maps during the upsampling phase. Additionally, a visual attention mechanism based on vertical and horizontal spatial dimensions embedded in the feature extraction module to enhance the capability of the object detection algorithm to represent key information related to NCP lesions.

Results

Experimental results on the NCP dataset showed that the detection method based on the detail upsampling algorithm improved the recall rate by 1.07% compared with the baseline model, with the AP50 reaching 85.14%. After embedding the attention mechanism in the feature extraction module, 86.13% AP50, 73.92% recall, and 90.37% accuracy were achieved, which were better than those of the popular object detection models.

Conclusion

The feature information mining of CT images based on deep learning can further improve the lesion detection ability. The proposed approach helps radiologists rapidly identify NCP lesions on CT images and provides an important clinical basis for early intervention and high-intensity monitoring of NCP patients.

Identification of ipsilateral supraclavicular lymph node metastasis in breast cancer based on LASSO regression with a high penalty factor

Aiming at the problems of small sample size and large feature dimension in the identification of ipsilateral supraclavicular lymph node metastasis status in breast cancer using ultrasound radiomics, an optimized feature combination search algorithm is proposed to construct linear classification models with high interpretability. The genetic algorithm (GA) is used to search for feature combinations within the feature subspace using least absolute shrinkage and selection operator (LASSO) regression. The search is optimized by applying a high penalty to the L1 norm of LASSO to retain excellent features in the crossover operation of the GA. The experimental results show that the linear model constructed using this method outperforms those using the conventional LASSO regression and standard GA. Therefore, this method can be used to build linear models with higher classification performance and more robustness.

PST-Radiomics: a PET/CT lymphoma classification method based on pseudo spatial-temporal radiomic features and structured atrous recurrent convolutional neural network

Objective.Existing radiomic methods tend to treat each isolated tumor as an inseparable whole, when extracting radiomic features. However, they may discard the critical intra-tumor metabolic heterogeneity (ITMH) information, that contributes to triggering tumor subtypes. To improve lymphoma classification performance, we propose a pseudo spatial-temporal radiomic method (PST-Radiomics) based on positron emission tomography computed tomography (PET/CT).Approach.Specifically, to enable exploitation of ITMH, we first present a multi-threshold gross tumor volume sequence (GTVS). Next, we extract 1D radiomic features based on PET images and each volume in GTVS and create a pseudo spatial-temporal feature sequence (PSTFS) tightly interwoven with ITMH. Then, we reshape PSTFS to create 2D pseudo spatial-temporal feature maps (PSTFM), of which the columns are elements of PSTFS. Finally, to learn from PSTFM in an end-to-end manner, we build a light-weighted pseudo spatial-temporal radiomic network (PSTR-Net), in which a structured atrous recurrent convolutional neural network serves as a PET branch to better exploit the strong local dependencies in PSTFM, and a residual convolutional neural network is used as a CT branch to exploit conventional radiomic features extracted from CT volumes.Main results.We validate PST-Radiomics based on a PET/CT lymphoma subtype classification task. Experimental results quantitatively demonstrate the superiority of PST-Radiomics, when compared to existing radiomic methods.Significance.Feature map visualization of our method shows that it performs complex feature selection while extracting hierarchical feature maps, which qualitatively demonstrates its superiority.

Current state of radiomics in hepatobiliary and pancreatic malignancies

Rising in incidence, hepatobiliary and pancreatic (HPB) cancers continue to exhibit dismal long-term survival. The overall poor prognosis of HPB cancers is reflective of the advanced stage at which most patients are diagnosed. Late diagnosis is driven by the often-asymptomatic nature of these diseases, as well as a dearth of screening modalities. Additionally, standard imaging modalities fall short of providing accurate and detailed information regarding specific tumor characteristics, which can better inform surgical planning and sequencing of systemic therapy. Therefore, precise therapeutic planning must be delayed until histopathological examination is performed at the time of resection. Given the current shortcomings in the management of HPB cancers, investigations of numerous noninvasive biomarkers, including circulating tumor cells and DNA, proteomics, immunolomics, and radiomics, are underway. Radiomics encompasses the extraction and analysis of quantitative imaging features. Along with summarizing the general framework of radiomics, this review synthesizes the state of radiomics in HPB cancers, outlining its role in various aspects of management, present limitations, and future applications for clinical integration. Current literature underscores the utility of radiomics in early detection, tumor characterization, therapeutic selection, and prognostication for HPB cancers. Seeing as single-center, small studies constitute the majority of radiomics literature, there is considerable heterogeneity with respect to steps of the radiomics workflow such as segmentation, or delineation of the region of interest on a scan. Nonetheless, the introduction of the radiomics quality score (RQS) demonstrates a step towards greater standardization and reproducibility in the young field of radiomics. Altogether, in the setting of continually improving artificial intelligence algorithms, radiomics represents a promising biomarker avenue for promoting enhanced and tailored management of HPB cancers, with the potential to improve long-term outcomes for patients.

Computer-Aided Detection for Pancreatic Cancer Diagnosis: Radiological Challenges and Future Directions

Radiological imaging plays a crucial role in the detection and treatment of pancreatic ductal adenocarcinoma (PDAC). However, there are several challenges associated with the use of these techniques in daily clinical practice. Determination of the presence or absence of cancer using radiological imaging is difficult and requires specific expertise, especially after neoadjuvant therapy. Early detection and characterization of tumors would potentially increase the number of patients who are eligible for curative treatment. Over the last decades, artificial intelligence (AI)-based computer-aided detection (CAD) has rapidly evolved as a means for improving the radiological detection of cancer and the assessment of the extent of disease. Although the results of AI applications seem promising, widespread adoption in clinical practice has not taken place. This narrative review provides an overview of current radiological CAD systems in pancreatic cancer, highlights challenges that are pertinent to clinical practice, and discusses potential solutions for these challenges.

Vision-Language Model for Visual Question Answering in Medical Imagery

In the clinical and healthcare domains, medical images play a critical role. A mature medical visual question answering system (VQA) can improve diagnosis by answering clinical questions presented with a medical image. Despite its enormous potential in the healthcare industry and services, this technology is still in its infancy and is far from practical use. This paper introduces an approach based on a transformer encoder-decoder architecture. Specifically, we extract image features using the vision transformer (ViT) model, and we embed the question using a textual encoder transformer. Then, we concatenate the resulting visual and textual representations and feed them into a multi-modal decoder for generating the answer in an autoregressive way. In the experiments, we validate the proposed model on two VQA datasets for radiology images termed VQA-RAD and PathVQA. The model shows promising results compared to existing solutions. It yields closed and open accuracies of 84.99% and 72.97%, respectively, for VQA-RAD, and 83.86% and 62.37%, respectively, for PathVQA. Other metrics such as the BLUE score showing the alignment between the predicted and true answer sentences are also reported.

Prediction of Suicidal Behaviors in the Middle-aged Population: Machine Learning Analyses of UK Biobank

BACKGROUND

Suicidal behaviors, including suicide deaths and attempts, are major public health concerns. However, previous suicide models required a huge amount of input features, resulting in limited applicability in clinical practice.

OBJECTIVE

We aimed to construct applicable models (ie, with limited features) for short- and long-term suicidal behavior prediction. We further validated these models among individuals with different genetic risks of suicide.

METHODS

Based on the prospective cohort of UK Biobank, we included 223 (0.06%) eligible cases of suicide attempts or deaths, according to hospital inpatient or death register data within 1 year from baseline and randomly selected 4460 (1.18%) controls (1:20) without such records. We similarly identified 833 (0.22%) cases of suicidal behaviors 1 to 6 years from baseline and 16,660 (4.42%) corresponding controls. Based on 143 input features, mainly including sociodemographic, environmental, and psychosocial factors; medical history; and polygenic risk scores (PRS) for suicidality, we applied a bagged balanced light gradient-boosting machine (LightGBM) with stratified 10-fold cross-validation and grid-search to construct the full prediction models for suicide attempts or deaths within 1 year or between 1 and 6 years. The Shapley Additive Explanations (SHAP) approach was used to quantify the importance of input features, and the top 20 features with the highest SHAP values were selected to train the applicable models. The external validity of the established models was assessed among 50,310 individuals who participated in UK Biobank repeated assessments both overall and by the level of PRS for suicidality.

RESULTS

Individuals with suicidal behaviors were on average 56 years old, with equal sex distribution. The application of these full models in the external validation data set demonstrated good model performance, with the area under the receiver operating characteristic (AUROC) curves of 0.919 and 0.892 within 1 year and between 1 and 6 years, respectively. Importantly, the applicable models with the top 20 most important features showed comparable external-validated performance (AUROC curves of 0.901 and 0.885) as the full models, based on which we found that individuals in the top quintile of predicted risk accounted for 91.7% (n=11) and 80.7% (n=25) of all suicidality cases within 1 year and during 1 to 6 years, respectively. We further obtained comparable prediction accuracy when applying these models to subpopulations with different genetic susceptibilities to suicidality. For example, for the 1-year risk prediction, the AUROC curves were 0.907 and 0.885 for the high (>2nd tertile of PRS) and low (<1st) genetic susceptibilities groups, respectively.

CONCLUSIONS

We established applicable machine learning-based models for predicting both the short- and long-term risk of suicidality with high accuracy across populations of varying genetic risk for suicide, highlighting a cost-effective method of identifying individuals with a high risk of suicidality.

Development and validation of a clinical-radiomics model to predict recurrence for patients with hepatocellular carcinoma after curative resection

PURPOSE

Recurrence is the leading cause of death in hepatocellular carcinoma (HCC) patients with curative resection. In this study, we aimed to develop a preoperative predictive model based on high-throughput radiomics features and clinical factors for prediction of long- and short-term recurrence for these patients.

METHODS

A total of 270 patients with HCC who were followed up for at least 5 years after curative hepatectomy between June 2014 and December 2017 were enrolled in this retrospective study. Regions of interest were manually delineated in preoperative T2-weighted images using ITK-SNAP software on each HCC tumor slice. A total of 1197 radiomics features were extracted, and the recursive feature elimination method based on logistic regression was used for radiomics signature building. Tenfold cross-validation was applied for model development. Nomograms were constructed and assessed by calibration plot, which compares nomogram-predicated probability with observed outcome. Receiver-operating characteristic was then generated to evaluate the predictive performance of the model in the development and test cohorts.

RESULTS

The 10 most recurrence-free survival-related radiomics features were selected for the radiomics signatures. A multiparametric clinical-radiomics model combining albumin and radiomics score for recurrence prediction was further established. The integrated model demonstrated good calibration and satisfactory discrimination, with the area under the curve (AUC) of 0.864, 95% CI 0.842-0.903, sensitivity of 0.889, and specificity of 0.644 in the test set. Calibration curve showed good agreement concerning 5-year recurrence risk predicted by the nomogram. In addition, the AUC of 1-, 2-, 3-, and 4-year recurrence was 0.935 (95% CI 0.836-1.000), 0.861 (95% CI 0.723-0.999), 0.878 (95% CI 0.762-0.994), and 0.878 (95% CI 0.762-0.994) in the test set, respectively.

CONCLUSIONS

The clinical-radiomics model integrating radiomics features and clinical factors can improve recurrence predictions beyond predictions made using clinical factors or radiomics features alone. Our clinical-radiomics model is a valid method to predict recurrence that should improve preoperative prognostic performance and allow more individualized treatment decisions.

Differential Diagnosis of DCIS and Fibroadenoma Based on Ultrasound Images: a Difference-Based Self-Supervised Approach

Differentiation of ductal carcinoma in situ (DCIS, a precancerous lesion of the breast) from fibroadenoma (FA) using ultrasonography is significant for the early prevention of malignant breast tumors. Radiomics-based artificial intelligence (AI) can provide additional diagnostic information but usually requires extensive labeling efforts by clinicians with specialized knowledge. This study aims to investigate the feasibility of differentially diagnosing DCIS and FA using ultrasound radiomics-based AI techniques and further explore a novel approach that can reduce labeling efforts without sacrificing diagnostic performance. We included 461 DCIS and 651 FA patients, of whom 139 DCIS and 181 FA patients constituted a prospective test cohort. First, various feature engineering-based machine learning (FEML) and deep learning (DL) approaches were developed. Then, we designed a difference-based self-supervised (DSS) learning approach that only required FA samples to participate in training. The DSS approach consists of three steps: (1) pretraining a Bootstrap Your Own Latent (BYOL) model using FA images, (2) reconstructing images using the encoder and decoder of the pretrained model, and (3) distinguishing DCIS from FA based on the differences between the original and reconstructed images. The experimental results showed that the trained FEML and DL models achieved the highest AUC of 0.7935 (95% confidence interval, 0.7900-0.7969) on the prospective test cohort, indicating that the developed models are effective for assisting in differentiating DCIS from FA based on ultrasound images. Furthermore, the DSS model achieved an AUC of 0.8172 (95% confidence interval, 0.8124-0.8219), indicating that our model outperforms the conventional radiomics-based AI models and is more competitive.

Setting the Research Agenda for Clinical Artificial Intelligence in Pancreatic Adenocarcinoma Imaging

Simple Summary

Pancreatic ductal adenocarcinoma (PDAC) is one of the deadliest cancers worldwide, associated with a 98% loss of life expectancy and a 30% increase in disability-adjusted life years. Image-based artificial intelligence (AI) can help improve outcomes for PDAC given that current clinical guidelines are non-uniform and lack evidence-based consensus. However, research on image-based AI for PDAC is too scattered and lacking in sufficient quality to be incorporated into clinical workflows. In this review, an international, multi-disciplinary team of the world’s leading experts in pancreatic cancer breaks down the patient pathway and pinpoints the current clinical touchpoints in each stage. The available PDAC imaging AI literature addressing each pathway stage is then rigorously analyzed, and current performance and pitfalls are identified in a comprehensive overview. Finally, the future research agenda for clinically relevant, image-driven AI in PDAC is proposed.

Abstract

Pancreatic ductal adenocarcinoma (PDAC), estimated to become the second leading cause of cancer deaths in western societies by 2030, was flagged as a neglected cancer by the European Commission and the United States Congress. Due to lack of investment in research and development, combined with a complex and aggressive tumour biology, PDAC overall survival has not significantly improved the past decades. Cross-sectional imaging and histopathology play a crucial role throughout the patient pathway. However, current clinical guidelines for diagnostic workup, patient stratification, treatment response assessment, and follow-up are non-uniform and lack evidence-based consensus. Artificial Intelligence (AI) can leverage multimodal data to improve patient outcomes, but PDAC AI research is too scattered and lacking in quality to be incorporated into clinical workflows. This review describes the patient pathway and derives touchpoints for image-based AI research in collaboration with a multi-disciplinary, multi-institutional expert panel. The literature exploring AI to address these touchpoints is thoroughly retrieved and analysed to identify the existing trends and knowledge gaps. The results show absence of multi-institutional, well-curated datasets, an essential building block for robust AI applications. Furthermore, most research is unimodal, does not use state-of-the-art AI techniques, and lacks reliable ground truth. Based on this, the future research agenda for clinically relevant, image-driven AI in PDAC is proposed.

Insight of pancreatic cancer: recommendations for improving its therapeutic efficacy in the next decade

Pancreatic cancer is one of the most malignant digestive system tumors. The effectiveness of pancreatic cancer treatment is still dismal, and the 5-year survival rate is only about 10%. Further improving the diagnosis and treatment of pancreatic cancer is the top priority of oncology research and clinical practice. Based on the existing clinical and scientific research experience, the review provides insight into the hotspots and future directions for pancreatic cancer, which focuses on early detection, early diagnosis, molecular typing and precise treatment, new drug development and regimen combination, immunotherapy, database development, model establishment, surgical technology and strategy change, as well as innovation of traditional Chinese medicine and breakthrough of treatment concept.

The impact of radiomics in diagnosis and staging of pancreatic cancer

INTRODUCTION

Pancreatic cancer (PC) is one of the most aggressive tumours, and better risk stratification among patients is required to provide tailored treatment. The meaning of radiomics and texture analysis as predictive techniques are not already systematically assessed. The aim of this study is to assess the role of radiomics in PC.

METHODS

A PubMed/MEDLINE and Embase systematic review was conducted to assess the role of radiomics in PC. The search strategy was 'radiomics [All Fields] AND ("pancreas" [MeSH Terms] OR "pancreas" [All Fields] OR "pancreatic" [All Fields])' and only original articles referred to PC in humans in the English language were considered.

RESULTS

A total of 123 studies and 183 studies were obtained using the mentioned search strategy on PubMed and Embase, respectively. After the complete selection process, a total of 56 papers were considered eligible for the analysis of the results. Radiomics methods were applied in PC for assessment technical feasibility and reproducibility aspects analysis, risk stratification, biologic or genomic status prediction and treatment response prediction.

DISCUSSION

Radiomics seems to be a promising approach to evaluate PC from diagnosis to treatment response prediction. Further and larger studies are required to confirm the role and allowed to include radiomics parameter in a comprehensive decision support system.

Research on the Construction and Application of Breast Cancer-Specific Database System Based on Full Data Lifecycle

Relying on the Biomedical Big Data Center of West China Hospital, this paper makes an in-depth research on the construction method and application of breast cancer-specific database system based on full data lifecycle, including the establishment of data standards, data fusion and governance, multi-modal knowledge graph, data security sharing and value application of breast cancer-specific database. The research was developed by establishing the breast cancer master data and metadata standards, then collecting, mapping and governing the structured and unstructured clinical data, and parsing and processing the electronic medical records with NLP natural language processing method or other applicable methods, as well as constructing the breast cancer-specific database system to support the application of data in clinical practices, scientific research, and teaching in hospitals, giving full play to the value of medical big data of the Biomedical Big Data Center of West China Hospital.