Predicting the recurrence risk of pancreatic neuroendocrine neoplasms after radical resection using deep learning radiomics with preoperative computed tomography images

Deep Learning Applications in Pancreatic Cancer

Pancreatic cancer is one of the most lethal gastrointestinal malignancies. Despite advances in cross-sectional imaging, chemotherapy, radiation therapy, and surgical techniques, the 5-year overall survival is only 12%. With the advent and rapid adoption of AI across all industries, we present a review of applications of DL in the care of patients diagnosed with PC. A review of different DL techniques with applications across diagnosis, management, and monitoring is presented across the different pathological subtypes of pancreatic cancer. This systematic review highlights AI as an emerging technology in the care of patients with pancreatic cancer.

Prognostic Assessment of Gastropancreatic Neuroendocrine Neoplasm: Prospects and Limits of Radiomics

Neuroendocrine neoplasms (NENs) are a group of lesions originating from cells of the diffuse neuroendocrine system. NENs may involve different sites, including the gastrointestinal tract (GEP-NENs). The incidence and prevalence of GEP-NENs has been constantly rising thanks to the increased diagnostic power of imaging and immuno-histochemistry. Despite the plethora of biochemical markers and imaging techniques, the prognosis and therapeutic choice in GEP-NENs still represents a challenge, mainly due to the great heterogeneity in terms of tumor lesions and clinical behavior. The concept that biomedical images contain information about tissue heterogeneity and pathological processes invisible to the human eye is now well established. From this substrate comes the idea of radiomics. Computational analysis has achieved promising results in several oncological settings, and the use of radiomics in different types of GEP-NENs is growing in the field of research, yet with conflicting results. The aim of this narrative review is to provide a comprehensive update on the role of radiomics on GEP-NEN management, focusing on the main clinical aspects analyzed by most existing reports: predicting tumor grade, distinguishing NET from other tumors, and prognosis assessment.

A deep learning model using convolutional neural networks for caries detection and recognition with endoscopes

Background

Caries are common, especially in economically undeveloped countries with limited access to medical resources. Sometimes patient cannot even realize that they have oral problems until they feel obvious pain. Deep convolutional neural networks (CNNs) have been widely adopted for medical image analysis and management and have yielded some progress in stomatology while the endoscopes are cheap and easily used in daily life for families or other non-medical situations. Therefore, we created a deep learning model to detect and recognize caries using endoscopic images.

Methods

We used 194 images of non-caries and 1,059 images of permanent molar and premolar caries to build a classification and a segmentation model in patients of endoscope images from the Department of Stomatology of People's Liberation Army General Hospital (PLAGH). A classification model combined with an end-to-end semantic segmentation model, DeepLabv3+ was used for segmenting the caries, then we evaluated with a 5-fold cross-validation protocol whereby each fold was used once.

Results

In the classification model, the mean area under the curve (AUC) [90% confidence interval (CI)] was 0.9897 (0.9821-0.9956) (P<0.01) In the segmentation model, the mean accuracy was 0.9843 (0.9820-0.9871), the recall was 0.6996 (0.6810-0.7194), the specificity was 0.9943 (0.9937-0.9954), the Dice coefficient was 0.7099 (0.6948-0.7343), and the intersection over union (IoU) was 0.5779 (0.5646-0.6006).

Conclusions

We used a deep learning model to monitor caries and encourage their early diagnosis and treatment.

GEP-NET radiomics: a systematic review and radiomics quality score assessment

OBJECTIVE

The number of radiomics studies in gastroenteropancreatic neuroendocrine tumours (GEP-NETs) is rapidly increasing. This systematic review aims to provide an overview of the available evidence of radiomics for clinical outcome measures in GEP-NETs, to understand which applications hold the most promise and which areas lack evidence.

METHODS

PubMed, Embase, and Wiley/Cochrane Library databases were searched and a forward and backward reference check of the identified studies was executed. Inclusion criteria were (1) patients with GEP-NETs and (2) radiomics analysis on CT, MRI or PET. Two reviewers independently agreed on eligibility and assessed methodological quality with the radiomics quality score (RQS) and extracted outcome data.

RESULTS

In total, 1364 unique studies were identified and 45 were included for analysis. Most studies focused on GEP-NET grade and differential diagnosis of GEP-NETs from other neoplasms, while only a minority analysed treatment response or long-term outcomes. Several studies were able to predict tumour grade or to differentiate GEP-NETs from other lesions with a good performance (AUCs 0.74-0.96 and AUCs 0.80-0.99, respectively). Only one study developed a model to predict recurrence in pancreas NETs (AUC 0.77). The included studies reached a mean RQS of 18%.

CONCLUSION

Although radiomics for GEP-NETs is still a relatively new area, some promising models have been developed. Future research should focus on developing robust models for clinically relevant aims such as prediction of response or long-term outcome in GEP-NET, since evidence for these aims is still scarce.

KEY POINTS

• The majority of radiomics studies in gastroenteropancreatic neuroendocrine tumours is of low quality. • Most evidence for radiomics is available for the identification of tumour grade or differentiation of gastroenteropancreatic neuroendocrine tumours from other neoplasms. • Radiomics for the prediction of response or long-term outcome in gastroenteropancreatic neuroendocrine tumours warrants further research.

CT-based radiomics for prediction of therapeutic response to Everolimus in metastatic neuroendocrine tumors

Aim

To test radiomic approach in patients with metastatic neuroendocrine tumors (NETs) treated with Everolimus, with the aim to predict progression-free survival (PFS) and death.

Materials and methods

Twenty-five patients with metastatic neuroendocrine tumors, 15/25 pancreatic (60%), 9/25 ileal (36%), 1/25 lung (4%), were retrospectively enrolled between August 2013 and December 2020. All patients underwent contrast-enhanced CT before starting Everolimus, histological diagnosis, tumor grading, PFS, overall survival (OS), death, and clinical data collected. Population was divided into two groups: responders (PFS ≤ 11 months) and non-responders (PFS > 11 months). 3D segmentation was performed on whole liver of naïve CT scans in arterial and venous phases, using a dedicated software (3DSlicer v4.10.2). A total of 107 radiomic features were extracted and compared between two groups (T test or Mann–Whitney), radiomics performance assessed with receiver operating characteristic curve, Kaplan–Meyer curves used for survival analysis, univariate and multivariate logistic regression performed to predict death, and interobserver variability assessed. All significant radiomic comparisons were validated by using a synthetic external cohort. P < 0.05 is considered significant.

Results

15/25 patients were classified as responders (median PFS 25 months and OS 29 months) and 10/25 as non-responders (median PFS 4.5 months and OS 23 months). Among radiomic parameters, Correlation and Imc1 showed significant differences between two groups (P < 0.05) with the best performance (internal cohort AUC 0.86–0.84, P < 0.0001; external cohort AUC 0.84–0.90; P < 0.0001). Correlation < 0.21 resulted correlated with death at Kaplan–Meyer analysis (P = 0.02). Univariate analysis showed three radiomic features independently correlated with death, and in multivariate analysis radiomic model showed good performance with AUC 0.87, sensitivity 100%, and specificity 66.7%. Three features achieved 0.77 ≤ ICC < 0.83 and one ICC = 0.92.

Conclusions

In patients affected by metastatic NETs eligible for Everolimus treatment, radiomics could be used as imaging biomarker able to predict PFS and death.

Artificial Intelligence and Machine Learning in the Diagnosis and Management of Gastroenteropancreatic Neuroendocrine Neoplasms—A Scoping Review

Neuroendocrine neoplasms (NENs) and tumors (NETs) are rare neoplasms that may affect any part of the gastrointestinal system. In this scoping review, we attempt to map existing evidence on the role of artificial intelligence, machine learning and deep learning in the diagnosis and management of NENs of the gastrointestinal system. After implementation of inclusion and exclusion criteria, we retrieved 44 studies with 53 outcome analyses. We then classified the papers according to the type of studied NET (26 Pan-NETs, 59.1%; 3 metastatic liver NETs (6.8%), 2 small intestinal NETs, 4.5%; colorectal, rectal, non-specified gastroenteropancreatic and non-specified gastrointestinal NETs had from 1 study each, 2.3%). The most frequently used AI algorithms were Supporting Vector Classification/Machine (14 analyses, 29.8%), Convolutional Neural Network and Random Forest (10 analyses each, 21.3%), Random Forest (9 analyses, 19.1%), Logistic Regression (8 analyses, 17.0%), and Decision Tree (6 analyses, 12.8%). There was high heterogeneity on the description of the prediction model, structure of datasets, and performance metrics, whereas the majority of studies did not report any external validation set. Future studies should aim at incorporating a uniform structure in accordance with existing guidelines for purposes of reproducibility and research quality, which are prerequisites for integration into clinical practice.

Using Quantitative Imaging for Personalized Medicine in Pancreatic Cancer: A Review of Radiomics and Deep Learning Applications

Simple Summary

With a five-year survival rate of only 3% for the majority of patients, pancreatic cancer is a global healthcare challenge. Radiomics and deep learning, two novel quantitative imaging methods that treat medical images as minable data instead of just pictures, have shown promise in advancing personalized management of pancreatic cancer through diagnosing precursor diseases, early detection, accurate diagnosis, and treatment personalization. Radiomics and deep learning methods aim to collect hidden information in medical images that is missed by conventional radiology practices through expanding the data search and comparing information across different patients. Both methods have been studied and applied in pancreatic cancer. In this review, we focus on the current progress of these two methods in pancreatic cancer and provide a comprehensive narrative review on the topic. With better regulation, enhanced workflow, and larger prospective patient datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through personalized precision medicine.

Abstract

As the most lethal major cancer, pancreatic cancer is a global healthcare challenge. Personalized medicine utilizing cutting-edge multi-omics data holds potential for major breakthroughs in tackling this critical problem. Radiomics and deep learning, two trendy quantitative imaging methods that take advantage of data science and modern medical imaging, have shown increasing promise in advancing the precision management of pancreatic cancer via diagnosing of precursor diseases, early detection, accurate diagnosis, and treatment personalization and optimization. Radiomics employs manually-crafted features, while deep learning applies computer-generated automatic features. These two methods aim to mine hidden information in medical images that is missed by conventional radiology and gain insights by systematically comparing the quantitative image information across different patients in order to characterize unique imaging phenotypes. Both methods have been studied and applied in various pancreatic cancer clinical applications. In this review, we begin with an introduction to the clinical problems and the technology. After providing technical overviews of the two methods, this review focuses on the current progress of clinical applications in precancerous lesion diagnosis, pancreatic cancer detection and diagnosis, prognosis prediction, treatment stratification, and radiogenomics. The limitations of current studies and methods are discussed, along with future directions. With better standardization and optimization of the workflow from image acquisition to analysis and with larger and especially prospective high-quality datasets, radiomics and deep learning methods could show real hope in the battle against pancreatic cancer through big data-based high-precision personalization.