Deep learning detection of prostate cancer recurrence with 18F-FACBC (fluciclovine, Axumin®) positron emission tomography

Detection of Local Prostate Cancer Recurrence from PET/CT Scans Using Deep Learning

Background: Prostate cancer (PC) is a leading cause of cancer-related deaths in men worldwide. PSMA-directed positron emission tomography (PET) has shown promising results in detecting recurrent PC and metastasis, improving the accuracy of diagnosis and treatment planning. To evaluate an artificial intelligence (AI) model based on [18F]-prostate specific membrane antigen (PSMA)-1007 PET datasets for the detection of local recurrence in patients with prostate cancer. Methods: We retrospectively analyzed 1404 [18F]-PSMA-1007 PET/CTs from patients with histologically confirmed prostate cancer. Artificial neural networks were trained to recognize the presence of local recurrence based on the PET data. First, the hyperparameters were optimized for an initial model (model A). Subsequently, the bladder was localized using an already published model and a model (model B) was trained only on a 20 cm cube around the bladder. Finally, two separate models were trained on the same section depending on the prostatectomy status (model C (post-prostatectomy) and model D (non-operated)). Results: Model A achieved an accuracy of 56% on the validation data. By restricting the region to the area around the bladder, Model B achieved a validation accuracy of 71%. When validating the specialized models according to prostatectomy status, model C achieved an accuracy of 77% and model D an accuracy of 77%. All models achieved accuracies of almost 100% on the training data, indicating overfitting. Conclusions: For the presented task, 1404 examinations were insufficient to reach an accuracy of over 90% even when employing data augmentation, including additional metadata and performing automated hyperparameter optimization. The low F1-score and AUC values indicate that none of the presented models produce reliable results. However, we will facilitate future research and the development of better models by openly sharing our source code and all pre-trained models for transfer learning.

The Evolution of Artificial Intelligence in Nuclear Medicine

Nuclear medicine has continuously evolved since its beginnings, constantly improving the diagnosis and treatment of various diseases. The integration of artificial intelligence (AI) is one of the latest revolutionizing chapters, promising significant advancements in diagnosis, prognosis, segmentation, image quality enhancement, and theranostics. Early AI applications in nuclear medicine focused on improving diagnostic accuracy, leveraging machine learning algorithms for disease classification and outcome prediction. Advances in deep learning, including convolutional and more recently transformer-based neural networks, have further enabled more precise diagnosis and image segmentation as well as low-dose imaging, and patient-specific dosimetry for personalized treatment. Generative AI, driven by large language models and diffusion techniques, is now allowing the process, interpretation, and generation of complex medical language and images. Despite these achievements, challenges such as data scarcity, heterogeneity, and ethical concerns remain barriers to clinical translation. Addressing these issues through interdisciplinary collaboration will pave the way for a broader adoption of AI in nuclear medicine, potentially enhancing patient care and optimizing diagnosis and therapeutic outcomes.

Diagnostic performance of a deep-learning model using 18F-FDG PET/CT for evaluating recurrence after radiation therapy in patients with lung cancer

OBJECTIVE

We developed a deep learning model for distinguishing radiation therapy (RT)-related changes and tumour recurrence in patients with lung cancer who underwent RT, and evaluated its performance.

METHODS

We retrospectively recruited 308 patients with lung cancer with RT-related changes observed on 18F-fluorodeoxyglucose positron emission tomography-computed tomography (18F-FDG PET/CT) performed after RT. Patients were labelled as positive or negative for tumour recurrence through histologic diagnosis or clinical follow-up after 18F-FDG PET/CT. A two-dimensional (2D) slice-based convolutional neural network (CNN) model was created with a total of 3329 slices as input, and performance was evaluated with five independent test sets.

RESULTS

For the five independent test sets, the area under the curve (AUC) of the receiver operating characteristic curve, sensitivity, and specificity were in the range of 0.98-0.99, 95-98%, and 87-95%, respectively. The region determined by the model was confirmed as an actual recurred tumour through the explainable artificial intelligence (AI) using gradient-weighted class activation mapping (Grad-CAM).

CONCLUSION

The 2D slice-based CNN model using 18F-FDG PET imaging was able to distinguish well between RT-related changes and tumour recurrence in patients with lung cancer.

A convolutional neural network-based system for fully automatic segmentation of whole-body [68Ga]Ga-PSMA PET images in prostate cancer

PURPOSE

The aim of this study was development and evaluation of a fully automated tool for the detection and segmentation of mPCa lesions in whole-body [68Ga]Ga-PSMA-11 PET scans by using a nnU-Net framework.

METHODS

In this multicenter study, a cohort of 412 patients from three different center with all indication of PCa who underwent [68Ga]Ga-PSMA-11 PET/CT were enrolled. Two hundred cases of center 1 dataset were used for training the model. A fully 3D convolutional neural network (CNN) is proposed which is based on the self-configuring nnU-Net framework. A subset of center 1 dataset and cases of center 2 and center 3 were used for testing of model. The performance of the segmentation pipeline that was developed was evaluated by comparing the fully automatic segmentation mask with the manual segmentation of the corresponding internal and external test sets in three levels including patient-level scan classification, lesion-level detection, and voxel-level segmentation. In addition, for comparison of PET-derived quantitative biomarkers between automated and manual segmentation, whole-body PSMA tumor volume (PSMA-TV) and total lesions PSMA uptake (TL-PSMA) were calculated.

RESULTS

In terms of patient-level classification, the model achieved an accuracy of 83%, sensitivity of 92%, PPV of 77%, and NPV of 91% for the internal testing set. For lesion-level detection, the model achieved an accuracy of 87-94%, sensitivity of 88-95%, PPV of 98-100%, and F1-score of 93-97% for all testing sets. For voxel-level segmentation, the automated method achieved average values of 65-70% for DSC, 72-79% for PPV, 53-58% for IoU, and 62-73% for sensitivity in all testing sets. In the evaluation of volumetric parameters, there was a strong correlation between the manual and automated measurements of PSMA-TV and TL-PSMA for all centers.

CONCLUSIONS

The deep learning networks presented here offer promising solutions for automatically segmenting malignant lesions in prostate cancer patients using [68Ga]Ga-PSMA PET. These networks achieve a high level of accuracy in whole-body segmentation, as measured by the DSC and PPV at the voxel level. The resulting segmentations can be used for extraction of PET-derived quantitative biomarkers and utilized for treatment response assessment and radiomic studies.

The Application of Radiomics and AI to Molecular Imaging for Prostate Cancer

Molecular imaging is a key tool in the diagnosis and treatment of prostate cancer (PCa). Magnetic Resonance (MR) plays a major role in this respect with nuclear medicine imaging, particularly, Prostate-Specific Membrane Antigen-based, (PSMA-based) positron emission tomography with computed tomography (PET/CT) also playing a major role of rapidly increasing importance. Another key technology finding growing application across medicine and specifically in molecular imaging is the use of machine learning (ML) and artificial intelligence (AI). Several authoritative reviews are available of the role of MR-based molecular imaging with a sparsity of reviews of the role of PET/CT. This review will focus on the use of AI for molecular imaging for PCa. It will aim to achieve two goals: firstly, to give the reader an introduction to the AI technologies available, and secondly, to provide an overview of AI applied to PET/CT in PCa. The clinical applications include diagnosis, staging, target volume definition for treatment planning, outcome prediction and outcome monitoring. ML and AL techniques discussed include radiomics, convolutional neural networks (CNN), generative adversarial networks (GAN) and training methods: supervised, unsupervised and semi-supervised learning.

Application of Artificial Intelligence in Oncologic Molecular PET-Imaging: A Narrative Review on Beyond [18F]F-FDG Tracers Part II. [18F]F-FLT, [18F]F-FET, [11C]C-MET and Other Less-Commonly Used Radiotracers

Following the previous part of the narrative review on artificial intelligence (AI) applications in positron emission tomography (PET) using tracers rather than 18F-fluorodeoxyglucose ([18F]F-FDG), in this part we review the impact of PET-derived radiomics data on the diagnostic performance of other PET radiotracers, 18F-O-(2-fluoroethyl)-L-tyrosine ([18F]F-FET), 18F-Fluorothymidine ([18F]F-FLT) and 11C-Methionine ([11C]C-MET). [18F]F-FET-PET, using an artificial amino acid taken up into upregulated tumoral cells, showed potential in lesion detection and tumor characterization, especially with its ability to reflect glioma heterogeneity. [18F]F-FET-PET-derived textural features appeared to have the potential to reveal considerable information for accurate delineation for guiding biopsy and treatment, differentiate between low-grade and high-grade glioma and related wild-type genotypes, and distinguish pseudoprogression from true progression. In addition, models built using clinical parameters and [18F]F-FET-PET-derived radiomics features showed acceptable results for survival stratification of glioblastoma patients. [18F]F-FLT-PET-based characteristics also showed potential in evaluating glioma patients, correlating with Ki-67 and patient prognosis. AI-based PET-volumetry using this radiotracer as a proliferation marker also revealed promising preliminary results in terms of guide-targeting bone marrow-preserving adaptive radiation therapy. Similar to [18F]F-FET, the other amino acid tracer which reflects cellular proliferation, [11C]C-MET, has also shown acceptable performance in predicting tumor grade, distinguishing brain tumor recurrence from radiation necrosis, and treatment monitoring by PET-derived radiomics models. In addition, PET-derived radiomics features of various radiotracers such as [18F]F-DOPA, [18F]F-FACBC, [18F]F-NaF, [68Ga]Ga-CXCR-4 and [18F]F-FMISO may also provide useful information for tumor characterization and predict of disease outcome. In conclusion, AI using tracers beyond [18F]F-FDG could improve the diagnostic performance of PET-imaging for specific indications and help clinicians in their daily routine by providing features that are often not detectable by the naked eye.

Novel hormone therapy and coordination of care in high-risk biochemically recurrent prostate cancer

Biochemical recurrence (BCR) occurs in 20-50% of patients with prostate cancer (PCa) undergoing primary definitive treatment. Patients with high-risk BCR have an increased risk of metastatic progression and subsequent PCa-specific mortality, and thus could benefit from treatment intensification. Given the increasing complexity of diagnostic and therapeutic modalities, multidisciplinary care (MDC) can play a crucial role in the individualized management of this patient population. This review explores the role for MDC when evaluating the clinical evidence for the evolving definition of high-risk BCR and the emerging therapeutic strategies, especially with novel hormone therapies (NHTs), for patients with either high-risk BCR or oligometastatic PCa. Clinical studies have used different characteristics to define high-risk BCR and there is no consensus regarding the definition of high-risk BCR nor for management strategies. Next-generation imaging and multigene panels offer potential enhanced patient identification and precision-based decision-making, respectively. Treatment intensification with NHTs, either alone or combined with radiotherapy or metastasis-directed therapy, has been promising in clinical trials in patients with high-risk BCR or oligometastases. As novel risk-stratification and treatment options as well as evidence-based literature evolve, it is important to involve a multidisciplinary team to identify patients with high-risk features at an earlier stage, and make informed decisions on the treatments that could optimize their care and long-term outcomes. Nevertheless, MDC data are scarce in the BCR or oligometastatic setting. Efforts to integrate MDC into the standard management of this patient population are needed, and will likely improve outcomes across this heterogeneous PCa patient population.

ChatGPT-assisted deep learning for diagnosing bone metastasis in bone scans: Bridging the AI Gap for Clinicians

BACKGROUND

Bone scans are often used to identify bone metastases, but their low specificity may necessitate further studies. Deep learning models may improve diagnostic accuracy but require both medical and programming expertise. Therefore, we investigated the feasibility of constructing a deep learning model employing ChatGPT for the diagnosis of bone metastasis in bone scans and to evaluate its diagnostic performance.

METHOD

We examined 4626 consecutive cancer patients (age, 65.1 ± 11.3 years; 2334 female) who had bone scans for metastasis assessment. A nuclear medicine physician developed a deep learning model using ChatGPT 3.5 (OpenAI). We employed ResNet50 as the backbone network and compared the diagnostic performance of four strategies (original training set, original training set with 1:10 class weight, 10-fold data augmentation for positive images only, and 10-fold data augmentation for all images) to address the class imbalance. We used a class activation map algorithm for visualization.

RESULTS

Among the four strategies, the deep learning model with 10-fold data augmentation for positive cases only, using a batch size of 16 and an epoch size of 150, achieved the area under curve of 0.8156, the sensitivity of 56.0 %, and specificity of 88.7 %. The class activation map indicated that the model focused on disseminated bone metastases within the spine but might confuse them with benign spinal lesions or intense urinary activity.

CONCLUSIONS

Our study illustrates that a clinical physician with rudimentary programming skills can develop a deep learning model for medical image analysis, such as diagnosing bone metastasis in bone scans using ChatGPT. Model visualization may offer guidance in enhancing deep learning model development, including preprocessing, and potentially support clinical decision-making processes.

Computed Tomography-Based Radiomics for Long-Term Prognostication of High-Risk Localized Prostate Cancer Patients Received Whole Pelvic Radiotherapy

Given the high death rate caused by high-risk prostate cancer (PCa) (>40%) and the reliability issues associated with traditional prognostic markers, the purpose of this study is to investigate planning computed tomography (pCT)-based radiomics for the long-term prognostication of high-risk localized PCa patients who received whole pelvic radiotherapy (WPRT). This is a retrospective study with methods based on best practice procedures for radiomics research. Sixty-four patients were selected and randomly assigned to training (n = 45) and testing (n = 19) cohorts for radiomics model development with five major steps: pCT image acquisition using a Philips Big Bore CT simulator; multiple manual segmentations of clinical target volume for the prostate (CTVprostate) on the pCT images; feature extraction from the CTVprostate using PyRadiomics; feature selection for overfitting avoidance; and model development with three-fold cross-validation. The radiomics model and signature performances were evaluated based on the area under the receiver operating characteristic curve (AUC) as well as accuracy, sensitivity and specificity. This study's results show that our pCT-based radiomics model was able to predict the six-year progression-free survival of the high-risk localized PCa patients who received the WPRT with highly consistent performances (mean AUC: 0.76 (training) and 0.71 (testing)). These are comparable to findings of other similar studies including those using magnetic resonance imaging (MRI)-based radiomics. The accuracy, sensitivity and specificity of our radiomics signature that consisted of two texture features were 0.778, 0.833 and 0.556 (training) and 0.842, 0.867 and 0.750 (testing), respectively. Since CT is more readily available than MRI and is the standard-of-care modality for PCa WPRT planning, pCT-based radiomics could be used as a routine non-invasive approach to the prognostic prediction of WPRT treatment outcomes in high-risk localized PCa.

Beyond diagnosis: is there a role for radiomics in prostate cancer management?

The role of imaging in pretreatment staging and management of prostate cancer (PCa) is constantly evolving. In the last decade, there has been an ever-growing interest in radiomics as an image analysis approach able to extract objective quantitative features that are missed by human eye. However, most of PCa radiomics studies have been focused on cancer detection and characterisation. With this narrative review we aimed to provide a synopsis of the recently proposed potential applications of radiomics for PCa with a management-based approach, focusing on primary treatments with curative intent and active surveillance as well as highlighting on recurrent disease after primary treatment. Current evidence is encouraging, with radiomics and artificial intelligence appearing as feasible tools to aid physicians in planning PCa management. However, the lack of external independent datasets for validation and prospectively designed studies casts a shadow on the reliability and generalisability of radiomics models, delaying their translation into clinical practice.Key points• Artificial intelligence solutions have been proposed to streamline prostate cancer radiotherapy planning.• Radiomics models could improve risk assessment for radical prostatectomy patient selection.• Delta-radiomics appears promising for the management of patients under active surveillance.• Radiomics might outperform current nomograms for prostate cancer recurrence risk assessment.• Reproducibility of results, methodological and ethical issues must still be faced before clinical implementation.

Artificial intelligence as a diagnostic aid in cross-sectional radiological imaging of surgical pathology in the abdominopelvic cavity: a systematic review

OBJECTIVES

There is emerging use of artificial intelligence (AI) models to aid diagnostic imaging. This review examined and critically appraised the application of AI models to identify surgical pathology from radiological images of the abdominopelvic cavity, to identify current limitations and inform future research.

DESIGN

Systematic review.

DATA SOURCES

Systematic database searches (Medline, EMBASE, Cochrane Central Register of Controlled Trials) were performed. Date limitations (January 2012 to July 2021) were applied.

ELIGIBILITY CRITERIA

Primary research studies were considered for eligibility using the PIRT (participants, index test(s), reference standard and target condition) framework. Only publications in the English language were eligible for inclusion in the review.

DATA EXTRACTION AND SYNTHESIS

Study characteristics, descriptions of AI models and outcomes assessing diagnostic performance were extracted by independent reviewers. A narrative synthesis was performed in accordance with the Synthesis Without Meta-analysis guidelines. Risk of bias was assessed (Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2)).

RESULTS

Fifteen retrospective studies were included. Studies were diverse in surgical specialty, the intention of the AI applications and the models used. AI training and test sets comprised a median of 130 (range: 5-2440) and 37 (range: 10-1045) patients, respectively. Diagnostic performance of models varied (range: 70%-95% sensitivity, 53%-98% specificity). Only four studies compared the AI model with human performance. Reporting of studies was unstandardised and often lacking in detail. Most studies (n=14) were judged as having overall high risk of bias with concerns regarding applicability.

CONCLUSIONS

AI application in this field is diverse. Adherence to reporting guidelines is warranted. With finite healthcare resources, future endeavours may benefit from targeting areas where radiological expertise is in high demand to provide greater efficiency in clinical care. Translation to clinical practice and adoption of a multidisciplinary approach should be of high priority.

PROSPERO REGISTRATION NUMBER

CRD42021237249.

Deep Learning Analysis Using 18F-FDG PET/CT to Predict Occult Lymph Node Metastasis in Patients With Clinical N0 Lung Adenocarcinoma

Introduction

The aim of this work was to determine the feasibility of using a deep learning approach to predict occult lymph node metastasis (OLM) based on preoperative FDG-PET/CT images in patients with clinical node-negative (cN0) lung adenocarcinoma.

Materials and Methods

Dataset 1 (for training and internal validation) included 376 consecutive patients with cN0 lung adenocarcinoma from our hospital between May 2012 and May 2021. Dataset 2 (for prospective test) used 58 consecutive patients with cN0 lung adenocarcinoma from June 2021 to February 2022 at the same center. Three deep learning models: PET alone, CT alone, and combined model, were developed for the prediction of OLM. The performance of the models was evaluated on internal validation and prospective test in terms of accuracy, sensitivity, specificity, and areas under the receiver operating characteristic curve (AUCs).

Results

The combined model incorporating PET and CT showed the best performance, achieved an AUC of 0.81 [95% confidence interval (CI): 0.61, 1.00] in the prediction of OLM in internal validation set (n = 60) and an AUC of 0.87 (95% CI: 0.75, 0.99) in the prospective test set (n = 58). The model achieved 87.50% sensitivity, 80.00% specificity, and 81.00% accuracy in the internal validation set and achieved 75.00% sensitivity, 88.46% specificity, and 86.60% accuracy in the prospective test set.

Conclusion

This study presented a deep learning approach to enable the prediction of occult nodal involvement based on the PET/CT images before surgery in cN0 lung adenocarcinoma, which would help clinicians select patients who would be suitable for sublobar resection.

Radiomics and artificial intelligence in prostate cancer: new tools for molecular hybrid imaging and theragnostics

In prostate cancer (PCa), the use of new radiopharmaceuticals has improved the accuracy of diagnosis and staging, refined surveillance strategies, and introduced specific and personalized radioreceptor therapies. Nuclear medicine, therefore, holds great promise for improving the quality of life of PCa patients, through managing and processing a vast amount of molecular imaging data and beyond, using a multi-omics approach and improving patients’ risk-stratification for tailored medicine. Artificial intelligence (AI) and radiomics may allow clinicians to improve the overall efficiency and accuracy of using these “big data” in both the diagnostic and theragnostic field: from technical aspects (such as semi-automatization of tumor segmentation, image reconstruction, and interpretation) to clinical outcomes, improving a deeper understanding of the molecular environment of PCa, refining personalized treatment strategies, and increasing the ability to predict the outcome. This systematic review aims to describe the current literature on AI and radiomics applied to molecular imaging of prostate cancer.

Evaluation of machine learning strategies for imaging confirmed prostate cancer recurrence prediction on electronic health records

BACKGROUND

The main screening parameter to monitor prostate cancer recurrence (PCR) after primary treatment is the serum concentration of prostate-specific antigen (PSA). In recent years, Ga-68-PSMA PET/CT has become an important method for additional diagnostics in patients with biochemical recurrence.

PURPOSE

While Ga-68-PSMA PET/CT performs better, it is an expensive, invasive, and time-consuming examination. Therefore, in this study, we aim to employ modern multivariate Machine Learning (ML) methods on electronic health records (EHR) of prostate cancer patients to improve the prediction of imaging confirmed PCR (IPCR).

METHODS

We retrospectively analyzed the clinical information of 272 patients, who were examined using Ga-68-PSMA PET/CT. The PSA values ranged from 0 ng/mL to 2270.38 ng/mL with a median PSA level at 1.79 ng/mL. We performed a descriptive analysis using Logistic Regression. Additionally, we evaluated the predictive performance of Logistic Regression, Support Vector Machine, Gradient Boosting, and Random Forest. Finally, we assessed the importance of all features using Ensemble Feature Selection (EFS).

RESULTS

The descriptive analysis found significant associations between IPCR and logarithmic PSA values as well as between IPCR and performed hormonal therapy. Our models were able to predict IPCR with an AUC score of 0.78 ± 0.13 (mean ± standard deviation) and a sensitivity of 0.997 ± 0.01. Features such as PSA, PSA doubling time, PSA velocity, hormonal therapy, radiation treatment, and injected activity show high importance for IPCR prediction using EFS.

CONCLUSION

This study demonstrates the potential of employing a multitude of parameters into multivariate ML models to improve identification of non-recurring patients compared to the current focus on the main screening parameter (PSA). We showed that ML models are able to predict IPCR, detectable by Ga-68-PSMA PET/CT, and thereby pave the way for optimized early imaging and treatment.

Clinical Application of Artificial Intelligence in Positron Emission Tomography: Imaging of Prostate Cancer

PET imaging with targeted novel tracers has been commonly used in the clinical management of prostate cancer. The use of artificial intelligence (AI) in PET imaging is a relatively new approach and in this review article, we will review the current trends and categorize the currently available research into the quantification of tumor burden within the organ, evaluation of metastatic disease, and translational/supplemental research which aims to improve other AI research efforts.

AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging:: Towards Radiophenomics

Artificial intelligence (AI) techniques have significant potential to enable effective, robust, and automated image phenotyping including the identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of "radiomics" and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be used as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques.

Radiomics for Identification and Prediction in Metastatic Prostate Cancer: A Review of Studies

Metastatic Prostate Cancer (mPCa) is associated with a poor patient prognosis. mPCa spreads throughout the body, often to bones, with spatial and temporal variations that make the clinical management of the disease difficult. The evolution of the disease leads to spatial heterogeneity that is extremely difficult to characterise with solid biopsies. Imaging provides the opportunity to quantify disease spread. Advanced image analytics methods, including radiomics, offer the opportunity to characterise heterogeneity beyond what can be achieved with simple assessment. Radiomics analysis has the potential to yield useful quantitative imaging biomarkers that can improve the early detection of mPCa, predict disease progression, assess response, and potentially inform the choice of treatment procedures. Traditional radiomics analysis involves modelling with hand-crafted features designed using significant domain knowledge. On the other hand, artificial intelligence techniques such as deep learning can facilitate end-to-end automated feature extraction and model generation with minimal human intervention. Radiomics models have the potential to become vital pieces in the oncology workflow, however, the current limitations of the field, such as limited reproducibility, are impeding their translation into clinical practice. This review provides an overview of the radiomics methodology, detailing critical aspects affecting the reproducibility of features, and providing examples of how artificial intelligence techniques can be incorporated into the workflow. The current landscape of publications utilising radiomics methods in the assessment and treatment of mPCa are surveyed and reviewed. Associated studies have incorporated information from multiple imaging modalities, including bone scintigraphy, CT, PET with varying tracers, multiparametric MRI together with clinical covariates, spanning the prediction of progression through to overall survival in varying cohorts. The methodological quality of each study is quantified using the radiomics quality score. Multiple deficits were identified, with the lack of prospective design and external validation highlighted as major impediments to clinical translation. These results inform some recommendations for future directions of the field.

Diagnostic performance of deep learning models for detecting bone metastasis on whole-body bone scan in prostate cancer

PURPOSE

We evaluated the performance of deep learning classifiers for bone scans of prostate cancer patients.

METHODS

A total of 9113 consecutive bone scans (5342 prostate cancer patients) were initially evaluated. Bone scans were labeled as positive/negative for bone metastasis using clinical reports and image review for ground truth diagnosis. Two different 2D convolutional neural network (CNN) architectures were proposed: (1) whole body-based (WB) and (2) tandem architectures integrating whole body and local patches, here named as "global-local unified emphasis" (GLUE). Both models were trained using abundant (72%:8%:20% for training:validation:test sets) and limited training data (10%:40%:50%). The allocation of test sets was rotated across all images: therefore, fivefold and twofold cross-validation test results were available for abundant and limited settings, respectively.

RESULTS

A total of 2991 positive and 6142 negative bone scans were used as input. For the abundant training setting, the receiver operating characteristics curves of both the GLUE and WB models indicated excellent diagnostic ability in terms of the area under the curve (GLUE: 0.936-0.955, WB: 0.933-0.957, P > 0.05 in four of the fivefold tests). The overall accuracies of the GLUE and WB models were 0.900 and 0.889, respectively. With the limited training setting, the GLUE models showed significantly higher AUCs than the WB models (0.894-0.908 vs. 0.870-0.877, P < 0.0001).

CONCLUSION

Our 2D-CNN models accurately classified bone scans of prostate cancer patients. While both showed excellent performance with the abundant dataset, the GLUE model showed higher performance than the WB model in the limited data setting.

Artificial Intelligence for Optimization and Interpretation of PET/CT and PET/MR Images

Artificial intelligence (AI) has recently attracted much attention for its potential use in healthcare applications. The use of AI to improve and extract more information out of medical images, given their parallels with natural images and the immense progress in the area of computer vision, has been at the forefront of these advances. This is due to a convergence of factors, including the increasing numbers of scans performed, the availability of open source AI tools, and decreases in the costs of hardware required to implement these technologies. In this article, we review the progress in the use of AI toward optimizing PET/CT and PET/MRI studies. These two methods, which combine molecular information with structural and (in the case of MRI) functional imaging, are extremely valuable for a wide range of clinical indications. They are also tremendously data-rich modalities and as such are highly amenable to data-driven technologies such as AI. The first half of the article will focus on methods to improve PET reconstruction and image quality, which has multiple benefits including faster image acquisition, image reconstruction, and lower or even "zero" radiation dose imaging. It will also address the value of AI-driven methods to perform MR-based attenuation correction. The second half will address how some of these advances can be used to perform to optimize diagnosis from the acquired images, with examples given for whole-body oncology, cardiology, and neurology indications. Overall, it is likely that the use of AI will markedly improve both the quality and safety of PET/CT and PET/MRI as well as enhance our ability to interpret the scans and follow lesions over time. This will hopefully lead to expanded clinical use cases for these valuable technologies leading to better patient care.