Signal separation of simultaneous dual-tracer PET imaging based on global spatial information and channel attention

BACKGROUND

Simultaneous dual-tracer positron emission tomography (PET) imaging efficiently provides more complete information for disease diagnosis. The signal separation has long been a challenge of dual-tracer PET imaging. To predict the single-tracer images, we proposed a separation network based on global spatial information and channel attention, and connected it to FBP-Net to form the FBPnet-Sep model.

RESULTS

Experiments using simulated dynamic PET data were conducted to: (1) compare the proposed FBPnet-Sep model to Sep-FBPnet model and currently existing Multi-task CNN, (2) verify the effectiveness of modules incorporated in FBPnet-Sep model, (3) investigate the generalization of FBPnet-Sep model to low-dose data, and (4) investigate the application of FBPnet-Sep model to multiple tracer combinations with decay corrections. Compared to the Sep-FBPnet model and Multi-task CNN, the FBPnet-Sep model reconstructed single-tracer images with higher structural similarity, peak signal-to-noise ratio and lower mean squared error, and reconstructed time-activity curves with lower bias and variation in most regions. Excluding the Inception or channel attention module resulted in degraded image qualities. The FBPnet-Sep model showed acceptable performance when applied to low-dose data. Additionally, it could deal with multiple tracer combinations. The qualities of predicted images, as well as the accuracy of derived time-activity curves and macro-parameters were slightly improved by incorporating a decay correction module.

CONCLUSIONS

The proposed FBPnet-Sep model was considered a potential method for the reconstruction and signal separation of simultaneous dual-tracer PET imaging.

Performance and application of the total-body PET/CT scanner: a literature review

BACKGROUND

The total-body positron emission tomography/computed tomography (PET/CT) system, with a long axial field of view, represents the state-of-the-art PET imaging technique. Recently, the total-body PET/CT system has been commercially available. The total-body PET/CT system enables high-resolution whole-body imaging, even under extreme conditions such as ultra-low dose, extremely fast imaging speed, delayed imaging more than 10 h after tracer injection, and total-body dynamic scan. The total-body PET/CT system provides a real-time picture of the tracers of all organs across the body, which not only helps to explain normal human physiological process, but also facilitates the comprehensive assessment of systemic diseases. In addition, the total-body PET/CT system may play critical roles in other medical fields, including cancer imaging, drug development and immunology.

MAIN BODY

Therefore, it is of significance to summarize the existing studies of the total-body PET/CT systems and point out its future direction. This review collected research literatures from the PubMed database since the advent of commercially available total-body PET/CT systems to the present, and was divided into the following sections: Firstly, a brief introduction to the total-body PET/CT system was presented, followed by a summary of the literature on the performance evaluation of the total-body PET/CT. Then, the research and clinical applications of the total-body PET/CT were discussed. Fourthly, deep learning studies based on total-body PET imaging was reviewed. At last, the shortcomings of existing research and future directions for the total-body PET/CT were discussed.

CONCLUSION

Due to its technical advantages, the total-body PET/CT system is bound to play a greater role in clinical practice in the future.

Machine learning methods for tracer kinetic modelling

Tracer kinetic modelling based on dynamic PET is an important field of Nuclear Medicine for quantitative functional imaging. Yet, its implementation in clinical routine has been constrained by its complexity and computational costs. Machine learning poses an opportunity to improve modelling processes in terms of arterial input function prediction, the prediction of kinetic modelling parameters and model selection in both clinical and preclinical studies while reducing processing time. Moreover, it can help improving kinetic modelling data used in downstream tasks such as tumor detection. In this review, we introduce the basics of tracer kinetic modelling and present a literature review of original works and conference papers using machine learning methods in this field.

Compartment model-based nonlinear unmixing for kinetic analysis of dynamic PET images

When no arterial input function is available, quantification of dynamic PET images requires a previous step devoted to the extraction of a reference time-activity curve (TAC). Factor analysis is often applied for this purpose. This paper introduces a novel approach that conducts a new kind of nonlinear factor analysis relying on a compartment model, and computes the kinetic parameters of specific binding tissues jointly. To this end, it capitalizes on data-driven parametric imaging methods to provide a physical description of the underlying PET data, directly relating the specific binding with the kinetics of the non-specific binding in the corresponding tissues. This characterization is introduced into the factor analysis formulation to yield a novel nonlinear unmixing model designed for PET image analysis. This model also explicitly introduces global kinetic parameters that allow for a direct estimation of a binding potential that represents the ratio at equilibrium of specifically bound radioligand to the concentration of nondisplaceable radioligand in each non-specific binding tissue. The performance of the method is evaluated on synthetic and real data to demonstrate its potential interest.

Direct reconstruction for simultaneous dual-tracer PET imaging based on multi-task learning

BACKGROUND

Simultaneous dual-tracer positron emission tomography (PET) imaging can observe two molecular targets in a single scan, which is conducive to disease diagnosis and tracking. Since the signals emitted by different tracers are the same, it is crucial to separate each single tracer from the mixed signals. The current study proposed a novel deep learning-based method to reconstruct single-tracer activity distributions from the dual-tracer sinogram.

METHODS

We proposed the Multi-task CNN, a three-dimensional convolutional neural network (CNN) based on a framework of multi-task learning. One common encoder extracted features from the dual-tracer dynamic sinogram, followed by two distinct and parallel decoders which reconstructed the single-tracer dynamic images of two tracers separately. The model was evaluated by mean squared error (MSE), multiscale structural similarity (MS-SSIM) index and peak signal-to-noise ratio (PSNR) on simulated data and real animal data, and compared to the filtered back-projection method based on deep learning (FBP-CNN).

RESULTS

In the simulation experiments, the Multi-task CNN reconstructed single-tracer images with lower MSE, higher MS-SSIM and PSNR than FBP-CNN, and was more robust to the changes in individual difference, tracer combination and scanning protocol. In the experiment of rats with an orthotopic xenograft glioma model, the Multi-task CNN reconstructions also showed higher qualities than FBP-CNN reconstructions.

CONCLUSIONS

The proposed Multi-task CNN could effectively reconstruct the dynamic activity images of two single tracers from the dual-tracer dynamic sinogram, which was potential in the direct reconstruction for real simultaneous dual-tracer PET imaging data in future.

Deep learning-based image reconstruction and post-processing methods in positron emission tomography for low-dose imaging and resolution enhancement

Image processing plays a crucial role in maximising diagnostic quality of positron emission tomography (PET) images. Recently, deep learning methods developed across many fields have shown tremendous potential when applied to medical image enhancement, resulting in a rich and rapidly advancing literature surrounding this subject. This review encapsulates methods for integrating deep learning into PET image reconstruction and post-processing for low-dose imaging and resolution enhancement. A brief introduction to conventional image processing techniques in PET is firstly presented. We then review methods which integrate deep learning into the image reconstruction framework as either deep learning-based regularisation or as a fully data-driven mapping from measured signal to images. Deep learning-based post-processing methods for low-dose imaging, temporal resolution enhancement and spatial resolution enhancement are also reviewed. Finally, the challenges associated with applying deep learning to enhance PET images in the clinical setting are discussed and future research directions to address these challenges are presented.

Total-Body PET Kinetic Modeling and Potential Opportunities Using Deep Learning

The uEXPLORER total-body PET/CT system provides a very high level of detection sensitivity and simultaneous coverage of the entire body for dynamic imaging for quantification of tracer kinetics. This article describes the fundamentals and potential benefits of total-body kinetic modeling and parametric imaging focusing on the noninvasive derivation of blood input function, multiparametric imaging, and high-temporal resolution kinetic modeling. Along with its attractive properties, total-body kinetic modeling also brings significant challenges, such as the large scale of total-body dynamic PET data, the need for organ and tissue appropriate input functions and kinetic models, and total-body motion correction. These challenges, and the opportunities using deep learning, are discussed.

Dictionary learning based image-domain material decomposition for spectral CT

The potential huge advantage of spectral computed tomography (CT) is that it can provide accurate material identification and quantitative tissue information by material decomposition. However, material decomposition is a typical inverse problem, where the noise can be magnified. To address this issue, we develop a dictionary learning based image-domain material decomposition (DLIMD) method for spectral CT to achieve accurate material components with better image quality. Specifically, a set of image patches are extracted from the mode-1 unfolding of normalized material images decomposed by direct inversion to train a unified dictionary using the K-SVD technique. Then, the DLIMD model is established to explore the redundant similarities of the material images, where the split-Bregman is employed to optimize the model. Finally, more constraints (i.e. volume conservation and the bounds of each pixel within material maps) are integrated into the DLIMD model. Numerical phantom, physical phantom and preclinical experiments are performed to evaluate the performance of the proposed DLIMD in material decomposition accuracy, material image edge preservation and feature recovery.