Anatomy-guided brain PET imaging incorporating a joint prior model

Utilizing Pix2Pix conditional generative adversarial networks to recover missing data in preclinical PET scanner sinogram gaps

BACKGROUND

The presence of a gap between adjacent detector blocks in Positron Emission Tomography (PET) scanners introduces a partial loss of projection data, which can degrade the image quality and quantitative accuracy of reconstructed PET images. This study suggests a novel approach for filling missing data from sinograms generated from preclinical PET scanners using a combination of an inpainting method and the Pix2Pix conditional generative adversarial network (cGAN).

MATERIALS AND METHODS

Twenty mice and Image Quality (IQ) phantom were scanned by a small animal Xtrim PET scanner, resulting in 7500 raw sinograms used for network training and test datasets. The absence of gap-free sinograms as the target for neural network training was a challenge. This issue was solved by artificially generating gap-free sinograms from the original sinogram. To assess the performance of the proposed approach, the sinograms were reconstructed using the ordered subset expectation maximization (OSEM) algorithm. The overall performance of the proposed network and the quality of the resulting images were quantitatively compared using various metrics, including the root mean squared error (RMSE), structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), contrast-to-noise ratio (CNR), and signal-to-noise ratio (SNR).

RESULTS

The Pix2Pix cGAN approach achieved an RMSE of 9.34 × 10-4 ± 5.7 × 10-5 and an SSIM of 99.984 × 10-2 ± 1.8 × 10-5, considering the corresponding inpainted sinograms as the target.

CONCLUSION

The proposed approach can retrieve missing sinogram data by learning a map derived from the whole sinogram compared to the adjacent pixels, which leads to better quantitative accuracy and improved reconstructed images.

Dynamic PET image reconstruction incorporating a median nonlocal means kernel method

In dynamic positron emission tomography (PET) imaging, the reconstructed image of a single frame often exhibits high noise due to limited counting statistics of projection data. This study proposed a median nonlocal means (MNLM)-based kernel method for dynamic PET image reconstruction. The kernel matrix is derived from median nonlocal means of pre-reconstructed composite images. Then the PET image intensities in all voxels were modeled as a kernel matrix multiplied by coefficients and incorporated into the forward model of PET projection data. Then, the coefficients of each feature were estimated by the maximum likelihood method. Using simulated low-count dynamic data of Zubal head phantom, the quantitative performance of the proposed MNLM kernel method was investigated and compared with the maximum-likelihood method, conventional kernel method with and without median filter, and nonlocal means (NLM) kernel method. Simulation results showed that the MNLM kernel method achieved visual and quantitative accuracy improvements (in terms of the ensemble mean squared error, bias versus variance, and contrast versus noise performances). Especially for frame 2 with the lowest count level of a single frame, the MNLM kernel method achieves lower ensemble mean squared error (10.43%) than the NLM kernel method (13.68%), conventional kernel method with and without median filter (11.88% and 23.50%), and MLEM algorithm (24.77%). The study on real low-dose ¹⁸F-FDG rat data also showed that the MNLM kernel method outperformed other methods in visual and quantitative accuracy improvements (in terms of regional noise versus intensity mean performance).

GapFill-Recon Net: A Cascade Network for simultaneously PET Gap Filling and Image Reconstruction

PET image reconstruction from incomplete data, such as the gap between adjacent detector blocks generally introduces partial projection data loss, is an important and challenging problem in medical imaging. This work proposes an efficient convolutional neural network (CNN) framework, called GapFill-Recon Net, that jointly reconstructs PET images and their associated sinogram data. GapFill-Recon Net including two blocks: the Gap-Filling block first address the sinogram gap and the Image-Recon block maps the filled sinogram onto the final image directly. A total of 43,660 pairs of synthetic 2D PET sinograms with gaps and images generated from the MOBY phantom are utilized for network training, testing and validation. Whole-body mouse Monte Carlo (MC) simulated data are also used for evaluation. The experimental results show that the reconstructed image quality of GapFill-Recon Net outperforms filtered back-projection (FBP) and maximum likelihood expectation maximization (MLEM) in terms of the structural similarity index metric (SSIM), relative root mean squared error (rRMSE), and peak signal-to-noise ratio (PSNR). Moreover, the reconstruction speed is equivalent to that of FBP and was nearly 83 times faster than that of MLEM. In conclusion, compared with the traditional reconstruction algorithm, GapFill-Recon Net achieves relatively optimal performance in image quality and reconstruction speed, which effectively achieves a balance between efficiency and performance.

Motion estimation and correction for simultaneous PET/MR using SIRF and CIL

SIRF is a powerful PET/MR image reconstruction research tool for processing data and developing new algorithms. In this research, new developments to SIRF are presented, with focus on motion estimation and correction. SIRF's recent inclusion of the adjoint of the resampling operator allows gradient propagation through resampling, enabling the MCIR technique. Another enhancement enabled registering and resampling of complex images, suitable for MRI. Furthermore, SIRF's integration with the optimization library CIL enables the use of novel algorithms. Finally, SPM is now supported, in addition to NiftyReg, for registration. Results of MR and PET MCIR reconstructions are presented, using FISTA and PDHG, respectively. These demonstrate the advantages of incorporating motion correction and variational and structural priors. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 2'.

OMEGA-open-source emission tomography software

In this paper we present OMEGA, an open-source software, for efficient and fast image reconstruction in positron emission tomography (PET). OMEGA uses the scripting language of MATLAB and GNU Octave allowing reconstruction of PET data with a MATLAB or GNU Octave interface. The goal of OMEGA is to allow easy and fast reconstruction of any PET data, and to provide a computationally efficient, easy-access platform for development of new PET algorithms with built-in forward and backward projection operations available to the user as a MATLAB/Octave class. OMEGA also includes direct support for GATE simulated data, facilitating easy evaluation of the new algorithms using Monte Carlo simulated PET data. OMEGA supports parallel computing by utilizing OpenMP for CPU implementations and OpenCL for GPU allowing any hardware to be used. OMEGA includes built-in function for the computation of normalization correction and allows several other corrections to be applied such as attenuation, randoms or scatter. OMEGA includes several different maximum-likelihood and maximum a posteriori (MAP) algorithms with several different priors. The user can also input their own priors to the built-in MAP functions. The image reconstruction in OMEGA can be computed either by using an explicitly computed system matrix or with a matrix-free formalism, where the latter can be accelerated with OpenCL. We provide an overview on the software and present some examples utilizing the different features of the software.

Multispectral Interlaced Sparse Sampling Photoacoustic Tomography

Multispectral photoacoustic tomography (PAT) is capable of resolving tissue chromophore distribution based on spectral un-mixing. It works by identifying the absorption spectrum variations from a sequence of photoacoustic images acquired at multiple illumination wavelengths. Due to multispectral acquisition, this inevitably creates a large dataset. To cut down the data volume, sparse sampling methods that reduce the number of detectors have been developed. However, image reconstruction of sparse sampling PAT is challenging because of insufficient angular coverage. During spectral un-mixing, these inaccurate reconstructions will further amplify imaging artefacts and contaminate the results. To solve this problem, we present the interlaced sparse sampling (ISS) PAT, a method that involved: 1) a novel scanning-based image acquisition scheme in which the sparse detector array rotates while switching illumination wavelength, such that a dense angular coverage could be achieved by using only a few detectors; and 2) a corresponding image reconstruction algorithm that makes use of an anatomical prior image created from the ISS strategy to guide PAT image computation. Reconstructed from the signals acquired at different wavelengths (angles), this self-generated prior image fuses multispectral and angular information, and thus has rich anatomical features and minimum artefacts. A specialized iterative imaging model that effectively incorporates this anatomical prior image into the reconstruction process is also developed. Simulation, phantom, and in vivo animal experiments showed that even under 1/6 or 1/8 sparse sampling rate, our method achieved comparable image reconstruction and spectral un-mixing results to those obtained by conventional dense sampling method.

PET Image Deblurring and Super-Resolution with an MR-Based Joint Entropy Prior

The intrinsically limited spatial resolution of PET confounds image quantitation. This paper presents an image deblurring and super-resolution framework for PET using anatomical guidance provided by high-resolution MR images. The framework relies on image-domain post-processing of already-reconstructed PET images by means of spatially-variant deconvolution stabilized by an MR-based joint entropy penalty function. The method is validated through simulation studies based on the BrainWeb digital phantom, experimental studies based on the Hoffman phantom, and clinical neuroimaging studies pertaining to aging and Alzheimer's disease. The developed technique was compared with direct deconvolution and deconvolution stabilized by a quadratic difference penalty, a total variation penalty, and a Bowsher penalty. The BrainWeb simulation study showed improved image quality and quantitative accuracy measured by contrast-to-noise ratio, structural similarity index, root-mean-square error, and peak signal-to-noise ratio generated by this technique. The Hoffman phantom study indicated noticeable improvement in the structural similarity index (relative to the MR image) and gray-to-white contrast-to-noise ratio. Finally, clinical amyloid and tau imaging studies for Alzheimer's disease showed lowering of the coefficient of variation in several key brain regions associated with two target pathologies.

Enhancement of dynamic myocardial perfusion PET images based on low-rank plus sparse decomposition

BACKGROUND AND OBJECTIVE

The absolute quantification of dynamic myocardial perfusion (MP) PET imaging is challenged by the limited spatial resolution of individual frame images due to division of the data into shorter frames. This study aims to develop a method for restoration and enhancement of dynamic PET images.

METHODS

We propose that the image restoration model should be based on multiple constraints rather than a single constraint, given the fact that the image characteristic is hardly described by a single constraint alone. At the same time, it may be possible, but not optimal, to regularize the image with multiple constraints simultaneously. Fortunately, MP PET images can be decomposed into a superposition of background vs. dynamic components via low-rank plus sparse (L + S) decomposition. Thus, we propose an L + S decomposition based MP PET image restoration model and express it as a convex optimization problem. An iterative soft thresholding algorithm was developed to solve the problem. Using realistic dynamic ⁸²Rb MP PET scan data, we optimized and compared its performance with other restoration methods.

RESULTS

The proposed method resulted in substantial visual as well as quantitative accuracy improvements in terms of noise versus bias performance, as demonstrated in extensive ⁸²Rb MP PET simulations. In particular, the myocardium defect in the MP PET images had improved visual as well as contrast versus noise tradeoff. The proposed algorithm was also applied on an 8-min clinical cardiac ⁸²Rb MP PET study performed on the GE Discovery PET/CT, and demonstrated improved quantitative accuracy (CNR and SNR) compared to other algorithms.

CONCLUSIONS

The proposed method is effective for restoration and enhancement of dynamic PET images.

Joint MR-PET Reconstruction Using a Multi-Channel Image Regularizer

While current state of the art MR-PET scanners enable simultaneous MR and PET measurements, the acquired data sets are still usually reconstructed separately. We propose a new multi-modality reconstruction framework using second order Total Generalized Variation (TGV) as a dedicated multi-channel regularization functional that jointly reconstructs images from both modalities. In this way, information about the underlying anatomy is shared during the image reconstruction process while unique differences are preserved. Results from numerical simulations and in-vivo experiments using a range of accelerated MR acquisitions and different MR image contrasts demonstrate improved PET image quality, resolution, and quantitative accuracy.

PET Reconstruction With an Anatomical MRI Prior Using Parallel Level Sets

The combination of positron emission tomography (PET) and magnetic resonance imaging (MRI) offers unique possibilities. In this paper we aim to exploit the high spatial resolution of MRI to enhance the reconstruction of simultaneously acquired PET data. We propose a new prior to incorporate structural side information into a maximum a posteriori reconstruction. The new prior combines the strengths of previously proposed priors for the same problem: it is very efficient in guiding the reconstruction at edges available from the side information and it reduces locally to edge-preserving total variation in the degenerate case when no structural information is available. In addition, this prior is segmentation-free, convex and no a priori assumptions are made on the correlation of edge directions of the PET and MRI images. We present results for a simulated brain phantom and for real data acquired by the Siemens Biograph mMR for a hardware phantom and a clinical scan. The results from simulations show that the new prior has a better trade-off between enhancing common anatomical boundaries and preserving unique features than several other priors. Moreover, it has a better mean absolute bias-to-mean standard deviation trade-off and yields reconstructions with superior relative l²-error and structural similarity index. These findings are underpinned by the real data results from a hardware phantom and a clinical patient confirming that the new prior is capable of promoting well-defined anatomical boundaries.