MR-guided dynamic PET reconstruction with the kernel method and spectral temporal basis functions

PET image reconstruction using weighted nuclear norm maximization and deep learning prior

The ill-posed Positron emission tomography (PET) reconstruction problem usually results in limited resolution and significant noise. Recently, deep neural networks have been incorporated into PET iterative reconstruction framework to improve the image quality. In this paper, we propose a new neural network-based iterative reconstruction method by using weighted nuclear norm (WNN) maximization, which aims to recover the image details in the reconstruction process. The novelty of our method is the application of WNN maximization rather than WNN minimization in PET image reconstruction. Meanwhile, a neural network is used to control the noise originated from WNN maximization. Our method is evaluated on simulated and clinical datasets. The simulation results show that the proposed approach outperforms state-of-the-art neural network-based iterative methods by achieving the best contrast/noise tradeoff with a remarkable contrast improvement on the lesion contrast recovery. The study on clinical datasets also demonstrates that our method can recover lesions of different sizes while suppressing noise in various low-dose PET image reconstruction tasks. Our code is available athttps://github.com/Kuangxd/PETReconstruction.

Anatomically Guided PET Image Reconstruction Using Conditional Weakly-Supervised Multi-Task Learning Integrating Self-Attention

To address the lack of high-quality training labels in positron emission tomography (PET) imaging, weakly-supervised reconstruction methods that generate network-based mappings between prior images and noisy targets have been developed. However, the learned model has an intrinsic variance proportional to the average variance of the target image. To suppress noise and improve the accuracy and generalizability of the learned model, we propose a conditional weakly-supervised multi-task learning (MTL) strategy, in which an auxiliary task is introduced serving as an anatomical regularizer for the PET reconstruction main task. In the proposed MTL approach, we devise a novel multi-channel self-attention (MCSA) module that helps learn an optimal combination of shared and task-specific features by capturing both local and global channel-spatial dependencies. The proposed reconstruction method was evaluated on NEMA phantom PET datasets acquired at different positions in a PET/CT scanner and 26 clinical whole-body PET datasets. The phantom results demonstrate that our method outperforms state-of-the-art learning-free and weakly-supervised approaches obtaining the best noise/contrast tradeoff with a significant noise reduction of approximately 50.0% relative to the maximum likelihood (ML) reconstruction. The patient study results demonstrate that our method achieves the largest noise reductions of 67.3% and 35.5% in the liver and lung, respectively, as well as consistently small biases in 8 tumors with various volumes and intensities. In addition, network visualization reveals that adding the auxiliary task introduces more anatomical information into PET reconstruction than adding only the anatomical loss, and the developed MCSA can abstract features and retain PET image details.

Partial volume correction of PET image data using geometric transfer matrices based on uniform B-splines

Objective. Most methods for partial volume correction (PVC) of positron emission tomography (PET) data employ anatomical segmentation of images into regions of interest. This approach is not optimal for exploratory functional imaging beyond regional hypotheses. Here, we describe a novel method for unbiased voxel-wise PVC.Approach.B-spline basis functions were combined with geometric transfer matrices to enable a method (bsGTM) that provides PVC or alternatively provides smoothing with minimal regional crosstalk. The efficacy of the proposed method was evaluated using Monte Carlo simulations, human PET data, and murine functional PET data.Main results.In simulations, bsGTM provided recovery of partial volume signal loss comparable to iterative deconvolution, while demonstrating superior resilience to noise. In a real murine PET dataset, bsGTM yielded much higher sensitivity for detecting amphetamine-induced reduction of [11C]raclopride binding potential. In human PET data, bsGTM smoothing enabled increased signal-to-noise ratios with less degradation of binding potentials relative to Gaussian convolution or non-local means.Significance.bsGTM offers improved performance for PVC relative to iterative deconvolution, the current method of choice for voxel-wise PVC, especially in the common PET regime of low signal-to-noise ratio. The new method provides an anatomically unbiased way to compensate partial volume errors in cases where anatomical segmentation is unavailable or of questionable relevance or accuracy.

Deep Generalized Learning Model for PET Image Reconstruction

Low-count positron emission tomography (PET) imaging is challenging because of the ill-posedness of this inverse problem. Previous studies have demonstrated that deep learning (DL) holds promise for achieving improved low-count PET image quality. However, almost all data-driven DL methods suffer from fine structure degradation and blurring effects after denoising. Incorporating DL into the traditional iterative optimization model can effectively improve its image quality and recover fine structures, but little research has considered the full relaxation of the model, resulting in the performance of this hybrid model not being sufficiently exploited. In this paper, we propose a learning framework that deeply integrates DL and an alternating direction of multipliers method (ADMM)-based iterative optimization model. The innovative feature of this method is that we break the inherent forms of the fidelity operators and use neural networks to process them. The regularization term is deeply generalized. The proposed method is evaluated on simulated data and real data. Both the qualitative and quantitative results show that our proposed neural network method can outperform partial operator expansion-based neural network methods, neural network denoising methods and traditional methods.

AI for PET image reconstruction

Image reconstruction for positron emission tomography (PET) has been developed over many decades, with advances coming from improved modelling of the data statistics and improved modelling of the imaging physics. However, high noise and limited spatial resolution have remained issues in PET imaging, and state-of-the-art PET reconstruction has started to exploit other medical imaging modalities (such as MRI) to assist in noise reduction and enhancement of PET's spatial resolution. Nonetheless, there is an ongoing drive towards not only improving image quality, but also reducing the injected radiation dose and reducing scanning times. While the arrival of new PET scanners (such as total body PET) is helping, there is always a need to improve reconstructed image quality due to the time and count limited imaging conditions. Artificial intelligence (AI) methods are now at the frontier of research for PET image reconstruction. While AI can learn the imaging physics as well as the noise in the data (when given sufficient examples), one of the most common uses of AI arises from exploiting databases of high-quality reference examples, to provide advanced noise compensation and resolution recovery. There are three main AI reconstruction approaches: (i) direct data-driven AI methods which rely on supervised learning from reference data, (ii) iterative (unrolled) methods which combine our physics and statistical models with AI learning from data, and (iii) methods which exploit AI with our known models, but crucially can offer benefits even in the absence of any example training data whatsoever. This article reviews these methods, considering opportunities and challenges of AI for PET reconstruction.

Neural KEM: A Kernel Method With Deep Coefficient Prior for PET Image Reconstruction

Image reconstruction of low-count positron emission tomography (PET) data is challenging. Kernel methods address the challenge by incorporating image prior information in the forward model of iterative PET image reconstruction. The kernelized expectation-maximization (KEM) algorithm has been developed and demonstrated to be effective and easy to implement. A common approach for a further improvement of the kernel method would be adding an explicit regularization, which however leads to a complex optimization problem. In this paper, we propose an implicit regularization for the kernel method by using a deep coefficient prior, which represents the kernel coefficient image in the PET forward model using a convolutional neural-network. To solve the maximum-likelihood neural network-based reconstruction problem, we apply the principle of optimization transfer to derive a neural KEM algorithm. Each iteration of the algorithm consists of two separate steps: a KEM step for image update from the projection data and a deep-learning step in the image domain for updating the kernel coefficient image using the neural network. This optimization algorithm is guaranteed to monotonically increase the data likelihood. The results from computer simulations and real patient data have demonstrated that the neural KEM can outperform existing KEM and deep image prior methods.

Spatiotemporal Kernel Reconstruction for Linear Parametric Neurotransmitter PET Kinetic Modeling in Motion Correction Brain PET of Awake Rats

The linear parametric neurotransmitter positron emission tomography (lp-ntPET) kinetic model can be used to detect transient changes (activation) in endogenous neurotransmitter levels. Preclinical PET scans in awake animals can be performed to investigate neurotransmitter transient changes. Here we use the spatiotemporal kernel reconstruction (Kernel) for noise reduction in dynamic PET, and lp-ntPET kinetic modeling. Kernel is adapted for motion correction reconstruction, applied in awake rat PET scans. We performed 2D rat brain phantom simulation using the ntPET model at 3 different noise levels. Data was reconstructed with independent frame reconstruction (IFR), IFR with HYPR denoising, and Kernel, and lp-ntPET kinetic parameters (k 2a : efflux rate, γ: activation magnitude, t d : activation onset time, and t p : activation peak time) were calculated. Additionally, significant activation magnitude (γ) difference with respect to a region with no activation (rest) was calculated. Finally, [11C]raclopride experiments were performed in anesthetized and awake rats, injecting cold raclopride at 20 min after scan start to simulate endogenous neurotransmitter release. For simulated data at the regional level, IFR coefficient of variation (COV) of k 2a , γ, t d and t p was reduced with HYPR denoising, but Kernel showed the lowest COV (2 fold reduction compared with IFR). At the pixel level the same trend is observed for k 2a , γ, t d and t p COV, but reduction is larger with Kernel compared with IFR (10-14 fold). Bias in γ with respect with noise-free values was additionally reduced using Kernel (difference of 292, 72.4, and -6.92% for IFR, IFR+KYPR, and Kernel, respectively). Significant difference in activation between the rest and active region could be detected at a simulated activation of 160% for IFR and IFR+HYPR, and of 120% for Kernel. In rat experiments, lp-ntPET parameters have better confidence intervals using Kernel. In the γ, and t d parametric maps, the striatum structure can be identified with Kernel but not with IFR. Striatum voxel-wise γ, t d and t p values have lower variability using Kernel compared with IFR and IFR+HYPR. The spatiotemporal kernel reconstruction adapted for motion correction reconstruction allows to improve lp-ntPET kinetic modeling noise in awake rat studies, as well as detection of subtle neurotransmitter activations.

Hybrid kernelised expectation maximisation for Bremsstrahlung SPECT reconstruction in SIRT with 90Y micro-spheres

Background

Selective internal radiation therapy with Yttrium-90 microspheres is an effective therapy for liver cancer and liver metastases. Yttrium-90 is mainly a high-energy beta particle emitter. These beta particles emit Bremsstrahlung radiation during their interaction with tissue making post-therapy imaging of the radioactivity distribution feasible. Nevertheless, image quality and quantification is difficult due to the continuous energy spectrum which makes resolution modelling, attenuation and scatter estimation challenging and therefore the dosimetry quantification is inaccurate. As a consequence a reconstruction algorithm able to improve resolution could be beneficial.

Methods

In this study, the hybrid kernelised expectation maximisation (HKEM) is used to improve resolution and contrast and reduce noise, in addition a modified HKEM called frozen HKEM (FHKEM) is investigated to further reduce noise. The iterative part of the FHKEM kernel was frozen at the 72nd sub-iteration. When using ordered subsets algorithms the data is divided in smaller subsets and the smallest algorithm iterative step is called sub-iteration. A NEMA phantom with spherical inserts was used for the optimisation and validation of the algorithm, and data from 5 patients treated with Selective internal radiation therapy were used as proof of clinical relevance of the method.

Results

The results suggest a maximum improvement of 56% for region of interest mean recovery coefficient at fixed coefficient of variation and better identification of the hot volumes in the NEMA phantom. Similar improvements were achieved with patient data, showing 47% mean value improvement over the gold standard used in hospitals.

Conclusions

Such quantitative improvements could facilitate improved dosimetry calculations with SPECT when treating patients with Selective internal radiation therapy, as well as provide a more visible position of the cancerous lesions in the liver.

Deep learning-based image reconstruction and post-processing methods in positron emission tomography for low-dose imaging and resolution enhancement

Image processing plays a crucial role in maximising diagnostic quality of positron emission tomography (PET) images. Recently, deep learning methods developed across many fields have shown tremendous potential when applied to medical image enhancement, resulting in a rich and rapidly advancing literature surrounding this subject. This review encapsulates methods for integrating deep learning into PET image reconstruction and post-processing for low-dose imaging and resolution enhancement. A brief introduction to conventional image processing techniques in PET is firstly presented. We then review methods which integrate deep learning into the image reconstruction framework as either deep learning-based regularisation or as a fully data-driven mapping from measured signal to images. Deep learning-based post-processing methods for low-dose imaging, temporal resolution enhancement and spatial resolution enhancement are also reviewed. Finally, the challenges associated with applying deep learning to enhance PET images in the clinical setting are discussed and future research directions to address these challenges are presented.

Review and Prospect: Artificial Intelligence in Advanced Medical Imaging

Artificial intelligence (AI) as an emerging technology is gaining momentum in medical imaging. Recently, deep learning-based AI techniques have been actively investigated in medical imaging, and its potential applications range from data acquisition and image reconstruction to image analysis and understanding. In this review, we focus on the use of deep learning in image reconstruction for advanced medical imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and positron emission tomography (PET). Particularly, recent deep learning-based methods for image reconstruction will be emphasized, in accordance with their methodology designs and performances in handling volumetric imaging data. It is expected that this review can help relevant researchers understand how to adapt AI for medical imaging and which advantages can be achieved with the assistance of AI.

Dynamic PET image reconstruction incorporating a median nonlocal means kernel method

In dynamic positron emission tomography (PET) imaging, the reconstructed image of a single frame often exhibits high noise due to limited counting statistics of projection data. This study proposed a median nonlocal means (MNLM)-based kernel method for dynamic PET image reconstruction. The kernel matrix is derived from median nonlocal means of pre-reconstructed composite images. Then the PET image intensities in all voxels were modeled as a kernel matrix multiplied by coefficients and incorporated into the forward model of PET projection data. Then, the coefficients of each feature were estimated by the maximum likelihood method. Using simulated low-count dynamic data of Zubal head phantom, the quantitative performance of the proposed MNLM kernel method was investigated and compared with the maximum-likelihood method, conventional kernel method with and without median filter, and nonlocal means (NLM) kernel method. Simulation results showed that the MNLM kernel method achieved visual and quantitative accuracy improvements (in terms of the ensemble mean squared error, bias versus variance, and contrast versus noise performances). Especially for frame 2 with the lowest count level of a single frame, the MNLM kernel method achieves lower ensemble mean squared error (10.43%) than the NLM kernel method (13.68%), conventional kernel method with and without median filter (11.88% and 23.50%), and MLEM algorithm (24.77%). The study on real low-dose ¹⁸F-FDG rat data also showed that the MNLM kernel method outperformed other methods in visual and quantitative accuracy improvements (in terms of regional noise versus intensity mean performance).

Use of dynamic reconstruction for parametric Patlak imaging in dynamic whole body PET

Dynamic whole body (DWB) PET acquisition protocols enable the use of whole body parametric imaging for clinical applications. In FDG imaging, accurate parametric images of PatlakK_ican be complementary to regular standardised uptake value images and improve on current applications or enable new ones. In this study we consider DWB protocols implemented on clinical scanners with a limited axial field of view with the use of multiple whole body sweeps. These protocols result in temporal gaps in the dynamic data which produce noisier and potentially more biased parametric images, compared to single bed (SB) dynamic protocols. Dynamic reconstruction using the Patlak model has been previously proposed to overcome these limits and shown improved DWB parametric images ofK_i. In this work, we propose and make use of a spectral analysis based model for dynamic reconstruction and parametric imaging of PatlakK_i. Both dynamic reconstruction methods were evaluated for DWB FDG protocols and compared against 3D reconstruction based parametric imaging from SB dynamic protocols. This work was conducted on simulated data and results were tested against real FDG dynamic data. We showed that dynamic reconstruction can achieve levels of parametric image noise and bias comparable to 3D reconstruction in SB dynamic studies, with the spectral model offering additional flexibility and further reduction of image noise. Comparisons were also made between step and shoot and continuous bed motion (CBM) protocols, which showed that CBM can achieve lower parametric image noise due to reduced acquisition temporal gaps. Finally, our results showed that dynamic reconstruction improved VOI parametric mean estimates but did not result to fully converged values before resulting in undesirable levels of noise. Additional regularisation methods need to be considered for DWB protocols to ensure both accurate quantification and acceptable noise levels for clinical applications.

Modified kernel MLAA using autoencoder for PET-enabled dual-energy CT

Combined use of PET and dual-energy CT provides complementary information for multi-parametric imaging. PET-enabled dual-energy CT combines a low-energy X-ray CT image with a high-energy γ-ray CT (GCT) image reconstructed from time-of-flight PET emission data to enable dual-energy CT material decomposition on a PET/CT scanner. The maximum-likelihood attenuation and activity (MLAA) algorithm has been used for GCT reconstruction but suffers from noise. Kernel MLAA exploits an X-ray CT image prior through the kernel framework to guide GCT reconstruction and has demonstrated substantial improvements in noise suppression. However, similar to other kernel methods for image reconstruction, the existing kernel MLAA uses image intensity-based features to construct the kernel representation, which is not always robust and may lead to suboptimal reconstruction with artefacts. In this paper, we propose a modified kernel method by using an autoencoder convolutional neural network (CNN) to extract an intrinsic feature set from the X-ray CT image prior. A computer simulation study was conducted to compare the autoencoder CNN-derived feature representation with raw image patches for evaluation of kernel MLAA for GCT image reconstruction and dual-energy multi-material decomposition. The results show that the autoencoder kernel MLAA method can achieve a significant image quality improvement for GCT and material decomposition as compared to the existing kernel MLAA algorithm. A weakness of the proposed method is its potential over-smoothness in a bone region, indicating the importance of further optimization in future work. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 2'.

Technical note: A preliminary study of dual-tracer PET image reconstruction guided by FDG and/or MR kernels

PURPOSE

Clinically, single radiotracer positron emission tomography (PET) imaging is a commonly used examination method; however, since each radioactive tracer reflects the information of only one kind of cell, it easily causes false negatives or false positives in disease diagnosis. Therefore, reasonably combining two or more radiotracers is recommended to improve the accuracy of diagnosis and the sensitivity and specificity of the disease when conditions permit.

METHODS

This paper proposes incorporating ¹⁸ F-fluorodeoxyglucose (FDG) as a higher-quality PET image to guide the reconstruction of other lower-count ¹¹ C-methionine (MET) PET datasets to compensate for the lower image quality by a popular kernel algorithm. Specifically, the FDG prior is needed to extract kernel features, and these features were used to build a kernel matrix using a k-nearest-neighbor (kNN) search for MET image reconstruction. We created a 2-D brain phantom to validate the proposed method by simulating sinogram data containing Poisson random noise and quantitatively compared the performance of the proposed FDG-guided kernelized expectation maximization (KEM) method with the performance of Gaussian and non-local means (NLM) smoothed maximum likelihood expectation maximization (MLEM), MR-guided KEM, and multi-guided-S KEM algorithms. Mismatch experiments between FDG/MR and MET data were also carried out to investigate the outcomes of possible clinical situations.

RESULTS

In the simulation study, the proposed method outperformed the other algorithms by at least 3.11% in the signal-to-noise ratio (SNR) and 0.68% in the contrast recovery coefficient (CRC), and it reduced the mean absolute error (MAE) by 8.07%. Regarding the tumor in the reconstructed image, the proposed method contained more pathological information. Furthermore, the proposed method was still superior to the MR-guided KEM method in the mismatch experiments.

CONCLUSIONS

The proposed FDG-guided KEM algorithm can effectively utilize and compensate for the tissue metabolism information obtained from dual-tracer PET to maximize the advantages of PET imaging.

(An overview of) Synergistic reconstruction for multimodality/multichannel imaging methods

Imaging is omnipresent in modern society with imaging devices based on a zoo of physical principles, probing a specimen across different wavelengths, energies and time. Recent years have seen a change in the imaging landscape with more and more imaging devices combining that which previously was used separately. Motivated by these hardware developments, an ever increasing set of mathematical ideas is appearing regarding how data from different imaging modalities or channels can be synergistically combined in the image reconstruction process, exploiting structural and/or functional correlations between the multiple images. Here we review these developments, give pointers to important challenges and provide an outlook as to how the field may develop in the forthcoming years. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 1'.

Low activity [11C]raclopride kinetic modeling in the mouse brain using the spatiotemporal kernel method

Depending on the molar activity of the tracer, the maximal allowable injected activity in mouse brain PET studies can be extremely low in order to avoid receptor saturation. Therefore, a high level of noise can be present in the image. We investigate several dynamic PET reconstruction methods in reduced counts, or equivalently in reduced injected activity, data exemplified in [¹¹C]racloprideBP_NDandR1quantification using the simplified reference tissue model (SRTM). We compared independent frame reconstruction (IFR), post-reconstruction HYPR denoising (IFR + HYPR), direct reconstruction using the SRTM model (DIR-SRTM), and the spatial (KERS) and spatiotemporal kernel reconstruction (KERST). Additionally, HYPR denoising of the frames used as features for the calculation of the spatial kernel matrix, was investigated (KERS-HYPR and KERST-HYPR).In vivodata of 11 mice, was used to generate list-mode data for five reduced count levels corresponding to reductions by a factor 4, 8, 12, 16 and 32 (equivalently 2.07, 1.04, 0.691, 0.518, and 0.260 MBq). Correlation of regionalBP_NDandR1values (reduced versus full counts reconstructions) was high (r > 0.94) for all methods, with KERS-HYPR and KERST-HYPR reaching the highest correlation (r > 0.96). Among methods with regularization, DIR-SRTM showed the largest variability inBP_ND(Bland-Altman SD from 3.0% to 12%), while IFR showed it forR1(5.1%-14.6%). KERST and KERST-HYPR were the only methods with Bland-Altman bias and SD below 5% for noise level up to a reduction factor of 16. At the voxel level,BP_NDandR1correlation was gradually decreased with increasing noise, with the largest correlation (BP_NDr > 0.88,R1r > 0.62) for KERS-HYPR and KERST-HYPR. The spatial and the spatiotemporal kernel methods performed similarly, while using only temporal regularization with direct reconstruction showed more variability. AlthoughR1 values present noise, using the spatiotemporal kernel reconstruction, accurate estimates of binding potential could be obtained with mouse injected activities as low as 0.26-0.518 MBq. This is desirable in order to maintain the tracer kinetics principle in mouse studies.

Anatomy-guided PET reconstruction usingl1bowsher prior

Advances in simultaneous positron emission tomography/magnetic resonance imaging (PET/MRI) technology have led to an active investigation of the anatomy-guided regularized PET image reconstruction algorithm based on MR images. Among the various priors proposed for anatomy-guided regularized PET image reconstruction, Bowsher's method based on second-order smoothing priors sometimes suffers from over-smoothing of detailed structures. Therefore, in this study, we propose a Bowsher prior based on thel1-norm and an iteratively reweighting scheme to overcome the limitation of the original Bowsher method. In addition, we have derived a closed solution for iterative image reconstruction based on this non-smooth prior. A comparison study between the originall2and proposedl1Bowsher priors was conducted using computer simulation and real human data. In the simulation and real data application, small lesions with abnormal PET uptake were better detected by the proposedl1Bowsher prior methods than the original Bowsher prior. The originall2Bowsher leads to a decreased PET intensity in small lesions when there is no clear separation between the lesions and surrounding tissue in the anatomical prior. However, the proposedl1Bowsher prior methods showed better contrast between the tumors and surrounding tissues owing to the intrinsic edge-preserving property of the prior which is attributed to the sparseness induced byl1-norm, especially in the iterative reweighting scheme. Besides, the proposed methods demonstrated lower bias and less hyper-parameter dependency on PET intensity estimation in the regions with matched anatomical boundaries in PET and MRI. Therefore, these methods will be useful for improving the PET image quality based on the anatomical side information.

PET-enabled dual-energy CT: image reconstruction and a proof-of-concept computer simulation study

Standard dual-energy computed tomography (CT) uses two different x-ray energies to obtain energy-dependent tissue attenuation information to allow quantitative material decomposition. The combined use of dual-energy CT and positron emission tomography (PET) may provide a more comprehensive characterization of disease states in cancer and other diseases. However, the integration of dual-energy CT with PET is not trivial, either requiring costly hardware upgrades or increasing radiation exposure. This paper proposes a different dual-energy CT imaging method that is enabled by PET. Instead of using a second x-ray CT scan with a different energy, this method exploits time-of-flight PET image reconstruction via the maximum likelihood attenuation and activity (MLAA) algorithm to obtain a 511 keV gamma-ray attenuation image from PET emission data. The high-energy gamma-ray attenuation image is then combined with the low-energy x-ray CT of PET/CT to provide a pair of dual-energy CT images. A major challenge with the standard MLAA reconstruction is the high noise present in the reconstructed 511 keV attenuation map, which would not compromise the PET activity reconstruction too much but may significantly affect the performance of the gamma-ray attenuation image for material decomposition. To overcome the problem, we further propose a kernel MLAA algorithm to exploit the prior information from the available x-ray CT image. We conducted a computer simulation to test the concept and algorithm for the task of material decomposition. The simulation results demonstrate that this PET-enabled dual-energy CT method is promising for quantitative material decomposition. The proposed method can be readily implemented on time-of-flight PET/CT scanners to enable simultaneous PET and dual-energy CT imaging.

Kernel-based curve-fitting method with spatial regularization for generation of parametric images in dynamic PET

Due to high levels of noise in pixel-wise time-activity curves, the indirect method that generates kinetic parametric images from dynamic positron emission tomography (PET) images often results in poor parametric image quality. We have demonstrated that the quality of parametric images can be improved by denoising dynamic PET images, using gradient-free curve-fitting and applying a kernel-based post-filtering to parametric images. However, many gradient-free curve-fitting methods are time-consuming. Moreover, some parameter estimates (e.g. k₂ and k₃) have large variability. To provide high-quality PET parametric images with low computational cost, we propose a curve-fitting method that incorporates the kernel-based denoising method and the highly constrained backprojection technique into the Levenberg-Marquardt (LM) algorithm. We conducted a simulation study to evaluate the performance of the proposed curve-fitting method. Dynamic PET images were reconstructed using the expectation-maximization (EM) algorithm and were denoised before parameter estimation. Compared to the LM algorithm with and without the kernel-based post-filtering, the proposed method achieved superior performance, offering a decrease in both bias and coefficient of variation (CV) on all parametric images. Overall, the proposed method exhibited lower bias and slightly higher CV than the gradient-free pattern search method with the kernel-based post-filtering (PatS-K). Moreover, the computation time of the proposed method was about 18 times lower than that of the PatS-K method. Finally, we show that the proposed method can further improve the quality of parametric images when dynamic PET images are reconstructed using the kernel-based EM algorithm.

Bootstrap-Optimised Regularised Image Reconstruction for Emission Tomography

In emission tomography, iterative image reconstruction from noisy measured data usually results in noisy images, and so regularisation is often used to compensate for noise. However, in practice, an appropriate, automatic and precise specification of the strength of regularisation for image reconstruction from a given noisy measured dataset remains unresolved. Existing approaches are either empirical approximations with no guarantee of generalisation, or else are computationally intensive cross-validation methods requiring full reconstructions for a limited set of preselected regularisation strengths. In contrast, we propose a novel methodology embedded within iterative image reconstruction, using one or more bootstrapped replicates of the measured data for precise optimisation of the regularisation. The approach uses a conventional unregularised iterative update of a current image estimate from the noisy measured data, and then also uses the bootstrap replicate to obtain a bootstrap update of the current image estimate. The method then seeks the regularisation hyperparameters which, when applied to the bootstrap update of the image, lead to a best fit of the regularised bootstrap update to the conventional measured data update. This corresponds to estimating the degree of regularisation needed in order to map the noisy update to a model of the mean of an ensemble of noisy updates. For a given regularised objective function (e.g. penalised likelihood), no hyperparameter selection or tuning is required. The method is demonstrated for positron emission tomography (PET) data at different noise levels, and delivers near-optimal reconstructions (in terms of reconstruction error) without any knowledge of the ground truth, nor any form of training data.

Intercomparison of MR-informed PET image reconstruction methods

PURPOSE

Numerous image reconstruction methodologies for positron emission tomography (PET) have been developed that incorporate magnetic resonance (MR) imaging structural information, producing reconstructed images with improved suppression of noise and reduced partial volume effects. However, the influence of MR structural information also increases the possibility of suppression or bias of structures present only in the PET data (PET-unique regions). To address this, further developments for MR-informed methods have been proposed, for example, through inclusion of the current reconstructed PET image, alongside the MR image, in the iterative reconstruction process. In this present work, a number of kernel and maximum a posteriori (MAP) methodologies are compared, with the aim of identifying methods that enable a favorable trade-off between the suppression of noise and the retention of unique features present in the PET data.

METHODS

The reconstruction methods investigated were: the MR-informed conventional and spatially compact kernel methods, referred to as KEM and KEM largest value sparsification (LVS) respectively; the MR-informed Bowsher and Gaussian MR-guided MAP methods; and the PET-MR-informed hybrid kernel and anato-functional MAP methods. The trade-off between improving the reconstruction of the whole brain region and the PET-unique regions was investigated for all methods in comparison with postsmoothed maximum likelihood expectation maximization (MLEM), evaluated in terms of structural similarity index (SSIM), normalized root mean square error (NRMSE), bias, and standard deviation. Both simulated BrainWeb (10 noise realizations) and real [18 F] fluorodeoxyglucose (FDG) three-dimensional datasets were used. The real [18 F]FDG dataset was augmented with simulated tumors to allow comparison of the reconstruction methodologies for the case of known regions of PET-MR discrepancy and evaluated at full counts (100%) and at a reduced (10%) count level.

RESULTS

For the high-count simulated and real data studies, the anato-functional MAP method performed better than the other methods under investigation (MR-informed, PET-MR-informed and postsmoothed MLEM), in terms of achieving the best trade-off for the reconstruction of the whole brain and PET-unique regions, assessed in terms of the SSIM, NRMSE, and bias vs standard deviation. The inclusion of PET information in the anato-functional MAP method enables the reconstruction of PET-unique regions to attain similarly low levels of bias as unsmoothed MLEM, while moderately improving the whole brain image quality for low levels of regularization. However, for low count simulated datasets the anato-functional MAP method performs poorly, due to the inclusion of noisy PET information in the regularization term. For the low counts simulated dataset, KEM LVS and to a lesser extent, HKEM performed better than the other methods under investigation in terms of achieving the best trade-off for the reconstruction of the whole brain and PET-unique regions, assessed in terms of the SSIM, NRMSE, and bias vs standard deviation.

CONCLUSION

For the reconstruction of noisy data, multiple MR-informed methods produce favorable whole brain vs PET-unique region trade-off in terms of the image quality metrics of SSIM and NRMSE, comfortably outperforming the whole image denoising of postsmoothed MLEM.

Two novel PET image restoration methods guided by PET-MR kernels: Application to brain imaging

PURPOSE

Post-reconstruction positron emission tomography (PET) image restoration methods that take advantage of available anatomical information can play an important role in accurate quantification of PET images. However, when using anatomical information, the resulting PET image may lose resolution in certain regions where the anatomy does not agree with the change in functional activity. In this work, this problem is addressed by using both magnetic resonance (MR) and filtered PET images to guide the denoising process.

METHODS

In this work, two novel post-reconstruction methods for restoring PET images using the subject's registered T1-weighted MR image are proposed. The first method is based on a representation of the image using basis functions extracted from T1-weighted MR and filtered PET image. The coefficients for these basis functions are estimated using a sparsity-penalized least squares objective function. The second method is a noniterative fast method that uses guided kernel filtering in combination with twicing to restore the noisy PET image. When applied after conventional PVE correction, these methods can be considered as voxel-based MR-guided partial volume effect (PVE) correction methods.

RESULTS

Using simulation analyses of [ 18 F]FDG PET images of the brain with lesions, the proposed methods are compared to other denoising methods through different figures of merit. The results show promising improvements in image quality as well as reduction in bias and variance of the lesions. We also show the application of the proposed methods on real [ 18 F]FDG data.

CONCLUSION

Two methods for restoring PET images were proposed. The methods were evaluated on simulation and real brain images. Most MR-guided PVE correction methods are only based on segmented T1-weighted images and their accuracy is very sensitive to segmentation errors, especially in regions of abnormalities and lesions. However, both proposed methods can use the T1-weighted image without segmentation. The simplicity and the very low computational cost of the second method make it suitable for clinical applications and large data studies. The proposed methods can be naturally extended to PVE correction and denoising of other functional modalities using corresponding anatomical information.

Indirect methods for improving parameter estimation of PET kinetic models

PURPOSE

Parametric images obtained from kinetic modeling of dynamic positron emission tomography (PET) data provide a new way of visualizing quantitative parameters of the tracer kinetics. However, due to the high noise level in pixel-wise image-driven time-activity curves, parametric images often suffer from poor quality and accuracy. In this study, we propose an indirect parameter estimation framework which aims to improve the quality and quantitative accuracy of parametric images.

METHODS

Three different approaches related to noise reduction and advanced curve fitting algorithm are used in the proposed framework. First, dynamic PET images are denoised using a kernel-based denoising method and the highly constrained backprojection technique. Second, gradient-free curve fitting algorithms are exploited to improve the accuracy and precision of parameter estimates. Third, a kernel-based post-filtering method is applied to parametric images to further improve the quality of parametric images. Computer simulations were performed to evaluate the performance of the proposed framework.

RESULTS AND CONCLUSIONS

The simulation results showed that when compared to the Gaussian filtering, the proposed denoising method could provide better PET image quality, and consequentially improve the quality and quantitative accuracy of parametric images. In addition, gradient-free optimization algorithms (i.e., pattern search) can result in better parametric images than the gradient-based curve fitting algorithm (i.e., trust-region-reflective). Finally, our results showed that the proposed kernel-based post-filtering method could further improve the precision of parameter estimates while maintaining the accuracy of parameter estimates.

High Temporal-Resolution Dynamic PET Image Reconstruction Using a New Spatiotemporal Kernel Method

Current clinical dynamic PET has an effective temporal resolution of 5-10 seconds, which can be adequate for traditional compartmental modeling but is inadequate for exploiting the benefit of more advanced tracer kinetic modeling for characterization of diseases (e.g., cancer and heart disease). There is a need to improve dynamic PET to allow fine temporal sampling of 1-2 seconds. However, the reconstruction of these short-time frames from tomographic data is extremely challenging as the count level of each frame is very low and high noise presents in both spatial and temporal domains. Previously, the kernel framework has been developed and demonstrated as a statistically efficient approach to utilizing image prior for low-count PET image reconstruction. Nevertheless, the existing kernel methods mainly explore spatial correlations in the data and only have a limited ability in suppressing temporal noise. In this paper, we propose a new kernel method which extends the previous spatial kernel method to the general spatiotemporal domain. The new kernelized model encodes both spatial and temporal correlations obtained from image prior information and are incorporated into the PET forward projection model to improve themaximumlikelihood(ML) image reconstruction. Computer simulations and an application to real patient scan have shown that the proposed approach can achieve effective noise reduction in both spatial and temporal domains and outperform the spatial kernel method and conventional ML reconstruction method for improving the high temporal-resolution dynamic PET imaging.

Iterative PET Image Reconstruction Using Convolutional Neural Network Representation

PET image reconstruction is challenging due to the ill-poseness of the inverse problem and limited number of detected photons. Recently, the deep neural networks have been widely and successfully used in computer vision tasks and attracted growing interests in medical imaging. In this paper, we trained a deep residual convolutional neural network to improve PET image quality by using the existing inter-patient information. An innovative feature of the proposed method is that we embed the neural network in the iterative reconstruction framework for image representation, rather than using it as a post-processing tool. We formulate the objective function as a constrained optimization problem and solve it using the alternating direction method of multipliers algorithm. Both simulation data and hybrid real data are used to evaluate the proposed method. Quantification results show that our proposed iterative neural network method can outperform the neural network denoising and conventional penalized maximum likelihood methods.

Hybrid PET/MR Kernelised Expectation Maximisation Reconstruction for Improved Image-Derived Estimation of the Input Function from the Aorta of Rabbits

Positron emission tomography (PET) provides simple noninvasive imaging biomarkers for multiple human diseases which can be used to produce quantitative information from single static images or to monitor dynamic processes. Such kinetic studies often require the tracer input function (IF) to be measured but, in contrast to direct blood sampling, the image-derived input function (IDIF) provides a noninvasive alternative technique to estimate the IF. Accurate estimation can, in general, be challenging due to the partial volume effect (PVE), which is particularly important in preclinical work on small animals. The recently proposed hybrid kernelised ordered subsets expectation maximisation (HKEM) method has been shown to improve accuracy and contrast across a range of different datasets and count levels and can be used on PET/MR or PET/CT data. In this work, we apply the method with the purpose of providing accurate estimates of the aorta IDIF for rabbit PET studies. In addition, we proposed a method for the extraction of the aorta region of interest (ROI) using the MR and the HKEM image, to minimise the PVE within the rabbit aortic region-a method which can be directly transferred to the clinical setting. A realistic simulation study was performed with ten independent noise realisations while two, real data, rabbit datasets, acquired with the Biograph Siemens mMR PET/MR scanner, were also considered. For reference and comparison, the data were reconstructed using OSEM, OSEM with Gaussian postfilter and KEM, as well as HKEM. The results across the simulated datasets and different time frames show reduced PVE and accurate IDIF values for the proposed method, with 5% average bias (0.8% minimum and 16% maximum bias). Consistent results were obtained with the real datasets. The results of this study demonstrate that HKEM can be used to accurately estimate the IDIF in preclinical PET/MR studies, such as rabbit mMR data, as well as in clinical human studies. The proposed algorithm is made available as part of an open software library, and it can be used equally successfully on human or animal data acquired from a variety of PET/MR or PET/CT scanners.

Effect of PET-MR Inconsistency in the Kernel Image Reconstruction Method

Anatomically-driven image reconstruction algorithms have become very popular in positron emission tomography (PET) where they have demonstrated improved image resolution and quantification. This work, consider the effect of spatial inconsistency between MR and PET images in hot and cold regions of the PET image. We investigate these effects on the kernel method from machine learning, in particular, the hybrid kernelized expectation maximization (HKEM). These were applied to Jaszczak phantom and patient data acquired with the Biograph Siemens mMR. The results show that even a small shift can cause a significant change in activity concentration. In general, the PET-MR inconsistencies can induce the partial volume effect, more specifically the 'spill-in' of the affected cold regions and the 'spill-out' from the hot regions. The maximum change was about 100% for the cold region and 10% for the hot lesion using KEM, against the 37% and 8% obtained with HKEM. The findings of this work suggest that including PET information in the kernel enhances the flexibility of the reconstruction in case of spatial inconsistency. Nevertheless, accurate registration and choice of the appropriate MR image for the creation of the kernel is essential to avoid artifacts, blurring, and bias.

Multi-Tracer Guided PET Image Reconstruction

Multi-tracer positron emission tomography (PET) has the potential to enhance PET imaging by providing complementary information from different physiological processes. However, one or more of the images may present high levels of noise. Guided image reconstruction methods transfer information from a guide image into the PET image reconstruction to encourage edge-preserving noise reduction. In this work we aim to reduce noise in poorer quality PET datasets via guidance from higher quality ones by using a weighted quadratic penalty approach. In particular, we applied this methodology to [18F]fluorodeoxyglucose (FDG) and [11C]methionine imaging of gliomas. 3D simulation studies showed that guiding the reconstruction of methionine datasets using pre-existing FDG images reduced reconstruction errors across the whole-brain (-8%) and within a tumour (-36%) compared to maximum likelihood expectation-maximisation (MLEM). Furthermore, guided reconstruction outperformed a comparable non-local means filter, indicating that regularising during reconstruction is preferable to post-reconstruction approaches. Hyperparameters selected from the 3D simulation study were applied to real data, where it was observed that the proposed FDG-guided methionine reconstruction allows for better edge preservation and noise reduction than standard MLEM. Overall, the results in this work demonstrate that transferring information between datasets in multi-tracer PET studies improves image quality and quantification performance.

Spatially-Compact MR-Guided Kernel EM for PET Image Reconstruction

Positron emission tomography (PET) is a highly sensitive functional and molecular imaging modality which can measure picomolar concentrations of an injected radionuclide. However, the physical sensitivity of PET is limited, and reducing the injected dose leads to low count data and noisy reconstructed images. A highly effective way of reducing noise is to reparameterise the reconstruction in terms of MR-derived spatial basis functions. Spatial basis functions derived using the kernel method have demonstrated excellent noise reduction properties and maintain shared PET-MR detailed structures. However, as previously shown in the literature, the MR-guided kernel method may lead to excessive smoothing of structures that are only present in the PET data. This work makes two main contributions in order to address this problem: first, we exploit the potential of the MR-guided kernel method to form more spatially-compact basis functions which are able to preserve PET-unique structures, and secondly, we consider reconstruction at the native MR resolution. The former contribution notably improves the recovery of structures which are unique to the PET data. These adaptations of the kernel method were compared to the conventional implementation of the MR-guided kernel method and also to MLEM, in terms of ability to recover PET unique structures for both simulated and real data. The spatially-compact kernel method showed clear visual and quantitative improvements in the reconstruction of the PET unique structures, relative to the conventional kernel method for all sizes of PET unique structures investigated, whilst maintaining to a large extent the impressive noise mitigating and detail preserving properties of the conventional MR-guided kernel method. We therefore conclude that a spatially-compact parameterisation of the MR-guided kernel method, should be the preferred implementation strategy in order to obviate unnecessary losses in PET-unique details.

From simultaneous to synergistic MR-PET brain imaging: A review of hybrid MR-PET imaging methodologies

Simultaneous Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) scanning is a recent major development in biomedical imaging. The full integration of the PET detector ring and electronics within the MR system has been a technologically challenging design to develop but provides capacity for simultaneous imaging and the potential for new diagnostic and research capability. This article reviews state-of-the-art MR-PET hardware and software, and discusses future developments focusing on neuroimaging methodologies for MR-PET scanning. We particularly focus on the methodologies that lead to an improved synergy between MRI and PET, including optimal data acquisition, PET attenuation and motion correction, and joint image reconstruction and processing methods based on the underlying complementary and mutual information. We further review the current and potential future applications of simultaneous MR-PET in both systems neuroscience and clinical neuroimaging research. We demonstrate a simultaneous data acquisition protocol to highlight new applications of MR-PET neuroimaging research studies.

Artificial Neural Network Enhanced Bayesian PET Image Reconstruction

In positron emission tomography (PET) image reconstruction, the Bayesian framework with various regularization terms has been implemented to constrain the radio tracer distribution. Varying the regularizing weight of a maximum a posteriori (MAP) algorithm specifies a lower bound of the tradeoff between variance and spatial resolution measured from the reconstructed images. The purpose of this paper is to build a patch-based image enhancement scheme to reduce the size of the unachievable region below the bound and thus to quantitatively improve the Bayesian PET imaging. We cast the proposed enhancement as a regression problem which models a highly nonlinear and spatial-varying mapping between the reconstructed image patches and an enhanced image patch. An artificial neural network model named multilayer perceptron (MLP) with backpropagation was used to solve this regression problem through learning from examples. Using the BrainWeb phantoms, we simulated brain PET data at different count levels of different subjects with and without lesions. The MLP was trained using the image patches reconstructed with a MAP algorithm of different regularization parameters for one normal subject at a certain count level. To evaluate the performance of the trained MLP, reconstructed images from other simulations and two patient brain PET imaging data sets were processed. In every testing cases, we demonstrate that the MLP enhancement technique improves the noise and bias tradeoff compared with the MAP reconstruction using different regularizing weights thus decreasing the size of the unachievable region defined by the MAP algorithm in the variance/resolution plane.

Penalized maximum likelihood simultaneous longitudinal PET image reconstruction with difference-image priors

PURPOSE

Many clinical contexts require the acquisition of multiple positron emission tomography (PET) scans of a single subject, for example, to observe and quantitate changes in functional behaviour in tumors after treatment in oncology. Typically, the datasets from each of these scans are reconstructed individually, without exploiting the similarities between them. We have recently shown that sharing information between longitudinal PET datasets by penalizing voxel-wise differences during image reconstruction can improve reconstructed images by reducing background noise and increasing the contrast-to-noise ratio of high-activity lesions. Here, we present two additional novel longitudinal difference-image priors and evaluate their performance using two-dimesional (2D) simulation studies and a three-dimensional (3D) real dataset case study.

METHODS

We have previously proposed a simultaneous difference-image-based penalized maximum likelihood (PML) longitudinal image reconstruction method that encourages sparse difference images (DS-PML), and in this work we propose two further novel prior terms. The priors are designed to encourage longitudinal images with corresponding differences which have (a) low entropy (DE-PML), and (b) high sparsity in their spatial gradients (DTV-PML). These two new priors and the originally proposed longitudinal prior were applied to 2D-simulated treatment response [¹⁸ F]fluorodeoxyglucose (FDG) brain tumor datasets and compared to standard maximum likelihood expectation-maximization (MLEM) reconstructions. These 2D simulation studies explored the effects of penalty strengths, tumor behaviour, and interscan coupling on reconstructed images. Finally, a real two-scan longitudinal data series acquired from a head and neck cancer patient was reconstructed with the proposed methods and the results compared to standard reconstruction methods.

RESULTS

Using any of the three priors with an appropriate penalty strength produced images with noise levels equivalent to those seen when using standard reconstructions with increased counts levels. In tumor regions, each method produces subtly different results in terms of preservation of tumor quantitation and reconstruction root mean-squared error (RMSE). In particular, in the two-scan simulations, the DE-PML method produced tumor means in close agreement with MLEM reconstructions, while the DTV-PML method produced the lowest errors due to noise reduction within the tumor. Across a range of tumor responses and different numbers of scans, similar results were observed, with DTV-PML producing the lowest errors of the three priors and DE-PML producing the lowest bias. Similar improvements were observed in the reconstructions of the real longitudinal datasets, although imperfect alignment of the two PET images resulted in additional changes in the difference image that affected the performance of the proposed methods.

CONCLUSION

Reconstruction of longitudinal datasets by penalizing difference images between pairs of scans from a data series allows for noise reduction in all reconstructed images. An appropriate choice of penalty term and penalty strength allows for this noise reduction to be achieved while maintaining reconstruction performance in regions of change, either in terms of quantitation of mean intensity via DE-PML, or in terms of tumor RMSE via DTV-PML. Overall, improving the image quality of longitudinal datasets via simultaneous reconstruction has the potential to improve upon currently used methods, allow dose reduction, or reduce scan time while maintaining image quality at current levels.

MR-Guided Kernel EM Reconstruction for Reduced Dose PET Imaging

PET image reconstruction is highly susceptible to the impact of Poisson noise, and if shorter acquisition times or reduced injected doses are used, the noisy PET data become even more limiting. The recent development of kernel expectation maximisation (KEM) is a simple way to reduce noise in PET images, and we show in this work that impressive dose reduction can be achieved when the kernel method is used with MR-derived kernels. The kernel method is shown to surpass maximum likelihood expectation maximisation (MLEM) for the reconstruction of low-count datasets (corresponding to those obtained at reduced injected doses) producing visibly clearer reconstructions for unsmoothed and smoothed images, at all count levels. The kernel EM reconstruction of 10% of the data had comparable whole brain voxel-level error measures to the MLEM reconstruction of 100% of the data (for simulated data, at 100 iterations). For regional metrics, the kernel method at reduced dose levels attained a reduced coefficient of variation and more accurate mean values compared to MLEM. However, the advances provided by the kernel method are at the expense of possible over-smoothing of features unique to the PET data. Further assessment on clinical data is required to determine the level of dose reduction that can be routinely achieved using the kernel method, whilst maintaining the diagnostic utility of the scan.

Direct Patlak Reconstruction From Dynamic PET Data Using the Kernel Method With MRI Information Based on Structural Similarity

Positron emission tomography (PET) is a functional imaging modality widely used in oncology, cardiology, and neuroscience. It is highly sensitive, but suffers from relatively poor spatial resolution, as compared with anatomical imaging modalities, such as magnetic resonance imaging (MRI). With the recent development of combined PET/MR systems, we can improve the PET image quality by incorporating MR information into image reconstruction. Previously, kernel learning has been successfully embedded into static and dynamic PET image reconstruction using either PET temporal or MRI information. Here, we combine both PET temporal and MRI information adaptively to improve the quality of direct Patlak reconstruction. We examined different approaches to combine the PET and MRI information in kernel learning to address the issue of potential mismatches between MRI and PET signals. Computer simulations and hybrid real-patient data acquired on a simultaneous PET/MR scanner were used to evaluate the proposed methods. Results show that the method that combines PET temporal information and MRI spatial information adaptively based on the structure similarity index has the best performance in terms of noise reduction and resolution improvement.

A framework based on hidden Markov trees for multimodal PET/CT image co-segmentation

PURPOSE

The purpose of this study was to investigate the use of a probabilistic quad-tree graph (hidden Markov tree, HMT) to provide fast computation, robustness and an interpretational framework for multimodality image processing and to evaluate this framework for single gross tumor target (GTV) delineation from both positron emission tomography (PET) and computed tomography (CT) images.

METHODS

We exploited joint statistical dependencies between hidden states to handle the data stack using multi-observation, multi-resolution of HMT and Bayesian inference. This framework was applied to segmentation of lung tumors in PET/CT datasets taking into consideration simultaneously the CT and the PET image information. PET and CT images were considered using either the original voxels intensities, or after wavelet/contourlet enhancement. The Dice similarity coefficient (DSC), sensitivity (SE), positive predictive value (PPV) were used to assess the performance of the proposed approach on one simulated and 15 clinical PET/CT datasets of non-small cell lung cancer (NSCLC) cases. The surrogate of truth was a statistical consensus (obtained with the Simultaneous Truth and Performance Level Estimation algorithm) of three manual delineations performed by experts on fused PET/CT images. The proposed framework was applied to PET-only, CT-only and PET/CT datasets, and were compared to standard and improved fuzzy c-means (FCM) multimodal implementations.

RESULTS

A high agreement with the consensus of manual delineations was observed when using both PET and CT images. Contourlet-based HMT led to the best results with a DSC of 0.92 ± 0.11 compared to 0.89 ± 0.13 and 0.90 ± 0.12 for Intensity-based HMT and Wavelet-based HMT, respectively. Considering PET or CT only in the HMT led to much lower accuracy. Standard and improved FCM led to comparatively lower accuracy than HMT, even when considering multimodal implementations.

CONCLUSIONS

We evaluated the accuracy of the proposed HMT-based framework for PET/CT image segmentation. The proposed method reached good accuracy, especially with pre-processing in the contourlet domain.

Simultaneous maximum a posteriori longitudinal PET image reconstruction

Positron emission tomography (PET) is frequently used to monitor functional changes that occur over extended time scales, for example in longitudinal oncology PET protocols that include routine clinical follow-up scans to assess the efficacy of a course of treatment. In these contexts PET datasets are currently reconstructed into images using single-dataset reconstruction methods. Inspired by recently proposed joint PET-MR reconstruction methods, we propose to reconstruct longitudinal datasets simultaneously by using a joint penalty term in order to exploit the high degree of similarity between longitudinal images. We achieved this by penalising voxel-wise differences between pairs of longitudinal PET images in a one-step-late maximum a posteriori (MAP) fashion, resulting in the MAP simultaneous longitudinal reconstruction (SLR) method. The proposed method reduced reconstruction errors and visually improved images relative to standard maximum likelihood expectation-maximisation (ML-EM) in simulated 2D longitudinal brain tumour scans. In reconstructions of split real 3D data with inserted simulated tumours, noise across images reconstructed with MAP-SLR was reduced to levels equivalent to doubling the number of detected counts when using ML-EM. Furthermore, quantification of tumour activities was largely preserved over a variety of longitudinal tumour changes, including changes in size and activity, with larger changes inducing larger biases relative to standard ML-EM reconstructions. Similar improvements were observed for a range of counts levels, demonstrating the robustness of the method when used with a single penalty strength. The results suggest that longitudinal regularisation is a simple but effective method of improving reconstructed PET images without using resolution degrading priors.