Direct Parametric Reconstruction Using Anatomical Regularization for Simultaneous PET/MRI Data

PET Mapping of Receptor Occupancy Using Joint Direct Parametric Reconstruction

Receptor occupancy (RO) studies using PET neuroimaging play a critical role in the development of drugs targeting the central nervous system (CNS). The conventional approach to estimate drug receptor occupancy consists in estimation of binding potential changes between two PET scans (baseline and post-drug injection). This estimation is typically performed separately for each scan by first reconstructing dynamic PET scan data before fitting a kinetic model to time activity curves. This approach fails to properly model the noise in PET measurements, resulting in poor RO estimates, especially in low receptor density regions.

OBJECTIVE

In this work, we evaluate a novel joint direct parametric reconstruction framework to directly estimate distributions of RO and other kinetic parameters in the brain from a pair of baseline and post-drug injection dynamic PET scans.

METHODS

The proposed method combines the use of regularization on RO maps with alternating optimization to enable estimation of occupancy even in low binding regions.

RESULTS

Simulation results demonstrate the quantitative improvement of this method over conventional approaches in terms of accuracy and precision of occupancy. The proposed method is also evaluated in preclinical in-vivo experiments using 11C-MK-6884 and a muscarinic acetylcholine receptor 4 positive allosteric modulator drug, showing improved estimation of receptor occupancy as compared to traditional estimators.

CONCLUSION

The proposed joint direct estimation framework improves RO estimation compared to conventional methods, especially in intermediate to low-binding regions.

SIGNIFICANCE

This work could potentially facilitate the evaluation of new drug candidates targeting the CNS.

SPECT reconstruction with a trained regularizer using CT-side information: Application to 177Lu SPECT imaging

Improving low-count SPECT can shorten scans and support pre-therapy theranostic imaging for dosimetry-based treatment planning, especially with radionuclides like 177Lu known for low photon yields. Conventional methods often underperform in low-count settings, highlighting the need for trained regularization in model-based image reconstruction. This paper introduces a trained regularizer for SPECT reconstruction that leverages segmentation based on CT imaging. The regularizer incorporates CT-side information via a segmentation mask from a pre-trained network (nnUNet). In this proof-of-concept study, we used patient studies with 177Lu DOTATATE to train and tested with phantom and patient datasets, simulating pre-therapy imaging conditions. Our results show that the proposed method outperforms both standard unregularized EM algorithms and conventional regularization with CT-side information. Specifically, our method achieved marked improvements in activity quantification, noise reduction, and root mean square error. The enhanced low-count SPECT approach has promising implications for theranostic imaging, post-therapy imaging, whole body SPECT, and reducing SPECT acquisition times.

Evaluation of MR anatomically-guided PET reconstruction using a convolutional neural network in PSMA patients

Background. Recently, approaches have utilized the superior anatomical information provided by magnetic resonance imaging (MRI) to guide the reconstruction of positron emission tomography (PET). One of those approaches is the Bowsher's prior, which has been accelerated lately with a convolutional neural network (CNN) to reconstruct MR-guided PET in the imaging domain in routine clinical imaging. Two differently trained Bowsher-CNN methods (B-CNN0 and B-CNN) have been trained and tested on brain PET/MR images with non-PSMA tracers, but so far, have not been evaluated in other anatomical regions yet.Methods. A NEMA phantom with five of its six spheres filled with the same, calibrated concentration of 18F-DCFPyL-PSMA, and thirty-two patients (mean age 64 ± 7 years) with biopsy-confirmed PCa were used in this study. Reconstruction with either of the two available Bowsher-CNN methods were performed on the conventional MR-based attenuation correction (MRAC) and T1-MR images in the imaging domain. Detectable volume of the spheres and tumors, relative contrast recovery (CR), and background variation (BV) were measured for the MRAC and the Bowsher-CNN images, and qualitative assessment was conducted by ranking the image sharpness and quality by two experienced readers.Results. For the phantom study, the B-CNN produced 12.7% better CR compared to conventional reconstruction. The small sphere volume (<1.8 ml) detectability improved from MRAC to B-CNN by nearly 13%, while measured activity was higher than the ground-truth by 8%. The signal-to-noise ratio, CR, and BV were significantly improved (p< 0.05) in B-CNN images of the tumor. The qualitative analysis determined that tumor sharpness was excellent in 76% of the PET images reconstructed with the B-CNN method, compared to conventional reconstruction.Conclusions. Applying the MR-guided B-CNN in clinical prostate PET/MR imaging improves some quantitative, as well as qualitative imaging measures. The measured improvements in the phantom are also clearly translated into clinical application.

Direct Reconstruction of Linear Parametric Images From Dynamic PET Using Nonlocal Deep Image Prior

Direct reconstruction methods have been developed to estimate parametric images directly from the measured PET sinograms by combining the PET imaging model and tracer kinetics in an integrated framework. Due to limited counts received, signal-to-noise-ratio (SNR) and resolution of parametric images produced by direct reconstruction frameworks are still limited. Recently supervised deep learning methods have been successfully applied to medical imaging denoising/reconstruction when large number of high-quality training labels are available. For static PET imaging, high-quality training labels can be acquired by extending the scanning time. However, this is not feasible for dynamic PET imaging, where the scanning time is already long enough. In this work, we proposed an unsupervised deep learning framework for direct parametric reconstruction from dynamic PET, which was tested on the Patlak model and the relative equilibrium Logan model. The training objective function was based on the PET statistical model. The patient's anatomical prior image, which is readily available from PET/CT or PET/MR scans, was supplied as the network input to provide a manifold constraint, and also utilized to construct a kernel layer to perform non-local feature denoising. The linear kinetic model was embedded in the network structure as a 1 ×1 ×1 convolution layer. Evaluations based on dynamic datasets of ¹⁸F-FDG and ¹¹C-PiB tracers show that the proposed framework can outperform the traditional and the kernel method-based direct reconstruction methods.

Rapid high-quality PET Patlak parametric image generation based on direct reconstruction and temporal nonlocal neural network

Parametric imaging based on dynamic positron emission tomography (PET) has wide applications in neurology. Compared to indirect methods, direct reconstruction methods, which reconstruct parametric images directly from the raw PET data, have superior image quality due to better noise modeling and richer information extracted from the PET raw data. For low-dose scenarios, the advantages of direct methods are more obvious. However, the wide adoption of direct reconstruction is inevitably impeded by the excessive computational demand and deficiency of the accessible raw data. In addition, motion modeling inside dynamic PET image reconstruction raises more computational challenges for direct reconstruction methods. In this work, we focused on the ¹⁸F-FDG Patlak model, and proposed a data-driven approach which can estimate the motion corrected full-dose direct Patlak images from the dynamic PET reconstruction series, based on a proposed novel temporal non-local convolutional neural network. During network training, direct reconstruction with motion correction based on full-dose dynamic PET sinograms was performed to obtain the training labels. The reconstructed full-dose /low-dose dynamic PET images were supplied as the network input. In addition, a temporal non-local block based on the dynamic PET images was proposed to better recover the structural information and reduce the image noise. During testing, the proposed network can directly output high-quality Patlak parametric images from the full-dose /low-dose dynamic PET images in seconds. Experiments based on 15 full-dose and 15 low-dose ¹⁸F-FDG brain datasets were conducted and analyzed to validate the feasibility of the proposed framework. Results show that the proposed framework can generate better image quality than reference methods.

Incorporation of anatomical MRI knowledge for enhanced mapping of brain metabolism using functional PET

Functional positron emission tomography (fPET) imaging using continuous infusion of [18F]-fluorodeoxyglucose (FDG) is a novel neuroimaging technique to track dynamic glucose utilization in the brain. In comparison to conventional static or dynamic bolus PET, fPET maintains a sustained supply of glucose in the blood plasma which improves sensitivity to measure dynamic glucose changes in the brain, and enables mapping of dynamic brain activity in task-based and resting-state fPET studies. However, there is a trade-off between temporal resolution and spatial noise due to the low concentration of FDG and the limited sensitivity of multi-ring PET scanners. Images from fPET studies suffer from partial volume errors and residual scatter noise that may cause the cerebral metabolic functional maps to be biased. Gaussian smoothing filters used to denoise the fPET images are suboptimal, as they introduce additional partial volume errors. In this work, a post-processing framework based on a magnetic resonance (MR) Bowsher-like prior was used to improve the spatial and temporal signal to noise characteristics of the fPET images. The performance of the MR guided method was compared with conventional denosing methods using both simulated and in vivo task fPET datasets. The results demonstrate that the MR-guided fPET framework denoises the fPET images and improves the partial volume correction, consequently enhancing the sensitivity to identify brain activation, and improving the anatomical accuracy for mapping changes of brain metabolism in response to a visual stimulation task. The framework extends the use of functional PET to investigate the dynamics of brain metabolic responses for faster presentation of brain activation tasks, and for applications in low dose PET imaging.

Approximating anatomically-guided PET reconstruction in image space using a convolutional neural network

In the last two decades, it has been shown that anatomically-guided PET reconstruction can lead to improved bias-noise characteristics in brain PET imaging. However, despite promising results in simulations and first studies, anatomically-guided PET reconstructions are not yet available for use in routine clinical because of several reasons. In light of this, we investigate whether the improvements of anatomically-guided PET reconstruction methods can be achieved entirely in the image domain with a convolutional neural network (CNN). An entirely image-based CNN post-reconstruction approach has the advantage that no access to PET raw data is needed and, moreover, that the prediction times of trained CNNs are extremely fast on state of the art GPUs which will substantially facilitate the evaluation, fine-tuning and application of anatomically-guided PET reconstruction in real-world clinical settings. In this work, we demonstrate that anatomically-guided PET reconstruction using the asymmetric Bowsher prior can be well-approximated by a purely shift-invariant convolutional neural network in image space allowing the generation of anatomically-guided PET images in almost real-time. We show that by applying dedicated data augmentation techniques in the training phase, in which 16 [18F]FDG and 10 [18F]PE2I data sets were used, lead to a CNN that is robust against the used PET tracer, the noise level of the input PET images and the input MRI contrast. A detailed analysis of our CNN in 36 [18F]FDG, 18 [18F]PE2I, and 7 [18F]FET test data sets demonstrates that the image quality of our trained CNN is very close to the one of the target reconstructions in terms of regional mean recovery and regional structural similarity.

Direct Parametric Maps Estimation from Dynamic PET Data: An Iterated Conditional Modes Approach

We propose and test a novel approach for direct parametric image reconstruction of dynamic PET data. We present a theoretical description of the problem of PET direct parametric maps estimation as an inference problem, from a probabilistic point of view, and we derive a simple iterative algorithm, based on the Iterated Conditional Mode (ICM) framework, which exploits the simplicity of a two-step optimization and the efficiency of an analytic method for estimating kinetic parameters from a nonlinear compartmental model. The resulting method is general enough to be flexible to an arbitrary choice of the kinetic model, and unlike many other solutions, it is capable to deal with nonlinear compartmental models without the need for linearization. We tested its performance on a two-tissue compartment model, including an analytical solution to the kinetic parameters evaluation, based on an auxiliary parameter set, with the aim of reducing computation errors and approximations. The new method is tested on simulated and clinical data. Simulation analysis led to the conclusion that the proposed algorithm gives a good estimation of the kinetic parameters in any noise condition. Furthermore, the application of the proposed method to clinical data gave promising results for further studies.

Hybrid PET-MRI in Alzheimer's Disease Research

Multiple factors, namely amyloid, tau, inflammation, metabolic, and perfusion changes, contribute to the cascade of neurodegeneration and functional decline occurring in Alzheimer's disease (AD). These molecular and cellular processes and related functional and morphological changes can be visualized in vivo by two imaging modalities, namely positron emission tomography (PET) and magnetic resonance imaging (MRI). These imaging biomarkers are now part of the diagnostic algorithm and of particular interest for patient stratification and targeted drug development.In this field the availability of hybrid PET/MR systems not only offers a comprehensive evaluation in a single imaging session, but also opens new possibilities for the integration of the two imaging information. Here, we cover the clinical protocols and practical details of FDG, amyloid, and tau PET/MR imaging as applied in our institutions.

Quantification of O-(2-[18F]fluoroethyl)-L-tyrosine kinetics in glioma

BACKGROUND

This study identified the optimal tracer kinetic model for quantification of dynamic O-(2-[18F]fluoroethyl)-L-tyrosine ([18F]FET) positron emission tomography (PET) studies in seven patients with diffuse glioma (four glioblastoma, three lower grade glioma). The performance of more simplified approaches was evaluated by comparison with the optimal compartment model. Additionally, the relationship with cerebral blood flow-determined by [15O]H2O PET-was investigated.

RESULTS

The optimal tracer kinetic model was the reversible two-tissue compartment model. Agreement analysis of binding potential estimates derived from reference tissue input models with the distribution volume ratio (DVR)-1 derived from the plasma input model showed no significant average difference and limits of agreement of - 0.39 and 0.37. Given the range of DVR-1 (- 0.25 to 1.5), these limits are wide. For the simplified methods, the 60-90 min tumour-to-blood ratio to parent plasma concentration yielded the highest correlation with volume of distribution VT as calculated by the plasma input model (r = 0.97). The 60-90 min standardized uptake value (SUV) showed better correlation with VT (r = 0.77) than SUV based on earlier intervals. The 60-90 min SUV ratio to contralateral healthy brain tissue showed moderate agreement with DVR with no significant average difference and limits of agreement of - 0.24 and 0.30. A significant but low correlation was found between VT and CBF in the tumour regions (r = 0.61, p = 0.007).

CONCLUSION

Uptake of [18F]FET was best modelled by a reversible two-tissue compartment model. Reference tissue input models yielded estimates of binding potential which did not correspond well with plasma input-derived DVR-1. In comparison, SUV ratio to contralateral healthy brain tissue showed slightly better performance, if measured at the 60-90 min interval. SUV showed only moderate correlation with VT. VT shows correlation with CBF in tumour.

MR-Guided Kernel EM Reconstruction for Reduced Dose PET Imaging

PET image reconstruction is highly susceptible to the impact of Poisson noise, and if shorter acquisition times or reduced injected doses are used, the noisy PET data become even more limiting. The recent development of kernel expectation maximisation (KEM) is a simple way to reduce noise in PET images, and we show in this work that impressive dose reduction can be achieved when the kernel method is used with MR-derived kernels. The kernel method is shown to surpass maximum likelihood expectation maximisation (MLEM) for the reconstruction of low-count datasets (corresponding to those obtained at reduced injected doses) producing visibly clearer reconstructions for unsmoothed and smoothed images, at all count levels. The kernel EM reconstruction of 10% of the data had comparable whole brain voxel-level error measures to the MLEM reconstruction of 100% of the data (for simulated data, at 100 iterations). For regional metrics, the kernel method at reduced dose levels attained a reduced coefficient of variation and more accurate mean values compared to MLEM. However, the advances provided by the kernel method are at the expense of possible over-smoothing of features unique to the PET data. Further assessment on clinical data is required to determine the level of dose reduction that can be routinely achieved using the kernel method, whilst maintaining the diagnostic utility of the scan.

Direct Patlak Reconstruction From Dynamic PET Data Using the Kernel Method With MRI Information Based on Structural Similarity

Positron emission tomography (PET) is a functional imaging modality widely used in oncology, cardiology, and neuroscience. It is highly sensitive, but suffers from relatively poor spatial resolution, as compared with anatomical imaging modalities, such as magnetic resonance imaging (MRI). With the recent development of combined PET/MR systems, we can improve the PET image quality by incorporating MR information into image reconstruction. Previously, kernel learning has been successfully embedded into static and dynamic PET image reconstruction using either PET temporal or MRI information. Here, we combine both PET temporal and MRI information adaptively to improve the quality of direct Patlak reconstruction. We examined different approaches to combine the PET and MRI information in kernel learning to address the issue of potential mismatches between MRI and PET signals. Computer simulations and hybrid real-patient data acquired on a simultaneous PET/MR scanner were used to evaluate the proposed methods. Results show that the method that combines PET temporal information and MRI spatial information adaptively based on the structure similarity index has the best performance in terms of noise reduction and resolution improvement.

Advances in PET/MR instrumentation and image reconstruction

The combination of positron emission tomography (PET) and MRI has attracted the attention of researchers in the past approximately 20 years in small-animal imaging and more recently in clinical research. The combination of PET/MRI allows researchers to explore clinical and research questions in a wide number of fields, some of which are briefly mentioned here. An important number of groups have developed different concepts to tackle the problems that PET instrumentation poses to the exposition of electromagnetic fields. We have described most of these research developments in preclinical and clinical experiments, including the few commercial scanners available. From the software perspective, an important number of algorithms have been developed to address the attenuation correction issue and to exploit the possibility that MRI provides for motion correction and quantitative image reconstruction, especially parametric modelling of radiopharmaceutical kinetics. In this work, we give an overview of some exemplar applications of simultaneous PET/MRI, together with technological hardware and software developments.

PET image reconstruction using multi-parametric anato-functional priors

In this study, we investigate the application of multi-parametric anato-functional (MR-PET) priors for the maximum a posteriori (MAP) reconstruction of brain PET data in order to address the limitations of the conventional anatomical priors in the presence of PET-MR mismatches. In addition to partial volume correction benefits, the suitability of these priors for reconstruction of low-count PET data is also introduced and demonstrated, comparing to standard maximum-likelihood (ML) reconstruction of high-count data. The conventional local Tikhonov and total variation (TV) priors and current state-of-the-art anatomical priors including the Kaipio, non-local Tikhonov prior with Bowsher and Gaussian similarity kernels are investigated and presented in a unified framework. The Gaussian kernels are calculated using both voxel- and patch-based feature vectors. To cope with PET and MR mismatches, the Bowsher and Gaussian priors are extended to multi-parametric priors. In addition, we propose a modified joint Burg entropy prior that by definition exploits all parametric information in the MAP reconstruction of PET data. The performance of the priors was extensively evaluated using 3D simulations and two clinical brain datasets of [18F]florbetaben and [18F]FDG radiotracers. For simulations, several anato-functional mismatches were intentionally introduced between the PET and MR images, and furthermore, for the FDG clinical dataset, two PET-unique active tumours were embedded in the PET data. Our simulation results showed that the joint Burg entropy prior far outperformed the conventional anatomical priors in terms of preserving PET unique lesions, while still reconstructing functional boundaries with corresponding MR boundaries. In addition, the multi-parametric extension of the Gaussian and Bowsher priors led to enhanced preservation of edge and PET unique features and also an improved bias-variance performance. In agreement with the simulation results, the clinical results also showed that the Gaussian prior with voxel-based feature vectors, the Bowsher and the joint Burg entropy priors were the best performing priors. However, for the FDG dataset with simulated tumours, the TV and proposed priors were capable of preserving the PET-unique tumours. Finally, an important outcome was the demonstration that the MAP reconstruction of a low-count FDG PET dataset using the proposed joint entropy prior can lead to comparable image quality to a conventional ML reconstruction with up to 5 times more counts. In conclusion, multi-parametric anato-functional priors provide a solution to address the pitfalls of the conventional priors and are therefore likely to increase the diagnostic confidence in MR-guided PET image reconstructions.

A Variational Bayesian inference method for parametric imaging of PET data

In dynamic Positron Emission Tomography (PET) studies, compartmental models provide the richest information on the tracer kinetics of the tissue. Inverting such models at the voxel level is however quite challenging due to the low signal-to-noise ratio of the time activity curves. In this study, we propose the use of a Variational Bayesian (VB) approach to efficiently solve this issue and thus obtain robust quantitative parametric maps. VB was adapted to the non-uniform noise distribution of PET data. Moreover, we propose a novel hierarchical scheme to define the model parameter priors directly from the images in case such information are not available from the literature, as often happens with new PET tracers. VB was initially tested on synthetic data generated using compartmental models of increasing complexity, providing accurate (%bias<2%±2%, root mean square error<15%±5%) parameter estimates. When applied to real data on a paradigmatic set of PET tracers (L-[1-11C]leucine, [11C]WAY100635 and [18F]FDG), VB was able to generate reliable parametric maps even in presence of high noise in the data (unreliable estimates<11%±5%).

Direct Parametric Reconstruction With Joint Motion Estimation/Correction for Dynamic Brain PET Data

Direct reconstruction of parametric images from raw photon counts has been shown to improve the quantitative analysis of dynamic positron emission tomography (PET) data. However it suffers from subject motion which is inevitable during the typical acquisition time of 1-2 hours. In this work we propose a framework to jointly estimate subject head motion and reconstruct the motion-corrected parametric images directly from raw PET data, so that the effects of distorted tissue-to-voxel mapping due to subject motion can be reduced in reconstructing the parametric images with motion-compensated attenuation correction and spatially aligned temporal PET data. The proposed approach is formulated within the maximum likelihood framework, and efficient solutions are derived for estimating subject motion and kinetic parameters from raw PET photon count data. Results from evaluations on simulated [¹¹C]raclopride data using the Zubal brain phantom and real clinical [¹⁸F]florbetapir data of a patient with Alzheimer's disease show that the proposed joint direct parametric reconstruction motion correction approach can improve the accuracy of quantifying dynamic PET data with large subject motion.

Anatomically-aided PET reconstruction using the kernel method

This paper extends the kernel method that was proposed previously for dynamic PET reconstruction, to incorporate anatomical side information into the PET reconstruction model. In contrast to existing methods that incorporate anatomical information using a penalized likelihood framework, the proposed method incorporates this information in the simpler maximum likelihood (ML) formulation and is amenable to ordered subsets. The new method also does not require any segmentation of the anatomical image to obtain edge information. We compare the kernel method with the Bowsher method for anatomically-aided PET image reconstruction through a simulated data set. Computer simulations demonstrate that the kernel method offers advantages over the Bowsher method in region of interest quantification. Additionally the kernel method is applied to a 3D patient data set. The kernel method results in reduced noise at a matched contrast level compared with the conventional ML expectation maximization algorithm.

Innovations in Small-Animal PET/MR Imaging Instrumentation

Multimodal imaging has led to a more detailed exploration of different physiologic processes with integrated PET/MR imaging being the most recent entry. Although the clinical need is still questioned, it is well recognized that it represents one of the most active and promising fields of medical imaging research in terms of software and hardware. The hardware developments have moved from small detector components to high-performance PET inserts and new concepts in full systems. Conversely, the software focuses on the efficient performance of necessary corrections without the use of CT data. The most recent developments in both directions are reviewed.