PET Reconstruction of the Posterior Image Probability, Including Multimodal Images

Probabilistic deconvolution of PET images using informed priors

Purpose

We present a probabilistic approach to medical image analysis that requires, and makes use of, explicit prior information provided by a medical expert. Depending on the choice of prior model the method can be used for image enhancement, analysis, and segmentation.

Methods

The methodology is based on a probabilistic approach to medical image analysis, that allows integration of 1) arbitrarily complex prior information (for which realizations can be generated), 2) information about a convolution operator of the imaging system, and 3) information about the noise in the reconstructed image into a posterior probability density. The method was demonstrated on positron emission tomography (PET) images obtained from a phantom and a patient with lung cancer. The likelihood model (multivariate log-normal) and the convolution operator were derived from phantom data. Two examples of prior information were used to show the potential of the method. The extended Metropolis-Hastings algorithm, a Markov chain Monte Carlo method, was used to generate realizations of the posterior distribution of the tracer activity concentration.

Results

A set of realizations from the posterior was used as the base of a quantitative PET image analysis. The mean and variance of activity concentrations were computed, as well as the probability of high tracer uptake and statistics on the size and activity concentration of high uptake regions. For both phantom and in vivo images, the estimated images of mean activity concentrations appeared to have reduced noise levels, and a sharper outline of high activity regions, as compared to the original PET. The estimated variance of activity concentrations was high at the edges of high activity regions.

Conclusions

The methodology provides a probabilistic approach for medical image analysis that explicitly takes into account medical expert knowledge as prior information. The presented first results indicate the potential of the method to improve the detection of small lesions. The methodology allows for a probabilistic measure of the size and activity level of high uptake regions, with possible long-term perspectives for early detection of cancer, as well as treatment, planning, and follow-up.

Conditional Variational Autoencoder for Learned Image Reconstruction

Learned image reconstruction techniques using deep neural networks have recently gained popularity and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect information uncertainty. In this work, we develop a novel computational framework that approximates the posterior distribution of the unknown image at each query observation. The proposed framework is very flexible: it handles implicit noise models and priors, it incorporates the data formation process (i.e., the forward operator), and the learned reconstructive properties are transferable between different datasets. Once the network is trained using the conditional variational autoencoder loss, it provides a computationally efficient sampler for the approximate posterior distribution via feed-forward propagation, and the summarizing statistics of the generated samples are used for both point-estimation and uncertainty quantification. We illustrate the proposed framework with extensive numerical experiments on positron emission tomography (with both moderate and low-count levels) showing that the framework generates high-quality samples when compared with state-of-the-art methods.

Reconstruction, analysis and interpretation of posterior probability distributions of PET images, using the posterior bootstrap

The uncertainty of reconstructed PET images remains difficult to assess and to interpret for the use in diagnostic and quantification tasks. Here we provide (1) an easy-to-use methodology for uncertainty assessment for almost any Bayesian model in PET reconstruction from single datasets and (2) a detailed analysis and interpretation of produced posterior image distributions. We apply a recent posterior bootstrap framework to the PET image reconstruction inverse problem and obtain simple parallelizable algorithms based on random weights and on existing maximuma posteriori(MAP) (posterior maximum) optimization-based algorithms. Posterior distributions are produced, analyzed and interpreted for several common Bayesian models. Their relationship with the distribution of the MAP image estimate over multiple dataset realizations is exposed. The coverage properties of posterior distributions are validated. More insight is obtained for the interpretation of posterior distributions in order to open the way for including uncertainty information into diagnostic and quantification tasks.