Joint MR-PET Reconstruction Using a Multi-Channel Image Regularizer

Volumetric Patch-Based Super-Resolution Reconstruction of Hyperpolarized 13C Cardiac MRI

The achievable spatial resolution of 13C metabolic images acquired with hyperpolarized 13C-pyruvate is worse than 1H images typically by an order of magnitude due to the rapidly decaying hyperpolarized signals and the low gyromagnetic ratio of 13C. This study is to develop and characterize a volumetric patch-based super-resolution reconstruction algorithm that enhances spatial resolution 13C cardiac MRI by utilizing structural information from 1H MRI. The reconstruction procedure comprises anatomical segmentation from high-resolution 1H MRI, calculation of a patch-based weight matrix, and iterative reconstruction of high-resolution multi-slice 13C MRI. The method was tested with a multi-compartmental digital phantom for optimizing the patch size and an anthropomorphic cardiac MR phantom for validating the performance. Finally, the method was applied to human cardiac 13C images, acquired with an injection of hyperpolarized [1-13C]pyruvate. The phantom studies demonstrated that high-resolution multi-slice 13C images, reconstructed from a single-slice low-resolution input 13C image, retained the signal intensity range. The reconstruction accuracy was asymptotically improved as the patch size increased whereas intra-segmental spatial fluctuations were preserved better with smaller patches. However, a structurally non-identified tissue region was not restored regardless of the patch size. The cardiac MR phantom and the human cardiac images demonstrated improved spatial resolutions in the reconstructed images (10 × 10 × 30 mm3/voxel to 2 × 2 × 5 mm3/voxel). The volumetric patch-based super-resolution method reconstructs multi-slice high-resolution of 13C images, enhancing the cardiac structure, while preserving the quantitative accuracy. The proposed method is applicable to other multi-modal images that suffer from limited spatial resolution.

PET image reconstruction using weighted nuclear norm maximization and deep learning prior

The ill-posed Positron emission tomography (PET) reconstruction problem usually results in limited resolution and significant noise. Recently, deep neural networks have been incorporated into PET iterative reconstruction framework to improve the image quality. In this paper, we propose a new neural network-based iterative reconstruction method by using weighted nuclear norm (WNN) maximization, which aims to recover the image details in the reconstruction process. The novelty of our method is the application of WNN maximization rather than WNN minimization in PET image reconstruction. Meanwhile, a neural network is used to control the noise originated from WNN maximization. Our method is evaluated on simulated and clinical datasets. The simulation results show that the proposed approach outperforms state-of-the-art neural network-based iterative methods by achieving the best contrast/noise tradeoff with a remarkable contrast improvement on the lesion contrast recovery. The study on clinical datasets also demonstrates that our method can recover lesions of different sizes while suppressing noise in various low-dose PET image reconstruction tasks. Our code is available athttps://github.com/Kuangxd/PETReconstruction.

Improved quantification in CEST-MRI by joint spatial total generalized variation

PURPOSE

In this work, the use of joint Total Generalized Variation (TGV) regularization to improve Multipool-Lorentzian fitting of chemical exchange saturation transfer (CEST) Spectra in terms of stability and parameter signal-to-noise ratio (SNR) was investigated.

THEORY AND METHODS

The joint TGV term was integrated into the nonlinear parameter fitting problem. To increase convergence and weight the gradients, preconditioning using a voxel-wise singular value decomposition was applied to the problem, which was then solved using the iteratively regularized Gauss-Newton method combined with a Primal-Dual splitting algorithm. The TGV method was evaluated on simulated numerical phantoms, 3T phantom data and 7T in vivo data with respect to systematic errors and robustness. Three reference methods were also implemented: The standard nonlinear fitting, a method using a nonlocal-means filter for denoising and the pyramid scheme, which uses downsampled images to acquire accurate start values.

RESULTS

The proposed regularized fitting method showed significantly improved robustness (compared to the reference methods). In testing, over a range of SNR values the TGV fit outperformed the other methods and showed accurate results even for large amounts of added noise. Parameter values found were closer or comparable to the ground truth. For in vivo datasets, the added regularization increased the parameter map SNR and prevented instabilities.

CONCLUSION

The proposed fitting method using TGV regularization leads to improved results over a range of different data-sets and noise levels. Furthermore, it can be applied to all Z-spectrum data, with different amounts of pools, where the improved SNR and stability can increase diagnostic confidence.

Joint diffusion: mutual consistency-driven diffusion model for PET-MRI co-reconstruction

Objective. Positron Emission Tomography and Magnetic Resonance Imaging (PET-MRI) systems can obtain functional and anatomical scans. But PET suffers from a low signal-to-noise ratio, while MRI are time-consuming. To address time-consuming, an effective strategy involves reducing k-space data collection, albeit at the cost of lowering image quality. This study aims to leverage the inherent complementarity within PET-MRI data to enhance the image quality of PET-MRI.Approach. A novel PET-MRI joint reconstruction model, termed MC-Diffusion, is proposed in the Bayesian framework. The joint reconstruction problem is transformed into a joint regularization problem, where data fidelity terms of PET and MRI are expressed independently. The regular term, the derivative of the logarithm of the joint probability distribution of PET and MRI, employs a joint score-based diffusion model for learning. The diffusion model involves the forward diffusion process and the reverse diffusion process. The forward diffusion process adds noise to transform a complex joint data distribution into a known joint prior distribution for PET and MRI simultaneously, resembling a denoiser. The reverse diffusion process removes noise using a denoiser to revert the joint prior distribution to the original joint data distribution, effectively utilizing joint probability distribution to describe the correlations of PET and MRI for improved quality of joint reconstruction.Main results. Qualitative and quantitative improvements are observed with the MC-Diffusion model. Comparative analysis against LPLS and Joint ISAT-net on the ADNI dataset demonstrates superior performance by exploiting complementary information between PET and MRI. The MC-Diffusion model effectively enhances the quality of PET and MRI images.Significance. This study employs the MC-Diffusion model to enhance the quality of PET-MRI images by integrating the fundamental principles of PET and MRI modalities and leveraging their inherent complementarity. Furthermore, utilizing the diffusion model to learn the joint probability distribution of PET and MRI, thereby elucidating their latent correlation, facilitates a more profound comprehension of the priors obtained through deep learning, contrasting with black-box prior or artificially constructed structural similarities.

Super-resolution techniques for biomedical applications and challenges

Super-resolution (SR) techniques have revolutionized the field of biomedical applications by detailing the structures at resolutions beyond the limits of imaging or measuring tools. These techniques have been applied in various biomedical applications, including microscopy, magnetic resonance imaging (MRI), computed tomography (CT), X-ray, electroencephalogram (EEG), ultrasound, etc. SR methods are categorized into two main types: traditional non-learning-based methods and modern learning-based approaches. In both applications, SR methodologies have been effectively utilized on biomedical images, enhancing the visualization of complex biological structures. Additionally, these methods have been employed on biomedical data, leading to improvements in computational precision and efficiency for biomedical simulations. The use of SR techniques has resulted in more detailed and accurate analyses in diagnostics and research, essential for early disease detection and treatment planning. However, challenges such as computational demands, data interpretation complexities, and the lack of unified high-quality data persist. The article emphasizes these issues, underscoring the need for ongoing development in SR technologies to further improve biomedical research and patient care outcomes.

Resolution enhancement, noise suppression, and joint T2* decay estimation in dual-echo sodium-23 MR imaging using anatomically guided reconstruction

PURPOSE

Sodium MRI is challenging because of the low tissue concentration of the 23 Na nucleus and its extremely fast biexponential transverse relaxation rate. In this article, we present an iterative reconstruction framework using dual-echo 23 Na data and exploiting anatomical prior information (AGR) from high-resolution, low-noise, 1 H MR images. This framework enables the estimation and modeling of the spatially varying signal decay due to transverse relaxation during readout (AGRdm), which leads to images of better resolution and reduced noise resulting in improved quantification of the reconstructed 23 Na images.

METHODS

The proposed framework was evaluated using reconstructions of 30 noise realizations of realistic simulations of dual echo twisted projection imaging (TPI) 23 Na data. Moreover, three dual echo 23 Na TPI brain datasets of healthy controls acquired on a 3T Siemens Prisma system were reconstructed using conventional reconstruction, AGR and AGRdm.

RESULTS

Our simulations show that compared to conventional reconstructions, AGR and AGRdm show improved bias-noise characteristics in several regions of the brain. Moreover, AGR and AGRdm images show more anatomical detail and less noise in the reconstructions of the experimental data sets. Compared to AGR and the conventional reconstruction, AGRdm shows higher contrast in the sodium concentration ratio between gray and white matter and between gray matter and the brain stem.

CONCLUSION

AGR and AGRdm generate 23 Na images with high resolution, high levels of anatomical detail, and low levels of noise, potentially enabling high-quality 23 Na MR imaging at 3T.

Multiparametric Oncologic Hybrid Imaging: Machine Learning Challenges and Opportunities

BACKGROUND

Machine learning (ML) is considered an important technology for future data analysis in health care.

METHODS

The inherently technology-driven fields of diagnostic radiology and nuclear medicine will both benefit from ML in terms of image acquisition and reconstruction. Within the next few years, this will lead to accelerated image acquisition, improved image quality, a reduction of motion artifacts and - for PET imaging - reduced radiation exposure and new approaches for attenuation correction. Furthermore, ML has the potential to support decision making by a combined analysis of data derived from different modalities, especially in oncology. In this context, we see great potential for ML in multiparametric hybrid imaging and the development of imaging biomarkers.

RESULTS AND CONCLUSION

In this review, we will describe the basics of ML, present approaches in hybrid imaging of MRI, CT, and PET, and discuss the specific challenges associated with it and the steps ahead to make ML a diagnostic and clinical tool in the future.

KEY POINTS

· ML provides a viable clinical solution for the reconstruction, processing, and analysis of hybrid imaging obtained from MRI, CT, and PET..

SPECT reconstruction with a trained regularizer using CT-side information: Application to 177Lu SPECT imaging

Improving low-count SPECT can shorten scans and support pre-therapy theranostic imaging for dosimetry-based treatment planning, especially with radionuclides like 177Lu known for low photon yields. Conventional methods often underperform in low-count settings, highlighting the need for trained regularization in model-based image reconstruction. This paper introduces a trained regularizer for SPECT reconstruction that leverages segmentation based on CT imaging. The regularizer incorporates CT-side information via a segmentation mask from a pre-trained network (nnUNet). In this proof-of-concept study, we used patient studies with 177Lu DOTATATE to train and tested with phantom and patient datasets, simulating pre-therapy imaging conditions. Our results show that the proposed method outperforms both standard unregularized EM algorithms and conventional regularization with CT-side information. Specifically, our method achieved marked improvements in activity quantification, noise reduction, and root mean square error. The enhanced low-count SPECT approach has promising implications for theranostic imaging, post-therapy imaging, whole body SPECT, and reducing SPECT acquisition times.

Evaluation of MR anatomically-guided PET reconstruction using a convolutional neural network in PSMA patients

Background. Recently, approaches have utilized the superior anatomical information provided by magnetic resonance imaging (MRI) to guide the reconstruction of positron emission tomography (PET). One of those approaches is the Bowsher's prior, which has been accelerated lately with a convolutional neural network (CNN) to reconstruct MR-guided PET in the imaging domain in routine clinical imaging. Two differently trained Bowsher-CNN methods (B-CNN0 and B-CNN) have been trained and tested on brain PET/MR images with non-PSMA tracers, but so far, have not been evaluated in other anatomical regions yet.Methods. A NEMA phantom with five of its six spheres filled with the same, calibrated concentration of 18F-DCFPyL-PSMA, and thirty-two patients (mean age 64 ± 7 years) with biopsy-confirmed PCa were used in this study. Reconstruction with either of the two available Bowsher-CNN methods were performed on the conventional MR-based attenuation correction (MRAC) and T1-MR images in the imaging domain. Detectable volume of the spheres and tumors, relative contrast recovery (CR), and background variation (BV) were measured for the MRAC and the Bowsher-CNN images, and qualitative assessment was conducted by ranking the image sharpness and quality by two experienced readers.Results. For the phantom study, the B-CNN produced 12.7% better CR compared to conventional reconstruction. The small sphere volume (<1.8 ml) detectability improved from MRAC to B-CNN by nearly 13%, while measured activity was higher than the ground-truth by 8%. The signal-to-noise ratio, CR, and BV were significantly improved (p< 0.05) in B-CNN images of the tumor. The qualitative analysis determined that tumor sharpness was excellent in 76% of the PET images reconstructed with the B-CNN method, compared to conventional reconstruction.Conclusions. Applying the MR-guided B-CNN in clinical prostate PET/MR imaging improves some quantitative, as well as qualitative imaging measures. The measured improvements in the phantom are also clearly translated into clinical application.

VSGD-Net: Virtual Staining Guided Melanocyte Detection on Histopathological Images

Detection of melanocytes serves as a critical prerequisite in assessing melanocytic growth patterns when diagnosing melanoma and its precursor lesions on skin biopsy specimens. However, this detection is challenging due to the visual similarity of melanocytes to other cells in routine Hematoxylin and Eosin (H&E) stained images, leading to the failure of current nuclei detection methods. Stains such as Sox10 can mark melanocytes, but they require an additional step and expense and thus are not regularly used in clinical practice. To address these limitations, we introduce VSGD-Net, a novel detection network that learns melanocyte identification through virtual staining from H&E to Sox10. The method takes only routine H&E images during inference, resulting in a promising approach to support pathologists in the diagnosis of melanoma. To the best of our knowledge, this is the first study that investigates the detection problem using image synthesis features between two distinct pathology stainings. Extensive experimental results show that our proposed model outperforms state-of-the-art nuclei detection methods for melanocyte detection. The source code and pre-trained model are available at: https://github.com/kechunl/VSGD-Net.

Fast and memory-efficient reconstruction of sparse Poisson data in listmode with non-smooth priors with application to time-of-flight PET

Objective. Complete time of flight (TOF) sinograms of state-of-the-art TOF PET scanners have a large memory footprint. Currently, they contain ∼4 · 109 data bins which amount to ∼17 GB in 32 bit floating point precision. Moreover, their size will continue to increase with advances in the achievable detector TOF resolution and increases in the axial field of view. Using iterative algorithms to reconstruct such enormous TOF sinograms becomes increasingly challenging due to the memory requirements and the computation time needed to evaluate the forward model for every data bin. This is especially true for more advanced optimization algorithms such as the stochastic primal-dual hybrid gradient (SPDHG) algorithm which allows for the use of non-smooth priors for regularization using subsets with guaranteed convergence. SPDHG requires the storage of additional sinograms in memory, which severely limits its application to data sets from state-of-the-art TOF PET systems using conventional computing hardware. Approach. Motivated by the generally sparse nature of the TOF sinograms, we propose and analyze a new listmode (LM) extension of the SPDHG algorithm for image reconstruction of sparse data following a Poisson distribution. The new algorithm is evaluated based on realistic 2D and 3D simulationsn, and a real data set acquired on a state-of-the-art TOF PET/CT system. The performance of the newly proposed LM SPDHG algorithm is compared against the conventional sinogram SPDHG and the listmode EM-TV algorithm. Main results. We show that the speed of convergence of the proposed LM-SPDHG is equivalent the original SPDHG operating on binned data (TOF sinograms). However, we find that for a TOF PET system with 400 ps TOF resolution and 25 cm axial FOV, the proposed LM-SPDHG reduces the required memory from approximately 56 to 0.7 GB for a short dynamic frame with 107 prompt coincidences and to 12.4 GB for a long static acquisition with 5·108 prompt coincidences. Significance. In contrast to SPDHG, the reduced memory requirements of LM-SPDHG enables a pure GPU implementation on state-of-the-art GPUs—avoiding memory transfers between host and GPU—which will substantially accelerate reconstruction times. This in turn will allow the application of LM-SPDHG in routine clinical practice where short reconstruction times are crucial.

Varying undersampling directions for accelerating multiple acquisition magnetic resonance imaging

In this study, we propose a new sampling strategy for efficiently accelerating multiple acquisition MRI. The new sampling strategy is to obtain data along different phase-encoding directions across multiple acquisitions. The proposed sampling strategy was evaluated in multicontrast MR imaging (T1, T2, proton density) and multiple phase-cycled (PC) balanced steady-state free precession (bSSFP) imaging by using convolutional neural networks with central and random sampling patterns. In vivo MRI acquisitions as well as a public database were used to test the concept. Based on both visual inspection and quantitative analysis, the proposed sampling strategy showed better performance than sampling along the same phase-encoding direction in both multicontrast MR imaging and multiple PC-bSSFP imaging, regardless of sampling pattern (central, random) or datasets (public, retrospective and prospective in vivo). For the prospective in vivo applications, acceleration was performed by sampling along different phase-encoding directions at the time of acquisition with a conventional rectangular field of view, which demonstrated the advantage of the proposed sampling strategy in the real environment. Preliminary trials on compressed sensing (CS) also demonstrated improvement of CS with the proposed idea. Sampling along different phase-encoding directions across multiple acquisitions is advantageous for accelerating multiacquisition MRI, irrespective of sampling pattern or datasets, with further improvement through transfer learning.

Multiparametric Oncologic Hybrid Imaging: Machine Learning Challenges and Opportunities

BACKGROUND

 Machine learning (ML) is considered an important technology for future data analysis in health care.

METHODS

 The inherently technology-driven fields of diagnostic radiology and nuclear medicine will both benefit from ML in terms of image acquisition and reconstruction. Within the next few years, this will lead to accelerated image acquisition, improved image quality, a reduction of motion artifacts and - for PET imaging - reduced radiation exposure and new approaches for attenuation correction. Furthermore, ML has the potential to support decision making by a combined analysis of data derived from different modalities, especially in oncology. In this context, we see great potential for ML in multiparametric hybrid imaging and the development of imaging biomarkers.

RESULTS AND CONCLUSION

 In this review, we will describe the basics of ML, present approaches in hybrid imaging of MRI, CT, and PET, and discuss the specific challenges associated with it and the steps ahead to make ML a diagnostic and clinical tool in the future.

KEY POINTS

  · ML provides a viable clinical solution for the reconstruction, processing, and analysis of hybrid imaging obtained from MRI, CT, and PET..

CITATION FORMAT

· Küstner T, Hepp T, Seith F. Multiparametric Oncologic Hybrid Imaging: Machine Learning Challenges and Opportunities. Fortschr Röntgenstr 2022; DOI: 10.1055/a-1718-4128.

Isotropic multichannel total variation framework for joint reconstruction of multicontrast parallel MRI

Purpose: To develop a synergistic image reconstruction framework that exploits multicontrast (MC), multicoil, and compressed sensing (CS) redundancies in magnetic resonance imaging (MRI). Approach: CS, MC acquisition, and parallel imaging (PI) have been individually well developed, but the combination of the three has not been equally well studied, much less the potential benefits of isotropy within such a setting. Inspired by total variation theory, we introduce an isotropic MC image regularizer and attain its full potential by integrating it into compressed MC multicoil MRI. A convex optimization problem is posed to model the new variational framework and a first-order algorithm is developed to solve the problem. Results: It turns out that the proposed isotropic regularizer outperforms many of the state-of-the-art reconstruction methods not only in terms of rotation-invariance preservation of symmetrical features, but also in suppressing noise or streaking artifacts, which are normally encountered in PI methods at aggressive undersampling rates. Moreover, the new framework significantly prevents intercontrast leakage of contrast-specific details, which seems to be a difficult situation to handle for some variational and low-rank MC reconstruction approaches. Conclusions: The new framework is a viable option for image reconstruction in fast protocols of MC parallel MRI, potentially reducing patient discomfort in otherwise long and time-consuming scans.

Kernel graph filtering-A new method for dynamic sinogram denoising

Low count PET (positron emission tomography) imaging is often desirable in clinical diagnosis and biomedical research, but its images are generally very noisy, due to the very weak signals in the sinograms used in image reconstruction. To address this issue, this paper presents a novel kernel graph filtering method for dynamic PET sinogram denoising. This method is derived from treating the dynamic sinograms as the signals on a graph, and learning the graph adaptively from the kernel principal components of the sinograms to construct a lowpass kernel graph spectrum filter. The kernel graph filter thus obtained is then used to filter the original sinogram time frames to obtain the denoised sinograms for PET image reconstruction. Extensive tests and comparisons on the simulated and real life in-vivo dynamic PET datasets show that the proposed method outperforms the existing methods in sinogram denoising and image enhancement of dynamic PET at all count levels, especially at low count, with a great potential in real life applications of dynamic PET imaging.

Core Imaging Library - Part II: multichannel reconstruction for dynamic and spectral tomography

The newly developed core imaging library (CIL) is a flexible plug and play library for tomographic imaging with a specific focus on iterative reconstruction. CIL provides building blocks for tailored regularized reconstruction algorithms and explicitly supports multichannel tomographic data. In the first part of this two-part publication, we introduced the fundamentals of CIL. This paper focuses on applications of CIL for multichannel data, e.g. dynamic and spectral. We formalize different optimization problems for colour processing, dynamic and hyperspectral tomography and demonstrate CIL's capabilities for designing state-of-the-art reconstruction methods through case studies and code snapshots. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 2'.

Motion estimation and correction for simultaneous PET/MR using SIRF and CIL

SIRF is a powerful PET/MR image reconstruction research tool for processing data and developing new algorithms. In this research, new developments to SIRF are presented, with focus on motion estimation and correction. SIRF's recent inclusion of the adjoint of the resampling operator allows gradient propagation through resampling, enabling the MCIR technique. Another enhancement enabled registering and resampling of complex images, suitable for MRI. Furthermore, SIRF's integration with the optimization library CIL enables the use of novel algorithms. Finally, SPM is now supported, in addition to NiftyReg, for registration. Results of MR and PET MCIR reconstructions are presented, using FISTA and PDHG, respectively. These demonstrate the advantages of incorporating motion correction and variational and structural priors. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 2'.

(An overview of) Synergistic reconstruction for multimodality/multichannel imaging methods

Imaging is omnipresent in modern society with imaging devices based on a zoo of physical principles, probing a specimen across different wavelengths, energies and time. Recent years have seen a change in the imaging landscape with more and more imaging devices combining that which previously was used separately. Motivated by these hardware developments, an ever increasing set of mathematical ideas is appearing regarding how data from different imaging modalities or channels can be synergistically combined in the image reconstruction process, exploiting structural and/or functional correlations between the multiple images. Here we review these developments, give pointers to important challenges and provide an outlook as to how the field may develop in the forthcoming years. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 1'.

Joint multi-field T1 quantification for fast field-cycling MRI

Purpose

Recent developments in hardware design enable the use of fast field‐cycling (FFC) techniques in MRI to exploit the different relaxation rates at very low field strength, achieving novel contrast. The method opens new avenues for in vivo characterizations of pathologies but at the expense of longer acquisition times. To mitigate this, we propose a model‐based reconstruction method that fully exploits the high information redundancy offered by FFC methods.

Methods

The proposed model‐based approach uses joint spatial information from all fields by means of a Frobenius ‐ total generalized variation regularization. The algorithm was tested on brain stroke images, both simulated and acquired from FFC patients scans using an FFC spin echo sequences. The results are compared to three non‐linear least squares fits with progressively increasing complexity.

Results

The proposed method shows excellent abilities to remove noise while maintaining sharp image features with large signal‐to‐noise ratio gains at low‐field images, clearly outperforming the reference approach. Especially patient data show huge improvements in visual appearance over all fields.

Conclusion

The proposed reconstruction technique largely improves FFC image quality, further pushing this new technology toward clinical standards.

MR-compatible optical microscope for in-situ dual-mode MR-optical microscopy

We present the development of a dual-mode imaging platform that combines optical microscopy with magnetic resonance microscopy. Our microscope is designed to operate inside a 9.4T small animal scanner with the option to use a 72mm bore animal RF coil or different integrated linear micro coils. With a design that minimizes the magnetic distortions near the sample, we achieved a field inhomogeneity of 19 ppb RMS. We further integrated a waveguide in the optical layout for the electromagnetic shielding of the camera, which minimizes the noise increase in the MR and optical images below practical relevance. The optical layout uses an adaptive lens for focusing, 2 × 2 modular combinations of objectives with 0.6mm to 2.3mm field of view and 4 configurable RGBW illumination channels and achieves a plano-apochromatic optical aberration correction with 0.6μm to 2.3μm resolution. We present the design, implementation and characterization of the prototype including the general optical and MR-compatible design strategies, a knife-edge optical characterization and different concurrent imaging demonstrations.

Anatomy-guided PET reconstruction usingl1bowsher prior

Advances in simultaneous positron emission tomography/magnetic resonance imaging (PET/MRI) technology have led to an active investigation of the anatomy-guided regularized PET image reconstruction algorithm based on MR images. Among the various priors proposed for anatomy-guided regularized PET image reconstruction, Bowsher's method based on second-order smoothing priors sometimes suffers from over-smoothing of detailed structures. Therefore, in this study, we propose a Bowsher prior based on thel1-norm and an iteratively reweighting scheme to overcome the limitation of the original Bowsher method. In addition, we have derived a closed solution for iterative image reconstruction based on this non-smooth prior. A comparison study between the originall2and proposedl1Bowsher priors was conducted using computer simulation and real human data. In the simulation and real data application, small lesions with abnormal PET uptake were better detected by the proposedl1Bowsher prior methods than the original Bowsher prior. The originall2Bowsher leads to a decreased PET intensity in small lesions when there is no clear separation between the lesions and surrounding tissue in the anatomical prior. However, the proposedl1Bowsher prior methods showed better contrast between the tumors and surrounding tissues owing to the intrinsic edge-preserving property of the prior which is attributed to the sparseness induced byl1-norm, especially in the iterative reweighting scheme. Besides, the proposed methods demonstrated lower bias and less hyper-parameter dependency on PET intensity estimation in the regions with matched anatomical boundaries in PET and MRI. Therefore, these methods will be useful for improving the PET image quality based on the anatomical side information.

Non-linear fitting with joint spatial regularization in arterial spin labeling

Multi-Delay single-shot arterial spin labeling (ASL) imaging provides accurate cerebral blood flow (CBF) and, in addition, arterial transit time (ATT) maps but the inherent low SNR can be challenging. Especially standard fitting using non-linear least squares often fails in regions with poor SNR, resulting in noisy estimates of the quantitative maps. State-of-the-art fitting techniques improve the SNR by incorporating prior knowledge in the estimation process which typically leads to spatial blurring. To this end, we propose a new estimation method with a joint spatial total generalized variation regularization on CBF and ATT. This joint regularization approach utilizes shared spatial features across maps to enhance sharpness and simultaneously improves noise suppression in the final estimates. The proposed method is evaluated at three levels, first on synthetic phantom data including pathologies, followed by in vivo acquisitions of healthy volunteers, and finally on patient data following an ischemic stroke. The quantitative estimates are compared to two reference methods, non-linear least squares fitting and a state-of-the-art ASL quantification algorithm based on Bayesian inference. The proposed joint regularization approach outperforms the reference implementations, substantially increasing the SNR in CBF and ATT while maintaining sharpness and quantitative accuracy in the estimates.

Di-chromatic interpolation of magnetic resonance metabolic images

OBJECTIVE

Magnetic resonance imaging with hyperpolarized contrast agents can provide unprecedented in vivo measurements of metabolism, but yields images that are lower resolution than that achieved with proton anatomical imaging. In order to spatially localize the metabolic activity, the metabolic image must be interpolated to the size of the proton image. The most common methods for choosing the unknown values rely exclusively on values of the original uninterpolated image.

METHODS

In this work, we present an alternative method that uses the higher-resolution proton image to provide additional spatial structure. The interpolated image is the result of a convex optimization algorithm which is solved with the fast iterative shrinkage threshold algorithm (FISTA).

RESULTS

Results are shown with images of hyperpolarized pyruvate, lactate, and bicarbonate using data of the heart and brain from healthy human volunteers, a healthy porcine heart, and a human with prostate cancer.

Approximating anatomically-guided PET reconstruction in image space using a convolutional neural network

In the last two decades, it has been shown that anatomically-guided PET reconstruction can lead to improved bias-noise characteristics in brain PET imaging. However, despite promising results in simulations and first studies, anatomically-guided PET reconstructions are not yet available for use in routine clinical because of several reasons. In light of this, we investigate whether the improvements of anatomically-guided PET reconstruction methods can be achieved entirely in the image domain with a convolutional neural network (CNN). An entirely image-based CNN post-reconstruction approach has the advantage that no access to PET raw data is needed and, moreover, that the prediction times of trained CNNs are extremely fast on state of the art GPUs which will substantially facilitate the evaluation, fine-tuning and application of anatomically-guided PET reconstruction in real-world clinical settings. In this work, we demonstrate that anatomically-guided PET reconstruction using the asymmetric Bowsher prior can be well-approximated by a purely shift-invariant convolutional neural network in image space allowing the generation of anatomically-guided PET images in almost real-time. We show that by applying dedicated data augmentation techniques in the training phase, in which 16 [18F]FDG and 10 [18F]PE2I data sets were used, lead to a CNN that is robust against the used PET tracer, the noise level of the input PET images and the input MRI contrast. A detailed analysis of our CNN in 36 [18F]FDG, 18 [18F]PE2I, and 7 [18F]FET test data sets demonstrates that the image quality of our trained CNN is very close to the one of the target reconstructions in terms of regional mean recovery and regional structural similarity.

Joint multi-contrast variational network reconstruction (jVN) with application to rapid 2D and 3D imaging

PURPOSE

To improve the image quality of highly accelerated multi-channel MRI data by learning a joint variational network that reconstructs multiple clinical contrasts jointly.

METHODS

Data from our multi-contrast acquisition were embedded into the variational network architecture where shared anatomical information is exchanged by mixing the input contrasts. Complementary k-space sampling across imaging contrasts and Bunch-Phase/Wave-Encoding were used for data acquisition to improve the reconstruction at high accelerations. At 3T, our joint variational network approach across T1w, T2w and T2-FLAIR-weighted brain scans was tested for retrospective under-sampling at R = 6 (2D) and R = 4 × 4 (3D) acceleration. Prospective acceleration was also performed for 3D data where the combined acquisition time for whole brain coverage at 1 mm isotropic resolution across three contrasts was less than 3 min.

RESULTS

Across all test datasets, our joint multi-contrast network better preserved fine anatomical details with reduced image-blurring when compared to the corresponding single-contrast reconstructions. Improvement in image quality was also obtained through complementary k-space sampling and Bunch-Phase/Wave-Encoding where the synergistic combination yielded the overall best performance as evidenced by exemplary slices and quantitative error metrics.

CONCLUSION

By leveraging shared anatomical structures across the jointly reconstructed scans, our joint multi-contrast approach learnt more efficient regularizers, which helped to retain natural image appearance and avoid over-smoothing. When synergistically combined with advanced encoding techniques, the performance was further improved, enabling up to R = 16-fold acceleration with good image quality. This should help pave the way to very rapid high-resolution brain exams.

Simultaneous use of individual and joint regularization terms in compressive sensing: Joint reconstruction of multi-channel multi-contrast MRI acquisitions

Multi-contrast images are commonly acquired together to maximize complementary diagnostic information, albeit at the expense of longer scan times. A time-efficient strategy to acquire high-quality multi-contrast images is to accelerate individual sequences and then reconstruct undersampled data with joint regularization terms that leverage common information across contrasts. However, these terms can cause features that are unique to a subset of contrasts to leak into the other contrasts. Such leakage-of-features may appear as artificial tissues, thereby misleading diagnosis. The goal of this study is to develop a compressive sensing method for multi-channel multi-contrast magnetic resonance imaging (MRI) that optimally utilizes shared information while preventing feature leakage. Joint regularization terms group sparsity and colour total variation are used to exploit common features across images while individual sparsity and total variation are also used to prevent leakage of distinct features across contrasts. The multi-channel multi-contrast reconstruction problem is solved via a fast algorithm based on Alternating Direction Method of Multipliers. The proposed method is compared against using only individual and only joint regularization terms in reconstruction. Comparisons were performed on single-channel simulated and multi-channel in-vivo datasets in terms of reconstruction quality and neuroradiologist reader scores. The proposed method demonstrates rapid convergence and improved image quality for both simulated and in-vivo datasets. Furthermore, while reconstructions that solely use joint regularization terms are prone to leakage-of-features, the proposed method reliably avoids leakage via simultaneous use of joint and individual terms, thereby holding great promise for clinical use.

TGV-regularized inversion of the Radon transform for photoacoustic tomography

We propose and study a reconstruction method for photoacoustic tomography (PAT) based on total generalized variation (TGV) regularization for the inversion of the slice-wise 2D-Radon transform in 3D. The latter problem occurs for recently-developed PAT imaging techniques with parallelized integrating ultrasound detection where projection data from various directions is sequentially acquired. As the imaging speed is presently limited to 20 seconds per 3D image, the reconstruction of temporally-resolved 3D sequences of, e.g., one heartbeat or breathing cycle, is very challenging and currently, the presence of motion artifacts in the reconstructions obstructs the applicability for biomedical research. In order to push these techniques forward towards real time, it thus becomes necessary to reconstruct from less measured data such as few-projection data and consequently, to employ sophisticated reconstruction methods in order to avoid typical artifacts. The proposed TGV-regularized Radon inversion is a variational method that is shown to be capable of such artifact-free inversion. It is validated by numerical simulations, compared to filtered back projection (FBP), and performance-tested on real data from phantom as well as in-vivo mouse experiments. The results indicate that a speed-up factor of four is possible without compromising reconstruction quality.

Faster PET reconstruction with non-smooth priors by randomization and preconditioning

Uncompressed clinical data from modern positron emission tomography (PET) scanners are very large, exceeding 350 million data points (projection bins). The last decades have seen tremendous advancements in mathematical imaging tools many of which lead to non-smooth (i.e. non-differentiable) optimization problems which are much harder to solve than smooth optimization problems. Most of these tools have not been translated to clinical PET data, as the state-of-the-art algorithms for non-smooth problems do not scale well to large data. In this work, inspired by big data machine learning applications, we use advanced randomized optimization algorithms to solve the PET reconstruction problem for a very large class of non-smooth priors which includes for example total variation, total generalized variation, directional total variation and various different physical constraints. The proposed algorithm randomly uses subsets of the data and only updates the variables associated with these. While this idea often leads to divergent algorithms, we show that the proposed algorithm does indeed converge for any proper subset selection. Numerically, we show on real PET data (FDG and florbetapir) from a Siemens Biograph mMR that about ten projections and backprojections are sufficient to solve the MAP optimisation problem related to many popular non-smooth priors; thus showing that the proposed algorithm is fast enough to bring these models into routine clinical practice.

A compressed sensing accelerated radial MS-CAIPIRINHA technique for extended anatomical coverage in myocardial perfusion studies on PET/MR systems

PURPOSE

Simultaneous acquisition of myocardial first-pass perfusion MRI and 18F-FDG PET viability imaging on integrated whole-body PET/MR hybrid systems synergistically delivers both functional and metabolic information on the tissue state. While PET viability scans are inherently three-dimensional, conventional MR myocardial perfusion imaging is typically performed using only three short-axis slices with a temporal resolution of one RR-interval. To improve the integrated diagnostics, an acquisition and image reconstruction method based on "Multi-Slice Controlled Aliasing In Parallel Imaging Results IN Higher Acceleration (MS-CAIPIRINHA)" was developed extending anatomical coverage for MR perfusion imaging to six short-axis slices per RR-interval.

METHODS

An ECG-gated radial TurboFLASH MR pulse sequence with dual band excitation was implemented on an integrated whole-body PET/MR system and a model-based reconstruction technique was developed to fully reconstruct the undersampled CAIPIRINHA acquisitions. An 18F-FDG viability PET scan was performed simultaneously to the MR protocol, additionally complemented by a late enhancement MRI acquisition (LGE).

RESULTS AND CONCLUSION

The developed imaging technique was tested in five patients with known collateralized coronary total occlusions, resulting in improved characterization of perfusion across areas of decreased tissue viability as indicated by the simultaneously determined 18F-FDG uptake. While conventional MR perfusion with only three slice positions was occasionally missing substantial parts of the viable area, the new approach achieved LV coverage only slightly inferior to LGE imaging and therefore better comparable to PET results. The quality of first-pass enhancement curves was comparable between conventional and radial MS-CAIPIRINHA-based acquisitions.

Feasibility of Quantitative Magnetic Resonance Fingerprinting in Ovarian Tumors for T1 and T2 Mapping in a PET/MR Setting

Multiparametric magnetic resonance imaging (MRI) can be used to characterize many cancer subtypes including ovarian cancer. Quantitative mapping of MRI relaxation values, such as T 1 and T 2 mapping, is promising for improving tumor assessment beyond conventional qualitative T 1- and T 2-weighted images. However, quantitative MRI relaxation mapping methods often involve long scan times due to sequentially measuring many parameters. Magnetic resonance fingerprinting (MRF) is a new method that enables fast quantitative MRI by exploiting the transient signals caused by the variation of pseudorandom sequence parameters. These transient signals are then matched to a simulated dictionary of T 1 and T 2 values to create quantitative maps. The ability of MRF to simultaneously measure multiple parameters, could represent a new approach to characterizing cancer and assessing treatment response. This feasibility study investigates MRF for simultaneous T 1, T 2, and relative proton density (rPD) mapping using ovarian cancer as a model system.

High-dimensionality undersampled patch-based reconstruction (HD-PROST) for accelerated multi-contrast MRI

PURPOSE

To develop a new high-dimensionality undersampled patch-based reconstruction (HD-PROST) for highly accelerated 2D and 3D multi-contrast MRI.

METHODS

HD-PROST jointly reconstructs multi-contrast MR images by exploiting the highly redundant information, on a local and non-local scale, and the strong correlation shared between the multiple contrast images. This is achieved by enforcing multi-dimensional low-rank in the undersampled images. 2D magnetic resonance fingerprinting (MRF) phantom and in vivo brain acquisitions were performed to evaluate the performance of HD-PROST for highly accelerated simultaneous T1 and T2 mapping. Additional in vivo experiments for reconstructing multiple undersampled 3D magnetization transfer (MT)-weighted images were conducted to illustrate the impact of HD-PROST for high-resolution multi-contrast 3D imaging.

RESULTS

In the 2D MRF phantom study, HD-PROST provided accurate and precise estimation of the T1 and T2 values in comparison to gold standard spin echo acquisitions. HD-PROST achieved good quality maps for the in vivo 2D MRF experiments in comparison to conventional low-rank inversion reconstruction. T1 and T2 values of white matter and gray matter were in good agreement with those reported in the literature for MRF acquisitions with reduced number of time point images (500 time point images, ~2.5 s scan time). For in vivo MT-weighted 3D acquisitions (6 different contrasts), HD-PROST achieved similar image quality than the fully sampled reference image for an undersampling factor of 6.5-fold.

CONCLUSION

HD-PROST enables multi-contrast 2D and 3D MR images in a short acquisition time without compromising image quality. Ultimately, this technique may increase the potential of conventional parameter mapping.

Total generalized variation regularization for multi-modal electron tomography

In multi-modal electron tomography, tilt series of several signals such as X-ray spectra, electron energy-loss spectra, annular dark-field, or bright-field data are acquired at the same time in a transmission electron microscope and subsequently reconstructed in three dimensions. However, the acquired data are often incomplete and suffer from noise, and generally each signal is reconstructed independently of all other signals, not taking advantage of correlation between different datasets. This severely limits both the resolution and validity of the reconstructed images. In this paper, we show how image quality in multi-modal electron tomography can be greatly improved by employing variational modeling and multi-channel regularization techniques. To achieve this aim, we employ a coupled Total Generalized Variation (TGV) regularization that exploits correlation between different channels. In contrast to other regularization methods, coupled TGV regularization allows to reconstruct both hard transitions and gradual changes inside each sample, and links different channels at the level of first and higher order derivatives. This favors similar interface positions for all reconstructions, thereby improving the image quality for all data, in particular, for 3D elemental maps. We demonstrate the joint multi-channel TGV reconstruction on tomographic energy-dispersive X-ray spectroscopy (EDXS) and high-angle annular dark field (HAADF) data, but the reconstruction method is generally applicable to all types of signals used in electron tomography, as well as all other types of projection-based tomographies.

Iterative PET Image Reconstruction Using Convolutional Neural Network Representation

PET image reconstruction is challenging due to the ill-poseness of the inverse problem and limited number of detected photons. Recently, the deep neural networks have been widely and successfully used in computer vision tasks and attracted growing interests in medical imaging. In this paper, we trained a deep residual convolutional neural network to improve PET image quality by using the existing inter-patient information. An innovative feature of the proposed method is that we embed the neural network in the iterative reconstruction framework for image representation, rather than using it as a post-processing tool. We formulate the objective function as a constrained optimization problem and solve it using the alternating direction method of multipliers algorithm. Both simulation data and hybrid real data are used to evaluate the proposed method. Quantification results show that our proposed iterative neural network method can outperform the neural network denoising and conventional penalized maximum likelihood methods.

Multi-modal synergistic PET and MR reconstruction using mutually weighted quadratic priors

PURPOSE

To propose a framework for synergistic reconstruction of PET-MR and multi-contrast MR data to improve the image quality obtained from noisy PET data and from undersampled MR data.

THEORY AND METHODS

Weighted quadratic priors were devised to preserve common boundaries between PET-MR images while reducing noise, PET Gibbs ringing, and MR undersampling artifacts. These priors are iteratively reweighted using normalized multi-modal Gaussian similarity kernels. Synergistic PET-MR reconstructions were built on the PET maximum a posteriori expectation maximization algorithm and the MR regularized sensitivity encoding method. The proposed approach was compared to conventional methods, total variation, and prior-image weighted quadratic regularization methods. Comparisons were performed on a simulated [18 F]fluorodeoxyglucose-PET and T1 /T2 -weighted MR brain phantom, 2 in vivo T1 /T2 -weighted MR brain datasets, and an in vivo [18 F]fluorodeoxyglucose-PET and fluid-attenuated inversion recovery/T1 -weighted MR brain dataset.

RESULTS

Simulations showed that synergistic reconstructions achieve the lowest quantification errors for all image modalities compared to conventional, total variation, and weighted quadratic methods. Whereas total variation regularization preserved modality-unique features, this method failed to recover PET details and was not able to reduce MR artifacts compared to our proposed method. For in vivo MR data, our method maintained similar image quality for 3× and 14× accelerated data. Reconstruction of the PET-MR dataset also demonstrated improved performance of our method compared to the conventional independent methods in terms of reduced Gibbs and undersampling artifacts.

CONCLUSION

The proposed methodology offers a robust multi-modal synergistic image reconstruction framework that can be readily built on existing established algorithms.

Magnetic Resonance Fingerprinting: Implications and Opportunities for PET/MR

Magnetic Resonance Imaging (MRI) can be used to assess anatomical structure, and its sensitivity to a variety of tissue properties enables superb contrast between tissues as well as the ability to characterize these tissues. However, despite vast potential for quantitative and functional evaluation, MRI is typically used qualitatively, in which the underlying tissue properties are not measured, and thus the brightness of each pixel is not quantitatively meaningful. Positron Emission Tomography (PET) is an inherently quantitative imaging modality that interrogates functional activity within a tissue, probed by a molecule of interest coupled with an appropriate tracer. These modalities can complement one another to provide clinical information regarding both structure and function, but there are still technical and practical hurdles in the way of the integrated use of both modalities. Recent advances in MRI have moved the field in an increasingly quantitative direction, which is complementary to PET, and could also potentially help solve some of the challenges in PET/MR. Magnetic Resonance Fingerprinting (MRF) is a recently described MRI-based technique which can efficiently and simultaneously quantitatively map several tissue properties in a single exam. Here, the basic principles behind the quantitative approach of MRF are laid out, and the potential implications for combined PET/MR are discussed.

Effect of PET-MR Inconsistency in the Kernel Image Reconstruction Method

Anatomically-driven image reconstruction algorithms have become very popular in positron emission tomography (PET) where they have demonstrated improved image resolution and quantification. This work, consider the effect of spatial inconsistency between MR and PET images in hot and cold regions of the PET image. We investigate these effects on the kernel method from machine learning, in particular, the hybrid kernelized expectation maximization (HKEM). These were applied to Jaszczak phantom and patient data acquired with the Biograph Siemens mMR. The results show that even a small shift can cause a significant change in activity concentration. In general, the PET-MR inconsistencies can induce the partial volume effect, more specifically the 'spill-in' of the affected cold regions and the 'spill-out' from the hot regions. The maximum change was about 100% for the cold region and 10% for the hot lesion using KEM, against the 37% and 8% obtained with HKEM. The findings of this work suggest that including PET information in the kernel enhances the flexibility of the reconstruction in case of spatial inconsistency. Nevertheless, accurate registration and choice of the appropriate MR image for the creation of the kernel is essential to avoid artifacts, blurring, and bias.

Accelerating the estimation of 3D spatially resolved T2 distributions

Obtaining quantitative, 3D spatially-resolved T₂ distributions (T₂ maps) from magnetic resonance data is of importance in both medical and porous media applications. Due to the long acquisition time, there is considerable interest in accelerating the experiments by applying undersampling schemes during the acquisition and developing reconstruction techniques for obtaining the 3D T₂ maps from the undersampled data. A multi-echo spin echo pulse sequence is used in this work to acquire the undersampled data according to two different sampling patterns: a conventional coherent sampling pattern where the same set of lines in k-space is sampled for all equally-spaced echoes in the echo train, and a proposed incoherent sampling pattern where an independent set of k-space lines is sampled for each echo. The conventional reconstruction technique of total variation regularization is compared to the more recent techniques of nuclear norm regularization and Nuclear Total Generalized Variation (NTGV) regularization. It is shown that best reconstructions are obtained when the data acquired using an incoherent sampling scheme are processed using NTGV regularization. Using an incoherent sampling pattern and NTGV regularization as the reconstruction technique, quantitative results are obtained at sampling percentages as low as 3.1% of k-space, corresponding to a 32-fold decrease in the acquisition time, compared to a fully sampled dataset.

Ultrafast 3D Bloch-Siegert B <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msubsup><mml:mrow/> <mml:mn>1</mml:mn> <mml:mo>+</mml:mo></mml:msubsup> </mml:math> -mapping using variational modeling

PURPOSE

Highly accelerated B <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msubsup><mml:mrow/> <mml:mn>1</mml:mn> <mml:mo>+</mml:mo></mml:msubsup> </mml:math> -mapping based on the Bloch-Siegert shift to allow 3D acquisitions even within a brief period of a single breath-hold.

THEORY AND METHODS

The B <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msubsup><mml:mrow/> <mml:mn>1</mml:mn> <mml:mo>+</mml:mo></mml:msubsup> </mml:math> dependent Bloch-Siegert phase shift is measured within a highly subsampled 3D-volume and reconstructed using a two-step variational approach, exploiting the different spatial distribution of morphology and B <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msubsup><mml:mrow/> <mml:mn>1</mml:mn> <mml:mo>+</mml:mo></mml:msubsup> </mml:math> -field. By appropriate variable substitution the basic non-convex optimization problem is transformed in a sequential solution of two convex optimization problems with a total generalized variation (TGV) regularization for the morphology part and a smoothness constraint for the B <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msubsup><mml:mrow/> <mml:mn>1</mml:mn> <mml:mo>+</mml:mo></mml:msubsup> </mml:math> -field. The method is evaluated on 3D in vivo data with retro- and prospective subsampling. The reconstructed B <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msubsup><mml:mrow/> <mml:mn>1</mml:mn> <mml:mo>+</mml:mo></mml:msubsup> </mml:math> -maps are compared to a zero-padded low resolution reconstruction and a fully sampled reference.

RESULTS

The reconstructed B <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msubsup><mml:mrow/> <mml:mn>1</mml:mn> <mml:mo>+</mml:mo></mml:msubsup> </mml:math> -field maps are in high accordance to the reference for all measurements with a mean error below 1% and a maximum of about 4% for acceleration factors up to 100. The minimal error for different sampling patterns was achieved by sampling a dense region in k-space center with acquisition times of around 10-12 s for 3D-acquistions.

CONCLUSIONS

The proposed variational approach enables highly accelerated 3D acquisitions of Bloch-Siegert data and thus full liver coverage in a single breath hold.

From simultaneous to synergistic MR-PET brain imaging: A review of hybrid MR-PET imaging methodologies

Simultaneous Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) scanning is a recent major development in biomedical imaging. The full integration of the PET detector ring and electronics within the MR system has been a technologically challenging design to develop but provides capacity for simultaneous imaging and the potential for new diagnostic and research capability. This article reviews state-of-the-art MR-PET hardware and software, and discusses future developments focusing on neuroimaging methodologies for MR-PET scanning. We particularly focus on the methodologies that lead to an improved synergy between MRI and PET, including optimal data acquisition, PET attenuation and motion correction, and joint image reconstruction and processing methods based on the underlying complementary and mutual information. We further review the current and potential future applications of simultaneous MR-PET in both systems neuroscience and clinical neuroimaging research. We demonstrate a simultaneous data acquisition protocol to highlight new applications of MR-PET neuroimaging research studies.

Coupled regularization with multiple data discrepancies

We consider a class of regularization methods for inverse problems where a coupled regularization is employed for the simultaneous reconstruction of data from multiple sources. Applications for such a setting can be found in multi-spectral or multimodality inverse problems, but also in inverse problems with dynamic data. We consider this setting in a rather general framework and derive stability and convergence results, including convergence rates. In particular, we show how parameter choice strategies adapted to the interplay of different data channels allow to improve upon convergence rates that would be obtained by treating all channels equally. Motivated by concrete applications, our results are obtained under rather general assumptions that allow to include the Kullback-Leibler divergence as data discrepancy term. To simplify their application to concrete settings, we further elaborate several practically relevant special cases in detail. To complement the analytical results, we also provide an algorithmic framework and source code that allows to solve a class of jointly regularized inverse problems with any number of data discrepancies. As concrete applications, we show numerical results for multi-contrast MR and joint MR-PET reconstruction.

Improving parallel imaging by jointly reconstructing multi-contrast data

PURPOSE

To develop parallel imaging techniques that simultaneously exploit coil sensitivity encoding, image phase prior information, similarities across multiple images, and complementary k-space sampling for highly accelerated data acquisition.

METHODS

We introduce joint virtual coil (JVC)-generalized autocalibrating partially parallel acquisitions (GRAPPA) to jointly reconstruct data acquired with different contrast preparations, and show its application in 2D, 3D, and simultaneous multi-slice (SMS) acquisitions. We extend the joint parallel imaging concept to exploit limited support and smooth phase constraints through Joint (J-) LORAKS formulation. J-LORAKS allows joint parallel imaging from limited autocalibration signal region, as well as permitting partial Fourier sampling and calibrationless reconstruction.

RESULTS

We demonstrate highly accelerated 2D balanced steady-state free precession with phase cycling, SMS multi-echo spin echo, 3D multi-echo magnetization-prepared rapid gradient echo, and multi-echo gradient recalled echo acquisitions in vivo. Compared to conventional GRAPPA, proposed joint acquisition/reconstruction techniques provide more than 2-fold reduction in reconstruction error.

CONCLUSION

JVC-GRAPPA takes advantage of additional spatial encoding from phase information and image similarity, and employs different sampling patterns across acquisitions. J-LORAKS achieves a more parsimonious low-rank representation of local k-space by considering multiple images as additional coils. Both approaches provide dramatic improvement in artifact and noise mitigation over conventional single-contrast parallel imaging reconstruction. Magn Reson Med 80:619-632, 2018. © 2018 International Society for Magnetic Resonance in Medicine.

Penalized maximum likelihood simultaneous longitudinal PET image reconstruction with difference-image priors

PURPOSE

Many clinical contexts require the acquisition of multiple positron emission tomography (PET) scans of a single subject, for example, to observe and quantitate changes in functional behaviour in tumors after treatment in oncology. Typically, the datasets from each of these scans are reconstructed individually, without exploiting the similarities between them. We have recently shown that sharing information between longitudinal PET datasets by penalizing voxel-wise differences during image reconstruction can improve reconstructed images by reducing background noise and increasing the contrast-to-noise ratio of high-activity lesions. Here, we present two additional novel longitudinal difference-image priors and evaluate their performance using two-dimesional (2D) simulation studies and a three-dimensional (3D) real dataset case study.

METHODS

We have previously proposed a simultaneous difference-image-based penalized maximum likelihood (PML) longitudinal image reconstruction method that encourages sparse difference images (DS-PML), and in this work we propose two further novel prior terms. The priors are designed to encourage longitudinal images with corresponding differences which have (a) low entropy (DE-PML), and (b) high sparsity in their spatial gradients (DTV-PML). These two new priors and the originally proposed longitudinal prior were applied to 2D-simulated treatment response [¹⁸ F]fluorodeoxyglucose (FDG) brain tumor datasets and compared to standard maximum likelihood expectation-maximization (MLEM) reconstructions. These 2D simulation studies explored the effects of penalty strengths, tumor behaviour, and interscan coupling on reconstructed images. Finally, a real two-scan longitudinal data series acquired from a head and neck cancer patient was reconstructed with the proposed methods and the results compared to standard reconstruction methods.

RESULTS

Using any of the three priors with an appropriate penalty strength produced images with noise levels equivalent to those seen when using standard reconstructions with increased counts levels. In tumor regions, each method produces subtly different results in terms of preservation of tumor quantitation and reconstruction root mean-squared error (RMSE). In particular, in the two-scan simulations, the DE-PML method produced tumor means in close agreement with MLEM reconstructions, while the DTV-PML method produced the lowest errors due to noise reduction within the tumor. Across a range of tumor responses and different numbers of scans, similar results were observed, with DTV-PML producing the lowest errors of the three priors and DE-PML producing the lowest bias. Similar improvements were observed in the reconstructions of the real longitudinal datasets, although imperfect alignment of the two PET images resulted in additional changes in the difference image that affected the performance of the proposed methods.

CONCLUSION

Reconstruction of longitudinal datasets by penalizing difference images between pairs of scans from a data series allows for noise reduction in all reconstructed images. An appropriate choice of penalty term and penalty strength allows for this noise reduction to be achieved while maintaining reconstruction performance in regions of change, either in terms of quantitation of mean intensity via DE-PML, or in terms of tumor RMSE via DTV-PML. Overall, improving the image quality of longitudinal datasets via simultaneous reconstruction has the potential to improve upon currently used methods, allow dose reduction, or reduce scan time while maintaining image quality at current levels.

Direct Patlak Reconstruction From Dynamic PET Data Using the Kernel Method With MRI Information Based on Structural Similarity

Positron emission tomography (PET) is a functional imaging modality widely used in oncology, cardiology, and neuroscience. It is highly sensitive, but suffers from relatively poor spatial resolution, as compared with anatomical imaging modalities, such as magnetic resonance imaging (MRI). With the recent development of combined PET/MR systems, we can improve the PET image quality by incorporating MR information into image reconstruction. Previously, kernel learning has been successfully embedded into static and dynamic PET image reconstruction using either PET temporal or MRI information. Here, we combine both PET temporal and MRI information adaptively to improve the quality of direct Patlak reconstruction. We examined different approaches to combine the PET and MRI information in kernel learning to address the issue of potential mismatches between MRI and PET signals. Computer simulations and hybrid real-patient data acquired on a simultaneous PET/MR scanner were used to evaluate the proposed methods. Results show that the method that combines PET temporal information and MRI spatial information adaptively based on the structure similarity index has the best performance in terms of noise reduction and resolution improvement.

Combined PET/MRI: Global Warming-Summary Report of the 6th International Workshop on PET/MRI, March 27-29, 2017, Tübingen, Germany

The 6th annual meeting to address key issues in positron emission tomography (PET)/magnetic resonance imaging (MRI) was held again in Tübingen, Germany, from March 27 to 29, 2017. Over three days of invited plenary lectures, round table discussions and dialogue board deliberations, participants critically assessed the current state of PET/MRI, both clinically and as a research tool, and attempted to chart future directions. The meeting addressed the use of PET/MRI and workflows in oncology, neurosciences, infection, inflammation and chronic pain syndromes, as well as deeper discussions about how best to characterise the tumour microenvironment, optimise the complementary information available from PET and MRI, and how advanced data mining and bioinformatics, as well as information from liquid biomarkers (circulating tumour cells and nucleic acids) and pathology, can be integrated to give a more complete characterisation of disease phenotype. Some issues that have dominated previous meetings, such as the accuracy of MR-based attenuation correction (AC) of the PET scan, were finally put to rest as having been adequately addressed for the majority of clinical situations. Likewise, the ability to standardise PET systems for use in multicentre trials was confirmed, thus removing a perceived barrier to larger clinical imaging trials. The meeting openly questioned whether PET/MRI should, in all cases, be used as a whole-body imaging modality or whether in many circumstances it would best be employed to give an in-depth study of previously identified disease in a single organ or region. The meeting concluded that there is still much work to be done in the integration of data from different fields and in developing a common language for all stakeholders involved. In addition, the participants advocated joint training and education for individuals who engage in routine PET/MRI. It was agreed that PET/MRI can enhance our understanding of normal and disrupted biology, and we are in a position to describe the in vivo nature of disease processes, metabolism, evolution of cancer and the monitoring of response to pharmacological interventions and therapies. As such, PET/MRI is a key to advancing medicine and patient care.

Evaluation of Parallel Level Sets and Bowsher's Method as Segmentation-Free Anatomical Priors for Time-of-Flight PET Reconstruction

In this article, we evaluate Parallel Level Sets (PLS) and Bowsher's method as segmentation-free anatomical priors for regularized brain positron emission tomography (PET) reconstruction. We derive the proximity operators for two PLS priors and use the EM-TV algorithm in combination with the first order primal-dual algorithm by Chambolle and Pock to solve the non-smooth optimization problem for PET reconstruction with PLS regularization. In addition, we compare the performance of two PLS versions against the symmetric and asymmetric Bowsher priors with quadratic and relative difference penalty function. For this aim, we first evaluate reconstructions of 30 noise realizations of simulated PET data derived from a real hybrid positron emission tomography/magnetic resonance imaging (PET/MR) acquisition in terms of regional bias and noise. Second, we evaluate reconstructions of a real brain PET/MR data set acquired on a GE Signa time-of-flight PET/MR in a similar way. The reconstructions of simulated and real 3D PET/MR data show that all priors were superior to post-smoothed maximum likelihood expectation maximization with ordered subsets (OSEM) in terms of bias-noise characteristics in different regions of interest where the PET uptake follows anatomical boundaries. Our implementation of the asymmetric Bowsher prior showed slightly superior performance compared with the two versions of PLS and the symmetric Bowsher prior. At very high regularization weights, all investigated anatomical priors suffer from the transfer of non-shared gradients.

Synergistic PET and SENSE MR Image Reconstruction Using Joint Sparsity Regularization

In this paper, we propose a generalized joint sparsity regularization prior and reconstruction framework for the synergistic reconstruction of positron emission tomography (PET) and under sampled sensitivity encoded magnetic resonance imaging data with the aim of improving image quality beyond that obtained through conventional independent reconstructions. The proposed prior improves upon the joint total variation (TV) using a non-convex potential function that assigns a relatively lower penalty for the PET and MR gradients, whose magnitudes are jointly large, thus permitting the preservation and formation of common boundaries irrespective of their relative orientation. The alternating direction method of multipliers (ADMM) optimization framework was exploited for the joint PET-MR image reconstruction. In this framework, the joint maximum a posteriori objective function was effectively optimized by alternating between well-established regularized PET and MR image reconstructions. Moreover, the dependency of the joint prior on the PET and MR signal intensities was addressed by a novel alternating scaling of the distribution of the gradient vectors. The proposed prior was compared with the separate TV and joint TV regularization methods using extensive simulation and real clinical data. In addition, the proposed joint prior was compared with the recently proposed linear parallel level sets (PLSs) method using a benchmark simulation data set. Our simulation and clinical data results demonstrated the improved quality of the synergistically reconstructed PET-MR images compared with the unregularized and conventional separately regularized methods. It was also found that the proposed prior can outperform both the joint TV and linear PLS regularization methods in assisting edge preservation and recovery of details, which are otherwise impaired by noise and aliasing artifacts. In conclusion, the proposed joint sparsity regularization within the presented a ADMM reconstruction framework is a promising technique, nonetheless our clinical results showed that the clinical applicability of joint reconstruction might be limited in current PET-MR scanners, mainly due to the lower resolution of PET images.