Simultaneous maximum a posteriori reconstruction of attenuation and activity distributions from emission sinograms

Effect of the transpulmonary pressure on the lungs' vibroacoustic response: a first numerical perspective

In the high-stakes environment of intensive care units (ICUs), managing transpulmonary pressure is crucial for providing breathing assistance to intubated patients, particularly when combining this intervention with respiratory therapy, such as high-frequency chest compression (HFCC). Despite the complexity of lung tissues, a computed tomography-based finite element model (CT-FEM), guided by Biot's theory, can be employed to numerically predict their vibroacoustic behavior at low frequencies, where the properties of the lungs align with the theory's principles. In this work, one aims to develop an analytical model of the lungs for two different levels of transpulmonary pressure-10 cm H2O (inflated lungs) and 20 cm H2O (healthy lungs)-to examine the poroviscoelastic behavior of the lungs and evaluate the generated analytical model using a CT-FEM of the human thorax like a digital twin of the human thorax. Biot's theory was utilized to predict the complex-valued shear wave speed, as well as the fast and slow compression wave speeds, across a frequency range between 5 and 100 Hz. The analytically computed values were tested using a previously validated CT-FEM of the human thorax to compare respiratory therapy outcomes for intubated patients under different transpulmonary pressure levels. Besides the frequency response function of the thorax, the kinetic energy density and the strain energy density were compared for these pressure levels. The CT-FEM demonstrated that all peak points fall within the range of 20-45 Hz; therefore, this range might be considered in ICUs settings. Kinetic energy density was nearly 2.2 times higher, and strain energy density was 1.46-1.26 times higher at the first and last peaks, respectively; therefore, inflated lungs experienced greater effects than healthy ones under the same respiratory therapy conditions. Overall, this study highlights how different transpulmonary pressures affect HFCC therapy, offering insights into gentle and effective conditions for intubated patients in ICUs while revealing the lungs' 3D responses by integrating analytically predicted shear wave speed, fast and slow compression wave speeds.

Deep-learning-based Attenuation Correction for 68Ga-DOTATATE Whole-body PET Imaging: A Dual-center Clinical Study

Objectives

Attenuation correction is a critical phenomenon in quantitative positron emission tomography (PET) imaging with its own special challenges. However, computed tomography (CT) modality which is used for attenuation correction and anatomical localization increases patient radiation dose. This study was aimed to develop a deep learning model for attenuation correction of whole-body 68Ga-DOTATATE PET images.

Methods

Non-attenuation-corrected and computed tomography-based attenuation-corrected (CTAC) whole-body 68Ga-DOTATATE PET images of 118 patients from two different imaging centers were used. We implemented a residual deep learning model using the NiftyNet framework. The model was trained four times and evaluated six times using the test data from the centers. The quality of the synthesized PET images was compared with the PET-CTAC images using different evaluation metrics, including the peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), mean square error (MSE), and root mean square error (RMSE).

Results

Quantitative analysis of four network training sessions and six evaluations revealed the highest and lowest PSNR values as (52.86±6.6) and (47.96±5.09), respectively. Similarly, the highest and lowest SSIM values were obtained (0.99±0.003) and (0.97±0.01), respectively. Additionally, the highest and lowest RMSE and MSE values fell within the ranges of (0.0117±0.003), (0.0015±0.000103), and (0.01072±0.002), (0.000121±5.07xe-5), respectively. The study found that using datasets from the same center resulted in the highest PSNR, while using datasets from different centers led to lower PSNR and SSIM values. In addition, scenarios involving datasets from both centers achieved the best SSIM and the lowest MSE and RMSE.

Conclusion

Acceptable accuracy of attenuation correction on 68Ga-DOTATATE PET images using a deep learning model could potentially eliminate the need for additional X-ray imaging modalities, thereby imposing a high radiation dose on the patient.

Artificial intelligence-based joint attenuation and scatter correction strategies for multi-tracer total-body PET

BACKGROUND

Low-dose ungated CT is commonly used for total-body PET attenuation and scatter correction (ASC). However, CT-based ASC (CT-ASC) is limited by radiation dose risks of CT examinations, propagation of CT-based artifacts and potential mismatches between PET and CT. We demonstrate the feasibility of direct ASC for multi-tracer total-body PET in the image domain.

METHODS

Clinical uEXPLORER total-body PET/CT datasets of [18F]FDG (N = 52), [18F]FAPI (N = 46) and [68Ga]FAPI (N = 60) were retrospectively enrolled in this study. We developed an improved 3D conditional generative adversarial network (cGAN) to directly estimate attenuation and scatter-corrected PET images from non-attenuation and scatter-corrected (NASC) PET images. The feasibility of the proposed 3D cGAN-based ASC was validated using four training strategies: (1) Paired 3D NASC and CT-ASC PET images from three tracers were pooled into one centralized server (CZ-ASC). (2) Paired 3D NASC and CT-ASC PET images from each tracer were individually used (DL-ASC). (3) Paired NASC and CT-ASC PET images from one tracer ([18F]FDG) were used to train the networks, while the other two tracers were used for testing without fine-tuning (NFT-ASC). (4) The pre-trained networks of (3) were fine-tuned with two other tracers individually (FT-ASC). We trained all networks in fivefold cross-validation. The performance of all ASC methods was evaluated by qualitative and quantitative metrics using CT-ASC as the reference.

RESULTS

CZ-ASC, DL-ASC and FT-ASC showed comparable visual quality with CT-ASC for all tracers. CZ-ASC and DL-ASC resulted in a normalized mean absolute error (NMAE) of 8.51 ± 7.32% versus 7.36 ± 6.77% (p < 0.05), outperforming NASC (p < 0.0001) in [18F]FDG dataset. CZ-ASC, FT-ASC and DL-ASC led to NMAE of 6.44 ± 7.02%, 6.55 ± 5.89%, and 7.25 ± 6.33% in [18F]FAPI dataset, and NMAE of 5.53 ± 3.99%, 5.60 ± 4.02%, and 5.68 ± 4.12% in [68Ga]FAPI dataset, respectively. CZ-ASC, FT-ASC and DL-ASC were superior to NASC (p < 0.0001) and NFT-ASC (p < 0.0001) in terms of NMAE results.

CONCLUSIONS

CZ-ASC, DL-ASC and FT-ASC demonstrated the feasibility of providing accurate and robust ASC for multi-tracer total-body PET, thereby reducing the radiation hazards to patients from redundant CT examinations. CZ-ASC and FT-ASC could outperform DL-ASC for cross-tracer total-body PET AC.

Single-Subject Deep-Learning Image Reconstruction With a Neural Optimization Transfer Algorithm for PET-Enabled Dual-Energy CT Imaging

Combining dual-energy computed tomography (DECT) with positron emission tomography (PET) offers many potential clinical applications but typically requires expensive hardware upgrades or increases radiation doses on PET/CT scanners due to an extra X-ray CT scan. The recent PET-enabled DECT method allows DECT imaging on PET/CT without requiring a second X-ray CT scan. It combines the already existing X-ray CT image with a 511 keV γ -ray CT (gCT) image reconstructed from time-of-flight PET emission data. A kernelized framework has been developed for reconstructing gCT image but this method has not fully exploited the potential of prior knowledge. Use of deep neural networks may explore the power of deep learning in this application. However, common approaches require a large database for training, which is impractical for a new imaging method like PET-enabled DECT. Here, we propose a single-subject method by using neural-network representation as a deep coefficient prior to improving gCT image reconstruction without population-based pre-training. The resulting optimization problem becomes the tomographic estimation of nonlinear neural-network parameters from gCT projection data. This complicated problem can be efficiently solved by utilizing the optimization transfer strategy with quadratic surrogates. Each iteration of the proposed neural optimization transfer algorithm includes: PET activity image update; gCT image update; and least-square neural-network learning in the gCT image domain. This algorithm is guaranteed to monotonically increase the data likelihood. Results from computer simulation, real phantom data and real patient data have demonstrated that the proposed method can significantly improve gCT image quality and consequent multi-material decomposition as compared to other methods.

Simultaneous Activity and Attenuation Estimation in TOF-PET With TV-Constrained Nonconvex Optimization

An alternating direction method of multipliers (ADMM) framework is developed for nonsmooth biconvex optimization for inverse problems in imaging. In particular, the simultaneous estimation of activity and attenuation (SAA) problem in time-of-flight positron emission tomography (TOF-PET) has such a structure when maximum likelihood estimation (MLE) is employed. The ADMM framework is applied to MLE for SAA in TOF-PET, resulting in the ADMM-SAA algorithm. This algorithm is extended by imposing total variation (TV) constraints on both the activity and attenuation map, resulting in the ADMM-TVSAA algorithm. The performance of this algorithm is illustrated using the penalized maximum likelihood activity and attenuation estimation (P-MLAA) algorithm as a reference.

Enhanced direct joint attenuation and scatter correction of whole-body PET images via context-aware deep networks

In positron emission tomography (PET), attenuation and scatter corrections are necessary steps toward accurate quantitative reconstruction of the radiopharmaceutical distribution. Inspired by recent advances in deep learning, many algorithms based on convolutional neural networks have been proposed for automatic attenuation and scatter correction, enabling applications to CT-less or MR-less PET scanners to improve performance in the presence of CT-related artifacts. A known characteristic of PET imaging is to have varying tracer uptakes for various patients and/or anatomical regions. However, existing deep learning-based algorithms utilize a fixed model across different subjects and/or anatomical regions during inference, which could result in spurious outputs. In this work, we present a novel deep learning-based framework for the direct reconstruction of attenuation and scatter-corrected PET from non-attenuation-corrected images in the absence of structural information in the inference. To deal with inter-subject and intra-subject uptake variations in PET imaging, we propose a novel model to perform subject- and region-specific filtering through modulating the convolution kernels in accordance to the contextual coherency within the neighboring slices. This way, the context-aware convolution can guide the composition of intermediate features in favor of regressing input-conditioned and/or region-specific tracer uptakes. We also utilized a large cohort of 910 whole-body studies for training and evaluation purposes, which is more than one order of magnitude larger than previous works. In our experimental studies, qualitative assessments showed that our proposed CT-free method is capable of producing corrected PET images that accurately resemble ground truth images corrected with the aid of CT scans. For quantitative assessments, we evaluated our proposed method over 112 held-out subjects and achieved an absolute relative error of 14.30±3.88% and a relative error of -2.11%±2.73% in whole-body.

The SNR of time-of-flight positron emission tomography data for joint reconstruction of the activity and attenuation images

Objective.Measurement of the time-of-flight (TOF) difference of each coincident pair of photons increases the effective sensitivity of positron emission tomography (PET). Many authors have analyzed the benefit of TOF for quantification and hot spot detection in the reconstructed activity images. However, TOF not only improves the effective sensitivity, it also enables the joint reconstruction of the tracer concentration and attenuation images. This can be used to correct for errors in CT- or MR-derived attenuation maps, or to apply attenuation correction without the help of a second modality. This paper presents an analysis of the effect of TOF on the variance of the jointly reconstructed attenuation and (attenuation corrected) tracer concentration images.Approach.The analysis is performed for PET systems that have a distribution of possibly non-Gaussian TOF-kernels, and includes the conventional Gaussian TOF-kernel as a special case. Non-Gaussian TOF-kernels are often observed in novel detector designs, which make use of two (or more) different mechanisms to convert the incoming 511 keV photon to optical photons. The analytical result is validated with a simple 2D simulation.Main results.We show that if two different TOF-kernels are equivalent for image reconstruction with known attenuation, then they are also equivalent for joint reconstruction of the activity and the attenuation images. The variance increase in the activity, caused by also jointly reconstructing the attenuation image, vanishes when the TOF-resolution approaches perfection.Significance.These results are of interest for PET detector development and for the development of stand-alone PET systems.

Deep-learning-based methods of attenuation correction for SPECT and PET

Attenuation correction (AC) is essential for quantitative analysis and clinical diagnosis of single-photon emission computed tomography (SPECT) and positron emission tomography (PET). In clinical practice, computed tomography (CT) is utilized to generate attenuation maps (μ-maps) for AC of hybrid SPECT/CT and PET/CT scanners. However, CT-based AC methods frequently produce artifacts due to CT artifacts and misregistration of SPECT-CT and PET-CT scans. Segmentation-based AC methods using magnetic resonance imaging (MRI) for PET/MRI scanners are inaccurate and complicated since MRI does not contain direct information of photon attenuation. Computational AC methods for SPECT and PET estimate attenuation coefficients directly from raw emission data, but suffer from low accuracy, cross-talk artifacts, high computational complexity, and high noise level. The recently evolving deep-learning-based methods have shown promising results in AC of SPECT and PET, which can be generally divided into two categories: indirect and direct strategies. Indirect AC strategies apply neural networks to transform emission, transmission, or MR images into synthetic μ-maps or CT images which are then incorporated into AC reconstruction. Direct AC strategies skip the intermediate steps of generating μ-maps or CT images and predict AC SPECT or PET images from non-attenuation-correction (NAC) SPECT or PET images directly. These deep-learning-based AC methods show comparable and even superior performance to non-deep-learning methods. In this article, we first discussed the principles and limitations of non-deep-learning AC methods, and then reviewed the status and prospects of deep-learning-based methods for AC of SPECT and PET.

International EANM-SNMMI-ISMRM consensus recommendation for PET/MRI in oncology

PREAMBLE

The Society of Nuclear Medicine and Molecular Imaging (SNMMI) is an international scientific and professional organization founded in 1954 to promote the science, technology, and practical application of nuclear medicine. The European Association of Nuclear Medicine (EANM) is a professional non-profit medical association that facilitates communication worldwide between individuals pursuing clinical and research excellence in nuclear medicine. The EANM was founded in 1985. The merged International Society for Magnetic Resonance in Medicine (ISMRM) is an international, nonprofit, scientific association whose purpose is to promote communication, research, development, and applications in the field of magnetic resonance in medicine and biology and other related topics and to develop and provide channels and facilities for continuing education in the field.The ISMRM was founded in 1994 through the merger of the Society of Magnetic Resonance in Medicine and the Society of Magnetic Resonance Imaging. SNMMI, ISMRM, and EANM members are physicians, technologists, and scientists specializing in the research and practice of nuclear medicine and/or magnetic resonance imaging. The SNMMI, ISMRM, and EANM will periodically define new guidelines for nuclear medicine practice to help advance the science of nuclear medicine and/or magnetic resonance imaging and to improve the quality of service to patients throughout the world. Existing practice guidelines will be reviewed for revision or renewal, as appropriate, on their fifth anniversary or sooner, if indicated. Each practice guideline, representing a policy statement by the SNMMI/EANM/ISMRM, has undergone a thorough consensus process in which it has been subjected to extensive review. The SNMMI, ISMRM, and EANM recognize that the safe and effective use of diagnostic nuclear medicine imaging and magnetic resonance imaging requires specific training, skills, and techniques, as described in each document. Reproduction or modification of the published practice guideline by those entities not providing these services is not authorized. These guidelines are an educational tool designed to assist practitioners in providing appropriate care for patients. They are not inflexible rules or requirements of practice and are not intended, nor should they be used, to establish a legal standard of care. For these reasons and those set forth below, the SNMMI, the ISMRM, and the EANM caution against the use of these guidelines in litigation in which the clinical decisions of a practitioner are called into question. The ultimate judgment regarding the propriety of any specific procedure or course of action must be made by the physician or medical physicist in light of all the circumstances presented. Thus, there is no implication that an approach differing from the guidelines, standing alone, is below the standard of care. To the contrary, a conscientious practitioner may responsibly adopt a course of action different from that set forth in the guidelines when, in the reasonable judgment of the practitioner, such course of action is indicated by the condition of the patient, limitations of available resources, or advances in knowledge or technology subsequent to publication of the guidelines. The practice of medicine includes both the art and the science of the prevention, diagnosis, alleviation, and treatment of disease. The variety and complexity of human conditions make it impossible to always reach the most appropriate diagnosis or to predict with certainty a particular response to treatment. Therefore, it should be recognized that adherence to these guidelines will not ensure an accurate diagnosis or a successful outcome. All that should be expected is that the practitioner will follow a reasonable course of action based on current knowledge, available resources, and the needs of the patient to deliver effective and safe medical care. The sole purpose of these guidelines is to assist practitioners in achieving this objective.

A review of PET attenuation correction methods for PET-MR

Despite being thirteen years since the installation of the first PET-MR system, the scanners constitute a very small proportion of the total hybrid PET systems installed. This is in stark contrast to the rapid expansion of the PET-CT scanner, which quickly established its importance in patient diagnosis within a similar timeframe. One of the main hurdles is the development of an accurate, reproducible and easy-to-use method for attenuation correction. Quantitative discrepancies in PET images between the manufacturer-provided MR methods and the more established CT- or transmission-based attenuation correction methods have led the scientific community in a continuous effort to develop a robust and accurate alternative. These can be divided into four broad categories: (i) MR-based, (ii) emission-based, (iii) atlas-based and the (iv) machine learning-based attenuation correction, which is rapidly gaining momentum. The first is based on segmenting the MR images in various tissues and allocating a predefined attenuation coefficient for each tissue. Emission-based attenuation correction methods aim in utilising the PET emission data by simultaneously reconstructing the radioactivity distribution and the attenuation image. Atlas-based attenuation correction methods aim to predict a CT or transmission image given an MR image of a new patient, by using databases containing CT or transmission images from the general population. Finally, in machine learning methods, a model that could predict the required image given the acquired MR or non-attenuation-corrected PET image is developed by exploiting the underlying features of the images. Deep learning methods are the dominant approach in this category. Compared to the more traditional machine learning, which uses structured data for building a model, deep learning makes direct use of the acquired images to identify underlying features. This up-to-date review goes through the literature of attenuation correction approaches in PET-MR after categorising them. The various approaches in each category are described and discussed. After exploring each category separately, a general overview is given of the current status and potential future approaches along with a comparison of the four outlined categories.

A quantitative clinical evaluation of simultaneous reconstruction of attenuation and activity in time-of-flight PET

BACKGROUND

The maximum likelihood activity and attenuation (MLAA) reconstruction algorithm has been proposed to jointly estimate tracer activity and attenuation at the same time, and proven to be a promising solution to the CT attenuation correction (CT-AC) artifacts in PET images. This study aimed to perform a quantitative evaluation and clinical validation of the MLAA method.

METHODS

A uniform cylinder phantom filled with ¹⁸F-FDG solution was scanned to optimize the reconstruction parameters for the implemented MLAA algorithm. 67 patients who underwent whole-body ¹⁸F-FDG PET/CT scan were retrospectively recruited. PET images were reconstructed using MLAA and clinical standard OSEM algorithm with CT-AC (CT-OSEM). The mean and maximum standardized uptake values (SUVmean and SUVmax) in regions of interest (ROIs) of organs, high uptake lesions and areas affected by metal implants and respiration motion artifacts were quantitatively analyzed.

RESULTS

In quantitative analysis, SUVs in patient's organ ROIs between two methods showed R² ranging from 0.91 to 0.98 and k ranging from 0.90 to 1.06, and the average SUVmax and SUVmean differences between two methods were within 10% range, except for the lung ROI, which was 10.5% and 16.73% respectively. The average SUVmax and SUVmean differences of a total of 117 high uptake lesions were 7.25% and 7.10% respectively. 20 patients were identified to have apparent respiration motion artifacts in the liver in CT-OSEM images, and the SUVs differences between two methods measured at dome of the liver were significantly larger than measured at middle part of the liver. 10 regions with obvious metal artifacts were identified in CT-OSEM images and the average SUVmean and SUVmax differences in metal implants affected regions were reported to be 52.90% and 56.20% respectively.

CONCLUSIONS

PET images reconstructed using MLAA are clinically acceptable in terms of image quality as well as quantification and it is a useful tool in clinical practice, especially when CT-AC may cause respiration motion and metal artifacts. Moreover, this study also provides technical reference and data support for the future iteration and development of PET reconstruction technology of SUV accurate quantification.

Joint Estimation of Metal Density and Attenuation Maps with Pencil Beam XFET

X-ray fluorescence emission tomography (XFET) is an emerging imaging modality that images the spatial distribution of metal without requiring biochemical modification or radioactivity. This work investigates the joint estimation of metal and attenuation maps with a pencil-beam XFET system that allows for direct metal measurement in the absence of attenuation. Using singular value decomposition on a simplified imaging model, we show that reconstructing metal and attenuation voxels far from the detector is an ill-conditioned problem. Using simulated data, we develop and compare two image reconstruction methods for joint estimation. The first method alternates between updating the attenuation map with a separable paraboloidal surrogates algorithm and updating the metal map with a closed-form solution. The second method performs simultaneous joint estimation with conjugate gradients based on a linearized imaging model. The alternating approach outperforms the linearized approach for iron and gold numerical phantom reconstructions. Reconstructing an (8 cm)3 object containing gold concentrations of 5 mg/cm3 and an unknown beam attenuation map using the alternating approach yields an accurate gold map (NRMSE = 0.19) and attenuation map (NRMSE = 0.14). This simulation demonstrates an accurate joint reconstruction of metal and attenuation maps, from emission data, without previous knowledge of any attenuation map.

Attenuation Correction for Dedicated Cardiac SPECT Imaging Without Using Transmission Data

Objectives

Attenuation correction (AC) using transmission scanning-like computed tomography (CT) is the standard method to increase the accuracy of cardiac single-photon emission computed tomography (SPECT) images. Recently developed dedicated cardiac SPECT do not support CT, and thus, scans on these systems are vulnerable to attenuation artifacts. This study presented a new method for generating an attenuation map directly from emission data by segmentation of precisely non-rigid registration extended cardiac-torso (XCAT)-digital phantom with cardiac SPECT images.

Methods

In-house developed non-rigid registration algorithm automatically aligns the XCAT- phantom with cardiac SPECT image to precisely segment the contour of organs. Pre-defined attenuation coefficients for given photon energies were assigned to generate attenuation maps. The CT-based attenuation maps were used for validation with which cardiac SPECT/CT data of 38 patients were included. Segmental myocardial counts of a 17-segment model from these databases were compared based on the basis of the paired t-test.

Results

The mean, and standard deviation of the mean square error and structural similarity index measure of the female stress phase between the proposed attenuation maps and the CT attenuation maps were 6.99±1.23% and 92±2.0%, of the male stress were 6.87±3.8% and 96±1.0%. Proposed attenuation correction and computed tomography based attenuation correction average myocardial perfusion count was significantly higher than that in non-AC in the mid-inferior, mid-lateral, basal-inferior, and lateral regions (p<0.001).

Conclusion

The proposed attenuation maps showed good agreement with the CT-based attenuation map. Therefore, it is feasible to enable AC for a dedicated cardiac SPECT or SPECT standalone scanners.

Joint motion estimation and penalized image reconstruction algorithm with anatomical priors for gated TOF-PET/CT

The presence of respiratory motion not only degrades the reconstructed image but also limits the utilization of anatomical priors in emission tomography. In this study, we explore the potential application of a joint motion estimation and penalized image reconstruction algorithm using anatomical priors in gated time-of-flight positron emission tomography/computed tomography (PET/CT). The algorithm is able to warp both the activity image and the attenuation map to align them with the measured data with the facilitation of anatomical information contained in the attenuation map. Five patient datasets, three acquired in single-bed position and two acquired in whole-body continuous-bed-motion mode, are included. For each patient, the attenuation map is derived from a breath-hold CT. The Parallel Levels Sets (PLS) is chosen as a representative anatomical prior. In addition to demonstrating the reliability of the estimated motion and the benefits of incorporating anatomical prior, preliminary results also indicate that the algorithm shows the potential to reconstruct an activity image in the space corresponding to that of the attenuation map, which could be applied to address the potential misalignment issue in applications involving multiple PET acquisitions but a single CT.

Feature-based Quality Assessment of Middle Cerebral Artery Occlusion Using 18F-Fluorodeoxyglucose Positron Emission Tomography

In animal experiments, ischemic stroke is usually induced through middle cerebral artery occlusion (MCAO), and quality assessment of this procedure is crucial. However, an accurate assessment method based on 18F-fluorodeoxyglucose (FDG) positron emission tomography (PET) is still lacking. The difficulty lies in the inconsistent preprocessing pipeline, biased intensity normalization, or unclear spatiotemporal uptake of FDG. Here, we propose an image feature-based protocol to assess the quality of the procedure using a 3D scale-invariant feature transform and support vector machine. This feature-based protocol provides a convenient, accurate, and reliable tool to assess the quality of the MCAO procedure in FDG PET studies. Compared with existing approaches, the proposed protocol is fully quantitative, objective, automatic, and bypasses the intensity normalization step. An online interface was constructed to check images and obtain assessment results.

Attenuation Coefficient Estimation for PET/MRI With Bayesian Deep Learning Pseudo-CT and Maximum-Likelihood Estimation of Activity and Attenuation

A major remaining challenge for magnetic resonance-based attenuation correction methods (MRAC) is their susceptibility to sources of magnetic resonance imaging (MRI) artifacts (e.g., implants and motion) and uncertainties due to the limitations of MRI contrast (e.g., accurate bone delineation and density, and separation of air/bone). We propose using a Bayesian deep convolutional neural network that in addition to generating an initial pseudo-CT from MR data, it also produces uncertainty estimates of the pseudo-CT to quantify the limitations of the MR data. These outputs are combined with the maximum-likelihood estimation of activity and attenuation (MLAA) reconstruction that uses the PET emission data to improve the attenuation maps. With the proposed approach uncertainty estimation and pseudo-CT prior for robust MLAA (UpCT-MLAA), we demonstrate accurate estimation of PET uptake in pelvic lesions and show recovery of metal implants. In patients without implants, UpCT-MLAA had acceptable but slightly higher root-mean-squared-error (RMSE) than Zero-echotime and Dixon Deep pseudo-CT when compared to CTAC. In patients with metal implants, MLAA recovered the metal implant; however, anatomy outside the implant region was obscured by noise and crosstalk artifacts. Attenuation coefficients from the pseudo-CT from Dixon MRI were accurate in normal anatomy; however, the metal implant region was estimated to have attenuation coefficients of air. UpCT-MLAA estimated attenuation coefficients of metal implants alongside accurate anatomic depiction outside of implant regions.

Evaluation of three methods for delineation and attenuation estimation of the sinus region in MR-based attenuation correction for brain PET-MR imaging

Background

Attenuation correction is crucial in quantitative positron emission tomography-magnetic resonance (PET-MRI) imaging. We evaluated three methods to improve the segmentation and modelling of the attenuation coefficients in the nasal sinus region. Two methods (cuboid and template method) included a MRI-CT conversion model for assigning the attenuation coefficients in the nasal sinus region, whereas one used fixed attenuation coefficient assignment (bulk method).

Methods

The study population consisted of data of 10 subjects which had undergone PET-CT and PET-MRI. PET images were reconstructed with and without time-of-flight (TOF) using CT-based attenuation correction (CTAC) as reference. Comparison was done visually, using DICE coefficients, correlation, analyzing attenuation coefficients, and quantitative analysis of PET and bias atlas images.

Results

The median DICE coefficients were 0.824, 0.853, 0.849 for the bulk, cuboid and template method, respectively. The median attenuation coefficients were 0.0841 cm⁻¹, 0.0876 cm⁻¹, 0.0861 cm⁻¹ and 0.0852 cm⁻¹, for CTAC, bulk, cuboid and template method, respectively. The cuboid and template methods showed error of less than 2.5% in attenuation coefficients. An increased correlation to CTAC was shown with the cuboid and template methods. In the regional analysis, improvement in at least 49% and 80% of VOI was seen with non-TOF and TOF imaging. All methods showed errors less than 2.5% in non-TOF and less than 2% in TOF reconstructions.

Conclusions

We evaluated two proof-of-concept methods for improving quantitative accuracy in PET/MRI imaging and showed that bias can be further reduced by inclusion of TOF. Largest improvements were seen in the regions of olfactory bulb, Heschl's gyri, lingual gyrus and cerebellar vermis. However, the overall effect of inclusion of the sinus region as separate class in MRAC to PET quantification in the brain was considered modest.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12880-022-00770-0.

Initial evaluation of a new maximum-likelihood attenuation correction factor-based attenuation correction for time-of-flight brain PET

AIM

The aim of this study was to evaluate an image reconstruction algorithm, including a new maximum-likelihood attenuation correction factor (ML-ACF) for time of flight (TOF) brain positron emission tomography (PET).

METHODS

The implemented algorithm combines an ML-ACF method that simultaneously estimates both the emission image and attenuation sinogram from TOF emission data, and a scaling method based on anatomical features. To evaluate the algorithm's quantitative accuracy, three-dimensional brain phantom images were acquired and soft-tissue attenuation coefficients and emission values were analyzed.

RESULTS

The heterogeneous distributions of attenuation coefficients in soft tissue, skull, and nasal cavity were sufficiently visualized. The attenuation coefficient of soft tissue remained within 5% of theoretical value. Attenuation-corrected emission showed no lateral differences, and significant differences among soft tissue were within the error range.

CONCLUSION

The ML-ACF-based attenuation correction implemented for TOF brain PET worked well and obtained practical levels of accuracy.

MR-based truncation correction using an advanced HUGE method to improve attenuation correction in PET/MR imaging of obese patients

PURPOSE

Truncation artifacts in the periphery of the magnetic resonance (MR) field-of-view (FOV) and thus, in the MR-based attenuation correction (AC) map, may hamper accurate positron emission tomography (PET) quantification in whole-body PET/MR, which is especially problematic in patients with obesity with overall large body dimensions. Therefore, an advanced truncation correction (TC) method to extend the conventional MR FOV is needed.

METHODS

The extent of MR-based AC-map truncations in obese patients was determined in a data set including n  =  10 patients that underwent whole-body PET/MR exams. Patient inclusion criteria were defined as BMI > 30 kg/m² and body weight > 100 kg. Truncations in PET/MR patients with obesity were quantified comparing the MR-based AC-map volume to segmented non-AC PET data, serving as the reference body volume without truncations to demonstrate the need of improved TC. The new method implemented in this study, termed "advanced HUGE", was modified and extended from the original HUGE method by Blumhagen et al. in order to provide improved TC across the entire axial MR FOV and to unlock new clinical applications of PET/MR. Advanced HUGE was then systematically tested in PET/MR NEMA phantom measurements. Relative differences between computed tomography (CT) AC PET data of the phantom setup (reference) and MR-based Dixon AC, respectively Dixon + advanced HUGE AC, were calculated. The applicability of the method for advanced TC was then demonstrated in first MR-based measurements in healthy volunteers.

RESULTS

It was found that the MR-based AC maps of obese patients often reveal truncations in anterior-posterior direction. Especially the abdominal region could benefit from improved TC, where maximal relative differences in the AC-map volume up to -17 % were calculated. Applying advanced HUGE to improve the MR-based AC in PET/MR, PET quantification errors in the large-volume phantom setup could be considerably reduced from average -18.6 % (Dixon AC) to 4.6 % compared to the CT AC reference. Volunteer measurements demonstrate that formerly missing AC-map volume in the Dixon-VIBE AC-map could be added due to advanced HUGE in anterior-posterior direction and thus, potentially improves AC in PET/MR.

CONCLUSIONS

The advanced HUGE method for truncation correction considerably reduces truncations in anterior-posterior direction demonstrated in phantom measurements and healthy volunteers and thus, further improves MR-based AC in PET/MR imaging. This article is protected by copyright. All rights reserved.

Lutetium background radiation in total-body PET-A simulation study on opportunities and challenges in PET attenuation correction

The current generation of total-body positron emission tomography (PET) scanners offer significant sensitivity increase with an extended axial imaging extent. With the large volume of lutetium-based scintillation crystals that are used as detector elements in these scanners, there is an increased flux of background radiation originating from ¹⁷⁶Lu decay in the crystals and higher sensitivity for detecting it. Combined with the ability of scanning the entire body in a single bed position, this allows more effective utilization of the lutetium background as a transmission source for estimating 511 keV attenuation coefficients. In this study, utilization of the lutetium background radiation for attenuation correction in total-body PET was studied using Monte Carlo simulations of a 3D whole-body XCAT phantom in the uEXPLORER PET scanner, with particular focus on ultralow-dose PET scans that are now made possible with these scanners. Effects of an increased acceptance angle, reduced scan durations, and Compton scattering on PET quantification were studied. Furthermore, quantification accuracy of lutetium-based attenuation correction was compared for a 20-min scan of the whole body on the uEXPLORER, a one-meter-long, and a conventional 24-cm-long scanner. Quantification and lesion contrast were minimally affected in both long axial field-of-view scanners and in a whole-body 20-min scan, the mean bias in all analyzed organs of interest were within a ±10% range compared to ground-truth activity maps. Quantification was affected in certain organs, when scan duration was reduced to 5 min or a reduced acceptance angle of 17° was used. Analysis of the Compton scattered events suggests that implementing a scatter correction method for the transmission data will be required, and increasing the energy threshold from 250 keV to 290 keV can reduce the computational costs and data rates, with negligible effects on PET quantification. Finally, the current results can serve as groundwork for transferring lutetium-based attenuation correction into research and clinical practice.

PET/CT and PET/MR Imaging of the Post-treatment Head and Neck: Traps and Tips

PET/computed tomography and PET/MR imaging are used to evaluate the post-treatment neck. Although 18F-FDG is helpful in the staging and treatment response assessment of head and neck cancer, recently developed PET radiotracers targeting specific surface markers are promising for applications of diagnostic problem solving and improved extent delineation. Diffusion-weighted MR imaging is helpful in the differential diagnosis of head and neck neoplasms, and improves the sensitivity and specificity for the detection of certain pathologies. Following standardized imaging parameters for PET/computed tomography and diffusion-weighted imaging in PET/MR imaging improves diagnostic accuracy and allows for future research data mining.

A CT-less approach to quantitative PET imaging using the LSO intrinsic radiation for long-axial FOV PET scanners

Purpose

Long‐axial field‐of‐view (FOV) positron emission tomography (PET) scanners have gained a lot of interest in the recent years. Such scanners provide increased sensitivity and enable unique imaging opportunities that were not previously feasible. Benefiting from the high sensitivity of a long‐axial FOV PET scanner, we studied a computed tomography (CT)–less reconstruction algorithm for the Siemens Biograph Vision Quadra with an axial FOV of 106 cm.

Methods

In this work, the background radiation from radioisotope lutetium‐176 in the scintillators was used to create an initial estimate of the attenuation maps. Then, joint activity and attenuation reconstruction algorithms were used to create an improved attenuation map of the object. The final attenuation maps were then used to reconstruct quantitative PET images, which were compared against CT‐based PET images. The proposed method was evaluated on data from three patients who underwent a flurodeoxyglucouse PET scan.

Results

Segmentation of the PET images of the three studied patients showed an average quantitative error of 6.5%–8.3% across all studied organs when using attenuation maps from maximum likelihood estimation of attenuation and activity and 5.3%–6.6% when using attenuation maps from maximum likelihood estimation of activity and attenuation correction coefficients.

Conclusions

Benefiting from the background radiation of lutetium‐based scintillators, a quantitative CT‐less PET imaging technique was evaluated in this work.

Convolutional neural network based attenuation correction for123I-FP-CIT SPECT with focused striatum imaging

SPECT imaging with¹²³I-FP-CIT is used for diagnosis of neurodegenerative disorders like Parkinson's disease. Attenuation correction (AC) can be useful for quantitative analysis of¹²³I-FP-CIT SPECT. Ideally, AC would be performed based on attenuation maps (μ-maps) derived from perfectly registered CT scans. Suchμ-maps, however, are most times not available and possible errors in image registration can induce quantitative inaccuracies in AC corrected SPECT images. Earlier, we showed that a convolutional neural network (CNN) based approach allows to estimate SPECT-alignedμ-maps for full brain perfusion imaging using only emission data. Here we investigate the feasibility of similar CNN methods for axially focused¹²³I-FP-CIT scans. We tested our approach on a high-resolution multi-pinhole prototype clinical SPECT system in a Monte Carlo simulation study. Three CNNs that estimateμ-maps in a voxel-wise, patch-wise and image-wise manner were investigated. As the added value of AC on clinical¹²³I-FP-CIT scans is still debatable, the impact of AC was also reported to check in which cases CNN based AC could be beneficial. AC using the ground truthμ-maps (GT-AC) and CNN estimatedμ-maps (CNN-AC) were compared with the case when no AC was done (No-AC). Results show that the effect of using GT-AC versus CNN-AC or No-AC on striatal shape and symmetry is minimal. Specific binding ratios (SBRs) from localized regions show a deviation from GT-AC≤2.5% for all three CNN-ACs while No-AC systematically underestimates SBRs by 13.1%. A strong correlation (r≥0.99) was obtained between GT-AC based SBRs and SBRs from CNN-ACs and No-AC. Absolute quantification (in kBq ml^-1) shows a deviation from GT-AC within 2.2% for all three CNN-ACs and of 71.7% for No-AC. To conclude, all three CNNs show comparable performance in accurateμ-map estimation and¹²³I-FP-CIT quantification. CNN-estimatedμ-map can be a promising substitute for CT-basedμ-map.

Pitfalls on PET/CT Due to Artifacts and Instrumentation

PET/CT has become a preferred imaging modality over PET-only scanners in clinical practice. However, along with the significant improvement in diagnostic accuracy and patient throughput, pitfalls on PET/CT are reported as well. This review provides a general overview on the potential influence of the limitations with respect to PET/CT instrumentation and artifacts associated with the modality integration on the image appearance and quantitative accuracy of PET. Approaches proposed in literature to address the limitations or minimize the artifacts are discussed as well as their current challenges for clinical applications. Although the CT component can play an important role in assisting clinical diagnosis, we concentrate on the imaging scenarios where CT is used to provide auxiliary information for attenuation compensation and scatter correction in PET.

Deep learning-based T1-enhanced selection of linear attenuation coefficients (DL-TESLA) for PET/MR attenuation correction in dementia neuroimaging

PURPOSE

The accuracy of existing PET/MR attenuation correction (AC) has been limited by a lack of correlation between MR signal and tissue electron density. Based on our finding that longitudinal relaxation rate, or R1 , is associated with CT Hounsfield unit in bone and soft tissues in the brain, we propose a deep learning T1 -enhanced selection of linear attenuation coefficients (DL-TESLA) method to incorporate quantitative R1 for PET/MR AC and evaluate its accuracy and longitudinal test-retest repeatability in brain PET/MR imaging.

METHODS

DL-TESLA uses a 3D residual UNet (ResUNet) for pseudo-CT (pCT) estimation. With a total of 174 participants, we compared PET AC accuracy of DL-TESLA to 3 other methods adopting similar 3D ResUNet structures but using UTE R 2 ∗ , or Dixon, or T1 -MPRAGE as input. With images from 23 additional participants repeatedly scanned, the test-retest differences and within-subject coefficient of variation of standardized uptake value ratios (SUVR) were compared between PET images reconstructed using either DL-TESLA or CT for AC.

RESULTS

DL-TESLA had (1) significantly lower mean absolute error in pCT, (2) the highest Dice coefficients in both bone and air, (3) significantly lower PET relative absolute error in whole brain and various brain regions, (4) the highest percentage of voxels with a PET relative error within both ±3% and ±5%, (5) similar to CT test-retest differences in SUVRs from the cerebrum and mean cortical (MC) region, and (6) similar to CT within-subject coefficient of variation in cerebrum and MC.

CONCLUSION

DL-TESLA demonstrates excellent PET/MR AC accuracy and test-retest repeatability.

(An overview of) Synergistic reconstruction for multimodality/multichannel imaging methods

Imaging is omnipresent in modern society with imaging devices based on a zoo of physical principles, probing a specimen across different wavelengths, energies and time. Recent years have seen a change in the imaging landscape with more and more imaging devices combining that which previously was used separately. Motivated by these hardware developments, an ever increasing set of mathematical ideas is appearing regarding how data from different imaging modalities or channels can be synergistically combined in the image reconstruction process, exploiting structural and/or functional correlations between the multiple images. Here we review these developments, give pointers to important challenges and provide an outlook as to how the field may develop in the forthcoming years. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 1'.

Pitfalls on PET/MRI

A decade of PET/MRI clinical imaging has passed and many of the pitfalls are similar to those on earlier studies. However, techniques to overcome them have emerged and continue to develop. Although clinically significant lung nodules are demonstrable, smaller nodules may be detected using ultrashort/zero echo-time (TE) lung MRI. Fast reconstruction ultrashort TE sequences have also been used to achieve high-resolution lung MRI even with free-breathing. The introduction and improvement of time-of-flight scanners and increasing the axial length of the PET detector arrays have more than doubled the sensitivity of the PET part of the system. MRI for attenuation correction has provided many potential pitfalls, including misclassification of tissue classes based on MRI information for attenuation correction. Although the use of short echo times have helped to address these pitfalls, one of the most exciting developments has been the use of deep learning algorithms and computational neural networks to rapidly provide soft tissue, fat, bone and air information for the attenuation correction as a supplement to the attenuation correction information from fat-water imaging. Challenges with motion correction, particularly respiratory and cardiac remain but are being addressed with respiratory monitors and using PET data. In order to address truncation artefacts, the system manufacturers have developed methods to extend the MR field-of-view for the purpose of the attenuation and scatter corrections. General pitfalls like stitching of body sections for individual studies, optimum delivery of images for viewing and reporting, and resource implications for the sheer volume of data generated remain Methods to overcome these pitfalls serve as a strong foundation for the future of PET/MRI. Advances in the underlying technology with significant evolution in hard-ware and software and the exiting developments in use of deep learning algorithms and computational neural networks will drive the next decade of PET/MRI imaging.

A physics and learning-based transmission-less attenuation compensation method for SPECT

Attenuation compensation (AC) is a pre-requisite for reliable quantification and beneficial for visual interpretation tasks in single-photon emission computed tomography (SPECT). Typical AC methods require the availability of an attenuation map, which is obtained using a transmission scan, such as a CT scan. This has several disadvantages such as increased radiation dose, higher costs, and possible misalignment between SPECT and CT scans. Also, often a CT scan is unavailable. In this context, we and others are showing that scattered photons in SPECT contain information to estimate the attenuation distribution. To exploit this observation, we propose a physics and learning-based method that uses the SPECT emission data in the photopeak and scatter windows to perform transmission-less AC in SPECT. The proposed method uses data acquired in the scatter window to reconstruct an initial estimate of the attenuation map using a physics-based approach. A convolutional neural network is then trained to segment this initial estimate into different regions. Pre-defined attenuation coefficients are assigned to these regions, yielding the reconstructed attenuation map, which is then used to reconstruct the activity distribution using an ordered subsets expectation maximization (OSEM)-based reconstruction approach. We objectively evaluated the performance of this method using highly realistic simulation studies conducted on the clinically relevant task of detecting perfusion defects in myocardial perfusion SPECT. Our results showed no statistically significant differences between the performance achieved using the proposed method and that with the true attenuation maps. Visually, the images reconstructed using the proposed method looked similar to those with the true attenuation map. Overall, these results provide evidence of the capability of the proposed method to perform transmission-less AC and motivate further evaluation.

A Role of PET/MR Imaging in Dementia?

Since many years, magnetic resonance imaging (MRI) and positron emission tomography (PET) have a prominent role in neurodegenerative disorders and dementia, not only in a research setting but also in a clinical setting. For several decades, information from both modalities is combined ranging from individual visual assessments to fully integrating all images. Several tools are available to coregister images from MRI and PET and to covisualize these images. When studying neurodegenerative disorders with PET it is important to perform a partial volume correction and this can be done using the structural information obtained by MRI. With the advent of PET/MR, the question arises in how far this hybrid imaging modality is an added value compared to combining PET and MRI data from two separate modalities. One issue in PET/MR is still not yet completely settled, that is, the attenuation correction. This is of less importance for visual assessments but it can become an issue when combining data from PET/CT and PET/MR scanners in multicenter studies or when using cut-off values to classify patients. Simultaneous imaging has clearly some advantages: for the patient it is beneficial to have only one scan session instead of two but also in cases in which PET data are related to functional of physiological data acquired with MRI (such as functional MRI or arterial spin labeling). However, the most important benefit is currently the more integrated use of PET and MRI. This is also possible with separate measurements but requires more streamlining of the whole process. In that case coregistration of images is mandatory. It needs to be determined in which cases simultaneous PET/MRI leads to new insights or improved diagnosis compared to multimodal imaging using dedicated scanners.

Practical joint reconstruction of activity and attenuation with autonomous scaling for time-of-flight PET

Recent research has showed that attenuation images can be determined from emission data, jointly with activity images, up to a scaling constant when utilizing the time-of-flight (TOF) information. We aim to develop practical CT-less joint reconstruction for clinical TOF PET scanners to obtain quantitatively accurate activity and attenuation images. In this work, we present a joint reconstruction of activity and attenuation based on MLAA (maximum likelihood reconstruction of attenuation and activity) with autonomous scaling determination and joint TOF scatter estimation from TOF PET data. Our idea for scaling is to use a selected volume of interest (VOI) in a reconstructed attenuation image with known attenuation, e.g. a liver in patient imaging. First, we construct a unit attenuation medium which has a similar, though not necessarily the same, support to the imaged emission object. All detectable LORs intersecting the unit medium have an attenuation factor of e -1≈ 0.3679, i.e. the line integral of linear attenuation coefficients is one. The scaling factor can then be determined from the difference between the reconstructed attenuation image and the known attenuation within the selected VOI normalized by the unit attenuation medium. A four-step iterative joint reconstruction algorithm is developed. In each iteration, (1) first the activity is updated using TOF OSEM from TOF list-mode data; (2) then the attenuation image is updated using XMLTR-a extended MLTR from non-TOF LOR sinograms; (3) a scaling factor is determined based on the selected VOI and both activity and attenuation images are updated using the estimated scaling; and (4) scatter is estimated using TOF single scatter simulation with the jointly reconstructed activity and attenuation images. The performance of joint reconstruction is studied using simulated data from a generic whole-body clinical TOF PET scanner and a long axial FOV research PET scanner as well as 3D experimental data from the PennPET Explorer scanner. We show that the proposed joint reconstruction with proper autonomous scaling provides low bias results comparable to the reference reconstruction with known attenuation.

PET-enabled dual-energy CT: image reconstruction and a proof-of-concept computer simulation study

Standard dual-energy computed tomography (CT) uses two different x-ray energies to obtain energy-dependent tissue attenuation information to allow quantitative material decomposition. The combined use of dual-energy CT and positron emission tomography (PET) may provide a more comprehensive characterization of disease states in cancer and other diseases. However, the integration of dual-energy CT with PET is not trivial, either requiring costly hardware upgrades or increasing radiation exposure. This paper proposes a different dual-energy CT imaging method that is enabled by PET. Instead of using a second x-ray CT scan with a different energy, this method exploits time-of-flight PET image reconstruction via the maximum likelihood attenuation and activity (MLAA) algorithm to obtain a 511 keV gamma-ray attenuation image from PET emission data. The high-energy gamma-ray attenuation image is then combined with the low-energy x-ray CT of PET/CT to provide a pair of dual-energy CT images. A major challenge with the standard MLAA reconstruction is the high noise present in the reconstructed 511 keV attenuation map, which would not compromise the PET activity reconstruction too much but may significantly affect the performance of the gamma-ray attenuation image for material decomposition. To overcome the problem, we further propose a kernel MLAA algorithm to exploit the prior information from the available x-ray CT image. We conducted a computer simulation to test the concept and algorithm for the task of material decomposition. The simulation results demonstrate that this PET-enabled dual-energy CT method is promising for quantitative material decomposition. The proposed method can be readily implemented on time-of-flight PET/CT scanners to enable simultaneous PET and dual-energy CT imaging.

Attenuation correction for human PET/MRI studies

Attenuation correction has been one of the main methodological challenges in the integrated positron emission tomography and magnetic resonance imaging (PET/MRI) field. As standard transmission or computed tomography approaches are not available in integrated PET/MRI scanners, MR-based attenuation correction approaches had to be developed. Aspects that have to be considered for implementing accurate methods include the need to account for attenuation in bone tissue, normal and pathological lung and the MR hardware present in the PET field-of-view, to reduce the impact of subject motion, to minimize truncation and susceptibility artifacts, and to address issues related to the data acquisition and processing both on the PET and MRI sides. The standard MR-based attenuation correction techniques implemented by the PET/MRI equipment manufacturers and their impact on clinical and research PET data interpretation and quantification are first discussed. Next, the more advanced methods, including the latest generation deep learning-based approaches that have been proposed for further minimizing the attenuation correction related bias are described. Finally, a future perspective focused on the needed developments in the field is given.

Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation

Multimodal fusion in neuroimaging combines data from multiple imaging modalities to overcome the fundamental limitations of individual modalities. Neuroimaging fusion can achieve higher temporal and spatial resolution, enhance contrast, correct imaging distortions, and bridge physiological and cognitive information. In this study, we analyzed over 450 references from PubMed, Google Scholar, IEEE, ScienceDirect, Web of Science, and various sources published from 1978 to 2020. We provide a review that encompasses (1) an overview of current challenges in multimodal fusion (2) the current medical applications of fusion for specific neurological diseases, (3) strengths and limitations of available imaging modalities, (4) fundamental fusion rules, (5) fusion quality assessment methods, and (6) the applications of fusion for atlas-based segmentation and quantification. Overall, multimodal fusion shows significant benefits in clinical diagnosis and neuroscience research. Widespread education and further research amongst engineers, researchers and clinicians will benefit the field of multimodal neuroimaging.

Fisher information analysis of list-mode SPECT emission data for joint estimation of activity and attenuation distribution

The potential to perform attenuation and scatter compensation (ASC) in single-photon emission computed tomography (SPECT) imaging without a separate transmission scan is highly significant. In this context, attenuation in SPECT is primarily due to Compton scattering, where the probability of Compton scatter is proportional to the attenuation coefficient of the tissue and the energy of the scattered photon and the scattering angle are related. Based on this premise, we investigated whether the SPECT scattered-photon data acquired in list-mode (LM) format and including the energy information can be used to estimate the attenuation map. For this purpose, we propose a Fisher-information-based method that yields the Cramer-Rao bound (CRB) for the task of jointly estimating the activity and attenuation distribution using only the SPECT emission data. In the process, a path-based formalism to process the LM SPECT emission data, including the scattered-photon data, is proposed. The Fisher information method was implemented on NVIDIA graphics processing units (GPU) for acceleration. The method was applied to analyze the information content of SPECT LM emission data, which contains up to first-order scattered events, in a simulated SPECT system with parameters modeling a clinical system using realistic computational studies with 2-D digital synthetic and anthropomorphic phantoms. The method was also applied to LM data containing up to second-order scatter for a synthetic phantom. Experiments with anthropomorphic phantoms simulated myocardial perfusion and dopamine transporter (DaT)-Scan SPECT studies. The results show that the CRB obtained for the attenuation and activity coefficients was typically much lower than the true value of these coefficients. An increase in the number of detected photons yielded lower CRB for both the attenuation and activity coefficients. Further, we observed that systems with better energy resolution yielded a lower CRB for the attenuation coefficient. Overall, the results provide evidence that LM SPECT emission data, including the scattered photons, contains information to jointly estimate the activity and attenuation coefficients.

PET/MRI of atherosclerosis

Myocardial infarction and stroke are the most prevalent global causes of death. Each year 15 million people worldwide die due to myocardial infarction or stroke. Rupture of a vulnerable atherosclerotic plaque is the main underlying cause of stroke and myocardial infarction. Key features of a vulnerable plaque are inflammation, a large lipid-rich necrotic core (LRNC) with a thin or ruptured overlying fibrous cap, and intraplaque hemorrhage (IPH). Noninvasive imaging of these features could have a role in risk stratification of myocardial infarction and stroke and can potentially be utilized for treatment guidance and monitoring. The recent development of hybrid PET/MRI combining the superior soft tissue contrast of MRI with the opportunity to visualize specific plaque features using various radioactive tracers, paves the way for comprehensive plaque imaging. In this review, the use of hybrid PET/MRI for atherosclerotic plaque imaging in carotid and coronary arteries is discussed. The pros and cons of different hybrid PET/MRI systems are reviewed. The challenges in the development of PET/MRI and potential solutions are described. An overview of PET and MRI acquisition techniques for imaging of atherosclerosis including motion correction is provided, followed by a summary of vessel wall imaging PET/MRI studies in patients with carotid and coronary artery disease. Finally, the future of imaging of atherosclerosis with PET/MRI is discussed.

Intrascanner Reproducibility of an SPM-based Head MR-based Attenuation Correction Method

Recently, an exhaustive examination of 11 state of the art MR-based attenuation correction (AC) concluded that there are currently a few methods showing similar results compared to the gold-standard, CT-based AC. While the study presented a thorough portfolio of metrics to quantify accuracy (bias) and quality, it lacked one of the most important metrics to quantify robustness that is critical for its clinical applicability: intrascanner reproducibility (repeatability). In this work, we provide for the first time a study of the repeatability of one of the outperforming brain MR-based AC methods: the SPM-based pseudo-CT approach. 22 subjects undergoing 3 ¹⁸F-FDG PET/MRI visits within 2 months were retrospectively analyzed in this study. Pseudo-CT mu-maps were obtained from the coregistered MR images for all 3 visits and the PET data from visit 1 was reconstructed using all three mu-maps. Relative changes (RC), Intraclass correlation coefficient (ICC), Reproducibility coefficient (RDC_95%) and Bland-Altman Limits of Agreement (LoA) were used to measure repeatability. Voxel-based and ROI-based results showed that absolute RC for the reconstructed PET images are within ~2%. The brain cortex and the cerebellum were the regions with the largest variability (~3%). The differences across visits were not statistically significant (p=0.90). In conclusion this study shows for the first time the repeatability of the SPM-based pseudo-CT approach for brain MR-AC. These results, in addition to the ease of implementation and the quality and robustness previously demonstrated, confer this SPM-based method an ideal candidate for routine brain PET/MRI research and clinical studies.

What scans we will read: imaging instrumentation trends in clinical oncology

Oncological diseases account for a significant portion of the burden on public healthcare systems with associated costs driven primarily by complex and long-lasting therapies. Through the visualization of patient-specific morphology and functional-molecular pathways, cancerous tissue can be detected and characterized non-invasively, so as to provide referring oncologists with essential information to support therapy management decisions. Following the onset of stand-alone anatomical and functional imaging, we witness a push towards integrating molecular image information through various methods, including anato-metabolic imaging (e.g., PET/CT), advanced MRI, optical or ultrasound imaging.This perspective paper highlights a number of key technological and methodological advances in imaging instrumentation related to anatomical, functional, molecular medicine and hybrid imaging, that is understood as the hardware-based combination of complementary anatomical and molecular imaging. These include novel detector technologies for ionizing radiation used in CT and nuclear medicine imaging, and novel system developments in MRI and optical as well as opto-acoustic imaging. We will also highlight new data processing methods for improved non-invasive tissue characterization. Following a general introduction to the role of imaging in oncology patient management we introduce imaging methods with well-defined clinical applications and potential for clinical translation. For each modality, we report first on the status quo and, then point to perceived technological and methodological advances in a subsequent status go section. Considering the breadth and dynamics of these developments, this perspective ends with a critical reflection on where the authors, with the majority of them being imaging experts with a background in physics and engineering, believe imaging methods will be in a few years from now.Overall, methodological and technological medical imaging advances are geared towards increased image contrast, the derivation of reproducible quantitative parameters, an increase in volume sensitivity and a reduction in overall examination time. To ensure full translation to the clinic, this progress in technologies and instrumentation is complemented by advances in relevant acquisition and image-processing protocols and improved data analysis. To this end, we should accept diagnostic images as "data", and - through the wider adoption of advanced analysis, including machine learning approaches and a "big data" concept - move to the next stage of non-invasive tumour phenotyping. The scans we will be reading in 10 years from now will likely be composed of highly diverse multi-dimensional data from multiple sources, which mandate the use of advanced and interactive visualization and analysis platforms powered by Artificial Intelligence (AI) for real-time data handling by cross-specialty clinical experts with a domain knowledge that will need to go beyond that of plain imaging.

Effect of attenuation mismatches in time of flight PET reconstruction

While the pursuit of better time resolution in positron emission tomography (PET) is rapidly evolving, little work has been performed on time of flight (TOF) image quality at high time resolution in the presence of modelling inconsistencies. This works focuses on the effect of using the wrong attenuation map in the system model, causing perturbations in the reconstructed radioactivity image. Previous work has usually considered the effects to be local to the area where there is attenuation mismatch, and has shown that the quantification errors in this area tend to reduce with improved time resolution. This publication shows however that errors in the PET image at a distance from the mismatch increase with time resolution. The errors depend on the reconstruction algorithm used. We quantify the errors in the hypothetical case of perfect time resolution for maximum likelihood reconstructions. In addition, we perform reconstructions on simulated and patient data. In particular, for respiratory-gated reconstructions from a wrong attenuation map, increased errors are observed with improved time resolutions in areas close to the lungs (e.g. from 13.3% in non-TOF to up to 20.9% at 200 ps in the left ventricle).

Deep learning-based attenuation map generation for myocardial perfusion SPECT

PURPOSE

Attenuation correction using CT transmission scanning increases the accuracy of single-photon emission computed tomography (SPECT) and enables quantitative analysis. Current existing SPECT-only systems normally do not support transmission scanning and therefore scans on these systems are susceptible to attenuation artifacts. Moreover, the use of CT scans also increases radiation dose to patients and significant artifacts can occur due to the misregistration between the SPECT and CT scans as a result of patient motion. The purpose of this study is to develop an approach to estimate attenuation maps directly from SPECT emission data using deep learning methods.

METHODS

Both photopeak window and scatter window SPECT images were used as inputs to better utilize the underlying attenuation information embedded in the emission data. The CT-based attenuation maps were used as labels with which cardiac SPECT/CT images of 65 patients were included for training and testing. We implemented and evaluated deep fully convolutional neural networks using both standard training and training using an adversarial strategy.

RESULTS

The synthetic attenuation maps were qualitatively and quantitatively consistent with the CT-based attenuation map. The globally normalized mean absolute error (NMAE) between the synthetic and CT-based attenuation maps were 3.60% ± 0.85% among the 25 testing subjects. The SPECT reconstructed images corrected using the CT-based attenuation map and synthetic attenuation map are highly consistent. The NMAE between the reconstructed SPECT images that were corrected using the synthetic and CT-based attenuation maps was 0.26% ± 0.15%, whereas the localized absolute percentage error was 1.33% ± 3.80% in the left ventricle (LV) myocardium and 1.07% ± 2.58% in the LV blood pool.

CONCLUSION

We developed a deep convolutional neural network to estimate attenuation maps for SPECT directly from the emission data. The proposed method is capable of generating highly reliable attenuation maps to facilitate attenuation correction for SPECT-only scanners for myocardial perfusion imaging.

Evaluation of improved attenuation correction in whole-body PET/MR on patients with bone metastasis using various radiotracers

Purpose

This study evaluates the quantitative effect of improved MR-based attenuation correction (AC), including bone segmentation and the HUGE method for truncation correction in PET/MR whole-body hybrid imaging specifically of oncologic patients with bone metastasis and using various radiotracers.

Methods

Twenty-three patients that underwent altogether 28 whole-body PET/MR examinations with findings of bone metastasis were included in this study. Different radiotracers (¹⁸F-FDG, ⁶⁸Ga-PSMA, ⁶⁸Ga-DOTATOC, ¹²⁴I–MIBG) were injected according to appropriate clinical indications. Each of the 28 whole-body PET datasets was reconstructed three times using AC with (1) standard four-compartment μ-maps (background air, lung, muscle, and soft tissue), (2) five-compartment μ-maps (adding bone), and (3) six-compartment μ-maps (adding bone and HUGE truncation correction). The SUV_max of each detected bone lesion was measured in each reconstruction to evaluate the quantitative impact of improved MR-based AC. Relative difference images between four- and six-compartment μ-maps were calculated. MR-based HUGE truncation correction was compared with the PET-based MLAA truncation correction method in all patients.

Results

Overall, 69 bone lesions were detected and evaluated. The mean increase in relative difference over all 69 lesions in SUV_max was 5.4 ± 6.4% when comparing the improved six-compartment AC with the standard four-compartment AC. Maximal relative difference of 28.4% was measured in one lesion. Truncation correction with HUGE worked robust and resulted in realistic body contouring in all 28 exams and for all 4 different radiotracers. Truncation correction with MLAA revealed overestimations of arm tissue volume in all PET/MR exams with ¹⁸F-FDG radiotracer and failed in all other exams with radiotracers ⁶⁸Ga-PSMA, ⁶⁸Ga-DOTATOC, and ¹²⁴I- MIBG due to limitations in body contour detection.

Conclusion

Improved MR-based AC, including bone segmentation and HUGE truncation correction in whole-body PET/MR on patients with bone lesions and using various radiotracers, is important to ensure best possible diagnostic image quality and accurate PET quantification. The HUGE method for truncation correction based on MR worked robust and results in realistic body contouring, independent of the radiotracers used.

Cardiac PET/MRI: Current Clinical Status and Future Perspectives

Combined PET/MRI has now been in clinical routine for almost 10 years. Since then, it has not only had to face validation, comparison and research questions, it has also been increasingly used in clinical routine. A number of cardiovascular applications have become established here, whereby viability imaging and assessment of inflammatory and infiltrative processes in the heart are to be emphasized. However, further interesting applications are expected in the near future. This review summarizes the most important clinical applications on the one hand and mentions interesting areas of application in research on the other.

Deep learning-based attenuation correction in the absence of structural information for whole-body positron emission tomography imaging

Deriving accurate structural maps for attenuation correction (AC) of whole-body positron emission tomography (PET) remains challenging. Common problems include truncation, inter-scan motion, and erroneous transformation of structural voxel-intensities to PET µ-map values (e.g. modality artifacts, implanted devices, or contrast agents). This work presents a deep learning-based attenuation correction (DL-AC) method to generate attenuation corrected PET (AC PET) from non-attenuation corrected PET (NAC PET) images for whole-body PET imaging, without the use of structural information. 3D patch-based cycle-consistent generative adversarial networks (CycleGAN) is introduced to include NAC-PET-to-AC-PET mapping and inverse mapping from AC PET to NAC PET, which constrains NAC-PET-to-AC-PET mapping to be closer to one-to-one mapping. Since NAC PET images share similar anatomical structures to the AC PET image but lack contrast information, residual blocks, which aim to learn the differences between NAC PET and AC PET, are used to construct generators of CycleGAN. After training, patches from NAC PET images were fed into NAC-PET-to-AC-PET mapping to generate DL-AC PET patches. DL-AC PET image was then reconstructed through patch fusion. We conducted a retrospective study on 55 datasets of whole-body PET/CT scans to evaluate the proposed method. In comparing DL-AC PET with original AC PET, average mean error (ME) and normalized mean square error (NMSE) of the whole-body were 0.62%  ±  1.26% and 0.72%  ±  0.34%. The average intensity changes measured on sequential PET images with AC and DL-AC on both normal tissues and lesions differ less than 3%. There was no significant difference of the intensity changes between AC and DL-AC PET, which demonstrate DL-AC PET images generated by the proposed DL-AC method can reach a same level to that of original AC PET images. The method demonstrates excellent quantification accuracy and reliability and is applicable to PET data collected on a single PET scanner or hybrid platform with computed tomography (PET/CT) or magnetic resonance imaging (PET/MRI).

Simultaneous emission and attenuation reconstruction in time-of-flight PET using a reference object

Background

Simultaneous reconstruction of emission and attenuation images in time-of-flight (TOF) positron emission tomography (PET) does not provide a unique solution. In this study, we propose to solve this limitation by including additional information given by a reference object with known attenuation placed outside the patient. Different configurations of the reference object were studied including geometry, material composition, and activity, and an optimal configuration was defined. In addition, this configuration was tested for different timing resolutions and noise levels.

Results

The proposed strategy was tested in 2D simulations obtained by forward projection of available PET/CT data and noise was included using Monte Carlo techniques. Obtained results suggest that the optimal configuration corresponds to a water cylinder inserted in the patient table and filled with activity. In that case, mean differences between reconstructed and true images were below 10%. However, better results can be obtained by increasing the activity of the reference object.

Conclusion

This study shows promising results that might allow to obtain an accurate attenuation map from pure TOF-PET data without prior knowledge obtained from CT, MRI, or transmission scans.

PET/MRI attenuation estimation in the lung: A review of past, present, and potential techniques

Positron emission tomography/magnetic resonance imaging (PET/MRI) potentially offers several advantages over positron emission tomography/computed tomography (PET/CT), for example, no CT radiation dose and soft tissue images from MR acquired at the same time as the PET. However, obtaining accurate linear attenuation correction (LAC) factors for the lung remains difficult in PET/MRI. LACs depend on electron density and in the lung, these vary significantly both within an individual and from person to person. Current commercial practice is to use a single‐valued population‐based lung LAC, and better estimation is needed to improve quantification. Given the under‐appreciation of lung attenuation estimation as an issue, the inaccuracy of PET quantification due to the use of single‐valued lung LACs, the unique challenges of lung estimation, and the emerging status of PET/MRI scanners in lung disease, a review is timely. This paper highlights past and present methods, categorizing them into segmentation, atlas/mapping, and emission‐based schemes. Potential strategies for future developments are also presented.