MRI-guided attenuation correction in torso PET/MRI: Assessment of segmentation-, atlas-, and deep learning-based approaches in the presence of outliers

A systematic literature review: deep learning techniques for synthetic medical image generation and their applications in radiotherapy

The aim of this systematic review is to determine whether Deep Learning (DL) algorithms can provide a clinically feasible alternative to classic algorithms for synthetic Computer Tomography (sCT). The following categories are presented in this study: ∙ MR-based treatment planning and synthetic CT generation techniques. ∙ Generation of synthetic CT images based on Cone Beam CT images. ∙ Low-dose CT to High-dose CT generation. ∙ Attenuation correction for PET images. To perform appropriate database searches, we reviewed journal articles published between January 2018 and June 2023. Current methodology, study strategies, and results with relevant clinical applications were analyzed as we outlined the state-of-the-art of deep learning based approaches to inter-modality and intra-modality image synthesis. This was accomplished by contrasting the provided methodologies with traditional research approaches. The key contributions of each category were highlighted, specific challenges were identified, and accomplishments were summarized. As a final step, the statistics of all the cited works from various aspects were analyzed, which revealed that DL-based sCTs have achieved considerable popularity, while also showing the potential of this technology. In order to assess the clinical readiness of the presented methods, we examined the current status of DL-based sCT generation.

Attention-based deep neural network for partial volume correction in brain 18F-FDG PET imaging

PURPOSE

This work set out to propose an attention-based deep neural network to predict partial volume corrected images from PET data not utilizing anatomical information.

METHODS

An attention-based convolutional neural network (ATB-Net) is developed to predict PVE-corrected images in brain PET imaging by concentrating on anatomical areas of the brain. The performance of the deep neural network for performing PVC without using anatomical images was evaluated for two PVC methods, including iterative Yang (IY) and reblurred Van-Cittert (RVC) approaches. The RVC and IY PVC approaches were applied to PET images to generate the reference images. The training of the U-Net network for the partial volume correction was trained twice, once without using the attention module and once with the attention module concentrating on the anatomical brain regions.

RESULTS

Regarding the peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), and root mean square error (RMSE) metrics, the proposed ATB-Net outperformed the standard U-Net model (without attention compartment). For the RVC technique, the ATB-Net performed just marginally better than the U-Net; however, for the IY method, which is a region-wise method, the attention-based approach resulted in a substantial improvement. The mean absolute relative SUV difference and mean absolute relative bias improved by 38.02 % and 91.60 % for the RVC method and 77.47 % and 79.68 % for the IY method when using the ATB-Net model, respectively.

CONCLUSIONS

Our results propose that without using anatomical data, the attention-based DL model could perform PVC on PET images, which could be employed for PVC in PET imaging.

Supplemental Transmission Aided Attenuation Correction for Quantitative Cardiac PET

Quantitative PET attenuation correction (AC) for cardiac PET/CT and PET/MR is a challenging problem. We propose and evaluate an AC approach that uses coincidences from a relatively weak and physically fixed sparse external source, in combination with that from the patient, to reconstruct μ -maps based on physics principles alone. The low 30 cm3 volume of the source makes it easy to fill and place, and the method does not use prior image data or attenuation map assumptions. Our supplemental transmission aided maximum likelihood reconstruction of attenuation and activity (sTX-MLAA) algorithm contains an attenuation map update that maximizes the likelihood of terms representing coincidences originating from tracer in the patient and a weighted expression of counts segmented from the external source alone. Both external source and patient scatter and randoms are fully corrected. We evaluated performance of sTX-MLAA compared to reference standard CT-based AC with FDG PET/CT phantom studies; including modeling a patient with myocardial inflammation. Through an ROI analysis we measured ≤ 5 % bias in activity concentrations for PET images generated with sTX-MLAA and a TX source strength ≥ 12.7 MBq, relative to CT-AC. PET background variability (from noise and sparse sampling) was substantially reduced with sTX-MLAA compared to using counts segmented from the transmission source alone for AC. Results suggest that sTX-MLAA will enable quantitative PET during cardiac PET/CT and PET/MR of human patients.

Strategies for deep learning-based attenuation and scatter correction of brain 18 F-FDG PET images in the image domain

BACKGROUND

Attenuation and scatter correction is crucial for quantitative positron emission tomography (PET) imaging. Direct attenuation correction (AC) in the image domain using deep learning approaches has been recently proposed for combined PET/MR and standalone PET modalities lacking transmission scanning devices or anatomical imaging.

PURPOSE

In this study, different input settings were considered in the model training to investigate deep learning-based AC in the image space.

METHODS

Three different deep learning methods were developed for direct AC in the image space: (i) use of non-attenuation-corrected PET images as input (NonAC-PET), (ii) use of attenuation-corrected PET images with a simple two-class AC map (composed of soft-tissue and background air) obtained from NonAC-PET images (PET segmentation-based AC [SegAC-PET]), and (iii) use of both NonAC-PET and SegAC-PET images in a Double-Channel fashion to predict ground truth attenuation corrected PET images with Computed Tomography images (CTAC-PET). Since a simple two-class AC map (generated from NonAC-PET images) can easily be generated, this work assessed the added value of incorporating SegAC-PET images into direct AC in the image space. A 4-fold cross-validation scheme was adopted to train and evaluate the different models based using 80 brain 18 F-Fluorodeoxyglucose PET/CT images. The voxel-wise and region-wise accuracy of the models were examined via measuring the standardized uptake value (SUV) quantification bias in different regions of the brain.

RESULTS

The overall root mean square error (RMSE) for the Double-Channel setting was 0.157 ± 0.08 SUV in the whole brain region, while RMSEs of 0.214 ± 0.07 and 0.189 ± 0.14 SUV were observed in NonAC-PET and SegAC-PET models, respectively. A mean SUV bias of 0.01 ± 0.26% was achieved by the Double-Channel model regarding the activity concentration in cerebellum region, as opposed to 0.08 ± 0.28% and 0.05 ± 0.28% SUV biases for the network that uniquely used NonAC-PET or SegAC-PET as input, respectively. SegAC-PET images with an SUV bias of -1.15 ± 0.54%, served as a benchmark for clinically accepted errors. In general, the Double-Channel network, relying on both SegAC-PET and NonAC-PET images, outperformed the other AC models.

CONCLUSION

Since the generation of two-class AC maps from non-AC PET images is straightforward, the current study investigated the potential added value of incorporating SegAC-PET images into a deep learning-based direct AC approach. Altogether, compared with models that use only NonAC-PET and SegAC-PET images, the Double-Channel deep learning network exhibited superior attenuation correction accuracy.

Systematic evaluation of human soft tissue attenuation correction in whole-body PET/MR: Implications from PET/CT for optimization of MR-based AC in patients with normal lung tissue

BACKGROUND

Attenuation correction (AC) is an important methodical step in positron emission tomography/magnetic resonance imaging (PET/MRI) to correct for attenuated and scattered PET photons.

PURPOSE

The overall quality of magnetic resonance (MR)-based AC in whole-body PET/MRI was evaluated in direct comparison to computed tomography (CT)-based AC serving as reference. The quantitative impact of isolated tissue classes in the MR-AC was systematically investigated to identify potential optimization needs and strategies.

METHODS

Data of n = 60 whole-body PET/CT patients with normal lung tissue and without metal implants/prostheses were used to generate six different AC-models based on the CT data for each patient, simulating variations of MR-AC. The original continuous CT-AC (CT-org) is referred to as reference. A pseudo MR-AC (CT-mrac), generated from CT data, with four tissue classes and a bone atlas represents the MR-AC. Relative difference in linear attenuation coefficients (LAC) and standardized uptake values were calculated. From the results two improvements regarding soft tissue AC and lung AC were proposed and evaluated.

RESULTS

The overall performance of MR-AC is in good agreement compared to CT-AC. Lungs, heart, and bone tissue were identified as the regions with most deviation to the CT-AC (myocardium -15%, bone tissue -14%, and lungs ±20%). Using single-valued LACs for AC in the lung only provides limited accuracy. For improved soft tissue AC, splitting the combined soft tissue class into muscles and organs each with adapted LAC could reduce the deviations to the CT-AC to < ±1%. For improved lung AC, applying a gradient LAC in the lungs could remarkably reduce over- or undercorrections in PET signal compared to CT-AC (±5%).

CONCLUSIONS

The AC is important to ensure best PET image quality and accurate PET quantification for diagnostics and radiotherapy planning. The optimized segment-based AC proposed in this study, which was evaluated on PET/CT data, inherently reduces quantification bias in normal lung tissue and soft tissue compared to the CT-AC reference.

Recent Advances in Positron Emission Tomography/Magnetic Resonance Imaging Technology

More than a decade has passed since the clinical deployment of the first commercial whole-body hybrid PET/MR scanner in the clinic. The major advantages and limitations of this technology have been investigated from technical and medical perspectives. Despite the remarkable advantages associated with hybrid PET/MR imaging, such as reduced radiation dose and fully simultaneous functional and structural imaging, this technology faced major challenges in terms of mutual interference between MRI and PET components, in addition to the complexity of achieving quantitative imaging owing to the intricate MRI-guided attenuation correction in PET/MRI. In this review, the latest technical developments in PET/MRI technology as well as the state-of-the-art solutions to the major challenges of quantitative PET/MR imaging are discussed.

A review of PET attenuation correction methods for PET-MR

Despite being thirteen years since the installation of the first PET-MR system, the scanners constitute a very small proportion of the total hybrid PET systems installed. This is in stark contrast to the rapid expansion of the PET-CT scanner, which quickly established its importance in patient diagnosis within a similar timeframe. One of the main hurdles is the development of an accurate, reproducible and easy-to-use method for attenuation correction. Quantitative discrepancies in PET images between the manufacturer-provided MR methods and the more established CT- or transmission-based attenuation correction methods have led the scientific community in a continuous effort to develop a robust and accurate alternative. These can be divided into four broad categories: (i) MR-based, (ii) emission-based, (iii) atlas-based and the (iv) machine learning-based attenuation correction, which is rapidly gaining momentum. The first is based on segmenting the MR images in various tissues and allocating a predefined attenuation coefficient for each tissue. Emission-based attenuation correction methods aim in utilising the PET emission data by simultaneously reconstructing the radioactivity distribution and the attenuation image. Atlas-based attenuation correction methods aim to predict a CT or transmission image given an MR image of a new patient, by using databases containing CT or transmission images from the general population. Finally, in machine learning methods, a model that could predict the required image given the acquired MR or non-attenuation-corrected PET image is developed by exploiting the underlying features of the images. Deep learning methods are the dominant approach in this category. Compared to the more traditional machine learning, which uses structured data for building a model, deep learning makes direct use of the acquired images to identify underlying features. This up-to-date review goes through the literature of attenuation correction approaches in PET-MR after categorising them. The various approaches in each category are described and discussed. After exploring each category separately, a general overview is given of the current status and potential future approaches along with a comparison of the four outlined categories.

PET-MRI of Coronary Artery Disease

Simultaneous positron emission tomography and magnetic resonance imaging (PET-MRI) combines the anatomical detail and tissue characterization of MRI with the functional information from PET. Within the coronary arteries, this hybrid technique can be used to identify biological activity combined with anatomically high-risk plaque features to better understand the processes underlying coronary atherosclerosis. Furthermore, the downstream effects of coronary artery disease on the myocardium can be characterized by providing information on myocardial perfusion, viability, and function. This review will describe the current capabilities of PET-MRI in coronary artery disease and discuss the limitations and future directions of this emerging technique. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 3.

Attenuation correction for PET/MRI to measure tracer activity surrounding total knee arthroplasty

Background

Positron emission tomography (PET) in combination with magnetic resonance imaging (MRI) could allow inflammatory complications near total knee arthroplasty (TKA) to be studied early in their development. However, attenuation of the PET signal by the metal TKA implants imparts substantial error into measurements of tracer activity, and conventional MR-based attenuation correction (AC) methods have large signal voids in the vicinity of metal implants.

Purpose

To evaluate a segmentation-based AC approach to measure tracer uptake from PET/MRI scans near TKA implants.

Methods

A TKA implant (Triathlon, Stryker, Mahwah, USA) was implanted into a cadaver. Four vials were filled with [¹⁸F]fluorodeoxyglucose with known activity concentration (4.68 MBq total, 0.76 MBq/mL) and inserted into the knee. Images of the knee were acquired using a 3T PET/MRI system (Biograph mMR, Siemens Healthcare, Erlangen, Germany). Models of the implant components were registered to the MR data using rigid-body transformations and the other tissue classes were manually segmented. These segments were used to create the segmentation-based map and complete the AC. Percentage error of the resulting measured activities was calculated by comparing the measured and known amounts of activity in each vial.

Results

The original AC resulted in a percentage error of 64.1% from the known total activity. Errors in the individual vial activities ranged from 40.2 to 82.7%. Using the new segmentation-based AC, the percentage error of the total activity decreased to 3.55%. Errors in the individual vials were less than 15%.

Conclusions

The segmentation-based AC technique dramatically reduced the error in activity measurements that result from PET signal attenuation by the metal TKA implant. This approach may be useful to enhance the reliability of PET/MRI measurements for numerous applications.

A deep learning-based whole-body solution for PET/MRI attenuation correction

BACKGROUND

Deep convolutional neural networks have demonstrated robust and reliable PET attenuation correction (AC) as an alternative to conventional AC methods in integrated PET/MRI systems. However, its whole-body implementation is still challenging due to anatomical variations and the limited MRI field of view. The aim of this study is to investigate a deep learning (DL) method to generate voxel-based synthetic CT (sCT) from Dixon MRI and use it as a whole-body solution for PET AC in a PET/MRI system.

MATERIALS AND METHODS

Fifteen patients underwent PET/CT followed by PET/MRI with whole-body coverage from skull to feet. We performed MRI truncation correction and employed co-registered MRI and CT images for training and leave-one-out cross-validation. The network was pretrained with region-specific images. The accuracy of the AC maps and reconstructed PET images were assessed by performing a voxel-wise analysis and calculating the quantification error in SUV obtained using DL-based sCT (PET_sCT) and a vendor-provided atlas-based method (PET_Atlas), with the CT-based reconstruction (PET_CT) serving as the reference. In addition, region-specific analysis was performed to compare the performances of the methods in brain, lung, liver, spine, pelvic bone, and aorta.

RESULTS

Our DL-based method resulted in better estimates of AC maps with a mean absolute error of 62 HU, compared to 109 HU for the atlas-based method. We found an excellent voxel-by-voxel correlation between PET_CT and PET_sCT (R² = 0.98). The absolute percentage difference in PET quantification for the entire image was 6.1% for PET_sCT and 11.2% for PET_Atlas. The regional analysis showed that the average errors and the variability for PET_sCT were lower than PET_Atlas in all regions. The largest errors were observed in the lung, while the smallest biases were observed in the brain and liver.

CONCLUSIONS

Experimental results demonstrated that a DL approach for whole-body PET AC in PET/MRI is feasible and allows for more accurate results compared with conventional methods. Further evaluation using a larger training cohort is required for more accurate and robust performance.