1
|
Guo X, Shi L, Chen X, Liu Q, Zhou B, Xie H, Liu YH, Palyo R, Miller EJ, Sinusas AJ, Staib L, Spottiswoode B, Liu C, Dvornek NC. TAI-GAN: A Temporally and Anatomically Informed Generative Adversarial Network for early-to-late frame conversion in dynamic cardiac PET inter-frame motion correction. Med Image Anal 2024; 96:103190. [PMID: 38820677 DOI: 10.1016/j.media.2024.103190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 04/12/2024] [Accepted: 05/01/2024] [Indexed: 06/02/2024]
Abstract
Inter-frame motion in dynamic cardiac positron emission tomography (PET) using rubidium-82 (82Rb) myocardial perfusion imaging impacts myocardial blood flow (MBF) quantification and the diagnosis accuracy of coronary artery diseases. However, the high cross-frame distribution variation due to rapid tracer kinetics poses a considerable challenge for inter-frame motion correction, especially for early frames where intensity-based image registration techniques often fail. To address this issue, we propose a novel method called Temporally and Anatomically Informed Generative Adversarial Network (TAI-GAN) that utilizes an all-to-one mapping to convert early frames into those with tracer distribution similar to the last reference frame. The TAI-GAN consists of a feature-wise linear modulation layer that encodes channel-wise parameters generated from temporal information and rough cardiac segmentation masks with local shifts that serve as anatomical information. Our proposed method was evaluated on a clinical 82Rb PET dataset, and the results show that our TAI-GAN can produce converted early frames with high image quality, comparable to the real reference frames. After TAI-GAN conversion, the motion estimation accuracy and subsequent myocardial blood flow (MBF) quantification with both conventional and deep learning-based motion correction methods were improved compared to using the original frames. The code is available at https://github.com/gxq1998/TAI-GAN.
Collapse
Affiliation(s)
- Xueqi Guo
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA.
| | | | - Xiongchao Chen
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Qiong Liu
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Bo Zhou
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Huidong Xie
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Yi-Hwa Liu
- Department of Internal Medicine, Yale University, New Haven, CT, USA
| | | | - Edward J Miller
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Internal Medicine, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Albert J Sinusas
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Internal Medicine, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Lawrence Staib
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | | | - Chi Liu
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
| | - Nicha C Dvornek
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
| |
Collapse
|
2
|
Sun P, Thomas MA, Luo D, Pan T. New full-counts phase-matched data-driven gated (DDG) PET/CT. Med Phys 2024. [PMID: 38648671 DOI: 10.1002/mp.17097] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Revised: 02/06/2024] [Accepted: 04/10/2024] [Indexed: 04/25/2024] Open
Abstract
BACKGROUND Data-driven gated (DDG) PET has gained clinical acceptance and has been shown to match or outperform external-device gated (EDG) PET. However, in most clinical applications, DDG PET is matched with helical CT acquired in free breathing (FB) at a random respiratory phase, leaving registration, and optimal attenuation correction (AC) to chance. Furthermore, DDG PET requires additional scan time to reduce image noise as it only preserves 35%-50% of the PET data at or near the end-expiratory phase of the breathing cycle. PURPOSE A new full-counts, phase-matched (FCPM) DDG PET/CT was developed based on a low-dose cine CT to improve registration between DDG PET and DDG CT, to reduce image noise, and to avoid increasing acquisition times in DDG PET. METHODS A new DDG CT was developed for three respiratory phases of CT images from a low dose cine CT acquisition of 1.35 mSv for a coverage of about 15.4 cm: end-inspiration (EI), average (AVG), and end-expiration (EE) to match with the three corresponding phases of DDG PET data: -10% to 15%; 15% to 30%, and 80% to 90%; and 30% to 80%, respectively. The EI and EE phases of DDG CT were selected based on the physiological changes in lung density and body outlines reflected in the dynamic cine CT images. The AVG phase was derived from averaging of all phases of the cine CT images. The cine CT was acquired over the lower lungs and/or upper abdomen for correction of misregistration between PET and FB CT as well as DDG PET and FB CT. The three phases of DDG CT were used for AC of the corresponding phases of PET. After phase-matched AC of each PET dataset, the EI and AVG PET data were registered to the EE PET data with deformable image registration. The final result was FCPM DDG PET/CT which accounts for all PET data registered at the EE phase. We applied this approach to 14 18F-FDG lung cancer patient studies acquired at 2 min/bed position on the GE Discovery MI (25-cm axial FOV) and evaluated its efficacy in improved quantification and noise reduction. RESULTS Relative to static PET/CT, the SUVmax increases for the EI, AVG, EE, and FCPM DDG PET/CT were 1.67 ± 0.40, 1.50 ± 0.28, 1.64 ± 0.36, and 1.49 ± 0.28, respectively. There were 10.8% and 9.1% average decreases in SUVmax from EI and EE to FCPM DDG PET/CT, respectively. EI, AVG, and EE DDG PET/CT all maintained increased image noise relative to static PET/CT. However, the noise levels of FCPM and static PET were statistically equivalent, suggesting the inclusion of all counts was able to decrease the image noise relative to EI and EE DDG PET/CT. CONCLUSIONS A new FCPM DDG PET/CT has been developed to account for 100% of collected PET data in DDG PET applications. Image noise in FCPM is comparable to static PET, while small decreases in SUVmax were also observed in FCPM when compared to either EI or EE DDG PET/CT.
Collapse
Affiliation(s)
- Peng Sun
- Department of Imaging Physics, UT MD Anderson Cancer Center, Houston, Texas, USA
| | - M Allan Thomas
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, Missouri, USA
| | - Dershan Luo
- Department of Radiation Physics, UT MD Anderson Cancer Center, Houston, Texas, USA
| | - Tinsu Pan
- Department of Imaging Physics, UT MD Anderson Cancer Center, Houston, Texas, USA
| |
Collapse
|
3
|
Reshtebar N, Hosseini SA, Zhuang M, Sheikhzadeh P. Estimation of kinetic parameters in dynamic FDG PET imaging based on shortened protocols: a virtual clinical study. Phys Eng Sci Med 2024; 47:199-213. [PMID: 38078995 DOI: 10.1007/s13246-023-01356-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 11/12/2023] [Indexed: 03/26/2024]
Abstract
This study investigated the estimation of kinetic parameters and production of related parametric Ki images in FDG PET imaging using the proposed shortened protocol (three 3-min/bed routine static images) by means of the simulated annealing (SA) algorithm. Six realistic heterogeneous tumors and various levels of [18F] FDG uptake were simulated by the XCAT phantom. An irreversible two-tissue compartment model (2TCM) using population-based input function was employed. By keeping two routine clinical scans fixed (60-min and 90-min post injection), the effect of the early scan time on optimizing the estimation of the pharmacokinetic parameters was investigated. The SA optimization algorithm was applied to estimate micro- and macro-parameters (K1, k2, k3, Ki). The minimum bias for most parameters was observed at a scan time of 20-min, which was < 10%. A highly significant correlation (> 0.9) as well as limited bias (< 10%) were observed between kinetic parameters generated from two methods [two-tissue compartment full dynamic scan (2TCM-full) and two-tissue compartment by SA algorithm (2TCM-SA)]. The analysis showed a strong correlation (> 0.8) between (2TCM-SA) Ki and SUV images. In addition, the tumor-to-background ratio (TBR) metric in the parametric (2TCM-SA) Ki images was significantly higher than SUV, although the SUV images provide better Contrast-to-noise ratio relative to parametric (2TCM-SA) Ki images. The proposed shortened protocol by the SA algorithm can estimate the kinetic parameters in FDG PET scan with high accuracy and robustness. It was also concluded that the parametric Ki images obtained from the 2TCM-SA as a complementary image of the SUV possess more quantification information than SUV images and can be used by the nuclear medicine specialist. This method has the potential to be an alternative to a full dynamic PET scan.
Collapse
Affiliation(s)
- Niloufar Reshtebar
- Department of Energy Engineering, Sharif University of Technology, Tehran, 8639-11365, Iran
| | - Seyed Abolfazl Hosseini
- Department of Energy Engineering, Sharif University of Technology, Tehran, 8639-11365, Iran.
| | - Mingzan Zhuang
- Department of Nuclear Medicine, Meizhou People's Hospital, Meizhou, 514011, China
| | - Peyman Sheikhzadeh
- Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
- Nuclear Medicine Department, Imam Khomeini Hospital Complex, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
4
|
Sun P, Thomas MA, Luo D, Pan T. Correcting CT misregistration in data-driven gated (DDG) PET with PET self-gating and deformable image registration. Med Phys 2024; 51:1626-1636. [PMID: 38285623 PMCID: PMC10939831 DOI: 10.1002/mp.16958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 12/08/2023] [Accepted: 01/05/2024] [Indexed: 01/31/2024] Open
Abstract
BACKGROUND Misregistration between CT and PET data can result in mis-localization and inaccurate quantification of functional uptake in whole body PET/CT imaging. This problem is exacerbated when an abnormal inspiration occurs during the free-breathing helical CT (FB CT) used for attenuation correction of PET data. In data-driven gated (DDG) PET, the data selected for reconstruction is typically derived from the end-expiration (EE) phase of the breathing cycle, making this potential issue worse. PURPOSE The objective of this study is to develop a deformable image registration (DIR)-based respiratory motion model to improve the registration and quantification between misregistered FB CT and PET. METHODS Twenty-two whole-body 18 F-FDG PET/CT scans encompassing 48 lesions in misregistered regions were analyzed in this study. End-inspiration (EI) and EE PET data were derived from -10% to 15% and 30% to 80% of the breathing cycle, respectively. DIR was used to estimate a motion model from the EE to EI phase of the PET data. The model was then used to generate PET images at any phase of up to four times the amplitude of motion between EE and EI for correlation with the misregistered FB CT. Once a matched phase of the FB CT was determined, FB CT was deformed to a pseudo CT at the EE phase (DIR CT). DIR CT was compared with the ground truth DDG CT for AC and localization of the DDG PET. RESULTS Between DDG PET/FB CT and DDG PET/DIR CT, a significant increase in ∆%SUV was observed (p < 0.01), with median values elevating from 26.7% to 42.4%. This new method was most effective for lesions ≤3 cm proximal to the diaphragm (p < 0.001) but showed decreasing efficacy as the distance increased. When FB CT was severely misregistered with DDG PET (>3 cm), DDG PET/DIR CT outperformed DDG PET/FB CT alone (p < 0.05). Even when patients showed varied breathing patterns during the PET/CT scan, DDG PET/DIR CT still surpassed the efficiency of DDG PET/FB CT (p < 0.01). Though DDG PET/DIR CT couldn't match the performance of the DDG PET/CT ground truth (42.4% vs. 53.6%, p < 0.01), it reached 84% of its quantification, demonstrating good agreement and a strong overall correlation (regression coefficient of 0.94, p < 0.0001). In some cases, anatomical distortion and blurring, and misregistration error were observed in DIR CT, rendering it still unable to correct inaccurate localization near the boundaries of two organs. CONCLUSIONS Based on the motion model derived from gated PET data, DIR CT can significantly improve the quantification and localization of DDG PET. This approach can achieve a performance level of about 84% of the ground truth established by DDG PET/CT. These results show that self-gated PET and DIR CT may offer an alternative clinical solution to DDG PET and FB CT for quantification without the need for additional cine-CT imaging. DIR CT was at times inferior to DDG CT due to some distortion and blurring of anatomy and misregistration error.
Collapse
Affiliation(s)
- Peng Sun
- Department of Imaging Physics, UT MD Anderson Cancer Center, Houston, TX 77030
| | - M Allan Thomas
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO 63110
| | - Dershan Luo
- Department of Radiation Physics, UT MD Anderson Cancer Center, Houston, TX 77030
| | - Tinsu Pan
- Department of Imaging Physics, UT MD Anderson Cancer Center, Houston, TX 77030
| |
Collapse
|
5
|
Li T, Xie Z, Qi W, Asma E, Qi J. Unsupervised deep learning framework for data-driven gating in positron emission tomography. Med Phys 2023; 50:6047-6059. [PMID: 37538038 PMCID: PMC10592231 DOI: 10.1002/mp.16642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Revised: 07/03/2023] [Accepted: 07/03/2023] [Indexed: 08/05/2023] Open
Abstract
BACKGROUND Physiological motion, such as respiratory motion, has become a limiting factor in the spatial resolution of positron emission tomography (PET) imaging as the resolution of PET detectors continue to improve. Motion-induced misregistration between PET and CT images can also cause attenuation correction artifacts. Respiratory gating can be used to freeze the motion and to reduce motion induced artifacts. PURPOSE In this study, we propose a robust data-driven approach using an unsupervised deep clustering network that employs an autoencoder (AE) to extract latent features for respiratory gating. METHODS We first divide list-mode PET data into short-time frames. The short-time frame images are reconstructed without attenuation, scatter, or randoms correction to avoid attenuation mismatch artifacts and to reduce image reconstruction time. The deep AE is then trained using reconstructed short-time frame images to extract latent features for respiratory gating. No additional data are required for the AE training. K-means clustering is subsequently used to perform respiratory gating based on the latent features extracted by the deep AE. The effectiveness of our proposed Deep Clustering method was evaluated using physical phantom and real patient datasets. The performance was compared against phase gating based on an external signal (External) and image based principal component analysis (PCA) with K-means clustering (Image PCA). RESULTS The proposed method produced gated images with higher contrast and sharper myocardium boundaries than those obtained using the External gating method and Image PCA. Quantitatively, the gated images generated by the proposed Deep Clustering method showed larger center of mass (COM) displacement and higher lesion contrast than those obtained using the other two methods. CONCLUSIONS The effectiveness of our proposed method was validated using physical phantom and real patient data. The results showed our proposed framework could provide superior gating than the conventional External method and Image PCA.
Collapse
Affiliation(s)
- Tiantian Li
- Department of Biomedical Engineering, University of California - Davis, Davis, CA 95616, USA
| | - Zhaoheng Xie
- Department of Biomedical Engineering, University of California - Davis, Davis, CA 95616, USA
| | - Wenyuan Qi
- Canon Medical Research USA, Inc., Vernon Hills, IL 60061, USA
| | - Evren Asma
- Canon Medical Research USA, Inc., Vernon Hills, IL 60061, USA
| | - Jinyi Qi
- Department of Biomedical Engineering, University of California - Davis, Davis, CA 95616, USA
| |
Collapse
|
6
|
Guo X, Wu J, Chen MK, Liu Q, Onofrey JA, Pucar D, Pang Y, Pigg D, Casey ME, Dvornek NC, Liu C. Inter-pass motion correction for whole-body dynamic PET and parametric imaging. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2023; 7:344-353. [PMID: 37842204 PMCID: PMC10569406 DOI: 10.1109/trpms.2022.3227576] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2023]
Abstract
Whole-body dynamic FDG-PET imaging through continuous-bed-motion (CBM) mode multi-pass acquisition protocol is a promising metabolism measurement. However, inter-pass misalignment originating from body movement could degrade parametric quantification. We aim to apply a non-rigid registration method for inter-pass motion correction in whole-body dynamic PET. 27 subjects underwent a 90-min whole-body FDG CBM PET scan on a Biograph mCT (Siemens Healthineers), acquiring 9 over-the-heart single-bed passes and subsequently 19 CBM passes (frames). The inter-pass motion correction was executed using non-rigid image registration with multi-resolution, B-spline free-form deformations. The parametric images were then generated by Patlak analysis. The overlaid Patlak slope Ki and y-intercept Vb images were visualized to qualitatively evaluate motion impact and correction effect. The normalized weighted mean squared Patlak fitting errors (NFE) were compared in the whole body, head, and hypermetabolic regions of interest (ROI). In Ki images, ROI statistics were collected and malignancy discrimination capacity was estimated by the area under the receiver operating characteristic curve (AUC). After the inter-pass motion correction was applied, the spatial misalignment appearance between Ki and Vb images was successfully reduced. Voxel-wise normalized fitting error maps showed global error reduction after motion correction. The NFE in the whole body (p = 0.0013), head (p = 0.0021), and ROIs (p = 0.0377) significantly decreased. The visual performance of each hypermetabolic ROI in Ki images was enhanced, while 3.59% and 3.67% average absolute percentage changes were observed in mean and maximum Ki values, respectively, across all evaluated ROIs. The estimated mean Ki values had substantial changes with motion correction (p = 0.0021). The AUC of both mean Ki and maximum Ki after motion correction increased, possibly suggesting the potential of enhancing oncological discrimination capacity through inter-pass motion correction.
Collapse
Affiliation(s)
- Xueqi Guo
- Department of Biomedical Engineering, Yale University, New Haven, CT, 06511, USA
| | - Jing Wu
- Department of Biomedical Engineering, Yale University, New Haven, CT, 06511, USA, and the Center for Advanced Quantum Studies and Department of Physics, Beijing Normal University, Beijing, China
| | - Ming-Kai Chen
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, 06511, USA
| | - Qiong Liu
- Department of Biomedical Engineering, Yale University, New Haven, CT, 06511, USA
| | - John A Onofrey
- Department of Biomedical Engineering, the Department of Radiology and Biomedical Imaging, and the Department of Urology, Yale University, New Haven, CT, 06511, USA
| | - Darko Pucar
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, 06511, USA
| | - Yulei Pang
- Department of Biomedical Engineering, Yale University, New Haven, CT, 06511, USA, and Southern Connecticut State University, New Haven, CT, 06515, USA
| | - David Pigg
- Siemens Medical Solutions USA, Inc., Knoxville, TN, 37932, USA
| | - Michael E Casey
- Siemens Medical Solutions USA, Inc., Knoxville, TN, 37932, USA
| | - Nicha C Dvornek
- Department of Biomedical Engineering and the Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, 06511, USA
| | - Chi Liu
- Department of Biomedical Engineering and the Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, 06511, USA
| |
Collapse
|
7
|
Shi L, Zhang J, Toyonaga T, Shao D, Onofrey JA, Lu Y. Deep learning-based attenuation map generation with simultaneously reconstructed PET activity and attenuation and low-dose application. Phys Med Biol 2023; 68. [PMID: 36584395 DOI: 10.1088/1361-6560/acaf49] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Accepted: 12/30/2022] [Indexed: 12/31/2022]
Abstract
Objective. In PET/CT imaging, CT is used for positron emission tomography (PET) attenuation correction (AC). CT artifacts or misalignment between PET and CT can cause AC artifacts and quantification errors in PET. Simultaneous reconstruction (MLAA) of PET activity (λ-MLAA) and attenuation (μ-MLAA) maps was proposed to solve those issues using the time-of-flight PET raw data only. However,λ-MLAA still suffers from quantification error as compared to reconstruction using the gold-standard CT-based attenuation map (μ-CT). Recently, a deep learning (DL)-based framework was proposed to improve MLAA by predictingμ-DL fromλ-MLAA andμ-MLAA using an image domain loss function (IM-loss). However, IM-loss does not directly measure the AC errors according to the PET attenuation physics. Our preliminary studies showed that an additional physics-based loss function can lead to more accurate PET AC. The main objective of this study is to optimize the attenuation map generation framework for clinical full-dose18F-FDG studies. We also investigate the effectiveness of the optimized network on predicting attenuation maps for synthetic low-dose oncological PET studies.Approach. We optimized the proposed DL framework by applying different preprocessing steps and hyperparameter optimization, including patch size, weights of the loss terms and number of angles in the projection-domain loss term. The optimization was performed based on 100 skull-to-toe18F-FDG PET/CT scans with minimal misalignment. The optimized framework was further evaluated on 85 clinical full-dose neck-to-thigh18F-FDG cancer datasets as well as synthetic low-dose studies with only 10% of the full-dose raw data.Main results. Clinical evaluation of tumor quantification as well as physics-based figure-of-merit metric evaluation validated the promising performance of our proposed method. For both full-dose and low-dose studies, the proposed framework achieved <1% error in tumor standardized uptake value measures.Significance. It is of great clinical interest to achieve CT-less PET reconstruction, especially for low-dose PET studies.
Collapse
Affiliation(s)
- Luyao Shi
- Department of Biomedical Engineering, Yale University, New Haven, CT, United States of America
| | - Jiazhen Zhang
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, United States of America
| | - Takuya Toyonaga
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, United States of America
| | - Dan Shao
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, United States of America.,Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, Guangdong, People's Republic of China
| | - John A Onofrey
- Department of Biomedical Engineering, Yale University, New Haven, CT, United States of America.,Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, United States of America.,Department of Urology, Yale University, New Haven, CT, United States of America
| | - Yihuan Lu
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, United States of America
| |
Collapse
|
8
|
Zheng S, Jiejie D, Yue Y, Qi M, Huifeng S. A Deep Learning Method for Motion Artifact Correction in Intravascular Photoacoustic Image Sequence. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:66-78. [PMID: 36037455 DOI: 10.1109/tmi.2022.3202910] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
In vivo application of intravascular photoacoustic (IVPA) imaging for coronary arteries is hampered by motion artifacts associated with the cardiac cycle. Gating is a common strategy to mitigate motion artifacts. However, a large amount of diagnostically valuable information might be lost due to one frame per cycle. In this work, we present a deep learning-based method for directly correcting motion artifacts in non-gated IVPA pullback sequences. The raw signal frames are classified into dynamic and static frames by clustering. Then, a neural network named Motion Artifact Correction (MAC)-Net is designed to correct motion in dynamic frames. Given the lack of the ground truth information on the underlying dynamics of coronary arteries, we trained and tested the network using a computer-generated dataset. Based on the results, it has been observed that the trained network can directly correct motion in successive frames while preserving the original structures without discarding any frames. The improvement in the visual effect of the longitudinal view has been demonstrated based on quantitative evaluation of the inter-frame dissimilarity. The comparison results validated the motion-suppression ability of our method comparable to gating and image registration-based non-learning methods, while maintaining the integrity of the pullbacks without image preprocessing. Experimental results from in vivo intravascular ultrasound and optical coherence tomography pullbacks validated the feasibility of our method in the in vivo intracoronary imaging scenario.
Collapse
|
9
|
Boeken T, Feydy J, Lecler A, Soyer P, Feydy A, Barat M, Duron L. Artificial intelligence in diagnostic and interventional radiology: Where are we now? Diagn Interv Imaging 2023; 104:1-5. [PMID: 36494290 DOI: 10.1016/j.diii.2022.11.004] [Citation(s) in RCA: 42] [Impact Index Per Article: 42.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 11/18/2022] [Indexed: 12/12/2022]
Abstract
The emergence of massively parallel yet affordable computing devices has been a game changer for research in the field of artificial intelligence (AI). In addition, dramatic investment from the web giants has fostered the development of a high-quality software stack. Going forward, the combination of faster computers with dedicated software libraries and the widespread availability of data has opened the door to more flexibility in the design of AI models. Radiomics is a process used to discover new imaging biomarkers that has multiple applications in radiology and can be used in conjunction with AI. AI can be used throughout the various processes of diagnostic imaging, including data acquisition, reconstruction, analysis and reporting. Today, the concept of "AI-augmented" radiologists is preferred to the theory of the replacement of radiologists by AI in many indications. Current evidence bolsters the assumption that AI-assisted radiologists work better and faster. Interventional radiology becomes a data-rich specialty where the entire procedure is fully recorded in a standardized DICOM format and accessible via standard picture archiving and communication systems. No other interventional specialty can bolster such readiness. In this setting, interventional radiology could lead the development of AI-powered applications in the broader interventional community. This article provides an update on the current status of radiomics and AI research, analyzes upcoming challenges and also discusses the main applications in AI in interventional radiology to help radiologists better understand and criticize articles reporting AI in medical imaging.
Collapse
Affiliation(s)
- Tom Boeken
- Université Paris Cité, Faculté de Médecine, Paris 75006, France; Department of Vascular and Oncological Interventional Radiology, Hôpital Européen Georges Pompidou, APHP, Paris 75015, France; HeKA team, INRIA, Paris 75012 , France.
| | | | - Augustin Lecler
- Université Paris Cité, Faculté de Médecine, Paris 75006, France; Department of Radiology, Rothschild Foundation Hospital, Paris 75019, France
| | - Philippe Soyer
- Université Paris Cité, Faculté de Médecine, Paris 75006, France; Department of Radiology, Hôpital Cochin, APHP, Paris 75014, France
| | - Antoine Feydy
- Université Paris Cité, Faculté de Médecine, Paris 75006, France; Department of Radiology, Hôpital Cochin, APHP, Paris 75014, France
| | - Maxime Barat
- Université Paris Cité, Faculté de Médecine, Paris 75006, France; Department of Radiology, Hôpital Cochin, APHP, Paris 75014, France
| | - Loïc Duron
- Université Paris Cité, Faculté de Médecine, Paris 75006, France; Department of Radiology, Rothschild Foundation Hospital, Paris 75019, France
| |
Collapse
|
10
|
Long Axial Field-of-View PET for Ultra-Low-Dose Imaging of Non-Hodgkin Lymphoma during Pregnancy. Diagnostics (Basel) 2022; 13:diagnostics13010028. [PMID: 36611320 PMCID: PMC9818305 DOI: 10.3390/diagnostics13010028] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 12/13/2022] [Accepted: 12/19/2022] [Indexed: 12/24/2022] Open
Abstract
Generally, positron emission tomography imaging is not often performed in the case of pregnant patients. The careful weighing of the risks of radiation exposure to the fetus and benefits for cancer staging and the swift onset of treatment for the mother complicates decision making in clinical practice. In oncology, the most commonly used PET radiotracer is 2-deoxy-2-[fluorine-18] fluoro-D-glucose (18F-FDG), a glucose analog which has established roles in the daily routines for, among other applications, initial diagnosis, staging, (radiation) therapy planning, and response monitoring. The introduction of long axial Field-of-View (LAFOV) PET systems allows for PET imaging with a reduced level of injected 18F-FDG activity while maintaining the image quality. Here, we discuss the first reported case of a pregnant patient diagnosed with follicular lymphoma using LAFOV PET imaging for the staging and therapy selection. The acquired PET images show diagnostic quality images with clearly distinguishable areas of lymphadenopathy, even with only 34 MBq of injected 18F-FDG activity, leading to a considerable decrease in the level of radiation exposure to the fetus.
Collapse
|
11
|
Han Y, Ahmed AI, Hayden C, Jung AK, Saad JM, Spottiswoode B, Nabi F, Al-Mallah MH. Change in positron emission tomography perfusion imaging quality with a data-driven motion correction algorithm. J Nucl Cardiol 2022; 29:3426-3431. [PMID: 35275348 DOI: 10.1007/s12350-021-02902-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2021] [Accepted: 12/17/2021] [Indexed: 01/18/2023]
Abstract
INTRODUCTION Cardiac motion frequently reduces the interpretability of PET images. This study utilized a prototype data-driven motion correction (DDMC) algorithm to generate corrected images and compare DDMC images with non-corrected images (NMC) to evaluate image quality and change of perfusion defect size and severity. METHODS Rest and stress images with NMC and DDMC from 40 consecutive patients with motion were rated by 2 blinded investigators on a 4-point visual ordinal scale (0: minimal motion; 1: mild motion; 2: moderate motion; 3: severe motion/uninterpretable). Motion was also quantified using Dwell Fraction, which is the fraction of time the motion vector shows the heart to be within 6 mm of the corrected position and was derived from listmode data of NMC images. RESULTS Minimal motion was seen in 15% of patients, while 40%, 30%, and 15% of patients had mild moderate and severe motion, respectively. All corrected images showed an improvement in quality and were interpretable after processing. This was confirmed by a significant correlation (Spearman's correlation coefficient 0.626, P < .001) between machine measurement of motion quantification and physician interpretation. CONCLUSION The novel DDMC algorithm improved quality of cardiac PET images with motion. Correlation between machine measurement of motion quantification and physician interpretation was significant.
Collapse
Affiliation(s)
- Yushui Han
- Houston Methodist Debakey Heart and Vascular Center, 6550 Fannin Street, Smith Tower-Suite 1801, Houston, TX, 77030, USA
| | - Ahmed Ibrahim Ahmed
- Houston Methodist Debakey Heart and Vascular Center, 6550 Fannin Street, Smith Tower-Suite 1801, Houston, TX, 77030, USA
| | | | - Aaron K Jung
- Siemens Medical Solutions USA, Inc., Knoxville, TN, USA
| | - Jean Michel Saad
- Houston Methodist Debakey Heart and Vascular Center, 6550 Fannin Street, Smith Tower-Suite 1801, Houston, TX, 77030, USA
| | | | - Faisal Nabi
- Houston Methodist Debakey Heart and Vascular Center, 6550 Fannin Street, Smith Tower-Suite 1801, Houston, TX, 77030, USA
| | - Mouaz H Al-Mallah
- Houston Methodist Debakey Heart and Vascular Center, 6550 Fannin Street, Smith Tower-Suite 1801, Houston, TX, 77030, USA.
- Medicine and Cardiology, Weill Cornell Medical College, New York, USA.
| |
Collapse
|
12
|
Zhang A, Meng X, Yao Y, Zhou X, Yan S, Fei W, Zhou N, Zhang Y, Kong H, Li N. Predictive Value of 18 F-FDG PET/MRI for Pleural Invasion in Solid and Subsolid Lung Adenocarcinomas Smaller Than 3 cm. J Magn Reson Imaging 2022; 57:1367-1375. [PMID: 36066210 DOI: 10.1002/jmri.28422] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Revised: 08/17/2022] [Accepted: 08/18/2022] [Indexed: 11/07/2022] Open
Abstract
BACKGROUND Positron emission tomography (PET)/MRI combines the characteristics of metabolism imaging and high soft tissue resolution, and could provide high diagnostic efficacy for assessment of pleural invasion (PI) of lung cancer. PURPOSE To investigate the application of 18 F-fluorodeoxyglucose (FDG) PET/MRI for predicting PI of lung cancer with the maximum diameter ≤3 cm. STUDY TYPE Prospective. POPULATION A total of 44 patients with non-small cell lung cancer (NSCLC), age from 39 to 79 years old, including 19 (56.82%) females. FIELD STRENGTH/SEQUENCE A 3-T, hybrid PET/MRI including axial fast spin echo respiratory-triggered T2 fat-suppressed imaging (T2FS) and echo planar imaging diffusion-weighted imaging (DWI). ASSESSMENT The maximum standardized uptake value (SUVmax) of all lesions was measured on PET images. Localized effusion outside the contact between the nodules and the pleura on T2FS and signal at the contact between the nodules and the pleura on DWI were evaluated by experienced physicians through visual assessment of the MRI sequences. STATISTICAL TESTS Three models (models 1-3) were developed, incorporating CT, CT and PET, PET and MRI features, and Lasso regression was used in feature selection. The receiver operating characteristic (ROC) curve for PI diagnosis was visualized for each model, and the area under the curve (AUC) was calculated. The DeLong test was used to compare the different AUCs. A P value < 0.05 was considered statistically significant. RESULTS The AUC of models 1-3 was 0.762, 0.829, and 0.915, respectively. The DeLong test showed a statistically significant difference between the AUCs of model 1 vs. model 3, while the differences between the AUCs of model 1 vs. model 2 (P = 0.253) and model 2 vs. model 3 (P = 0.075) were not statistically significant. DATA CONCLUSION 18 F-FDG PET/MRI might show high predictive value for lung adenocarcinoma smaller than 3 cm with PI. EVIDENCE LEVEL 1 TECHNICAL EFFICACY: Stage 2.
Collapse
Affiliation(s)
- Annan Zhang
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| | - Xiangxi Meng
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| | - Yuan Yao
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| | - Xin Zhou
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| | - Shuo Yan
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Radiology, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| | - Wang Fei
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| | - Nina Zhou
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| | - Yan Zhang
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| | - Hanjing Kong
- Beijing United Imaging Research Institute of Intelligent Imaging, UIH Group, Beijing, China
| | - Nan Li
- Key Laboratory of Carcinogenesis and Translational Research (Ministry of Education/Beijing), Department of Nuclear Medicine, Peking University Cancer Hospital & Institute, Haidian, Beijing, China
| |
Collapse
|
13
|
Guo X, Zhou B, Pigg D, Spottiswoode B, Casey ME, Liu C, Dvornek NC. Unsupervised inter-frame motion correction for whole-body dynamic PET using convolutional long short-term memory in a convolutional neural network. Med Image Anal 2022; 80:102524. [PMID: 35797734 PMCID: PMC10923189 DOI: 10.1016/j.media.2022.102524] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 06/08/2022] [Accepted: 06/24/2022] [Indexed: 11/24/2022]
Abstract
Subject motion in whole-body dynamic PET introduces inter-frame mismatch and seriously impacts parametric imaging. Traditional non-rigid registration methods are generally computationally intense and time-consuming. Deep learning approaches are promising in achieving high accuracy with fast speed, but have yet been investigated with consideration for tracer distribution changes or in the whole-body scope. In this work, we developed an unsupervised automatic deep learning-based framework to correct inter-frame body motion. The motion estimation network is a convolutional neural network with a combined convolutional long short-term memory layer, fully utilizing dynamic temporal features and spatial information. Our dataset contains 27 subjects each under a 90-min FDG whole-body dynamic PET scan. Evaluating performance in motion simulation studies and a 9-fold cross-validation on the human subject dataset, compared with both traditional and deep learning baselines, we demonstrated that the proposed network achieved the lowest motion prediction error, obtained superior performance in enhanced qualitative and quantitative spatial alignment between parametric Ki and Vb images, and significantly reduced parametric fitting error. We also showed the potential of the proposed motion correction method for impacting downstream analysis of the estimated parametric images, improving the ability to distinguish malignant from benign hypermetabolic regions of interest. Once trained, the motion estimation inference time of our proposed network was around 460 times faster than the conventional registration baseline, showing its potential to be easily applied in clinical settings.
Collapse
Affiliation(s)
- Xueqi Guo
- Department of Biomedical Engineering, Yale University, New Haven, CT 06511, USA
| | - Bo Zhou
- Department of Biomedical Engineering, Yale University, New Haven, CT 06511, USA
| | - David Pigg
- Siemens Medical Solutions USA, Inc., Knoxville, TN, 37932, USA
| | | | - Michael E Casey
- Siemens Medical Solutions USA, Inc., Knoxville, TN, 37932, USA
| | - Chi Liu
- Department of Biomedical Engineering, Yale University, New Haven, CT 06511, USA; Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT 06511, USA.
| | - Nicha C Dvornek
- Department of Biomedical Engineering, Yale University, New Haven, CT 06511, USA; Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT 06511, USA.
| |
Collapse
|
14
|
Toyonaga T, Shao D, Shi L, Zhang J, Revilla EM, Menard D, Ankrah J, Hirata K, Chen MK, Onofrey JA, Lu Y. Deep learning-based attenuation correction for whole-body PET - a multi-tracer study with 18F-FDG, 68 Ga-DOTATATE, and 18F-Fluciclovine. Eur J Nucl Med Mol Imaging 2022; 49:3086-3097. [PMID: 35277742 PMCID: PMC10725742 DOI: 10.1007/s00259-022-05748-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Accepted: 02/25/2022] [Indexed: 11/04/2022]
Abstract
A novel deep learning (DL)-based attenuation correction (AC) framework was applied to clinical whole-body oncology studies using 18F-FDG, 68 Ga-DOTATATE, and 18F-Fluciclovine. The framework used activity (λ-MLAA) and attenuation (µ-MLAA) maps estimated by the maximum likelihood reconstruction of activity and attenuation (MLAA) algorithm as inputs to a modified U-net neural network with a novel imaging physics-based loss function to learn a CT-derived attenuation map (µ-CT). METHODS Clinical whole-body PET/CT datasets of 18F-FDG (N = 113), 68 Ga-DOTATATE (N = 76), and 18F-Fluciclovine (N = 90) were used to train and test tracer-specific neural networks. For each tracer, forty subjects were used to train the neural network to predict attenuation maps (µ-DL). µ-DL and µ-MLAA were compared to the gold-standard µ-CT. PET images reconstructed using the OSEM algorithm with µ-DL (OSEMDL) and µ-MLAA (OSEMMLAA) were compared to the CT-based reconstruction (OSEMCT). Tumor regions of interest were segmented by two radiologists and tumor SUV and volume measures were reported, as well as evaluation using conventional image analysis metrics. RESULTS µ-DL yielded high resolution and fine detail recovery of the attenuation map, which was superior in quality as compared to µ-MLAA in all metrics for all tracers. Using OSEMCT as the gold-standard, OSEMDL provided more accurate tumor quantification than OSEMMLAA for all three tracers, e.g., error in SUVmax for OSEMMLAA vs. OSEMDL: - 3.6 ± 4.4% vs. - 1.7 ± 4.5% for 18F-FDG (N = 152), - 4.3 ± 5.1% vs. 0.4 ± 2.8% for 68 Ga-DOTATATE (N = 70), and - 7.3 ± 2.9% vs. - 2.8 ± 2.3% for 18F-Fluciclovine (N = 44). OSEMDL also yielded more accurate tumor volume measures than OSEMMLAA, i.e., - 8.4 ± 14.5% (OSEMMLAA) vs. - 3.0 ± 15.0% for 18F-FDG, - 14.1 ± 19.7% vs. 1.8 ± 11.6% for 68 Ga-DOTATATE, and - 15.9 ± 9.1% vs. - 6.4 ± 6.4% for 18F-Fluciclovine. CONCLUSIONS The proposed framework provides accurate and robust attenuation correction for whole-body 18F-FDG, 68 Ga-DOTATATE and 18F-Fluciclovine in tumor SUV measures as well as tumor volume estimation. The proposed method provides clinically equivalent quality as compared to CT in attenuation correction for the three tracers.
Collapse
Affiliation(s)
- Takuya Toyonaga
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
| | - Dan Shao
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
- Guangdong Provincial People's Hospital, Guangzhou, Guangdong, China
| | - Luyao Shi
- Department of Biomedical Engineering, Yale University, New Haven, CT, 06520, USA
| | - Jiazhen Zhang
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
| | - Enette Mae Revilla
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
| | | | | | - Kenji Hirata
- Department of Diagnostic Imaging, School of Medicine, Hokkaido University, Sapporo, Hokkaido, Japan
| | - Ming-Kai Chen
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
- Yale New Haven Hospital, New Haven, CT, USA
| | - John A Onofrey
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA
- Department of Biomedical Engineering, Yale University, New Haven, CT, 06520, USA
- Department of Urology, Yale University, New Haven, CT, USA
| | - Yihuan Lu
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, USA.
| |
Collapse
|
15
|
Grootjans W, Rietbergen DDD, van Velden FHP. Added Value of Respiratory Gating in Positron Emission Tomography for the Clinical Management of Lung Cancer Patients. Semin Nucl Med 2022; 52:745-758. [DOI: 10.1053/j.semnuclmed.2022.04.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Accepted: 04/21/2022] [Indexed: 12/24/2022]
|
16
|
Li T, Zhang M, Qi W, Asma E, Qi J. Deep Learning Based Joint PET Image Reconstruction and Motion Estimation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1230-1241. [PMID: 34928789 PMCID: PMC9064915 DOI: 10.1109/tmi.2021.3136553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Respiratory motion is one of the main sources of motion artifacts in positron emission tomography (PET) imaging. The emission image and patient motion can be estimated simultaneously from respiratory gated data through a joint estimation framework. However, conventional motion estimation methods based on registration of a pair of images are sensitive to noise. The goal of this study is to develop a robust joint estimation method that incorporates a deep learning (DL)-based image registration approach for motion estimation. We propose a joint estimation framework by incorporating a learned image registration network into a regularized PET image reconstruction. The joint estimation was formulated as a constrained optimization problem with moving gated images related to a fixed image via the deep neural network. The constrained optimization problem is solved by the alternating direction method of multipliers (ADMM) algorithm. The effectiveness of the algorithm was demonstrated using simulated and real data. We compared the proposed DL-ADMM joint estimation algorithm with a monotonic iterative joint estimation. Motion compensated reconstructions using pre-calculated deformation fields by DL-based (DL-MC recon) and iterative (iterative-MC recon) image registration were also included for comparison. Our simulation study shows that the proposed DL-ADMM joint estimation method reduces bias compared to the ungated image without increasing noise and outperforms the competing methods. In the real data study, our proposed method also generated higher lesion contrast and sharper liver boundaries compared to the ungated image and had lower noise than the reference gated image.
Collapse
|
17
|
Meier JG, Diab RH, Connor TM, Mawlawi OR. Impact of low injected activity on data driven respiratory gating for PET/CT imaging with continuous bed motion. J Appl Clin Med Phys 2022; 23:e13619. [PMID: 35481961 PMCID: PMC9121057 DOI: 10.1002/acm2.13619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Revised: 02/25/2022] [Accepted: 03/28/2022] [Indexed: 11/25/2022] Open
Abstract
Data driven respiratory gating (DDG) in positron emission tomography (PET) imaging extracts respiratory waveforms from the acquired PET data obviating the need for dedicated external devices. DDG performance, however, degrades with decreasing detected number of coincidence counts. In this paper, we assess the clinical impact of reducing injected activity on a new DDG algorithm designed for PET data acquired with continuous bed motion (CBM_DDG) by evaluating CBM_DDG waveforms, tumor quantification, and physician's perception of motion blur in resultant images. Forty patients were imaged on a Siemens mCT scanner in CBM mode. Reduced injected activity was simulated by generating list mode datasets with 50% and 25% of the original data (100%). CBM_DDG waveforms were compared to that of the original data over the range between the aortic arch and the center of the right kidney using the Pearson correlation coefficient (PCC). Tumor quantification was assessed by comparing the maximum standardized uptake value (SUVmax) and peak SUV (SUVpeak) of reconstructed images from the various list mode datasets using elastic motion deblurring (EMDB) reconstruction. Perceived motion blur was assessed by three radiologists of one lesion per patient on a continuous scale from no motion blur (0) to significant motion blur (3). The mean PCC of the 50% and 25% dataset waveforms was 0.74 ± 0.18 and 0.59 ± 0.25, respectively. In comparison to the 100% datasets, the mean SUVmax increased by 2.25% (p = 0.11) for the 50% datasets and by 3.91% (p = 0.16) for the 25% datasets, while SUVpeak changes were within ±0.25%. Radiologist evaluations of motion blur showed negligible changes with average values of 0.21, 0.3, and 0.28 for the 100%, 50%, and 25% datasets. Decreased injected activities degrades the resultant CBM_DDG respiratory waveforms; however this decrease has minimal impact on quantification and perceived image motion blur.
Collapse
Affiliation(s)
- Joseph G Meier
- Department of Imaging Physics, MD Anderson Cancer Center, Houston, USA.,MD Anderson Cancer Center UTHealth Science Center, Houston Graduate School of Biomedical Sciences, Houston, Texas, USA
| | - Radwan H Diab
- Department of Internal Medicine, Kansas University School of Medicine, Wichita, Kansas, USA
| | - Trevor M Connor
- Department of Imaging Physics, MD Anderson Cancer Center, Houston, USA
| | - Osama R Mawlawi
- Department of Imaging Physics, MD Anderson Cancer Center, Houston, USA.,MD Anderson Cancer Center UTHealth Science Center, Houston Graduate School of Biomedical Sciences, Houston, Texas, USA
| |
Collapse
|
18
|
Thomas MA, Meier JG, Mawlawi OR, Sun P, Pan T. Impact of acquisition time and misregistration with CT on data-driven gated PET. Phys Med Biol 2022; 67:10.1088/1361-6560/ac5f73. [PMID: 35313286 PMCID: PMC9128538 DOI: 10.1088/1361-6560/ac5f73] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Accepted: 03/21/2022] [Indexed: 11/11/2022]
Abstract
Objective. Data-driven gating (DDG) can address patient motion issues and enhance PET quantification but suffers from increased image noise from utilization of <100% of PET data. Misregistration between DDG-PET and CT may also occur, altering the potential benefits of gating. Here, the effects of PET acquisition time and CT misregistration were assessed with a combined DDG-PET/DDG-CT technique.Approach. In the primary PET bed with lesions of interest and likely respiratory motion effects, PET acquisition time was extended to 12 min and a low-dose cine CT was acquired to enable DDG-CT. Retrospective reconstructions were created for both non-gated (NG) and DDG-PET using 30 s to 12 min of PET data. Both the standard helical CT and DDG-CT were used for attenuation correction of DDG-PET data. SUVmax, SUVpeak, and CNR were compared for 45 lesions in the liver and lung from 27 cases.Main results. For both NG-PET (p= 0.0041) and DDG-PET (p= 0.0028), only the 30 s acquisition time showed clear SUVmaxbias relative to the 3 min clinical standard. SUVpeakshowed no bias at any change in acquisition time. DDG-PET alone increased SUVmaxby 15 ± 20% (p< 0.0001), then was increased further by an additional 15 ± 29% (p= 0.0007) with DDG-PET/CT. Both 3 min and 6 min DDG-PET had lesion CNR statistically equivalent to 3 min NG-PET, but then increased at 12 min by 28 ± 48% (p= 0.0022). DDG-PET/CT at 6 min had comparable counts to 3 min NG-PET, but significantly increased CNR by 39 ± 46% (p< 0.0001).Significance. 50% counts DDG-PET did not lead to inaccurate or biased SUV-increased SUV resulted from gating. Improved registration from DDG-CT was equally as important as motion correction with DDG-PET for increasing SUV in DDG-PET/CT. Lesion detectability could be significantly improved when DDG-PET used equivalent counts to NG-PET, but only when combined with DDG-CT in DDG-PET/CT.
Collapse
Affiliation(s)
- M. Allan Thomas
- Department of Imaging Physics, UT MD Anderson Cancer Center, Houston, TX 77030
| | - Joseph G. Meier
- Department of Medical Physics, University of Wisconsin, Madison, WI 53726
| | - Osama R. Mawlawi
- Department of Imaging Physics, UT MD Anderson Cancer Center, Houston, TX 77030
| | - Peng Sun
- Department of Imaging Physics, UT MD Anderson Cancer Center, Houston, TX 77030
| | - Tinsu Pan
- Department of Imaging Physics, UT MD Anderson Cancer Center, Houston, TX 77030
| |
Collapse
|
19
|
Chen S, Fraum TJ, Eldeniz C, Mhlanga J, Gan W, Vahle T, Krishnamurthy UB, Faul D, Gach HM, Binkley MM, Kamilov US, Laforest R, An H. MR-assisted PET respiratory motion correction using deep-learning based short-scan motion fields. Magn Reson Med 2022; 88:676-690. [PMID: 35344592 DOI: 10.1002/mrm.29233] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 02/03/2022] [Accepted: 02/23/2022] [Indexed: 11/11/2022]
Abstract
PURPOSE We evaluated the impact of PET respiratory motion correction (MoCo) in a phantom and patients. Moreover, we proposed and examined a PET MoCo approach using motion vector fields (MVFs) from a deep-learning reconstructed short MRI scan. METHODS The evaluation of PET MoCo was performed in a respiratory motion phantom study with varying lesion sizes and tumor to background ratios (TBRs) using a static scan as the ground truth. MRI-based MVFs were derived from either 2000 spokes (MoCo2000 , 5-6 min acquisition time) using a Fourier transform reconstruction or 200 spokes (MoCoP2P200 , 30-40 s acquisition time) using a deep-learning Phase2Phase (P2P) reconstruction and then incorporated into PET MoCo reconstruction. For six patients with hepatic lesions, the performance of PET MoCo was evaluated using quantitative metrics (SUVmax , SUVpeak , SUVmean , lesion volume) and a blinded radiological review on lesion conspicuity. RESULTS MRI-assisted PET MoCo methods provided similar results to static scans across most lesions with varying TBRs in the phantom. Both MoCo2000 and MoCoP2P200 PET images had significantly higher SUVmax , SUVpeak , SUVmean and significantly lower lesion volume than non-motion-corrected (non-MoCo) PET images. There was no statistical difference between MoCo2000 and MoCoP2P200 PET images for SUVmax , SUVpeak , SUVmean or lesion volume. Both radiological reviewers found that MoCo2000 and MoCoP2P200 PET significantly improved lesion conspicuity. CONCLUSION An MRI-assisted PET MoCo method was evaluated using the ground truth in a phantom study. In patients with hepatic lesions, PET MoCo images improved quantitative and qualitative metrics based on only 30-40 s of MRI motion modeling data.
Collapse
Affiliation(s)
- Sihao Chen
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO, USA
| | - Tyler J Fraum
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Cihat Eldeniz
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Joyce Mhlanga
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Weijie Gan
- Department of Computer Science & Engineering, Washington University in St. Louis, St. Louis, MO, USA
| | | | | | - David Faul
- Siemens Medical Solutions USA, Inc., Malvern, PA, USA
| | - H Michael Gach
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO, USA.,Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Radiation Oncology, Washington University in St. Louis, St. Louis, MO, USA
| | - Michael M Binkley
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Ulugbek S Kamilov
- Department of Computer Science & Engineering, Washington University in St. Louis, St. Louis, MO, USA.,Department of Electrical & Systems Engineering, Washington University in St. Louis, St. Louis, MO, USA
| | - Richard Laforest
- Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Hongyu An
- Department of Biomedical Engineering, Washington University in St. Louis, St. Louis, MO, USA.,Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA.,Department of Electrical & Systems Engineering, Washington University in St. Louis, St. Louis, MO, USA
| |
Collapse
|
20
|
Pan T, Thomas MA, Luo D. Data-driven gated (DDG) CT: An automated respiratory gating method to enable DDG PET/CT. Med Phys 2022; 49:3597-3611. [PMID: 35324002 DOI: 10.1002/mp.15620] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 02/23/2022] [Accepted: 02/23/2022] [Indexed: 11/07/2022] Open
Abstract
BACKGROUND The accuracy of PET quantification and localization can be compromised if a misregistered CT is used for attenuation correction (AC) in PET/CT. As data-driven gating (DDG) continues to grow in clinical use, these issues are becoming more relevant with respect to solutions for gated CT. PURPOSE In this work, a new automated data-driven gated (DDG) CT method was developed to provide average CT and DDG CT for AC of PET and DDG PET, respectively. METHODS An automatic DDG CT was developed to provide the end-expiratory (EE) and end-inspiratory (EI) phases of images from low-dose cine CT images, with all phases being averaged to generate an average CT. The respiratory phases of EE and EI were determined according to lung region Hounsfield unit (HU) values and body outline contours. The average CT was used for AC of baseline PET and DDG CT at EE phase was used for AC of DDG PET at the quiescent or EE phase. The EI and EE phases obtained with DDG CT were used for assessing the magnitude of respiratory motion. The proposed DDG CT was compared to two commercial CT gating methods: 1) 4D CT (external device based) and 2) D4D CT (DDG based) in 38 patient data sets with respect to respiratory phase image selection, lung HU, lung volume, and image artifacts. In a separate set of twenty consecutive PET/CT studies containing a mix of 18 F-FDG, 68 Ga-Dotatate, and 64 Cu-Dotatate scans, the proposed DDG CT was compared with D4D CT for impacts on registration and quantification in DDG PET/CT. RESULTS In the EE phase, the images selected by DDG CT and 4D CT were identical 62.5±21.6% of the time, while DDG CT and D4D CT were 6.5±9.7%, and 4D CT and D4D CT were 8.6±12.2%. These differences in EE phase image selection were significant (p<0.0001). In the EI phase, the images selected by DDG CT and 4D CT were identical 68.2±18.9% of the time, DDG CT and D4D CT were 63.9±18.8%, and 4D CT and D4D CT were 61.2±19.8%. These differences were not significant. The mean lung HU and volumes were not statistically different (p > 0.1) among the three methods. In some studies, DDG CT was better than D4D or 4D CT in appropriate selection of the EE and EI phases, and D4D CT was found to reverse the EE and EI phases or not select the correct images by visual inspection. A statistically significant improvement of DDG CT over D4D CT for AC of DDG PET was also demonstrated with PET quantification analysis. When irregular breath cycles were present in the cine CT, DDG CT could be used to replace average CT for improved AC of baseline PET. CONCLUSION A new automatic DDG CT was developed to tackle the issues of misregistration and tumor motion in PET/CT imaging. DDG CT was significantly more consistent than D4D CT in selecting the EE phase images as the clinical standard of 4D CT. When compared to both commercial gated CT methods of 4D CT and D4D CT, DDG CT appeared to be more robust in the lower lung and upper diaphragm regions where misregistration and tumor motion often occur. DDG CT offered improved AC for DDG PET relative to D4D CT. In cases with irregular respiratory motion, DDG CT improved AC over average CT for baseline PET. The new DDG CT provides the benefits of 4D CT without the need for external device gating. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Tinsu Pan
- Department of Imaging Physics, M.D. Anderson Cancer Center, University of Texas, Houston, Texas, USA
| | - M Allan Thomas
- Department of Imaging Physics, M.D. Anderson Cancer Center, University of Texas, Houston, Texas, USA
| | - Dershan Luo
- Department of Radiation Physics, M.D. Anderson Cancer Center, University of Texas, Houston, Texas, USA
| |
Collapse
|
21
|
Prime Time for Artificial Intelligence in Interventional Radiology. Cardiovasc Intervent Radiol 2022; 45:283-289. [PMID: 35031822 PMCID: PMC8921296 DOI: 10.1007/s00270-021-03044-4] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2021] [Accepted: 11/28/2021] [Indexed: 12/16/2022]
Abstract
Machine learning techniques, also known as artificial intelligence (AI), is about to dramatically change workflow and diagnostic capabilities in diagnostic radiology. The interest in AI in Interventional Radiology is rapidly gathering pace. With this early interest in AI in procedural medicine, IR could lead the way to AI research and clinical applications for all interventional medical fields. This review will address an overview of machine learning, radiomics and AI in the field of interventional radiology, enumerating the possible applications of such techniques, while also describing techniques to overcome the challenge of limited data when applying these techniques in interventional radiology. Lastly, this review will address common errors in research in this field and suggest pathways for those interested in learning and becoming involved about AI.
Collapse
|
22
|
Lamare F, Bousse A, Thielemans K, Liu C, Merlin T, Fayad H, Visvikis D. PET respiratory motion correction: quo vadis? Phys Med Biol 2021; 67. [PMID: 34915465 DOI: 10.1088/1361-6560/ac43fc] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 12/16/2021] [Indexed: 11/12/2022]
Abstract
Positron emission tomography (PET) respiratory motion correction has been a subject of great interest for the last twenty years, prompted mainly by the development of multimodality imaging devices such as PET/computed tomography (CT) and PET/magnetic resonance imaging (MRI). PET respiratory motion correction involves a number of steps including acquisition synchronization, motion estimation and finally motion correction. The synchronization steps include the use of different external device systems or data driven approaches which have been gaining ground over the last few years. Patient specific or generic motion models using the respiratory synchronized datasets can be subsequently derived and used for correction either in the image space or within the image reconstruction process. Similar overall approaches can be considered and have been proposed for both PET/CT and PET/MRI devices. Certain variations in the case of PET/MRI include the use of MRI specific sequences for the registration of respiratory motion information. The proposed review includes a comprehensive coverage of all these areas of development in field of PET respiratory motion for different multimodality imaging devices and approaches in terms of synchronization, estimation and subsequent motion correction. Finally, a section on perspectives including the potential clinical usage of these approaches is included.
Collapse
Affiliation(s)
- Frederic Lamare
- Nuclear Medicine Department, University Hospital Centre Bordeaux Hospital Group South, ., Bordeaux, Nouvelle-Aquitaine, 33604, FRANCE
| | - Alexandre Bousse
- LaTIM, INSERM UMR1101, Université de Bretagne Occidentale, ., Brest, Bretagne, 29285, FRANCE
| | - Kris Thielemans
- University College London Institute of Nuclear Medicine, UCL Hospital, Tower 5, 235 Euston Road, London, NW1 2BU, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Chi Liu
- Department of Diagnostic Radiology, Yale University School of Medicine Department of Radiology and Biomedical Imaging, PO Box 208048, 801 Howard Avenue, New Haven, Connecticut, 06520-8042, UNITED STATES
| | - Thibaut Merlin
- LaTIM, INSERM UMR1101, Universite de Bretagne Occidentale, ., Brest, Bretagne, 29285, FRANCE
| | - Hadi Fayad
- Weill Cornell Medicine - Qatar, ., Doha, ., QATAR
| | - Dimitris Visvikis
- LaTIM, UMR1101, Universite de Bretagne Occidentale, INSERM, Brest, Bretagne, 29285, FRANCE
| |
Collapse
|
23
|
Shi L, Lu Y, Dvornek N, Weyman CA, Miller EJ, Sinusas AJ, Liu C. Automatic Inter-Frame Patient Motion Correction for Dynamic Cardiac PET Using Deep Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3293-3304. [PMID: 34018932 PMCID: PMC8670362 DOI: 10.1109/tmi.2021.3082578] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
Patient motion during dynamic PET imaging can induce errors in myocardial blood flow (MBF) estimation. Motion correction for dynamic cardiac PET is challenging because the rapid tracer kinetics of 82Rb leads to substantial tracer distribution change across different dynamic frames over time, which can cause difficulties for image registration-based motion correction, particularly for early dynamic frames. In this paper, we developed an automatic deep learning-based motion correction (DeepMC) method for dynamic cardiac PET. In this study we focused on the detection and correction of inter-frame rigid translational motion caused by voluntary body movement and pattern change of respiratory motion. A bidirectional-3D LSTM network was developed to fully utilize both local and nonlocal temporal information in the 4D dynamic image data for motion detection. The network was trained and evaluated over motion-free patient scans with simulated motion so that the motion ground-truths are available, where one million samples based on 65 patient scans were used in training, and 600 samples based on 20 patient scans were used in evaluation. The proposed method was also evaluated using additional 10 patient datasets with real motion. We demonstrated that the proposed DeepMC obtained superior performance compared to conventional registration-based methods and other convolutional neural networks (CNN), in terms of motion estimation and MBF quantification accuracy. Once trained, DeepMC is much faster than the registration-based methods and can be easily integrated into the clinical workflow. In the future work, additional investigation is needed to evaluate this approach in a clinical context with realistic patient motion.
Collapse
|
24
|
Low-Dose PET Imaging of Tumors in Lung and Liver Regions Using Internal Motion Estimation. Diagnostics (Basel) 2021; 11:diagnostics11112138. [PMID: 34829485 PMCID: PMC8625002 DOI: 10.3390/diagnostics11112138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 11/12/2021] [Accepted: 11/15/2021] [Indexed: 11/23/2022] Open
Abstract
Motion estimation and compensation are necessary for improvement of tumor quantification analysis in positron emission tomography (PET) images. The aim of this study was to propose adaptive PET imaging with internal motion estimation and correction using regional artificial evaluation of tumors injected with low-dose and high-dose radiopharmaceuticals. In order to assess internal motion, molecular sieves imitating tumors were loaded with 18F and inserted into the lung and liver regions in rats. All models were classified into two groups, based on the injected radiopharmaceutical activity, to compare the effect of tumor intensity. The PET study was performed with injection of F-18 fluorodeoxyglucose (18F-FDG). Respiratory gating was carried out by external trigger device. Count, signal to noise ratio (SNR), contrast and full width at half maximum (FWHM) were measured in artificial tumors in gated images. Motion correction was executed by affine transformation with estimated internal motion data. Monitoring data were different from estimated motion. Contrast in the low-activity group was 3.57, 4.08 and 6.19, while in the high-activity group it was 10.01, 8.36 and 6.97 for static, 4 bin and 8 bin images, respectively. The results of the lung target in 4 bin and the liver target in 8 bin showed improvement in FWHM and contrast with sufficient SNR. After motion correction, FWHM was improved in both regions (lung: 24.56%, liver: 10.77%). Moreover, with the low dose of radiopharmaceuticals the PET image visualized specific accumulated radiopharmaceutical areas in the liver. Therefore, low activity in PET images should undergo motion correction before quantification analysis using PET data. We could improve quantitative tumor evaluation by considering organ region and tumor intensity.
Collapse
|
25
|
Sun Z, Du J. Suppression of motion artifacts in intravascular photoacoustic image sequences. BIOMEDICAL OPTICS EXPRESS 2021; 12:6909-6927. [PMID: 34858688 PMCID: PMC8606127 DOI: 10.1364/boe.440975] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Revised: 10/10/2021] [Accepted: 10/10/2021] [Indexed: 05/25/2023]
Abstract
Intravascular photoacoustic (IVPA) imaging is an image-based imaging modality for the assessment of atherosclerotic plaques. Successful application of IVPA for in vivo coronary arterial imaging requires one overcomes the challenge of motion artifacts associated with the cardiac cycle. We propose a method for correcting artifacts owing to cardiac motion, which are observed in sequential IVPA images acquired by the continuous pullback of the imaging catheter. This method groups raw photoacoustic signals into subsets corresponding to similar phases in the cardiac cycles. Thereafter, the sequential images are reconstructed, by representing the initial pressure distribution on the vascular cross-sections based on the clustered frames of signals by time reversal. Results of simulation data demonstrate the efficacy of this method in suppressing motion artifacts. Qualitative and quantitative evaluations of the method indicate an enhancement of the image quality. Comparison results reveal that this method is computationally efficient in motion correction compared with the image-based gating.
Collapse
Affiliation(s)
- Zheng Sun
- Department of Electronic and Communication Engineering, North China Electric Power University, Baoding 071003, Hebei, China
- Hebei Key Laboratory of Power Internet of Things Technology, North China Electric Power University, Baoding 071003, Hebei, China
| | - Jiejie Du
- Department of Electronic and Communication Engineering, North China Electric Power University, Baoding 071003, Hebei, China
- Hebei Key Laboratory of Power Internet of Things Technology, North China Electric Power University, Baoding 071003, Hebei, China
| |
Collapse
|
26
|
Zhou B, Tsai YJ, Chen X, Duncan JS, Liu C. MDPET: A Unified Motion Correction and Denoising Adversarial Network for Low-Dose Gated PET. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3154-3164. [PMID: 33909561 PMCID: PMC8588635 DOI: 10.1109/tmi.2021.3076191] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
In positron emission tomography (PET), gating is commonly utilized to reduce respiratory motion blurring and to facilitate motion correction methods. In application where low-dose gated PET is useful, reducing injection dose causes increased noise levels in gated images that could corrupt motion estimation and subsequent corrections, leading to inferior image quality. To address these issues, we propose MDPET, a unified motion correction and denoising adversarial network for generating motion-compensated low-noise images from low-dose gated PET data. Specifically, we proposed a Temporal Siamese Pyramid Network (TSP-Net) with basic units made up of 1.) Siamese Pyramid Network (SP-Net), and 2.) a recurrent layer for motion estimation among the gates. The denoising network is unified with our motion estimation network to simultaneously correct the motion and predict a motion-compensated denoised PET reconstruction. The experimental results on human data demonstrated that our MDPET can generate accurate motion estimation directly from low-dose gated images and produce high-quality motion-compensated low-noise reconstructions. Comparative studies with previous methods also show that our MDPET is able to generate superior motion estimation and denoising performance. Our code is available at https://github.com/bbbbbbzhou/MDPET.
Collapse
|
27
|
Mostafapour S, Gholamiankhah F, Dadgar H, Arabi H, Zaidi H. Feasibility of Deep Learning-Guided Attenuation and Scatter Correction of Whole-Body 68Ga-PSMA PET Studies in the Image Domain. Clin Nucl Med 2021; 46:609-615. [PMID: 33661195 DOI: 10.1097/rlu.0000000000003585] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE This study evaluates the feasibility of direct scatter and attenuation correction of whole-body 68Ga-PSMA PET images in the image domain using deep learning. METHODS Whole-body 68Ga-PSMA PET images of 399 subjects were used to train a residual deep learning model, taking PET non-attenuation-corrected images (PET-nonAC) as input and CT-based attenuation-corrected PET images (PET-CTAC) as target (reference). Forty-six whole-body 68Ga-PSMA PET images were used as an independent validation dataset. For validation, synthetic deep learning-based attenuation-corrected PET images were assessed considering the corresponding PET-CTAC images as reference. The evaluation metrics included the mean absolute error (MAE) of the SUV, peak signal-to-noise ratio, and structural similarity index (SSIM) in the whole body, as well as in different regions of the body, namely, head and neck, chest, and abdomen and pelvis. RESULTS The deep learning-guided direct attenuation and scatter correction produced images of comparable visual quality to PET-CTAC images. It achieved an MAE, relative error (RE%), SSIM, and peak signal-to-noise ratio of 0.91 ± 0.29 (SUV), -2.46% ± 10.10%, 0.973 ± 0.034, and 48.171 ± 2.964, respectively, within whole-body images of the independent external validation dataset. The largest RE% was observed in the head and neck region (-5.62% ± 11.73%), although this region exhibited the highest value of SSIM metric (0.982 ± 0.024). The MAE (SUV) and RE% within the different regions of the body were less than 2.0% and 6%, respectively, indicating acceptable performance of the deep learning model. CONCLUSIONS This work demonstrated the feasibility of direct attenuation and scatter correction of whole-body 68Ga-PSMA PET images in the image domain using deep learning with clinically tolerable errors. The technique has the potential of performing attenuation correction on stand-alone PET or PET/MRI systems.
Collapse
Affiliation(s)
- Samaneh Mostafapour
- From the Department of Radiology Technology, Faculty of Paramedical Sciences, Mashhad University of Medical Sciences, Mashhad
| | - Faeze Gholamiankhah
- Department of Medical Physics, Faculty of Medicine, Shahid Sadoughi University of Medical Sciences, Yazd
| | - Habibollah Dadgar
- Cancer Research Center, Razavi Hospital, Imam Reza International University, Mashhad, Iran
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular Imaging, Department of Medical Imaging, Geneva University Hospital, CH-1211 Geneva 4
| | | |
Collapse
|
28
|
Muraoka Y, Yoshida Y, Nakagawa K, Ito K, Watanabe H, Narita T, Watanabe SI, Yotsukura M, Motoi N, Yatabe Y. Maximum standardized uptake value of the primary tumor does not improve candidate selection for sublobar resection. J Thorac Cardiovasc Surg 2021; 163:1656-1665.e3. [PMID: 34275620 DOI: 10.1016/j.jtcvs.2021.06.053] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Revised: 06/15/2021] [Accepted: 06/21/2021] [Indexed: 12/25/2022]
Abstract
OBJECTIVE This retrospective study examined whether adding the maximum standardized uptake value of a primary tumor to the consolidation-to-tumor ratio from a high-resolution computed tomography scan can improve the predictive accuracy for pathological noninvasive lung cancer and lead to better patient selection for sublobar resection. METHODS We included 926 patients with clinical stage IA non-small cell lung cancer. Pathological noninvasive cancer (n = 515) was defined as any case without lymphatic invasion, vascular invasion, or lymph node metastasis. The prediction accuracies of maximum standardized uptake value and consolidation-to-tumor ratio were evaluated using receiver operating characteristic curves and area under the curve. RESULTS For consolidation-to-tumor ratio or maximum standardized uptake value alone, the area under the curves were 0.733 (95% confidence interval, 0.708-0.758) and 0.842 (95% confidence interval, 0.816-0.866), respectively. When the consolidation-to-tumor ratio and maximum standardized uptake value were combined, the area under the curve was 0.854 (95% confidence interval, 0.829-0.876). However, to obtain a predictive specificity of 97%, sensitivity needed to be 42.5% for the consolidation-to-tumor ratio, 38.3% for the maximum standardized uptake value, and 45.0% for these 2 in combination. CONCLUSIONS Our results suggest that despite the high area under the curve for maximum standardized uptake value, caution is needed when using maximum standardized uptake value to select candidates for sublobar resection. We found that a low maximum standardized uptake value did not mean the tumor was a pathological noninvasive lung cancer. Therefore, using consolidation-to-tumor ratios from high-resolution computed tomography to decide whether sublobar resection is appropriate for patients with clinical stage IA non-small cell lung cancer is better than using maximum standardized uptake value when setting specificity to a conservative 97% for predicting pathological noninvasive lung cancer.
Collapse
Affiliation(s)
- Yuji Muraoka
- Department of Thoracic Surgery, National Cancer Center Hospital, Tokyo, Japan
| | - Yukihiro Yoshida
- Department of Thoracic Surgery, National Cancer Center Hospital, Tokyo, Japan.
| | - Kazuo Nakagawa
- Department of Thoracic Surgery, National Cancer Center Hospital, Tokyo, Japan
| | - Kimiteru Ito
- Department of Diagnostic Radiology, National Cancer Center Hospital, Tokyo, Japan
| | - Hirokazu Watanabe
- Department of Diagnostic Radiology, National Cancer Center Hospital, Tokyo, Japan
| | | | - Shun-Ichi Watanabe
- Department of Thoracic Surgery, National Cancer Center Hospital, Tokyo, Japan
| | | | - Masaya Yotsukura
- Department of Thoracic Surgery, National Cancer Center Hospital, Tokyo, Japan
| | - Noriko Motoi
- Department of Diagnostic Pathology, National Cancer Center Hospital, Tokyo, Japan
| | - Yasushi Yatabe
- Department of Diagnostic Pathology, National Cancer Center Hospital, Tokyo, Japan
| |
Collapse
|
29
|
Hwang D, Kang SK, Kim KY, Choi H, Seo S, Lee JS. Data-driven respiratory phase-matched PET attenuation correction without CT. Phys Med Biol 2021; 66. [PMID: 33910170 DOI: 10.1088/1361-6560/abfc8f] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Accepted: 04/28/2021] [Indexed: 12/20/2022]
Abstract
We propose a deep learning-based data-driven respiratory phase-matched gated-PET attenuation correction (AC) method that does not need a gated-CT. The proposed method is a multi-step process that consists of data-driven respiratory gating, gated attenuation map estimation using maximum-likelihood reconstruction of attenuation and activity (MLAA) algorithm, and enhancement of the gated attenuation maps using convolutional neural network (CNN). The gated MLAA attenuation maps enhanced by the CNN allowed for the phase-matched AC of gated-PET images. We conducted a non-rigid registration of the gated-PET images to generate motion-free PET images. We trained the CNN by conducting a 3D patch-based learning with 80 oncologic whole-body18F-fluorodeoxyglucose (18F-FDG) PET/CT scan data and applied it to seven regional PET/CT scans that cover the lower lung and upper liver. We investigated the impact of the proposed respiratory phase-matched AC of PET without utilizing CT on tumor size and standard uptake value (SUV) assessment, and PET image quality (%STD). The attenuation corrected gated and motion-free PET images generated using the proposed method yielded sharper organ boundaries and better noise characteristics than conventional gated and ungated PET images. A banana artifact observed in a phase-mismatched CT-based AC was not observed in the proposed approach. By employing the proposed method, the size of tumor was reduced by 12.3% and SUV90%was increased by 13.3% in tumors with larger movements than 5 mm. %STD of liver uptake was reduced by 11.1%. The deep learning-based data-driven respiratory phase-matched AC method improved the PET image quality and reduced the motion artifacts.
Collapse
Affiliation(s)
- Donghwi Hwang
- Department of Biomedical Sciences, Seoul National University College of Medicine, Seoul, Republic of Korea.,Department of Nuclear Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Seung Kwan Kang
- Department of Biomedical Sciences, Seoul National University College of Medicine, Seoul, Republic of Korea.,Department of Nuclear Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Kyeong Yun Kim
- Department of Biomedical Sciences, Seoul National University College of Medicine, Seoul, Republic of Korea.,Department of Nuclear Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Hongyoon Choi
- Department of Nuclear Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Seongho Seo
- Department of Electronic Engineering, Pai Chai University, Daejeon, Republic of Korea
| | - Jae Sung Lee
- Department of Biomedical Sciences, Seoul National University College of Medicine, Seoul, Republic of Korea.,Department of Nuclear Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea.,Institute of Radiation Medicine, Medical Research Center, Seoul National University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
30
|
Kim JS, Park CR, Yoon SH, Lee JA, Kim TY, Yang HJ. Improvement of image quality using amplitude-based respiratory gating in PET-computed tomography scanning. Nucl Med Commun 2021; 42:553-565. [PMID: 33625179 DOI: 10.1097/mnm.0000000000001368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
OBJECTIVES This study sought to provide data supporting the expanded clinical use of respiratory gating by assessing the diagnostic accuracy of breathing motion correction using amplitude-based respiratory gating. METHODS A respiratory movement tracking device was attached to a PET-computed tomography scanner, and images were obtained in respiratory gating mode using a motion phantom that was capable of sensing vertical motion. Specifically, after setting amplitude changes and intervals according to the movement cycle using a total of nine combinations of three waveforms and three amplitude ranges, respiratory motion-corrected images were reconstructed using the filtered back projection method. After defining areas of interest in the acquired images in the same image planes, statistical analyses were performed to compare differences in standardized uptake value (SUV), lesion volume, full width at half maximum (FWHM), signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR). RESULTS SUVmax increased by 89.9%, and lesion volume decreased by 27.9%. Full width at half maximum decreased by 53.9%, signal-to-noise ratio increased by 11% and contrast-to-noise ratio increased by 16.3%. Optimal results were obtained when using a rest waveform and 35% duty cycle, in which the change in amplitude in the respiratory phase signal was low, and a constant level of long breaths was maintained. CONCLUSIONS These results demonstrate that respiratory-gated PET-CT imaging can be used to accurately correct for SUV changes and image distortion caused by respiratory motion, thereby providing excellent imaging information and quality.
Collapse
Affiliation(s)
- Jung-Soo Kim
- Department of Radiological Technology, Dongnam Health University, Suwon
- Department of Biomedical Science, The Korea University, Sejong
| | - Chan-Rok Park
- Department of Biomedical Science, The Korea University, Sejong
- Department of Nuclear Medicine, Seoul National University Hospital, Seoul
| | - Seok-Hwan Yoon
- Department of Biomedical Science, The Korea University, Sejong
- Department of Nuclear Medicine, Seoul National University Hospital, Seoul
| | - Joo-Ah Lee
- Department of Biomedical Science, The Korea University, Sejong
- Department of Radiation Oncology, Catholic University Incheon St. Mary's Hospital, Incheon
| | - Tae-Yoon Kim
- Department of Radiation Oncology, Catholic University Incheon St. Mary's Hospital, Incheon
- Department of Radiation Oncology, National Cancer Center, Goyang
| | - Hyung-Jin Yang
- Department of Radiation Oncology, Catholic University Incheon St. Mary's Hospital, Incheon
- Department of Physics, The Korea University, Sejong, Korea
| |
Collapse
|
31
|
New Data-Driven Gated PET/CT Free of Misregistration Artifacts. Int J Radiat Oncol Biol Phys 2021; 109:1638-1646. [PMID: 33186619 DOI: 10.1016/j.ijrobp.2020.11.014] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2020] [Revised: 10/30/2020] [Accepted: 11/05/2020] [Indexed: 10/23/2022]
Abstract
PURPOSE We developed a new data-driven gated (DDG) positron emission tomography (PET)/computed tomography (CT) to improve the registration of CT and DDG PET. METHODS We acquired 10 repeat PET/CT and 35 cine CT scans for the mitigation of misregistration between CT and PET data. We also derived end-expiration phase CT as DDG CT for attenuation correction of DDG PET. Radiation exposure, body mass index (BMI), scan coverage, and effective radiation dose were compared between repeat PET/CT and cine CT. Of the 35 cine CT patients, 14 (capturing 59 total tumors) were compared among average PET/CT (baseline PET attenuation correction by average CT), DDG PET (DDG PET attenuation correction by baseline CT), and DDG PET/CT (DDG PET attenuation correction by DDG CT) for registration and quantification without increasing the scan time for DDG PET. RESULTS Compared with repeat PET/CT, cine CT had significantly lower scan coverage (32.5 ± 11.5 cm vs 15.4 ± 4.7 cm; P < .001) and effective radiation dose (3.7 ± 2.6 mSv vs 1.3 ± 0.6 mSv; P < .01). Repeat PET/CT and cine CT did not differ significantly in BMI or radiation exposure (P > .1). Cine CT saved the scan time for not needing a repeat PET. The SUV ratios of average PET/CT, DDG PET, and DDG PET/CT to baseline PET/CT were 1.14 ± 0.28, 1.28 ± 0.20, and 1.63 ± 0.64, respectively (P < .0001), suggesting that the SUVmax increased consecutively from baseline PET/CT to average PET/CT, DDG PET, and DDG PET/CT. Motion correction with DDG PET had a larger impact on quantification than registration improvement with average CT did. The biggest improvement in quantification was from DDG PET/CT, in which both registration was improved and motion was mitigated. CONCLUSION Our new DDG PET/CT approach alleviates misregistration artifacts and, compared with DDG PET, improves quantification and registration. The use of cine CT in our DDG PET/CT method also reduces the effective radiation dose and scan coverage compared with repeat CT.
Collapse
|
32
|
Radiomics model of dual-time 2-[ 18F]FDG PET/CT imaging to distinguish between pancreatic ductal adenocarcinoma and autoimmune pancreatitis. Eur Radiol 2021; 31:6983-6991. [PMID: 33677645 DOI: 10.1007/s00330-021-07778-0] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 01/19/2021] [Accepted: 02/11/2021] [Indexed: 12/24/2022]
Abstract
OBJECTIVES Pancreatic ductal adenocarcinoma (PDAC) and autoimmune pancreatitis (AIP) are diseases with a highly analogous visual presentation that are difficult to distinguish by imaging. The purpose of this research was to create a radiomics-based prediction model using dual-time PET/CT imaging for the noninvasive classification of PDAC and AIP lesions. METHODS This retrospective study was performed on 112 patients (48 patients with AIP and 64 patients with PDAC). All cases were confirmed by imaging and clinical follow-up, and/or pathology. A total of 502 radiomics features were extracted from the dual-time PET/CT images to develop a radiomics decision model. An additional 12 maximum intensity projection (MIP) features were also calculated to further improve the radiomics model. The optimal radiomics feature set was selected by support vector machine recursive feature elimination (SVM-RFE), and the final classifier was built using a linear SVM. The performance of the proposed dual-time model was evaluated using nested cross-validation for accuracy, sensitivity, specificity, and area under the curve (AUC). RESULTS The final prediction model was developed from a combination of the SVM-RFE and linear SVM with the required quantitative features. The multimodal and multidimensional features performed well for classification (average AUC: 0.9668, accuracy: 89.91%, sensitivity: 85.31%, specificity: 96.04%). CONCLUSIONS The radiomics model based on 2-[18F]fluoro-2-deoxy-D-glucose (2-[18F]FDG) PET/CT dual-time images provided promising performance for discriminating between patients with benign AIP and malignant PDAC lesions, which shows its potential for use as a diagnostic tool for clinical decision-making. KEY POINTS • The clinical symptoms and imaging visual presentations of PDAC and AIP are highly similar, and accurate differentiation of PDAC and AIP lesions is difficult. • Radiomics features provided a potential noninvasive method for differentiation of AIP from PDAC. • The diagnostic performance of the proposed radiomics model indicates its potential to assist doctors in making treatment decisions.
Collapse
|
33
|
Malbert CH, Chauvin A, Horowitz M, Jones KL. Glucose Sensing Mediated by Portal Glucagon-Like Peptide 1 Receptor Is Markedly Impaired in Insulin-Resistant Obese Animals. Diabetes 2021; 70:99-110. [PMID: 33067312 DOI: 10.2337/db20-0361] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/09/2020] [Accepted: 10/06/2020] [Indexed: 02/05/2023]
Abstract
The glucose portal sensor informs the brain of changes in glucose inflow through vagal afferents that require an activated glucagon-like peptide 1 receptor (GLP-1r). The GLP-1 system is known to be impaired in insulin-resistant conditions, and we sought to understand the consequences of GLP-1 resistance on glucose portal signaling. GLP-1-dependent portal glucose signaling was identified, in vivo, using a novel 68Ga-labeled GLP-1r positron-emitting probe that supplied a quantitative in situ tridimensional representation of the portal sensor with specific reference to the receptor density expressed in binding potential units. It also served as a map for single-neuron electrophysiology driven by an image-based abdominal navigation. We determined that in insulin-resistant animals, portal vagal afferents failed to inhibit their spiking activity during glucose infusion, a GLP-1r-dependent function. This reflected a reduction in portal GLP-1r binding potential, particularly between the splenic vein and the entrance of the liver. We propose that insulin resistance, through a reduction in GLP-1r density, leads to functional portal desensitization with a consequent suppression of vagal sensitivity to portal glucose.
Collapse
Affiliation(s)
| | - Alain Chauvin
- UEPR Unit, Department of Animal Physiology, INRAE, Saint-Gilles, France
| | - Michael Horowitz
- Centre of Research Excellence in Translating Nutritional Science to Good Health, Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, Australia
| | - Karen L Jones
- Centre of Research Excellence in Translating Nutritional Science to Good Health, Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, Australia
| |
Collapse
|
34
|
Lu Y, Liu C. Patient motion correction for dynamic cardiac PET: Current status and challenges. J Nucl Cardiol 2020; 27:1999-2002. [PMID: 30421380 DOI: 10.1007/s12350-018-01513-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2018] [Accepted: 10/29/2018] [Indexed: 11/29/2022]
Affiliation(s)
- Yihuan Lu
- Department of Radiology and Biomedical Imaging, Yale University, 789 Howard Ave., New Haven, CT, 06519-1368, USA
| | - Chi Liu
- Department of Radiology and Biomedical Imaging, Yale University, 789 Howard Ave., New Haven, CT, 06519-1368, USA.
| |
Collapse
|
35
|
Emond EC, Bousse A, Brusaferri L, Hutton BF, Thielemans K. Improved PET/CT Respiratory Motion Compensation by Incorporating Changes in Lung Density. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2020. [DOI: 10.1109/trpms.2020.3001094] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
36
|
Vergalasova I, Cai J. A modern review of the uncertainties in volumetric imaging of respiratory-induced target motion in lung radiotherapy. Med Phys 2020; 47:e988-e1008. [PMID: 32506452 DOI: 10.1002/mp.14312] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2019] [Revised: 05/15/2020] [Accepted: 05/26/2020] [Indexed: 12/25/2022] Open
Abstract
Radiotherapy has become a critical component for the treatment of all stages and types of lung cancer, often times being the primary gateway to a cure. However, given that radiation can cause harmful side effects depending on how much surrounding healthy tissue is exposed, treatment of the lung can be particularly challenging due to the presence of moving targets. Careful implementation of every step in the radiotherapy process is absolutely integral for attaining optimal clinical outcomes. With the advent and now widespread use of stereotactic body radiation therapy (SBRT), where extremely large doses are delivered, accurate, and precise dose targeting is especially vital to achieve an optimal risk to benefit ratio. This has largely become possible due to the rapid development of image-guided technology. Although imaging is critical to the success of radiotherapy, it can often be plagued with uncertainties due to respiratory-induced target motion. There has and continues to be an immense research effort aimed at acknowledging and addressing these uncertainties to further our abilities to more precisely target radiation treatment. Thus, the goal of this article is to provide a detailed review of the prevailing uncertainties that remain to be investigated across the different imaging modalities, as well as to highlight the more modern solutions to imaging motion and their role in addressing the current challenges.
Collapse
Affiliation(s)
- Irina Vergalasova
- Department of Radiation Oncology, Rutgers Cancer Institute of New Jersey, Rutgers University, New Brunswick, NJ, USA
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong
| |
Collapse
|
37
|
Li T, Zhang M, Qi W, Asma E, Qi J. Motion correction of respiratory-gated PET images using deep learning based image registration framework. Phys Med Biol 2020; 65:155003. [PMID: 32244230 PMCID: PMC7446936 DOI: 10.1088/1361-6560/ab8688] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Artifacts caused by patient breathing and movement during PET data acquisition affect image quality. Respiratory gating is commonly used to gate the list-mode PET data into multiple bins over a respiratory cycle. Non-rigid registration of respiratory-gated PET images can reduce motion artifacts and preserve count statistics, but it is time consuming. In this work, we propose an unsupervised non-rigid image registration framework using deep learning for motion correction. Our network uses a differentiable spatial transformer layer to warp the moving image to the fixed image and uses a stacked structure for deformation field refinement. Estimated deformation fields were incorporated into an iterative image reconstruction algorithm to perform motion compensated PET image reconstruction. We validated the proposed method using simulation and clinical data and implemented an iterative image registration approach for comparison. Motion compensated reconstructions were compared with ungated images. Our simulation study showed that the motion compensated methods can generate images with sharp boundaries and reveal more details in the heart region compared with the ungated image. The resulting normalized root mean square error (NRMS) was 24.3 ± 1.7% for the deep learning based motion correction, 31.1 ± 1.4% for the iterative registration based motion correction, and 41.9 ± 2.0% for ungated reconstruction. The proposed deep learning based motion correction reduced the bias compared with the ungated image without increasing the noise level and outperformed the iterative registration based method. In the real data study, both motion compensated images provided higher lesion contrast and sharper liver boundaries than the ungated image and had lower noise than the reference gate image. The contrast of the proposed method based on the deep neural network was higher than the ungated image and iterative registration method at any matched noise level.
Collapse
Affiliation(s)
- Tiantian Li
- Department of Biomedical Engineering, University of California, Davis, CA 95616, United States of America
| | | | | | | | | |
Collapse
|
38
|
Gratz M, Ruhlmann V, Umutlu L, Fenchel M, Hong I, Quick HH. Impact of respiratory motion correction on lesion visibility and quantification in thoracic PET/MR imaging. PLoS One 2020; 15:e0233209. [PMID: 32497135 PMCID: PMC7272064 DOI: 10.1371/journal.pone.0233209] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2019] [Accepted: 04/30/2020] [Indexed: 01/04/2023] Open
Abstract
The impact of a method for MR-based respiratory motion correction of PET data on lesion visibility and quantification in patients with oncologic findings in the lung was evaluated. Twenty patients with one or more lesions in the lung were included. Hybrid imaging was performed on an integrated PET/MR system using 18F-FDG as radiotracer. The standard thoracic imaging protocol was extended by a free-breathing self-gated acquisition of MR data for motion modelling. PET data was acquired simultaneously in list-mode for 5-10 mins. One experienced radiologist and one experienced nuclear medicine specialist evaluated and compared the post-processed data in consensus regarding lesion visibility (scores 1-4, 4 being best), image noise levels (scores 1-3, 3 being lowest noise), SUVmean and SUVmax. Motion-corrected (MoCo) images were additionally compared with gated images. Non-motion-corrected free-breathing data served as standard of reference in this study. Motion correction generally improved lesion visibility (3.19 ± 0.63) and noise ratings (2.95 ± 0.22) compared to uncorrected (2.81 ± 0.66 and 2.95 ± 0.22, respectively) or gated PET data (2.47 ± 0.93 and 1.30 ± 0.47, respectively). Furthermore, SUVs (mean and max) were compared for all methods to estimate their respective impact on the quantification. Deviations of SUVmax were smallest between the uncorrected and the MoCo lesion data (average increase of 9.1% of MoCo SUVs), while SUVmean agreed best for gated and MoCo reconstructions (MoCo SUVs increased by 1.2%). The studied method for MR-based respiratory motion correction of PET data combines increased lesion sharpness and improved lesion activity quantification with high signal-to-noise ratio in a clinical setting. In particular, the detection of small lesions in moving organs such as the lung and liver may thus be facilitated. These advantages justify the extension of the PET/MR imaging protocol by 5-10 minutes for motion correction.
Collapse
Affiliation(s)
- Marcel Gratz
- Erwin L. Hahn Institute for Magnetic Resonance Imaging, University of Duisburg Essen, Essen, Germany
- High Field and Hybrid MR Imaging, University of Duisburg-Essen, Essen, Germany
| | - Verena Ruhlmann
- Department of Nuclear Medicine, University Hospital Essen, Essen, Germany
| | - Lale Umutlu
- Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Essen, Germany
| | | | - Inki Hong
- Siemens Medical Solutions Inc, Knoxville, Tennessee, United States of America
| | - Harald H. Quick
- Erwin L. Hahn Institute for Magnetic Resonance Imaging, University of Duisburg Essen, Essen, Germany
- High Field and Hybrid MR Imaging, University of Duisburg-Essen, Essen, Germany
| |
Collapse
|
39
|
Beheshti M, Manafi-Farid R, Rezaee A, Langsteger W. PET/CT and PET/MRI, Normal Variations, and Artifacts. Clin Nucl Med 2020. [DOI: 10.1007/978-3-030-39457-8_17] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
40
|
Surti S, Pantel AR, Karp JS. Total Body PET: Why, How, What for? IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2020; 4:283-292. [PMID: 33134653 PMCID: PMC7595297 DOI: 10.1109/trpms.2020.2985403] [Citation(s) in RCA: 60] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
PET instruments are now available with a long axial field-of-view (LAFOV) to enable imaging the total-body, or at least head and torso, simultaneously and without bed translation. This has two major benefits, a dramatic increase in system sensitivity and the ability to measure kinetics with wider axial coverage so as to include multiple organs. This manuscript presents a review of the technology leading up to the introduction of these new instruments, and explains the benefits of a LAFOV PET-CT instrument. To date there are two platforms developed for TB-PET, an outcome of the EXPLORER Consortium of the University of California at Davis (UC Davis) and the University of Pennsylvania (Penn). The uEXPLORER at UC Davis has an AFOV of 194 cm and was developed by United Imaging Healthcare. The PennPET EXPLORER was developed at Penn and is based on the digital detector from Philips Healthcare. This multi-ring system is scalable and has been tested with 3 rings but is now being expanded to 6 rings for 140 cm. Initial human studies with both EXPLORER systems have demonstrated the successful implementation and benefits of LAFOV scanners for both clinical and research applications. Examples of such studies are described in this manuscript.
Collapse
Affiliation(s)
- Suleman Surti
- Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Austin R Pantel
- Department of Radiology, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Joel S Karp
- Departments of Radiology and Physics & Astronomy, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
41
|
Hamill JJ, Meier JG, Betancourt Cuellar SL, Sabloff B, Erasmus JJ, Mawlawi O. Improved Alignment of PET and CT Images in Whole-Body PET/CT in Cases of Respiratory Motion During CT. J Nucl Med 2020; 61:1376-1380. [PMID: 32005768 DOI: 10.2967/jnumed.119.235804] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Accepted: 01/10/2020] [Indexed: 11/16/2022] Open
Abstract
Respiratory motion during the CT and PET parts of a PET/CT scan leads to imperfect alignment of anatomic features seen by the 2 modalities. In this work, we concentrate on the effects of motion during CT. We propose a novel approach for improving the alignment. Methods: Respiratory waveform data were gathered during the CT and PET parts of 28 PET/CT scans of cancer patients with 40 lesions up to 3 cm in size in the lung or upper abdomen. PET list-mode data were reconstructed by 3 reconstruction methods: PET/static (the standard method with no motion correction); PET/ex (a method that calculates a range of expiratory amplitudes from the lowest one to the highest one); and PET/matched (a novel method that uses both waveforms). The 3 methods were compared. The distance between tumor positions in PET and CT were characterized in visual interpretation by physicians as well as quantitatively. Tumor SUVs (SUVmax and SUVpeak) were determined relative to SUV based on the static method. Image noise was evaluated in the liver and compared with PET/static. Results: In visual interpretation, the rate of good alignment was 13 of 21, 13 of 23, and 18 of 21 for the PET/static, PET/ex, and PET/matched methods, respectively, and the mean PET/CT distances were 3.5, 5.1, and 2.8 mm. In visual comparison with PET/ex, the rate of good alignment was increased in 1 of 10 and 7 of 10 cases for PET/static and PET/matched, respectively. SUVmax was on average 21% higher than PET/static when either PET/ex or PET/matched was used. SUVpeak was 12% higher. Image noise in the liver was 15% higher than PET/static for the PET/ex method, and 40% higher for PET/matched; that is, noise was much lower than in gated PET. Conclusion: Acquiring respiratory waveforms both in PET (as in the current state of the art) and in CT (an unusual key step in this approach) has the potential to improve the alignment of PET and CT images. A proposed method for using this information was tested. Improved alignment was demonstrated.
Collapse
Affiliation(s)
- James J Hamill
- Siemens Medical Solutions USA, Inc., Knoxville, Tennessee
| | - Joseph G Meier
- Department of Imaging Physics, M.D. Anderson Cancer Center, Houston Texas.,M.D. Anderson Cancer Center UTHealth Science Center at Houston Graduate School of Biomedical Sciences, Houston, Texas; and
| | | | - Bradley Sabloff
- Department of Diagnostic Radiology, M.D. Anderson Cancer Center, Houston Texas
| | - Jeremy J Erasmus
- Department of Diagnostic Radiology, M.D. Anderson Cancer Center, Houston Texas
| | - Osama Mawlawi
- Department of Imaging Physics, M.D. Anderson Cancer Center, Houston Texas.,M.D. Anderson Cancer Center UTHealth Science Center at Houston Graduate School of Biomedical Sciences, Houston, Texas; and
| |
Collapse
|
42
|
Ren S, Laub P, Lu Y, Naganawa M, Carson RE. Atlas-Based Multiorgan Segmentation for Dynamic Abdominal PET. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2020. [DOI: 10.1109/trpms.2019.2926889] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
43
|
Gallezot JD, Lu Y, Naganawa M, Carson RE. Parametric Imaging With PET and SPECT. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2020. [DOI: 10.1109/trpms.2019.2908633] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
44
|
Shi L, Lu Y, Wu J, Gallezot JD, Boutagy N, Thorn S, Sinusas AJ, Carson RE, Liu C. Direct List Mode Parametric Reconstruction for Dynamic Cardiac SPECT. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:119-128. [PMID: 31180845 PMCID: PMC7030971 DOI: 10.1109/tmi.2019.2921969] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Recently introduced stationary dedicated cardiac SPECT scanners provide new opportunities to quantify myocardial blood flow (MBF) using dynamic SPECT. However, comparing to PET, the low sensitivity of SPECT scanners affects MBF quantification due to the high noise level, especially for 201 Thallium (201Tl) due to its typically low injected dose. The conventional indirect method for generating parametric images typically starts by reconstructing a time series of frame images followed by fitting the time-activity curve (TAC) for each voxel or segment with an appropriate kinetic model. The indirect method is simple and easy to implement; however, it usually suffers from substantial image noise that could also lead to bias. In this paper, we developed a list mode direct parametric image reconstruction algorithm to substantially reduce noise in MBF quantification using dynamic SPECT and allow for patient radiation dose reduction. GPU-based parallel computing was used to achieve more than 2000-fold acceleration. The proposed method was evaluated in both simulation and in vivo canine studies. Compared with the indirect method, the proposed direct method achieved substantially lower image noise and variability, particularly at large number of iterations and at low-count levels.
Collapse
Affiliation(s)
- Luyao Shi
- Department of Biomedical Engineering, Yale University, New Haven, CT 06512, USA
| | - Yihuan Lu
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT 06512, USA
| | - Jing Wu
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT 06512, USA
| | | | - Nabil Boutagy
- Department of Internal Medicine (Cardiology), Yale University, New Haven, CT 06512, USA
| | - Stephanie Thorn
- Department of Internal Medicine (Cardiology), Yale University, New Haven, CT 06512, USA
| | - Albert J. Sinusas
- Department of Internal Medicine (Cardiology), Yale University, New Haven, CT 06512, USA
| | - Richard E. Carson
- Department of Biomedical Engineering and also with the Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT 06512, USA
| | - Chi Liu
- Department of Biomedical Engineering and also with the Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT 06512, USA
| |
Collapse
|
45
|
Ren S, Lu Y, Bertolli O, Thielemans K, Carson RE. Event-by-event non-rigid data-driven PET respiratory motion correction methods: comparison of principal component analysis and centroid of distribution. ACTA ACUST UNITED AC 2019; 64:165014. [DOI: 10.1088/1361-6560/ab0bc9] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
46
|
Using Cine-Averaged CT With the Shallow Breathing Pattern to Reduce Respiration-Induced Artifacts for Thoracic Cavity PET/CT Scans. AJR Am J Roentgenol 2019; 213:140-146. [DOI: 10.2214/ajr.18.20606] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
47
|
Tashima H, Yoshida E, Iwao Y, Wakizaka H, Maeda T, Seki C, Kimura Y, Takado Y, Higuchi M, Suhara T, Yamashita T, Yamaya T. First prototyping of a dedicated PET system with the hemisphere detector arrangement. ACTA ACUST UNITED AC 2019; 64:065004. [DOI: 10.1088/1361-6560/ab012c] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
48
|
Lu Y, Gallezot JD, Naganawa M, Ren S, Fontaine K, Wu J, Onofrey JA, Toyonaga T, Boutagy N, Mulnix T, Panin VY, Casey ME, Carson RE, Liu C. Data-driven voluntary body motion detection and non-rigid event-by-event correction for static and dynamic PET. Phys Med Biol 2019; 64:065002. [PMID: 30695768 DOI: 10.1088/1361-6560/ab02c2] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
PET has the potential to perform absolute in vivo radiotracer quantitation. This potential can be compromised by voluntary body motion (BM), which degrades image resolution, alters apparent tracer uptakes, introduces CT-based attenuation correction mismatch artifacts and causes inaccurate parameter estimates in dynamic studies. Existing body motion correction (BMC) methods include frame-based image-registration (FIR) approaches and real-time motion tracking using external measurement devices. FIR does not correct for motion occurring within a pre-defined frame and the device-based method is generally not practical in routine clinical use, since it requires attaching a tracking device to the patient and additional device set up time. In this paper, we proposed a data-driven algorithm, centroid of distribution (COD), to detect BM. In this algorithm, the central coordinate of the time-of-flight (TOF) bin, which can be used as a reasonable surrogate for the annihilation point, is calculated for every event, and averaged over a certain time interval to generate a COD trace. We hypothesized that abrupt changes on the COD trace in lateral direction represent BMs. After detection, BM is estimated using non-rigid image registrations and corrected through list-mode reconstruction. The COD-based BMC approach was validated using a monkey study and was evaluated against FIR using four human and one dog studies with multiple tracers. The proposed approach successfully detected BMs and yielded superior correction results over conventional FIR approaches.
Collapse
Affiliation(s)
- Yihuan Lu
- Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, United States of America. Author to whom any correspondence should be addressed
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
49
|
Cline GW, McCarthy TJ, Carson RE, Calle RA. Clinical and scientific value in the pursuit of quantification of beta cells in the pancreas by PET imaging. Diabetologia 2018; 61:2671-2673. [PMID: 30136144 PMCID: PMC6219921 DOI: 10.1007/s00125-018-4718-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/30/2018] [Accepted: 08/01/2018] [Indexed: 12/17/2022]
Affiliation(s)
- Gary W Cline
- Yale University, 801 Howard Avenue, PO Box 208048, New Haven, CT, 06520, USA.
| | | | - Richard E Carson
- Yale University, 801 Howard Avenue, PO Box 208048, New Haven, CT, 06520, USA
| | | |
Collapse
|