1
|
Guo X, Shi L, Chen X, Liu Q, Zhou B, Xie H, Liu YH, Palyo R, Miller EJ, Sinusas AJ, Staib L, Spottiswoode B, Liu C, Dvornek NC. TAI-GAN: A Temporally and Anatomically Informed Generative Adversarial Network for early-to-late frame conversion in dynamic cardiac PET inter-frame motion correction. Med Image Anal 2024; 96:103190. [PMID: 38820677 PMCID: PMC11180595 DOI: 10.1016/j.media.2024.103190] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 04/12/2024] [Accepted: 05/01/2024] [Indexed: 06/02/2024]
Abstract
Inter-frame motion in dynamic cardiac positron emission tomography (PET) using rubidium-82 (82Rb) myocardial perfusion imaging impacts myocardial blood flow (MBF) quantification and the diagnosis accuracy of coronary artery diseases. However, the high cross-frame distribution variation due to rapid tracer kinetics poses a considerable challenge for inter-frame motion correction, especially for early frames where intensity-based image registration techniques often fail. To address this issue, we propose a novel method called Temporally and Anatomically Informed Generative Adversarial Network (TAI-GAN) that utilizes an all-to-one mapping to convert early frames into those with tracer distribution similar to the last reference frame. The TAI-GAN consists of a feature-wise linear modulation layer that encodes channel-wise parameters generated from temporal information and rough cardiac segmentation masks with local shifts that serve as anatomical information. Our proposed method was evaluated on a clinical 82Rb PET dataset, and the results show that our TAI-GAN can produce converted early frames with high image quality, comparable to the real reference frames. After TAI-GAN conversion, the motion estimation accuracy and subsequent myocardial blood flow (MBF) quantification with both conventional and deep learning-based motion correction methods were improved compared to using the original frames. The code is available at https://github.com/gxq1998/TAI-GAN.
Collapse
Affiliation(s)
- Xueqi Guo
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA.
| | | | - Xiongchao Chen
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Qiong Liu
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Bo Zhou
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Huidong Xie
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA
| | - Yi-Hwa Liu
- Department of Internal Medicine, Yale University, New Haven, CT, USA
| | | | - Edward J Miller
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Internal Medicine, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Albert J Sinusas
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Internal Medicine, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | - Lawrence Staib
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA
| | | | - Chi Liu
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
| | - Nicha C Dvornek
- Department of Biomedical Engineering, Yale University, New Haven, CT, USA; Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA.
| |
Collapse
|
2
|
Bahadorzadeh B, Faghihi R, Sina S, Aghaz A, Rahmim A, Reza Ay M. Design and implementation of continuous bed motion (CBM) in Xtrim preclinical PET scanner for whole-body Imaging: MC simulation and experimental measurements. Phys Med 2024; 123:103395. [PMID: 38843650 DOI: 10.1016/j.ejmp.2024.103395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 05/09/2024] [Accepted: 06/01/2024] [Indexed: 07/13/2024] Open
Abstract
PURPOSE Preclinical PET scanners often have limited axial field-of-view for whole-body (WB) scanning of the small-animal. Step-and-shoot(S&S) acquisition mode requires multiple bed positions (BPs) to cover the scan length. Alternatively, in Continuous Bed Motion(CBM) mode, data acquisition is performed while the bed is continuously moving. In this study, to reduce acquisition time and enhance image quality, the CBM acquisition protocol was optimized and implemented on the Xtrim-PET preclinical scanner for WB imaging. METHODS The over-scan percentage(OS%) in CBM mode was optimized by Monte Carlo simulation. Bed movement speed was optimized considering ranges from 0.1 to 2.0 mm s-1, and absolute system sensitivities with the optimal OS% were calculated. The performance of the scanner in CBM mode was measured, and compared with S&S mode based on the NEMA-NU4 standard. RESULTS The optimal trade-off between absolute sensitivity and uniformity of sensitivity profile was achieved at OS-50 %. In comparison to S&S mode with maximum ring differences (MRD) of 9 and 23, the calculated equivalent speeds in CBM(OS-50 %) mode were 0.3 and 0.14 mm s-1, respectively. In terms of data acquisition with equal sensitivity in both CBM(OS-50 %) and S&S(MRD-9) modes, the total scan time in CBM mode decreased by 25.9 %, 47.7 %, 54.7 %, and 58.2 % for scan lengths of 1 to 4 BPs, respectively. CONCLUSION The CBM mode enhances WB PET scans for small-animals, offering rapid data acquisition, high system sensitivity, and uniform axial sensitivity, leading to improved image quality. Its efficiency and customizable scan length and bed speed make it a superior alternative.
Collapse
Affiliation(s)
- Bahador Bahadorzadeh
- Nuclear Engineering Department, School of Mechanical Engineering, Shiraz University, Shiraz, Iran; Research Center for Molecular and Cellular Imaging (RCMCI), Advanced Medical Technologies and Equipment Institute (AMTEI), Tehran University of Medical Sciences, Tehran, Iran
| | - Reza Faghihi
- Nuclear Engineering Department, School of Mechanical Engineering, Shiraz University, Shiraz, Iran; Radiation Research Center (RRC), Shiraz University, Shiraz, Iran.
| | - Sedigheh Sina
- Nuclear Engineering Department, School of Mechanical Engineering, Shiraz University, Shiraz, Iran; Radiation Research Center (RRC), Shiraz University, Shiraz, Iran
| | - Ahdiyeh Aghaz
- Radiation Application Research School, Nuclear Science and Technology Research Institute, Tehran, Iran
| | - Arman Rahmim
- Departments of Radiology and Physics Vancouver, The University of British Columbia, Vancouver, Canada; Department of Integrative Oncology, BC Cancer Research Institute, Vancouver, Canada
| | - Mohammad Reza Ay
- Research Center for Molecular and Cellular Imaging (RCMCI), Advanced Medical Technologies and Equipment Institute (AMTEI), Tehran University of Medical Sciences, Tehran, Iran; Department of Medical Physics and Biomedical Engineering, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
3
|
Wang J, Bermudez D, Chen W, Durgavarjhula D, Randell C, Uyanik M, McMillan A. Motion-correction strategies for enhancing whole-body PET imaging. FRONTIERS IN NUCLEAR MEDICINE (LAUSANNE, SWITZERLAND) 2024; 4:1257880. [PMID: 39118964 PMCID: PMC11308502 DOI: 10.3389/fnume.2024.1257880] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 08/10/2024]
Abstract
Positron Emission Tomography (PET) is a powerful medical imaging technique widely used for detection and monitoring of disease. However, PET imaging can be adversely affected by patient motion, leading to degraded image quality and diagnostic capability. Hence, motion gating schemes have been developed to monitor various motion sources including head motion, respiratory motion, and cardiac motion. The approaches for these techniques have commonly come in the form of hardware-driven gating and data-driven gating, where the distinguishing aspect is the use of external hardware to make motion measurements vs. deriving these measures from the data itself. The implementation of these techniques helps correct for motion artifacts and improves tracer uptake measurements. With the great impact that these methods have on the diagnostic and quantitative quality of PET images, much research has been performed in this area, and this paper outlines the various approaches that have been developed as applied to whole-body PET imaging.
Collapse
Affiliation(s)
- James Wang
- Department of Radiology, University of Wisconsin Madison, Madison, WI, United States
- Department of Medical Physics, University of Wisconsin Madison, Madison, WI, United States
| | - Dalton Bermudez
- Department of Medical Physics, University of Wisconsin Madison, Madison, WI, United States
| | - Weijie Chen
- Department of Radiology, University of Wisconsin Madison, Madison, WI, United States
- Department of Electrical and Computer Engineering, University of Wisconsin Madison, Madison, WI, United States
| | - Divya Durgavarjhula
- Department of Radiology, University of Wisconsin Madison, Madison, WI, United States
- Department of Computer Science, University of Wisconsin Madison, Madison, WI, United States
| | - Caitlin Randell
- Department of Radiology, University of Wisconsin Madison, Madison, WI, United States
- Department of Biomedical Engineering, University of Wisconsin Madison, Madison, WI, United States
| | - Meltem Uyanik
- Department of Radiology, University of Wisconsin Madison, Madison, WI, United States
- Department of Medical Physics, University of Wisconsin Madison, Madison, WI, United States
| | - Alan McMillan
- Department of Radiology, University of Wisconsin Madison, Madison, WI, United States
- Department of Medical Physics, University of Wisconsin Madison, Madison, WI, United States
- Department of Electrical and Computer Engineering, University of Wisconsin Madison, Madison, WI, United States
- Department of Biomedical Engineering, University of Wisconsin Madison, Madison, WI, United States
- Data Science Institute, University of Wisconsin Madison, Madison, WI, United States
| |
Collapse
|
4
|
Guo X, Shi L, Chen X, Zhou B, Liu Q, Xie H, Liu YH, Palyo R, Miller EJ, Sinusas AJ, Spottiswoode B, Liu C, Dvornek NC. TAI-GAN: Temporally and Anatomically Informed GAN for Early-to-Late Frame Conversion in Dynamic Cardiac PET Motion Correction. SIMULATION AND SYNTHESIS IN MEDICAL IMAGING : ... INTERNATIONAL WORKSHOP, SASHIMI ..., HELD IN CONJUNCTION WITH MICCAI ..., PROCEEDINGS. SASHIMI (WORKSHOP) 2023; 14288:64-74. [PMID: 38464964 PMCID: PMC10923183 DOI: 10.1007/978-3-031-44689-4_7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/12/2024]
Abstract
The rapid tracer kinetics of rubidium-82 (82Rb) and high variation of cross-frame distribution in dynamic cardiac positron emission tomography (PET) raise significant challenges for inter-frame motion correction, particularly for the early frames where conventional intensity-based image registration techniques are not applicable. Alternatively, a promising approach utilizes generative methods to handle the tracer distribution changes to assist existing registration methods. To improve frame-wise registration and parametric quantification, we propose a Temporally and Anatomically Informed Generative Adversarial Network (TAI-GAN) to transform the early frames into the late reference frame using an all-to-one mapping. Specifically, a feature-wise linear modulation layer encodes channel-wise parameters generated from temporal tracer kinetics information, and rough cardiac segmentations with local shifts serve as the anatomical information. We validated our proposed method on a clinical 82Rb PET dataset and found that our TAI-GAN can produce converted early frames with high image quality, comparable to the real reference frames. After TAI-GAN conversion, motion estimation accuracy and clinical myocardial blood flow (MBF) quantification were improved compared to using the original frames. Our code is published at https://github.com/gxq1998/TAI-GAN.
Collapse
Affiliation(s)
- Xueqi Guo
- Yale University, New Haven, CT 06511, USA
| | - Luyao Shi
- IBM Research, San Jose, CA 95120, USA
| | | | - Bo Zhou
- Yale University, New Haven, CT 06511, USA
| | - Qiong Liu
- Yale University, New Haven, CT 06511, USA
| | | | - Yi-Hwa Liu
- Yale University, New Haven, CT 06511, USA
| | | | | | | | | | - Chi Liu
- Yale University, New Haven, CT 06511, USA
| | | |
Collapse
|
5
|
Guo X, Zhou B, Chen X, Chen MK, Liu C, Dvornek NC. MCP-Net: Introducing Patlak Loss Optimization to Whole-body Dynamic PET Inter-frame Motion Correction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; PP:10.1109/TMI.2023.3290003. [PMID: 37368811 PMCID: PMC10751388 DOI: 10.1109/tmi.2023.3290003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/29/2023]
Abstract
In whole-body dynamic positron emission tomography (PET), inter-frame subject motion causes spatial misalignment and affects parametric imaging. Many of the current deep learning inter-frame motion correction techniques focus solely on the anatomy-based registration problem, neglecting the tracer kinetics that contains functional information. To directly reduce the Patlak fitting error for 18F-FDG and further improve model performance, we propose an interframe motion correction framework with Patlak loss optimization integrated into the neural network (MCP-Net). The MCP-Net consists of a multiple-frame motion estimation block, an image-warping block, and an analytical Patlak block that estimates Patlak fitting using motion-corrected frames and the input function. A novel Patlak loss penalty component utilizing mean squared percentage fitting error is added to the loss function to reinforce the motion correction. The parametric images were generated using standard Patlak analysis following motion correction. Our framework enhanced the spatial alignment in both dynamic frames and parametric images and lowered normalized fitting error when compared to both conventional and deep learning benchmarks. MCP-Net also achieved the lowest motion prediction error and showed the best generalization capability. The potential of enhancing network performance and improving the quantitative accuracy of dynamic PET by directly utilizing tracer kinetics is suggested.
Collapse
|