1
|
Pal A, Ning L, Rathi Y. A domain-agnostic MR reconstruction framework using a randomly weighted neural network. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.03.22.533764. [PMID: 36993372 PMCID: PMC10055311 DOI: 10.1101/2023.03.22.533764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
PURPOSE To design a randomly-weighted neural network that performs domain-agnostic MR image reconstruction from undersampled k-space data without the need for ground truth or extensive in-vivo training datasets. The network performance must be similar to the current state-of-the-art algorithms that require large training datasets. METHODS We propose a Weight Agnostic randomly weighted Network method for MRI reconstruction (termed WAN-MRI) which does not require updating the weights of the neural network but rather chooses the most appropriate connections of the network to reconstruct the data from undersampled k-space measurements. The network architecture has three components, i.e. (1) Dimensionality Reduction Layers comprising of 3d convolutions, ReLu, and batch norm; (2) Reshaping Layer is Fully Connected layer; and (3) Upsampling Layers that resembles the ConvDecoder architecture. The proposed methodology is validated on fastMRI knee and brain datasets. RESULTS The proposed method provides a significant boost in performance for structural similarity index measure (SSIM) and root mean squared error (RMSE) scores on fastMRI knee and brain datasets at an undersampling factor of R=4 and R=8 while trained on fractal and natural images, and fine-tuned with only 20 samples from the fastMRI training k-space dataset. Qualitatively, we see that classical methods such as GRAPPA and SENSE fail to capture the subtle details that are clinically relevant. We either outperform or show comparable performance with several existing deep learning techniques (that require extensive training) like GrappaNET, VariationNET, J-MoDL, and RAKI. CONCLUSION The proposed algorithm (WAN-MRI) is agnostic to reconstructing images of different body organs or MRI modalities and provides excellent scores in terms of SSIM, PSNR, and RMSE metrics and generalizes better to out-of-distribution examples. The methodology does not require ground truth data and can be trained using very few undersampled multi-coil k-space training samples.
Collapse
|
2
|
Pain CD, Egan GF, Chen Z. Deep learning-based image reconstruction and post-processing methods in positron emission tomography for low-dose imaging and resolution enhancement. Eur J Nucl Med Mol Imaging 2022; 49:3098-3118. [PMID: 35312031 PMCID: PMC9250483 DOI: 10.1007/s00259-022-05746-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Accepted: 02/25/2022] [Indexed: 12/21/2022]
Abstract
Image processing plays a crucial role in maximising diagnostic quality of positron emission tomography (PET) images. Recently, deep learning methods developed across many fields have shown tremendous potential when applied to medical image enhancement, resulting in a rich and rapidly advancing literature surrounding this subject. This review encapsulates methods for integrating deep learning into PET image reconstruction and post-processing for low-dose imaging and resolution enhancement. A brief introduction to conventional image processing techniques in PET is firstly presented. We then review methods which integrate deep learning into the image reconstruction framework as either deep learning-based regularisation or as a fully data-driven mapping from measured signal to images. Deep learning-based post-processing methods for low-dose imaging, temporal resolution enhancement and spatial resolution enhancement are also reviewed. Finally, the challenges associated with applying deep learning to enhance PET images in the clinical setting are discussed and future research directions to address these challenges are presented.
Collapse
Affiliation(s)
- Cameron Dennis Pain
- Monash Biomedical Imaging, Monash University, Melbourne, Australia.
- Department of Electrical and Computer Systems Engineering, Monash University, Melbourne, Australia.
| | - Gary F Egan
- Monash Biomedical Imaging, Monash University, Melbourne, Australia
- Turner Institute for Brain and Mental Health, Monash University, Melbourne, Australia
| | - Zhaolin Chen
- Monash Biomedical Imaging, Monash University, Melbourne, Australia
- Department of Data Science and AI, Monash University, Melbourne, Australia
| |
Collapse
|
3
|
Konishi T. [[SPECT] 4. Introductions of SPECT Reconstruction Algorithm Using the Conjugated Gradient Method and Metal Artifact Reduction Technologies in the Latest SPECT System]. Nihon Hoshasen Gijutsu Gakkai Zasshi 2022; 78:895-901. [PMID: 35989260 DOI: 10.6009/jjrt.2022-2075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
|
4
|
Flux G, Leek F, Gape P, Gear J, Taprogge J. Iodine-131 and Iodine-131-Meta-iodobenzylguanidine Dosimetry in Cancer Therapy. Semin Nucl Med 2021; 52:167-177. [PMID: 34961618 DOI: 10.1053/j.semnuclmed.2021.11.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Radioactive iodine was first used for the treatment of benign thyroid disease and thyroid cancer 80 years ago. I-131 mIBG was later developed for the treatment of adult and pediatric neuroendocrine tumors. Physicists were closely involved from the outset to measure retention, to quantify uptake and to calculate radiation dosimetry. As the treatment became widespread, contrasting treatment regimes were followed, either given with empirically derived fixed levels of activity or guided according to the radiation doses delivered. As for external beam radiotherapy, individualized treatments for both thyroid cancer and neuroendocrine tumors were developed based on the aim of maximizing the radiation doses delivered to target volumes while restricting the radiation doses delivered to organs-at-risk, particularly the bone marrow. The challenge of marrow dosimetry has been met by using surrogate measures, often the blood dose for thyroid treatments and the whole-body dose in the case of treatment of neuroblastoma with I-131 mIBG. A number of studies have sought to establish threshold absorbed doses to ensure therapeutic efficacy. Although different values have been postulated, it has nevertheless been conclusively demonstrated that a fixed activity approach leads to a wide range of absorbed doses delivered to target volumes and to normal organs. Personalized treatment planning is now technically feasible with ongoing multicenter clinical trials and investigations into image quantification, biokinetic modelling and radiobiology.
Collapse
Affiliation(s)
- Glenn Flux
- Department of Physics, Royal Marsden Hospital & Institute of Cancer Research, Sutton, UK.
| | - Francesca Leek
- Department of Physics, Royal Marsden Hospital & Institute of Cancer Research, Sutton, UK
| | - Paul Gape
- Department of Physics, Royal Marsden Hospital & Institute of Cancer Research, Sutton, UK
| | - Jonathan Gear
- Department of Physics, Royal Marsden Hospital & Institute of Cancer Research, Sutton, UK
| | - Jan Taprogge
- Department of Physics, Royal Marsden Hospital & Institute of Cancer Research, Sutton, UK
| |
Collapse
|
5
|
Guo S, Sheng Y, Chai L, Zhang J. Kernel graph filtering-A new method for dynamic sinogram denoising. PLoS One 2021; 16:e0260374. [PMID: 34855798 PMCID: PMC8638912 DOI: 10.1371/journal.pone.0260374] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Accepted: 11/08/2021] [Indexed: 11/18/2022] Open
Abstract
Low count PET (positron emission tomography) imaging is often desirable in clinical diagnosis and biomedical research, but its images are generally very noisy, due to the very weak signals in the sinograms used in image reconstruction. To address this issue, this paper presents a novel kernel graph filtering method for dynamic PET sinogram denoising. This method is derived from treating the dynamic sinograms as the signals on a graph, and learning the graph adaptively from the kernel principal components of the sinograms to construct a lowpass kernel graph spectrum filter. The kernel graph filter thus obtained is then used to filter the original sinogram time frames to obtain the denoised sinograms for PET image reconstruction. Extensive tests and comparisons on the simulated and real life in-vivo dynamic PET datasets show that the proposed method outperforms the existing methods in sinogram denoising and image enhancement of dynamic PET at all count levels, especially at low count, with a great potential in real life applications of dynamic PET imaging.
Collapse
Affiliation(s)
- Shiyao Guo
- Engineering Research Center of Metallurgical Automation and Measurement Technology, Wuhan University of Science and Technology, Wuhan, China
| | - Yuxia Sheng
- Engineering Research Center of Metallurgical Automation and Measurement Technology, Wuhan University of Science and Technology, Wuhan, China
- * E-mail:
| | - Li Chai
- Engineering Research Center of Metallurgical Automation and Measurement Technology, Wuhan University of Science and Technology, Wuhan, China
| | - Jingxin Zhang
- School of Science, Computing and Engineering Technology, Swinburne University of Technology Melbourne, VIC, Australia
| |
Collapse
|
6
|
Tsai YJ, Bousse A, Arridge S, Stearns CW, Hutton BF, Thielemans K. Penalized PET/CT Reconstruction Algorithms With Automatic Realignment for Anatomical Priors. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2021. [DOI: 10.1109/trpms.2020.3025540] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
7
|
Bardiès M, Gear JI. Scientific Developments in Imaging and Dosimetry for Molecular Radiotherapy. Clin Oncol (R Coll Radiol) 2020; 33:117-124. [PMID: 33281018 DOI: 10.1016/j.clon.2020.11.005] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Revised: 10/12/2020] [Accepted: 11/09/2020] [Indexed: 11/29/2022]
Abstract
Molecular radiotherapy is a rapidly developing field with new vector and isotope combinations continually added to market. As with any radiotherapy treatment, it is vital that the absorbed dose and toxicity profile are adequately characterised. Methodologies for absorbed dose calculations for radiopharmaceuticals were generally developed to characterise stochastic effects and not suited to calculations on a patient-specific basis. There has been substantial scientific and technological development within the field of molecular radiotherapy dosimetry to answer this challenge. The development of imaging systems and advanced processing techniques enable the acquisition of accurate measurements of radioactivity within the body. Activity assessment combined with dosimetric models and radiation transport algorithms make individualised absorbed dose calculations not only feasible, but commonplace in a variety of commercially available software packages. The development of dosimetric parameters beyond the absorbed dose has also allowed the possibility to characterise the effect of irradiation by including biological parameters that account for radiation absorbed dose rates, gradients and spatial and temporal energy distribution heterogeneities. Molecular radiotherapy is in an exciting time of its development and the application of dosimetry in this field can only have a positive influence on its continued progression.
Collapse
Affiliation(s)
- M Bardiès
- Centre de Recherches en Cancérologie de Toulouse UMR 1037, Toulouse, France; INSERM UMR 1037 Université Toulouse III Paul Sabatier, Toulouse, France
| | - J I Gear
- Joint Department of Physics, The Royal Marsden NHS Foundation Trust and Institute of Cancer Research, Sutton, Surrey, UK.
| |
Collapse
|
8
|
Zhang J, Liu Z, Zhang S, Zhang H, Spincemaille P, Nguyen TD, Sabuncu MR, Wang Y. Fidelity imposed network edit (FINE) for solving ill-posed image reconstruction. Neuroimage 2020; 211:116579. [PMID: 31981779 PMCID: PMC7093048 DOI: 10.1016/j.neuroimage.2020.116579] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2019] [Revised: 12/20/2019] [Accepted: 01/20/2020] [Indexed: 01/19/2023] Open
Abstract
Deep learning (DL) is increasingly used to solve ill-posed inverse problems in medical imaging, such as reconstruction from noisy and/or incomplete data, as DL offers advantages over conventional methods that rely on explicit image features and hand engineered priors. However, supervised DL-based methods may achieve poor performance when the test data deviates from the training data, for example, when it has pathologies not encountered in the training data. Furthermore, DL-based image reconstructions do not always incorporate the underlying forward physical model, which may improve performance. Therefore, in this work we introduce a novel approach, called fidelity imposed network edit (FINE), which modifies the weights of a pre-trained reconstruction network for each case in the testing dataset. This is achieved by minimizing an unsupervised fidelity loss function that is based on the forward physical model. FINE is applied to two important inverse problems in neuroimaging: quantitative susceptibility mapping (QSM) and under-sampled image reconstruction in MRI. Our experiments demonstrate that FINE can improve reconstruction accuracy.
Collapse
Affiliation(s)
- Jinwei Zhang
- Department of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Zhe Liu
- Department of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Shun Zhang
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Hang Zhang
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA; Department of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA
| | - Pascal Spincemaille
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Thanh D Nguyen
- Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA
| | - Mert R Sabuncu
- Department of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA; Department of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA
| | - Yi Wang
- Department of Biomedical Engineering, Cornell University, Ithaca, NY, USA; Department of Radiology, Weill Medical College of Cornell University, New York, NY, USA.
| |
Collapse
|
9
|
Ravishankar S, Ye JC, Fessler JA. Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learning. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2020; 108:86-109. [PMID: 32095024 PMCID: PMC7039447 DOI: 10.1109/jproc.2019.2936204] [Citation(s) in RCA: 68] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
The field of medical image reconstruction has seen roughly four types of methods. The first type tended to be analytical methods, such as filtered back-projection (FBP) for X-ray computed tomography (CT) and the inverse Fourier transform for magnetic resonance imaging (MRI), based on simple mathematical models for the imaging systems. These methods are typically fast, but have suboptimal properties such as poor resolution-noise trade-off for CT. A second type is iterative reconstruction methods based on more complete models for the imaging system physics and, where appropriate, models for the sensor statistics. These iterative methods improved image quality by reducing noise and artifacts. The FDA-approved methods among these have been based on relatively simple regularization models. A third type of methods has been designed to accommodate modified data acquisition methods, such as reduced sampling in MRI and CT to reduce scan time or radiation dose. These methods typically involve mathematical image models involving assumptions such as sparsity or low-rank. A fourth type of methods replaces mathematically designed models of signals and systems with data-driven or adaptive models inspired by the field of machine learning. This paper focuses on the two most recent trends in medical image reconstruction: methods based on sparsity or low-rank models, and data-driven methods based on machine learning techniques.
Collapse
Affiliation(s)
- Saiprasad Ravishankar
- Departments of Computational Mathematics, Science and Engineering, and Biomedical Engineering at Michigan State University, East Lansing, MI, 48824 USA
| | - Jong Chul Ye
- Department of Bio and Brain Engineering and Department of Mathematical Sciences at the Korea Advanced Institute of Science & Technology (KAIST), Daejeon, South Korea
| | - Jeffrey A Fessler
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, 48109 USA
| |
Collapse
|
10
|
Zhu Y, Zhu X. MRI-Driven PET Image Optimization for Neurological Applications. Front Neurosci 2019; 13:782. [PMID: 31417346 PMCID: PMC6684790 DOI: 10.3389/fnins.2019.00782] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2018] [Accepted: 07/12/2019] [Indexed: 12/12/2022] Open
Abstract
Positron emission tomography (PET) and magnetic resonance imaging (MRI) are established imaging modalities for the study of neurological disorders, such as epilepsy, dementia, psychiatric disorders and so on. Since these two available modalities vary in imaging principle and physical performance, each technique has its own advantages and disadvantages over the other. To acquire the mutual complementary information and reinforce each other, there is a need for the fusion of PET and MRI. This combined dual-modality (either sequential or simultaneous) could generate preferable soft tissue contrast of brain tissue, flexible acquisition parameters, and minimized exposure to radiation. The most unique superiority of PET/MRI is mainly manifested in MRI-based improvement for the inherent limitations of PET, such as motion artifacts, partial volume effect (PVE) and invasive procedure in quantitative analysis. Head motion during scanning significantly deteriorates the effective resolution of PET image, especially for the dynamic scan with lengthy time. Hybrid PET/MRI device can offer motion correction (MC) for PET data through MRI information acquired simultaneously. Regarding the PVE associated with limited spatial resolution, the process and reconstruction of PET data can be further optimized by using acquired MRI either sequentially or simultaneously. The quantitative analysis of dynamic PET data mainly relies upon an invasive arterial blood sampling procedure to acquire arterial input function (AIF). An image-derived input function (IDIF) method without the need of arterial cannulization, can serve as a potential alternative estimation of AIF. Compared with using PET data only, combining anatomical or functional information from MRI for improving the accuracy in IDIF approach has been demonstrated. Yet, due to the interference and inherent disparity between the two modalities, these methods for optimizing PET image based on MRI still have many technical challenges. This review discussed upon the most recent progress, current challenges and future directions of MRI-driven PET data optimization for neurological applications, with either sequential or simultaneous acquisition approach.
Collapse
Affiliation(s)
- Yuankai Zhu
- Department of Nuclear Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Xiaohua Zhu
- Department of Nuclear Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|
11
|
Gong K, Catana C, Qi J, Li Q. PET Image Reconstruction Using Deep Image Prior. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:1655-1665. [PMID: 30575530 PMCID: PMC6584077 DOI: 10.1109/tmi.2018.2888491] [Citation(s) in RCA: 104] [Impact Index Per Article: 20.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Recently, deep neural networks have been widely and successfully applied in computer vision tasks and have attracted growing interest in medical imaging. One barrier for the application of deep neural networks to medical imaging is the need for large amounts of prior training pairs, which is not always feasible in clinical practice. This is especially true for medical image reconstruction problems, where raw data are needed. Inspired by the deep image prior framework, in this paper, we proposed a personalized network training method where no prior training pairs are needed, but only the patient's own prior information. The network is updated during the iterative reconstruction process using the patient-specific prior information and measured data. We formulated the maximum-likelihood estimation as a constrained optimization problem and solved it using the alternating direction method of multipliers algorithm. Magnetic resonance imaging guided positron emission tomography reconstruction was employed as an example to demonstrate the effectiveness of the proposed framework. Quantification results based on simulation and real data show that the proposed reconstruction framework can outperform Gaussian post-smoothing and anatomically guided reconstructions using the kernel method or the neural-network penalty.
Collapse
|
12
|
Vija AH, Bartenstein PA, Froelich JW, Kuwert T, Macapinlac H, Daignault CP, Gowda N, Hadjiev O, Hephzibah J, Huang P, Ilhan H, Jessop A, Cachovan M, Ma J, Ding X, Spence D, Platsch G, Szabo Z. ROC study and SUV threshold using quantitative multi-modal SPECT for bone imaging. Eur J Hybrid Imaging 2019; 3:10. [PMID: 34191147 PMCID: PMC8218047 DOI: 10.1186/s41824-019-0057-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2019] [Accepted: 05/24/2019] [Indexed: 11/23/2022] Open
Abstract
Background We investigated the clinical performance of a quantitative multi-modal SPECT/CT reconstruction platform for yielding radioactivity concentrations of bone imaging with 99mTc-methylene diphosphonate (MDP) or 99mTc-dicarboxypropane diphosphonate (DPD). The novel reconstruction incorporates CT-derived tissue information while preserving the delineation of tissue boundaries. We assessed image-based reader concordance and confidence, and determined lesion classification and SUV thresholds from ROC analysis. Methods Seventy-two cancer patients were scanned at three US and two German clinical sites, each contributing two experienced board-certified nuclear medicine physicians as readers. We compared four variants of the reconstructed data resulting from the Flash3D (F3D) and the xSPECT Bone™ (xB) iterative reconstruction methods and presented images to the readers with and without a fused CT, resulting in four combinations. We used an all-or-none approach for inclusion, compiling results only when a reader completed all reads in a subset. After the final read, we conducted a “surrogate truth” reading, presenting all data to each reader. For any remaining discordant lesions, we conducted a consensus read. We next undertook ROC analysis to determine SUV thresholds for differentiating benign and lesional uptake. Results On a five-point rating scale of image quality, xB was deemed better by almost two points in resolution and one point better in overall acceptance compared to F3D. The absolute agreement of the rendered decision between the nine readers was significantly higher with CT information either inside the reconstruction (xB, xBCT) or simply through image fusion (F3DCT): 0.70 (xBCT), 0.67 (F3DCT), 0.64 (xB), and 0.46 (F3D). The confidence level to characterize the lesion was significantly higher (3.03x w/o CT, 1.32x w/CT) for xB than for F3D. There was high correlation between xB and F3D scores for lesion detection and classification, but lesion detection confidence was 41% higher w/o CT, and 21% higher w/CT for xB compared to F3D. Without CT, xB had 6.6% higher sensitivity, 7.1% higher specificity, and 6.9% greater AUC compared to F3D, and similarly with CT-fusion. The overall SUV-criterion (SUVc) of xB (12) exceeded that for xSPECT Quant™ (xQ; 9), an approach not using the tissue delineation of xB. SUV critical numbers depended on lesion volume and location. For non-joint lesions > 6 ml, the AUC for xQ and xB was 94%, with SUVc > 9.28 (xQ) or > 9.68 (xB); for non-joint lesions ≤ 6 ml, AUCs were 81% (xQ) and 88% (xB), and SUVc > 8.2 (xQ) or > 9.1 (xB). For joint lesions, the AUC was 80% (xQ) and 83% (xB), with SUVc > 8.61 (xQ) or > 13.4 (xB). Conclusion The incorporation of high-resolution CT-based tissue delineation in SPECT reconstruction (xSPECT Bone) provides better resolution and detects smaller lesions (6 ml), and the CT component facilitates lesion characterization. Our approach increases confidence, concordance, and accuracy for readers with a wide range of experience. The xB method retained high reading accuracy, despite the unfamiliar image presentation, having greatest impact for smaller lesions, and better localization of foci relative to bone anatomy. The quantitative assessment yielded an SUV-threshold for sensitively distinguishing benign and malignant lesions. Ongoing efforts shall establish clinically usable protocols and SUV thresholds for decision-making based on quantitative SPECT.
Collapse
Affiliation(s)
- A H Vija
- Molecular Imaging, Siemens Medical Solutions USA, Inc, Hoffman Estates, IL, USA.
| | | | | | - T Kuwert
- Friedrich Alexander Universität Erlangen, Erlangen, Germany
| | | | - C P Daignault
- University of Minnesota, Minneapolis, MN, USA.,Veterans Medical Center, Minneapolis, MN, USA
| | - N Gowda
- University of Minnesota, Minneapolis, MN, USA.,Consulting Radiology, Edina, MN, USA
| | - O Hadjiev
- University of Minnesota, Minneapolis, MN, USA.,Milwaukee Radiologists, Greenfield, WI, USA
| | - J Hephzibah
- Johns Hopkins University, Baltimore, MD, USA.,Christian Medical College, Vellore, India
| | - P Huang
- Johns Hopkins University, Baltimore, MD, USA
| | - H Ilhan
- Ludwig-Maximilians Universität, München, Munich, Germany
| | - A Jessop
- MD Anderson Cancer Center, Houston, TX, USA.,Vanderbilt University Medical Center, Nashville, TN, USA
| | - M Cachovan
- Siemens Healthineers GmbH, Erlangen, Germany
| | - J Ma
- Molecular Imaging, Siemens Medical Solutions USA, Inc, Hoffman Estates, IL, USA
| | - X Ding
- Molecular Imaging, Siemens Medical Solutions USA, Inc, Hoffman Estates, IL, USA
| | - D Spence
- Molecular Imaging, Siemens Medical Solutions USA, Inc, Hoffman Estates, IL, USA
| | - G Platsch
- Siemens Healthineers GmbH, Erlangen, Germany
| | - Z Szabo
- Johns Hopkins University, Baltimore, MD, USA
| |
Collapse
|
13
|
Farkash G, Markovic S, Novakovic M, Frydman L. Enhanced hyperpolarized chemical shift imaging based on a priori segmented information. Magn Reson Med 2019; 81:3080-3093. [PMID: 30652358 DOI: 10.1002/mrm.27631] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2018] [Revised: 10/29/2018] [Accepted: 11/17/2018] [Indexed: 01/07/2023]
Abstract
PURPOSE The purpose of the study was to develop an approach for improving the resolution and sensitivity of hyperpolarized 13 C MRSI based on a priori anatomical information derived from featured, water-based 1 H images. METHODS A reconstruction algorithm exploiting 1 H MRI for the redefinition of the 13 C MRSI anatomies was developed, based on a modification of the spectroscopy with linear algebraic modeling (SLAM) principle. To enhance 13 C spatial resolution and reduce spillover effects without compromising SNR, this model was extended by endowing it with a search allowing smooth variations in the 13 C MR intensity within the targeted regions of interest. RESULTS Experiments were performed in vitro on enzymatic solutions and in vivo on rodents, based on the administration of 13 C-enriched hyperpolarized pyruvate and urea. The spectral images reconstructed for these substrates and from metabolic products based on predefined 1 H anatomical compartments using the new algorithm, compared favorably with those arising from conventional Fourier-based analyses of the same data. The new approach also delivered reliable kinetic 13 C results, for the kind of processes and timescales usually targeted by hyperpolarized MRSI. CONCLUSION A simple, flexible strategy is introduced to boost the sensitivity and resolution provided by hyperpolarized 13 C MRSI, based on readily available 1 H MR information.
Collapse
Affiliation(s)
- Gil Farkash
- Department of Chemical and Biological Physics, Weizmann Institute of Science, Rehovot, 76100, Israel
| | - Stefan Markovic
- Department of Chemical and Biological Physics, Weizmann Institute of Science, Rehovot, 76100, Israel
| | - Mihajlo Novakovic
- Department of Chemical and Biological Physics, Weizmann Institute of Science, Rehovot, 76100, Israel
| | - Lucio Frydman
- Department of Chemical and Biological Physics, Weizmann Institute of Science, Rehovot, 76100, Israel
| |
Collapse
|
14
|
Yang B, Ying L, Tang J. Artificial Neural Network Enhanced Bayesian PET Image Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:1297-1309. [PMID: 29870360 PMCID: PMC6132251 DOI: 10.1109/tmi.2018.2803681] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
In positron emission tomography (PET) image reconstruction, the Bayesian framework with various regularization terms has been implemented to constrain the radio tracer distribution. Varying the regularizing weight of a maximum a posteriori (MAP) algorithm specifies a lower bound of the tradeoff between variance and spatial resolution measured from the reconstructed images. The purpose of this paper is to build a patch-based image enhancement scheme to reduce the size of the unachievable region below the bound and thus to quantitatively improve the Bayesian PET imaging. We cast the proposed enhancement as a regression problem which models a highly nonlinear and spatial-varying mapping between the reconstructed image patches and an enhanced image patch. An artificial neural network model named multilayer perceptron (MLP) with backpropagation was used to solve this regression problem through learning from examples. Using the BrainWeb phantoms, we simulated brain PET data at different count levels of different subjects with and without lesions. The MLP was trained using the image patches reconstructed with a MAP algorithm of different regularization parameters for one normal subject at a certain count level. To evaluate the performance of the trained MLP, reconstructed images from other simulations and two patient brain PET imaging data sets were processed. In every testing cases, we demonstrate that the MLP enhancement technique improves the noise and bias tradeoff compared with the MAP reconstruction using different regularizing weights thus decreasing the size of the unachievable region defined by the MAP algorithm in the variance/resolution plane.
Collapse
Affiliation(s)
- Bao Yang
- Department of Electrical and Computer Engineering, Oakland University, Rochester, MI, USA
| | - Leslie Ying
- Departments of Biomedical Engineering and Electrical Engineering, The State University of New York at Buffalo, Buffalo, NY, USA
| | | |
Collapse
|
15
|
Abstract
Simultaneous PET-MR imaging improves deficiencies in PET images. The primary areas in which magnetic resonance (MR) has been applied to guide PET results are in correction for patient motion and in improving the effects of PET resolution and partial volume averaging. MR-guided motion correction of PET has been applied to respiratory, cardiac, and gross body movements and shown to improve lesion detectability and contrast. Partial volume correction or resolution improvement of PET governed by MR imaging anatomic information improves visualization of structures and quantitative accuracy. Evaluation in clinical applications is needed to determine their true impacts.
Collapse
Affiliation(s)
- David S Lalush
- Joint Department of Biomedical Engineering, The University of North Carolina, Campus Box 7575, 152 MacNider Hall, Chapel Hill, NC 27599-7575, USA; Joint Department of Biomedical Engineering, North Carolina State University, Campus Box 7115, 911 Oval Drive, Raleigh, NC 27695-7115, USA.
| |
Collapse
|
16
|
Boudjelal A, Messali Z, Elmoataz A, Attallah B. Improved Simultaneous Algebraic Reconstruction Technique Algorithm for Positron-Emission Tomography Image Reconstruction via Minimizing the Fast Total Variation. J Med Imaging Radiat Sci 2017; 48:385-393. [PMID: 31047474 DOI: 10.1016/j.jmir.2017.09.005] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2017] [Revised: 09/05/2017] [Accepted: 09/15/2017] [Indexed: 12/15/2022]
Abstract
CONTEXT There has been considerable progress in the instrumentation for data measurement and computer methods for generating images of measured PET data. These computer methods have been developed to solve the inverse problem, also known as the "image reconstruction from projections" problem. AIM In this paper, we propose a modified Simultaneous Algebraic Reconstruction Technique (SART) algorithm to improve the quality of image reconstruction by incorporating total variation (TV) minimization into the iterative SART algorithm. METHODOLOGY The SART updates the estimated image by forward projecting the initial image onto the sinogram space. Then, the difference between the estimated sinogram and the given sinogram is back-projected onto the image domain. This difference is then subtracted from the initial image to obtain a corrected image. Fast total variation (FTV) minimization is applied to the image obtained in the SART step. The second step is the result obtained from the previous FTV update. The SART and the FTV minimization steps run iteratively in an alternating manner. Fifty iterations were applied to the SART algorithm used in each of the regularization-based methods. In addition to the conventional SART algorithm, spatial smoothing was used to enhance the quality of the image. All images were sized at 128 × 128 pixels. RESULTS The proposed algorithm successfully accomplished edge preservation. A detailed scrutiny revealed that the reconstruction algorithms differed; for example, the SART and the proposed FTV-SART algorithm effectively preserved the hot lesion edges, whereas artifacts and deviations were more likely to occur in the ART algorithm than in the other algorithms. CONCLUSIONS Compared to the standard SART, the proposed algorithm is more robust in removing background noise while preserving edges to suppress the existent image artifacts. The quality measurements and visual inspections show a significant improvement in image quality compared to the conventional SART and Algebraic Reconstruction Technique (ART) algorithms.
Collapse
Affiliation(s)
- Abdelwahhab Boudjelal
- Electronics Department, University of Mohammed Boudiaf-M'sila, M'sila, Algeria; Image Team, GREYC Laboratory, University of Caen Normandy, Caen Cedex, France.
| | - Zoubeida Messali
- Electronics Department, University of Mohamed El Bachir El Ibrahimi-Bordj Bou Arréridj, Bordj Bou Arréridj, Algeria
| | - Abderrahim Elmoataz
- Image Team, GREYC Laboratory, University of Caen Normandy, Caen Cedex, France
| | - Bilal Attallah
- Electronics Department, University of Mohammed Boudiaf-M'sila, M'sila, Algeria; Image Team, GREYC Laboratory, University of Caen Normandy, Caen Cedex, France
| |
Collapse
|
17
|
Mehranian A, Belzunce MA, Niccolini F, Politis M, Prieto C, Turkheimer F, Hammers A, Reader AJ. PET image reconstruction using multi-parametric anato-functional priors. Phys Med Biol 2017; 62:5975-6007. [PMID: 28570263 DOI: 10.1088/1361-6560/aa7670] [Citation(s) in RCA: 44] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
In this study, we investigate the application of multi-parametric anato-functional (MR-PET) priors for the maximum a posteriori (MAP) reconstruction of brain PET data in order to address the limitations of the conventional anatomical priors in the presence of PET-MR mismatches. In addition to partial volume correction benefits, the suitability of these priors for reconstruction of low-count PET data is also introduced and demonstrated, comparing to standard maximum-likelihood (ML) reconstruction of high-count data. The conventional local Tikhonov and total variation (TV) priors and current state-of-the-art anatomical priors including the Kaipio, non-local Tikhonov prior with Bowsher and Gaussian similarity kernels are investigated and presented in a unified framework. The Gaussian kernels are calculated using both voxel- and patch-based feature vectors. To cope with PET and MR mismatches, the Bowsher and Gaussian priors are extended to multi-parametric priors. In addition, we propose a modified joint Burg entropy prior that by definition exploits all parametric information in the MAP reconstruction of PET data. The performance of the priors was extensively evaluated using 3D simulations and two clinical brain datasets of [18F]florbetaben and [18F]FDG radiotracers. For simulations, several anato-functional mismatches were intentionally introduced between the PET and MR images, and furthermore, for the FDG clinical dataset, two PET-unique active tumours were embedded in the PET data. Our simulation results showed that the joint Burg entropy prior far outperformed the conventional anatomical priors in terms of preserving PET unique lesions, while still reconstructing functional boundaries with corresponding MR boundaries. In addition, the multi-parametric extension of the Gaussian and Bowsher priors led to enhanced preservation of edge and PET unique features and also an improved bias-variance performance. In agreement with the simulation results, the clinical results also showed that the Gaussian prior with voxel-based feature vectors, the Bowsher and the joint Burg entropy priors were the best performing priors. However, for the FDG dataset with simulated tumours, the TV and proposed priors were capable of preserving the PET-unique tumours. Finally, an important outcome was the demonstration that the MAP reconstruction of a low-count FDG PET dataset using the proposed joint entropy prior can lead to comparable image quality to a conventional ML reconstruction with up to 5 times more counts. In conclusion, multi-parametric anato-functional priors provide a solution to address the pitfalls of the conventional priors and are therefore likely to increase the diagnostic confidence in MR-guided PET image reconstructions.
Collapse
Affiliation(s)
- Abolfazl Mehranian
- Department of Biomedical Engineering, Division of Imaging Sciences and Biomedical Engineering, King's College London, St. Thomas' Hospital, London, United Kingdom
| | | | | | | | | | | | | | | |
Collapse
|
18
|
Ramos-Llorden G, den Dekker AJ, Sijbers J. Partial Discreteness: A Novel Prior for Magnetic Resonance Image Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1041-1053. [PMID: 28026759 DOI: 10.1109/tmi.2016.2645122] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
An important factor influencing the quality of magnetic resonance (MR) images is the reconstruction method that is employed, and specifically, the type of prior knowledge that is exploited during reconstruction. In this work, we introduce a new type of prior knowledge, partial discreteness (PD), where a small number of regions in the image are assumed to be homogeneous and can be well represented by a constant magnitude. In particular, we mathematically formalize the partial discreteness property based on a Gaussian Mixture Model (GMM) and derive a partial discreteness image representation that characterizes the salient features of partially discrete images: a constant intensity in homogeneous areas and texture in heterogeneous areas. The partial discreteness representation is then used to construct a novel prior dedicated to the reconstruction of partially discrete MR images. The strength of the proposed prior is demonstrated on various simulated and real k-space data-based experiments with partially discrete images. Results demonstrate that the PD algorithm performs competitively with state-of-the-art reconstruction methods, being flexible and easy to implement.
Collapse
|
19
|
|
20
|
Chu Y, Su MY, Mandelkern M, Nalcioglu O. Resolution Improvement in Positron Emission Tomography Using Anatomical Magnetic Resonance Imaging. Technol Cancer Res Treat 2016; 5:311-7. [PMID: 16866561 DOI: 10.1177/153303460600500402] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
An ideal imaging system should provide information with high-sensitivity, high spatial, and temporal resolution. Unfortunately, it is not possible to satisfy all of these desired features in a single modality. In this paper, we discuss methods to improve the spatial resolution in positron emission imaging (PET) using a priori information from Magnetic Resonance Imaging (MRI). Our approach uses an image restoration algorithm based on the maximization of mutual information (MMI), which has found significant success for optimizing multimodal image registration. The MMI criterion is used to estimate the parameters in the Sharpness-Constrained Wiener filter. The generated filter is then applied to restore PET images of a realistic digital brain phantom. The resulting restored images show improved resolution and better signal-to-noise ratio compared to the interpolated PET images. We conclude that a Sharpness-Constrained Wiener filter having parameters optimized from a MMI criterion may be useful for restoring spatial resolution in PET based on a priori information from correlated MRI.
Collapse
Affiliation(s)
- Yong Chu
- Tu and Yuen Center for Functional Onco-Imaging, University of California, Irvine, CA 92697, USA.
| | | | | | | |
Collapse
|
21
|
|
22
|
Abstract
Multimodal imaging has led to a more detailed exploration of different physiologic processes with integrated PET/MR imaging being the most recent entry. Although the clinical need is still questioned, it is well recognized that it represents one of the most active and promising fields of medical imaging research in terms of software and hardware. The hardware developments have moved from small detector components to high-performance PET inserts and new concepts in full systems. Conversely, the software focuses on the efficient performance of necessary corrections without the use of CT data. The most recent developments in both directions are reviewed.
Collapse
Affiliation(s)
- Charalampos Tsoumpas
- Division of Biomedical Imaging, Faculty of Medicine and Health, University of Leeds, 8.001a, Worsley Building, Clarendon Way, Leeds LS2 9JT, UK
| | - Dimitris Visvikis
- LaTIM UMR 1101, INSERM, University of Brest, Bat 1, 1er etage, 5 avenue Foch, Brest 29609, France
| | - George Loudos
- Department of Biomedical Engineering, Technological Educational Institute of Athens, Ag. Spiridonos 28, Egaleo, Athens 12210, Greece.
| |
Collapse
|
23
|
Cheng L, Hobbs RF, Sgouros G, Frey EC. Development and evaluation of convergent and accelerated penalized SPECT image reconstruction methods for improved dose-volume histogram estimation in radiopharmaceutical therapy. Med Phys 2015; 41:112507. [PMID: 25370666 DOI: 10.1118/1.4897613] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Three-dimensional (3D) dosimetry has the potential to provide better prediction of response of normal tissues and tumors and is based on 3D estimates of the activity distribution in the patient obtained from emission tomography. Dose-volume histograms (DVHs) are an important summary measure of 3D dosimetry and a widely used tool for treatment planning in radiation therapy. Accurate estimates of the radioactivity distribution in space and time are desirable for accurate 3D dosimetry. The purpose of this work was to develop and demonstrate the potential of penalized SPECT image reconstruction methods to improve DVHs estimates obtained from 3D dosimetry methods. METHODS The authors developed penalized image reconstruction methods, using maximum a posteriori (MAP) formalism, which intrinsically incorporate regularization in order to control noise and, unlike linear filters, are designed to retain sharp edges. Two priors were studied: one is a 3D hyperbolic prior, termed single-time MAP (STMAP), and the second is a 4D hyperbolic prior, termed cross-time MAP (CTMAP), using both the spatial and temporal information to control noise. The CTMAP method assumed perfect registration between the estimated activity distributions and projection datasets from the different time points. Accelerated and convergent algorithms were derived and implemented. A modified NURBS-based cardiac-torso phantom with a multicompartment kidney model and organ activities and parameters derived from clinical studies were used in a Monte Carlo simulation study to evaluate the methods. Cumulative dose-rate volume histograms (CDRVHs) and cumulative DVHs (CDVHs) obtained from the phantom and from SPECT images reconstructed with both the penalized algorithms and OS-EM were calculated and compared both qualitatively and quantitatively. The STMAP method was applied to patient data and CDRVHs obtained with STMAP and OS-EM were compared qualitatively. RESULTS The results showed that the penalized algorithms substantially improved the CDRVH and CDVH estimates for large organs such as the liver compared to optimally postfiltered OS-EM. For example, the mean squared errors (MSEs) of the CDRVHs for the liver at 5 h postinjection obtained with CTMAP and STMAP were about 15% and 17%, respectively, of the MSEs obtained with optimally filtered OS-EM. For the CDVH estimates, the MSEs obtained with CTMAP and STMAP were about 16% and 19%, respectively, of the MSEs from OS-EM. For the kidneys and renal cortices, larger residual errors were observed for all algorithms, likely due to partial volume effects. The STMAP method showed promising qualitative results when applied to patient data. CONCLUSIONS Penalized image reconstruction methods were developed and evaluated through a simulation study. The study showed that the MAP algorithms substantially improved CDVH estimates for large organs such as the liver compared to optimally postfiltered OS-EM reconstructions. For small organs with fine structural detail such as the kidneys, a large residual error was observed for both MAP algorithms and OS-EM. While CTMAP provided marginally better MSEs than STMAP, given the extra effort needed to handle misregistration of images at different time points in the algorithm and the potential impact of residual misregistration, 3D regularization methods, such as that used in STMAP, appear to be a more practical choice.
Collapse
Affiliation(s)
- Lishui Cheng
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland 21287 and Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, Maryland 21287
| | - Robert F Hobbs
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland 21287
| | - George Sgouros
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland 21287
| | - Eric C Frey
- The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, Baltimore, Maryland 21287
| |
Collapse
|
24
|
Adaptive Autoregressive Model for Reduction of Noise in SPECT. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2015; 2015:494691. [PMID: 26089966 PMCID: PMC4450303 DOI: 10.1155/2015/494691] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/02/2014] [Revised: 11/05/2014] [Accepted: 12/02/2014] [Indexed: 11/17/2022]
Abstract
This paper presents improved autoregressive modelling (AR) to reduce noise in SPECT images. An AR filter was applied to prefilter projection images and postfilter ordered subset expectation maximisation (OSEM) reconstruction images (AR-OSEM-AR method). The performance of this method was compared with filtered back projection (FBP) preceded by Butterworth filtering (BW-FBP method) and the OSEM reconstruction method followed by Butterworth filtering (OSEM-BW method). A mathematical cylinder phantom was used for the study. It consisted of hot and cold objects. The tests were performed using three simulated SPECT datasets. Image quality was assessed by means of the percentage contrast resolution (CR%) and the full width at half maximum (FWHM) of the line spread functions of the cylinders. The BW-FBP method showed the highest CR% values and the AR-OSEM-AR method gave the lowest CR% values for cold stacks. In the analysis of hot stacks, the BW-FBP method had higher CR% values than the OSEM-BW method. The BW-FBP method exhibited the lowest FWHM values for cold stacks and the AR-OSEM-AR method for hot stacks. In conclusion, the AR-OSEM-AR method is a feasible way to remove noise from SPECT images. It has good spatial resolution for hot objects.
Collapse
|
25
|
|
26
|
Chen S, Liu H, Shi P, Chen Y. Sparse representation and dictionary learning penalized image reconstruction for positron emission tomography. Phys Med Biol 2015; 60:807-23. [PMID: 25565039 DOI: 10.1088/0031-9155/60/2/807] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Accurate and robust reconstruction of the radioactivity concentration is of great importance in positron emission tomography (PET) imaging. Given the Poisson nature of photo-counting measurements, we present a reconstruction framework that integrates sparsity penalty on a dictionary into a maximum likelihood estimator. Patch-sparsity on a dictionary provides the regularization for our effort, and iterative procedures are used to solve the maximum likelihood function formulated on Poisson statistics. Specifically, in our formulation, a dictionary could be trained on CT images, to provide intrinsic anatomical structures for the reconstructed images, or adaptively learned from the noisy measurements of PET. Accuracy of the strategy with very promising application results from Monte-Carlo simulations, and real data are demonstrated.
Collapse
Affiliation(s)
- Shuhang Chen
- State Key Laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, Hangzhou 310027, People's Republic of China
| | | | | | | |
Collapse
|
27
|
Abstract
Image reconstruction from low-count positron emission tomography (PET) projection data is challenging because the inverse problem is ill-posed. Prior information can be used to improve image quality. Inspired by the kernel methods in machine learning, this paper proposes a kernel based method that models PET image intensity in each pixel as a function of a set of features obtained from prior information. The kernel-based image model is incorporated into the forward model of PET projection data and the coefficients can be readily estimated by the maximum likelihood (ML) or penalized likelihood image reconstruction. A kernelized expectation-maximization algorithm is presented to obtain the ML estimate. Computer simulations show that the proposed approach can achieve better bias versus variance trade-off and higher contrast recovery for dynamic PET image reconstruction than the conventional maximum likelihood method with and without post-reconstruction denoising. Compared with other regularization-based methods, the kernel method is easier to implement and provides better image quality for low-count data. Application of the proposed kernel method to a 4-D dynamic PET patient dataset showed promising results.
Collapse
|
28
|
Tang J, Rahmim A. Anatomy assisted PET image reconstruction incorporating multi-resolution joint entropy. Phys Med Biol 2014; 60:31-48. [PMID: 25479422 DOI: 10.1088/0031-9155/60/1/31] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
A promising approach in PET image reconstruction is to incorporate high resolution anatomical information (measured from MR or CT) taking the anato-functional similarity measures such as mutual information or joint entropy (JE) as the prior. These similarity measures only classify voxels based on intensity values, while neglecting structural spatial information. In this work, we developed an anatomy-assisted maximum a posteriori (MAP) reconstruction algorithm wherein the JE measure is supplied by spatial information generated using wavelet multi-resolution analysis. The proposed wavelet-based JE (WJE) MAP algorithm involves calculation of derivatives of the subband JE measures with respect to individual PET image voxel intensities, which we have shown can be computed very similarly to how the inverse wavelet transform is implemented. We performed a simulation study with the BrainWeb phantom creating PET data corresponding to different noise levels. Realistically simulated T1-weighted MR images provided by BrainWeb modeling were applied in the anatomy-assisted reconstruction with the WJE-MAP algorithm and the intensity-only JE-MAP algorithm. Quantitative analysis showed that the WJE-MAP algorithm performed similarly to the JE-MAP algorithm at low noise level in the gray matter (GM) and white matter (WM) regions in terms of noise versus bias tradeoff. When noise increased to medium level in the simulated data, the WJE-MAP algorithm started to surpass the JE-MAP algorithm in the GM region, which is less uniform with smaller isolated structures compared to the WM region. In the high noise level simulation, the WJE-MAP algorithm presented clear improvement over the JE-MAP algorithm in both the GM and WM regions. In addition to the simulation study, we applied the reconstruction algorithms to real patient studies involving DPA-173 PET data and Florbetapir PET data with corresponding T1-MPRAGE MRI images. Compared to the intensity-only JE-MAP algorithm, the WJE-MAP algorithm resulted in comparable regional mean values to those from the maximum likelihood algorithm while reducing noise. Achieving robust performance in various noise-level simulation and patient studies, the WJE-MAP algorithm demonstrates its potential in clinical quantitative PET imaging.
Collapse
Affiliation(s)
- Jing Tang
- Department of Electrical and Computer Engineering, Oakland University, 2200 N Squirrel Rd, Rochester, MI 48309, USA
| | | |
Collapse
|
29
|
Tsai YJ, Huang HM, Fang YHD, Chang SI, Hsiao IT. Acceleration of MAP-EM algorithm via over-relaxation. Comput Med Imaging Graph 2014; 40:100-7. [PMID: 25465068 DOI: 10.1016/j.compmedimag.2014.11.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2013] [Revised: 10/10/2014] [Accepted: 11/03/2014] [Indexed: 11/27/2022]
Abstract
To improve the convergence rate of the effective maximum a posteriori expectation-maximization (MAP-EM) algorithm in tomographic reconstructions, this study proposes a modified MAP-EM which uses an over-relaxation factor to accelerate image reconstruction. The proposed method, called MAP-AEM, is evaluated and compared with the results for MAP-EM and for an ordered-subset algorithm, in terms of the convergence rate and noise properties. The results show that the proposed method converges numerically much faster than MAP-EM and with a speed that is comparable to that for an ordered-subset type method. The proposed method is effective in accelerating MAP-EM tomographic reconstruction.
Collapse
Affiliation(s)
- Yu-Jung Tsai
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan.
| | - Hsuan-Ming Huang
- Medical Physics Research Center, Institute of Radiological Research, Chang Gung University and Chang Gung Memorial Hospital, Taoyuan, Taiwan.
| | - Yu-Hua Dean Fang
- Department of Electrical Engineering, Chang Gung University, Taoyuan, Taiwan.
| | - Shi-Ing Chang
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan.
| | - Ing-Tsung Hsiao
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan; Medical Physics Research Center, Institute of Radiological Research, Chang Gung University and Chang Gung Memorial Hospital, Taoyuan, Taiwan; Molecular Imaging Center and Department of Nuclear Medicine, Chang Gung Memorial Hospital, Taoyuan, Taiwan.
| |
Collapse
|
30
|
Schrapp MJ, Herman GT. Data fusion in X-ray computed tomography using a superiorization approach. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2014; 85:053701. [PMID: 24880376 DOI: 10.1063/1.4872378] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
X-ray computed tomography (CT) is an important and widespread inspection technique in industrial non-destructive testing. However, large-sized and heavily absorbing objects cause artifacts due to either the lack of penetration of the specimen in specific directions or by having data from only a limited angular range of views. In such cases, valuable information about the specimen is not revealed by the CT measurements alone. Further imaging modalities, such as optical scanning and ultrasonic testing, are able to provide data (such as an edge map) that are complementary to the CT acquisition. In this paper, a superiorization approach (a newly developed method for constrained optimization) is used to incorporate the complementary data into the CT reconstruction; this allows precise localization of edges that are not resolvable from the CT data by itself. Superiorization, as presented in this paper, exploits the fact that the simultaneous algebraic reconstruction technique (SART), often used for CT reconstruction, is resilient to perturbations; i.e., it can be modified to produce an output that is as consistent with the CT measurements as the output of unmodified SART, but is more consistent with the complementary data. The application of this superiorized SART method to measured data of a turbine blade demonstrates a clear improvement in the quality of the reconstructed image.
Collapse
Affiliation(s)
- Michael J Schrapp
- Siemens AG, CT Munich, Germany and Physics Department E21, Technical University of Munich, Munich, Germany
| | - Gabor T Herman
- Department of Computer Science, The Graduate Center, City University of New York, New York, New York 10016, USA
| |
Collapse
|
31
|
Chun SY, Fessler JA, Dewaraja YK. Post-reconstruction non-local means filtering methods using CT side information for quantitative SPECT. Phys Med Biol 2014; 58:6225-40. [PMID: 23956327 DOI: 10.1088/0031-9155/58/17/6225] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Quantitative SPECT techniques are important for many applications including internal emitter therapy dosimetry where accurate estimation of total target activity and activity distribution within targets are both potentially important for dose–response evaluations. We investigated non-local means (NLM) post-reconstruction filtering for accurate I-131 SPECT estimation of both total target activity and the 3D activity distribution. We first investigated activity estimation versus number of ordered-subsets expectation–maximization (OSEM) iterations. We performed simulations using the XCAT phantom with tumors containing a uniform and a non-uniform activity distribution, and measured the recovery coefficient (RC) and the root mean squared error (RMSE) to quantify total target activity and activity distribution, respectively. We observed that using more OSEM iterations is essential for accurate estimation of RC, but may or may not improve RMSE. We then investigated various post-reconstruction filtering methods to suppress noise at high iteration while preserving image details so that both RC and RMSE can be improved. Recently, NLM filtering methods have shown promising results for noise reduction. Moreover, NLM methods using high-quality side information can improve image quality further. We investigated several NLM methods with and without CT side information for I-131 SPECT imaging and compared them to conventional Gaussian filtering and to unfiltered methods. We studied four different ways of incorporating CT information in the NLM methods: two known (NLM CT-B and NLM CT-M) and two newly considered (NLM CT-S and NLM CT-H). We also evaluated the robustness of NLM filtering using CT information to erroneous CT. NLM CT-S and NLM CT-H yielded comparable RC values to unfiltered images while substantially reducing RMSE. NLM CT-S achieved −2.7 to 2.6% increase of RC compared to no filtering and NLM CT-H yielded up to 6% decrease in RC while other methods yielded lower RCs than them: Gaussian filtering (up to 11.8% decrease in RC), NLM method without CT (up to 9.5% decrease in RC), and NLM CT-M and NLM CT-B (up to 19.4% decrease in RC). NLM CT-S and NLM CT-H achieved 8.2 to 33.9% and −0.9 to 36% decreased RMSE on tumors compared to no filtering respectively while other methods yielded less reduced or increased RMSE: Gaussian filtering (up to 7.9% increase in RMSE), NLM method without CT (up to 18.3% increase in RMSE), and NLM CT-M and NLM CT-B (up to 31.5% increase in RMSE). NLM CT-S and NLM CT-H also yielded images with tumor shapes that better-matched the true shapes than other methods. All NLM methods using CT information were robust to small misregistration between SPECT and CT, but NLM CT-S and NLM CT-H were more sensitive than NLM CT-M and NLM CT-B to missing CT information.
Collapse
Affiliation(s)
- Se Young Chun
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109, USA.
| | | | | |
Collapse
|
32
|
Chan C, Fulton R, Barnett R, Feng DD, Meikle S. Postreconstruction nonlocal means filtering of whole-body PET with an anatomical prior. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:636-650. [PMID: 24595339 DOI: 10.1109/tmi.2013.2292881] [Citation(s) in RCA: 53] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Positron emission tomography (PET) images usually suffer from poor signal-to-noise ratio (SNR) due to the high level of noise and low spatial resolution, which adversely affect its performance for lesion detection and quantification. The complementary information present in high-resolution anatomical images from multi-modality imaging systems could potentially be used to improve the ability to detect and/or quantify lesions. However, previous methods that use anatomical priors usually require matched organ/lesion boundaries. In this study, we investigated the use of anatomical information to suppress noise in PET images while preserving both quantitative accuracy and the amplitude of prominent signals that do not have corresponding boundaries on computerized tomography (CT). The proposed approach was realized through a postreconstruction filter based on the nonlocal means (NLM) filter, which reduces noise by computing the weighted average of voxels based on the similarity measurement between patches of voxels within the image. Anatomical knowledge obtained from CT was incorporated to constrain the similarity measurement within a subset of voxels. In contrast to other methods that use anatomical priors, the actual number of neighboring voxels and weights used for smoothing were determined from a robust measurement on PET images within the subset. Thus, the proposed approach can be robust to signal mismatches between PET and CT. A 3-D search scheme was also investigated for the volumetric PET/CT data. The proposed anatomically guided median nonlocal means filter (AMNLM) was first evaluated using a computer phantom and a physical phantom to simulate realistic but challenging situations where small lesions are located in homogeneous regions, which can be detected on PET but not on CT. The proposed method was further assessed with a clinical study of a patient with lung lesions. The performance of the proposed method was compared to Gaussian, edge-preserving bilateral and NLM filters, as well as median nonlocal means (MNLM) filtering without an anatomical prior. The proposed AMNLM method yielded improved lesion contrast and SNR compared with other methods even with imperfect anatomical knowledge, such as missing lesion boundaries and mismatched organ boundaries.
Collapse
|
33
|
Nguyen VG, Lee SJ. Incorporating anatomical side information into PET reconstruction using nonlocal regularization. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2013; 22:3961-3973. [PMID: 23744678 DOI: 10.1109/tip.2013.2265881] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
With the introduction of combined positron emission tomography (PET)/computed tomography (CT) or PET/magnetic resonance imaging (MRI) scanners, there is an increasing emphasis on reconstructing PET images with the aid of the anatomical side information obtained from X-ray CT or MRI scanners. In this paper, we propose a new approach to incorporating prior anatomical information into PET reconstruction using the nonlocal regularization method. The nonlocal regularizer developed for this application is designed to selectively consider the anatomical information only when it is reliable. As our proposed nonlocal regularization method does not directly use anatomical edges or boundaries which are often used in conventional methods, it is not only free from additional processes to extract anatomical boundaries or segmented regions, but also more robust to the signal mismatch problem that is caused by the indirect relationship between the PET image and the anatomical image. We perform simulations with digital phantoms. According to our experimental results, compared to the conventional method based on the traditional local regularization method, our nonlocal regularization method performs well even with the imperfect prior anatomical information or in the presence of signal mismatch between the PET image and the anatomical image.
Collapse
Affiliation(s)
- Van-Giang Nguyen
- Department of Electronic Engineering, Paichai University, Daejeon, Korea.
| | | |
Collapse
|
34
|
Abstract
The resolution of positron emission tomography (PET) images is limited by the physics of positron-electron annihilation and instrumentation for photon coincidence detection. Model-based methods that incorporate accurate physical and statistical models have produced significant improvements in reconstructed image quality when compared with filtered backprojection reconstruction methods. However, it has often been suggested that by incorporating anatomical information, the resolution and noise properties of PET images could be further improved, leading to better quantitation or lesion detection. With the recent development of combined MR-PET scanners, we can now collect intrinsically coregistered magnetic resonance images. It is therefore possible to routinely make use of anatomical information in PET reconstruction, provided appropriate methods are available. In this article, we review research efforts over the past 20 years to develop these methods. We discuss approaches based on the use of both Markov random field priors and joint information or entropy measures. The general framework for these methods is described, and their performance and longer-term potential and limitations are discussed.
Collapse
Affiliation(s)
- Bing Bai
- Department of Radiology, University of Southern California, Los Angeles, CA, USA.
| | | | | |
Collapse
|
35
|
Mehranian A, Rahmim A, Ay MR, Kotasidis F, Zaidi H. An ordered-subsets proximal preconditioned gradient algorithm for edge-preserving PET image reconstruction. Med Phys 2013; 40:052503. [DOI: 10.1118/1.4801898] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
36
|
Wang G, Qi J. Penalized likelihood PET image reconstruction using patch-based edge-preserving regularization. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:2194-204. [PMID: 22875244 PMCID: PMC4080915 DOI: 10.1109/tmi.2012.2211378] [Citation(s) in RCA: 83] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Iterative image reconstruction for positron emission tomography (PET) can improve image quality by using spatial regularization that penalizes image intensity difference between neighboring pixels. The most commonly used quadratic penalty often oversmoothes edges and fine features in reconstructed images. Nonquadratic penalties can preserve edges but often introduce piece-wise constant blocky artifacts and the results are also sensitive to the hyper-parameter that controls the shape of the penalty function. This paper presents a patch-based regularization for iterative image reconstruction that uses neighborhood patches instead of individual pixels in computing the nonquadratic penalty. The new regularization is more robust than the conventional pixel-based regularization in differentiating sharp edges from random fluctuations due to noise. An optimization transfer algorithm is developed for the penalized maximum likelihood estimation. Each iteration of the algorithm can be implemented in three simple steps: an EM-like image update, an image smoothing and a pixel-by-pixel image fusion. Computer simulations show that the proposed patch-based regularization can achieve higher contrast recovery for small objects without increasing background variation compared with the quadratic regularization. The reconstruction is also more robust to the hyper-parameter than conventional pixel-based nonquadratic regularizations. The proposed regularization method has been applied to real 3-D PET data.
Collapse
|
37
|
Gopinath A, Xu G, Ress D, Öktem O, Subramaniam S, Bajaj C. Shape-based regularization of electron tomographic reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:2241-52. [PMID: 22922711 PMCID: PMC3513577 DOI: 10.1109/tmi.2012.2214229] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
We introduce a tomographic reconstruction method implemented using a shape-based regularization technique. Spatial models of known features in the structure being reconstructed are integrated into the reconstruction process as regularizers. Our regularization scheme is driven locally through shape information obtained from segmentation and compared with a known spatial model. We demonstrated our method on tomography data from digital phantoms, simulated data, and experimental electron tomography (ET) data of virus complexes. Our reconstruction showed reduced blurring and an improvement in the resolution of the reconstructed volume was also measured. This method also produced improved demarcation of spike boundaries in viral membranes when compared with popular techniques like weighted back projection and the algebraic reconstruction technique. Improved ET reconstructions will provide better structure elucidation and improved feature visualization, which can aid in solving key biological issues. Our method can also be generalized to other tomographic modalities.
Collapse
Affiliation(s)
- Ajay Gopinath
- Department of Electrical and Computer Engineering, University of Texas at Austin, Austin, TX 78712 USA.
| | | | | | | | | | | |
Collapse
|
38
|
Erlandsson K, Buvat I, Pretorius PH, Thomas BA, Hutton BF. A review of partial volume correction techniques for emission tomography and their applications in neurology, cardiology and oncology. Phys Med Biol 2012; 57:R119-59. [DOI: 10.1088/0031-9155/57/21/r119] [Citation(s) in RCA: 320] [Impact Index Per Article: 26.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|
39
|
Kelm BM, Kaster FO, Henning A, Weber MA, Bachert P, Boesiger P, Hamprecht FA, Menze BH. Using spatial prior knowledge in the spectral fitting of MRS images. NMR IN BIOMEDICINE 2012; 25:1-13. [PMID: 21538636 DOI: 10.1002/nbm.1704] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/26/2010] [Revised: 02/09/2011] [Accepted: 02/10/2011] [Indexed: 05/30/2023]
Abstract
We propose a Bayesian smoothness prior in the spectral fitting of MRS images which can be used in addition to commonly employed prior knowledge. By combining a frequency-domain model for the free induction decay with a Gaussian Markov random field prior, a new optimization objective is derived that encourages smooth parameter maps. Using a particular parameterization of the prior, smooth damping, frequency and phase maps can be obtained whilst preserving sharp spatial features in the amplitude map. A Monte Carlo study based on two sets of simulated data demonstrates that the variance of the estimated parameter maps can be reduced considerably, even below the Cramér-Rao lower bound, when using spatial prior knowledge. Long-TE (1)H MRSI at 1.5 T of a patient with a brain tumor shows that the use of the spatial prior resolves the overlapping peaks of choline and creatine when a single voxel method fails to do so. Improved and detailed metabolic maps can be derived from high-spatial-resolution, short-TE (1)H MRSI at 3 T. Finally, the evaluation of four series of long-TE brain MRSI data with various signal-to-noise ratios shows the general benefit of the proposed approach.
Collapse
Affiliation(s)
- B Michael Kelm
- Interdisciplinary Center for Scientific Computing (IWR), University of Heidelberg, Germany.
| | | | | | | | | | | | | | | |
Collapse
|
40
|
Abstract
Early diagnosis and therapy increasingly operate at the cellular, molecular, or even at the genetic level. As diagnostic techniques transition from the systems to the molecular level, the role of multimodality molecular imaging becomes increasingly important. Positron emission tomography (PET) and magnetic resonance imaging (MRI) are powerful techniques for in vivo molecular imaging. The inability of PET to provide anatomical information is a major limitation of standalone PET systems. Combining PET and CT proved to be clinically relevant and successfully reduced this limitation by providing the anatomical information required for localization of metabolic abnormalities. However, this technology still lacks the excellent soft-tissue contrast provided by MRI. Standalone MRI systems reveal structure and function but cannot provide insight into the physiology and/or the pathology at the molecular level. The combination of PET and MRI, enabling truly simultaneous acquisition, bridges the gap between molecular and systems diagnosis. MRI and PET offer richly complementary functionality and sensitivity; fusion into a combined system offering simultaneous acquisition will capitalize the strengths of each, providing a hybrid technology that is greatly superior to the sum of its parts. A combined PET/MRI system provides both the anatomical and structural description of MRI simultaneously with the quantitative capabilities of PET. In addition, such a system would allow exploiting the power of MR spectroscopy (MRS) to measure the regional biochemical content and to assess the metabolic status or the presence of neoplasia and other diseases in specific tissue areas. This paper briefly summarizes state-of-the-art developments and latest advances in dedicated hybrid PET/MRI instrumentation. Future prospects and potential clinical applications of this technology will also be discussed.
Collapse
Affiliation(s)
- Habib Zaidi
- Division of Nuclear Medicine and Molecular Imaging, Geneva University Hospital, CH-1211 Geneva, Switzerland.
| | | |
Collapse
|
41
|
Cheng-Liao J, Qi J. PET image reconstruction with anatomical edge guided level set prior. Phys Med Biol 2011; 56:6899-918. [PMID: 21983558 DOI: 10.1088/0031-9155/56/21/009] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Acquiring both anatomical and functional images during one scan, PET/CT systems improve the ability to detect and localize abnormal uptakes. In addition, CT images provide anatomical boundary information that can be used to regularize positron emission tomography (PET) images. Here we propose a new approach to maximum a posteriori reconstruction of PET images with a level set prior guided by anatomical edges. The image prior models both the smoothness of PET images and the similarity between functional boundaries in PET and anatomical boundaries in CT. Level set functions (LSFs) are used to represent smooth and closed functional boundaries. The proposed method does not assume an exact match between PET and CT boundaries. Instead, it encourages similarity between the two boundaries, while allowing different region definition in PET images to accommodate possible signal and position mismatch between functional and anatomical images. While the functional boundaries are guaranteed to be closed by the LSFs, the proposed method does not require closed anatomical boundaries and can utilize incomplete edges obtained from an automatic edge detection algorithm. We conducted computer simulations to evaluate the performance of the proposed method. Two digital phantoms were constructed based on the Digimouse data and a human CT image, respectively. Anatomical edges were extracted automatically from the CT images. Tumors were simulated in the PET phantoms with different mismatched anatomical boundaries. Compared with existing methods, the new method achieved better bias-variance performance. The proposed method was also applied to real mouse data and achieved higher contrast than other methods.
Collapse
Affiliation(s)
- Jinxiu Cheng-Liao
- Department of Biomedical Engineering, University of California, Davis, CA 95616, USA
| | | |
Collapse
|
42
|
Improved image fusion in PET/CT using hybrid image reconstruction and super-resolution. Int J Biomed Imaging 2011; 2007:46846. [PMID: 18521180 PMCID: PMC1987321 DOI: 10.1155/2007/46846] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2006] [Revised: 09/03/2006] [Accepted: 10/17/2006] [Indexed: 11/18/2022] Open
Abstract
Purpose. To provide PET/CT image fusion with an improved PET resolution and better contrast ratios than standard reconstructions.
Method. Using a super-resolution algorithm, several PET acquisitions were combined to improve the resolution. In addition, functional PET data was smoothed with a hybrid computed tomography algorithm (HCT), in which anatomical edge information taken from the CT was employed to retain sharper edges. The combined HCT and super-resolution technique were evaluated in phantom and patient studies using a clinical PET scanner. Results. In the phantom studies, 3 mm18F-FDG sources were resolved. PET contrast ratios
improved (average: 54%, range: 45%–69%) relative to the standard reconstructions. In the patient study, target-to-background ratios also improved (average: 34%, range: 17%–47%).
Given corresponding anatomical borders, sharper edges were depicted.
Conclusion. A new method incorporating super-resolution and HCT for
fusing PET and CT images has been developed and shown to provide higher-resolution metabolic images.
Collapse
|
43
|
Somayajula S, Panagiotou C, Rangarajan A, Li Q, Arridge SR, Leahy RM. PET image reconstruction using information theoretic anatomical priors. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:537-49. [PMID: 20851790 PMCID: PMC3331595 DOI: 10.1109/tmi.2010.2076827] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
We describe a nonparametric framework for incorporating information from co-registered anatomical images into positron emission tomographic (PET) image reconstruction through priors based on information theoretic similarity measures. We compare and evaluate the use of mutual information (MI) and joint entropy (JE) between feature vectors extracted from the anatomical and PET images as priors in PET reconstruction. Scale-space theory provides a framework for the analysis of images at different levels of detail, and we use this approach to define feature vectors that emphasize prominent boundaries in the anatomical and functional images, and attach less importance to detail and noise that is less likely to be correlated in the two images. Through simulations that model the best case scenario of perfect agreement between the anatomical and functional images, and a more realistic situation with a real magnetic resonance image and a PET phantom that has partial volumes and a smooth variation of intensities, we evaluate the performance of MI and JE based priors in comparison to a Gaussian quadratic prior, which does not use any anatomical information. We also apply this method to clinical brain scan data using F(18) Fallypride, a tracer that binds to dopamine receptors and therefore localizes mainly in the striatum. We present an efficient method of computing these priors and their derivatives based on fast Fourier transforms that reduce the complexity of their convolution-like expressions. Our results indicate that while sensitive to initialization and choice of hyperparameters, information theoretic priors can reconstruct images with higher contrast and superior quantitation than quadratic priors.
Collapse
Affiliation(s)
- Sangeetha Somayajula
- Signal and Image Processing Institute of University of Southern California, Los Angeles, CA 90089, USA
| | | | | | | | | | | |
Collapse
|
44
|
Tong S, Alessio AM, Kinahan PE. Image reconstruction for PET/CT scanners: past achievements and future challenges. ACTA ACUST UNITED AC 2010; 2:529-545. [PMID: 21339831 DOI: 10.2217/iim.10.49] [Citation(s) in RCA: 61] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
PET is a medical imaging modality with proven clinical value for disease diagnosis and treatment monitoring. The integration of PET and CT on modern scanners provides a synergy of the two imaging modalities. Through different mathematical algorithms, PET data can be reconstructed into the spatial distribution of the injected radiotracer. With dynamic imaging, kinetic parameters of specific biological processes can also be determined. Numerous efforts have been devoted to the development of PET image reconstruction methods over the last four decades, encompassing analytic and iterative reconstruction methods. This article provides an overview of the commonly used methods. Current challenges in PET image reconstruction include more accurate quantitation, TOF imaging, system modeling, motion correction and dynamic reconstruction. Advances in these aspects could enhance the use of PET/CT imaging in patient care and in clinical research studies of pathophysiology and therapeutic interventions.
Collapse
Affiliation(s)
- Shan Tong
- Department of Radiology, University of Washington, Seattle WA, USA
| | | | | |
Collapse
|
45
|
Vanhove C, Defrise M, Bossuyt A, Lahoutte T. Improved quantification in multiple-pinhole SPECT by anatomy-based reconstruction using microCT information. Eur J Nucl Med Mol Imaging 2010; 38:153-65. [PMID: 20882279 DOI: 10.1007/s00259-010-1627-6] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2010] [Accepted: 09/09/2010] [Indexed: 11/24/2022]
Abstract
PURPOSE The aim of this study was to evaluate the potential of anatomy-based reconstruction, using microCT information, to improve quantitative accuracy in multiple-pinhole SPECT. METHODS Multiple-pinhole SPECT and microCT images were acquired with the Micro Deluxe Phantom using both hot and cold rod inserts. The phantoms were filled with 3.7 MBq/ml of (99m)Tc. To improve microCT contrast, the phantoms were also filled with contrast agent. Emission images were reconstructed using a one-step-late (OSL) modification of the ordered subsets expectation maximization (OSEM) algorithm for incorporation of microCT information, to encourage smoothing within but not across boundaries. To allow quantification, the OSL OSEM algorithm takes into account imperfect camera motion, collimator response, angular variation of the sensitivity, intrinsic camera resolution, attenuation and scatter. For comparison, the emission images were also reconstructed by OSEM using post-reconstruction filtering and by OSL OSEM using a quadratic prior and an edge-preserving prior. In each rod of the phantoms the recovery coefficient (RC), defined as measured divided by the true activity concentration, was expressed as a function of the noise. Different noise levels were obtained by varying the amount of spatial filtering during or after reconstruction and by the use of binominal deviates. RESULTS Compared to conventional OSEM using post-reconstruction filtering and compared to OSL OSEM using a quadratic prior, our study demonstrated that the use of anatomical information during reconstruction significantly improved the quantitative accuracy in both cold and hot rods with a diameter larger than or equal to 2.4 mm. When compared to the edge-preserving prior, the anatomical prior performs significantly better for hot rods with a diameter ≥ 2.4 mm. For the 4.0-mm hot rods for example, the RC averaged over the different noise levels was 0.67 ± 0.02 when multiple-pinhole SPECT images were reconstructed using anatomical information, compared to 0.54 ± 0.08, 0.60 ± 0.04 and 0.64 ± 0.02 when OSEM in combination with a post-reconstruction filter, OSL OSEM using a quadratic prior and OSL OSEM using a median root prior was used, respectively. For the 4.0-mm cold rods, the RC averaged over the different noise levels was 0.61 ± 0.03 when the multiple-pinhole SPECT images were reconstructed using anatomical information, compared to 0.54 ± 0.07, 0.53 ± 0.08 and 0.60 ± 0.03 when OSEM in combination with a post-reconstruction filter, OSL OSEM using a quadratic prior and OSL OSEM using a median root prior was used, respectively. CONCLUSION Anatomy-based reconstruction using microCT information has the potential to improve quantitative accuracy in multiple-pinhole SPECT.
Collapse
Affiliation(s)
- Christian Vanhove
- Nuclear Medicine Department, UZ Brussel, Laarbeeklaan 101, 1090, Brussels, Belgium.
| | | | | | | |
Collapse
|
46
|
Dewaraja YK, Koral KF, Fessler JA. Regularized reconstruction in quantitative SPECT using CT side information from hybrid imaging. Phys Med Biol 2010; 55:2523-39. [PMID: 20393233 DOI: 10.1088/0031-9155/55/9/007] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
A penalized-likelihood (PL) SPECT reconstruction method using a modified regularizer that accounts for anatomical boundary side information was implemented to achieve accurate estimates of both the total target activity and the activity distribution within targets. In both simulations and experimental I-131 phantom studies, reconstructions from (1) penalized likelihood employing CT-side information-based regularization (PL-CT), (2) penalized likelihood with edge preserving regularization (no CT) and (3) penalized likelihood with conventional spatially invariant quadratic regularization (no CT) were compared with (4) ordered subset expectation maximization (OSEM), which is the iterative algorithm conventionally used in clinics for quantitative SPECT. Evaluations included phantom studies with perfect and imperfect side information and studies with uniform and non-uniform activity distributions in the target. For targets with uniform activity, the PL-CT images and profiles were closest to the 'truth', avoided the edge offshoots evident with OSEM and minimized the blurring across boundaries evident with regularization without CT information. Apart from visual comparison, reconstruction accuracy was evaluated using the bias and standard deviation (STD) of the total target activity estimate and the root mean square error (RMSE) of the activity distribution within the target. PL-CT reconstruction reduced both bias and RMSE compared with regularization without side information. When compared with unregularized OSEM, PL-CT reduced RMSE and STD while bias was comparable. For targets with non-uniform activity, these improvements with PL-CT were observed only when the change in activity was matched by a change in the anatomical image and the corresponding inner boundary was also used to control the regularization. In summary, the present work demonstrates the potential of using CT side information to obtain improved estimates of the activity distribution in targets without sacrificing the accuracy of total target activity estimation. The method is best suited for data acquired on hybrid systems where SPECT-CT misregistration is minimized. To demonstrate clinical application, the PL reconstruction with CT-based regularization was applied to data from a patient who underwent SPECT/CT imaging for tumor dosimetry following I-131 radioimmunotherapy.
Collapse
Affiliation(s)
- Yuni K Dewaraja
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109, USA.
| | | | | |
Collapse
|
47
|
Schwaiger M, Ziegler SI, Nekolla SG. PET/CT challenge for the non-invasive diagnosis of coronary artery disease. Eur J Radiol 2010; 73:494-503. [PMID: 20206454 DOI: 10.1016/j.ejrad.2009.12.025] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2009] [Accepted: 12/15/2009] [Indexed: 10/19/2022]
Abstract
This review will focus on the clinical potential of PET/CT for the characterization of cardiovascular diseases. We describe the technical challenges of combining instrumentation with very different imaging performance and discuss the clinical applications in the field of cardiology.
Collapse
Affiliation(s)
- Markus Schwaiger
- Klinikum rechts der Isar, Technische Universität München, Nuklearmedizinische Klinik und Poliklinik, München, Germany
| | | | | |
Collapse
|
48
|
Abstract
Multimodality image registration and fusion have a key role in routine diagnosis, staging, restaging, and the assessment of response to treatment, surgery, and radiotherapy planning of malignant disease. The complementarity between anatomic (CT and MR imaging) and molecular (SPECT and PET) imaging modalities is well established and the role of fusion imaging widely recognized as a central piece of the general tree of clinical decision making. Moreover, dual modality imaging technologies including SPECT/CT, PET/CT, and, in the future, PET/MR imaging, now represent the leading component of contemporary health care institutions. This article discusses recent advances in clinical multimodality imaging, the role of correlative fusion imaging in a clinical setting, and future opportunities and challenges facing the adoption of multimodality imaging.
Collapse
|
49
|
Chan C, Fulton R, Feng DD, Meikle S. Regularized image reconstruction with an anatomically adaptive prior for positron emission tomography. Phys Med Biol 2009; 54:7379-400. [PMID: 19934490 DOI: 10.1088/0031-9155/54/24/009] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
The incorporation of accurately aligned anatomical information as a prior to guide reconstruction and noise regularization in positron emission tomography (PET) has been suggested in many previous studies. However, the advantages of this approach can only be realized if the exact lesion outline is also available. In practice, the anatomical imaging modality may be unable to differentiate between normal and pathological tissues, and thus the edges of lesions seen in the anatomical image may not correspond to functional boundaries in the emission image. In this study, we explored an alternative approach to incorporating an anatomical prior into PET image reconstruction. Of particular interest was the realistic situation where lesions are apparent in the emission images but not in the corresponding anatomical images. In the proposed method, regional information obtained from the anatomical prior was used to estimate an anatomically adaptive anisotropic median-diffusion filtering (AAMDF) prior. This smoothing prior was determined and applied adaptively to each anatomical region on the emission image and then assembled to form a prior image for the next iteration in the reconstruction process. We formulated a two-step joint estimation reconstruction scheme to update the estimated image and prior image iteratively. The proposed AAMDF prior was evaluated and compared with maximum a posteriori (MAP) reconstruction methods with and without anatomical side information. In experiments using synthetic and physical phantom data, the AAMDF prior yielded overall higher lesion-to-background contrast and less error in lesion estimation than other algorithms for a comparable level of background noise. We conclude that lesion contrast and quantification can be improved using an anatomically derived smoothing prior without requiring knowledge of the lesion boundary. This may have important implications in clinical PET/CT, where lesion boundaries are often not obtainable from CT images.
Collapse
Affiliation(s)
- Chung Chan
- Biomedical & Multimedia Information Technology (BMIT) Research Group, School of Information Technologies, University of Sydney, Australia.
| | | | | | | |
Collapse
|
50
|
Benameur S, Mignotte M, Meunier J, Soucy JP. Image restoration using functional and anatomical information fusion with application to SPECT-MRI images. Int J Biomed Imaging 2009; 2009:843160. [PMID: 19812704 PMCID: PMC2756467 DOI: 10.1155/2009/843160] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2008] [Revised: 05/03/2009] [Accepted: 07/10/2009] [Indexed: 12/02/2022] Open
Abstract
Image restoration is usually viewed as an ill-posed problem in image processing, since there is no unique solution associated with it. The quality of restored image closely depends on the constraints imposed of the characteristics of the solution. In this paper, we propose an original extension of the NAS-RIF restoration technique by using information fusion as prior information with application in SPECT medical imaging. That extension allows the restoration process to be constrained by efficiently incorporating, within the NAS-RIF method, a regularization term which stabilizes the inverse solution. Our restoration method is constrained by anatomical information extracted from a high resolution anatomical procedure such as magnetic resonance imaging (MRI). This structural anatomy-based regularization term uses the result of an unsupervised Markovian segmentation obtained after a preliminary registration step between the MRI and SPECT data volumes from each patient. This method was successfully tested on 30 pairs of brain MRI and SPECT acquisitions from different subjects and on Hoffman and Jaszczak SPECT phantoms. The experiments demonstrated that the method performs better, in terms of signal-to-noise ratio, than a classical supervised restoration approach using a Metz filter.
Collapse
Affiliation(s)
- S Benameur
- Department of Computer Science and Operations Research (DIRO), University of Montreal, CP 6128l, Station Centre-Ville, P.O. Box 6128, Montréal, QC, Canada H3C 3J7.
| | | | | | | |
Collapse
|