1
|
Li L, Zhang Z, Li Y, Wang Y, Zhao W. DDoCT: Morphology preserved dual-domain joint optimization for fast sparse-view low-dose CT imaging. Med Image Anal 2025; 101:103420. [PMID: 39705821 DOI: 10.1016/j.media.2024.103420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2024] [Revised: 11/07/2024] [Accepted: 11/28/2024] [Indexed: 12/23/2024]
Abstract
Computed tomography (CT) is continuously becoming a valuable diagnostic technique in clinical practice. However, the radiation dose exposure in the CT scanning process is a public health concern. Within medical diagnoses, mitigating the radiation risk to patients can be achieved by reducing the radiation dose through adjustments in tube current and/or the number of projections. Nevertheless, dose reduction introduces additional noise and artifacts, which have extremely detrimental effects on clinical diagnosis and subsequent analysis. In recent years, the feasibility of applying deep learning methods to low-dose CT (LDCT) imaging has been demonstrated, leading to significant achievements. This article proposes a dual-domain joint optimization LDCT imaging framework (termed DDoCT) which uses noisy sparse-view projection to reconstruct high-performance CT images with joint optimization in projection and image domains. The proposed method not only addresses the noise introduced by reducing tube current, but also pays special attention to issues such as streak artifacts caused by a reduction in the number of projections, enhancing the applicability of DDoCT in practical fast LDCT imaging environments. Experimental results have demonstrated that DDoCT has made significant progress in reducing noise and streak artifacts and enhancing the contrast and clarity of the images.
Collapse
Affiliation(s)
- Linxuan Li
- School of Physics, Beihang University, Beijing, China.
| | - Zhijie Zhang
- School of Physics, Beihang University, Beijing, China.
| | - Yongqing Li
- School of Physics, Beihang University, Beijing, China.
| | - Yanxin Wang
- School of Physics, Beihang University, Beijing, China.
| | - Wei Zhao
- School of Physics, Beihang University, Beijing, China; Hangzhou International Innovation Institute, Beihang University, Hangzhou, China; Tianmushan Laboratory, Hangzhou, China.
| |
Collapse
|
2
|
Dehdab R, Brendel JM, Streich S, Ladurner R, Stenzl B, Mueck J, Gassenmaier S, Krumm P, Werner S, Herrmann J, Nikolaou K, Afat S, Brendlin A. Evaluation of a Deep Learning Denoising Algorithm for Dose Reduction in Whole-Body Photon-Counting CT Imaging: A Cadaveric Study. Acad Radiol 2025:S1076-6332(24)01040-7. [PMID: 39818525 DOI: 10.1016/j.acra.2024.12.052] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2024] [Revised: 12/21/2024] [Accepted: 12/22/2024] [Indexed: 01/18/2025]
Abstract
RATIONALE AND OBJECTIVES Photon Counting CT (PCCT) offers advanced imaging capabilities with potential for substantial radiation dose reduction; however, achieving this without compromising image quality remains a challenge due to increased noise at lower doses. This study aims to evaluate the effectiveness of a deep learning (DL)-based denoising algorithm in maintaining diagnostic image quality in whole-body PCCT imaging at reduced radiation levels, using real intraindividual cadaveric scans. MATERIALS AND METHODS Twenty-four cadaveric human bodies underwent whole-body CT scans on a PCCT scanner (NAEOTOM Alpha, Siemens Healthineers) at four different dose levels (100%, 50%, 25%, and 10% mAs). Each scan was reconstructed using both ADMIRE level 2 and a DL algorithm (ClariCT.AI, ClariPi Inc.), resulting in 192 datasets. Objective image quality was assessed by measuring CT value stability, image noise, and contrast-to-noise ratio (CNR) across consistent regions of interest (ROIs) in the liver parenchyma. Two radiologists independently evaluated subjective image quality based on overall image clarity, sharpness, and contrast. Inter-rater agreement was determined using Spearman's correlation coefficient, and statistical analysis included mixed-effects modeling to assess objective and subjective image quality. RESULTS Objective analysis showed that the DL denoising algorithm did not significantly alter CT values (p ≥ 0.9975). Noise levels were consistently lower in denoised datasets compared to the Original (p < 0.0001). No significant differences were observed between the 25% mAs denoised and the 100% mAs original datasets in terms of noise and CNR (p ≥ 0.7870). Subjective analysis revealed strong inter-rater agreement (r ≥ 0.78), with the 50% mAs denoised datasets rated superior to the 100% mAs original datasets (p < 0.0001) and no significant differences detected between the 25% mAs denoised and 100% mAs original datasets (p ≥ 0.9436). CONCLUSION The DL denoising algorithm maintains image quality in PCCT imaging while enabling up to a 75% reduction in radiation dose. This approach offers a promising method for reducing radiation exposure in clinical PCCT without compromising diagnostic quality.
Collapse
Affiliation(s)
- Reza Dehdab
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.).
| | - Jan M Brendel
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Sebastian Streich
- Institute of Clinical Anatomy and Cell Analysis, Eberhard Karls University of Tuebingen, Elfriede-Aulhorn-Str 8, 72076, Tuebingen, Germany (S.S., R.L.)
| | - Ruth Ladurner
- Institute of Clinical Anatomy and Cell Analysis, Eberhard Karls University of Tuebingen, Elfriede-Aulhorn-Str 8, 72076, Tuebingen, Germany (S.S., R.L.)
| | - Benedikt Stenzl
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Jonas Mueck
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Sebastian Gassenmaier
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Patrick Krumm
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Sebastian Werner
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Judith Herrmann
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Konstantin Nikolaou
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Saif Afat
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| | - Andreas Brendlin
- Department of Radiology, University Hospital Tuebingen, Hoppe-Seyler-Str. 3, 72076 Tuebingen, Germany (R.D., J.M.B., B.S., J.M., S.G., P.K., S.W., J.H., K.N., S.A., A.B.)
| |
Collapse
|
3
|
Wang S, Yang Y, Stevens GM, Yin Z, Wang AS. Emulating Low-Dose PCCT Image Pairs With Independent Noise for Self-Supervised Spectral Image Denoising. IEEE TRANSACTIONS ON MEDICAL IMAGING 2025; 44:530-542. [PMID: 39196747 DOI: 10.1109/tmi.2024.3449817] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/30/2024]
Abstract
Photon counting CT (PCCT) acquires spectral measurements and enables generation of material decomposition (MD) images that provide distinct advantages in various clinical situations. However, noise amplification is observed in MD images, and denoising is typically applied. Clean or high-quality references are rare in clinical scans, often making supervised learning (Noise2Clean) impractical. Noise2Noise is a self-supervised counterpart, using noisy images and corresponding noisy references with zero-mean, independent noise. PCCT counts transmitted photons separately, and raw measurements are assumed to follow a Poisson distribution in each energy bin, providing the possibility to create noise-independent pairs. The approach is to use binomial selection to split the counts into two low-dose scans with independent noise. We prove that the reconstructed spectral images inherit the noise independence from counts domain through noise propagation analysis and also validated it in numerical simulation and experimental phantom scans. The method offers the flexibility to split measurements into desired dose levels while ensuring the reconstructed images share identical underlying features, thereby strengthening the model's robustness for input dose levels and capability of preserving fine details. In both numerical simulation and experimental phantom scans, we demonstrated that Noise2Noise with binomial selection outperforms other common self-supervised learning methods based on different presumptive conditions.
Collapse
|
4
|
Chen X, Xia W, Yang Z, Chen H, Liu Y, Zhou J, Wang Z, Chen Y, Wen B, Zhang Y. SOUL-Net: A Sparse and Low-Rank Unrolling Network for Spectral CT Image Reconstruction. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:18620-18634. [PMID: 37792650 DOI: 10.1109/tnnls.2023.3319408] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/06/2023]
Abstract
Spectral computed tomography (CT) is an emerging technology, that generates a multienergy attenuation map for the interior of an object and extends the traditional image volume into a 4-D form. Compared with traditional CT based on energy-integrating detectors, spectral CT can make full use of spectral information, resulting in high resolution and providing accurate material quantification. Numerous model-based iterative reconstruction methods have been proposed for spectral CT reconstruction. However, these methods usually suffer from difficulties such as laborious parameter selection and expensive computational costs. In addition, due to the image similarity of different energy bins, spectral CT usually implies a strong low-rank prior, which has been widely adopted in current iterative reconstruction models. Singular value thresholding (SVT) is an effective algorithm to solve the low-rank constrained model. However, the SVT method requires a manual selection of thresholds, which may lead to suboptimal results. To relieve these problems, in this article, we propose a sparse and low-rank unrolling network (SOUL-Net) for spectral CT image reconstruction, that learns the parameters and thresholds in a data-driven manner. Furthermore, a Taylor expansion-based neural network backpropagation method is introduced to improve the numerical stability. The qualitative and quantitative results demonstrate that the proposed method outperforms several representative state-of-the-art algorithms in terms of detail preservation and artifact reduction.
Collapse
|
5
|
Zhao Y, Po LM, Lin T, Yan Q, Liu W, Xian P. HSGAN: Hyperspectral Reconstruction From RGB Images With Generative Adversarial Network. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:17137-17150. [PMID: 37561623 DOI: 10.1109/tnnls.2023.3300099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/12/2023]
Abstract
Hyperspectral (HS) reconstruction from RGB images denotes the recovery of whole-scene HS information, which has attracted much attention recently. State-of-the-art approaches often adopt convolutional neural networks to learn the mapping for HS reconstruction from RGB images. However, they often do not achieve high HS reconstruction performance across different scenes consistently. In addition, their performance in recovering HS images from clean and real-world noisy RGB images is not consistent. To improve the HS reconstruction accuracy and robustness across different scenes and from different input images, we present an effective HSGAN framework with a two-stage adversarial training strategy. The generator is a four-level top-down architecture that extracts and combines features on multiple scales. To generalize well to real-world noisy images, we further propose a spatial-spectral attention block (SSAB) to learn both spatial-wise and channel-wise relations. We conduct the HS reconstruction experiments from both clean and real-world noisy RGB images on five well-known HS datasets. The results demonstrate that HSGAN achieves superior performance to existing methods. Please visit https://github.com/zhaoyuzhi/HSGAN to try our codes.
Collapse
|
6
|
Wu W, Pan J, Wang Y, Wang S, Zhang J. Multi-Channel Optimization Generative Model for Stable Ultra-Sparse-View CT Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:3461-3475. [PMID: 38466593 DOI: 10.1109/tmi.2024.3376414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/13/2024]
Abstract
Score-based generative model (SGM) has risen to prominence in sparse-view CT reconstruction due to its impressive generation capability. The consistency of data is crucial in guiding the reconstruction process in SGM-based reconstruction methods. However, the existing data consistency policy exhibits certain limitations. Firstly, it employs partial data from the reconstructed image of the iteration process for image updates, which leads to secondary artifacts with compromising image quality. Moreover, the updates to the SGM and data consistency are considered as distinct stages, disregarding their interdependent relationship. Additionally, the reference image used to compute gradients in the reconstruction process is derived from the intermediate result rather than ground truth. Motivated by the fact that a typical SGM yields distinct outcomes with different random noise inputs, we propose a Multi-channel Optimization Generative Model (MOGM) for stable ultra-sparse-view CT reconstruction by integrating a novel data consistency term into the stochastic differential equation model. Notably, the unique aspect of this data consistency component is its exclusive reliance on original data for effectively confining generation outcomes. Furthermore, we pioneer an inference strategy that traces back from the current iteration result to ground truth, enhancing reconstruction stability through foundational theoretical support. We also establish a multi-channel optimization reconstruction framework, where conventional iterative techniques are employed to seek the reconstruction solution. Quantitative and qualitative assessments on 23 views datasets from numerical simulation, clinical cardiac and sheep's lung underscore the superiority of MOGM over alternative methods. Reconstructing from just 10 and 7 views, our method consistently demonstrates exceptional performance.
Collapse
|
7
|
Bousse A, Kandarpa VSS, Rit S, Perelli A, Li M, Wang G, Zhou J, Wang G. Systematic Review on Learning-based Spectral CT. ARXIV 2024:arXiv:2304.07588v9. [PMID: 37461421 PMCID: PMC10350100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 07/24/2023]
Abstract
Spectral computed tomography (CT) has recently emerged as an advanced version of medical CT and significantly improves conventional (single-energy) CT. Spectral CT has two main forms: dual-energy computed tomography (DECT) and photon-counting computed tomography (PCCT), which offer image improvement, material decomposition, and feature quantification relative to conventional CT. However, the inherent challenges of spectral CT, evidenced by data and image artifacts, remain a bottleneck for clinical applications. To address these problems, machine learning techniques have been widely applied to spectral CT. In this review, we present the state-of-the-art data-driven techniques for spectral CT.
Collapse
Affiliation(s)
| | | | - Simon Rit
- Univ. Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Étienne, CNRS, Inserm, CREATIS UMR 5220, U1294, F-69373, Lyon, France
| | - Alessandro Perelli
- School of Science and Engineering, University of Dundee, DD1 4HN Dundee, U.K
| | - Mengzhou Li
- Biomedical Imaging Center, Rensselaer Polytechnic Institute, Troy, NY 12180 USA
| | - Guobao Wang
- Department of Radiology, University of California Davis Health, Sacramento, CA 95817 USA
| | - Jian Zhou
- CTIQ, Canon Medical Research USA, Inc., Vernon Hills, IL 60061 USA
| | - Ge Wang
- Biomedical Imaging Center, Rensselaer Polytechnic Institute, Troy, NY 12180 USA
| |
Collapse
|
8
|
Zhang X, Li L, Wang S, Liang N, Cai A, Yan B. One-step inverse generation network for sparse-view dual-energy CT reconstruction and material imaging. Phys Med Biol 2024; 69:145012. [PMID: 38955333 DOI: 10.1088/1361-6560/ad5e59] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 07/01/2024] [Indexed: 07/04/2024]
Abstract
Objective.Sparse-view dual-energy spectral computed tomography (DECT) imaging is a challenging inverse problem. Due to the incompleteness of the collected data, the presence of streak artifacts can result in the degradation of reconstructed spectral images. The subsequent material decomposition task in DECT can further lead to the amplification of artifacts and noise.Approach.To address this problem, we propose a novel one-step inverse generation network (OIGN) for sparse-view dual-energy CT imaging, which can achieve simultaneous imaging of spectral images and materials. The entire OIGN consists of five sub-networks that form four modules, including the pre-reconstruction module, the pre-decomposition module, and the following residual filtering module and residual decomposition module. The residual feedback mechanism is introduced to synchronize the optimization of spectral CT images and materials.Main results.Numerical simulation experiments show that the OIGN has better performance on both reconstruction and material decomposition than other state-of-the-art spectral CT imaging algorithms. OIGN also demonstrates high imaging efficiency by completing two high-quality imaging tasks in just 50 seconds. Additionally, anti-noise testing is conducted to evaluate the robustness of OIGN.Significance.These findings have great potential in high-quality multi-task spectral CT imaging in clinical diagnosis.
Collapse
Affiliation(s)
- Xinrui Zhang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou 450001, People's Republic of China
| | - Lei Li
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou 450001, People's Republic of China
| | - Shaoyu Wang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou 450001, People's Republic of China
| | - Ningning Liang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou 450001, People's Republic of China
| | - Ailong Cai
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou 450001, People's Republic of China
| | - Bin Yan
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou 450001, People's Republic of China
| |
Collapse
|
9
|
Wang F, Wang R, Qiu H. Low-dose CT reconstruction using dataset-free learning. PLoS One 2024; 19:e0304738. [PMID: 38875181 PMCID: PMC11178168 DOI: 10.1371/journal.pone.0304738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Accepted: 05/16/2024] [Indexed: 06/16/2024] Open
Abstract
Low-Dose computer tomography (LDCT) is an ideal alternative to reduce radiation risk in clinical applications. Although supervised-deep-learning-based reconstruction methods have demonstrated superior performance compared to conventional model-driven reconstruction algorithms, they require collecting massive pairs of low-dose and norm-dose CT images for neural network training, which limits their practical application in LDCT imaging. In this paper, we propose an unsupervised and training data-free learning reconstruction method for LDCT imaging that avoids the requirement for training data. The proposed method is a post-processing technique that aims to enhance the initial low-quality reconstruction results, and it reconstructs the high-quality images by neural work training that minimizes the ℓ1-norm distance between the CT measurements and their corresponding simulated sinogram data, as well as the total variation (TV) value of the reconstructed image. Moreover, the proposed method does not require to set the weights for both the data fidelity term and the plenty term. Experimental results on the AAPM challenge data and LoDoPab-CT data demonstrate that the proposed method is able to effectively suppress the noise and preserve the tiny structures. Also, these results demonstrate the rapid convergence and low computational cost of the proposed method. The source code is available at https://github.com/linfengyu77/IRLDCT.
Collapse
Affiliation(s)
- Feng Wang
- College of Big Data and Software Engineering, Zhejiang Wanli University, Ningbo, Zhejiang, China
| | - Renfang Wang
- College of Big Data and Software Engineering, Zhejiang Wanli University, Ningbo, Zhejiang, China
| | - Hong Qiu
- College of Big Data and Software Engineering, Zhejiang Wanli University, Ningbo, Zhejiang, China
| |
Collapse
|
10
|
Bousse A, Kandarpa VSS, Rit S, Perelli A, Li M, Wang G, Zhou J, Wang G. Systematic Review on Learning-based Spectral CT. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2024; 8:113-137. [PMID: 38476981 PMCID: PMC10927029 DOI: 10.1109/trpms.2023.3314131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/14/2024]
Abstract
Spectral computed tomography (CT) has recently emerged as an advanced version of medical CT and significantly improves conventional (single-energy) CT. Spectral CT has two main forms: dual-energy computed tomography (DECT) and photon-counting computed tomography (PCCT), which offer image improvement, material decomposition, and feature quantification relative to conventional CT. However, the inherent challenges of spectral CT, evidenced by data and image artifacts, remain a bottleneck for clinical applications. To address these problems, machine learning techniques have been widely applied to spectral CT. In this review, we present the state-of-the-art data-driven techniques for spectral CT.
Collapse
Affiliation(s)
- Alexandre Bousse
- LaTIM, Inserm UMR 1101, Université de Bretagne Occidentale, 29238 Brest, France
| | | | - Simon Rit
- Univ Lyon, INSA-Lyon, Université Claude Bernard Lyon 1, UJM-Saint Étienne, CNRS, Inserm, CREATIS UMR 5220, U1294, F-69373, Lyon, France
| | - Alessandro Perelli
- Department of Biomedical Engineering, School of Science and Engineering, University of Dundee, DD1 4HN, UK
| | - Mengzhou Li
- Biomedical Imaging Center, Rensselaer Polytechnic Institute, Troy, New York, USA
| | - Guobao Wang
- Department of Radiology, University of California Davis Health, Sacramento, USA
| | - Jian Zhou
- CTIQ, Canon Medical Research USA, Inc., Vernon Hills, 60061, USA
| | - Ge Wang
- Biomedical Imaging Center, Rensselaer Polytechnic Institute, Troy, New York, USA
| |
Collapse
|
11
|
Hu R, Xie Y, Zhang L, Liu L, Luo H, Wu R, Luo D, Liu Z, Hu Z. A two-stage deep-learning framework for CT denoising based on a clinically structure-unaligned paired data set. Quant Imaging Med Surg 2024; 14:335-351. [PMID: 38223072 PMCID: PMC10784028 DOI: 10.21037/qims-23-403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Accepted: 10/30/2023] [Indexed: 01/16/2024]
Abstract
Background In low-dose computed tomography (LDCT) lung cancer screening, soft tissue is hardly appreciable due to high noise levels. While deep learning-based LDCT denoising methods have shown promise, they typically rely on structurally aligned synthesized paired data, which lack consideration of the clinical reality that there are no aligned LDCT and normal-dose CT (NDCT) images available. This study introduces an LDCT denoising method using clinically structure-unaligned but paired data sets (LDCT and NDCT scans from the same patients) to improve lesion detection during LDCT lung cancer screening. Methods A cohort of 64 patients undergoing both LDCT and NDCT was randomly divided into training (n=46) and testing (n=18) sets. A two-stage training approach was adopted. First, Gaussian noise was added to NDCT data to create simulated LDCT data for generator training. Then, the model was trained on a clinically structure-unaligned paired data set using a Wasserstein generative adversarial network (WGAN) framework with the initial generator weights obtained during the first stage of training. An attention mechanism was also incorporated into the network. Results Validated on a clinical CT data set, our proposed method outperformed other available methods [CycleGAN, Pixel2Pixel, block-matching and three-dimensional filtering (BM3D)] in noise removal and detail retention tasks in terms of the peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and root mean square error (RMSE) metrics. Compared with the results produced by BM3D, our method yielded an average improvement of approximately 7% in terms of the three evaluation indicators. The probability density profile of the denoised CT output produced using our method best fit the reference NDCT scan. Additionally, our two-stage model outperformed the one-stage WGAN-based model in both objective and subjective evaluations, further demonstrating the higher effectiveness of our two-stage training approach. Conclusions The proposed method performed the best in removing noise from LDCT scans and exhibited good detail retention, which could potentially enhance the lesion detection and characterization effects obtained for soft tissues in the scanning scope of LDCT lung cancer screening.
Collapse
Affiliation(s)
- Ruibao Hu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
- School of Computer and Information, Anhui Normal University, Wuhu, China
| | - Yongsheng Xie
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital and Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, China
| | - Lulu Zhang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Lijian Liu
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital and Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, China
| | - Honghong Luo
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital and Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, China
| | - Ruodai Wu
- Department of Radiology, Shenzhen University General Hospital, Shenzhen University Clinical Medical Academy, Shenzhen, China
| | - Dehong Luo
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital and Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, China
| | - Zhou Liu
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital and Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, China
| | - Zhanli Hu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| |
Collapse
|
12
|
Yu J, Zhang H, Zhang P, Zhu Y. Unsupervised learning-based dual-domain method for low-dose CT denoising. Phys Med Biol 2023; 68:185010. [PMID: 37567225 DOI: 10.1088/1361-6560/acefa2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Accepted: 08/10/2023] [Indexed: 08/13/2023]
Abstract
Objective. Low-dose CT (LDCT) is an important research topic in the field of CT imaging because of its ability to reduce radiation damage in clinical diagnosis. In recent years, deep learning techniques have been widely applied in LDCT imaging and a large number of denoising methods have been proposed. However, One major challenge of supervised deep learning-based methods is the exactly geometric pairing of datasets with different doses. Therefore, the aim of this study is to develop an unsupervised learning-based LDCT imaging method to address the aforementioned challenges.Approach. In this paper, we propose an unsupervised learning-based dual-domain method for LDCT denoising, which consists of two stages: the first stage is projection domain denoising, in which the unsupervised learning method Noise2Self is applied to denoise the projection data with statistically independent and zero-mean noise. The second stage is an iterative enhancement approach, which combines the prior information obtained from the generative model with an iterative reconstruction algorithm to enhance the details of the reconstructed image.Main results. Experimental results show that our proposed method outperforms the comparison method in terms of denoising effect. Particularly, in terms of SSIM, the denoised results obtained using our method achieve the highest SSIM.Significance. In conclusion, our unsupervised learning-based method can be a promising alternative to the traditional supervised methods for LDCT imaging, especially when the availability of the labeled datasets is limited.
Collapse
Affiliation(s)
- Jie Yu
- School of Mathematical Sciences, Capital Normal University, Beijing, 100048, People's Republic of China
| | - Huitao Zhang
- School of Mathematical Sciences, Capital Normal University, Beijing, 100048, People's Republic of China
- Shenzhen National Applied Mathematics Center, Southern University of Science and Technology, Shenzhen, 518055, People's Republic of China
| | - Peng Zhang
- School of Mathematical Sciences, Capital Normal University, Beijing, 100048, People's Republic of China
| | - Yining Zhu
- School of Mathematical Sciences, Capital Normal University, Beijing, 100048, People's Republic of China
- Shenzhen National Applied Mathematics Center, Southern University of Science and Technology, Shenzhen, 518055, People's Republic of China
| |
Collapse
|
13
|
Whitehead JF, Laeseke PF, Periyasamy S, Speidel MA, Wagner MG. In silico simulation of hepatic arteries: An open-source algorithm for efficient synthetic data generation. Med Phys 2023; 50:5505-5517. [PMID: 36950870 PMCID: PMC10517083 DOI: 10.1002/mp.16379] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 02/28/2023] [Accepted: 03/13/2023] [Indexed: 03/24/2023] Open
Abstract
BACKGROUND In silico testing of novel image reconstruction and quantitative algorithms designed for interventional imaging requires realistic high-resolution modeling of arterial trees with contrast dynamics. Furthermore, data synthesis for training of deep learning algorithms requires that an arterial tree generation algorithm be computationally efficient and sufficiently random. PURPOSE The purpose of this paper is to provide a method for anatomically and physiologically motivated, computationally efficient, random hepatic arterial tree generation. METHODS The vessel generation algorithm uses a constrained constructive optimization approach with a volume minimization-based cost function. The optimization is constrained by the Couinaud liver classification system to assure a main feeding artery to each Couinaud segment. An intersection check is included to guarantee non-intersecting vasculature and cubic polynomial fits are used to optimize bifurcation angles and to generate smoothly curved segments. Furthermore, an approach to simulate contrast dynamics and respiratory and cardiac motion is also presented. RESULTS The proposed algorithm can generate a synthetic hepatic arterial tree with 40 000 branches in 11 s. The high-resolution arterial trees have realistic morphological features such as branching angles (MAD with Murray's law= 1.2 ± 1 . 2 o $ = \;1.2 \pm {1.2^o}$ ), radii (median Murray deviation= 0.08 $ = \;0.08$ ), and smoothly curved, non-intersecting vessels. Furthermore, the algorithm assures a main feeding artery to each Couinaud segment and is random (variability = 0.98 ± 0.01). CONCLUSIONS This method facilitates the generation of large datasets of high-resolution, unique hepatic angiograms for the training of deep learning algorithms and initial testing of novel 3D reconstruction and quantitative algorithms designed for interventional imaging.
Collapse
Affiliation(s)
- Joseph F Whitehead
- Department of Medical Physics, University of Wisconsin - Madison, Madison, Wisconsin, USA
| | - Paul F Laeseke
- Department of Medicine, University of Wisconsin - Madison, Madison, Wisconsin, USA
| | - Sarvesh Periyasamy
- Department of Radiology, University of Wisconsin - Madison, Madison, Wisconsin, USA
| | - Michael A Speidel
- Department of Medical Physics, University of Wisconsin - Madison, Madison, Wisconsin, USA
- Department of Medicine, University of Wisconsin - Madison, Madison, Wisconsin, USA
| | - Martin G Wagner
- Department of Medical Physics, University of Wisconsin - Madison, Madison, Wisconsin, USA
- Department of Radiology, University of Wisconsin - Madison, Madison, Wisconsin, USA
| |
Collapse
|
14
|
Wang Z, Liu M, Cheng X, Zhu J, Wang X, Gong H, Liu M, Xu L. Self-adaption and texture generation: A hybrid loss function for low-dose CT denoising. J Appl Clin Med Phys 2023; 24:e14113. [PMID: 37571834 PMCID: PMC10476999 DOI: 10.1002/acm2.14113] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 05/25/2023] [Accepted: 07/11/2023] [Indexed: 08/13/2023] Open
Abstract
BACKGROUND Deep learning has been successfully applied to low-dose CT (LDCT) denoising. But the training of the model is very dependent on an appropriate loss function. Existing denoising models often use per-pixel loss, including mean abs error (MAE) and mean square error (MSE). This ignores the difference in denoising difficulty between different regions of the CT images and leads to the loss of large texture information in the generated image. PURPOSE In this paper, we propose a new hybrid loss function that adapts to the noise in different regions of CT images to balance the denoising difficulty and preserve texture details, thus acquiring CT images with high-quality diagnostic value using LDCT images, providing strong support for condition diagnosis. METHODS We propose a hybrid loss function consisting of weighted patch loss (WPLoss) and high-frequency information loss (HFLoss). To enhance the model's denoising ability of the local areas which are difficult to denoise, we improve the MAE to obtain WPLoss. After the generated image and the target image are divided into several patches, the loss weight of each patch is adaptively and dynamically adjusted according to its loss ratio. In addition, considering that texture details are contained in the high-frequency information of the image, we use HFLoss to calculate the difference between CT images in the high-frequency information part. RESULTS Our hybrid loss function improves the denoising performance of several models in the experiment, and obtains a higher peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM). Moreover, through visual inspection of the generated results of the comparison experiment, the proposed hybrid function can effectively suppress noise and retain image details. CONCLUSIONS We propose a hybrid loss function for LDCT image denoising, which has good interpretation properties and can improve the denoising performance of existing models. And the validation results of multiple models using different datasets show that it has good generalization ability. By using this loss function, high-quality CT images with low radiation are achieved, which can avoid the hazards caused by radiation and ensure the disease diagnosis for patients.
Collapse
Affiliation(s)
- Zhenchuan Wang
- Yangtze Delta Region Institute(Quzhou), University of Electronic Science and Technology of ChinaQuzhouChina
- The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou People's HospitalQuzhouChina
| | - Minghui Liu
- Yangtze Delta Region Institute(Quzhou), University of Electronic Science and Technology of ChinaQuzhouChina
- University of Electronic Science and Technology of ChinaChengduChina
| | - Xuan Cheng
- Yangtze Delta Region Institute(Quzhou), University of Electronic Science and Technology of ChinaQuzhouChina
- University of Electronic Science and Technology of ChinaChengduChina
| | - Jinqi Zhu
- Tianjin Normal UniversityTianjinChina
| | - Xiaomin Wang
- Yangtze Delta Region Institute(Quzhou), University of Electronic Science and Technology of ChinaQuzhouChina
- University of Electronic Science and Technology of ChinaChengduChina
| | - Haigang Gong
- Yangtze Delta Region Institute(Quzhou), University of Electronic Science and Technology of ChinaQuzhouChina
- University of Electronic Science and Technology of ChinaChengduChina
| | - Ming Liu
- The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou People's HospitalQuzhouChina
- University of Electronic Science and Technology of ChinaChengduChina
| | - Lifeng Xu
- The Quzhou Affiliated Hospital of Wenzhou Medical University, Quzhou People's HospitalQuzhouChina
| |
Collapse
|
15
|
Liu J, Zhang T, Kang Y, Wang Y, Zhang Y, Hu D, Chen Y. Deep residual constrained reconstruction via learned convolutional sparse coding for low-dose CT imaging. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
|
16
|
Li Y, Sun X, Wang S, Li X, Qin Y, Pan J, Chen P. MDST: multi-domain sparse-view CT reconstruction based on convolution and swin transformer. Phys Med Biol 2023; 68:095019. [PMID: 36889004 DOI: 10.1088/1361-6560/acc2ab] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 03/08/2023] [Indexed: 03/10/2023]
Abstract
Objective.Sparse-view computed tomography (SVCT), which can reduce the radiation doses administered to patients and hasten data acquisition, has become an area of particular interest to researchers. Most existing deep learning-based image reconstruction methods are based on convolutional neural networks (CNNs). Due to the locality of convolution and continuous sampling operations, existing approaches cannot fully model global context feature dependencies, which makes the CNN-based approaches less efficient in modeling the computed tomography (CT) images with various structural information.Approach.To overcome the above challenges, this paper develops a novel multi-domain optimization network based on convolution and swin transformer (MDST). MDST uses swin transformer block as the main building block in both projection (residual) domain and image (residual) domain sub-networks, which models global and local features of the projections and reconstructed images. MDST consists of two modules for initial reconstruction and residual-assisted reconstruction, respectively. The sparse sinogram is first expanded in the initial reconstruction module with a projection domain sub-network. Then, the sparse-view artifacts are effectively suppressed by an image domain sub-network. Finally, the residual assisted reconstruction module to correct the inconsistency of the initial reconstruction, further preserving image details.Main results. Extensive experiments on CT lymph node datasets and real walnut datasets show that MDST can effectively alleviate the loss of fine details caused by information attenuation and improve the reconstruction quality of medical images.Significance.MDST network is robust and can effectively reconstruct images with different noise level projections. Different from the current prevalent CNN-based networks, MDST uses transformer as the main backbone, which proves the potential of transformer in SVCT reconstruction.
Collapse
Affiliation(s)
- Yu Li
- Department of Information and Communication Engineering, North University of China, Taiyuan, People's Republic of China
- The State Key Lab for Electronic Testing Technology, North University of China, People's Republic of China
| | - XueQin Sun
- Department of Information and Communication Engineering, North University of China, Taiyuan, People's Republic of China
- The State Key Lab for Electronic Testing Technology, North University of China, People's Republic of China
| | - SuKai Wang
- Department of Information and Communication Engineering, North University of China, Taiyuan, People's Republic of China
- The State Key Lab for Electronic Testing Technology, North University of China, People's Republic of China
| | - XuRu Li
- Department of Information and Communication Engineering, North University of China, Taiyuan, People's Republic of China
- The State Key Lab for Electronic Testing Technology, North University of China, People's Republic of China
| | - YingWei Qin
- Department of Information and Communication Engineering, North University of China, Taiyuan, People's Republic of China
- The State Key Lab for Electronic Testing Technology, North University of China, People's Republic of China
| | - JinXiao Pan
- Department of Information and Communication Engineering, North University of China, Taiyuan, People's Republic of China
- The State Key Lab for Electronic Testing Technology, North University of China, People's Republic of China
| | - Ping Chen
- Department of Information and Communication Engineering, North University of China, Taiyuan, People's Republic of China
- The State Key Lab for Electronic Testing Technology, North University of China, People's Republic of China
| |
Collapse
|
17
|
Wang S, Wu W, Cai A, Xu Y, Vardhanabhuti V, Liu F, Yu H. Image-spectral decomposition extended-learning assisted by sparsity for multi-energy computed tomography reconstruction. Quant Imaging Med Surg 2023; 13:610-630. [PMID: 36819292 PMCID: PMC9929415 DOI: 10.21037/qims-22-235] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 11/10/2022] [Indexed: 12/13/2022]
Abstract
Background Multi-energy computed tomography (CT) provides multiple channel-wise reconstructed images, and they can be used for material identification and k-edge imaging. Nonetheless, the projection datasets are frequently corrupted by various noises (e.g., electronic, Poisson) in the acquisition process, resulting in lower signal-noise-ratio (SNR) measurements. Multi-energy CT images have local sparsity, nonlocal self-similarity in spatial dimension, and correlation in spectral dimension. Methods In this paper, we propose an image-spectral decomposition extended-learning assisted by sparsity (IDEAS) method to fully exploit these intrinsic priors for multi-energy CT image reconstruction. Particularly, a nonlocal low-rank Tucker decomposition (TD) is employed to utilize the correlation and nonlocal self-similarity priors. Moreover, considering the advantages of multi-task tensor dictionary learning (TDL) in sparse representation, an adaptive spatial dictionary and an adaptive spectral dictionary are trained during the iterative reconstruction process. Furthermore, a weighted total variation (TV) regularization term is employed to encourage local sparsity. Results Numerical simulation, physical phantom, and preclinical mouse experiments are performed to validate the proposed IDEAS algorithm. Specifically, in the simulation experiments, the proposed IDEAS reconstructed high-quality images that are very close to the references. For example, the root mean square error (RMSE) of IDEAS image in energy bin 1 is as low as 0.0672, while the RMSE of other methods are higher than 0.0843. Besides, the structural similarity (SSIM) of IDEAS reconstructed image in energy bin 1 is greater than 0.98. For material decomposition, the RMSE of IDEAS bone component is as low as 0.0152, and other methods are higher than 0.0199. In addition, the computational cost of IDEAS is as low as 98.8 s for one iteration, and the competing tensor decomposition method is higher than 327 s. Conclusions To further improve the quality of the reconstructed multi-energy CT images, multiple prior regularizations are introduced to the multi-energy CT reconstructed model, leading to an IDEAS method. Both qualitative and quantitative evaluation of our results confirm the outstanding performance of the proposed algorithm compared to the state-of-the-arts.
Collapse
Affiliation(s)
- Shaoyu Wang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, China;,Key Lab of Optoelectronic Technology and Systems, Ministry of Education, Chongqing University, Chongqing, China;,Department of Electrical and Computer Engineering, University of Massachusetts Lowell, Lowell, MA, USA
| | - Weiwen Wu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| | - Ailong Cai
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Yongshun Xu
- Department of Electrical and Computer Engineering, University of Massachusetts Lowell, Lowell, MA, USA
| | - Varut Vardhanabhuti
- Department of Diagnostic Radiology, The University of Hong Kong, Hong Kong, China
| | - Fenglin Liu
- Key Lab of Optoelectronic Technology and Systems, Ministry of Education, Chongqing University, Chongqing, China
| | - Hengyong Yu
- Department of Electrical and Computer Engineering, University of Massachusetts Lowell, Lowell, MA, USA
| |
Collapse
|
18
|
Huang Z, Liu Z, He P, Ren Y, Li S, Lei Y, Luo D, Liang D, Shao D, Hu Z, Zhang N. Segmentation-guided Denoising Network for Low-dose CT Imaging. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 227:107199. [PMID: 36334524 DOI: 10.1016/j.cmpb.2022.107199] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 10/06/2022] [Accepted: 10/21/2022] [Indexed: 05/15/2023]
Abstract
BACKGROUND To reduce radiation exposure and improve diagnosis in low-dose computed tomography, several deep learning (DL)-based image denoising methods have been proposed to suppress noise and artifacts over the past few years. However, most of them seek an objective data distribution approximating the gold standard and neglect structural semantic preservation. Moreover, the numerical response in CT images presents substantial regional anatomical differences among tissues in terms of X-ray absorbency. METHODS In this paper, we introduce structural semantic information for low-dose CT imaging. First, the regional segmentation prior to low-dose CT can guide the denoising process. Second the structural semantical results can be considered as evaluation metrics on the estimated normal-dose CT images. Then, a semantic feature transform is engaged to combine the semantic and image features on a semantic fusion module. In addition, the structural semantic loss function is introduced to measure the segmentation difference. RESULTS Experiments are conducted on clinical abdomen data obtained from a clinical hospital, and the semantic labels consist of subcutaneous fat, muscle and visceral fat associated with body physical evaluation. Compared with other DL-based methods, the proposed method achieves better performance on quantitative metrics and better semantic evaluation. CONCLUSIONS The quantitative experimental results demonstrate the promising performance of the proposed methods in noise reduction and structural semantic preservation. While, the proposed method may suffer from several limitations on abnormalities, unknown noise and different manufacturers. In the future, the proposed method will be further explored, and wider applications in PET/CT and PET/MR will be sought.
Collapse
Affiliation(s)
- Zhenxing Huang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Zhou Liu
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Pin He
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Ya Ren
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Shuluan Li
- Department of Medical Oncology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Yuanyuan Lei
- Department of Pathology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Dehong Luo
- Department of Radiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Shenzhen, 518116, China
| | - Dong Liang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Dan Shao
- Department of Nuclear Medicine, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou 510080, China
| | - Zhanli Hu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Na Zhang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China.
| |
Collapse
|
19
|
Liu X, Liang X, Deng L, Tan S, Xie Y. Learning low-dose CT degradation from unpaired data with flow-based model. Med Phys 2022; 49:7516-7530. [PMID: 35880375 DOI: 10.1002/mp.15886] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 07/13/2022] [Accepted: 07/17/2022] [Indexed: 12/27/2022] Open
Abstract
BACKGROUND There has been growing interest in low-dose computed tomography (LDCT) for reducing the X-ray radiation to patients. However, LDCT always suffers from complex noise in reconstructed images. Although deep learning-based methods have shown their strong performance in LDCT denoising, most of them require a large number of paired training data of normal-dose CT (NDCT) images and LDCT images, which are hard to acquire in the clinic. Lack of paired training data significantly undermines the practicability of supervised deep learning-based methods. To alleviate this problem, unsupervised or weakly supervised deep learning-based methods are required. PURPOSE We aimed to propose a method that achieves LDCT denoising without training pairs. Specifically, we first trained a neural network in a weakly supervised manner to simulate LDCT images from NDCT images. Then, simulated training pairs could be used for supervised deep denoising networks. METHODS We proposed a weakly supervised method to learn the degradation of LDCT from unpaired LDCT and NDCT images. Concretely, LDCT and normal-dose images were fed into one shared flow-based model and projected to the latent space. Then, the degradation between low-dose and normal-dose images was modeled in the latent space. Finally, the model was trained by minimizing the negative log-likelihood loss with no requirement of paired training data. After training, an NDCT image can be input to the trained flow-based model to generate the corresponding LDCT image. The simulated image pairs of NDCT and LDCT can be further used to train supervised denoising neural networks for test. RESULTS Our method achieved much better performance on LDCT image simulation compared with the most widely used image-to-image translation method, CycleGAN, according to the radial noise power spectrum. The simulated image pairs could be used for any supervised LDCT denoising neural networks. We validated the effectiveness of our generated image pairs on a classic convolutional neural network, REDCNN, and a novel transformer-based model, TransCT. Our method achieved mean peak signal-to-noise ratio (PSNR) of 24.43dB, mean structural similarity (SSIM) of 0.785 on an abdomen CT dataset, mean PSNR of 33.88dB, mean SSIM of 0.797 on a chest CT dataset, which outperformed several traditional CT denoising methods, the same network trained by CycleGAN-generated data, and a novel transfer learning method. Besides, our method was on par with the supervised networks in terms of visual effects. CONCLUSION We proposed a flow-based method to learn LDCT degradation from only unpaired training data. It achieved impressive performance on LDCT synthesis. Next, we could train neural networks with the generated paired data for LDCT denoising. The denoising results are better than traditional and weakly supervised methods, comparable to supervised deep learning methods.
Collapse
Affiliation(s)
- Xuan Liu
- School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China
| | - Xiaokun Liang
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Lei Deng
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Shan Tan
- School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China
| | - Yaoqin Xie
- Institute of Biomedical and Health Engineering, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| |
Collapse
|
20
|
Wu W, Yu H, Liu F, Zhang J, Vardhanabhuti V, Chen J. Spectral CT reconstruction via Spectral-Image Tensor and Bidirectional Image-gradient minimization. Comput Biol Med 2022; 151:106080. [PMID: 36327881 DOI: 10.1016/j.compbiomed.2022.106080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 08/19/2022] [Accepted: 09/03/2022] [Indexed: 12/27/2022]
Abstract
It is challenging to obtain good image quality in spectral computed tomography (CT) as the photon-number for the photon-counting detectors is limited for each narrow energy bin. This results in a lower signal to noise ratio (SNR) for the projections. To handle this issue, we first formulate the weight bidirectional image gradient with L0-norm constraint of spectral CT image. Then, as a new regularizer, bidirectional image gradient with L0-norm constraint is introduced into the tensor decomposition model, generating the Spectral-Image Tensor and Bidirectional Image-gradient Minimization (SITBIM) algorithm. Finally, the split-Bregman method is employed to optimize the proposed SITBIM mathematical model. The experiments on the numerical mouse phantom and real mouse experiments are designed to validate and evaluate the SITBIM method. The results demonstrate that the SITBIM can outperform other state-of-the-art methods (including TVM, TV + LR, SSCMF and NLCTF). INDEX TERMS: -spectral CT, image reconstruction, tensor decomposition, unidirectional image gradient, image similarity.
Collapse
Affiliation(s)
- Weiwen Wu
- The School of Biomedical Engineering, Shenzhen Campus, Sun Yat-sen University, Shenzhen, Guangdong, 518107, China; The University of Hong Kong, Hong Kong, 999077, China
| | - Hengyong Yu
- Department of Electrical and Computer Engineering, University of Massachusetts Lowell, Lowell, MA, 01854, USA
| | - Fenglin Liu
- The Key Lab of Optoelectronic Technology and Systems, Ministry of Education, Chongqing University, Chongqing, 400044, China
| | - Jianjia Zhang
- The School of Biomedical Engineering, Shenzhen Campus, Sun Yat-sen University, Shenzhen, Guangdong, 518107, China.
| | | | | |
Collapse
|
21
|
Liu H, Liao P, Chen H, Zhang Y. ERA-WGAT: Edge-enhanced residual autoencoder with a window-based graph attention convolutional network for low-dose CT denoising. BIOMEDICAL OPTICS EXPRESS 2022; 13:5775-5793. [PMID: 36733738 PMCID: PMC9872905 DOI: 10.1364/boe.471340] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 09/03/2022] [Accepted: 09/19/2022] [Indexed: 06/18/2023]
Abstract
Computed tomography (CT) has become a powerful tool for medical diagnosis. However, minimizing X-ray radiation risk for the patient poses significant challenges to obtain suitable low dose CT images. Although various low-dose CT methods using deep learning techniques have produced impressive results, convolutional neural network based methods focus more on local information and hence are very limited for non-local information extraction. This paper proposes ERA-WGAT, a residual autoencoder incorporating an edge enhancement module that performs convolution with eight types of learnable operators providing rich edge information and a window-based graph attention convolutional network that combines static and dynamic attention modules to explore non-local self-similarity. We use the compound loss function that combines MSE loss and multi-scale perceptual loss to mitigate the over-smoothing problem. Compared with current low-dose CT denoising methods, ERA-WGAT confirmed superior noise suppression and perceived image quality.
Collapse
Affiliation(s)
- Han Liu
- College of Computer Science, Sichuan University, Chengdu 610065, China
| | - Peixi Liao
- Department of Scientific Research and Education, The Sixth People’s Hospital of Chengdu, Chengdu 610051, China
| | - Hu Chen
- College of Computer Science, Sichuan University, Chengdu 610065, China
| | - Yi Zhang
- College of Computer Science, Sichuan University, Chengdu 610065, China
| |
Collapse
|
22
|
Wen YC, Wen S, Hsu L, Chi S. Spectral Reflectance Recovery from the Quadcolor Camera Signals Using the Interpolation and Weighted Principal Component Analysis Methods. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22166288. [PMID: 36016049 PMCID: PMC9416231 DOI: 10.3390/s22166288] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 08/14/2022] [Accepted: 08/19/2022] [Indexed: 05/25/2023]
Abstract
The recovery of surface spectral reflectance using the quadcolor camera was numerically studied. Assume that the RGB channels of the quadcolor camera are the same as the Nikon D5100 tricolor camera. The spectral sensitivity of the fourth signal channel was tailored using a color filter. Munsell color chips were used as reflective surfaces. When the interpolation method or the weighted principal component analysis (wPCA) method is used to reconstruct spectra, using the quadcolor camera can effectively reduce the mean spectral error of the test samples compared to using the tricolor camera. Except for computation time, the interpolation method outperforms the wPCA method in spectrum reconstruction. A long-pass optical filter can be applied to the fourth channel for reducing the mean spectral error. A short-pass optical filter can be applied to the fourth channel for reducing the mean color difference, but the mean spectral error will be larger. Due to the small color difference, the quadcolor camera using an optimized short-pass filter may be suitable as an imaging colorimeter. It was found that an empirical design rule to keep the color difference small is to reduce the error in fitting the color-matching functions using the camera spectral sensitivity functions.
Collapse
Affiliation(s)
- Yu-Che Wen
- Department of Electrophysics, National Yang Ming Chiao Tung University, No. 1001 University Road, Hsinchu 30010, Taiwan
| | - Senfar Wen
- Department of Electrical Engineering, Yuan Ze University, No. 135 Yuan-Tung Road, Taoyuan 320, Taiwan
| | - Long Hsu
- Department of Electrophysics, National Yang Ming Chiao Tung University, No. 1001 University Road, Hsinchu 30010, Taiwan
| | - Sien Chi
- Department of Photonics, National Yang Ming Chiao Tung University, No. 1001 University Road, Hsinchu 30010, Taiwan
| |
Collapse
|
23
|
Liu J, Jiang H, Ning F, Li M, Pang W. DFSNE-Net: Deviant feature sensitive noise estimate network for low-dose CT denoising. Comput Biol Med 2022; 149:106061. [DOI: 10.1016/j.compbiomed.2022.106061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 08/10/2022] [Accepted: 08/27/2022] [Indexed: 11/26/2022]
|
24
|
Jing J, Xia W, Hou M, Chen H, Liu Y, Zhou J, Zhang Y. Training low dose CT denoising network without high quality reference data. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac5f70] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Accepted: 03/21/2022] [Indexed: 11/12/2022]
Abstract
Abstract
Objective. Currently, the field of low-dose CT (LDCT) denoising is dominated by supervised learning based methods, which need perfectly registered pairs of LDCT and its corresponding clean reference image (normal-dose CT). However, training without clean labels is more practically feasible and significant, since it is clinically impossible to acquire a large amount of these paired samples. In this paper, a self-supervised denoising method is proposed for LDCT imaging. Approach. The proposed method does not require any clean images. In addition, the perceptual loss is used to achieve data consistency in feature domain during the denoising process. Attention blocks used in decoding phase can help further improve the image quality. Main results. In the experiments, we validate the effectiveness of our proposed self-supervised framework and compare our method with several state-of-the-art supervised and unsupervised methods. The results show that our proposed model achieves competitive performance in both qualitative and quantitative aspects to other methods. Significance. Our framework can be directly applied to most denoising scenarios without collecting pairs of training data, which is more flexible for real clinical scenario.
Collapse
|
25
|
Yao Y, Li L, Chen Z. Iterative dynamic dual-energy CT algorithm in reducing statistical noise in multi-energy CT imaging. Phys Med Biol 2021; 67. [PMID: 34937002 DOI: 10.1088/1361-6560/ac459d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Accepted: 12/22/2021] [Indexed: 11/11/2022]
Abstract
Multi-energy spectral CT has a broader range of applications with the recent development of photon-counting detectors. However, the photons counted in each energy bin decrease when the number of energy bins increases, which causes a higher statistical noise level of the CT image. In this work, we propose a novel iterative dynamic dual-energy CT algorithm to reduce the statistical noise. In the proposed algorithm, the multi-energy projections are estimated from the dynamic dual-energy CT data during the iterative process. The proposed algorithm is verified on sufficient numerical simulations and a laboratory two-energy-threshold PCD system. By applying the same reconstruction algorithm, the dynamic dual-energy CT's final reconstruction results have a much lower statistical noise level than the conventional multi-energy CT. Moreover, based on the analysis of the simulation results, we explain why the dynamic dual-energy CT has a lower statistical noise level than the conventional multi-energy CT. The reason is that: the statistical noise level of multi-energy projection estimated with the proposed algorithm is much lower than that of the conventional multi-energy CT, which leads to less statistical noise of the dynamic dual-energy CT imaging.
Collapse
Affiliation(s)
- Yidi Yao
- Department of Engineering Physics, Tsinghua University, 30 Shuangqing Rd, Hai Dian Qu, Beijing, 100084, CHINA
| | - Liang Li
- Department of Engineering Physics, Tsinghua University, 30 Shuangqing Rd, Hai Dian Qu, Beijing, 100084, CHINA
| | - Zhiqiang Chen
- Department of Engineering Physics, Tsinghua University, 30 Shuangqing Rd, Hai Dian Qu, Beijing, 100084, CHINA
| |
Collapse
|
26
|
Sun C, Liu Y, Yang H. Degradation-Aware Deep Learning Framework for Sparse-View CT Reconstruction. Tomography 2021; 7:932-949. [PMID: 34941649 PMCID: PMC8704775 DOI: 10.3390/tomography7040077] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Revised: 11/25/2021] [Accepted: 11/29/2021] [Indexed: 12/11/2022] Open
Abstract
Sparse-view CT reconstruction is a fundamental task in computed tomography to overcome undesired artifacts and recover the details of textual structure in degraded CT images. Recently, many deep learning-based networks have achieved desirable performances compared to iterative reconstruction algorithms. However, the performance of these methods may severely deteriorate when the degradation strength of the test image is not consistent with that of the training dataset. In addition, these methods do not pay enough attention to the characteristics of different degradation levels, so solely extending the training dataset with multiple degraded images is also not effective. Although training plentiful models in terms of each degradation level can mitigate this problem, extensive parameter storage is involved. Accordingly, in this paper, we focused on sparse-view CT reconstruction for multiple degradation levels. We propose a single degradation-aware deep learning framework to predict clear CT images by understanding the disparity of degradation in both the frequency domain and image domain. The dual-domain procedure can perform particular operations at different degradation levels in frequency component recovery and spatial details reconstruction. The peak signal-to-noise ratio (PSNR), structural similarity (SSIM) and visual results demonstrate that our method outperformed the classical deep learning-based reconstruction methods in terms of effectiveness and scalability.
Collapse
|
27
|
Xia W, Lu Z, Huang Y, Shi Z, Liu Y, Chen H, Chen Y, Zhou J, Zhang Y. MAGIC: Manifold and Graph Integrative Convolutional Network for Low-Dose CT Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3459-3472. [PMID: 34110990 DOI: 10.1109/tmi.2021.3088344] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Low-dose computed tomography (LDCT) scans, which can effectively alleviate the radiation problem, will degrade the imaging quality. In this paper, we propose a novel LDCT reconstruction network that unrolls the iterative scheme and performs in both image and manifold spaces. Because patch manifolds of medical images have low-dimensional structures, we can build graphs from the manifolds. Then, we simultaneously leverage the spatial convolution to extract the local pixel-level features from the images and incorporate the graph convolution to analyze the nonlocal topological features in manifold space. The experiments show that our proposed method outperforms both the quantitative and qualitative aspects of state-of-the-art methods. In addition, aided by a projection loss component, our proposed method also demonstrates superior performance for semi-supervised learning. The network can remove most noise while maintaining the details of only 10% (40 slices) of the training data labeled.
Collapse
|
28
|
Zhou Q, Huang X, Xie Y, Liu X, Li S, Zhou J. Role of quantitative energy spectrum CT parameters in differentiating thymic epithelial tumours and thymic cysts. Clin Radiol 2021; 77:136-141. [PMID: 34857380 DOI: 10.1016/j.crad.2021.10.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Accepted: 11/01/2021] [Indexed: 11/30/2022]
Abstract
AIM To explore the utility of multiple energy spectrum computed tomography (CT) parameters in distinguishing thymic epithelial tumours (TETs) from thymic cysts among lesions <5 cm in diameter. MATERIALS AND METHODS Data pertaining to 56 patients with TETs and thymic cysts <5 cm in diameter were assessed retrospectively. All patients underwent surgical resection and the diagnosis was confirmed histopathologically. Thirty-five patients with TETs (average age, 51.97 years) and 21 patients with thymic cysts (average age, 50.54 years) were included. The region of interest for the lesion on the energy spectrum CT was delineated on the post-processing workstation, and multiple parameters of the energy spectrum CT were obtained. The diagnostic efficacies of the parameters were analysed using receiver operating characteristic (ROC) curves. RESULTS To distinguish small TETs from thymic cysts, a single-energy CT value of 60 keV showed good differential diagnostic performance in the arterial phase (cut-off value = 68.42 HU; area under the curve [AUC] = 0.978), a single-energy CT value of 70 keV showed good differential diagnostic performance in the venous phase (cut-off value = 59.77 HU; AUC = 0.956). In the arterial and venous phases, effective atomic numbers of 8.065 and 8.175, respectively, were used as cut-off values to distinguish small TETs from thymic cysts (AUC = 0.972 and AUC = 0.961, respectively). Iodine concentrations of 10.99 and 11.05 were used as cut-off values to distinguish small TETs from thymic cysts (AUC = 0.956 and AUC = 0.924, respectively). CONCLUSION According to the present study, energy spectrum CT parameters may have clinical value in the differential diagnosis of TETs and thymic cysts.
Collapse
Affiliation(s)
- Q Zhou
- Department of Radiology, Lanzhou University Second Hospital, Gansu, China; Second Clinical School, Lanzhou University, China; Key Laboratory of Medical Imaging of Gansu Province, Lanzhou University Second Hospital, China; Gansu International Scientific and Technological Cooperation Base of Medical Imaging Artificial Intelligence, China
| | - X Huang
- Department of Radiology, Lanzhou University Second Hospital, Gansu, China; Second Clinical School, Lanzhou University, China; Key Laboratory of Medical Imaging of Gansu Province, Lanzhou University Second Hospital, China; Gansu International Scientific and Technological Cooperation Base of Medical Imaging Artificial Intelligence, China
| | - Y Xie
- Department of Radiology, Lanzhou University Second Hospital, Gansu, China; Second Clinical School, Lanzhou University, China; Key Laboratory of Medical Imaging of Gansu Province, Lanzhou University Second Hospital, China; Gansu International Scientific and Technological Cooperation Base of Medical Imaging Artificial Intelligence, China
| | - X Liu
- Department of Radiology, Lanzhou University Second Hospital, Gansu, China; Second Clinical School, Lanzhou University, China; Key Laboratory of Medical Imaging of Gansu Province, Lanzhou University Second Hospital, China; Gansu International Scientific and Technological Cooperation Base of Medical Imaging Artificial Intelligence, China
| | - S Li
- Department of Radiology, Lanzhou University Second Hospital, Gansu, China; Second Clinical School, Lanzhou University, China; Key Laboratory of Medical Imaging of Gansu Province, Lanzhou University Second Hospital, China; Gansu International Scientific and Technological Cooperation Base of Medical Imaging Artificial Intelligence, China
| | - J Zhou
- Department of Radiology, Lanzhou University Second Hospital, Gansu, China; Key Laboratory of Medical Imaging of Gansu Province, Lanzhou University Second Hospital, China; Gansu International Scientific and Technological Cooperation Base of Medical Imaging Artificial Intelligence, China.
| |
Collapse
|
29
|
Low-Dose CT Image Denoising with Improving WGAN and Hybrid Loss Function. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:2973108. [PMID: 34484414 PMCID: PMC8416402 DOI: 10.1155/2021/2973108] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Revised: 07/12/2021] [Accepted: 08/12/2021] [Indexed: 11/17/2022]
Abstract
The X-ray radiation from computed tomography (CT) brought us the potential risk. Simply decreasing the dose makes the CT images noisy and diagnostic performance compromised. Here, we develop a novel denoising low-dose CT image method. Our framework is based on an improved generative adversarial network coupling with the hybrid loss function, including the adversarial loss, perceptual loss, sharpness loss, and structural similarity loss. Among the loss function terms, perceptual loss and structural similarity loss are made use of to preserve textural details, and sharpness loss can make reconstruction images clear. The adversarial loss can sharp the boundary regions. The results of experiments show the proposed method can effectively remove noise and artifacts better than the state-of-the-art methods in the aspects of the visual effect, the quantitative measurements, and the texture details.
Collapse
|
30
|
Huang Z, Liu X, Wang R, Chen Z, Yang Y, Liu X, Zheng H, Liang D, Hu Z. Learning a Deep CNN Denoising Approach Using Anatomical Prior Information Implemented With Attention Mechanism for Low-Dose CT Imaging on Clinical Patient Data From Multiple Anatomical Sites. IEEE J Biomed Health Inform 2021; 25:3416-3427. [PMID: 33625991 DOI: 10.1109/jbhi.2021.3061758] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Dose reduction in computed tomography (CT) has gained considerable attention in clinical applications because it decreases radiation risks. However, a lower dose generates noise in low-dose computed tomography (LDCT) images. Previous deep learning (DL)-based works have investigated ways to improve diagnostic performance to address this ill-posed problem. However, most of them disregard the anatomical differences among different human body sites in constructing the mapping function between LDCT images and their high-resolution normal-dose CT (NDCT) counterparts. In this article, we propose a novel deep convolutional neural network (CNN) denoising approach by introducing information of the anatomical prior. Instead of designing multiple networks for each independent human body anatomical site, a unified network framework is employed to process anatomical information. The anatomical prior is represented as a pattern of weights of the features extracted from the corresponding LDCT image in an anatomical prior fusion module. To promote diversity in the contextual information, a spatial attention fusion mechanism is introduced to capture many local regions of interest in the attention fusion module. Although many network parameters are saved, the experimental results demonstrate that our method, which incorporates anatomical prior information, is effective in denoising LDCT images. Furthermore, the anatomical prior fusion module could be conveniently integrated into other DL-based methods and avails the performance improvement on multiple anatomical data.
Collapse
|
31
|
Lin YT, Finlayson GD. On the Optimization of Regression-Based Spectral Reconstruction. SENSORS (BASEL, SWITZERLAND) 2021; 21:5586. [PMID: 34451030 PMCID: PMC8402277 DOI: 10.3390/s21165586] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Revised: 08/14/2021] [Accepted: 08/15/2021] [Indexed: 11/16/2022]
Abstract
Spectral reconstruction (SR) algorithms attempt to recover hyperspectral information from RGB camera responses. Recently, the most common metric for evaluating the performance of SR algorithms is the Mean Relative Absolute Error (MRAE)-an ℓ1 relative error (also known as percentage error). Unsurprisingly, the leading algorithms based on Deep Neural Networks (DNN) are trained and tested using the MRAE metric. In contrast, the much simpler regression-based methods (which actually can work tolerably well) are trained to optimize a generic Root Mean Square Error (RMSE) and then tested in MRAE. Another issue with the regression methods is-because in SR the linear systems are large and ill-posed-that they are necessarily solved using regularization. However, hitherto the regularization has been applied at a spectrum level, whereas in MRAE the errors are measured per wavelength (i.e., per spectral channel) and then averaged. The two aims of this paper are, first, to reformulate the simple regressions so that they minimize a relative error metric in training-we formulate both ℓ2 and ℓ1 relative error variants where the latter is MRAE-and, second, we adopt a per-channel regularization strategy. Together, our modifications to how the regressions are formulated and solved leads to up to a 14% increment in mean performance and up to 17% in worst-case performance (measured with MRAE). Importantly, our best result narrows the gap between the regression approaches and the leading DNN model to around 8% in mean accuracy.
Collapse
Affiliation(s)
- Yi-Tun Lin
- School of Computing Sciences, University of East Anglia, Norwich NR4 7TJ, UK;
| | | |
Collapse
|
32
|
Wang AS, Pelc NJ. Spectral Photon Counting CT: Imaging Algorithms and Performance Assessment. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2021; 5:453-464. [PMID: 35419500 PMCID: PMC9000208 DOI: 10.1109/trpms.2020.3007380] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/27/2023]
Abstract
Photon counting x-ray detectors (PCDs) with spectral capabilities have the potential to revolutionize computed tomography (CT) for medical imaging. The ideal PCD provides accurate energy information for each incident x-ray, and at high spatial resolution. This information enables material-specific imaging, enhanced radiation dose efficiency, and improved spatial resolution in CT images. In practice, PCDs are affected by non-idealities, including limited energy resolution, pulse pileup, and cross talk due to charge sharing, K-fluorescence, and Compton scattering. In order to maximize their performance, PCDs must be carefully designed to reduce these effects and then later account for them during correction and post-acquisition steps. This review article examines algorithms for using PCDs in spectral CT applications, including how non-idealities impact image quality. Performance assessment metrics that account for spatial resolution and noise such as the detective quantum efficiency (DQE) can be used to compare different PCD designs, as well as compare PCDs with conventional energy integrating detectors (EIDs). These methods play an important role in enhancing spectral CT images and assessing the overall performance of PCDs.
Collapse
Affiliation(s)
- Adam S Wang
- Departments of Radiology and, by courtesy, Electrical Engineering, Stanford University, Stanford, CA 94305 USA
| | - Norbert J Pelc
- Department of Radiology, Stanford University, Stanford, CA 94305 USA
| |
Collapse
|
33
|
Zhang T, Zhao S, Ma X, Cuadros AP, Zhao Q, Arce GR. Nonlinear reconstruction of coded spectral X-ray CT based on material decomposition. OPTICS EXPRESS 2021; 29:19319-19339. [PMID: 34266043 DOI: 10.1364/oe.426732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 05/28/2021] [Indexed: 06/13/2023]
Abstract
Coded spectral X-ray computed tomography (CT) based on K-edge filtered illumination is a cost-effective approach to acquire both 3-dimensional structure of objects and their material composition. This approach allows sets of incomplete rays from sparse views or sparse rays with both spatial and spectral encoding to effectively reduce the inspection duration or radiation dose, which is of significance in biological imaging and medical diagnostics. However, reconstruction of spectral CT images from compressed measurements is a nonlinear and ill-posed problem. This paper proposes a material-decomposition-based approach to directly solve the reconstruction problem, without estimating the energy-binned sinograms. This approach assumes that the linear attenuation coefficient map of objects can be decomposed into a few basis materials that are separable in the spectral and space domains. The nonlinear problem is then converted to the reconstruction of the mass density maps of the basis materials. The dimensionality of the optimization variables is thus effectively reduced to overcome the ill-posedness. An alternating minimization scheme is used to solve the reconstruction with regularizations of weighted nuclear norm and total variation. Compared to the state-of-the-art reconstruction method for coded spectral CT, the proposed method can significantly improve the reconstruction quality. It is also capable of reconstructing the spectral CT images at two additional energy bins from the same set of measurements, thus providing more spectral information of the object.
Collapse
|
34
|
Considering anatomical prior information for low-dose CT image enhancement using attribute-augmented Wasserstein generative adversarial networks. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.10.077] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
35
|
Zhang T, Wu C, Li Z, Ding Y, Wen L, Wang L. CAMPO Precision128 Max ENERGY Spectrum CT Combined with Multiple Parameters to Evaluate the Benign and Malignant Pleural Effusion. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:5526977. [PMID: 33728032 PMCID: PMC7935599 DOI: 10.1155/2021/5526977] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 01/30/2021] [Accepted: 02/16/2021] [Indexed: 12/11/2022]
Abstract
The emergence of energy spectrum CT provides greater diagnostic value for clinical practice. Its advantage is that it can provide more functional imaging parameters and accurate image information for clinical practice, which represents a mainstream direction of CT technology development at present. This paper mainly studies the clinical trial of CAMPO Precision128 Max ENERGY spectrum CT combined with multiple parameters to evaluate the benign and malignant pleural effusion. This paper analyzes the principle and key performance parameters of energy spectrum CT imaging, the etiology of pleural effusion, and its conventional diagnostic methods and uses energy spectrum CT to detect the benign and malignant pleural effusion. In this paper, two groups of patients with different types of pleural effusions were scanned by line spectrum chest CT scans, and energy spectrum analysis software was used to measure and calculate the CT values of conventional mixed energy values of ROI of patients with pleural effusions. For the CT value and energy curve slope measurement value of different single energy keV, independent sample t-test was used to analyze and compare the two sets of data, and finally it has been found out that the two sets of data were similar. According to the experimental results, the curves of energy spectrum of the two groups of data are similar in the descending curve of bow-back. The slope of energy spectrum curve in the leakage group was lower than that in the exudate group, showing statistical significance (P < 0.05). The slope of energy spectrum curve K in the malignant pleural effusion group was significantly higher than that in the benign pleural effusion group, and the difference was statistically significant (P < 0.05). The trend of energy spectrum curves of the two is roughly the same, while at the high energy level, part of the energy spectrum curves of the two are overlapped. The above conclusion indicates that energy spectrum CT plays a certain role in the differential diagnosis of pleural effusion. At the same time, energy spectrum CT also provides a noninvasive and rapid examination method for clinical differentiation of pleural effusion, which has certain clinical application value and prospect.
Collapse
Affiliation(s)
- Tianyu Zhang
- CT Section of The Second Hospital Affiliated Qiqihar Medical University, Qiqihar 161000, Heilongjiang, China
| | - Cuicui Wu
- Qiqihar Medical University, Qiqihar 161000, Heilongjiang, China
| | - Zhongtao Li
- Qiqihar Medical University, Qiqihar 161000, Heilongjiang, China
| | - Yan Ding
- Ultrasound Department, The Third Hospital Affiliated Qiqihar Medical University, Qiqihar 161000, Heilongjiang, China
| | - Lijuan Wen
- Radiology Center, The Third Hospital Affiliated Qiqihar Medical University, Qiqihar 161000, Heilongjiang, China
| | - Li Wang
- Radiology Center, The Third Hospital Affiliated Qiqihar Medical University, Qiqihar 161000, Heilongjiang, China
| |
Collapse
|
36
|
Abstract
The introduction of photon-counting detectors is expected to be the next major breakthrough in clinical x-ray computed tomography (CT). During the last decade, there has been considerable research activity in the field of photon-counting CT, in terms of both hardware development and theoretical understanding of the factors affecting image quality. In this article, we review the recent progress in this field with the intent of highlighting the relationship between detector design considerations and the resulting image quality. We discuss detector design choices such as converter material, pixel size, and readout electronics design, and then elucidate their impact on detector performance in terms of dose efficiency, spatial resolution, and energy resolution. Furthermore, we give an overview of data processing, reconstruction methods and metrics of imaging performance; outline clinical applications; and discuss potential future developments.
Collapse
Affiliation(s)
- Mats Danielsson
- Department of Physics, KTH Royal Institute of Technology, AlbaNova University Center, SE-106 91 Stockholm, Sweden. Prismatic Sensors AB, AlbaNova University Center, SE-106 91 Stockholm, Sweden
| | | | | |
Collapse
|
37
|
Wang Y, Zhang W, Cai A, Wang L, Tang C, Feng Z, Li L, Liang N, Yan B. An effective sinogram inpainting for complementary limited-angle dual-energy computed tomography imaging using generative adversarial networks. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2021; 29:37-61. [PMID: 33104055 DOI: 10.3233/xst-200736] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Dual-energy computed tomography (DECT) provides more anatomical and functional information for image diagnosis. Presently, the popular DECT imaging systems need to scan at least full angle (i.e., 360°). In this study, we propose a DECT using complementary limited-angle scan (DECT-CL) technology to reduce the radiation dose and compress the spatial distribution of the imaging system. The dual-energy total scan is 180°, where the low- and high-energy scan range is the first 90° and last 90°, respectively. We describe this dual limited-angle problem as a complementary limited-angle problem, which is challenging to obtain high-quality images using traditional reconstruction algorithms. Furthermore, a complementary-sinogram-inpainting generative adversarial networks (CSI-GAN) with a sinogram loss is proposed to inpainting sinogram to suppress the singularity of truncated sinogram. The sinogram loss focuses on the data distribution of the generated sinogram while approaching the target sinogram. We use the simultaneous algebraic reconstruction technique namely, a total variable (SART-TV) algorithms for image reconstruction. Then, taking reconstructed CT images of pleural and cranial cavity slices as examples, we evaluate the performance of our method and numerically compare different methods based on root mean square error (RMSE), peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). Compared with traditional algorithms, the proposed network shows advantages in numerical terms. Compared with Patch-GAN, the proposed network can also reduce the RMSE of the reconstruction results by an average of 40% and increase the PSNR by an average of 26%. In conclusion, both qualitative and quantitative comparison and analysis demonstrate that our proposed method achieves a good artifact suppression effect and can suitably solve the complementary limited-angle problem.
Collapse
Affiliation(s)
- Yizhong Wang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| | - Wenkun Zhang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| | - Ailong Cai
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| | - Linyuan Wang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| | - Chao Tang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| | - Zhiwei Feng
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| | - Lei Li
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| | - Ningning Liang
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| | - Bin Yan
- Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University, Zhengzhou, Henan, China
| |
Collapse
|
38
|
Physically Plausible Spectral Reconstruction. SENSORS 2020; 20:s20216399. [PMID: 33182473 PMCID: PMC7665140 DOI: 10.3390/s20216399] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 10/30/2020] [Accepted: 11/04/2020] [Indexed: 11/30/2022]
Abstract
Spectral reconstruction algorithms recover spectra from RGB sensor responses. Recent methods—with the very best algorithms using deep learning—can already solve this problem with good spectral accuracy. However, the recovered spectra are physically incorrect in that they do not induce the RGBs from which they are recovered. Moreover, if the exposure of the RGB image changes then the recovery performance often degrades significantly—i.e., most contemporary methods only work for a fixed exposure. In this paper, we develop a physically accurate recovery method: the spectra we recover provably induce the same RGBs. Key to our approach is the idea that the set of spectra that integrate to the same RGB can be expressed as the sum of a unique fundamental metamer (spanned by the camera’s spectral sensitivities and linearly related to the RGB) and a linear combination of a vector space of metameric blacks (orthogonal to the spectral sensitivities). Physically plausible spectral recovery resorts to finding a spectrum that adheres to the fundamental metamer plus metameric black decomposition. To further ensure spectral recovery that is robust to changes in exposure, we incorporate exposure changes in the training stage of the developed method. In experiments we evaluate how well the methods recover spectra and predict the actual RGBs and RGBs under different viewing conditions (changing illuminations and/or cameras). The results show that our method generally improves the state-of-the-art spectral recovery (with more stabilized performance when exposure varies) and provides zero colorimetric error. Moreover, our method significantly improves the color fidelity under different viewing conditions, with up to a 60% reduction in some cases.
Collapse
|
39
|
Zhang W, Liang N, Wang Z, Cai A, Wang L, Tang C, Zheng Z, Li L, Yan B, Hu G. Multi-energy CT reconstruction using tensor nonlocal similarity and spatial sparsity regularization. Quant Imaging Med Surg 2020; 10:1940-1960. [PMID: 33014727 DOI: 10.21037/qims-20-594] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Background Multi-energy computed tomography (MECT) based on a photon-counting detector is an emerging imaging modality that collects projections at several energy bins with a single scan. However, the limited number of photons collected into the divided, narrow energy bins results in high quantum noise levels in reconstructed images. This study aims to improve MECT image quality by minimizing noise levels while retaining image details. Methods A novel MECT reconstruction method was proposed by exploiting the nonlocal tensor similarity among interchannel images and spatial sparsity in single-channel images. Similar patches were initially extracted from the interchannel images in spectral and spatial domains, then stacked into a new three-order tensor. Intrinsic tensor sparsity regularization that combined the Tuker and canonical polyadic (CP) low-rank decomposition techniques were applied to exploit the nonlocal similarity of the formulated tensor. Spatial sparsity in single-channel images was modeled by total variation (TV) regularization that utilizes the compressibility of gradient image. A new MECT reconstruction model was established by simultaneously incorporating the intrinsic tensor sparsity and TV regularizations. The iterative alternating minimization method was utilized to solve the reconstruction model based on a flexible framework. Results The proposed method was applied to the digital phantom and real mouse data to assess its feasibility and reliability. The reconstruction and decomposition results in the mouse data were encouraging and demonstrated the ability of the proposed method in noise suppression while preserving image details, not observed with other methods. Imaging data from the digital phantom illustrated this method as achieving the best intuitive reconstruction and decomposition results among all compared methods. They reduced the root mean square error (RMSE) by 89.75%, 50.75%, and 36.54% on the reconstructed images compared with analytic, TV-based, and tensor-based methods, respectively. This phenomenon was also observed with decomposition results, where the RMSE was also reduced by 97.96%, 67.74%, 72.05%, respectively. Conclusions In this study, we proposed a reconstruction method for photon counting detector-based MECT, using the intrinsic tensor sparsity and TV regularizations. Improvements in noise suppression and detail preservation in the digital phantom and real mouse data were validated by the qualitative and quantitative evaluations on the reconstruction and decomposition results, verifying the potential of the proposed method in MECT reconstruction.
Collapse
Affiliation(s)
- Wenkun Zhang
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Ningning Liang
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Zhe Wang
- Beijing Engineering Research Center of Radiographic Techniques and Equipment, Institute of High Energy Physics, Chinese Academy of Sciences, Beijing, China
| | - Ailong Cai
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Linyuan Wang
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Chao Tang
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Zhizhong Zheng
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Lei Li
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Bin Yan
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| | - Guoen Hu
- Key Laboratory of Imaging and Intelligent Processing of Henan Province, PLA Strategic Support Force Information Engineering University, Zhengzhou, China
| |
Collapse
|
40
|
Zeng D, Yao L, Ge Y, Li S, Xie Q, Zhang H, Bian Z, Zhao Q, Li Y, Xu Z, Meng D, Ma J. Full-Spectrum-Knowledge-Aware Tensor Model for Energy-Resolved CT Iterative Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2831-2843. [PMID: 32112677 DOI: 10.1109/tmi.2020.2976692] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Energy-resolved computed tomography (ErCT) with a photon counting detector concurrently produces multiple CT images corresponding to different photon energy ranges. It has the potential to generate energy-dependent images with improved contrast-to-noise ratio and sufficient material-specific information. Since the number of detected photons in one energy bin in ErCT is smaller than that in conventional energy-integrating CT (EiCT), ErCT images are inherently more noisy than EiCT images, which leads to increased noise and bias in the subsequent material estimation. In this work, we first deeply analyze the intrinsic tensor properties of two-dimensional (2D) ErCT images acquired in different energy bins and then present a F ull- S pectrum-knowledge-aware Tensor analysis and processing (FSTensor) method for ErCT reconstruction to suppress noise-induced artifacts to obtain high-quality ErCT images and high-accuracy material images. The presented method is based on three considerations: (1) 2D ErCT images obtained in different energy bins can be treated as a 3-order tensor with three modes, i.e., width, height and energy bin, and a rich global correlation exists among the three modes, which can be characterized by tensor decomposition. (2) There is a locally piecewise smooth property in the 3-order ErCT images, and it can be captured by a tensor total variation regularization. (3) The images from the full spectrum are much better than the ErCT images with respect to noise variance and structural details and serve as external information to improve the reconstruction performance. We then develop an alternating direction method of multipliers algorithm to numerically solve the presented FSTensor method. We further utilize a genetic algorithm to tackle the parameter selection in ErCT reconstruction, instead of manually determining parameters. Simulation, preclinical and synthesized clinical ErCT results demonstrate that the presented FSTensor method leads to significant improvements over the filtered back-projection, robust principal component analysis, tensor-based dictionary learning and low-rank tensor decomposition with spatial-temporal total variation methods.
Collapse
|
41
|
|
42
|
Li Z, Zhou S, Huang J, Yu L, Jin M. Investigation of Low-Dose CT Image Denoising Using Unpaired Deep Learning Methods. IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES 2020; 5:224-234. [PMID: 33748562 DOI: 10.1109/trpms.2020.3007583] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Low-dose computed tomography (LDCT) is desired due to prevalence and ionizing radiation of CT, but suffers elevated noise. To improve LDCT image quality, an image-domain denoising method based on cycle-consistent generative adversarial network ("CycleGAN") is developed and compared with two other variants, IdentityGAN and GAN-CIRCLE. Different from supervised deep learning methods, these unpaired methods can effectively learn image translation from the low-dose domain to the full-dose (FD) domain without the need of aligning FDCT and LDCT images. The results on real and synthetic patient CT data show that these methods can achieve peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM) comparable to, if not better than, the other state-of-the-art denoising methods. Among CycleGAN, IdentityGAN, and GAN-CIRCLE, the later achieves the best denoising performance with the shortest computation time. Subsequently, GAN-CIRCLE is used to demonstrate that the increasing number of training patches and of training patients can improve denoising performance. Finally, two non-overlapping experiments, i.e. no counterparts of FDCT and LDCT images in the training data, further demonstrate the effectiveness of unpaired learning methods. This work paves the way for applying unpaired deep learning methods to enhance LDCT images without requiring aligned full-dose and low-dose images from the same patient.
Collapse
Affiliation(s)
- Zeheng Li
- Computer Science and Engineering Department, University of Texas at Arlington, Arlington, TX 76019 USA
| | - Shiwei Zhou
- Physics Department, University of Texas at Arlington, Arlington, TX 76019 USA
| | - Junzhou Huang
- Computer Science and Engineering Department, University of Texas at Arlington, Arlington, TX 76019 USA
| | - Lifeng Yu
- Department of Radiology at Mayo Clinic, Rochester, MN 55905 USA
| | - Mingwu Jin
- Physics Department, University of Texas at Arlington, Arlington, TX 76019 USA
| |
Collapse
|
43
|
Li M, Hsu W, Xie X, Cong J, Gao W. SACNN: Self-Attention Convolutional Neural Network for Low-Dose CT Denoising With Self-Supervised Perceptual Loss Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2289-2301. [PMID: 31985412 DOI: 10.1109/tmi.2020.2968472] [Citation(s) in RCA: 111] [Impact Index Per Article: 22.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Computed tomography (CT) is a widely used screening and diagnostic tool that allows clinicians to obtain a high-resolution, volumetric image of internal structures in a non-invasive manner. Increasingly, efforts have been made to improve the image quality of low-dose CT (LDCT) to reduce the cumulative radiation exposure of patients undergoing routine screening exams. The resurgence of deep learning has yielded a new approach for noise reduction by training a deep multi-layer convolutional neural networks (CNN) to map the low-dose to normal-dose CT images. However, CNN-based methods heavily rely on convolutional kernels, which use fixed-size filters to process one local neighborhood within the receptive field at a time. As a result, they are not efficient at retrieving structural information across large regions. In this paper, we propose a novel 3D self-attention convolutional neural network for the LDCT denoising problem. Our 3D self-attention module leverages the 3D volume of CT images to capture a wide range of spatial information both within CT slices and between CT slices. With the help of the 3D self-attention module, CNNs are able to leverage pixels with stronger relationships regardless of their distance and achieve better denoising results. In addition, we propose a self-supervised learning scheme to train a domain-specific autoencoder as the perceptual loss function. We combine these two methods and demonstrate their effectiveness on both CNN-based neural networks and WGAN-based neural networks with comprehensive experiments. Tested on the AAPM-Mayo Clinic Low Dose CT Grand Challenge data set, our experiments demonstrate that self-attention (SA) module and autoencoder (AE) perceptual loss function can efficiently enhance traditional CNNs and can achieve comparable or better results than the state-of-the-art methods.
Collapse
|
44
|
Xie B, Niu P, Su T, Kaftandjian V, Boussel L, Douek P, Yang F, Duvauchelle P, Zhu Y. ROI-Wise Material Decomposition in Spectral Photon-Counting CT. IEEE TRANSACTIONS ON NUCLEAR SCIENCE 2020; 67:1066-1075. [DOI: 10.1109/tns.2020.2985071] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/30/2023]
|
45
|
Qu Z, Yan X, Pan J, Chen P. Sparse View CT Image Reconstruction Based on Total Variation and Wavelet Frame Regularization. IEEE ACCESS 2020; 8:57400-57413. [DOI: 10.1109/access.2020.2982229] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/29/2023]
|
46
|
Bao P, Xia W, Yang K, Chen W, Chen M, Xi Y, Niu S, Zhou J, Zhang H, Sun H, Wang Z, Zhang Y. Convolutional Sparse Coding for Compressed Sensing CT Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2607-2619. [PMID: 30908204 DOI: 10.1109/tmi.2019.2906853] [Citation(s) in RCA: 49] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Over the past few years, dictionary learning (DL)-based methods have been successfully used in various image reconstruction problems. However, the traditional DL-based computed tomography (CT) reconstruction methods are patch-based and ignore the consistency of pixels in overlapped patches. In addition, the features learned by these methods always contain shifted versions of the same features. In recent years, convolutional sparse coding (CSC) has been developed to address these problems. In this paper, inspired by several successful applications of CSC in the field of signal processing, we explore the potential of CSC in sparse-view CT reconstruction. By directly working on the whole image, without the necessity of dividing the image into overlapped patches in DL-based methods, the proposed methods can maintain more details and avoid artifacts caused by patch aggregation. With predetermined filters, an alternating scheme is developed to optimize the objective function. Extensive experiments with simulated and real CT data were performed to validate the effectiveness of the proposed methods. The qualitative and quantitative results demonstrate that the proposed methods achieve better performance than the several existing state-of-the-art methods.
Collapse
|
47
|
Liu J, Zhang Y, Zhao Q, Lv T, Wu W, Cai N, Quan G, Yang W, Chen Y, Luo L, Shu H, Coatrieux JL. Deep iterative reconstruction estimation (DIRE): approximate iterative reconstruction estimation for low dose CT imaging. ACTA ACUST UNITED AC 2019; 64:135007. [DOI: 10.1088/1361-6560/ab18db] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
48
|
Spectral Photon-Counting Computed Tomography (SPCCT): in-vivo single-acquisition multi-phase liver imaging with a dual contrast agent protocol. Sci Rep 2019; 9:8458. [PMID: 31186467 PMCID: PMC6559958 DOI: 10.1038/s41598-019-44821-z] [Citation(s) in RCA: 44] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2019] [Accepted: 05/14/2019] [Indexed: 01/09/2023] Open
Abstract
Diagnostic imaging of hepatocellular carcinoma (HCC) requires a liver CT or MRI multiphase acquisition protocol. Patients would benefit from a high-resolution imaging method capable of performing multi-phase imaging in a single acquisition without an increase in radiation dose. Spectral Photon-Counting Computed Tomography (SPCCT) has recently emerged as a novel and promising imaging modality in the field of diagnostic radiology. SPCCT is able to distinguish between two contrast agents referred to as multicolor imaging because, when measuring in three or more energy regimes, it can detect and quantify elements with a K-edge in the diagnostic energy range. Based on this capability, we tested the feasibility of a dual-contrast multi-phase liver imaging protocol via the use of iodinated and gadolinated contrast agents on four healthy New Zealand White (NZW) rabbits. To perform a dual-contrast protocol, we injected the agents at different times so that the first contrast agent visualized the portal phase and the second the arterial phase, both of which are mandatory for liver lesion characterization. We demonstrated a sensitive discrimination and quantification of gadolinium within the arteries and iodine within the liver parenchyma. In the hepatic artery, the concentration of gadolinium was much higher than iodine (8.5 ± 3.9 mg/mL versus 0.7 ± 0.1 mg/mL) contrary to the concentrations found in the liver parenchyma (0.5 ± 0.3 mg/mL versus 4.2 ± 0.3 mg/mL). In conclusion, our results confirm that SPCCT allows in-vivo dual contrast qualitative and quantitative multi-phase liver imaging in a single acquisition.
Collapse
|
49
|
Abstract
In the real applications of computed tomography (CT) imaging, the projection data of the scanned objects are usually acquired within a limited-angle range because of the limitation of the scanning condition. Under these circumstances, conventional analytical algorithms, such as filtered back-projection (FBP), do not work because the projection data are incomplete. The regularization method has proven to be effective for tomographic reconstruction from under-sampled measurements. To deal with the limited-angle CT reconstruction problem, the regularization method is commonly used, but it is difficult to find a generic regularization term and choose the regularization parameters. Moreover, in some cases, the quality of reconstructed images is less than satisfactory. To solve this problem, we developed an alternating direction method of multipliers (ADMM)-based deep reconstruction (ADMMBDR) algorithm for limited-angle CT. First, we used the ADMM algorithm to decompose a regularization reconstruction model. Then, we utilized a deep convolutional neural network (CNN) to replace a part of the ADMM algorithm to reduce artifacts and avoid the choice of the regularization term and the regularization parameter. Furthermore, we conducted some numerical experiments to evaluate the feasibility and the advantages of the proposed algorithm. The results showed that the proposed algorithm had a better performance than several state-of-the-art algorithms; with respect to structure preservation and artifact reduction.
Collapse
Affiliation(s)
- Jiaxi Wang
- Key Laboratory of Optoelectronic Technology and System of the Education Ministry of China, Chongqing University, Chongqing 400044, People's Republic of China. Engineering Research Center of Industrial Computed Tomography Nondestructive Testing of the Education Ministry of China, Chongqing University, Chongqing 400044, People's Republic of China
| | | | | | | |
Collapse
|
50
|
Leng S, Bruesewitz M, Tao S, Rajendran K, Halaweish AF, Campeau NG, Fletcher JG, McCollough CH. Photon-counting Detector CT: System Design and Clinical Applications of an Emerging Technology. Radiographics 2019; 39:729-743. [PMID: 31059394 PMCID: PMC6542627 DOI: 10.1148/rg.2019180115] [Citation(s) in RCA: 311] [Impact Index Per Article: 51.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2018] [Revised: 06/15/2018] [Accepted: 06/26/2018] [Indexed: 01/01/2023]
Abstract
Photon-counting detector (PCD) CT is an emerging technology that has shown tremendous progress in the last decade. Various types of PCD CT systems have been developed to investigate the benefits of this technology, which include reduced electronic noise, increased contrast-to-noise ratio with iodinated contrast material and radiation dose efficiency, reduced beam-hardening and metal artifacts, extremely high spatial resolution (33 line pairs per centimeter), simultaneous multienergy data acquisition, and the ability to image with and differentiate among multiple CT contrast agents. PCD technology is described and compared with conventional CT detector technology. With the use of a whole-body research PCD CT system as an example, PCD technology and its use for in vivo high-spatial-resolution multienergy CT imaging is discussed. The potential clinical applications, diagnostic benefits, and challenges associated with this technology are then discussed, and examples with phantom, animal, and patient studies are provided. ©RSNA, 2019.
Collapse
Affiliation(s)
- Shuai Leng
- From the Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (S.L., M.B., S.T., K.R., N.G.C., J.G.F., C.H.M.); and Siemens Healthcare, Malvern, Pa (A.F.H.)
| | - Michael Bruesewitz
- From the Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (S.L., M.B., S.T., K.R., N.G.C., J.G.F., C.H.M.); and Siemens Healthcare, Malvern, Pa (A.F.H.)
| | - Shengzhen Tao
- From the Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (S.L., M.B., S.T., K.R., N.G.C., J.G.F., C.H.M.); and Siemens Healthcare, Malvern, Pa (A.F.H.)
| | - Kishore Rajendran
- From the Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (S.L., M.B., S.T., K.R., N.G.C., J.G.F., C.H.M.); and Siemens Healthcare, Malvern, Pa (A.F.H.)
| | - Ahmed F. Halaweish
- From the Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (S.L., M.B., S.T., K.R., N.G.C., J.G.F., C.H.M.); and Siemens Healthcare, Malvern, Pa (A.F.H.)
| | - Norbert G. Campeau
- From the Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (S.L., M.B., S.T., K.R., N.G.C., J.G.F., C.H.M.); and Siemens Healthcare, Malvern, Pa (A.F.H.)
| | - Joel G. Fletcher
- From the Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (S.L., M.B., S.T., K.R., N.G.C., J.G.F., C.H.M.); and Siemens Healthcare, Malvern, Pa (A.F.H.)
| | - Cynthia H. McCollough
- From the Department of Radiology, Mayo Clinic, 200 First St SW, Rochester, MN 55905 (S.L., M.B., S.T., K.R., N.G.C., J.G.F., C.H.M.); and Siemens Healthcare, Malvern, Pa (A.F.H.)
| |
Collapse
|