1
|
Gao Y, Tan J, Shi Y, Zhang H, Lu S, Gupta A, Li H, Reiter M, Liang Z. Machine Learned Texture Prior From Full-Dose CT Database via Multi-Modality Feature Selection for Bayesian Reconstruction of Low-Dose CT. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:3129-3139. [PMID: 34968178 PMCID: PMC9243192 DOI: 10.1109/tmi.2021.3139533] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
In our earlier study, we proposed a regional Markov random field type tissue-specific texture prior from previous full-dose computed tomography (FdCT) scan for current low-dose CT (LdCT) imaging, which showed clinical benefits through task-based evaluation. Nevertheless, two assumptions were made for early study. One assumption is that the center pixel has a linear relationship with its nearby neighbors and the other is previous FdCT scans of the same subject are available. To eliminate the two assumptions, we proposed a database assisted end-to-end LdCT reconstruction framework which includes a deep learning texture prior model and a multi-modality feature based candidate selection model. A convolutional neural network-based texture prior is proposed to eliminate the linear relationship assumption. And for scenarios in which the concerned subject has no previous FdCT scans, we propose to select one proper prior candidate from the FdCT database using multi-modality features. Features from three modalities are used including the subjects' physiological factors, the CT scan protocol, and a novel feature named Lung Mark which is deliberately proposed to reflect the z-axial property of human anatomy. Moreover, a majority vote strategy is designed to overcome the noise effect from LdCT scans. Experimental results showed the effectiveness of Lung Mark. The selection model has accuracy of 84% testing on 1,470 images from 49 subjects. The learned texture prior from FdCT database provided reconstruction comparable to the subjects having corresponding FdCT. This study demonstrated the feasibility of bringing clinically relevant textures from available FdCT database to perform Bayesian reconstruction of any current LdCT scan.
Collapse
|
2
|
Chang S, Gao Y, Pomeroy MJ, Bai T, Zhang H, Lu S, Pickhardt PJ, Gupta A, Reiter MJ, Gould ES, Liang Z. Exploring Dual-Energy CT Spectral Information for Machine Learning-Driven Lesion Diagnosis in Pre-Log Domain. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:1835-1845. [PMID: 37022248 PMCID: PMC10238622 DOI: 10.1109/tmi.2023.3240847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
In this study, we proposed a computer-aided diagnosis (CADx) framework under dual-energy spectral CT (DECT), which operates directly on the transmission data in the pre-log domain, called CADxDE, to explore the spectral information for lesion diagnosis. The CADxDE includes material identification and machine learning (ML) based CADx. Benefits from DECT's capability of performing virtual monoenergetic imaging with the identified materials, the responses of different tissue types (e.g., muscle, water, and fat) in lesions at each energy can be explored by ML for CADx. Without losing essential factors in the DECT scan, a pre-log domain model-based iterative reconstruction is adopted to obtain decomposed material images, which are then used to generate the virtual monoenergetic images (VMIs) at selected n energies. While these VMIs have the same anatomy, their contrast distribution patterns contain rich information along with the n energies for tissue characterization. Thus, a corresponding ML-based CADx is developed to exploit the energy-enhanced tissue features for differentiating malignant from benign lesions. Specifically, an original image-driven multi-channel three-dimensional convolutional neural network (CNN) and extracted lesion feature-based ML CADx methods are developed to show the feasibility of CADxDE. Results from three pathologically proven clinical datasets showed 4.01% to 14.25% higher AUC (area under the receiver operating characteristic curve) scores than the scores of both the conventional DECT data (high and low energy spectrum separately) and the conventional CT data. The mean gain >9.13% in AUC scores indicated that the energy spectral-enhanced tissue features from CADxDE have great potential to improve lesion diagnosis performance.
Collapse
Affiliation(s)
- Shaojie Chang
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Yongfeng Gao
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Marc J. Pomeroy
- Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY 11794, USA
| | - Ti Bai
- Department of Radiation Oncology, University of Texas Southwestern Medical Centre, Dallas, TX 75390, USA
| | - Hao Zhang
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, NY 10065, USA
| | - Siming Lu
- Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY 11794, USA
| | - Perry J. Pickhardt
- Department of Radiology, School of Medicine, University of Wisconsin, Madison, WI 53792, USA
| | - Amit Gupta
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Michael J. Reiter
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Elaine S. Gould
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Zhengrong Liang
- Departments of Radiology and Biomedical Engineering, Stony Brook University, Stony Brook, NY 11794, USA
| |
Collapse
|
3
|
Azour L, Hu Y, Ko JP, Chen B, Knoll F, Alpert JB, Brusca-Augello G, Mason DM, Wickstrom ML, Kwon YJF, Babb J, Liang Z, Moore WH. Deep Learning Denoising of Low-Dose Computed Tomography Chest Images: A Quantitative and Qualitative Image Analysis. J Comput Assist Tomogr 2023; 47:212-219. [PMID: 36790870 DOI: 10.1097/rct.0000000000001405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2023]
Abstract
PURPOSE To assess deep learning denoised (DLD) computed tomography (CT) chest images at various low doses by both quantitative and qualitative perceptual image analysis. METHODS Simulated noise was inserted into sinogram data from 32 chest CTs acquired at 100 mAs, generating anatomically registered images at 40, 20, 10, and 5 mAs. A DLD model was developed, with 23 scans selected for training, 5 for validation, and 4 for test.Quantitative analysis of perceptual image quality was assessed with Structural SIMilarity Index (SSIM) and Fréchet Inception Distance (FID). Four thoracic radiologists graded overall diagnostic image quality, image artifact, visibility of small structures, and lesion conspicuity. Noise-simulated and denoised image series were evaluated in comparison with one another, and in comparison with standard 100 mAs acquisition at the 4 mAs levels. Statistical tests were conducted at the 2-sided 5% significance level, with multiple comparison correction. RESULTS At the same mAs levels, SSIM and FID between noise-simulated and reconstructed DLD images indicated that images were closer to a perfect match with increasing mAs (closer to 1 for SSIM, and 0 for FID).In comparing noise-simulated and DLD images to standard-dose 100-mAs images, DLD improved SSIM and FID. Deep learning denoising improved SSIM of 40-, 20-, 10-, and 5-mAs simulations in comparison with standard-dose 100-mAs images, with change in SSIM from 0.91 to 0.94, 0.87 to 0.93, 0.67 to 0.87, and 0.54 to 0.84, respectively. Deep learning denoising improved FID of 40-, 20-, 10-, and 5-mAs simulations in comparison with standard-dose 100-mAs images, with change in FID from 20 to 13, 46 to 21, 104 to 41, and 148 to 69, respectively.Qualitative image analysis showed no significant difference in lesion conspicuity between DLD images at any mAs in comparison with 100-mAs images. Deep learning denoising images at 10 and 5 mAs were rated lower for overall diagnostic image quality ( P < 0.001), and at 5 mAs lower for overall image artifact and visibility of small structures ( P = 0.002), in comparison with 100 mAs. CONCLUSIONS Deep learning denoising resulted in quantitative improvements in image quality. Qualitative assessment demonstrated DLD images at or less than 10 mAs to be rated inferior to standard-dose images.
Collapse
Affiliation(s)
- Lea Azour
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | - Yunan Hu
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | - Jane P Ko
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | - Baiyu Chen
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | - Florian Knoll
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | - Jeffrey B Alpert
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | | | - Derek M Mason
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | - Maj L Wickstrom
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | | | - James Babb
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| | - Zhengrong Liang
- Departments of Radiology, Biomedical Engineering, Computer Science, and Electrical Engineering, Stony Brook University, Stony Brook, NY
| | - William H Moore
- From the Department of Radiology, NYU Grossman School of Medicine, NYU Langone Health
| |
Collapse
|
4
|
Gao Y, Lu S, Shi Y, Chang S, Zhang H, Hou W, Li L, Liang Z. A Joint-Parameter Estimation and Bayesian Reconstruction Approach to Low-Dose CT. SENSORS (BASEL, SWITZERLAND) 2023; 23:1374. [PMID: 36772417 PMCID: PMC9921255 DOI: 10.3390/s23031374] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 01/18/2023] [Accepted: 01/23/2023] [Indexed: 06/18/2023]
Abstract
Most penalized maximum likelihood methods for tomographic image reconstruction based on Bayes' law include a freely adjustable hyperparameter to balance the data fidelity term and the prior/penalty term for a specific noise-resolution tradeoff. The hyperparameter is determined empirically via a trial-and-error fashion in many applications, which then selects the optimal result from multiple iterative reconstructions. These penalized methods are not only time-consuming by their iterative nature, but also require manual adjustment. This study aims to investigate a theory-based strategy for Bayesian image reconstruction without a freely adjustable hyperparameter, to substantially save time and computational resources. The Bayesian image reconstruction problem is formulated by two probability density functions (PDFs), one for the data fidelity term and the other for the prior term. When formulating these PDFs, we introduce two parameters. While these two parameters ensure the PDFs completely describe the data and prior terms, they cannot be determined by the acquired data; thus, they are called complete but unobservable parameters. Estimating these two parameters becomes possible under the conditional expectation and maximization for the image reconstruction, given the acquired data and the PDFs. This leads to an iterative algorithm, which jointly estimates the two parameters and computes the to-be reconstructed image by maximizing a posteriori probability, denoted as joint-parameter-Bayes. In addition to the theoretical formulation, comprehensive simulation experiments are performed to analyze the stopping criterion of the iterative joint-parameter-Bayes method. Finally, given the data, an optimal reconstruction is obtained without any freely adjustable hyperparameter by satisfying the PDF condition for both the data likelihood and the prior probability, and by satisfying the stopping criterion. Moreover, the stability of joint-parameter-Bayes is investigated through factors such as initialization, the PDF specification, and renormalization in an iterative manner. Both phantom simulation and clinical patient data results show that joint-parameter-Bayes can provide comparable reconstructed image quality compared to the conventional methods, but with much less reconstruction time. To see the response of the algorithm to different types of noise, three common noise models are introduced to the simulation data, including white Gaussian noise to post-log sinogram data, Poisson-like signal-dependent noise to post-log sinogram data and Poisson noise to the pre-log transmission data. The experimental outcomes of the white Gaussian noise reveal that the two parameters estimated by the joint-parameter-Bayes method agree well with simulations. It is observed that the parameter introduced to satisfy the prior's PDF is more sensitive to stopping the iteration process for all three noise models. A stability investigation showed that the initial image by filtered back projection is very robust. Clinical patient data demonstrated the effectiveness of the proposed joint-parameter-Bayes and stopping criterion.
Collapse
Affiliation(s)
- Yongfeng Gao
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Siming Lu
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Yongyi Shi
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Shaojie Chang
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| | - Hao Zhang
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA
| | - Wei Hou
- Department of Preventive Medicine, Stony Brook University, Stony Brook, NY 11794, USA
| | - Lihong Li
- Department of Engineering Science and Physics, CUNY/CSI, Staten Island, NY 10314, USA
| | - Zhengrong Liang
- Department of Radiology, Stony Brook University, Stony Brook, NY 11794, USA
| |
Collapse
|
5
|
Zeng D, Zeng C, Zeng Z, Li S, Deng Z, Chen S, Bian Z, Ma J. Basis and current state of computed tomography perfusion imaging: a review. Phys Med Biol 2022; 67. [PMID: 35926503 DOI: 10.1088/1361-6560/ac8717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 08/04/2022] [Indexed: 12/30/2022]
Abstract
Computed tomography perfusion (CTP) is a functional imaging that allows for providing capillary-level hemodynamics information of the desired tissue in clinics. In this paper, we aim to offer insight into CTP imaging which covers the basics and current state of CTP imaging, then summarize the technical applications in the CTP imaging as well as the future technological potential. At first, we focus on the fundamentals of CTP imaging including systematically summarized CTP image acquisition and hemodynamic parameter map estimation techniques. A short assessment is presented to outline the clinical applications with CTP imaging, and then a review of radiation dose effect of the CTP imaging on the different applications is presented. We present a categorized methodology review on known and potential solvable challenges of radiation dose reduction in CTP imaging. To evaluate the quality of CTP images, we list various standardized performance metrics. Moreover, we present a review on the determination of infarct and penumbra. Finally, we reveal the popularity and future trend of CTP imaging.
Collapse
Affiliation(s)
- Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Cuidie Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhixiong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Sui Li
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhen Deng
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Sijin Chen
- Department of Medical Imaging Center, Nanfang Hospital, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| |
Collapse
|