1
|
Valat E, Farrahi K, Blumensath T. Sinogram Inpainting with Generative Adversarial Networks and Shape Priors. Tomography 2023; 9:1137-1152. [PMID: 37368546 DOI: 10.3390/tomography9030094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Revised: 05/31/2023] [Accepted: 06/01/2023] [Indexed: 06/29/2023] Open
Abstract
X-ray computed tomography is a widely used, non-destructive imaging technique that computes cross-sectional images of an object from a set of X-ray absorption profiles (the so-called sinogram). The computation of the image from the sinogram is an ill-posed inverse problem, which becomes underdetermined when we are only able to collect insufficiently many X-ray measurements. We are here interested in solving X-ray tomography image reconstruction problems where we are unable to scan the object from all directions, but where we have prior information about the object's shape. We thus propose a method that reduces image artefacts due to limited tomographic measurements by inferring missing measurements using shape priors. Our method uses a Generative Adversarial Network that combines limited acquisition data and shape information. While most existing methods focus on evenly spaced missing scanning angles, we propose an approach that infers a substantial number of consecutive missing acquisitions. We show that our method consistently improves image quality compared to images reconstructed using the previous state-of-the-art sinogram-inpainting techniques. In particular, we demonstrate a 7 dB Peak Signal-to-Noise Ratio improvement compared to other methods.
Collapse
Affiliation(s)
- Emilien Valat
- Cambridge Image Analysis Group, Department of Applied Mathematics and Theoretical Physics, Centre for Mathematical Sciences, University of Cambridge, Wilberforce Rd., Cambridge CB3 0WA, UK
| | - Katayoun Farrahi
- Vision, Learning and Control Group, Department of Electronics and Computer Science, University of Southampton, University Rd., Southampton SO17 1BJ, UK
| | - Thomas Blumensath
- Institute of Sound and Vibration Research, Department of Engineering and the Environment, University of Southampton, University Rd., Southampton SO17 1BJ, UK
| |
Collapse
|
4
|
Jia X, Liao Y, Zeng D, Zhang H, Zhang Y, He J, Bian Z, Wang Y, Tao X, Liang Z, Huang J, Ma J. Statistical CT reconstruction using region-aware texture preserving regularization learning from prior normal-dose CT image. Phys Med Biol 2018; 63:225020. [PMID: 30457116 PMCID: PMC6309620 DOI: 10.1088/1361-6560/aaebc9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
In some clinical applications, prior normal-dose CT (NdCT) images are available, and the valuable textures and structure features in them may be used to promote follow-up low-dose CT (LdCT) reconstruction. This study aims to learn texture information from the NdCT images and leverage it for follow-up LdCT image reconstruction to preserve textures and structure features. Specifically, the proposed reconstruction method first learns the texture information from those patches with similar structures in NdCT image, and the similar patches can be clustered by searching context features efficiently from the surroundings of the current patch. Then it utilizes redundant texture information from the similar patches as a priori knowledge to describe specific regions in the LdCT image. The advanced region-aware texture preserving prior is termed as 'RATP'. The main advantage of the PATP prior is that it can properly learn the texture features from available NdCT images and adaptively characterize the region-specific structures in the LdCT image. The experiments using patient data were performed to evaluate the performance of the proposed method. The proposed RATP method demonstrated superior performance in LdCT imaging compared to the filtered back projection (FBP) and statistical iterative reconstruction (SIR) methods using Gaussian regularization, Huber regularization and the original texture preserving regularization.
Collapse
Affiliation(s)
- Xiao Jia
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- School of Software Engineering, Nanyang Normal University, Nanyang, Henan 473061, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Yuting Liao
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Hao Zhang
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| | - Yuanke Zhang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Ji He
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Yongbo Wang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Xi Tao
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Zhengrong Liang
- Department of Radiology and Biomedical Engineering, State University of New York at Stony Brook, NY 11794, United States of America
| | - Jing Huang
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
- Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangzhou, Guangdong 510515, People’s Republic of China
| |
Collapse
|
5
|
Oyama A, Kumagai S, Arai N, Takata T, Saikawa Y, Shiraishi K, Kobayashi T, Kotoku J. Image quality improvement in cone-beam CT using the super-resolution technique. JOURNAL OF RADIATION RESEARCH 2018; 59:501-510. [PMID: 29659997 PMCID: PMC6054223 DOI: 10.1093/jrr/rry019] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/20/2017] [Revised: 08/28/2017] [Indexed: 06/08/2023]
Abstract
This study was conducted to improve cone-beam computed tomography (CBCT) image quality using the super-resolution technique, a method of inferring a high-resolution image from a low-resolution image. This technique is used with two matrices, so-called dictionaries, constructed respectively from high-resolution and low-resolution image bases. For this study, a CBCT image, as a low-resolution image, is represented as a linear combination of atoms, the image bases in the low-resolution dictionary. The corresponding super-resolution image was inferred by multiplying the coefficients and the high-resolution dictionary atoms extracted from planning CT images. To evaluate the proposed method, we computed the root mean square error (RMSE) and structural similarity (SSIM). The resulting RMSE and SSIM between the super-resolution images and the planning CT images were, respectively, as much as 0.81 and 1.29 times better than those obtained without using the super-resolution technique. We used super-resolution technique to improve the CBCT image quality.
Collapse
Affiliation(s)
- Asuka Oyama
- Graduate School of Medical Care and Technology, Teikyo University, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
| | - Shinobu Kumagai
- Central Radiology Division, Teikyo University Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
| | - Norikazu Arai
- Central Radiology Division, Teikyo University Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
| | - Takeshi Takata
- Graduate School of Medical Care and Technology, Teikyo University, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
| | - Yusuke Saikawa
- Graduate School of Medical Care and Technology, Teikyo University, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
| | - Kenshiro Shiraishi
- Department of Radiology, Teikyo University School of Medicine, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
| | - Takenori Kobayashi
- Graduate School of Medical Care and Technology, Teikyo University, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
| | - Jun’ichi Kotoku
- Graduate School of Medical Care and Technology, Teikyo University, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
- Central Radiology Division, Teikyo University Hospital, 2-11-1 Kaga, Itabashi-ku, Tokyo, Japan
| |
Collapse
|
6
|
Karimi D, Ward RK. Patch-based models and algorithms for image processing: a review of the basic principles and methods, and their application in computed tomography. Int J Comput Assist Radiol Surg 2016; 11:1765-77. [PMID: 27287761 DOI: 10.1007/s11548-016-1434-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2016] [Accepted: 05/27/2016] [Indexed: 11/28/2022]
Abstract
PURPOSE Image models are central to all image processing tasks. The great advancements in digital image processing would not have been made possible without powerful models which, themselves, have evolved over time. In the past decade, "patch-based" models have emerged as one of the most effective models for natural images. Patch-based methods have outperformed other competing methods in many image processing tasks. These developments have come at a time when greater availability of powerful computational resources and growing concerns over the health risks of the ionizing radiation encourage research on image processing algorithms for computed tomography (CT). The goal of this paper is to explain the principles of patch-based methods and to review some of their recent applications in CT. METHODS We first review the central concepts in patch-based image processing and explain some of the state-of-the-art algorithms, with a focus on aspects that are more relevant to CT. Then, we review some of the recent application of patch-based methods in CT. RESULTS Patch-based methods have already transformed the field of image processing, leading to state-of-the-art results in many applications. More recently, several studies have proposed patch-based algorithms for various image processing tasks in CT, from denoising and restoration to iterative reconstruction. Although these studies have reported good results, the true potential of patch-based methods for CT has not been yet appreciated. CONCLUSIONS Patch-based methods can play a central role in image reconstruction and processing for CT. They have the potential to lead to substantial improvements in the current state of the art.
Collapse
Affiliation(s)
| | - Rabab K Ward
- , 2366 Main Mall, Vancouver, BC, V6T 1Z4, Canada
| |
Collapse
|