1
|
Yao L, Wang J, Wu Z, Du Q, Yang X, Li M, Zheng J. Parallel processing model for low-dose computed tomography image denoising. Vis Comput Ind Biomed Art 2024; 7:14. [PMID: 38865022 PMCID: PMC11169366 DOI: 10.1186/s42492-024-00165-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 05/20/2024] [Indexed: 06/13/2024] Open
Abstract
Low-dose computed tomography (LDCT) has gained increasing attention owing to its crucial role in reducing radiation exposure in patients. However, LDCT-reconstructed images often suffer from significant noise and artifacts, negatively impacting the radiologists' ability to accurately diagnose. To address this issue, many studies have focused on denoising LDCT images using deep learning (DL) methods. However, these DL-based denoising methods have been hindered by the highly variable feature distribution of LDCT data from different imaging sources, which adversely affects the performance of current denoising models. In this study, we propose a parallel processing model, the multi-encoder deep feature transformation network (MDFTN), which is designed to enhance the performance of LDCT imaging for multisource data. Unlike traditional network structures, which rely on continual learning to process multitask data, the approach can simultaneously handle LDCT images within a unified framework from various imaging sources. The proposed MDFTN consists of multiple encoders and decoders along with a deep feature transformation module (DFTM). During forward propagation in network training, each encoder extracts diverse features from its respective data source in parallel and the DFTM compresses these features into a shared feature space. Subsequently, each decoder performs an inverse operation for multisource loss estimation. Through collaborative training, the proposed MDFTN leverages the complementary advantages of multisource data distribution to enhance its adaptability and generalization. Numerous experiments were conducted on two public datasets and one local dataset, which demonstrated that the proposed network model can simultaneously process multisource data while effectively suppressing noise and preserving fine structures. The source code is available at https://github.com/123456789ey/MDFTN .
Collapse
Affiliation(s)
- Libing Yao
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230026, China
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Jiping Wang
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230026, China
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Zhongyi Wu
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China.
| | - Qiang Du
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Xiaodong Yang
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Ming Li
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230026, China.
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China.
| | - Jian Zheng
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230026, China
- Medical Imaging Department, Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| |
Collapse
|
2
|
Lee JH, Kim YG, Ahn Y, Park S, Kong HJ, Choi JY, Kim K, Nam IC, Lee MC, Masuoka H, Miyauchi A, Kim S, Kim YA, Choe EK, Chai YJ. Investigation of optimal convolutional neural network conditions for thyroid ultrasound image analysis. Sci Rep 2023; 13:1360. [PMID: 36693894 PMCID: PMC9873643 DOI: 10.1038/s41598-023-28001-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Accepted: 01/11/2023] [Indexed: 01/26/2023] Open
Abstract
Neural network models have been used to analyze thyroid ultrasound (US) images and stratify malignancy risk of the thyroid nodules. We investigated the optimal neural network condition for thyroid US image analysis. We compared scratch and transfer learning models, performed stress tests in 10% increments, and compared the performance of three threshold values. All validation results indicated superiority of the transfer learning model over the scratch model. Stress test indicated that training the algorithm using 3902 images (70%) resulted in a performance which was similar to the full dataset (5575). Threshold 0.3 yielded high sensitivity (1% false negative) and low specificity (72% false positive), while 0.7 gave low sensitivity (22% false negative) and high specificity (23% false positive). Here we showed that transfer learning was more effective than scratch learning in terms of area under curve, sensitivity, specificity and negative/positive predictive value, that about 3900 images were minimally required to demonstrate an acceptable performance, and that algorithm performance can be customized according to the population characteristics by adjusting threshold value.
Collapse
Affiliation(s)
- Joon-Hyop Lee
- Department of Surgery, Gachon University College of Medicine, Gil Medical Center, Inchon, Korea
| | - Young-Gon Kim
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea
| | - Youngbin Ahn
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea
| | - Seyeon Park
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea
| | - Hyoun-Joong Kong
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea
| | - June Young Choi
- Department of Surgery, Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea
| | - Kwangsoon Kim
- Department of Surgery, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Inn-Chul Nam
- Department of Otolaryngology-Head and Neck Surgery, College of Medicine, The Catholic University of Korea, Seoul, Korea
| | - Myung-Chul Lee
- Department of Otorhinolaryngology-Head and Neck Surgery, Korea Cancer Center Hospital, Korea Institute of Radiological and Medical Science, Seoul, Korea
| | | | | | - Sungwan Kim
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea
| | - Young A Kim
- Department of Pathology, Seoul Metropolitan Government Seoul National University Boramae Medical Center, Seoul, Korea
| | - Eun Kyung Choe
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea. .,Department of Surgery, Seoul National University Hospital Healthcare System Gangnam Center, Seoul, Korea.
| | - Young Jun Chai
- Transdisciplinary Department of Medicine and Advanced Technology, Seoul National University Hospital, Seoul, Korea. .,Department of Surgery, Seoul Metropolitan Government, Seoul National University Boramae Medical Center, 20 Boramaep-ro 5-gil, Dongjak-gu, Seoul, 07061, Korea.
| |
Collapse
|
3
|
X-ray CT image denoising with MINF: A modularized iterative network framework for data from multiple dose levels. Comput Biol Med 2023; 152:106419. [PMID: 36527781 DOI: 10.1016/j.compbiomed.2022.106419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 11/30/2022] [Accepted: 12/10/2022] [Indexed: 12/14/2022]
Abstract
In clinical applications, multi-dose scan protocols will cause the noise levels of computed tomography (CT) images to fluctuate widely. The popular low-dose CT (LDCT) denoising network outputs denoised images through an end-to-end mapping between an LDCT image and its corresponding ground truth. The limitation of this method is that the reduced noise level of the image may not meet the diagnostic needs of doctors. To establish a denoising model adapted to the multi-noise levels robustness, we proposed a novel and efficient modularized iterative network framework (MINF) to learn the feature of the original LDCT and the outputs of the previous modules, which can be reused in each following module. The proposed network can achieve the goal of gradual denoising, outputting clinical images with different denoising levels, and providing the reviewing physicians with increased confidence in their diagnosis. Moreover, a multi-scale convolutional neural network (MCNN) module is designed to extract as much feature information as possible during the network's training. Extensive experiments on public and private clinical datasets were carried out, and comparisons with several state-of-the-art methods show that the proposed method can achieve satisfactory results for noise suppression of LDCT images. In further comparisons with modularized adaptive processing neural network (MAP-NN), the proposed network shows superior step-by-step or gradual denoising performance. Considering the high quality of gradual denoising results, the proposed method can obtain satisfactory performance in terms of image contrast and detail protection as the level of denoising increases, which shows its potential to be suitable for a multi-dose levels denoising task.
Collapse
|
4
|
Papoutsellis E, Ametova E, Delplancke C, Fardell G, Jørgensen JS, Pasca E, Turner M, Warr R, Lionheart WRB, Withers PJ. Core Imaging Library - Part II: multichannel reconstruction for dynamic and spectral tomography. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2021; 379:20200193. [PMID: 34218671 PMCID: PMC8255950 DOI: 10.1098/rsta.2020.0193] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/15/2021] [Indexed: 05/10/2023]
Abstract
The newly developed core imaging library (CIL) is a flexible plug and play library for tomographic imaging with a specific focus on iterative reconstruction. CIL provides building blocks for tailored regularized reconstruction algorithms and explicitly supports multichannel tomographic data. In the first part of this two-part publication, we introduced the fundamentals of CIL. This paper focuses on applications of CIL for multichannel data, e.g. dynamic and spectral. We formalize different optimization problems for colour processing, dynamic and hyperspectral tomography and demonstrate CIL's capabilities for designing state-of-the-art reconstruction methods through case studies and code snapshots. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 2'.
Collapse
Affiliation(s)
- Evangelos Papoutsellis
- Henry Royce Institute, Department of Materials, The University of Manchester, Manchester, UK
- Scientific Computing Department, Science Technology Facilities Council, UK Research and Innovation, Rutherford Appleton Laboratory, Didcot, UK
| | - Evelina Ametova
- Henry Royce Institute, Department of Materials, The University of Manchester, Manchester, UK
- Laboratory for Applications of Synchrotron Radiation, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | | | - Gemma Fardell
- Scientific Computing Department, Science Technology Facilities Council, UK Research and Innovation, Rutherford Appleton Laboratory, Didcot, UK
| | - Jakob S Jørgensen
- Department of Mathematics, The University of Manchester, Manchester, UK
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Edoardo Pasca
- Scientific Computing Department, Science Technology Facilities Council, UK Research and Innovation, Rutherford Appleton Laboratory, Didcot, UK
| | - Martin Turner
- Research IT Services, The University of Manchester, Manchester, UK
| | - Ryan Warr
- Henry Royce Institute, Department of Materials, The University of Manchester, Manchester, UK
| | | | - Philip J Withers
- Henry Royce Institute, Department of Materials, The University of Manchester, Manchester, UK
| |
Collapse
|
5
|
Generative Noise Reduction in Dental Cone-Beam CT by a Selective Anatomy Analytic Iteration Reconstruction Algorithm. ELECTRONICS 2019. [DOI: 10.3390/electronics8121381] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
Dental cone-beam computed tomography (CBCT) is a powerful tool in clinical treatment planning, especially in a digital dentistry platform. Currently, the “as low as diagnostically acceptable” (ALADA) principle and diagnostic ability are a trade-off in most of the 3D integrated applications, especially in the low radio-opaque densified tissue structure. The CBCT benefits in comprehensive diagnosis and its treatment prognosis for post-operation predictability are clinically known in modern dentistry. In this paper, we propose a new algorithm called the selective anatomy analytic iteration reconstruction (SA2IR) algorithm for the sparse-projection set. The algorithm was simulated on a phantom structure analogous to a patient’s head for geometric similarity. The proposed algorithm is projection-based. Interpolated set enrichment and trio-subset enhancement were used to reduce the generative noise and maintain the scan’s clinical diagnostic ability. The results show that proposed method was highly applicable in medico-dental imaging diagnostics fusion for the computer-aided treatment planning, because it had significant generative noise reduction and lowered computational cost when compared to the other common contemporary algorithms for sparse projection, which generate a low-dosed CBCT reconstruction.
Collapse
|
6
|
Chen Y, Liu J, Xie L, Hu Y, Shu H, Luo L, Zhang L, Gui Z, Coatrieux G. Discriminative Prior - Prior Image Constrained Compressed Sensing Reconstruction for Low-Dose CT Imaging. Sci Rep 2017; 7:13868. [PMID: 29066731 PMCID: PMC5655040 DOI: 10.1038/s41598-017-13520-y] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2017] [Accepted: 09/25/2017] [Indexed: 12/15/2022] Open
Abstract
X-ray computed tomography (CT) has been widely used to provide patient-specific anatomical information in the forms of tissue attenuation. However, the cumulative radiation induced in CT scan has raised extensive concerns in recently years. How to maintain reconstruction image quality is a major challenge for low-dose CT (LDCT) imaging. Generally, LDCT imaging can be greatly improved by incorporating prior knowledge in some specific forms. A joint estimation framework termed discriminative prior-prior image constrained compressed sensing (DP-PICCS) reconstruction is proposed in this paper. This DP-PICCS algorithm utilizes discriminative prior knowledge via two feature dictionary constraints which built on atoms from the samples of tissue attenuation feature patches and noise-artifacts residual feature patches, respectively. Also, the prior image construction relies on a discriminative feature representation (DFR) processing by two feature dictionary. Its comparison to other competing methods through experiments on low-dose projections acquired from torso phantom simulation study and clinical abdomen study demonstrated that the DP-PICCS method achieved promising improvement in terms of the effectively-suppressed noise and the well-retained structures.
Collapse
Affiliation(s)
- Yang Chen
- Laboratory of Image Science and Technology, School of Computer Science and Engineering, Southeast University, Nanjing, 210096, China.,Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, 210096, China.,International Joint Research Laboratory of Information Display and Visualization, Southeast University, Ministry of Education, Nanjing, 210096, China
| | - Jin Liu
- Laboratory of Image Science and Technology, School of Computer Science and Engineering, Southeast University, Nanjing, 210096, China.,Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, 210096, China.,International Joint Research Laboratory of Information Display and Visualization, Southeast University, Ministry of Education, Nanjing, 210096, China
| | - Lizhe Xie
- Jiangsu Key Laboratory of Oral Diseases, Nanjing Medical University, No. 140, Hanzhong road, Nanjing, 210000, China
| | - Yining Hu
- Laboratory of Image Science and Technology, School of Computer Science and Engineering, Southeast University, Nanjing, 210096, China.,Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, 210096, China.,International Joint Research Laboratory of Information Display and Visualization, Southeast University, Ministry of Education, Nanjing, 210096, China
| | - Huazhong Shu
- Laboratory of Image Science and Technology, School of Computer Science and Engineering, Southeast University, Nanjing, 210096, China. .,Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, 210096, China. .,International Joint Research Laboratory of Information Display and Visualization, Southeast University, Ministry of Education, Nanjing, 210096, China.
| | - Limin Luo
- Laboratory of Image Science and Technology, School of Computer Science and Engineering, Southeast University, Nanjing, 210096, China.,Key Laboratory of Computer Network and Information Integration (Southeast University), Ministry of Education, Nanjing, 210096, China.,International Joint Research Laboratory of Information Display and Visualization, Southeast University, Ministry of Education, Nanjing, 210096, China
| | - Libo Zhang
- The General Hospital of Shenyang Military, Shenyang, Liaoning, 110016, China.
| | - Zhiguo Gui
- The National Key Laboratory for Electronic Measurement Technology, North University of China, Taiyuan, 030051, China
| | - Gouenou Coatrieux
- The Institut Mines-Telecom, Telecom Bretagne; INSERM U1101 LaTIM, Brest, 29238, France
| |
Collapse
|
7
|
Smoothed l0 Norm Regularization for Sparse-View X-Ray CT Reconstruction. BIOMED RESEARCH INTERNATIONAL 2016; 2016:2180457. [PMID: 27725935 PMCID: PMC5048096 DOI: 10.1155/2016/2180457] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/15/2016] [Revised: 08/19/2016] [Accepted: 08/24/2016] [Indexed: 11/17/2022]
Abstract
Low-dose computed tomography (CT) reconstruction is a challenging problem in medical imaging. To complement the standard filtered back-projection (FBP) reconstruction, sparse regularization reconstruction gains more and more research attention, as it promises to reduce radiation dose, suppress artifacts, and improve noise properties. In this work, we present an iterative reconstruction approach using improved smoothed l0 (SL0) norm regularization which is used to approximate l0 norm by a family of continuous functions to fully exploit the sparseness of the image gradient. Due to the excellent sparse representation of the reconstruction signal, the desired tissue details are preserved in the resulting images. To evaluate the performance of the proposed SL0 regularization method, we reconstruct the simulated dataset acquired from the Shepp-Logan phantom and clinical head slice image. Additional experimental verification is also performed with two real datasets from scanned animal experiment. Compared to the referenced FBP reconstruction and the total variation (TV) regularization reconstruction, the results clearly reveal that the presented method has characteristic strengths. In particular, it improves reconstruction quality via reducing noise while preserving anatomical features.
Collapse
|
8
|
Zhang C, Zhang T, Li M, Peng C, Liu Z, Zheng J. Low-dose CT reconstruction via L1 dictionary learning regularization using iteratively reweighted least-squares. Biomed Eng Online 2016; 15:66. [PMID: 27316680 PMCID: PMC4912768 DOI: 10.1186/s12938-016-0193-y] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2015] [Accepted: 05/17/2016] [Indexed: 01/09/2023] Open
Abstract
Background In order to reduce the radiation dose of CT (computed tomography), compressed sensing theory has been a hot topic since it provides the possibility of a high quality recovery from the sparse sampling data. Recently, the algorithm based on DL (dictionary learning) was developed to deal with the sparse CT reconstruction problem. However, the existing DL algorithm focuses on the minimization problem with the L2-norm regularization term, which leads to reconstruction quality deteriorating while the sampling rate declines further. Therefore, it is essential to improve the DL method to meet the demand of more dose reduction. Methods In this paper, we replaced the L2-norm regularization term with the L1-norm one. It is expected that the proposed L1-DL method could alleviate the over-smoothing effect of the L2-minimization and reserve more image details. The proposed algorithm solves the L1-minimization problem by a weighting strategy, solving the new weighted L2-minimization problem based on IRLS (iteratively reweighted least squares). Results Through the numerical simulation, the proposed algorithm is compared with the existing DL method (adaptive dictionary based statistical iterative reconstruction, ADSIR) and other two typical compressed sensing algorithms. It is revealed that the proposed algorithm is more accurate than the other algorithms especially when further reducing the sampling rate or increasing the noise. Conclusion The proposed L1-DL algorithm can utilize more prior information of image sparsity than ADSIR. By transforming the L2-norm regularization term of ADSIR with the L1-norm one and solving the L1-minimization problem by IRLS strategy, L1-DL could reconstruct the image more exactly.
Collapse
Affiliation(s)
- Cheng Zhang
- Suzhou Institute of Biomedical Engineering and Technology of Chinese Academy of Sciences, Suzhou, 215163, China.,Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, 130033, China.,University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Tao Zhang
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, 130033, China
| | - Ming Li
- Suzhou Institute of Biomedical Engineering and Technology of Chinese Academy of Sciences, Suzhou, 215163, China
| | - Chengtao Peng
- Department of Electronic Science and technology, University of Science and Technology of China, Hefei, 230061, China
| | - Zhaobang Liu
- Suzhou Institute of Biomedical Engineering and Technology of Chinese Academy of Sciences, Suzhou, 215163, China
| | - Jian Zheng
- Suzhou Institute of Biomedical Engineering and Technology of Chinese Academy of Sciences, Suzhou, 215163, China.
| |
Collapse
|