1
|
Pan J, Zhang H, Wu W, Gao Z, Wu W. Multi-domain integrative Swin transformer network for sparse-view tomographic reconstruction. PATTERNS (NEW YORK, N.Y.) 2022; 3:100498. [PMID: 35755869 PMCID: PMC9214338 DOI: 10.1016/j.patter.2022.100498] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Revised: 01/17/2022] [Accepted: 03/30/2022] [Indexed: 11/09/2022]
Abstract
Decreasing projection views to a lower X-ray radiation dose usually leads to severe streak artifacts. To improve image quality from sparse-view data, a multi-domain integrative Swin transformer network (MIST-net) was developed and is reported in this article. First, MIST-net incorporated lavish domain features from data, residual data, image, and residual image using flexible network architectures, where a residual data and residual image sub-network was considered as a data consistency module to eliminate interpolation and reconstruction errors. Second, a trainable edge enhancement filter was incorporated to detect and protect image edges. Third, a high-quality reconstruction Swin transformer (i.e., Recformer) was designed to capture image global features. The experimental results on numerical and real cardiac clinical datasets with 48 views demonstrated that our proposed MIST-net provided better image quality with more small features and sharp edges than other competitors.
Collapse
Affiliation(s)
- Jiayi Pan
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, Guangdong, China
| | - Heye Zhang
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, Guangdong, China
| | - Weifei Wu
- Department of Orthopedics, The People’s Hospital of China Three Gorges University, The First People’s Hospital of Yichang, Yichang, Hubei, China
| | - Zhifan Gao
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, Guangdong, China
| | - Weiwen Wu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, Guangdong, China
| |
Collapse
|
2
|
Gadekallu TR, Alazab M, Kaluri R, Maddikunta PKR, Bhattacharya S, Lakshmanna K, M P. Hand gesture classification using a novel CNN-crow search algorithm. COMPLEX INTELL SYST 2021. [DOI: 10.1007/s40747-021-00324-x] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
AbstractHuman–computer interaction (HCI) and related technologies focus on the implementation of interactive computational systems. The studies in HCI emphasize on system use, creation of new techniques that support user activities, access to information, and ensures seamless communication. The use of artificial intelligence and deep learning-based models has been extensive across various domains yielding state-of-the-art results. In the present study, a crow search-based convolution neural networks model has been implemented in gesture recognition pertaining to the HCI domain. The hand gesture dataset used in the study is a publicly available one, downloaded from Kaggle. In this work, a one-hot encoding technique is used to convert the categorical data values to binary form. This is followed by the implementation of a crow search algorithm (CSA) for selecting optimal hyper-parameters for training of dataset using the convolution neural networks. The irrelevant parameters are eliminated from consideration, which contributes towards enhancement of accuracy in classifying the hand gestures. The model generates 100 percent training and testing accuracy that justifies the superiority of the model against traditional state-of-the-art models.
Collapse
|
3
|
Yang T, Tang L, Tang Q, Li L. Sparse angle CT reconstruction with weighted dictionary learning algorithm based on adaptive group-sparsity regularization. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2021; 29:435-452. [PMID: 33843720 DOI: 10.3233/xst-210839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
OBJECTIVE In order to solve the blurred structural details and over-smoothing effects in sparse representation dictionary learning reconstruction algorithm, this study aims to test sparse angle CT reconstruction with weighted dictionary learning algorithm based on adaptive Group-Sparsity Regularization (AGSR-SART). METHODS First, a new similarity measure is defined in which Covariance is introduced into Euclidean distance, Non-local image patches are adaptively divided into groups of different sizes as the basic unit of sparse representation. Second, the weight factor of the regular constraint terms is designed through the residuals represented by the dictionary, so that the algorithm takes different smoothing effects on different regions of the image during the iterative process. The sparse reconstructed image is modified according to the difference between the estimated value and the intermediate image. Last, The SBI (Split Bregman Iteration) iterative algorithm is used to solve the objective function. An abdominal image, a pelvic image and a thoracic image are employed to evaluate performance of the proposed method. RESULTS In terms of quantitative evaluations, experimental results show that new algorithm yields PSNR of 48.20, the maximum SSIM of 99.06% and the minimum MAE of 0.0028. CONCLUSIONS This study demonstrates that new algorithm can better preserve structural details in reconstructed CT images. It eliminates the effect of excessive smoothing in sparse angle reconstruction, enhances the sparseness and non-local self-similarity of the image, and thus it is superior to several existing reconstruction algorithms.
Collapse
Affiliation(s)
- Tiejun Yang
- School of Artificial Intelligence and Big Data, Henan University of Technology, Zhengzhou, Henan, China
| | - Lu Tang
- School of Information Engineering, Zhengzhou Institute of Finance and Economics, Zhengzhou, Henan, China
| | - Qi Tang
- School of Information Engineering, Zhengzhou Institute of Finance and Economics, Zhengzhou, Henan, China
| | - Lei Li
- School of Artificial Intelligence and Big Data, Henan University of Technology, Zhengzhou, Henan, China
| |
Collapse
|
4
|
SLRL4D: Joint Restoration of Subspace Low-Rank Learning and Non-Local 4-D Transform Filtering for Hyperspectral Image. REMOTE SENSING 2020. [DOI: 10.3390/rs12182979] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
During the process of signal sampling and digital imaging, hyperspectral images (HSI) inevitably suffer from the contamination of mixed noises. The fidelity and efficiency of subsequent applications are considerably reduced along with this degradation. Recently, as a formidable implement for image processing, low-rank regularization has been widely extended to the restoration of HSI. Meanwhile, further exploration of the non-local self-similarity of low-rank images are proven useful in exploiting the spatial redundancy of HSI. Better preservation of spatial-spectral features is achieved under both low-rank and non-local regularizations. However, existing methods generally regularize the original space of HSI, the exploration of the intrinsic properties in subspace, which leads to better denoising performance, is relatively rare. To address these challenges, a joint method of subspace low-rank learning and non-local 4-d transform filtering, named SLRL4D, is put forward for HSI restoration. Technically, the original HSI is projected into a low-dimensional subspace. Then, both spectral and spatial correlations are explored simultaneously by imposing low-rank learning and non-local 4-d transform filtering on the subspace. The alternating direction method of multipliers-based algorithm is designed to solve the formulated convex signal-noise isolation problem. Finally, experiments on multiple datasets are conducted to illustrate the accuracy and efficiency of SLRL4D.
Collapse
|
5
|
Singhal V, Majumdar A. Reconstructing multi-echo magnetic resonance images via structured deep dictionary learning. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2019.11.107] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
6
|
Yang M, Xu S. A novel patch-based nonlinear matrix completion algorithm for image analysis through convolutional neural network. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.01.037] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
7
|
|
8
|
Zha Z, Zhang X, Wu Y, Wang Q, Liu X, Tang L, Yuan X. Non-convex weighted ℓ nuclear norm based ADMM framework for image restoration. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.05.073] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
9
|
Bai H, Zhang W, Zhao J, Wang Y, Sun J. New reconstruction method for few-view grating-based phase-contrast imaging via dictionary learning. OPTICS EXPRESS 2018; 26:26566-26575. [PMID: 30469741 DOI: 10.1364/oe.26.026566] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2018] [Accepted: 09/15/2018] [Indexed: 06/09/2023]
Abstract
Grating-based phase-contrast is a hot topic in recent years owing to its excellent imaging contrast capability on soft tissues. Although it is compatible with conventional X-ray tubes and applicable in many fields, long scanning time, and high radiation dose obstruct its wider use in clinical and medical fields, especially for computed tomography applications. In this study, we solve this challenge by reducing the projection views and compensating the loss of reconstruction quality through dual-dictionary learning algorithm. The algorithm is implemented in two steps. First, estimated high-quality absorption images are obtained from the first dual-quality dictionary learning, which uses the correspondence between high-quality images and low-quality ones reconstructed from highly under-sampled data. Then, the second absorption-phase dual-modality dictionary learning is adopted to yield both estimated phase and absorption images, resulting in complementary information for both modality images. Afterwards the absorption and phase images are gradually improved in iterative reconstructions. By using SSIM RMSE measurements and visual assessment for enlarged regions of interest, our proposed method can improve the resolution of these two modality images and recover smaller structures, as compared to conventional methods.
Collapse
|
10
|
Zha Z, Zhang X, Wang Q, Tang L, Liu X. Group-based sparse representation for image compressive sensing reconstruction with non-convex regularization. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.03.027] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
11
|
Fang L, Zhuo H, Li S. Super-resolution of hyperspectral image via superpixel-based sparse representation. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2017.08.019] [Citation(s) in RCA: 89] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
12
|
|
13
|
Zhang J, Hu Y, Yang J, Chen Y, Coatrieux JL, Luo L. Sparse-view X-ray CT reconstruction with Gamma regularization. Neurocomputing 2017. [DOI: 10.1016/j.neucom.2016.12.019] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
14
|
Optshrink LR + S: accelerated fMRI reconstruction using non-convex optimal singular value shrinkage. Brain Inform 2017; 4:65-83. [PMID: 28074352 PMCID: PMC5319953 DOI: 10.1007/s40708-016-0059-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2016] [Accepted: 12/23/2016] [Indexed: 11/22/2022] Open
Abstract
This paper presents a new accelerated fMRI reconstruction method, namely, OptShrink LR + S method that reconstructs undersampled fMRI data using a linear combination of low-rank and sparse components. The low-rank component has been estimated using non-convex optimal singular value shrinkage algorithm, while the sparse component has been estimated using convex l1 minimization. The performance of the proposed method is compared with the existing state-of-the-art algorithms on real fMRI dataset. The proposed OptShrink LR + S method yields good qualitative and quantitative results.
Collapse
|
15
|
Accelerated fMRI reconstruction using Matrix Completion with Sparse Recovery via Split Bregman. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2016.08.016] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
16
|
|
17
|
Zhou Y, Kwong S, Guo H, Gao W, Wang X. Bilevel optimization of block compressive sensing with perceptually nonlocal similarity. Inf Sci (N Y) 2016. [DOI: 10.1016/j.ins.2016.03.027] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
18
|
|