1
|
Shi Y, Gao Y, Xu Q, Li Y, Zhang C, Mou X, Liang Z. Learned Tensor Neural Network Texture Prior for Photon-Counting CT Reconstruction. IEEE Trans Med Imaging 2024; PP:1-1. [PMID: 38753483 DOI: 10.1109/tmi.2024.3402079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2024]
Abstract
Photon-counting computed tomography (PCCT) reconstructs multiple energy-channel images to describe the same object, where there exists a strong correlation among different channel images. In addition, reconstruction of each channel image suffers photon count starving problem. To make full use of the correlation among different channel images to suppress the data noise and enhance the texture details in reconstructing each channel image, this paper proposes a tensor neural network (TNN) architecture to learn a multi-channel texture prior for PCCT reconstruction. Specifically, we first learn a spatial texture prior in each individual channel image by modeling the relationship between the center pixels and its corresponding neighbor pixels using a neural network. Then, we merge the single channel spatial texture prior into multi-channel neural network to learn the spectral local correlation information among different channel images. Since our proposed TNN is trained on a series of unpaired small spatial-spectral cubes which are extracted from one single reference multi-channel image, the local correlation in the spatial-spectral cubes is considered by TNN. To boost the TNN performance, a low-rank representation is also employed to consider the global correlation among different channel images. Finally, we integrate the learned TNN and the low-rank representation as priors into Bayesian reconstruction framework. To evaluate the performance of the proposed method, four references are considered. One is simulated images from ultra-high-resolution CT. One is spectral images from dual-energy CT. The other two are animal tissue and preclinical mouse images from a custom-made PCCT systems. Our TNN prior Bayesian reconstruction demonstrated better performance than other state-of-the-art competing algorithms, in terms of not only preserving texture feature but also suppressing image noise in each channel image.
Collapse
|
2
|
Feng D, Chen X, Wang X, Mou X, Bai L, Zhang S, Zhou Z. Predicting effectiveness of anti-VEGF injection through self-supervised learning in OCT images. Math Biosci Eng 2023; 20:2439-2458. [PMID: 36899541 DOI: 10.3934/mbe.2023114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Anti-vascular endothelial growth factor (Anti-VEGF) therapy has become a standard way for choroidal neovascularization (CNV) and cystoid macular edema (CME) treatment. However, anti-VEGF injection is a long-term therapy with expensive cost and may be not effective for some patients. Therefore, predicting the effectiveness of anti-VEGF injection before the therapy is necessary. In this study, a new optical coherence tomography (OCT) images based self-supervised learning (OCT-SSL) model for predicting the effectiveness of anti-VEGF injection is developed. In OCT-SSL, we pre-train a deep encoder-decoder network through self-supervised learning to learn the general features using a public OCT image dataset. Then, model fine-tuning is performed on our own OCT dataset to learn the discriminative features to predict the effectiveness of anti-VEGF. Finally, classifier trained by the features from fine-tuned encoder as a feature extractor is built to predict the response. Experimental results on our private OCT dataset demonstrated that the proposed OCT-SSL can achieve an average accuracy, area under the curve (AUC), sensitivity and specificity of 0.93, 0.98, 0.94 and 0.91, respectively. Meanwhile, it is found that not only the lesion region but also the normal region in OCT image is related to the effectiveness of anti-VEGF.
Collapse
Affiliation(s)
- Dehua Feng
- School of Information and Communications Engineering, Xi'an Jiaotong University, Shaanxi 710049, China
| | - Xi Chen
- School of Information and Communications Engineering, Xi'an Jiaotong University, Shaanxi 710049, China
| | - Xiaoyu Wang
- School of Information and Communications Engineering, Xi'an Jiaotong University, Shaanxi 710049, China
| | - Xuanqin Mou
- School of Information and Communications Engineering, Xi'an Jiaotong University, Shaanxi 710049, China
| | - Ling Bai
- Department of Ophthalmology, the Second Affiliated Hospital of Xi'an Jiaotong University, Shaanxi 710004, China
| | - Shu Zhang
- Department of Geriatric Surgery, the Second Affiliated Hospital of Xi'an Jiaotong University, Shaanxi 710004, China
| | - Zhiguo Zhou
- Department of Biostatistics and Data Science, University of Kansas Medical Center, KS 66160, USA
| |
Collapse
|
3
|
Ma Y, Mou X, Beeraka NM, Guo Y, Liu J, Dai J, Fan R. Machine Log File and Calibration Errors-based Patient-specific Quality Assurance (QA) for Volumetric Modulated Arc Therapy (VMAT). Curr Pharm Des 2023; 29:2738-2751. [PMID: 37916622 DOI: 10.2174/0113816128226519231017050459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 05/19/2023] [Accepted: 06/05/2023] [Indexed: 11/03/2023]
Abstract
INTRODUCTION Dose reconstructed based on linear accelerator (linac) log-files is one of the widely used solutions to perform patient-specific quality assurance (QA). However, it has a drawback that the accuracy of log-file is highly dependent on the linac calibration. The objective of the current study is to represent a new practical approach for a patient-specific QA during Volumetric modulated arc therapy (VMAT) using both log-file and calibration errors of linac. METHODS A total of six cases, including two head and neck neoplasms, two lung cancers, and two rectal carcinomas, were selected. The VMAT-based delivery was optimized by the TPS of Pinnacle^3 subsequently, using Elekta Synergy VMAT linac (Elekta Oncology Systems, Crawley, UK), which was equipped with 80 Multi-leaf collimators (MLCs) and the energy of the ray selected at 6 MV. Clinical mode log-file of this linac was used in this study. A series of test fields validate the accuracy of log-file. Then, six plans of test cases were delivered and log-file of each was obtained. The log-file errors were added to the corresponding plans through the house script and the first reconstructed plan was obtained. Later, a series of tests were performed to evaluate the major calibration errors of the linac (dose-rate, gantry angle, MLC leaf position) and the errors were added to the first reconstruction plan to generate the second reconstruction plan. At last, all plans were imported to Pinnacle and recalculated dose distribution on patient CT and ArcCheck phantom (SUN Nuclear). For the former, both target and OAR dose differences between them were compared. For the latter, γ was evaluated by ArcCheck, and subsequently, the surface dose differences between them were performed. RESULTS Accuracy of log-file was validated. If error recordings in the log file were only considered, there were four arcs whose proportion of control points with gantry angle errors more than ± 1°larger than 35%. Errors of leaves within ± 0.5 mm were 95% for all arcs. The distinctness of a single control point MU was bigger, but the distinctness of cumulative MU was smaller. The maximum, minimum, and mean doses for all targets were distributed between -6.79E-02-0.42%, -0.38-0.4%, 2.69E-02-8.54E-02% respectively, whereas for all OAR, the maximum and mean dose were distributed between -1.16-2.51%, -1.21-3.12% respectively. For the second reconstructed dose: the maximum, minimum, and mean dose for all targets was distributed between 0.0995~5.7145%, 0.6892~4.4727%, 0.5829~1.8931% separately. Due to OAR, maximum and mean dose distribution was observed between -3.1462~6.8920%, -6.9899~1.9316%, respectively. CONCLUSION Patient-specific QA based on the log-file could reflect the accuracy of the linac execution plan, which usually has a small influence on dose delivery. When the linac calibration errors were considered, the reconstructed dose was closer to the actual delivery and the developed method was accurate and practical.
Collapse
Affiliation(s)
- Yangguang Ma
- Department of Radiation Oncology, First Affiliated Hospital of Zhengzhou University, Zhengzhou 450052, China
- School of Information and Communications Engineering, Xi'AN Jiaotong University, Xi'an 710049, China
| | - Xuanqin Mou
- School of Information and Communications Engineering, Xi'AN Jiaotong University, Xi'an 710049, China
| | - Narasimha M Beeraka
- Raghavendra Institute of Pharmaceutical Education and Research (RIPER), Anantapuramu, Chiyyedu, Andhra Pradesh 515721, India
- Department of Human Anatomy, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), 8/2 Trubetskaya Str., Moscow 119991, Russia
| | - Yuexin Guo
- Department of Radiation Oncology, First Affiliated Hospital of Zhengzhou University, Zhengzhou 450052, China
| | - Junqi Liu
- Department of Radiation Oncology, First Affiliated Hospital of Zhengzhou University, Zhengzhou 450052, China
| | - Jianrong Dai
- Department of Radiation Oncology, National Cancer Center/National Clinical Research Center for Cancer, Cancer Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing 100021, China
| | - Ruitai Fan
- Department of Radiation Oncology, First Affiliated Hospital of Zhengzhou University, Zhengzhou 450052, China
| |
Collapse
|
4
|
Wu J, Wang X, Mou X. Statistical Interior Tomography via L1 Norm Dictionary Learning without Assuming an Object Support. Tomography 2022; 8:2218-2231. [PMID: 36136882 PMCID: PMC9498861 DOI: 10.3390/tomography8050186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 08/20/2022] [Accepted: 08/22/2022] [Indexed: 11/16/2022] Open
Abstract
Interior tomography of X-ray computed tomography (CT) has many advantages, such as a lower radiation dose and lower detector hardware cost compared to traditional CT. However, this imaging technique only uses the projection data passing through the region of interest (ROI) for imaging; accordingly, the projection data are truncated at both ends of the detector, so the traditional analytical reconstruction algorithm cannot satisfy the demand of clinical diagnosis. To solve the above limitations, in this paper we propose a high-quality statistical iterative reconstruction algorithm that uses the zeroth-order image moment as novel prior knowledge; the zeroth-order image moment can be estimated in the projection domain using the Helgason–Ludwig consistency condition. Then, the L1norm of sparse representation, in terms of dictionary learning, and the zeroth-order image moment constraints are incorporated into the statistical iterative reconstruction framework to construct an objective function. Finally, the objective function is minimized using an alternating minimization iterative algorithm. The chest CT image simulated and CT real data experimental results demonstrate that the proposed approach can remove shift artifacts effectively and has superior performance in removing noise and persevering fine structures than the total variation (TV)-based approach.
Collapse
Affiliation(s)
- Junfeng Wu
- Department of Applied Mathematics, Xi’an University of Technology, Xi’an 710048, China
- Correspondence:
| | - Xiaofeng Wang
- Department of Applied Mathematics, Xi’an University of Technology, Xi’an 710048, China
| | - Xuanqin Mou
- The Institute of Image Processing and Pattern Recognition, Xi’an Jiaotong University, Xi’an 710049, China
| |
Collapse
|
5
|
Tang S, Huang T, Qiao Z, Li B, Xu Y, Mou X, Fan J. Non-convex optimization based optimal bone correction for various beam-hardening artifacts in CT imaging. J Xray Sci Technol 2022; 30:805-822. [PMID: 35599528 DOI: 10.3233/xst-221176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Tube of X-ray computed tomography (CT) system emitting a polychromatic spectrum of photons leads to beam hardening artifacts such as cupping and streaks, while the metal implants in the imaged object results in metal artifacts in the reconstructed images. The simultaneous emergence of various beam-hardening artifacts degrades the diagnostic accuracy of CT images in clinics. Thus, it should be deeply investigated for suppressing such artifacts. In this study, data consistency condition is exploited to construct an objective function. Non-convex optimization algorithm is employed to solve the optimal scaling factors. Finally, an optimal bone correction is acquired to simultaneously correct for cupping, streaks and metal artifacts. Experimental result acquired by a realistic computer simulation demonstrates that the proposed method can adaptively determine the optimal scaling factors, and then correct for various beam-hardening artifacts in the reconstructed CT images. Especially, as compared to the nonlinear least squares before variable substitution, the running time of the new CT image reconstruction algorithm decreases 82.36% and residual error reduces 55.95%. As compared to the nonlinear least squares after variable substitution, the running time of the new algorithm decreases 67.54% with the same residual error.
Collapse
Affiliation(s)
- Shaojie Tang
- School of Automation, Xi'an University of Posts and Telecommunications, Xi'an, Shaanxi, China
- Automatic Sorting Technology Research Center, Xi'an University of Posts and Telecommunications, State Post Bureau of the People's Republic of China, Xi'an, Shaanxi, China
- Xi'an Key Laboratory of Advanced Control and Intelligent Process, Xi'an, Shaanxi, China
| | - Tonggang Huang
- School of Automation, Xi'an University of Posts and Telecommunications, Xi'an, Shaanxi, China
| | - Zhiwei Qiao
- School of Computer and Information Technology, Shanxi University, Taiyuan, Shanxi, China
| | - Baolei Li
- Beijing Hangxing Machinery Co., Ltd., Dongcheng, Beijing, China
| | - Yuanfei Xu
- Beijing Hangxing Machinery Co., Ltd., Dongcheng, Beijing, China
| | - Xuanqin Mou
- School of Electronics and Information Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Jiulun Fan
- Automatic Sorting Technology Research Center, Xi'an University of Posts and Telecommunications, State Post Bureau of the People's Republic of China, Xi'an, Shaanxi, China
- School of Communications and Information Engineering, Xi'an University of Posts and Telecommunications, Xi'an, Shaanxi, China
| |
Collapse
|
6
|
Zhi S, KachelrieB M, Pan F, Mou X. CycN-Net: A Convolutional Neural Network Specialized for 4D CBCT Images Refinement. IEEE Trans Med Imaging 2021; 40:3054-3064. [PMID: 34010129 DOI: 10.1109/tmi.2021.3081824] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Four-dimensional cone-beam computed tomography (4D CBCT) has been developed to provide a sequence of phase-resolved reconstructions in image-guided radiation therapy. However, 4D CBCT images are degraded by severe streaking artifacts and noise because the phase-resolved image is an extremely sparse-view CT procedure wherein a few under-sampled projections are used for the reconstruction of each phase. Aiming at improving the overall quality of 4D CBCT images, we proposed two CNN models, named N-Net and CycN-Net, respectively, by fully excavating the inherent property of 4D CBCT. To be specific, the proposed N-Net incorporates the prior image reconstructed from entire projection data based on U-Net to boost the image quality for each phase-resolved image. Based on N-Net, a temporal correlation among the phase-resolved images is also considered by the proposed CycN-Net. Extensive experiments on both XCAT simulation data and real patient 4D CBCT datasets were carried out to verify the feasibility of the proposed CNNs. Both networks can effectively suppress streaking artifacts and noise while restoring the distinct features simultaneously, compared with the existing CNN models and two state-of-the-art iterative algorithms. Moreover, the proposed method is robust in handling complicated tasks of various patient datasets and imaging devices, which implies its excellent generalization ability.
Collapse
|
7
|
Zhi S, Kachelrieß M, Mou X. Spatiotemporal structure-aware dictionary learning-based 4D CBCT reconstruction. Med Phys 2021; 48:6421-6436. [PMID: 34514608 DOI: 10.1002/mp.15009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 05/12/2021] [Accepted: 05/19/2021] [Indexed: 11/11/2022] Open
Abstract
PURPOSE Four-dimensional cone-beam computed tomography (4D CBCT) is developed to reconstruct a sequence of phase-resolved images, which could assist in verifying the patient's position and offering information for cancer treatment planning. However, 4D CBCT images suffer from severe streaking artifacts and noise due to the extreme sparse-view CT reconstruction problem for each phase. As a result, it would cause inaccuracy of treatment estimation. The purpose of this paper was to develop a new 4D CBCT reconstruction method to generate a series of high spatiotemporal 4D CBCT images. METHODS Considering the advantage of (DL) on representing structural features and correlation between neighboring pixels effectively, we construct a novel DL-based method for the 4D CBCT reconstruction. In this study, both a motion-aware dictionary and a spatially structural 2D dictionary are trained for 4D CBCT by excavating the spatiotemporal correlation among ten phase-resolved images and the spatial information in each image, respectively. Specifically, two reconstruction models are produced in this study. The first one is the motion-aware dictionary learning-based 4D CBCT algorithm, called motion-aware DL based 4D CBCT (MaDL). The second one is the MaDL equipped with a prior knowledge constraint, called pMaDL. Qualitative and quantitative evaluations are performed using a 4D extended cardiac torso (XCAT) phantom, simulated patient data, and two sets of patient data sets. Several state-of-the-art 4D CBCT algorithms, such as the McKinnon-Bates (MKB) algorithm, prior image constrained compressed sensing (PICCS), and the high-quality initial image-guided 4D CBCT reconstruction method (HQI-4DCBCT) are applied for comparison to validate the performance of the proposed MaDL and prior constraint MaDL (pMaDL) pmadl reconstruction frameworks. RESULTS Experimental results validate that the proposed MaDL can output the reconstructions with few streaking artifacts but some structural information such as tumors and blood vessels, may still be missed. Meanwhile, the results of the proposed pMaDL demonstrate an improved spatiotemporal resolution of the reconstructed 4D CBCT images. In these improved 4D CBCT reconstructions, streaking artifacts are suppressed primarily and detailed structures are also restored. Regarding the XCAT phantom, quantitative evaluations indicate that an average of 58.70%, 45.25%, and 40.10% decrease in terms of root-mean-square error (RMSE) and an average of 2.10, 1.37, and 1.37 times in terms of structural similarity index (SSIM) are achieved by the proposed pMaDL method when compared with piccs, PICCS, MaDL(2D), and MaDL(2D), respectively. Moreover the proposed pMaDL achieves a comparable performance with HQI-4DCBCT algorithm in terms of RMSE and SSIM metrics. However, pMaDL has a better ability to suppress streaking artifacts than HQI-4DCBCT. CONCLUSIONS The proposed algorithm could reconstruct a set of 4D CBCT images with both high spatiotemporal resolution and detailed features preservation. Moreover the proposed pMaDL can effectively suppress the streaking artifacts in the resultant reconstructions, while achieving an overall improved spatiotemporal resolution by incorporating the motion-aware dictionary with a prior constraint into the proposed 4D CBCT iterative framework.
Collapse
Affiliation(s)
- Shaohua Zhi
- Institute of Image Processing and Pattern Recognition, School of Information and Communications Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| | - Marc Kachelrieß
- German Cancer Research Center, Heidelberg (DKFZ), Im Neuenheimer Feld 280, Heidelberg, 69120, Germany
| | - Xuanqin Mou
- Institute of Image Processing and Pattern Recognition, School of Information and Communications Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, 710049, China
| |
Collapse
|
8
|
Duan J, Mou X. Image quality guided iterative reconstruction for low-dose CT based on CT image statistics. Phys Med Biol 2021; 66. [PMID: 34352735 DOI: 10.1088/1361-6560/ac1b1b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Accepted: 08/05/2021] [Indexed: 11/12/2022]
Abstract
Iterative reconstruction framework shows predominance in low dose and incomplete data situation. In the iterative reconstruction framework, there are two components, i.e., fidelity term aims to maintain the structure details of the reconstructed object, and the regularization term uses prior information to suppress the artifacts such as noise. A regularization parameter balances them, aiming to find a good trade-off between noise and resolution. Currently, the regularization parameters are selected as a rule of thumb or some prior knowledge assumption is required, which limits practical uses. Furthermore, the computation cost of regularization parameter selection is also heavy. In this paper, we address this problem by introducing CT image quality assessment (IQA) into the iterative reconstruction framework. Several steps are involved during the study. First, we analyze the CT image statistics using the dual dictionary method. Regularities are observed and concluded, revealing the relationship among the regularization parameter, iterations, and CT image quality. Second, with derivation and simplification of DDL procedure, a CT IQA metric named SODVAC is designed. The SODVAC locates the optimal regularization parameter that results in the reconstructed image with distinct structures and with no noise or little noise. Third, we introduce SODVAC into the iterative reconstruction framework and then propose a general image-quality-guided iterative reconstruction (QIR) framework and give a specific framework example (sQIR) by introducing SODVAC into the iterative reconstruction framework. sQIR simultaneously optimizes the reconstructed image and the regularization parameter during the iterations. Results confirm the effectiveness of the proposed method. No prior information needed and low computation cost are the advantages of our method compared with existing state-of-theart L-curve and ZIP selection strategies.
Collapse
Affiliation(s)
- Jiayu Duan
- Institute of Image Processing and Pattern Recognition School of Electronics and Information Engineering, Xi'an Jiaotong University, Xi'an, Shannxi, CHINA
| | - Xuanqin Mou
- Institute of Image Processing and Pattern Recognition School of Electronics and Information Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, Xi'an, 710049, CHINA
| |
Collapse
|
9
|
|
10
|
Wiedeman C, Xie H, Mou X, Wang G. Innovating the Medical Imaging Course. technol innov 2020. [DOI: 10.21300/21.4.2020.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Artificial intelligence (AI) and machine learning (ML), especially deep learning, have generated tremendous impacts throughout our society, including the tomographic medical imaging field. In contrast to computer vision and image analysis, which have been major application examples
of deep learning and deal with existing images, tomographic medical imaging mainly produces cross-sectional or volumetric images of internal structures from sensor measurements. Recently, deep learning has started being actively developed worldwide for medical imaging, including both tomographic
reconstruction and image analysis. While medical imaging is a well-established field, in which extensive teaching experience has been accumulated over the past few decades, updating the medical imaging course to reflect AI/ML influence is a new challenge given the rapidly changing landscape
of AI-based medical imaging, particularly deep tomographic imaging. In the 2019 fall semester, the medical imaging course at Rensselaer Polytechnic Institute was modified to include an AI framework with positive feedback from students. Encouragingly, many students showed a strong motivation
to learn AI in classes and hands-on projects, as confirmed in their survey reports. In the 2020 fall semester, we improved this course further, incorporating new advances. This article describes our teaching philosophy, practice, and considerations with respect to integrating deep learning,
tomographic imaging, and hands-on programming to redefine the medical imaging course. Furthermore, given the persistent pandemic, online teaching and examination have become an integral part of higher education. These needs will be addressed as well, with the hope of developing an open course
in the future.
Collapse
|
11
|
Feng D, Chen X, Zhou Z, Liu H, Wang Y, Bai L, Zhang S, Mou X. A Preliminary Study of Predicting Effectiveness of Anti-VEGF Injection Using OCT Images Based on Deep Learning. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2020:5428-5431. [PMID: 33019208 DOI: 10.1109/embc44109.2020.9176743] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Deep learning based radiomics have made great progress such as CNN based diagnosis and U-Net based segmentation. However, the prediction of drug effectiveness based on deep learning has fewer studies. Choroidal neovascularization (CNV) and cystoid macular edema (CME) are the diseases often leading to a sudden onset but progressive decline in central vision. And the curative treatment using anti-vascular endothelial growth factor (anti-VEGF) may not be effective for some patients. Therefore, the prediction of the effectiveness of anti-VEGF for patients is important. With the development of Convolutional Neural Networks (CNNs) coupled with transfer learning, medical image classifications have achieved great success. We used a method based on transfer learning to automatically predict the effectiveness of anti-VEGF by Optical Coherence tomography (OCT) images before giving medication. The method consists of image preprocessing, data augmentation and CNN-based transfer learning, the prediction AUC can be over 0.8. We also made a comparison study of using lesion region images and full OCT images on this task. Experiments shows that using the full OCT images can obtain better performance. Different deep neural networks such as AlexNet, VGG-16, GooLeNet and ResNet-50 were compared, and the modified ResNet-50 is more suitable for predicting the effectiveness of anti-VEGF.Clinical Relevance - This prediction model can give an estimation of whether anti-VEGF is effective for patients with CNV or CME, which can help ophthalmologists make treatment plan.
Collapse
|
12
|
Shi Y, Gao Y, Zhang Y, Sun J, Mou X, Liang Z. Spectral CT Reconstruction via Low-Rank Representation and Region-Specific Texture Preserving Markov Random Field Regularization. IEEE Trans Med Imaging 2020; 39:2996-3007. [PMID: 32217474 PMCID: PMC7529661 DOI: 10.1109/tmi.2020.2983414] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Photon-counting spectral computed tomography (CT) is capable of material characterization and can improve diagnostic performance over traditional clinical CT. However, it suffers from photon count starving for each individual energy channel which may cause severe artifacts in the reconstructed images. Furthermore, since the images in different energy channels describe the same object, there are high correlations among different channels. To make full use of the inter-channel correlations and minimize the count starving effect while maintaining clinically meaningful texture information, this paper combines a region-specific texture model with a low-rank correlation descriptor as an a priori regularization to explore a superior texture preserving Bayesian reconstruction of spectral CT. Specifically, the inter-channel correlations are characterized by the low-rank representation, and the inner-channel regional textures are modeled by a texture preserving Markov random field. In other words, this paper integrates the spectral and spatial information into a unified Bayesian reconstruction framework. The widely-used Split-Bregman algorithm is employed to minimize the objective function because of the non-differentiable property of the low-rank representation. To evaluate the tissue texture preserving performance of the proposed method for each channel, three references are built for comparison: one is the traditional CT image from energy integration detection. The second one is spectral images from dual-energy CT. The third one is individual channels images from custom-made photon-counting spectral CT. As expected, the proposed method produced promising results in terms of not only preserving texture features but also suppressing image noise in each channel, comparing to existing methods of total variation (TV), low-rank TV and tensor dictionary learning, by both visual inspection and quantitative indexes of root mean square error, peak signal to noise ratio, structural similarity and feature similarity.
Collapse
|
13
|
Zhang J, Lalevée J, Mou X, Morlet-Savary F, Graff B, Xiao P. Retraction of “ N-Phenylglycine as a Versatile Photoinitiator under Near-UV LED”. Macromolecules 2020. [DOI: 10.1021/acs.macromol.0c00700] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
14
|
Wu J, Wang X, Mou X, Chen Y, Liu S. Low Dose CT Image Reconstruction Based on Structure Tensor Total Variation Using Accelerated Fast Iterative Shrinkage Thresholding Algorithm. Sensors (Basel) 2020; 20:s20061647. [PMID: 32188068 PMCID: PMC7146515 DOI: 10.3390/s20061647] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/30/2020] [Revised: 03/07/2020] [Accepted: 03/10/2020] [Indexed: 12/20/2022]
Abstract
Low dose computed tomography (CT) has drawn much attention in the medical imaging field because of its ability to reduce the radiation dose. Recently, statistical iterative reconstruction (SIR) with total variation (TV) penalty has been developed to low dose CT image reconstruction. Nevertheless, the TV penalty has the drawback of creating blocky effects in the reconstructed images. To overcome the limitations of TV, in this paper we firstly introduce the structure tensor total variation (STV1) penalty into SIR framework for low dose CT image reconstruction. Then, an accelerated fast iterative shrinkage thresholding algorithm (AFISTA) is developed to minimize the objective function. The proposed AFISTA reconstruction algorithm was evaluated using numerical simulated low dose projection based on two CT images and realistic low dose projection data of a sheep lung CT perfusion. The experimental results demonstrated that our proposed STV1-based algorithm outperform FBP and TV-based algorithm in terms of removing noise and restraining blocky effects.
Collapse
Affiliation(s)
- Junfeng Wu
- Department of Applied Mathematics, Xi’an University of Technology, Xi’an 710048, China;
- The Key Laboratory of Computer Network and Information Integration, Southeast University and Ministry of Education, Nanjing 210096, China;
- Correspondence:
| | - Xiaofeng Wang
- Department of Applied Mathematics, Xi’an University of Technology, Xi’an 710048, China;
| | - Xuanqin Mou
- The Institute of Image processing and Pattern recognition, Xi’an Jiaotong University, Xi’an 710049, China;
| | - Yang Chen
- The Key Laboratory of Computer Network and Information Integration, Southeast University and Ministry of Education, Nanjing 210096, China;
| | - Shuguang Liu
- Equipment Management and Unmanned Aerial Vehicle Engineering College, Air Force Engineering University, Xi’an 710051, China;
| |
Collapse
|
15
|
Zhi S, Kachelrieß M, Mou X. High-quality initial image-guided 4D CBCT reconstruction. Med Phys 2020; 47:2099-2115. [PMID: 32017128 DOI: 10.1002/mp.14060] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2019] [Revised: 11/27/2019] [Accepted: 01/20/2020] [Indexed: 01/24/2023] Open
Abstract
PURPOSE Four-dimensional cone-beam computed tomography (4D CBCT) has been developed to provide a sequence of phase-resolved reconstructions in image-guided radiation therapy. However, 4D CBCT images are degraded by severe streaking artifacts because the 4D CBCT reconstruction process is an extreme sparse-view CT procedure wherein only under-sampled projections are used for the reconstruction of each phase. To obtain a set of 4D CBCT images achieving both high spatial and temporal resolution, we propose an algorithm by providing a high-quality initial image at the beginning of the iterative reconstruction process for each phase to guide the final reconstructed result toward its optimal solution. METHODS The proposed method consists of three steps to generate the initial image. First, a prior image is obtained by an iterative reconstruction method using the measured projections of the entire set of 4D CBCT images. The prior image clearly shows the appearance of structures in static regions, although it contains blurring artifacts in motion regions. Second, the robust principal component analysis (RPCA) model is adopted to extract the motion components corresponding to each phase-resolved image. Third, a set of initial images are produced by the proposed linear estimation model that combines the prior image and the RPCA-decomposed motion components. The final 4D CBCT images are derived from the simultaneous algebraic reconstruction technique (SART) equipped with the initial images. Qualitative and quantitative evaluations were performed by using two extended cardiac-torso (XCAT) phantoms and two sets of patient data. Several state-of-the-art 4D CBCT algorithms were performed for comparison to validate the performance of the proposed method. RESULTS The image quality of phase-resolved images is greatly improved by the proposed method in both phantom and patient studies. The results show an outstanding spatial resolution, in which streaking artifacts are suppressed to a large extent, while detailed structures such as tumors and blood vessels are well restored. Meanwhile, the proposed method depicts a high temporal resolution with a distinct respiratory motion change at different phases. For simulation phantom, quantitative evaluations of the simulation data indicate that an average of 36.72% decrease at EI phase and 42% decrease at EE phase in terms of root-mean-square error (RMSE) are achieved by our method when comparing with PICCS algorithm in Phantom 1 and Phantom 2. In addition, the proposed method has the lowest entropy and the highest normalized mutual information compared with the existing methods in simulation experiments, such as PRI, RPCA-4DCT, SMART, and PICCS. And for real patient cases, the proposed method also achieves the lowest entropy value compared with the competitive method. CONCLUSIONS The proposed algorithm can generate an optimal initial image to improve iterative reconstruction performance. The final sequence of phase-resolved volumes guided by the initial image achieves high spatiotemporal resolution by eliminating motion-induced artifacts. This study presents a practical 4D CBCT reconstruction method with leading image quality.
Collapse
Affiliation(s)
- Shaohua Zhi
- Institute of Image Processing and Pattern Recognition, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| | - Marc Kachelrieß
- German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, 69120, Heidelberg, Germany
| | - Xuanqin Mou
- Institute of Image Processing and Pattern Recognition, Xi'an Jiaotong University, Xi'an, Shaanxi, China
| |
Collapse
|
16
|
Chang S, Li M, Yu H, Chen X, Deng S, Zhang P, Mou X. Spectrum Estimation-Guided Iterative Reconstruction Algorithm for Dual Energy CT. IEEE Trans Med Imaging 2020; 39:246-258. [PMID: 31251178 DOI: 10.1109/tmi.2019.2924920] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
X-ray spectrum plays a very important role in dual energy computed tomography (DECT) reconstruction. Because it is difficult to measure x-ray spectrum directly in practice, efforts have been devoted into spectrum estimation by using transmission measurements. These measurement methods are independent of the image reconstruction, which bring extra cost and are time consuming. Furthermore, the estimated spectrum mismatch would degrade the quality of the reconstructed images. In this paper, we propose a spectrum estimation-guided iterative reconstruction algorithm for DECT which aims to simultaneously recover the spectrum and reconstruct the image. The proposed algorithm is formulated as an optimization framework combining spectrum estimation based on model spectra representation, image reconstruction, and regularization for noise suppression. To resolve the multi-variable optimization problem of simultaneously obtaining the spectra and images, we introduce the block coordinate descent (BCD) method into the optimization iteration. Both the numerical simulations and physical phantom experiments are performed to verify and evaluate the proposed method. The experimental results validate the accuracy of the estimated spectra and reconstructed images under different noise levels. The proposed method obtains a better image quality compared with the reconstructed images from the known exact spectra and is robust in noisy data applications.
Collapse
|
17
|
Zhang Y, Mou X, Chandler DM. Learning No-Reference Quality Assessment of Multiply and Singly Distorted Images with Big Data. IEEE Trans Image Process 2019; 29:2676-2691. [PMID: 31794396 DOI: 10.1109/tip.2019.2952010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Previous research on no-reference (NR) quality assessment of multiply-distorted images focused mainly on three distortion types (white noise, Gaussian blur, and JPEG compression), while in practice images can be contaminated by many other common distortions due to the various stages of processing. Although MUSIQUE (MUltiply-and Singly-distorted Image QUality Estimator) Zhang et al., TIP 2018 is a successful NR algorithm, this approach is still limited to the three distortion types. In this paper, we extend MUSIQUE to MUSIQUE-II to blindly assess the quality of images corrupted by five distortion types (white noise, Gaussian blur, JPEG compression, JPEG2000 compression, and contrast change) and their combinations. The proposed MUSIQUE-II algorithm builds upon the classification and parameter-estimation framework of its predecessor by using more advanced models and a more comprehensive set of distortion-sensitive features. Specifically, MUSIQUE-II relies on a three-layer classification model to identify 19 distortion types. To predict the five distortion parameter values, MUSIQUE-II extracts an additional 14 contrast features and employs a multi-layer probability-weighting rule. Finally, MUSIQUE-II employs a new most-apparent-distortion strategy to adaptively combine five quality scores based on outputs of three classification models. Experimental results tested on three multiply-distorted and six singly-distorted image quality databases show that MUSIQUE-II yields not only a substantial improvement in quality predictive performance as compared with its predecessor, but also highly competitive performance relative to other state-of-the-art FR/NR IQA algorithms.
Collapse
|
18
|
Xing L, Jin B, Fu X, Zhu J, Guo X, Xu W, Mou X, Wang Z, Jiang F, Zhou Y, Chen X, Shu J. Identification of functional estrogen response elements in glycerol channel Aquaporin-7 gene. Climacteric 2019; 22:466-471. [PMID: 30888885 DOI: 10.1080/13697137.2019.1580255] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Affiliation(s)
- L. Xing
- Department of Reproductive Endocrinology, Zhejiang Provincial People‘s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, P.R. China
| | - B. Jin
- Department of Reproductive Endocrinology, Zhejiang Provincial People‘s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, P.R. China
| | - X. Fu
- Department of Reproductive Endocrinology, Zhejiang Provincial People‘s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, P.R. China
| | - J. Zhu
- Department of Reproductive Endocrinology, Zhejiang Provincial People‘s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, P.R. China
| | - X. Guo
- Department of Reproductive Endocrinology, Zhejiang Provincial People‘s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, P.R. China
| | - W. Xu
- Department of Reproductive Endocrinology, Zhejiang Provincial People‘s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, P.R. China
| | - X. Mou
- Key Laboratory of Tumor Molecular Diagnosis and Individualized Medicine of Zhejiang Province, Hangzhou, Zhejiang, P.R. China
- Clinical Research Institute, Zhejiang Provincial People’s Hospital, Hangzhou, Zhejiang, P.R. China
| | - Z. Wang
- Key Laboratory of Tumor Molecular Diagnosis and Individualized Medicine of Zhejiang Province, Hangzhou, Zhejiang, P.R. China
- Clinical Research Institute, Zhejiang Provincial People’s Hospital, Hangzhou, Zhejiang, P.R. China
| | - F. Jiang
- The First Clinical Medical School of Wenzhou Medical University, Wenzhou, Zhejiang, P.R. China
| | - Y. Zhou
- The First Clinical Medical School of Wenzhou Medical University, Wenzhou, Zhejiang, P.R. China
| | - X. Chen
- Department of Reproductive Endocrinology, Zhejiang Provincial People‘s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, P.R. China
- Key Laboratory of Tumor Molecular Diagnosis and Individualized Medicine of Zhejiang Province, Hangzhou, Zhejiang, P.R. China
- Clinical Research Institute, Zhejiang Provincial People’s Hospital, Hangzhou, Zhejiang, P.R. China
| | - J. Shu
- Department of Reproductive Endocrinology, Zhejiang Provincial People‘s Hospital, Hangzhou Medical College, Hangzhou, Zhejiang, P.R. China
- The First Clinical Medical School of Wenzhou Medical University, Wenzhou, Zhejiang, P.R. China
| |
Collapse
|
19
|
Chen X, Zhou Z, Hannan R, Thomas K, Pedrosa I, Kapur P, Brugarolas J, Mou X, Wang J. Reliable gene mutation prediction in clear cell renal cell carcinoma through multi-classifier multi-objective radiogenomics model. Phys Med Biol 2018; 63:215008. [PMID: 30277889 DOI: 10.1088/1361-6560/aae5cd] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
Genetic studies have identified associations between gene mutations and clear cell renal cell carcinoma (ccRCC). Since the complete gene mutational landscape cannot be characterized through biopsy and sequencing assays for each patient, non-invasive tools are needed to determine the mutation status for tumors. Radiogenomics may be an attractive alternative tool to identify disease genomics by analyzing amounts of features extracted from medical images. Most current radiogenomics predictive models are built based on a single classifier and trained through a single objective. However, since many classifiers are available, selecting an optimal model is challenging. On the other hand, a single objective may not be a good measure to guide model training. We proposed a new multi-classifier multi-objective (MCMO) radiogenomics predictive model. To obtain more reliable prediction results, similarity-based sensitivity and specificity were defined and considered as the two objective functions simultaneously during training. To take advantage of different classifiers, the evidential reasoning (ER) approach was used for fusing the output of each classifier. Additionally, a new similarity-based multi-objective optimization algorithm (SMO) was developed for training the MCMO to predict ccRCC related gene mutations (VHL, PBRM1 and BAP1) using quantitative CT features. Using the proposed MCMO model, we achieved a predictive area under the receiver operating characteristic curve (AUC) over 0.85 for VHL, PBRM1 and BAP1 genes with balanced sensitivity and specificity. Furthermore, MCMO outperformed all the individual classifiers, and yielded more reliable results than other optimization algorithms and commonly used fusion strategies.
Collapse
Affiliation(s)
- Xi Chen
- School of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, People's Repubic of China
| | | | | | | | | | | | | | | | | |
Collapse
|
20
|
Abstract
In computed tomography (CT), the polychromatic characteristics of x-ray photons, which are emitted from a source, interact with materials and are absorbed by a detector, may lead to beam-hardening effect in signal detection and image formation, especially in situations where materials of high attenuation (e.g. the bone or metal implants) are in the x-ray beam. Usually, a beam-hardening correction (BHC) method is used to suppress the artifacts induced by bone or other objects of high attenuation, in which a calibration-oriented iterative operation is carried out to determine a set of parameters for all situations. Based on the Helgasson-Ludwig consistency condition (HLCC), an optimization based method has been proposed by turning the calibration-oriented iterative operation of BHC into solving an optimization problem sustained by projection data. However, the optimization based HLCC-BHC method demands the engagement of a large number of neighboring projection views acquired at relatively high and uniform angular sampling rate, hindering its application in situations where the angular sampling in projection view is sparse or non-uniform. By defining an objective function based on the data integral invariant constraint (DIIC), we again turn BHC into solving an optimization problem sustained by projection data. As it only needs a pair of projection views at any view angle, the proposed BHC method can be applicable in the challenging scenarios mentioned above. Using the projection data simulated by computer, we evaluate and verify the proposed optimization based DIIC-BHC method's performance. Moreover, with the projection data of a head scan by a multi-detector row MDCT, we show the proposed DIIC-BHC method's utility in clinical applications.
Collapse
Affiliation(s)
- Shaojie Tang
- Xi'an University of Posts and Telecommunications, Xi'an, Shaanxi 710121, People's Republic of China
| | | | | | | | | |
Collapse
|
21
|
Zhang Y, Chandler DM, Mou X. Quality Assessment of Screen Content Images via Convolutional-Neural-Network-Based Synthetic/Natural Segmentation. IEEE Trans Image Process 2018; 27:5113-5128. [PMID: 29994707 DOI: 10.1109/tip.2018.2851390] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The recent popularity of remote desktop software and live streaming of composited video has given rise to a growing number of applications which make use of so-called screen content images that contain a mixture of text, graphics, and photographic imagery. Automatic quality assessment (QA) of screen-content images is necessary to enable tasks such as quality monitoring, parameter adaptation, and other optimizations. Although QA of natural images has been heavily researched over the last several decades, QA of screen content images is a relatively new topic. In this paper, we present a QA algorithm, called convolutional neural network (CNN) based screen content image quality estimator (CNN-SQE), which operates via a fuzzy classification of screen content images into plain-text, computergraphics/ cartoons, and natural-image regions. The first two classes are considered to contain synthetic content (text/graphics), and the latter two classes are considered to contain naturalistic content (graphics/photographs), where the overlap of the classes allows the computer graphics/cartoons segments to be analyzed by both text-based and natural-image-based features. We present a CNN-based approach for the classification, an edge-structurebased quality degradation model, and a region-size-adaptive quality-fusion strategy. As we will demonstrate, the proposed CNN-SQE algorithm can achieve better/competitive performance as compared with other state-of-the-art QA algorithms.
Collapse
|
22
|
Yang Q, Yan P, Zhang Y, Yu H, Shi Y, Mou X, Kalra MK, Zhang Y, Sun L, Wang G. Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss. IEEE Trans Med Imaging 2018; 37:1348-1357. [PMID: 29870364 PMCID: PMC6021013 DOI: 10.1109/tmi.2018.2827462] [Citation(s) in RCA: 507] [Impact Index Per Article: 84.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
The continuous development and extensive use of computed tomography (CT) in medical practice has raised a public concern over the associated radiation dose to the patient. Reducing the radiation dose may lead to increased noise and artifacts, which can adversely affect the radiologists' judgment and confidence. Hence, advanced image reconstruction from low-dose CT data is needed to improve the diagnostic performance, which is a challenging problem due to its ill-posed nature. Over the past years, various low-dose CT methods have produced impressive results. However, most of the algorithms developed for this application, including the recently popularized deep learning techniques, aim for minimizing the mean-squared error (MSE) between a denoised CT image and the ground truth under generic penalties. Although the peak signal-to-noise ratio is improved, MSE- or weighted-MSE-based methods can compromise the visibility of important structural details after aggressive denoising. This paper introduces a new CT image denoising method based on the generative adversarial network (GAN) with Wasserstein distance and perceptual similarity. The Wasserstein distance is a key concept of the optimal transport theory and promises to improve the performance of GAN. The perceptual loss suppresses noise by comparing the perceptual features of a denoised output against those of the ground truth in an established feature space, while the GAN focuses more on migrating the data noise distribution from strong to weak statistically. Therefore, our proposed method transfers our knowledge of visual perception to the image denoising task and is capable of not only reducing the image noise level but also trying to keep the critical information at the same time. Promising results have been obtained in our experiments with clinical CT images.
Collapse
|
23
|
Affiliation(s)
- J. Zhang
- Research
School of Chemistry, Australian National University, Canberra, ACT 2601, Australia
- Université de Haute-Alsace, CNRS, IS2M UMR 7361, Cedex F-68100 Mulhouse, France
- Université de Strasbourg, France
- School
of Chemistry, University of New South Wales, Sydney, NSW 2052, Australia
| | - J. Lalevée
- Université de Haute-Alsace, CNRS, IS2M UMR 7361, Cedex F-68100 Mulhouse, France
- Université de Strasbourg, France
| | - X. Mou
- School
of Chemistry, University of New South Wales, Sydney, NSW 2052, Australia
| | - F. Morlet-Savary
- Université de Haute-Alsace, CNRS, IS2M UMR 7361, Cedex F-68100 Mulhouse, France
- Université de Strasbourg, France
| | - B. Graff
- Université de Haute-Alsace, CNRS, IS2M UMR 7361, Cedex F-68100 Mulhouse, France
- Université de Strasbourg, France
| | - P. Xiao
- Research
School of Chemistry, Australian National University, Canberra, ACT 2601, Australia
- Université de Haute-Alsace, CNRS, IS2M UMR 7361, Cedex F-68100 Mulhouse, France
- Université de Strasbourg, France
- School
of Chemistry, University of New South Wales, Sydney, NSW 2052, Australia
| |
Collapse
|
24
|
Wu J, Dai F, Hu G, Mou X. Low dose CT reconstruction via L1 norm dictionary learning using alternating minimization algorithm and balancing principle. J Xray Sci Technol 2018; 26:603-622. [PMID: 29689766 DOI: 10.3233/xst-17358] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Excessive radiation exposure in computed tomography (CT) scans increases the chance of developing cancer and has become a major clinical concern. Recently, statistical iterative reconstruction (SIR) with l0-norm dictionary learning regularization has been developed to reconstruct CT images from the low dose and few-view dataset in order to reduce radiation dose. Nonetheless, the sparse regularization term adopted in this approach is l0-norm, which cannot guarantee the global convergence of the proposed algorithm. To address this problem, in this study we introduced the l1-norm dictionary learning penalty into SIR framework for low dose CT image reconstruction, and developed an alternating minimization algorithm to minimize the associated objective function, which transforms CT image reconstruction problem into a sparse coding subproblem and an image updating subproblem. During the image updating process, an efficient model function approach based on balancing principle is applied to choose the regularization parameters. The proposed alternating minimization algorithm was evaluated first using real projection data of a sheep lung CT perfusion and then using numerical simulation based on sheep lung CT image and chest image. Both visual assessment and quantitative comparison using terms of root mean square error (RMSE) and structural similarity (SSIM) index demonstrated that the new image reconstruction algorithm yielded similar performance with l0-norm dictionary learning penalty and outperformed the conventional filtered backprojection (FBP) and total variation (TV) minimization algorithms.
Collapse
Affiliation(s)
- Junfeng Wu
- College of Science, Xi'an University of Technology, Xi'an, China
- The Key Laboratory of Computer Network and Information Integration, Southeast University, Ministry of Education, Nanjing, China
| | - Fang Dai
- College of Science, Xi'an University of Technology, Xi'an, China
| | - Gang Hu
- College of Science, Xi'an University of Technology, Xi'an, China
| | - Xuanqin Mou
- The Institute of Image processing and Pattern recognition, Xi'an Jiaotong University, Xi'an, China
| |
Collapse
|
25
|
Bai T, Yan H, Jia X, Jiang S, Wang G, Mou X. Z-Index Parameterization for Volumetric CT Image Reconstruction via 3-D Dictionary Learning. IEEE Trans Med Imaging 2017; 36:2466-2478. [PMID: 28981411 PMCID: PMC5732496 DOI: 10.1109/tmi.2017.2759819] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Despite the rapid developments of X-ray cone-beam CT (CBCT), image noise still remains a major issue for the low dose CBCT. To suppress the noise effectively while retain the structures well for low dose CBCT image, in this paper, a sparse constraint based on the 3-D dictionary is incorporated into a regularized iterative reconstruction framework, defining the 3-D dictionary learning (3-DDL) method. In addition, by analyzing the sparsity level curve associated with different regularization parameters, a new adaptive parameter selection strategy is proposed to facilitate our 3-DDL method. To justify the proposed method, we first analyze the distributions of the representation coefficients associated with the 3-D dictionary and the conventional 2-D dictionary to compare their efficiencies in representing volumetric images. Then, multiple real data experiments are conducted for performance validation. Based on these results, we found: 1) the 3-D dictionary-based sparse coefficients have three orders narrower Laplacian distribution compared with the 2-D dictionary, suggesting the higher representation efficiencies of the 3-D dictionary; 2) the sparsity level curve demonstrates a clear Z-shape, and hence referred to as Z-curve, in this paper; 3) the parameter associated with the maximum curvature point of the Z-curve suggests a nice parameter choice, which could be adaptively located with the proposed Z-index parameterization (ZIP) method; 4) the proposed 3-DDL algorithm equipped with the ZIP method could deliver reconstructions with the lowest root mean squared errors and the highest structural similarity index compared with the competing methods; 5) similar noise performance as the regular dose FDK reconstruction regarding the standard deviation metric could be achieved with the proposed method using (1/2)/(1/4)/(1/8) dose level projections. The contrast-noise ratio is improved by ~2.5/3.5 times with respect to two different cases under the (1/8) dose level compared with the low dose FDK reconstruction. The proposed method is expected to reduce the radiation dose by a factor of 8 for CBCT, considering the voted strongly discriminated low contrast tissues.
Collapse
|
26
|
Peng B, Zhang L, Mou X, Yang MH. Evaluation of Segmentation Quality via Adaptive Composition of Reference Segmentations. IEEE Trans Pattern Anal Mach Intell 2017; 39:1929-1941. [PMID: 27810800 DOI: 10.1109/tpami.2016.2622703] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Evaluating image segmentation quality is a critical step for generating desirable segmented output and comparing performance of algorithms, among others. However, automatic evaluation of segmented results is inherently challenging since image segmentation is an ill-posed problem. This paper presents a framework to evaluate segmentation quality using multiple labeled segmentations which are considered as references. For a segmentation to be evaluated, we adaptively compose a reference segmentation using multiple labeled segmentations, which locally matches the input segments while preserving structural consistency. The quality of a given segmentation is then measured by its distance to the composed reference. A new dataset of 200 images, where each one has 6 to 15 labeled segmentations, is developed for performance evaluation of image segmentation. Furthermore, to quantitatively compare the proposed segmentation evaluation algorithm with the state-of-the-art methods, a benchmark segmentation evaluation dataset is proposed. Extensive experiments are carried out to validate the proposed segmentation evaluation framework.
Collapse
|
27
|
Jin B, Chen X, Xing L, Xu W, Fu X, Zhu J, Mou X, Wang Z, Shu J. Tissue-specific effects of estrogen on glycerol channel aquaporin 7 expression in an ovariectomized mouse model of menopause. Climacteric 2017; 20:385-390. [PMID: 28489425 DOI: 10.1080/13697137.2017.1319920] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
OBJECTIVE Elevated fat mass and redistribution of body fat are commonly observed in postmenopausal women. Aquaporin 7 (AQP7), a unique glycerol permeable integral membrane protein, has been associated with the onset of obesity. We hypothesized that estrogen supplementation could counteract this fat accumulation and redistribution through tissue-specific modulation of AQP7. METHODS We measured fat depot weight, adipocyte size, and the expression of AQP7 and glycerol kinase (GK) in visceral and subcutaneous fat tissues of ovariectomized mice supplemented with or without 17β-estradiol. RESULTS Removal of the ovaries resulted in a significant decrease in AQP7 expression and an increase in GK expression in visceral adipocyte tissue; expression of AQP7 and GK in subcutaneous adipose tissue remained unaltered. Supplementation with estrogen significantly restored the visceral, but not subcutaneous, fat depot mass and adipocyte size to those of sham-operated mice. A marked increase in the expression of AQP7 and a reduction of GK were observed selectively in the visceral fat depots in estrogen-treated mice. CONCLUSIONS Our results suggest that estrogen has tissue-specific effects on AQP7 expression, and modulation of AQP7 by estrogen alters the balance of adipocyte metabolism between adipose tissue depots.
Collapse
Affiliation(s)
- B Jin
- a Department of Reproductive Endocrinology , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| | - X Chen
- a Department of Reproductive Endocrinology , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| | - L Xing
- a Department of Reproductive Endocrinology , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| | - W Xu
- a Department of Reproductive Endocrinology , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| | - X Fu
- a Department of Reproductive Endocrinology , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| | - J Zhu
- a Department of Reproductive Endocrinology , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| | - X Mou
- b Clinical Research Institute , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| | - Z Wang
- b Clinical Research Institute , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| | - J Shu
- a Department of Reproductive Endocrinology , Zhejiang Provincial People's Hospital , Hangzhou , Zhejiang , PR China
| |
Collapse
|
28
|
Li H, Hong W, Mou X, Liu Y. A novel method of micro-tomography geometric angle calibration with random phantom. J Xray Sci Technol 2017; 25:XST16178. [PMID: 28234269 DOI: 10.3233/xst-16178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The objective of this study is to develop and test the feasibility of applying a machine learning method for geometry calibration of angles in micro-tomography systems. Increasing importance of micro-tomography systems are manifested with escalating applications in various scenarios including but not limited to oral and maxillofacial surgery, vascular and intervention radiology, among other specific applications for purposes of diagnosis and treatments planning. There is possibility, however, actual pathology is confused by artifact of tissue structures after volume reconstruction as a result of CT construction errors. A Kernel Ridge Regression algorithm for micro-tomography geometry estimation and its corresponding phantom is developed and tested in this study. Several projection images of a rotating Random Phantom of some steel ball bearings in an unknown geometry with gantry angle information were utilized to calibrate both in-plane and out-plane rotation of the detector. The described method can also be expanded to calibrate other parameters of CT construction effortlessly. Using computer simulation, the study results validated that geometry parameters of micro-tomography system were accurately calibrated.
Collapse
Affiliation(s)
- Haocheng Li
- Institute of Image Processing and Pattern Recognition, School of Electronic and Information Engineering, Xi'an Jiaotong University, China
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, China
| | - Wei Hong
- Institute of Image Processing and Pattern Recognition, School of Electronic and Information Engineering, Xi'an Jiaotong University, China
| | - Xuanqin Mou
- Institute of Image Processing and Pattern Recognition, School of Electronic and Information Engineering, Xi'an Jiaotong University, China
| | - Yu Liu
- Institute of Image Processing and Pattern Recognition, School of Electronic and Information Engineering, Xi'an Jiaotong University, China
| |
Collapse
|
29
|
Bai T, Yan H, Ouyang L, Staub D, Wang J, Jia X, Jiang SB, Mou X. Data correlation based noise level estimation for cone beam projection data. J Xray Sci Technol 2017; 25:907-926. [PMID: 28697578 PMCID: PMC5714667 DOI: 10.3233/xst-17266] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
BACKGROUND In regularized iterative reconstruction algorithms, the selection of regularization parameter depends on the noise level of cone beam projection data. OBJECTIVE Our aim is to propose an algorithm to estimate the noise level of cone beam projection data. METHODS We first derived the data correlation of cone beam projection data in the Fourier domain, based on which, the signal and the noise were decoupled. Then the noise was extracted and averaged for estimation. An adaptive regularization parameter selection strategy was introduced based on the estimated noise level. Simulation and real data studies were conducted for performance validation. RESULTS There exists an approximately zero-energy double-wedge area in the 3D Fourier domain of cone beam projection data. As for the noise level estimation results, the averaged relative errors of the proposed algorithm in the analytical/MC/spotlight-mode simulation experiments were 0.8%, 0.14% and 0.24%, respectively, and outperformed the homogeneous area based as well as the transformation based algorithms. Real studies indicated that the estimated noise levels were inversely proportional to the exposure levels, i.e., the slopes in the log-log plot were -1.0197 and -1.049 with respect to the short-scan and half-fan modes. The introduced regularization parameter selection strategy could deliver promising reconstructed image qualities. CONCLUSIONS Based on the data correlation of cone beam projection data in Fourier domain, the proposed algorithm could estimate the noise level of cone beam projection data accurately and robustly. The estimated noise level could be used to adaptively select the regularization parameter.
Collapse
Affiliation(s)
- Ti Bai
- Institute of Image Processing and Pattern Recognition, Xi’an Jiaotong University, Xi’an 710049, China
- Beijing Center for Mathematics and Information Interdisciplinary Sciences, Beijing 100048, China
| | - Hao Yan
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Luo Ouyang
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - David Staub
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Jing Wang
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Xun Jia
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Steve B. Jiang
- Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX 75390, USA
| | - Xuanqin Mou
- Institute of Image Processing and Pattern Recognition, Xi’an Jiaotong University, Xi’an 710049, China
- Beijing Center for Mathematics and Information Interdisciplinary Sciences, Beijing 100048, China
- Corresponding author:
| |
Collapse
|
30
|
Abstract
Spectral computed tomography (CT) produces an energy-discriminative attenuation map of an object, extending a conventional image volume with a spectral dimension. In spectral CT, an image can be sparsely represented in each of multiple energy channels, and are highly correlated among energy channels. According to this characteristics, we propose a tensor-based dictionary learning method for spectral CT reconstruction. In our method, tensor patches are extracted from an image tensor, which is reconstructed using the filtered backprojection (FBP), to form a training dataset. With the Candecomp/Parafac decomposition, a tensor-based dictionary is trained, in which each atom is a rank-one tensor. Then, the trained dictionary is used to sparsely represent image tensor patches during an iterative reconstruction process, and the alternating minimization scheme is adapted for optimization. The effectiveness of our proposed method is validated with both numerically simulated and real preclinical mouse datasets. The results demonstrate that the proposed tensor-based method generally produces superior image quality, and leads to more accurate material decomposition than the currently popular popular methods.
Collapse
|
31
|
Abstract
In dynamic computed tomography (CT) reconstruction, the data acquisition speed limits the spatio-temporal resolution. Recently, compressed sensing theory has been instrumental in improving CT reconstruction from far few-view projections. In this paper, we present an adaptive method to train a tensor-based spatio-temporal dictionary for sparse representation of an image sequence during the reconstruction process. The correlations among atoms and across phases are considered to capture the characteristics of an object. The reconstruction problem is solved by the alternating direction method of multipliers. To recover fine or sharp structures such as edges, the nonlocal total variation is incorporated into the algorithmic framework. Preclinical examples including a sheep lung perfusion study and a dynamic mouse cardiac imaging demonstrate that the proposed approach outperforms the vectorized dictionary-based CT reconstruction in the case of few-view reconstruction.
Collapse
Affiliation(s)
- Shengqi Tan
- Beijing Key Laboratory of Nuclear Detection & Measurement Technology, Beijing 100084, People's Republic of China. Institute of Nuclear and New Energy Technology, Tsinghua University, Beijing 100084, People's Republic of China
| | | | | | | | | | | | | |
Collapse
|
32
|
Lombard L, Chen S, Mou X, Zhou X, Crous P, Wingfield M. New species, hyper-diversity and potential importance of Calonectria spp. from Eucalyptus in South China. Stud Mycol 2015; 80:151-88. [PMID: 26955194 PMCID: PMC4779793 DOI: 10.1016/j.simyco.2014.11.003] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Plantation forestry is expanding rapidly in China to meet an increasing demand for wood and pulp products globally. Fungal pathogens including species of Calonectria represent a serious threat to the growth and sustainability of this industry. Surveys were conducted in the Guangdong, Guangxi and Hainan Provinces of South China, where Eucalyptus trees in plantations or cuttings in nurseries displayed symptoms of leaf blight. Isolations from symptomatic leaves and soils collected close to infected trees resulted in a large collection of Calonectria isolates. These isolates were identified using the Consolidated Species Concept, employing morphological characters and DNA sequence comparisons for the β-tubulin, calmodulin, histone H3 and translation elongation factor 1-alpha gene regions. Twenty-one Calonectria species were identified of which 18 represented novel taxa. Of these, 12 novel taxa belonged to Sphaero-Naviculate Group and the remaining six to the Prolate Group. Southeast Asia appears to represent a centre of biodiversity for the Sphaero-Naviculate Group and this fact could be one of the important constraints to Eucalyptus forestry in China. The remarkable diversity of Calonectria species in a relatively small area of China and associated with a single tree species is surprising.
Collapse
Key Words
- C. arbusta L. Lombard, Crous & S.F. Chen
- C. expansa L. Lombard, Crous & S.F. Chen
- C. foliicola L. Lombard, Crous & S.F. Chen
- C. guangxiensis L. Lombard, Crous & S.F. Chen
- C. hainanensis L. Lombard, Crous & S.F. Chen
- C. lateralis L. Lombard, Crous & S.F. Chen
- C. magnispora L. Lombard, Crous & S.F. Chen
- C. microconidialis L. Lombard, Crous & S.F. Chen
- C. papillata L. Lombard, Crous & S.F. Chen
- C. parakyotensis L. Lombard, Crous & S.F. Chen
- C. pluriramosa L. Lombard, Crous & S.F. Chen
- C. pseudokyotensis L. Lombard, Crous & S.F. Chen
- C. seminaria L. Lombard, Crous & S.F. Chen
- C. sphaeropedunculata L. Lombard, Crous & S.F. Chen
- C. terrestris L. Lombard, Crous & S.F. Chen
- C. tetraramosa L. Lombard, Crous & S.F. Chen
- C. turangicola L. Lombard, Crous & S.F. Chen
- Calonectria
- Calonectria aconidialis L. Lombard, Crous & S.F. Chen
- Cylindrocladium leaf blight
- Eucalyptus
- Soil
- Taxonomy
Collapse
Affiliation(s)
- L. Lombard
- CBS-KNAW Fungal Biodiversity Centre, Uppsalalaan 8, 3584 CT Utrecht, The Netherlands
| | - S.F. Chen
- Department of Microbiology and Plant Pathology, Tree Protection Co-operative Programme, Forestry and Agricultural Biotechnology Institute, University of Pretoria, Pretoria 0002, South Africa
- China Eucalypt Research Centre (CERC), Chinese Academy of Forestry (CAF), ZhanJiang 524022, GuangDong Province, China
| | - X. Mou
- Department of Microbiology and Plant Pathology, Tree Protection Co-operative Programme, Forestry and Agricultural Biotechnology Institute, University of Pretoria, Pretoria 0002, South Africa
- China Eucalypt Research Centre (CERC), Chinese Academy of Forestry (CAF), ZhanJiang 524022, GuangDong Province, China
| | - X.D. Zhou
- Department of Microbiology and Plant Pathology, Tree Protection Co-operative Programme, Forestry and Agricultural Biotechnology Institute, University of Pretoria, Pretoria 0002, South Africa
- China Eucalypt Research Centre (CERC), Chinese Academy of Forestry (CAF), ZhanJiang 524022, GuangDong Province, China
| | - P.W. Crous
- CBS-KNAW Fungal Biodiversity Centre, Uppsalalaan 8, 3584 CT Utrecht, The Netherlands
- Department of Microbiology and Plant Pathology, Tree Protection Co-operative Programme, Forestry and Agricultural Biotechnology Institute, University of Pretoria, Pretoria 0002, South Africa
- Microbiology, Department of Biology, Utrecht University, Padualaan 8, 3584 CH Utrecht, The Netherlands
| | - M.J. Wingfield
- Department of Microbiology and Plant Pathology, Tree Protection Co-operative Programme, Forestry and Agricultural Biotechnology Institute, University of Pretoria, Pretoria 0002, South Africa
| |
Collapse
|
33
|
Xue W, Mou X, Zhang L, Bovik AC, Feng X. Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Trans Image Process 2014; 23:4850-62. [PMID: 25216482 DOI: 10.1109/tip.2014.2355716] [Citation(s) in RCA: 64] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Blind image quality assessment (BIQA) aims to evaluate the perceptual quality of a distorted image without information regarding its reference image. Existing BIQA models usually predict the image quality by analyzing the image statistics in some transformed domain, e.g., in the discrete cosine transform domain or wavelet domain. Though great progress has been made in recent years, BIQA is still a very challenging task due to the lack of a reference image. Considering that image local contrast features convey important structural information that is closely related to image perceptual quality, we propose a novel BIQA model that utilizes the joint statistics of two types of commonly used local contrast features: 1) the gradient magnitude (GM) map and 2) the Laplacian of Gaussian (LOG) response. We employ an adaptive procedure to jointly normalize the GM and LOG features, and show that the joint statistics of normalized GM and LOG features have desirable properties for the BIQA task. The proposed model is extensively evaluated on three large-scale benchmark databases, and shown to deliver highly competitive performance with state-of-the-art BIQA models, as well as with some well-known full reference image quality assessment models.
Collapse
|
34
|
Bai T, Yan H, Shi F, Jia X, Lou Y, Xu Q, Jiang SB, Mou X. WE-G-18A-04: 3D Dictionary Learning Based Statistical Iterative Reconstruction for Low-Dose Cone Beam CT Imaging. Med Phys 2014. [DOI: 10.1118/1.4889515] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
35
|
Bai T, Yan H, Jia X, Jiang SB, Mou X. SU-E-QI-08: Fourier Properties of Cone Beam CT Projection. Med Phys 2014. [DOI: 10.1118/1.4888988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
36
|
Bai T, Yan H, Shi F, Jia X, Lou Y, Xu Q, Jiang S, Mou X. 3D dictionary learning based iterative cone beam CT reconstruction. Int J Cancer Ther Oncol 2014. [DOI: 10.14319/ijcto.0202.40] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
|
37
|
Xue W, Zhang L, Mou X, Bovik AC. Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index. IEEE Trans Image Process 2014; 23:684-695. [PMID: 26270911 DOI: 10.1109/tip.2013.2293423] [Citation(s) in RCA: 222] [Impact Index Per Article: 22.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
It is an important task to faithfully evaluate the perceptual quality of output images in many applications, such as image compression, image restoration, and multimedia streaming. A good image quality assessment (IQA) model should not only deliver high quality prediction accuracy, but also be computationally efficient. The efficiency of IQA metrics is becoming particularly important due to the increasing proliferation of high-volume visual data in high-speed networks. We present a new effective and efficient IQA model, called gradient magnitude similarity deviation (GMSD). The image gradients are sensitive to image distortions, while different local structures in a distorted image suffer different degrees of degradations. This motivates us to explore the use of global variation of gradient based local quality map for overall image quality prediction. We find that the pixel-wise gradient magnitude similarity (GMS) between the reference and distorted images combined with a novel pooling strategy-the standard deviation of the GMS map-can predict accurately perceptual image quality. The resulting GMSD algorithm is much faster than most state-of-the-art IQA methods, and delivers highly competitive prediction accuracy. MATLAB source code of GMSD can be downloaded at http://www4.comp.polyu.edu.hk/~cslzhang/IQA/GMSD/GMSD.htm.
Collapse
|
38
|
Chen X, Nishikawa RM, Chan ST, Lau BA, Zhang L, Mou X. Algorithmic scatter correction in dual-energy digital mammography. Med Phys 2013; 40:111919. [DOI: 10.1118/1.4826173] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
39
|
Abstract
PURPOSE Presence of metal artifacts is a major reason of degradation of computed tomography image quality and there is still no standard solution to this issue. A class of recently investigated metal artifact reduction (MAR) methods based on forward projection of a prior image that is artifact-free to replace the metal affected projection data have shown promising results. However, usually it is hard to get a good prior image which is close to the true image without artifacts. This work aims at creating a good prior image so that the forward projection can replace the metal affected projection data well. METHODS The proposed method consists of four steps based on the forward projection MAR framework. First, metal implants in the reconstructed image are segmented and the corresponding metal traces in the projection domain are identified. Then the prior image is obtained by two steps. A processed precorrected image is generated as an initial prior image first and then in the next step it is used as the initial image of the iterative reconstruction from the unaffected projection data to generate a better prior image. In order to deal with severe artifacts, the iteration incorporates the total variation minimization constraint as well as a novel constraint which forces the soft tissue region near metal to be as flat as possible. Finally, the projection is completed using forward projection of the prior image and the corrected image is reconstructed by FBP. A linear interpolation MAR method and two recently reported forward projection based methods are performed simultaneously for comparison. RESULTS The proposed method shows outstanding performance on both phantoms' and patients' datasets. This approach can reduce artifacts dramatically and restore tissue structures near metal to a large extent. Unlike competing MAR methods, it can effectively prevent introduction of new artifacts and false structures. Moreover, the proposed method has the lowest RMSE in regions of both soft tissue and bone tissue among the corrected images and is ranked as the best method for evaluation, by radiologists. CONCLUSIONS Both subjective and quantitative evaluations of the results demonstrate the superior performance of the proposed algorithm, compared to that of the competing methods. This method offers a remarkable improvement of the image quality.
Collapse
Affiliation(s)
- Yanbo Zhang
- Institute of Image Processing and Pattern Recognition, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, China
| | | | | | | | | | | |
Collapse
|
40
|
Yan H, Wang X, Yin W, Pan T, Ahmad M, Mou X, Cerviño L, Jia X, Jiang SB. Extracting respiratory signals from thoracic cone beam CT projections. Phys Med Biol 2013; 58:1447-64. [PMID: 23399757 DOI: 10.1088/0031-9155/58/5/1447] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
The patient respiratory signal associated with the cone beam CT (CBCT) projections is important for lung cancer radiotherapy. In contrast to monitoring an external surrogate of respiration, such a signal can be extracted directly from the CBCT projections. In this paper, we propose a novel local principal component analysis (LPCA) method to extract the respiratory signal by distinguishing the respiration motion-induced content change from the gantry rotation-induced content change in the CBCT projections. The LPCA method is evaluated by comparing with three state-of-the-art projection-based methods, namely the Amsterdam Shroud method, the intensity analysis method and the Fourier-transform-based phase analysis method. The clinical CBCT projection data of eight patients, acquired under various clinical scenarios, were used to investigate the performance of each method. We found that the proposed LPCA method has demonstrated the best overall performance for cases tested and thus is a promising technique for extracting a respiratory signal. We also identified the applicability of each existing method.
Collapse
Affiliation(s)
- Hao Yan
- Center for Advanced Radiotherapy Technologies and Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, CA 92037-0843, USA
| | | | | | | | | | | | | | | | | |
Collapse
|
41
|
Yu H, Xu Q, He P, Bennett J, Amir R, Dobbs B, Mou X, Wei B, Butler A, Butler P, Wang G. Medipix-based Spectral Micro-CT. CT Li Lun Yu Ying Yong Yan Jiu 2012; 21:583. [PMID: 24194631 PMCID: PMC3815543] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Since Hounsfield's Nobel Prize winning breakthrough decades ago, X-ray CT has been widely applied in the clinical and preclinical applications - producing a huge number of tomographic gray-scale images. However, these images are often insufficient to distinguish crucial differences needed for diagnosis. They have poor soft tissue contrast due to inherent photon-count issues, involving high radiation dose. By physics, the X-ray spectrum is polychromatic, and it is now feasible to obtain multi-energy, spectral, or true-color, CT images. Such spectral images promise powerful new diagnostic information. The emerging Medipix technology promises energy-sensitive, high-resolution, accurate and rapid X-ray detection. In this paper, we will review the recent progress of Medipix-based spectral micro-CT with the emphasis on the results obtained by our team. It includes the state- of-the-art Medipix detector, the system and method of a commercial MARS (Medipix All Resolution System) spectral micro-CT, and the design and color diffusion of a hybrid spectral micro-CT.
Collapse
Affiliation(s)
- Hengyong Yu
- Department of Radiology, Division of Radiologic Sciences, Wake Forest University Health Sciences, Winston-Salem, NC, 27157, USA ; Biomedical Imaging Division, VT-WFU School of Biomedical Engineering and Sciences, Wake Forest University Health Sciences, Winston-Salem, NC, 27157, USA ; Biomedical Imaging Division, VT-WFU School of Biomedical Engineering and Sciences, Virginia Tech, Blacksburg, VA 24061, USA
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
42
|
Abstract
Although diagnostic medical imaging provides enormous benefits in the early detection and accuracy diagnosis of various diseases, there are growing concerns on the potential side effect of radiation induced genetic, cancerous and other diseases. How to reduce radiation dose while maintaining the diagnostic performance is a major challenge in the computed tomography (CT) field. Inspired by the compressive sensing theory, the sparse constraint in terms of total variation (TV) minimization has already led to promising results for low-dose CT reconstruction. Compared to the discrete gradient transform used in the TV method, dictionary learning is proven to be an effective way for sparse representation. On the other hand, it is important to consider the statistical property of projection data in the low-dose CT case. Recently, we have developed a dictionary learning based approach for low-dose X-ray CT. In this paper, we present this method in detail and evaluate it in experiments. In our method, the sparse constraint in terms of a redundant dictionary is incorporated into an objective function in a statistical iterative reconstruction framework. The dictionary can be either predetermined before an image reconstruction task or adaptively defined during the reconstruction process. An alternating minimization scheme is developed to minimize the objective function. Our approach is evaluated with low-dose X-ray projections collected in animal and human CT studies, and the improvement associated with dictionary learning is quantified relative to filtered backprojection and TV-based reconstructions. The results show that the proposed approach might produce better images with lower noise and more detailed structural features in our selected cases. However, there is no proof that this is true for all kinds of structures.
Collapse
Affiliation(s)
- Qiong Xu
- Institute of Image Processing and Pattern Recognition, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China, and also with the Biomedical Imaging Division, VT-WFU School of Biomedical Engineering and Sciences, Wake Forest University Health Sciences, Winston-Salem, NC 27157 USA
| | - Hengyong Yu
- Biomedical Imaging Division, VT-WFU School of Biomedical Engineering and Sciences, and the Department of Radiology, Division of Radiologic Sciences, Wake Forest University Health Sciences, Winston-Salem, NC 27157 USA
| | - Xuanqin Mou
- Institute of Image Processing and Pattern Recognition, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China
| | - Lei Zhang
- Department of Computing, Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong, China
| | - Jiang Hsieh
- GE Healthcare Technology, Waukesha, WI 53188 USA
| | - Ge Wang
- Biomedical Imaging Division, VT-WFU School of Biomedical Engineering and Sciences, Virginia Tech, Blacksburg, VA 24061 USA, and also with the Wake Forest University Health Sciences, Winston-Salem, NC 27157 USA
| |
Collapse
|
43
|
Yan H, Wang X, Yin W, Pan T, Ahmad M, Mou X, Cervino L, Jia X, Jiang S. TU-C-213CD-12: Respiratory Signal Extraction from Thoracic Cone Beam CT Projections. Med Phys 2012. [DOI: 10.1118/1.4735939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
|
44
|
Xu Q, Yu H, Bennett J, He P, Zainon R, Doesburg R, Opie A, Walsh M, Shen H, Butler A, Butler P, Mou X, Wang G. Image reconstruction for hybrid true-color micro-CT. IEEE Trans Biomed Eng 2012; 59:1711-9. [PMID: 22481806 DOI: 10.1109/tbme.2012.2192119] [Citation(s) in RCA: 69] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
X-ray micro-CT is an important imaging tool for biomedical researchers. Our group has recently proposed a hybrid "true-color" micro-CT system to improve contrast resolution with lower system cost and radiation dose. The system incorporates an energy-resolved photon-counting true-color detector into a conventional micro-CT configuration, and can be used for material decomposition. In this paper, we demonstrate an interior color-CT image reconstruction algorithm developed for this hybrid true-color micro-CT system. A compressive sensing-based statistical interior tomography method is employed to reconstruct each channel in the local spectral imaging chain, where the reconstructed global gray-scale image from the conventional imaging chain served as the initial guess. Principal component analysis was used to map the spectral reconstructions into the color space. The proposed algorithm was evaluated by numerical simulations, physical phantom experiments, and animal studies. The results confirm the merits of the proposed algorithm, and demonstrate the feasibility of the hybrid true-color micro-CT system. Additionally, a "color diffusion" phenomenon was observed whereby high-quality true-color images are produced not only inside the region of interest, but also in neighboring regions. It appears harnessing that this phenomenon could potentially reduce the color detector size for a given ROI, further reducing system cost and radiation dose.
Collapse
Affiliation(s)
- Qiong Xu
- Institute of Image Processing and Pattern Recognition, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China.
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
45
|
Mou X, Chen L, Liu F, Shen Y, Wang H, Li Y, Yuan L, Lin J, Lin J, Teng L, Xiang C. Low prevalence of human papillomavirus (HPV) in Chinese patients with breast cancer. J Int Med Res 2012; 39:1636-44. [PMID: 22117964 DOI: 10.1177/147323001103900506] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
This retrospective study investigated the presence of human papillomavirus (HPV) in Chinese women with breast cancer, and the correlation between HPV infection and carcinogenesis. Tumour and non-cancerous breast tissue samples were obtained from 62 female patients with breast cancer; normal breast tissue samples were obtained from 46 women without breast cancer. HPV DNA was detected by nested polymerase chain reaction using consensus primers; HPV subtypes were determined by reverse dot blot and pyrosequencing analyses. HPV was found in tumour tissue samples from four of the 62 patients (6.5%), while no HPV DNA was detected in either the non-cancerous samples from patients with breast cancer or from the normal breast tissue controls. Of the four HPV-positive cases, three were HPV 16 positive (75%) and one was HPV 18 positive (25%). The low frequency of HPV detected in this study suggests that this infection is not a major risk factor in breast cancer development.
Collapse
Affiliation(s)
- X Mou
- State Key Laboratory for the Diagnosis and Treatment of Infectious Diseases, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
46
|
Tang S, Xu Q, Mou X, Tang X. The mathematical equivalence of consistency conditions in the divergent-beam computed tomography. J Xray Sci Technol 2012; 20:45-68. [PMID: 22398587 DOI: 10.3233/xst-2012-0318] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
In this paper, we discuss the mathematical equivalence among four consistency conditions in the divergent-beam computed tomography (CT). The first is the consistency condition derived by Levine et al. by degenerating the John's equation; the second is the integral invariant derived by Wei et al. using the symmetric group theory; the third is the so-called parallel-fan-beam Hilbert projection equality derived by Hamaker et al.; and the fourth is the fan-beam data consistency condition (FDCC) derived by Chen et al. using the complex analysis theory. Historically, most of these consistency conditions were derived by their corresponding authors using complicated mathematical strategies, which are usually not easy to be precisely understood by researchers with only a general engineering mathematical background. In this paper, we symmetrically re-derive all these consistency conditions using a friendly mathematical language. Based on theoretical derivation, it has been found that all these consistency conditions can be viewed as a necessary condition for the specific solution to John's equation. From the physical point of view, all these consistency conditions have been essentially expressed as a similar constraint on the projection data acquired with arbitrary two x-ray source points. Numerical simulations have been carried out to experimentally evaluate and verify their merits.
Collapse
Affiliation(s)
- Shaojie Tang
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, GA 30322, USA.
| | | | | | | |
Collapse
|
47
|
Abstract
AIM The prevalence of human papillomavirus (HPV) was determined in Chinese patients with colorectal cancer (CRC). The study also aimed to determine whether the HPV DNA peripheral blood (PB) assay can be used to diagnose HPV-related CRC. METHOD Tumour tissue, noncancerous colorectal tissue and whole-blood samples were obtained from 96 patients with CRC. In addition, 32 colorectal tissue samples were harvested from patients without CRC, and 48 whole-blood samples were collected from healthy blood donors. HPV DNA was detected by means of a nested polymerase chain reaction (PCR) using consensus primers, and HPV genotypes were determined by reverse Southern blot and pyrosequencing. RESULTS HPV DNA was detected in 32 of the 96 patients with CRC, and colorectal tissues from the 32 control patients without CRC were negative for HPV DNA (P < 0.001). Among 48 healthy donors, three had detectable levels of HPV DNA in their PB. Patients with CRC did not have significantly higher levels of HPV DNA than controls. The HPV prevalence in tumour tissues was higher than that in noncancerous colorectal tissues (P < 0.001) or that in PB samples (P < 0.001). No correlation between the presence of HPV and demographic or medical characteristics was observed. HPV 16 was the viral type most frequently detected and was found in 33 (94%) of 35 HPV-positive patients. CONCLUSION HPV infection may be a risk factor for CRC. However, detection of HPV DNA in PB does not appear to reflect the HPV status of CRC.
Collapse
Affiliation(s)
- F Liu
- State Key Laboratory for Diagnosis and Treatment of Infectious Disease, the First Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | | | | | | | | | | |
Collapse
|
48
|
Abstract
Image quality assessment (IQA) aims to use computational models to measure the image quality consistently with subjective evaluations. The well-known structural similarity index brings IQA from pixel- to structure-based stage. In this paper, a novel feature similarity (FSIM) index for full reference IQA is proposed based on the fact that human visual system (HVS) understands an image mainly according to its low-level features. Specifically, the phase congruency (PC), which is a dimensionless measure of the significance of a local structure, is used as the primary feature in FSIM. Considering that PC is contrast invariant while the contrast information does affect HVS' perception of image quality, the image gradient magnitude (GM) is employed as the secondary feature in FSIM. PC and GM play complementary roles in characterizing the image local quality. After obtaining the local quality map, we use PC again as a weighting function to derive a single quality score. Extensive experiments performed on six benchmark IQA databases demonstrate that FSIM can achieve much higher consistency with the subjective evaluations than state-of-the-art IQA metrics.
Collapse
|
49
|
Abstract
This paper presents a statistical interior tomography (SIT) approach making use of compressed sensing (CS) theory. With the projection data modeled by the Poisson distribution, an objective function with a total variation (TV) regularization term is formulated in the maximization of a posteriori (MAP) framework to solve the interior problem. An alternating minimization method is used to optimize the objective function with an initial image from the direct inversion of the truncated Hilbert transform. The proposed SIT approach is extensively evaluated with both numerical and real datasets. The results demonstrate that SIT is robust with respect to data noise and down-sampling, and has better resolution and less bias than its deterministic counterpart in the case of low count data.
Collapse
Affiliation(s)
- Qiong Xu
- Institute of Image Processing and Pattern Recognition, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China
| | - Xuanqin Mou
- Institute of Image Processing and Pattern Recognition, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China
| | - Ge Wang
- Biomedical Imaging Division, VT-WFU School of Biomedical Engineering and Sciences, Virginia Tech., Blacksburg, VA 24061 USA and with Wake Forest University Health Sciences, Winston-Salem, NC 27157 USA
| | - Jered Sieren
- Iowa Comprehensive Lung Imaging Center, Department of Radiology, University of Iowa, Iowa City, IA 52242 USA
| | - Eric A. Hoffman
- Iowa Comprehensive Lung Imaging Center, Department of Radiology, University of Iowa, Iowa City, IA 52242 USA
| | - Hengyong Yu
- Biomedical Imaging Division, VT-WFU School of Biomedical Engineering and Sciences, Virginia Tech., Blacksburg, VA 24061 USA, and with the Department of Radiology, Division of Radiologic Sciences, Wake Forest University Health Sciences, Winston-Salem, NC 27157 USA
| |
Collapse
|
50
|
Abstract
An algorithm is proposed to directly reconstruct a CT gradient image in a region of interest(ROI). First, the central slice theorem is generalized and a differential constraint condition (DCC) is introduced in parallel-beam geometry. Then, an algorithm is developed to reconstruct the gradient images in both Cartesian and polar coordinate systems based on a two-step Hilbert transform method. Finally, the reconstruction algorithm is extended into the equi-distant fan-beam geometry. Meanwhile, a conditional truncation for projection data acquisition is permitted by using a one-dimensional(1-D) finite Hilbert transform in image domain. Because the reconstructed gradient image is in terms of local operator, it have a better performance in CT image analysis and other CT applications compared to the global Calderon operator in Lambda Tomography.
Collapse
Affiliation(s)
- Shaojie Tang
- School of Automation, Xi'an University of Posts and Telecommunications, Xi'an, Shanxi, China
| | | | | | | | | |
Collapse
|