1
|
Wang B, Li S, Zhang H, Zhang L, Li J, Yu J, He X, Guo H. Sparse-Laplace hybrid graph manifold method for fluorescence molecular tomography. Phys Med Biol 2024; 69:215009. [PMID: 39417341 DOI: 10.1088/1361-6560/ad84b8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Accepted: 10/08/2024] [Indexed: 10/19/2024]
Abstract
Objective.Fluorescence molecular tomography (FMT) holds promise for early tumor detection by mapping fluorescent agents in three dimensions non-invasively with low cost. However, since ill-posedness and ill-condition due to strong scattering effects in biotissues and limited measurable data, current FMT reconstruction is still up against unsatisfactory accuracy, including location prediction and morphological preservation.Approach.To strike the above challenges, we propose a novel Sparse-Laplace hybrid graph manifold (SLHGM) model. This model integrates a hybrid Laplace norm-based graph manifold learning term, facilitating a trade-off between sparsity and preservation of morphological features. To address the non-convexity of the hybrid objective function, a fixed-point equation is designed, which employs two successive resolvent operators and a forward operator to find a converged solution.Main results.Through numerical simulations andin vivoexperiments, we demonstrate that the SLHGM model achieves an improved performance in providing accurate spatial localization while preserving morphological details.Significance.Our findings suggest that the SLHGM model has the potential to advance the application of FMT in biological research, not only in simulation but also inin vivostudies.
Collapse
Affiliation(s)
- Beilei Wang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Shuangchen Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Lizhi Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Jintao Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Jingjing Yu
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an 710062, People's Republic of China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China
- School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| |
Collapse
|
2
|
Zhao Y, Zhang L, Li J, Zhang H, Wei D, He X, Guo H. SSN: Monitoring liver injure through signal separation network in dynamic fluorescence molecular tomography. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-5. [PMID: 40040134 DOI: 10.1109/embc53108.2024.10782519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
Dynamic fluorescence molecular tomography (DFMT) is a promising molecular imaging technique that offers the potential to monitor fast kinetic behaviors within small animals in three dimensions. Early monitoring of liver disease requires the ability to distinguish and analyze normal and injured liver tissues. However, the inherent ill-posed nature of the problem and energy signal interference between the normal and injured liver regions limit the practical application of liver injury monitoring. In this paper, a novel Signal Separation Net (SSN) is proposed to distinguish normal and injured liver tissue for early liver injury monitoring and liver injury localization. By employing a Convolutional Long Short-Term Memory (ConvLSTM) model, SSN first separates the projections of liver injury from the surface photon distribution of DFMT. Then, a ResNet is employed to establish the nonlinear relationship between the liver injury projections and liver injury localization. Experimental findings underscore the viability of the proposed SSN in achieving promising performance in liver injury monitoring using DFMT, demonstrating significant potential for advancing early liver disease monitoring.
Collapse
|
3
|
Su SP, Yang YZ, Chiang HK. Development of an integrated dual-modality 3D bioluminescence tomography and ultrasound imaging system for small animal tumor imaging. OPTICS EXPRESS 2024; 32:5607-5620. [PMID: 38439282 DOI: 10.1364/oe.507659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 01/16/2024] [Indexed: 03/06/2024]
Abstract
Ultrasound (US) is a valuable tool for imaging soft tissue and visualizing tumor contours. Taking the benefits of US, we presented an integrated dual-modality imaging system in this paper that achieves three-dimensional (3D) bioluminescence tomography (BLT) with multi-view bioluminescence images and 3D US imaging. The purpose of this system is to perform non-invasive, long-term monitoring of tumor growth in 3D images. US images can enhance the accuracy of the 3D BLT reconstruction and the bioluminescence dose within an object. Furthermore, an integrated co-registered scanning geometry was used to capture the fused BLT and US images. We validated the system with an in vivo experiment involving tumor-bearing mice. The results demonstrated the feasibility of reconstructing 3D BLT images in the tumor region using 3D US images. We used the dice coefficient and locational error to evaluate the similarity between the reconstructed source region and the actual source region. The dice coefficient was 88.5%, and the locational error was 0.4 mm when comparing the BLT and 3D US images. The hybrid BLT/US system could provide significant benefits for reconstructing the source of tumor location and conducting quantitative analysis of tumor size.
Collapse
|
4
|
Zhang X, Jia Y, Cui J, Zhang J, Cao X, Zhang L, Zhang G. Two-stage deep learning method for sparse-view fluorescence molecular tomography reconstruction. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2023; 40:1359-1371. [PMID: 37706737 DOI: 10.1364/josaa.489702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 05/23/2023] [Indexed: 09/15/2023]
Abstract
Fluorescence molecular tomography (FMT) is a preclinical optical tomographic imaging technique that can trace various physiological and pathological processes at the cellular or even molecular level. Reducing the number of FMT projection views can improve the data acquisition speed, which is significant in applications such as dynamic problems. However, a reduction in the number of projection views will dramatically aggravate the ill-posedness of the FMT inverse problem and lead to significant degradation of the reconstructed images. To deal with this problem, we have proposed a deep-learning-based reconstruction method for sparse-view FMT that only uses four perpendicular projection views and divides the image reconstruction into two stages: image restoration and inverse Radon transform. In the first stage, the projection views of the surface fluorescence are restored to eliminate the blur derived from photon diffusion through a fully convolutional neural network. In the second stage, another convolutional neural network is used to implement the inverse Radon transform between the restored projections from the first stage and the reconstructed transverse slices. Numerical simulation and phantom and mouse experiments are carried out. The results show that the proposed method can effectively deal with the image reconstruction problem of sparse-view FMT.
Collapse
|
5
|
Yuan Y, Yi H, Kang D, Yu J, Guo H, He X, He X. Robust transformed l 1 metric for fluorescence molecular tomography. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 234:107503. [PMID: 37015182 DOI: 10.1016/j.cmpb.2023.107503] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Revised: 02/27/2023] [Accepted: 03/21/2023] [Indexed: 06/19/2023]
Abstract
BACKGROUND AND OBJECTIVE Fluorescence molecular tomography (FMT) is a non-invasive molecular imaging modality that can be used to observe the three-dimensional distribution of fluorescent probes in vivo. FMT is a promising imaging technique in clinical and preclinical research that has attracted significant attention. Numerous regularization based reconstruction algorithms have been proposed. However, traditional algorithms that use the squared l2-norm distance usually exaggerate the influence of noise and measurement and calculation errors, and their robustness cannot be guaranteed. METHODS In this study, we propose a novel robust transformed l1 (TL1) metric that interpolates l0 and l1 norms through a nonnegative parameter α∈(0,+∞). The TL1 metric looks like the lp-norm with p∈(0,1). These are markedly different because TL1 metric has two properties, boundedness and Lipschitz-continuity, which make the TL1 criterion suitable distance metric, particularly for robustness, owing to its stronger noise suppression. Subsequently, we apply the proposed metric to FMT and build a robust model to reduce the influence of noise. The nonconvexity of the proposed model made direct optimization difficult, and a continuous optimization method was developed to solve the model. The problem was converted into a difference in convex programming problem for the TL1 metric (DCATL1), and the corresponding algorithm converged linearly. RESULTS Various numerical simulations and in vivo bead-implanted mouse experiments were conducted to verify the performance of the proposed method. The experimental results show that the DCATL1 algorithm is more robust than the state-of-the-art approaches and achieves better source localization and morphology recovery. CONCLUSIONS The in vivo experiments showed that DCATL1 can be used to visualize the distribution of fluorescent probes inside biological tissues and promote preclinical application in small animals, demonstrating the feasibility and effectiveness of the proposed method.
Collapse
Affiliation(s)
- Yating Yuan
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China; School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Huangjian Yi
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China; School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Dizhen Kang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China; School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, 710119, China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China; School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Xuelei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China; School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China; School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China.
| |
Collapse
|
6
|
An Y, Wang H, Li J, Li G, Ma X, Du Y, Tian J. Reconstruction based on adaptive group least angle regression for fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2023; 14:2225-2239. [PMID: 37206151 PMCID: PMC10191665 DOI: 10.1364/boe.486451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 03/17/2023] [Accepted: 03/27/2023] [Indexed: 05/21/2023]
Abstract
Fluorescence molecular tomography can combine two-dimensional fluorescence imaging with anatomical information to reconstruct three-dimensional images of tumors. Reconstruction based on traditional regularization with tumor sparsity priors does not take into account that tumor cells form clusters, so it performs poorly when multiple light sources are used. Here we describe reconstruction based on an "adaptive group least angle regression elastic net" (AGLEN) method, in which local spatial structure correlation and group sparsity are integrated with elastic net regularization, followed by least angle regression. The AGLEN method works iteratively using the residual vector and a median smoothing strategy in order to adaptively obtain a robust local optimum. The method was verified using numerical simulations as well as imaging of mice bearing liver or melanoma tumors. AGLEN reconstruction performed better than state-of-the-art methods with different sizes of light sources at different distances from the sample and in the presence of Gaussian noise at 5-25%. In addition, AGLEN-based reconstruction accurately imaged tumor expression of cell death ligand-1, which can guide immunotherapy.
Collapse
Affiliation(s)
- Yu An
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Hanfan Wang
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Jiaqian Li
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Guanghui Li
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
| | - Xiaopeng Ma
- School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, China
| | - Yang Du
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Jie Tian
- the Key Laboratory of Big Data-Based Precision Medicine (Beihang University), Ministry of Industry and Information Technology of the People's Republic of China, School of Engineering Medicine, Beihang University, Beijing, 100191, China
- the CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| |
Collapse
|
7
|
Zhang P, Song F, Ma C, Liu Z, Wu H, Sun Y, Feng Y, He Y, Zhang G. Robust reconstruction of fluorescence molecular tomography based on adaptive adversarial learning strategy. Phys Med Biol 2023; 68. [PMID: 36696695 DOI: 10.1088/1361-6560/acb638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 01/25/2023] [Indexed: 01/26/2023]
Abstract
Objective.Fluorescence molecular tomography (FMT) is a promising molecular imaging modality for quantifying the three-dimensional (3D) distribution of tumor probes in small animals. However, traditional deep learning reconstruction methods that aim to minimize the mean squared error (MSE) and iterative regularization algorithms that rely on optimal parameters are typically influenced by strong noise, resulting in poor FMT reconstruction robustness.Approach.In this letter, we propose an adaptive adversarial learning strategy (3D-UR-WGAN) to achieve robust FMT reconstructions. Unlike the pixel-based MSE criterion in traditional CNNs or the regularization strategy in iterative solving schemes, the reconstruction strategy can greatly facilitate the performance of the network models through alternating loop training of the generator and the discriminator. Second, the reconstruction strategy combines the adversarial loss in GANs with the L1 loss to significantly enhance the robustness and preserve image details and textual information.Main results.Both numerical simulations and physical phantom experiments demonstrate that the 3D-UR-WGAN method can adaptively eliminate the effects of different noise levels on the reconstruction results, resulting in robust reconstructed images with reduced artifacts and enhanced image contrast. Compared with the state-of-the-art methods, the proposed method achieves better reconstruction performance in terms of target shape recovery and localization accuracy.Significance.This adaptive adversarial learning reconstruction strategy can provide a possible paradigm for robust reconstruction in complex environments, and also has great potential to provide an alternative solution for solving the problem of poor robustness encountered in other optical imaging modalities such as diffuse optical tomography, bioluminescence imaging, and Cherenkov luminescence imaging.
Collapse
Affiliation(s)
- Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Fan Song
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Chenbin Ma
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Zeyu Liu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Huijie Wu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Yangyang Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Youdan Feng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Yufang He
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| | - Guanglei Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, People's Republic of China
| |
Collapse
|
8
|
Zhang P, Ma C, Song F, Zhang T, Sun Y, Feng Y, He Y, Liu F, Wang D, Zhang G. D2-RecST: Dual-domain joint reconstruction strategy for fluorescence molecular tomography based on image domain and perception domain. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 229:107293. [PMID: 36481532 DOI: 10.1016/j.cmpb.2022.107293] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Revised: 10/05/2022] [Accepted: 10/10/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND AND OBJECTIVE Fluorescence molecular tomography (FMT) is a promising molecular imaging modality for quantifying the three-dimensional (3D) distribution of fluorescent probes in small animals. Over the past few years, learning-based FMT reconstruction methods have achieved promising results. However, these methods typically attempt to minimize the mean-squared error (MSE) between the reconstructed image and the ground truth. Although signal-to-noise ratios (SNRs) are improved, they are susceptible to non-uniform artifacts and loss of structural detail, making it extremely challenging to obtain accurate and robust FMT reconstructions under noisy measurements. METHODS We propose a novel dual-domain joint strategy based on the image domain and perception domain for accurate and robust FMT reconstruction. First, we formulate an explicit adversarial learning strategy in the image domain, which greatly facilitates training and optimization through two enhanced networks to improve anti-noise ability. Besides, we introduce a novel transfer learning strategy in the perceptual domain to optimize edge details by providing perceptual priors for fluorescent targets. Collectively, the proposed dual-domain joint reconstruction strategy can significantly eliminate the non-uniform artifacts and effectively preserve the structural edge details. RESULTS Both numerical simulations and in vivo mouse experiments demonstrate that the proposed method markedly outperforms traditional and cutting-edge methods in terms of positioning accuracy, image contrast, robustness, and target morphological recovery. CONCLUSIONS The proposed method achieves the best reconstruction performance and has great potential to facilitate precise localization and 3D visualization of tumors in in vivo animal experiments.
Collapse
Affiliation(s)
- Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Chenbin Ma
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Fan Song
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Tianyi Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Yangyang Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Youdan Feng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Yufang He
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Fei Liu
- Advanced information & Industrial Technology Research Institute, Beijing Information Science & Technology University, Beijing, 100192, China
| | - Daifa Wang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Guanglei Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China.
| |
Collapse
|
9
|
Zhang P, Ma C, Song F, Liu Z, Feng Y, Sun Y, He Y, Liu F, Wang D, Zhang G. Multi-branch attention prior based parameterized generative adversarial network for fast and accurate limited-projection reconstruction in fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2022; 13:5327-5343. [PMID: 36425627 PMCID: PMC9664898 DOI: 10.1364/boe.469505] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 09/05/2022] [Accepted: 09/06/2022] [Indexed: 06/16/2023]
Abstract
Limited-projection fluorescence molecular tomography (FMT) allows rapid reconstruction of the three-dimensional (3D) distribution of fluorescent targets within a shorter data acquisition time. However, the limited-projection FMT is severely ill-posed and ill-conditioned due to insufficient fluorescence measurements and the strong scattering properties of photons in biological tissues. Previously, regularization-based methods, combined with the sparse distribution of fluorescent sources, have been commonly used to alleviate the severe ill-posed nature of the limited-projection FMT. Due to the complex iterative computations, time-consuming solution procedures, and less stable reconstruction results, the limited-projection FMT remains an intractable challenge for achieving fast and accurate reconstructions. In this work, we completely discard the previous iterative solving-based reconstruction themes and propose multi-branch attention prior based parameterized generative adversarial network (MAP-PGAN) to achieve fast and accurate limited-projection FMT reconstruction. Firstly, the multi-branch attention can provide parameterized weighted sparse prior information for fluorescent sources, enabling MAP-PGAN to effectively mitigate the ill-posedness and significantly improve the reconstruction accuracy of limited-projection FMT. Secondly, since the end-to-end direct reconstruction strategy is adopted, the complex iterative computation process in traditional regularization algorithms can be avoided, thus greatly accelerating the 3D visualization process. The numerical simulation results show that the proposed MAP-PGAN method outperforms the state-of-the-art methods in terms of localization accuracy and morphological recovery. Meanwhile, the reconstruction time is only about 0.18s, which is about 100 to 1000 times faster than the conventional iteration-based regularization algorithms. The reconstruction results from the physical phantoms and in vivo experiments further demonstrate the feasibility and practicality of the MAP-PGAN method in achieving fast and accurate limited-projection FMT reconstruction.
Collapse
Affiliation(s)
- Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
- These authors contributed equally to this work
| | - Chenbin Ma
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
- Shenyuan Honors College, Beihang University, 100191, Beijing, China
- These authors contributed equally to this work
| | - Fan Song
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Zeyu Liu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Youdan Feng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Yangyang Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Yufang He
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Fei Liu
- Advanced Information & Industrial Technology Research Institute, Beijing Information Science & Technology University, Beijing, 100192, China
| | - Daifa Wang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| | - Guanglei Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering,
Beihang University, Beijing, 100191, China
| |
Collapse
|
10
|
Zhang P, Liu J, Yin L, An Y, Zhang S, Tong W, Hui H, Tian J. Adaptive permissible region based random Kaczmarz reconstruction method for localization of carotid atherosclerotic plaques in fluorescence molecular tomography. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac8718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 08/04/2022] [Indexed: 11/12/2022]
Abstract
Abstract
Objective. In this study, we propose the adaptive permissible region based random Kaczmarz method as an improved reconstruction method to recover small carotid atherosclerotic plaque targets in rodents with high resolution in fluorescence molecular tomography (FMT). Approach. We introduce the random Kaczmarz method as an advanced minimization method to solve the FMT inverse problem. To satisfy the special condition of this method, we proposed an adaptive permissible region strategy based on traditional permissible region methods to flexibly compress the dimension of the solution space. Main results. Monte Carlo simulations, phantom experiments, and in vivo experiments demonstrate that the proposed method can recover the small carotid atherosclerotic plaque targets with high resolution and accuracy, and can achieve lower root mean squared error and distance error (DE) than other traditional methods. For targets with 1.5 mm diameter and 0.5 mm separation, the DE indicators can be improved by up to 40%. Moreover, the proposed method can be utilized for in vivo locating atherosclerotic plaques with high accuracy and robustness. Significance. We applied the random Kaczmarz method to solve the inverse problem in FMT and improve the reconstruction result via this advanced minimization method. We verified that the FMT technology has a great potential to locate and quantify atherosclerotic plaques with higher accuracy, and can be expanded to more preclinical research.
Collapse
|
11
|
Zhang P, Ma C, Song F, Fan G, Sun Y, Feng Y, Ma X, Liu F, Zhang G. A review of advances in imaging methodology in fluorescence molecular tomography. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac5ce7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Accepted: 03/11/2022] [Indexed: 01/03/2023]
Abstract
Abstract
Objective. Fluorescence molecular tomography (FMT) is a promising non-invasive optical molecular imaging technology with strong specificity and sensitivity that has great potential for preclinical and clinical studies in tumor diagnosis, drug development and therapeutic evaluation. However, the strong scattering of photons and insufficient surface measurements make it very challenging to improve the quality of FMT image reconstruction and its practical application for early tumor detection. Therefore, continuous efforts have been made to explore more effective approaches or solutions in the pursuit of high-quality FMT reconstructions. Approach. This review takes a comprehensive overview of advances in imaging methodology for FMT, mainly focusing on two critical issues in FMT reconstructions: improving the accuracy of solving the forward physical model and mitigating the ill-posed nature of the inverse problem from a methodological point of view. More importantly, numerous impressive and practical strategies and methods for improving the quality of FMT reconstruction are summarized. Notably, deep learning methods are discussed in detail to illustrate their advantages in promoting the imaging performance of FMT thanks to large datasets, the emergence of optimized algorithms and the application of innovative networks. Main results. The results demonstrate that the imaging quality of FMT can be effectively promoted by improving the accuracy of optical parameter modeling, combined with prior knowledge, and reducing dimensionality. In addition, the traditional regularization-based methods and deep neural network-based methods, especially end-to-end deep networks, can enormously alleviate the ill-posedness of the inverse problem and improve the quality of FMT image reconstruction. Significance. This review aims to illustrate a variety of effective and practical methods for the reconstruction of FMT images that may benefit future research. Furthermore, it may provide some valuable research ideas and directions for FMT in the future, and could promote, to a certain extent, the development of FMT and other methods of optical tomography.
Collapse
|
12
|
Wang Y, Zhang H, Guo H, Wang B, Liu Y, He X, Yu J, Yi H, He X. Accurate and fast reconstruction for bioluminescence tomography based on adaptive Newton hard thresholding pursuit algorithm. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2022; 39:829-840. [PMID: 36215444 DOI: 10.1364/josaa.449917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 03/15/2022] [Indexed: 06/16/2023]
Abstract
As a promising noninvasive medical imaging technique, bioluminescence tomography (BLT) dynamically offers three-dimensional visualization of tumor distribution in living animals. However, due to the high ill-posedness caused by the strong scattering property of biological tissues and the limited boundary measurements with noise, BLT reconstruction still cannot meet actual preliminary clinical application requirements. In our research, to recover 3D tumor distribution quickly and precisely, an adaptive Newton hard thresholding pursuit (ANHTP) algorithm is proposed to improve the performance of BLT. The ANHTP algorithm fully combines the advantages of sparsity constrained optimization and convex optimization to guarantee global convergence. More precisely, an adaptive sparsity adjustment strategy was developed to obtain the support set of the inverse system matrix. Based on the strong Wolfe line search criterion, a modified damped Newton algorithm was constructed to obtain optimal source distribution information. A series of numerical simulations and phantom and in vivo experiments show that ANHTP has high reconstruction accuracy, fast reconstruction speed, and good robustness. Our proposed algorithm can further increase the practicality of BLT in biomedical applications.
Collapse
|
13
|
An Y, Bian C, Yan D, Wang H, Wang Y, Du Y, Tian J. A Fast and Automated FMT/XCT Reconstruction Strategy Based on Standardized Imaging Space. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:657-666. [PMID: 34648436 DOI: 10.1109/tmi.2021.3120011] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
The traditional finite element method-based fluorescence molecular tomography (FMT)/ X-ray computed tomography (XCT) imaging reconstruction suffers from complicated mesh generation and dual-modality image data fusion, which limits the application of in vivo imaging. To solve this problem, a novel standardized imaging space reconstruction (SISR) method for the quantitative determination of fluorescent probe distributions inside small animals was developed. In conjunction with a standardized dual-modality image data fusion technology, and novel reconstruction strategy based on Laplace regularization and L1-fused Lasso method, the in vivo distribution can be calculated rapidly and accurately, which enables standardized and algorithm-driven data process. We demonstrated the method's feasibility through numerical simulations and quantitatively monitored in vivo programmed death ligand 1 (PD-L1) expression in mouse tumor xenografts, and the results demonstrate that our proposed SISR can increase data throughput and reproducibility, which helps to realize the dynamically and accurately in vivo imaging.
Collapse
|
14
|
Zhang H, He X, Yu J, He X, Guo H, Hou Y. L1-L2 norm regularization via forward-backward splitting for fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:7807-7825. [PMID: 35003868 PMCID: PMC8713696 DOI: 10.1364/boe.435932] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 11/08/2021] [Accepted: 11/08/2021] [Indexed: 05/07/2023]
Abstract
Fluorescent molecular tomography (FMT) is a highly sensitive and noninvasive imaging approach for providing three-dimensional distribution of fluorescent marker probes. However, owing to its light scattering effect and the ill-posedness of inverse problems, it is challenging to develop an efficient reconstruction algorithm that can achieve the exact location and morphology of the fluorescence source. In this study, therefore, in order to satisfy the need for early tumor detection and improve the sparsity of solution, we proposed a novel L 1-L 2 norm regularization via the forward-backward splitting method for enhancing the FMT reconstruction accuracy and the robustness. By fully considering the highly coherent nature of the system matrix of FMT, it operates by splitting the objective to be minimized into simpler functions, which are dealt with individually to obtain a sparser solution. An analytic solution of L 1-L 2 norm proximal operators and a forward-backward splitting algorithm were employed to efficiently solve the nonconvex L 1-L 2 norm minimization problem. Numerical simulations and an in-vivo glioma mouse model experiment were conducted to evaluate the performance of our algorithm. The comparative results of these experiments demonstrated that the proposed algorithm obtained superior reconstruction performance in terms of spatial location, dual-source resolution, and in-vivo practicability. It was believed that this study would promote the preclinical and clinical applications of FMT in early tumor detection.
Collapse
Affiliation(s)
- Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an, 710062, China
| | - Xuelei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| | - Yuqing Hou
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, 710127, China
| |
Collapse
|
15
|
Zhang H, Guo H, Li S, Liu Y, He X, He X, Hou Y. L 1-L 2 Minimization Via A Proximal Operator For Fluorescence Molecular Tomography. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:3640-3645. [PMID: 34892026 DOI: 10.1109/embc46164.2021.9630236] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Fluorescent Molecular Tomography (FMT) is a highly sensitive and noninvasive imaging method that provides three-dimensional distribution of biomarkers by noninvasive detection of fluorescent marker probes. However, due to the light scattering effect and ill-posedness of inverse problems, it is challenging to develop an efficient construction method that can provide the exact location and morphology of the fluorescence distribution. In this paper, we proposed L1-L2 norm regularization to improve FMT reconstruction. In our research, proximal operators of non-convex L1 -L2 norm and forward-backward splitting method was adopted to solve the inverse problem of FMT. Simulation results on heterogeneous mouse model demonstrated that the proposed FBS method is superior to IVTCG, DCA and IRW-L1/2 reconstruction methods in location accuracy and other aspects.
Collapse
|
16
|
Zhang P, Fan G, Xing T, Song F, Zhang G. UHR-DeepFMT: Ultra-High Spatial Resolution Reconstruction of Fluorescence Molecular Tomography Based on 3-D Fusion Dual-Sampling Deep Neural Network. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3217-3228. [PMID: 33826514 DOI: 10.1109/tmi.2021.3071556] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Fluorescence molecular tomography (FMT) is a promising and high sensitivity imaging modality that can reconstruct the three-dimensional (3D) distribution of interior fluorescent sources. However, the spatial resolution of FMT has encountered an insurmountable bottleneck and cannot be substantially improved, due to the simplified forward model and the severely ill-posed inverse problem. In this work, a 3D fusion dual-sampling convolutional neural network, namely UHR-DeepFMT, was proposed to achieve ultra-high spatial resolution reconstruction of FMT. Under this framework, the UHR-DeepFMT does not need to explicitly solve the FMT forward and inverse problems. Instead, it directly establishes an end-to-end mapping model to reconstruct the fluorescent sources, which can enormously eliminate the modeling errors. Besides, a novel fusion mechanism that integrates the dual-sampling strategy and the squeeze-and-excitation (SE) module is introduced into the skip connection of UHR-DeepFMT, which can significantly improve the spatial resolution by greatly alleviating the ill-posedness of the inverse problem. To evaluate the performance of UHR-DeepFMT network model, numerical simulations, physical phantom and in vivo experiments were conducted. The results demonstrated that the proposed UHR-DeepFMT can outperform the cutting-edge methods and achieve ultra-high spatial resolution reconstruction of FMT with the powerful ability to distinguish adjacent targets with a minimal edge-to-edge distance (EED) of 0.5 mm. It is assumed that this research is a significant improvement for FMT in terms of spatial resolution and overall imaging quality, which could promote the precise diagnosis and preclinical application of small animals in the future.
Collapse
|
17
|
Yuan Y, Guo H, Yi H, Yu J, He X, He X. Correntropy-induced metric with Laplacian kernel for robust fluorescence molecular tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:5991-6012. [PMID: 34745717 PMCID: PMC8547984 DOI: 10.1364/boe.434679] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 08/08/2021] [Accepted: 08/22/2021] [Indexed: 06/13/2023]
Abstract
Fluorescence molecular tomography (FMT), which is used to visualize the three-dimensional distribution of fluorescence probe in small animals via the reconstruction method, has become a promising imaging technique in preclinical research. However, the classical reconstruction criterion is formulated based on the squared l 2-norm distance metric, leaving it prone to being influenced by the presence of outliers. In this study, we propose a robust distance based on the correntropy-induced metric with a Laplacian kernel (CIML). The proposed metric satisfies the conditions of distance metric function and contains first and higher order moments of samples. Moreover, we demonstrate important properties of the proposed metric such as nonnegativity, nonconvexity, and boundedness, and analyze its robustness from the perspective of M-estimation. The proposed metric includes and extends the traditional metrics such as l 0-norm and l 1-norm metrics by setting an appropriate parameter. We show that, in reconstruction, the metric is a sparsity-promoting penalty. To reduce the negative effects of noise and outliers, a novel robust reconstruction framework is presented with the proposed correntropy-based metric. The proposed CIML model retains the advantages of the traditional model and promotes robustness. However, the nonconvexity of the proposed metric renders the CIML model difficult to optimize. Furthermore, an effective iterative algorithm for the CIML model is designed, and we present a theoretical analysis of its ability to converge. Numerical simulation and in vivo mouse experiments were conducted to evaluate the CIML method's performance. The experimental results show that the proposed method achieved more accurate fluorescent target reconstruction than the state-of-the-art methods in most cases, which illustrates the feasibility and robustness of the CIML method.
Collapse
Affiliation(s)
- Yating Yuan
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| | - Hongbo Guo
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| | - Huangjian Yi
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi’an, 710119, China
| | - Xuelei He
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| | - Xiaowei He
- The Xi’an Key Laboratory of Radiomics and Intelligent Perception, Xi’an, China
- School of Information Sciences and Technology, Northwest University, Xi’an, 710127, China
| |
Collapse
|
18
|
Wang H, Bian C, Kong L, An Y, Du Y, Tian J. A Novel Adaptive Parameter Search Elastic Net Method for Fluorescent Molecular Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1484-1498. [PMID: 33556004 DOI: 10.1109/tmi.2021.3057704] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Fluorescence molecular tomography (FMT) is a new type of medical imaging technology that can quantitatively reconstruct the three-dimensional distribution of fluorescent probes in vivo. Traditional Lp norm regularization techniques used in FMT reconstruction often face problems such as over-sparseness, over-smoothness, spatial discontinuity, and poor robustness. To address these problems, this paper proposes an adaptive parameter search elastic net (APSEN) method that is based on elastic net regularization, using weight parameters to combine the L1 and L2 norms. For the selection of elastic net weight parameters, this approach introduces the L0 norm of valid reconstruction results and the L2 norm of the residual vector, which are used to adjust the weight parameters adaptively. To verify the proposed method, a series of numerical simulation experiments were performed using digital mice with tumors as experimental subjects, and in vivo experiments of liver tumors were also conducted. The results showed that, compared with the state-of-the-art methods with different light source sizes or distances, Gaussian noise of 5%-25%, and the brute-force parameter search method, the APSEN method has better location accuracy, spatial resolution, fluorescence yield recovery ability, morphological characteristics, and robustness. Furthermore, the in vivo experiments demonstrated the applicability of APSEN for FMT.
Collapse
|
19
|
Zhang P, Liu J, Hui H, An Y, Wang K, Yang X, Tian J. Linear scheme for the direct reconstruction of noncontact time-domain fluorescence molecular lifetime tomography. APPLIED OPTICS 2020; 59:7961-7967. [PMID: 32976471 DOI: 10.1364/ao.398967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2020] [Accepted: 08/07/2020] [Indexed: 06/11/2023]
Abstract
Direct reconstruction of the noncontact time-domain fluorescence molecular lifetime tomography (TD-FMLT) with current nonlinear algorithms has suffered from complexity and heavy computation loads of the physical model for a large imaging area in TD-FMLT. In this work, we discretize the system matrix along time points and apply a linearized reconstruction algorithm using the fused least absolute shrinkage and selection operator method. The reconstructed yield map and object geometry are used as a priori information to mitigate the ill conditions. This approach is implemented on a fully noncontact TD-FMLT system equipped with a femtosecond pulse laser and a high-speed, time-gated camera. We validate the methodology using both numerical simulations and inhomogeneous phantom experiments. The results exhibit good localization accuracy for fluorescent targets and an efficient computation capability for the reconstruction of fluorescence lifetime in noncontact TD-FMLT. We envision that the proposed linear scheme for the direct reconstruction method in noncontact TD-FMLT has a significant potential for in vivo preclinical studies.
Collapse
|
20
|
Gao P, Cheng K, Schüler E, Jia M, Zhao W, Xing L. Restarted primal-dual Newton conjugate gradient method for enhanced spatial resolution of reconstructed cone-beam x-ray luminescence computed tomography images. Phys Med Biol 2020; 65:135008. [PMID: 32268318 PMCID: PMC7594591 DOI: 10.1088/1361-6560/ab87fb] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Cone-beam x-ray luminescence computed tomography (CB-XLCT) has been proposed as a promising imaging tool, which enables three-dimensional imaging of the distribution of nanophosphors (NPs) in small animals. However, the reconstruction performance is usually unsatisfactory in terms of spatial resolution due to the ill-posedness of the CB-XLCT inverse problem. To alleviate this problem and to achieve high spatial resolution, a reconstruction method consisting of inner and outer iterations based on a restarted strategy is proposed. In this method, the primal-dual Newton conjugate gradient method (pdNCG) is adopted in the inner iterations to get fast reconstruction, which is used for resetting the permission region and increasing the convergence speed of the outer iteration. To assess the performance of the method, both numerical simulation and physical phantom experiments were conducted with a CB-XLCT system. The results demonstrate that compared with conventional reconstruction methods, the proposed re-pdNCG method can accurately and efficiently resolve the adjacent NPs with the least relative error.
Collapse
Affiliation(s)
- Peng Gao
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
- School of Biomedical Engineering, Fourth Military Medical University, Xi’an, Shaanxi 710032, People’s Republic of China
- These authors contributed to this work equally
| | - Kai Cheng
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
- These authors contributed to this work equally
| | - Emil Schüler
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| | - Mengyu Jia
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| | - Wei Zhao
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| | - Lei Xing
- Department of Radiation Oncology, Stanford University, Stanford, CA 94305, United States of America
| |
Collapse
|
21
|
Cai M, Zhang Z, Shi X, Hu Z, Tian J. NIR-II/NIR-I Fluorescence Molecular Tomography of Heterogeneous Mice Based on Gaussian Weighted Neighborhood Fused Lasso Method. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2213-2222. [PMID: 31976880 DOI: 10.1109/tmi.2020.2964853] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
Fluorescence molecular tomography (FMT), which can visualize the distribution of fluorescence biomarkers, has become a novel three-dimensional noninvasive imaging technique for in vivo studies such as tumor detection and lymph node location. However, it remains a challenging problem to achieve satisfactory reconstruction performance of conventional FMT in the first near-infrared window (NIR-I, 700-900nm) because of the severe scattering of NIR-I light. In this study, a promising FMT method for heterogeneous mice was proposed to improve the reconstruction accuracy using the second near-infrared window (NIR-II, 1000-1700nm), where the light scattering significantly reduced compared with NIR-I. The optical properties of NIR-II were analyzed to construct the forward model for NIR-II FMT. Furthermore, to raise the accuracy of solution of the inverse problem, we proposed a novel Gaussian weighted neighborhood fused Lasso (GWNFL) method. Numerical simulation was performed to demonstrate the outperformance of GWNFL compared with other algorithms. Besides, a novel NIR-II/NIR-I dual-modality FMT system was developed to contrast the in vivo reconstruction performance between NIR-II FMT and NIR-I FMT. To compare the reconstruction performance of NIR-II FMT with traditional NIR-I FMT, numerical simulations and in vivo experiments were conducted. Both the simulation and in vivo results showed that NIR-II FMT outperformed NIR-I FMT in terms of location accuracy and spatial overlap index. It is believed that this study could promote the development and biomedical application of NIR-II FMT in the future.
Collapse
|
22
|
Kong L, An Y, Liang Q, Yin L, Du Y, Tian J. Reconstruction for Fluorescence Molecular Tomography via Adaptive Group Orthogonal Matching Pursuit. IEEE Trans Biomed Eng 2020; 67:2518-2529. [PMID: 31905129 DOI: 10.1109/tbme.2019.2963815] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Fluorescence molecular tomography (FMT) is a promising medical imaging technology aimed at the non-invasive, specific, and sensitive detection of the distribution of fluorophore. Conventional sparsity prior-based methods of FMT commonly face problems such as over-sparseness, spatial discontinuity, and poor robustness, due to the neglect of the interrelation within the local subspace. To address this, we propose an adaptive group orthogonal matching pursuit (AGOMP) method. METHODS AGOMP is based on a novel local spatial-structured sparse regularization, which leverages local spatial interrelations as group sparsity without the hard prior of the tumor region. The adaptive grouped subspace matching pursuit method was adopted to enhance the interrelatedness of elements within a group, which alleviates the over-sparsity problem to some extent and improves the accuracy, robustness, and morphological similarity of FMT reconstruction. A series of numerical simulation experiments, based on digital mouse with both one and several tumors, were conducted, as well as in vivo mouse experiments. RESULTS The results demonstrated that the proposed AGOMP method achieved better location accuracy, fluorescent yield reconstruction, relative sparsity, and morphology than state-of-the-art methods under complex conditions for levels of Gaussian noise ranging from 5-25%. Furthermore, the in vivo mouse experiments demonstrated the practical application of FMT with AGOMP. CONCLUSION The proposed AGOMP can improve the accuracy and robustness for FMT reconstruction in biomedical application.
Collapse
|
23
|
An Y, Meng H, Gao Y, Tong T, Zhang C, Wang K, Tian J. Application of machine learning method in optical molecular imaging: a review. SCIENCE CHINA INFORMATION SCIENCES 2020; 63:111101. [DOI: 10.1007/s11432-019-2708-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Revised: 09/17/2019] [Accepted: 10/22/2019] [Indexed: 08/30/2023]
|
24
|
Yin L, Wang K, Tong T, An Y, Meng H, Yang X, Tian J. Improved Block Sparse Bayesian Learning Method Using K-Nearest Neighbor Strategy for Accurate Tumor Morphology Reconstruction in Bioluminescence Tomography. IEEE Trans Biomed Eng 2019; 67:2023-2032. [PMID: 31751214 DOI: 10.1109/tbme.2019.2953732] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
OBJECTIVE Bioluminescence tomography (BLT) is a non-invasive technique designed to enable three-dimensional (3D) visualization and quantification of viable tumor cells in living organisms. However, despite the excellent sensitivity and specificity of bioluminescence imaging (BLI), BLT is limited by the photon scattering effect and ill-posed inverse problem. If the complete structural information of a light source is considered when solving the inverse problem, reconstruction accuracy will be improved. METHODS This article proposed a block sparse Bayesian learning method based on K-nearest neighbor strategy (KNN-BSBL), which incorporated several types of a priori information including sparsity, spatial correlations among neighboring points, and anatomical information to balance over-sparsity and morphology preservation in BLT. Furthermore, we considered the Gaussian weighted distance prior in a light source and proposed a KNN-GBSBL method to further improve the performance of KNN-BSBL. RESULTS The results of numerical simulations and in vivo glioma-bearing mouse experiments demonstrated that KNN-BSBL and KNN-GBSBL achieved superior accuracy for tumor spatial positioning and morphology reconstruction. CONCLUSION The proposed method KNN-BSBL incorporated several types of a priori information is an efficient and robust reconstruction method for BLT.
Collapse
|
25
|
Mirbagheri M, Hakimi N, Ebrahimzadeh E, Pourrezaei K, Setarehdan SK. Enhancement of optical penetration depth of LED-based NIRS systems by comparing different beam profiles. Biomed Phys Eng Express 2019; 5:065004. [DOI: 10.1088/2057-1976/ab42d9] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
|
26
|
Jiang S, Liu J, An Y, Gao Y, Meng H, Wang K, Tian J. Fluorescence Molecular Tomography Based on Group Sparsity Priori for Morphological Reconstruction of Glioma. IEEE Trans Biomed Eng 2019; 67:1429-1437. [PMID: 31449004 DOI: 10.1109/tbme.2019.2937354] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Fluorescence molecular tomography (FMT) is an important tool for life science, which can noninvasive real-time three-dimensional (3-D) visualization for fluorescence source location. FMT is widely used in tumor research due to its high-sensitive and low cost. However, the reconstruction of FMT is difficult. Although the reconstruction methods of FMT have developed rapidly in recent years, the morphological reconstruction of FMT is still a challenge problem. Thus, the purpose of this study is to realize the morphological reconstruction performance of FMT in glioma research. METHODS In this study, group sparsity was used as a new priori information for FMT. Besides sparsity, group sparsity also takes the group structure of the fluorescent sources, which can maintain the morphological information of the sources. Fused LASSO method (FLM) was proved it can efficiently model the group sparsity prior. Thus, we utilize FLM to reconstruct the morphological information of glioma. Furthermore, to reduce the influence of the high scattering of skull, we modified the FLM for improving the accuracy of morphological reconstruction. RESULTS Glioma numerical simulation model and in vivo glioma model were established to evaluate the performance of morphological reconstruction of the proposed method. The results demonstrated that the proposed method was efficient to reconstruct the morphological information of glioma. CONCLUSION Group sparsity priori can effectively improve the morphological accuracy of FMT reconstruction. SIGNIFICANCE Group sparsity can maintain the morphological information of fluorescent sources effectively, which has great application potential in FMT. The group sparsity based methods can realize the morphological reconstruction, which is of great practical significance in tumor research.
Collapse
|