1
|
Han K, Li C, Xiao A, Tian Y, Tian J, Hu Z. TSPE: Reconstruction of multi-morphological tumors of NIR-II fluorescence molecular tomography based on positional encoding. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2025; 261:108554. [PMID: 39889498 DOI: 10.1016/j.cmpb.2024.108554] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/22/2024] [Revised: 11/25/2024] [Accepted: 12/04/2024] [Indexed: 02/03/2025]
Abstract
BACKGROUND AND OBJECTIVE Fluorescence molecular tomography (FMT) is a noninvasive and highly sensitive imaging modality, which can display 3D visualization of tumors by reconstructing fluorescence probes' distribution. However, existing methods mostly ignore positional information, which includes spatial structure information crucial for the reconstruction of light sources. This limits the reconstruction accuracy of light sources with multiple morphologies. Therefore, to our best knowledge, we for the first time integrated positional encoding into the FMT task, enabling the incorporation of high-frequency spatial structure information. METHODS We proposed a three-stage network embedded with a positional encoding module (TSPE) to perform high reconstruction accuracy of tumors with multiple morphologies. Additionally, our study focused on NIR-II which had less severe scattering problems and higher imaging accuracy than NIR-I. RESULTS The simulation experiments demonstrated that TSPE achieved high reconstruction accuracy in NIR-II FMT, with the barycenter error (BCE) for single-tumor reconstruction reaching 0.18 mm, representing a 14 % reduction compared to other methods. TSPE more accurately distinguished adjacent multi-morphological tumors with a minimal edge-to-edge distance (EED) of 0.3 mm. In vivo experiments also showed that TSPE could achieve more accurate reconstruction of tumors compared with other methods. CONCLUSIONS The proposed method can achieve the best reconstruction performance. It has potential to promote the development of NIR-II FMT and its preclinical application.
Collapse
Affiliation(s)
- Keyi Han
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Chunzhao Li
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing 100070, China; China National Clinical Research Center for Neurological Diseases, Beijing Tiantan Hospital, Beijing 100070, China
| | - Anqi Xiao
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yaqi Tian
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, 100050, China
| | - Jie Tian
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China; Beijing Advanced Innovation Center for Big Data-based Precision Medicine, School of Engineering Medicine, Beihang University, Beijing 100191, China; Enginering Research Center of Molecular and Neuro Imaging of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an 710071, China; National Key Laboratory of Kidney Diseases, Beijing, 100853, China.
| | - Zhenhua Hu
- CAS Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China; National Key Laboratory of Kidney Diseases, Beijing, 100853, China.
| |
Collapse
|
2
|
Cao X, Tang W, Gao H, Wang Y, Chen Y, Gao C, Zhao F, Su L. SODL-IR-FISTA: sparse online dictionary learning with iterative reduction FISTA for cone-beam X-ray luminescence computed tomography. BIOMEDICAL OPTICS EXPRESS 2024; 15:5162-5179. [PMID: 39296417 PMCID: PMC11407256 DOI: 10.1364/boe.531828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Revised: 08/02/2024] [Accepted: 08/03/2024] [Indexed: 09/21/2024]
Abstract
Cone beam X-ray luminescence computed tomography (CB-XLCT) is an emerging imaging technique with potential for early 3D tumor detection. However, the reconstruction challenge due to low light absorption and high scattering in tissues makes it a difficult inverse problem. In this study, the online dictionary learning (ODL) method, combined with iterative reduction FISTA (IR-FISTA), has been utilized to achieve high-quality reconstruction. Our method integrates IR-FISTA for efficient and accurate sparse coding, followed by an online stochastic approximation for dictionary updates, effectively capturing the sparse features inherent to the problem. Additionally, a re-sparse step is introduced to enhance the sparsity of the solution, making it better suited for CB-XLCT reconstruction. Numerical simulations and in vivo experiments were conducted to assess the performance of the method. The SODL-IR-FISTA achieved the smallest location error of 0.325 mm in in vivo experiments, which is 58% and 45% of the IVTCG-L 1 (0.562 mm) and OMP-L 0 (0.721 mm), respectively. Additionally, it has the highest DICE similarity coefficient, which is 0.748. The results demonstrate that our approach outperforms traditional methods in terms of localization precision, shape restoration, robustness, and practicality in live subjects.
Collapse
Affiliation(s)
- Xin Cao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Wenlong Tang
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Huimin Gao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Yifan Wang
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Yi Chen
- School of Electrical and Mechanical Engineering, The University of Adelaide, Adelaide SA 5005, Australia
| | - Chengyi Gao
- Department of Oncology, The First Affiliated Hospital, Xi'an Jiaotong University, Xi'an, Shaanxi 710061, China
| | - Fengjun Zhao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| | - Linzhi Su
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, China
| |
Collapse
|
3
|
Sun W, Zhang L, Xing L, He Z, Zhang Y, Gao F. Projected algebraic reconstruction technique-network for high-fidelity diffuse fluorescence tomography reconstruction. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:988-999. [PMID: 38856406 DOI: 10.1364/josaa.517742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 04/01/2024] [Indexed: 06/11/2024]
Abstract
We propose a model-driven projected algebraic reconstruction technique (PART)-network (PART-Net) that leverages the advantages of the traditional model-based method and the neural network to improve the imaging quality of diffuse fluorescence tomography. In this algorithm, nonnegative prior information is incorporated into the ART iteration process to better guide the optimization process, and thereby improve imaging quality. On this basis, PART in conjunction with a residual convolutional neural network is further proposed to obtain high-fidelity image reconstruction. The numerical simulation results demonstrate that the PART-Net algorithm effectively improves noise robustness and reconstruction accuracy by at least 1-2 times and exhibits superiority in spatial resolution and quantification, especially for a small-sized target (r=2m m), compared with the traditional ART algorithm. Furthermore, the phantom and in vivo experiments verify the effectiveness of the PART-Net, suggesting strong generalization capability and a great potential for practical applications.
Collapse
|
4
|
Cheng X, Sun S, Xiao Y, Li W, Li J, Yu J, Guo H. Fluorescence molecular tomography based on an online maximum a posteriori estimation algorithm. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:844-851. [PMID: 38856571 DOI: 10.1364/josaa.519667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Accepted: 03/25/2024] [Indexed: 06/11/2024]
Abstract
Fluorescence molecular tomography (FMT) is a non-invasive, radiation-free, and highly sensitive optical molecular imaging technique for early tumor detection. However, inadequate measurement information along with significant scattering of near-infrared light within the tissue leads to high ill-posedness in the inverse problem of FMT. To improve the quality and efficiency of FMT reconstruction, we build a reconstruction model based on log-sum regularization and introduce an online maximum a posteriori estimation (OPE) algorithm to solve the non-convex optimization problem. The OPE algorithm approximates a stationary point by evaluating the gradient of the objective function at each iteration, and its notable strength lies in the remarkable speed of convergence. The results of simulations and experiments demonstrate that the OPE algorithm ensures good reconstruction quality and exhibits outstanding performance in terms of reconstruction efficiency.
Collapse
|
5
|
Gao P, Pu H, Liu T, Cao Y, Li W, Huang S, Li R, Lu H, Rong J. Automated Restarting Fast Proximal Gradient Descent Method for Single-View Cone-Beam X-ray Luminescence Computed Tomography Based on Depth Compensation. Bioengineering (Basel) 2024; 11:123. [PMID: 38391609 PMCID: PMC10885960 DOI: 10.3390/bioengineering11020123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 01/23/2024] [Accepted: 01/25/2024] [Indexed: 02/24/2024] Open
Abstract
Single-view cone-beam X-ray luminescence computed tomography (CB-XLCT) has recently gained attention as a highly promising imaging technique that allows for the efficient and rapid three-dimensional visualization of nanophosphor (NP) distributions in small animals. However, the reconstruction performance is hindered by the ill-posed nature of the inverse problem and the effects of depth variation as only a single view is acquired. To tackle this issue, we present a methodology that integrates an automated restarting strategy with depth compensation to achieve reconstruction. The present study employs a fast proximal gradient descent (FPGD) method, incorporating L0 norm regularization, to achieve efficient reconstruction with accelerated convergence. The proposed approach offers the benefit of retrieving neighboring multitarget distributions without the need for CT priors. Additionally, the automated restarting strategy ensures reliable reconstructions without the need for manual intervention. Numerical simulations and physical phantom experiments were conducted using a custom CB-XLCT system to demonstrate the accuracy of the proposed method in resolving adjacent NPs. The results showed that this method had the lowest relative error compared to other few-view techniques. This study signifies a significant progression in the development of practical single-view CB-XLCT for high-resolution 3-D biomedical imaging.
Collapse
Affiliation(s)
- Peng Gao
- School of Biomedical Engineering, Air Force Medical University, Xi’an 710032, China; (P.G.); (T.L.); (Y.C.); (W.L.); (S.H.); (R.L.)
| | - Huangsheng Pu
- College of Advanced Interdisciplinary Studies & Hunan Provincial Key Laboratory of Novel NanoOptoelectronic Information Materials and Devices, National University of Defense Technology, Changsha 410073, China;
- Nanhu Laser Laboratory, National University of Defense Technology, Changsha 410073, China
| | - Tianshuai Liu
- School of Biomedical Engineering, Air Force Medical University, Xi’an 710032, China; (P.G.); (T.L.); (Y.C.); (W.L.); (S.H.); (R.L.)
| | - Yilin Cao
- School of Biomedical Engineering, Air Force Medical University, Xi’an 710032, China; (P.G.); (T.L.); (Y.C.); (W.L.); (S.H.); (R.L.)
| | - Wangyang Li
- School of Biomedical Engineering, Air Force Medical University, Xi’an 710032, China; (P.G.); (T.L.); (Y.C.); (W.L.); (S.H.); (R.L.)
| | - Shien Huang
- School of Biomedical Engineering, Air Force Medical University, Xi’an 710032, China; (P.G.); (T.L.); (Y.C.); (W.L.); (S.H.); (R.L.)
| | - Ruijing Li
- School of Biomedical Engineering, Air Force Medical University, Xi’an 710032, China; (P.G.); (T.L.); (Y.C.); (W.L.); (S.H.); (R.L.)
| | - Hongbing Lu
- School of Biomedical Engineering, Air Force Medical University, Xi’an 710032, China; (P.G.); (T.L.); (Y.C.); (W.L.); (S.H.); (R.L.)
| | - Junyan Rong
- School of Biomedical Engineering, Air Force Medical University, Xi’an 710032, China; (P.G.); (T.L.); (Y.C.); (W.L.); (S.H.); (R.L.)
| |
Collapse
|
6
|
Zhang J, Zhang G, Chen Y, Li K, Zhao F, Yi H, Su L, Cao X. Regularized reconstruction based on joint smoothly clipped absolute deviation regularization and graph manifold learning for fluorescence molecular tomography. Phys Med Biol 2023; 68:195004. [PMID: 37647921 DOI: 10.1088/1361-6560/acf55a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 08/30/2023] [Indexed: 09/01/2023]
Abstract
Objective.Fluorescence molecular tomography (FMT) is an optical imaging modality that provides high sensitivity and low cost, which can offer the three-dimensional distribution of biomarkers by detecting the fluorescently labeled probe noninvasively. In the field of preclinical cancer diagnosis and treatment, FMT has gained significant traction. Nonetheless, the current FMT reconstruction results suffer from unsatisfactory morphology and location accuracy of the fluorescence distribution, primarily due to the light scattering effect and the ill-posed nature of the inverse problem.Approach.To address these challenges, a regularized reconstruction method based on joint smoothly clipped absolute deviation regularization and graph manifold learning (SCAD-GML) for FMT is presented in this paper. The SCAD-GML approach combines the sparsity of the fluorescent sources with the latent manifold structure of fluorescent source distribution to achieve more accurate and sparse reconstruction results. To obtain the reconstruction results efficiently, the non-convex gradient descent iterative method is employed to solve the established objective function. To assess the performance of the proposed SCAD-GML method, a comprehensive evaluation is conducted through numerical simulation experiments as well asin vivoexperiments.Main results.The results demonstrate that the SCAD-GML method outperforms other methods in terms of both location and shape recovery of fluorescence biomarkers distribution.Siginificance.These findings indicate that the SCAD-GML method has the potential to advance the application of FMT inin vivobiological research.
Collapse
Affiliation(s)
- Jun Zhang
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Gege Zhang
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Yi Chen
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Kang Li
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Fengjun Zhao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
| | - Huangjian Yi
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
| | - Linzhi Su
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| | - Xin Cao
- School of Information Science and Technology, Northwest University, Xi'an, Shaanxi 710127, People's Republic of China
- National and Local Joint Engineering Research Center for Cultural Heritage Digitization, Xi'an, Shaanxi 710127, People's Republic of China
| |
Collapse
|
7
|
Chen Y, Du M, Zhang G, Zhang J, Li K, Su L, Zhao F, Yi H, Cao X. Sparse reconstruction based on dictionary learning and group structure strategy for cone-beam X-ray luminescence computed tomography. OPTICS EXPRESS 2023; 31:24845-24861. [PMID: 37475302 DOI: 10.1364/oe.493797] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Accepted: 06/13/2023] [Indexed: 07/22/2023]
Abstract
As a dual-modal imaging technology that has emerged in recent years, cone-beam X-ray luminescence computed tomography (CB-XLCT) has exhibited promise as a tool for the early three-dimensional detection of tumors in small animals. However, due to the challenges imposed by the low absorption and high scattering of light in tissues, the CB-XLCT reconstruction problem is a severely ill-conditioned inverse problem, rendering it difficult to obtain satisfactory reconstruction results. In this study, a strategy that utilizes dictionary learning and group structure (DLGS) is proposed to achieve satisfactory CB-XLCT reconstruction performance. The group structure is employed to account for the clustering of nanophosphors in specific regions within the organism, which can enhance the interrelation of elements in the same group. Furthermore, the dictionary learning strategy is implemented to effectively capture sparse features. The performance of the proposed method was evaluated through numerical simulations and in vivo experiments. The experimental results demonstrate that the proposed method achieves superior reconstruction performance in terms of location accuracy, target shape, robustness, dual-source resolution, and in vivo practicability.
Collapse
|
8
|
Chen Y, Du M, Zhang J, Zhang G, Su L, Li K, Zhao F, Yi H, Wang L, Cao X. Generalized conditional gradient method with adaptive regularization parameters for fluorescence molecular tomography. OPTICS EXPRESS 2023; 31:18128-18146. [PMID: 37381530 DOI: 10.1364/oe.486339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 04/08/2023] [Indexed: 06/30/2023]
Abstract
Fluorescence molecular tomography (FMT) is an optical imaging technology with the ability of visualizing the three-dimensional distribution of fluorescently labelled probes in vivo. However, due to the light scattering effect and ill-posed inverse problems, obtaining satisfactory FMT reconstruction is still a challenging problem. In this work, to improve the performance of FMT reconstruction, we proposed a generalized conditional gradient method with adaptive regularization parameters (GCGM-ARP). In order to make a tradeoff between the sparsity and shape preservation of the reconstruction source, and to maintain its robustness, elastic-net (EN) regularization is introduced. EN regularization combines the advantages of L1-norm and L2-norm, and overcomes the shortcomings of traditional Lp-norm regularization, such as over-sparsity, over-smoothness, and non-robustness. Thus, the equivalent optimization formulation of the original problem can be obtained. To further improve the performance of the reconstruction, the L-curve is adopted to adaptively adjust the regularization parameters. Then, the generalized conditional gradient method (GCGM) is used to split the minimization problem based on EN regularization into two simpler sub-problems, which are determining the direction of the gradient and the step size. These sub-problems are addressed efficiently to obtain more sparse solutions. To assess the performance of our proposed method, a series of numerical simulation experiments and in vivo experiments were implemented. The experimental results show that, compared with other mathematical reconstruction methods, GCGM-ARP method has the minimum location error (LE) and relative intensity error (RIE), and the maximum dice coefficient (Dice) in the case of different sources number or shape, or Gaussian noise of 5%-25%. This indicates that GCGM-ARP has superior reconstruction performance in source localization, dual-source resolution, morphology recovery, and robustness. In conclusion, the proposed GCGM-ARP is an effective and robust strategy for FMT reconstruction in biomedical application.
Collapse
|
9
|
Li J, Zhang L, Liu J, Zhang D, Kang D, Wang B, He X, Zhang H, Zhao Y, Guo H, Hou Y. An adaptive parameter selection strategy based on maximizing the probability of data for robust fluorescence molecular tomography reconstruction. JOURNAL OF BIOPHOTONICS 2023:e202300031. [PMID: 37074336 DOI: 10.1002/jbio.202300031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 03/20/2023] [Accepted: 04/14/2023] [Indexed: 05/03/2023]
Abstract
To alleviate the ill-posed of the inverse problem in fluorescent molecular tomography (FMT), many regularization methods based on L2 or L1 norm have been proposed. Whereas, the quality of regularization parameters affects the performance of the reconstruction algorithm. Some classical parameter selection strategies usually need initialization of parameter range and high computing costs, which is not universal in the practical application of FMT. In this paper, an universally applicable adaptive parameter selection method based on maximizing the probability of data (MPD) strategy was proposed. This strategy used maximum a posteriori (MAP) estimation and maximum likelihood (ML) estimation to establish a regularization parameters model. The stable optimal regularization parameters can be determined by multiple iterative estimates. Numerical simulations and in vivo experiments show that MPD strategy can obtain stable regularization parameters for both regularization algorithms based on L2 or L1 norm and achieve good reconstruction performance.
Collapse
Affiliation(s)
- Jintao Li
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Lizhi Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Jia Liu
- Xi'an Company of Shaanxi Tobacco Company, The Information Center, Xi'an, China
| | - Diya Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Dizhen Kang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Beilei Wang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Heng Zhang
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Yizhe Zhao
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Yuqing Hou
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, China
- School of Information Sciences and Technology, Northwest University, Xi'an, China
| |
Collapse
|
10
|
Zhang P, Ma C, Song F, Zhang T, Sun Y, Feng Y, He Y, Liu F, Wang D, Zhang G. D2-RecST: Dual-domain joint reconstruction strategy for fluorescence molecular tomography based on image domain and perception domain. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 229:107293. [PMID: 36481532 DOI: 10.1016/j.cmpb.2022.107293] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2022] [Revised: 10/05/2022] [Accepted: 10/10/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND AND OBJECTIVE Fluorescence molecular tomography (FMT) is a promising molecular imaging modality for quantifying the three-dimensional (3D) distribution of fluorescent probes in small animals. Over the past few years, learning-based FMT reconstruction methods have achieved promising results. However, these methods typically attempt to minimize the mean-squared error (MSE) between the reconstructed image and the ground truth. Although signal-to-noise ratios (SNRs) are improved, they are susceptible to non-uniform artifacts and loss of structural detail, making it extremely challenging to obtain accurate and robust FMT reconstructions under noisy measurements. METHODS We propose a novel dual-domain joint strategy based on the image domain and perception domain for accurate and robust FMT reconstruction. First, we formulate an explicit adversarial learning strategy in the image domain, which greatly facilitates training and optimization through two enhanced networks to improve anti-noise ability. Besides, we introduce a novel transfer learning strategy in the perceptual domain to optimize edge details by providing perceptual priors for fluorescent targets. Collectively, the proposed dual-domain joint reconstruction strategy can significantly eliminate the non-uniform artifacts and effectively preserve the structural edge details. RESULTS Both numerical simulations and in vivo mouse experiments demonstrate that the proposed method markedly outperforms traditional and cutting-edge methods in terms of positioning accuracy, image contrast, robustness, and target morphological recovery. CONCLUSIONS The proposed method achieves the best reconstruction performance and has great potential to facilitate precise localization and 3D visualization of tumors in in vivo animal experiments.
Collapse
Affiliation(s)
- Peng Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Chenbin Ma
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Fan Song
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Tianyi Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Yangyang Sun
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Youdan Feng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Yufang He
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Fei Liu
- Advanced information & Industrial Technology Research Institute, Beijing Information Science & Technology University, Beijing, 100192, China
| | - Daifa Wang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
| | - Guanglei Zhang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China.
| |
Collapse
|
11
|
Liu F, Zhang P, Liu Z, Song F, Ma C, Sun Y, Feng Y, He Y, Zhang G. In vivo accurate detection of the liver tumor with pharmacokinetic parametric images from dynamic fluorescence molecular tomography. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:070501. [PMID: 35810324 PMCID: PMC9270690 DOI: 10.1117/1.jbo.27.7.070501] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Accepted: 06/28/2022] [Indexed: 06/15/2023]
Abstract
SIGNIFICANCE Pharmacokinetic parametric images in dynamic fluorescence molecular tomography (FMT) can describe three-dimensional (3D) physiological and pathological information inside biological tissues, potentially providing quantitative assessment tools for biological research and drug development. AIM In vivo imaging of the liver tumor with pharmacokinetic parametric images from dynamic FMT based on the differences in metabolic properties of indocyanine green (ICG) between normal liver cells and tumor liver cells inside biological tissues. APPROACH First, an orthotopic liver tumor mouse model was constructed. Then, with the help of the FMT/computer tomography (CT) dual-modality imaging system and the direct reconstruction algorithm, 3D imaging of liver metabolic parameters in nude mice was achieved to distinguish liver tumors from normal tissues. Finally, pharmacokinetic parametric imaging results were validated against in vitro anatomical results. RESULTS This letter demonstrates the ability of dynamic FMT to monitor the pharmacokinetic delivery of the fluorescent dye ICG in vivo, thus, enabling the distinction between normal and tumor tissues based on the pharmacokinetic parametric images derived from dynamic FMT. CONCLUSIONS Compared with CT structural imaging technology, dynamic FMT combined with compartmental modeling as an analytical method can obtain quantitative images of pharmacokinetic parameters, thus providing a more powerful research tool for organ function assessment, disease diagnosis and new drug development.
Collapse
Affiliation(s)
- Fei Liu
- Beijing Information Science & Technology University, Advanced Information and Industrial Technology Research Institute, Beijing, China
| | - Peng Zhang
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Zeyu Liu
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Fan Song
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Chenbin Ma
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Yangyang Sun
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Youdan Feng
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Yufang He
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| | - Guanglei Zhang
- Beihang University, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beijing, China
| |
Collapse
|
12
|
Zhao J, Guo H, Yu J, Yi H, Hou Y, He X. A robust elastic net- ℓ1ℓ2reconstruction method for x-ray luminescence computed tomography. Phys Med Biol 2021; 66. [PMID: 34492648 DOI: 10.1088/1361-6560/ac246f] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Accepted: 09/07/2021] [Indexed: 11/12/2022]
Abstract
Objective. X-ray luminescence computed tomography (XLCT) has played a crucial role in pre-clinical research and effective diagnosis of disease. However, due to the ill-posed of the XLCT inverse problem, the generalization of reconstruction methods and the selection of appropriate regularization parameters are still challenging in practical applications. In this research, an robust Elastic net-ℓ1ℓ2reconstruction method is proposed aiming to the challenge.Approach. Firstly, our approach consists of ℓ1and ℓ2regularization to enhance the sparsity and suppress the smoothness. Secondly, through optimal approximation of the optimization problem, double modification of Landweber algorithm is adopted to solve the Elastic net-ℓ1ℓ2regulazation. Thirdly, drawing on the ideal of supervised learning, multi-parameter K-fold cross validation strategy is proposed to determin the optimal parameters adaptively.Main results. To evaluate the performance of the Elastic net-ℓ1ℓ2method, numerical simulations, phantom and in vivo experiments were conducted. In these experiments, the Elastic net-ℓ1ℓ2method achieved the minimum reconstruction error (with smallest location error, fluorescent yield relative error, normalized root-mean-square error) and the best image reconstruction quality (with largest contrast-to-noise ratio and Dice similarity) among all methods. The results demonstrated that Elastic net-ℓ1ℓ2can obtain superior reconstruction performance in terms of location accuracy, dual source resolution, robustness and in vivo practicability.Significance. It is believed that this study will further benefit preclinical applications with a view to provide a more reliable reference for the later researches on XLCT.
Collapse
Affiliation(s)
- Jingwen Zhao
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China.,Network and Data Center, Northwest University, Xi'an 710127, People's Republic of China
| | - Hongbo Guo
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China.,School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Jingjing Yu
- School of Physics and Information Technology, Shaanxi Normal University, Xi'an 710119, People's Republic of China
| | - Huangjian Yi
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China.,School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Yuqing Hou
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China.,School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| | - Xiaowei He
- The Xi'an Key Laboratory of Radiomics and Intelligent Perception, Xi'an, People's Republic of China.,Network and Data Center, Northwest University, Xi'an 710127, People's Republic of China.,School of Information Sciences and Technology, Northwest University, Xi'an 710127, People's Republic of China
| |
Collapse
|
13
|
Wang H, Bian C, Kong L, An Y, Du Y, Tian J. A Novel Adaptive Parameter Search Elastic Net Method for Fluorescent Molecular Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1484-1498. [PMID: 33556004 DOI: 10.1109/tmi.2021.3057704] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Fluorescence molecular tomography (FMT) is a new type of medical imaging technology that can quantitatively reconstruct the three-dimensional distribution of fluorescent probes in vivo. Traditional Lp norm regularization techniques used in FMT reconstruction often face problems such as over-sparseness, over-smoothness, spatial discontinuity, and poor robustness. To address these problems, this paper proposes an adaptive parameter search elastic net (APSEN) method that is based on elastic net regularization, using weight parameters to combine the L1 and L2 norms. For the selection of elastic net weight parameters, this approach introduces the L0 norm of valid reconstruction results and the L2 norm of the residual vector, which are used to adjust the weight parameters adaptively. To verify the proposed method, a series of numerical simulation experiments were performed using digital mice with tumors as experimental subjects, and in vivo experiments of liver tumors were also conducted. The results showed that, compared with the state-of-the-art methods with different light source sizes or distances, Gaussian noise of 5%-25%, and the brute-force parameter search method, the APSEN method has better location accuracy, spatial resolution, fluorescence yield recovery ability, morphological characteristics, and robustness. Furthermore, the in vivo experiments demonstrated the applicability of APSEN for FMT.
Collapse
|
14
|
Meng H, Gao Y, Yang X, Wang K, Tian J. K-Nearest Neighbor Based Locally Connected Network for Fast Morphological Reconstruction in Fluorescence Molecular Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:3019-3028. [PMID: 32286961 DOI: 10.1109/tmi.2020.2984557] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Fluorescence molecular tomography (FMT) is a highly sensitive and noninvasive imaging modality for three-dimensional visualization of fluorescence probe distribution in small animals. However, the simplified photon propagation model and ill-posed inverse problem limit the improvement of FMT reconstruction. In this work, we proposed a novel K-nearest neighbor based locally connected (KNN-LC) network to improve the performance of morphological reconstruction in FMT. It directly builds the inverse process of photon transmission by learning the mapping relation between the surface photon intensity and the distribution of fluorescent source. KNN-LC network cascades a fully connected (FC) sub-network with a locally connected (LC) sub-network, where the FC part provides a coarse reconstruction result and LC part fine-tunes the morphological quality of reconstructed result. To assess the performance of our proposed network, we implemented both numerical simulation and in vivo studies. Furthermore, split Bregman-resolved total variation (SBRTV) regularization method and inverse problem simulation (IPS) method were utilized as baselines in all comparisons. The results demonstrated that KNN-LC network achieved accurate reconstruction in both source localization and morphology recovery in a short time. This promoted the in vivo application of FMT for visualizing the distribution of biomarkers inside biological tissue.
Collapse
|
15
|
Cai M, Zhang Z, Shi X, Hu Z, Tian J. NIR-II/NIR-I Fluorescence Molecular Tomography of Heterogeneous Mice Based on Gaussian Weighted Neighborhood Fused Lasso Method. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2213-2222. [PMID: 31976880 DOI: 10.1109/tmi.2020.2964853] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
Fluorescence molecular tomography (FMT), which can visualize the distribution of fluorescence biomarkers, has become a novel three-dimensional noninvasive imaging technique for in vivo studies such as tumor detection and lymph node location. However, it remains a challenging problem to achieve satisfactory reconstruction performance of conventional FMT in the first near-infrared window (NIR-I, 700-900nm) because of the severe scattering of NIR-I light. In this study, a promising FMT method for heterogeneous mice was proposed to improve the reconstruction accuracy using the second near-infrared window (NIR-II, 1000-1700nm), where the light scattering significantly reduced compared with NIR-I. The optical properties of NIR-II were analyzed to construct the forward model for NIR-II FMT. Furthermore, to raise the accuracy of solution of the inverse problem, we proposed a novel Gaussian weighted neighborhood fused Lasso (GWNFL) method. Numerical simulation was performed to demonstrate the outperformance of GWNFL compared with other algorithms. Besides, a novel NIR-II/NIR-I dual-modality FMT system was developed to contrast the in vivo reconstruction performance between NIR-II FMT and NIR-I FMT. To compare the reconstruction performance of NIR-II FMT with traditional NIR-I FMT, numerical simulations and in vivo experiments were conducted. Both the simulation and in vivo results showed that NIR-II FMT outperformed NIR-I FMT in terms of location accuracy and spatial overlap index. It is believed that this study could promote the development and biomedical application of NIR-II FMT in the future.
Collapse
|
16
|
Kong L, An Y, Liang Q, Yin L, Du Y, Tian J. Reconstruction for Fluorescence Molecular Tomography via Adaptive Group Orthogonal Matching Pursuit. IEEE Trans Biomed Eng 2020; 67:2518-2529. [PMID: 31905129 DOI: 10.1109/tbme.2019.2963815] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Fluorescence molecular tomography (FMT) is a promising medical imaging technology aimed at the non-invasive, specific, and sensitive detection of the distribution of fluorophore. Conventional sparsity prior-based methods of FMT commonly face problems such as over-sparseness, spatial discontinuity, and poor robustness, due to the neglect of the interrelation within the local subspace. To address this, we propose an adaptive group orthogonal matching pursuit (AGOMP) method. METHODS AGOMP is based on a novel local spatial-structured sparse regularization, which leverages local spatial interrelations as group sparsity without the hard prior of the tumor region. The adaptive grouped subspace matching pursuit method was adopted to enhance the interrelatedness of elements within a group, which alleviates the over-sparsity problem to some extent and improves the accuracy, robustness, and morphological similarity of FMT reconstruction. A series of numerical simulation experiments, based on digital mouse with both one and several tumors, were conducted, as well as in vivo mouse experiments. RESULTS The results demonstrated that the proposed AGOMP method achieved better location accuracy, fluorescent yield reconstruction, relative sparsity, and morphology than state-of-the-art methods under complex conditions for levels of Gaussian noise ranging from 5-25%. Furthermore, the in vivo mouse experiments demonstrated the practical application of FMT with AGOMP. CONCLUSION The proposed AGOMP can improve the accuracy and robustness for FMT reconstruction in biomedical application.
Collapse
|
17
|
Meng H, Wang K, Gao Y, Jin Y, Ma X, Tian J. Adaptive Gaussian Weighted Laplace Prior Regularization Enables Accurate Morphological Reconstruction in Fluorescence Molecular Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2726-2734. [PMID: 31021763 DOI: 10.1109/tmi.2019.2912222] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Fluorescence molecular tomography (FMT), as a powerful imaging technique in preclinical research, can offer the three-dimensional distribution of biomarkers by detecting the fluorescently labelled probe noninvasively. However, because of the light scattering effect and the ill-pose of inverse problem, it is challenging to develop an efficient reconstruction method, which can provide accurate location and morphology of the fluorescence distribution. In this research, we proposed a novel adaptive Gaussian weighted Laplace prior (AGWLP) regularization method, which assumed the variance of fluorescence intensity between any two voxels had a non-linear correlation with their Gaussian distance. It utilized an adaptive Gaussian kernel parameter strategy to achieve accurate morphological reconstructions in FMT. To evaluate the performance of the AGWLP method, we conducted numerical simulation and in vivo experiments. The results were compared with fast iterative shrinkage (FIS) thresholding method, split Bregman-resolved TV (SBRTV) regularization method, and Gaussian weighted Laplace prior (GWLP) regularization method. We validated in vivo imaging results against planar fluorescence images of frozen sections. The results demonstrated that the AGWLP method achieved superior performance in both location and shape recovery of fluorescence distribution. This enabled FMT more suitable and practical for in vivo visualization of biomarkers.
Collapse
|
18
|
Huang W, Wang K, An Y, Meng H, Gao Y, Xiong Z, Yan H, Wang Q, Cai X, Yang X, Zhang B, Chen Q, Yang X, Tian J, Zhang S. In vivo three-dimensional evaluation of tumour hypoxia in nasopharyngeal carcinomas using FMT-CT and MSOT. Eur J Nucl Med Mol Imaging 2019; 47:1027-1038. [PMID: 31705175 PMCID: PMC7101302 DOI: 10.1007/s00259-019-04526-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Accepted: 09/05/2019] [Indexed: 11/26/2022]
Abstract
Purpose Accurate evaluation of hypoxia is particularly important in patients with nasopharyngeal carcinoma (NPC) undergoing radiotherapy. The aim of this study was to propose a novel imaging strategy for quantitative three-dimensional (3D) evaluation of hypoxia in a small animal model of NPC. Methods A carbonic anhydrase IX (CAIX)-specific molecular probe (CAIX-800) was developed for imaging of hypoxia. Mouse models of subcutaneous, orthotopic, and spontaneous lymph node metastasis from NPC (5 mice per group) were established to assess the imaging strategy. A multi-modality imaging method that consisted of a hybrid combination of fluorescence molecular tomography-computed tomography (FMT-CT) and multispectral optoacoustic tomography (MSOT) was used for 3D quantitative evaluation of tumour hypoxia. Magnetic resonance imaging, histological examination, and immunohistochemical analysis were used as references for comparison and validation. Results In the early stage of NPC (2 weeks after implantation), FMT-CT enabled precise 3D localisation of the hypoxia biomarker with high sensitivity. At the advanced stage (6 weeks after implantation), MSOT allowed multispectral analysis of the biomarker and haemoglobin molecules with high resolution. The combination of high sensitivity and high resolution from FMT-CT and MSOT could not only detect hypoxia in small-sized NPCs but also visualise the heterogeneity of hypoxia in 3D. Conclusions Integration of FMT-CT and MSOT could allow comprehensive and quantifiable evaluation of hypoxia in NPC. These findings may potentially benefit patients with NPC undergoing radiotherapy in the future. A novel multimodality imaging strategy for three-dimensional evaluation of tumour hypoxia in an orthotopic model of nasopharyngeal carcinoma. ![]()
Electronic supplementary material The online version of this article (10.1007/s00259-019-04526-x) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Wenhui Huang
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China.,CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Kun Wang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Yu An
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Hui Meng
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Yuan Gao
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Zhiyuan Xiong
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China.,Department of Chemical and Bio-molecular Engineering, The university of Melbourne, Melbourne, Victoria, 3010, Australia
| | - Hao Yan
- Engineering Laboratory for Functionalized Carbon Materials, Graduate School at Shenzhen, Tsinghua University, Shenzhen, 518055, China
| | - Qian Wang
- Department of Diagnostic Imaging, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, 100021, China
| | - Xuekang Cai
- Department of Nuclear Medicine, Peking University First Hospital, No. 8 Xishiku Road, Xicheng District, Beijing, 100034, China
| | - Xin Yang
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China
| | - Bin Zhang
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China
| | - Qiuying Chen
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China
| | - Xing Yang
- Department of Nuclear Medicine, Peking University First Hospital, No. 8 Xishiku Road, Xicheng District, Beijing, 100034, China.
| | - Jie Tian
- CAS Key Laboratory of Molecular Imaging, Institute of Automation Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing, 100190, China. .,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing, 100191, China.
| | - Shuixing Zhang
- Medical Imaging Center, the First Affiliated Hospital, Jinan University, No. 163, Huangpu West Road, Tianhe District, Guangzhou, Guangdong, 510632, China.
| |
Collapse
|
19
|
Etrych T, Janoušková O, Chytil P. Fluorescence Imaging as a Tool in Preclinical Evaluation of Polymer-Based Nano-DDS Systems Intended for Cancer Treatment. Pharmaceutics 2019; 11:E471. [PMID: 31547308 PMCID: PMC6781319 DOI: 10.3390/pharmaceutics11090471] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 08/29/2019] [Accepted: 09/04/2019] [Indexed: 01/04/2023] Open
Abstract
Targeted drug delivery using nano-sized carrier systems with targeting functions to malignant and inflammatory tissue and tailored controlled drug release inside targeted tissues or cells has been and is still intensively studied. A detailed understanding of the correlation between the pharmacokinetic properties and structure of the nano-sized carrier is crucial for the successful transition of targeted drug delivery nanomedicines into clinical practice. In preclinical research in particular, fluorescence imaging has become one of the most commonly used powerful imaging tools. Increasing numbers of suitable fluorescent dyes that are excitable in the visible to near-infrared (NIR) wavelengths of the spectrum and the non-invasive nature of the method have significantly expanded the applicability of fluorescence imaging. This chapter summarizes non-invasive fluorescence-based imaging methods and discusses their potential advantages and limitations in the field of drug delivery, especially in anticancer therapy. This chapter focuses on fluorescent imaging from the cellular level up to the highly sophisticated three-dimensional imaging modality at a systemic level. Moreover, we describe the possibility for simultaneous treatment and imaging using fluorescence theranostics and the combination of different imaging techniques, e.g., fluorescence imaging with computed tomography.
Collapse
Affiliation(s)
- Tomáš Etrych
- Institute of Macromolecular Chemistry, Czech Academy of Sciences, Heyrovského nám. 2, 162 06 Prague 6, Czech Republic.
| | - Olga Janoušková
- Institute of Macromolecular Chemistry, Czech Academy of Sciences, Heyrovského nám. 2, 162 06 Prague 6, Czech Republic
| | - Petr Chytil
- Institute of Macromolecular Chemistry, Czech Academy of Sciences, Heyrovského nám. 2, 162 06 Prague 6, Czech Republic
| |
Collapse
|
20
|
Jiang S, Liu J, An Y, Gao Y, Meng H, Wang K, Tian J. Fluorescence Molecular Tomography Based on Group Sparsity Priori for Morphological Reconstruction of Glioma. IEEE Trans Biomed Eng 2019; 67:1429-1437. [PMID: 31449004 DOI: 10.1109/tbme.2019.2937354] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE Fluorescence molecular tomography (FMT) is an important tool for life science, which can noninvasive real-time three-dimensional (3-D) visualization for fluorescence source location. FMT is widely used in tumor research due to its high-sensitive and low cost. However, the reconstruction of FMT is difficult. Although the reconstruction methods of FMT have developed rapidly in recent years, the morphological reconstruction of FMT is still a challenge problem. Thus, the purpose of this study is to realize the morphological reconstruction performance of FMT in glioma research. METHODS In this study, group sparsity was used as a new priori information for FMT. Besides sparsity, group sparsity also takes the group structure of the fluorescent sources, which can maintain the morphological information of the sources. Fused LASSO method (FLM) was proved it can efficiently model the group sparsity prior. Thus, we utilize FLM to reconstruct the morphological information of glioma. Furthermore, to reduce the influence of the high scattering of skull, we modified the FLM for improving the accuracy of morphological reconstruction. RESULTS Glioma numerical simulation model and in vivo glioma model were established to evaluate the performance of morphological reconstruction of the proposed method. The results demonstrated that the proposed method was efficient to reconstruct the morphological information of glioma. CONCLUSION Group sparsity priori can effectively improve the morphological accuracy of FMT reconstruction. SIGNIFICANCE Group sparsity can maintain the morphological information of fluorescent sources effectively, which has great application potential in FMT. The group sparsity based methods can realize the morphological reconstruction, which is of great practical significance in tumor research.
Collapse
|
21
|
Guo L, Liu F, Cai C, Liu J, Zhang G. 3D deep encoder-decoder network for fluorescence molecular tomography. OPTICS LETTERS 2019; 44:1892-1895. [PMID: 30985768 DOI: 10.1364/ol.44.001892] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2023]
Abstract
Fluorescence molecular tomography (FMT) is a promising and noninvasive in vivo functional imaging modality. However, the quality of FMT reconstruction is limited by the simplified linear model of photon propagation. Here, an end-to-end three-dimensional deep encoder-decoder (3D-En-Decoder) network is proposed to improve the quality of FMT reconstruction. It directly establishes the nonlinear mapping relationship between the inside fluorescent source distribution and the boundary fluorescent signal distribution. Thus the reconstruction inaccuracy caused by the simplified linear model can be fundamentally avoided by the proposed network. Both numerical simulations and phantom experiments were carried out, and the results demonstrated that the 3D-En-Decoder network can greatly improve image quality and significantly reduce reconstruction time compared with conventional methods.
Collapse
|
22
|
Jiang S, Liu J, Zhang G, An Y, Meng H, Gao Y, Wang K, Tian J. Reconstruction of Fluorescence Molecular Tomography via a Fused LASSO Method Based on Group Sparsity Prior. IEEE Trans Biomed Eng 2018; 66:1361-1371. [PMID: 30281432 DOI: 10.1109/tbme.2018.2872913] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE The aim of this paper is to improve the reconstruction accuracy in both position and source region of fluorescence molecular tomography (FMT). METHODS The reconstruction of the FMT is challenging due to its serious ill-posedness and ill-condition. Currently, to obtain the fluorescent sources accurately, more a priori information of the fluorescent sources is utilized and more efficient and practical methods are proposed. In this paper, we took the group sparsity of the fluorescent sources as a new type of priori information in the FMT, and proposed the fused LASSO method (FLM) for FMT. The FLM based on group sparsity prior not only takes advantage of the sparsity of the fluorescent sources, but also utilizes the structure of the sources, thus making the reconstruction results more accuracy and morphologically similar to the sources. To further improve the reconstruction efficiency, we adopt Nesterov's method to solve the FLM. RESULTS Both heterogeneous numerical simulation experiments and in vivo mouse experiments were carried out to verify the property of the FLM. The results have verified the superiority of the FLM over conventional methods in tumor detection and tumor morphological reconstruction. Furthermore, the in vivo experiments had demonstrated that the FLM has great potential in preclinical application of the FMT. SIGNIFICANCE The reconstruction method based on group sparsity prior has a great potential in the FMT study, it can further improve the reconstruction quality, which has practical significance in preclinical research.
Collapse
|
23
|
Zhang S, Ma X, Wang Y, Wu M, Meng H, Chai W, Wang X, Wei S, Tian J. Robust Reconstruction of Fluorescence Molecular Tomography Based on Sparsity Adaptive Correntropy Matching Pursuit Method for Stem Cell Distribution. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:2176-2184. [PMID: 29993826 DOI: 10.1109/tmi.2018.2825102] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
Fluorescence molecular tomography (FMT), as a promising imaging modality in preclinical research, can obtain the three-dimensional (3-D) position information of the stem cell in mice. However, because of the ill-posed nature and sensitivity to noise of the inverse problem, it is a challenge to develop a robust reconstruction method, which can accurately locate the stem cells and define the distribution. In this paper, we proposed a sparsity adaptive correntropy matching pursuit (SACMP) method. SACMP method is independent on the noise distribution of measurements and it assigns small weights on severely corrupted entries of data and large weights on clean ones adaptively. These properties make it more suitable for in vivo experiment. To analyze the performance in terms of robustness and practicability of SACMP, we conducted numerical simulation and in vivo mice experiments. The results demonstrated that the SACMP method obtained the highest robustness and accuracy in locating stem cells and depicting stem cell distribution compared with stagewise orthogonal matching pursuit and sparsity adaptive subspace pursuit reconstruction methods. To the best of our knowledge, this is the first study that acquired such accurate and robust FMT distribution reconstruction for stem cell tracking in mice brain. This promotes the application of FMT in locating stem cell and distribution reconstruction in practical mice brain injury models.
Collapse
|
24
|
An Y, Wang K, Tian J. Recent methodology advances in fluorescence molecular tomography. Vis Comput Ind Biomed Art 2018; 1:1. [PMID: 32240398 PMCID: PMC7098398 DOI: 10.1186/s42492-018-0001-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2018] [Accepted: 06/30/2018] [Indexed: 12/26/2022] Open
Abstract
Molecular imaging (MI) is a novel imaging discipline that has been continuously developed in recent years. It combines biochemistry, multimodal imaging, biomathematics, bioinformatics, cell & molecular physiology, biophysics, and pharmacology, and it provides a new technology platform for the early diagnosis and quantitative analysis of diseases, treatment monitoring and evaluation, and the development of comprehensive physiology. Fluorescence Molecular Tomography (FMT) is a type of optical imaging modality in MI that captures the three-dimensional distribution of fluorescence within a biological tissue generated by a specific molecule of fluorescent material within a biological tissue. Compared with other optical molecular imaging methods, FMT has the characteristics of high sensitivity, low cost, and safety and reliability. It has become the research frontier and research hotspot of optical molecular imaging technology. This paper took an overview of the recent methodology advances in FMT, mainly focused on the photon propagation model of FMT based on the radiative transfer equation (RTE), and the reconstruction problem solution consist of forward problem and inverse problem. We introduce the detailed technologies utilized in reconstruction of FMT. Finally, the challenges in FMT were discussed. This survey aims at summarizing current research hotspots in methodology of FMT, from which future research may benefit.
Collapse
Affiliation(s)
- Yu An
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Kun Wang
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China
| | - Jie Tian
- Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, Beijing, China.
| |
Collapse
|
25
|
Liu Y, Jiang S, Liu J, An Y, Zhang G, Gao Y, Wang K, Tian J. Reconstruction method for fluorescence molecular tomography based on L1-norm primal accelerated proximal gradient. JOURNAL OF BIOMEDICAL OPTICS 2018; 23:1-11. [PMID: 30109802 DOI: 10.1117/1.jbo.23.8.085002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/20/2018] [Accepted: 07/30/2018] [Indexed: 06/08/2023]
Abstract
Fluorescence molecular tomography (FMT) has been widely used in preclinical tumor imaging, which enables three-dimensional imaging of the distribution of fluorescent probes in small animal bodies via image reconstruction method. However, the reconstruction results are usually unsatisfactory in the term of robustness and efficiency because of the ill-posed and ill-conditioned of FMT problem. In this study, an FMT reconstruction method based on primal accelerated proximal gradient (PAPG) descent and L1-norm regularized projection (L1RP) is proposed. The proposed method utilizes the current and previous iterations to obtain a search point at each iteration. To achieve fast convergence, the PAPG method is applied to efficiently solve the search point, and then L1RP is performed to obtain the robust and accurate reconstruction. To verify the performance of the proposed method, simulation experiments are conducted. The comparative results revealed that it held advantages of robustness, accuracy, and efficiency in FMT reconstructions. Furthermore, a phantom experiment and an in vivo mouse experiment were also performed, which proved the potential and feasibility of the proposed method for practical applications.
Collapse
Affiliation(s)
- Yuhao Liu
- Beijing Jiaotong University, School of Computer and Information Technology, Haidian District, Beijin, China
- Institute of Automation, CAS Key Laboratory of Molecular Imaging, Chinese Academy of Sciences, Beiji, China
| | - Shixin Jiang
- Beijing Jiaotong University, School of Computer and Information Technology, Haidian District, Beijin, China
- Institute of Automation, CAS Key Laboratory of Molecular Imaging, Chinese Academy of Sciences, Beiji, China
| | - Jie Liu
- Beijing Jiaotong University, School of Computer and Information Technology, Haidian District, Beijin, China
| | - Yu An
- Institute of Automation, CAS Key Laboratory of Molecular Imaging, Chinese Academy of Sciences, Beiji, China
| | - Guanglei Zhang
- Beihang University, School of Biological Science and Medical Engineering, Beijing Advanced Innovatio, China
| | - Yuan Gao
- Institute of Automation, CAS Key Laboratory of Molecular Imaging, Chinese Academy of Sciences, Beiji, China
| | - Kun Wang
- Institute of Automation, CAS Key Laboratory of Molecular Imaging, Chinese Academy of Sciences, Beiji, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Jie Tian
- Institute of Automation, CAS Key Laboratory of Molecular Imaging, Chinese Academy of Sciences, Beiji, China
- University of Chinese Academy of Sciences, Beijing, China
- Beijing Key Laboratory of Molecular Imaging, Beijing, China
| |
Collapse
|
26
|
Guo H, Yu J, Hu Z, Yi H, Hou Y, He X. A hybrid clustering algorithm for multiple-source resolving in bioluminescence tomography. JOURNAL OF BIOPHOTONICS 2018; 11:e201700056. [PMID: 28700135 DOI: 10.1002/jbio.201700056] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2017] [Revised: 06/20/2017] [Accepted: 06/21/2017] [Indexed: 05/23/2023]
Abstract
Bioluminescence tomography is a preclinical imaging modality to locate and quantify internal bioluminescent sources from surface measurements, which experienced rapid growth in the last 10 years. However, multiple-source resolving remains a challenging issue in BLT. In this study, it is treated as an unsupervised pattern recognition problem based on the reconstruction result, and a novel hybrid clustering algorithm combining the advantages of affinity propagation (AP) and K-means is developed to identify multiple sources automatically. Moreover, we incorporate the clustering analysis into a general multiple-source reconstruction framework, which can provide stable reconstruction and accurate resolving result without providing the number of targets. Numerical simulations and in vivo experiments on 4T1-luc2 mouse model were conducted to assess the performance of the proposed method in multiple-source resolving. The encouraging results demonstrate significant effectiveness and potential of our method in preclinical BLT applications.
Collapse
Affiliation(s)
- Hongbo Guo
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
- Chinese Academy of Sciences, Key Laboratory of Molecular Imaging, Institute of Automation, Beijing, China
| | - Jingjing Yu
- The School of Physics and Information Technology, Shaanxi Normal University, Xi'an, China
| | - Zhenhua Hu
- Chinese Academy of Sciences, Key Laboratory of Molecular Imaging, Institute of Automation, Beijing, China
| | - Huangjian Yi
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Yuqing Hou
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
| | - Xiaowei He
- The School of Information Sciences and Technology, Northwest University, Xi'an, China
| |
Collapse
|
27
|
Yi H, Wei H, Peng J, Hou Y, He X. Adaptive threshold method for recovered images of FMT. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2018; 35:256-261. [PMID: 29400892 DOI: 10.1364/josaa.35.000256] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2017] [Accepted: 12/12/2017] [Indexed: 06/07/2023]
Abstract
This paper proposes a post-processing strategy for recovered images of fluorescence molecular tomography. A threshold value is adaptively obtained from the recovered images without external interference, which is objective because it is extracted from the reconstructed result. The recovered images from simulation experiments and physical phantom experiments are processed by this threshold method. And by visualization, the processed images are clearer than those with no post-processing. The full width at half-maximum and contrast-to-noise ratio are then utilized to further verify the effectiveness of the post-processing method, being capable of removing spurious information from the original images, thus bringing convenience to users.
Collapse
|
28
|
Wu Z, Wang X, Yu J, Yi H, He X. Synchronization-based clustering algorithm for reconstruction of multiple reconstructed targets in fluorescence molecular tomography. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2018; 35:328-335. [PMID: 29400883 DOI: 10.1364/josaa.35.000328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2017] [Accepted: 01/01/2018] [Indexed: 06/07/2023]
Abstract
Fluorescence molecular tomography (FMT) is an important in vivo molecular imaging technique and has been widely studied in preclinical research. Many methods perform well in the reconstruction of a single fluorescent target but may fail in reconstructing multiple targets because of the severe ill-posedness of the FMT inverse problem. In this paper the original synchronization-inspired clustering algorithm (OSC) is introduced into FMT for resolving multiple targets from the reconstruction result. Based on OSC, a synchronization-based clustering algorithm for FMT (SC-FMT) is developed to further improve location accuracy. Both algorithms utilize the minimum spanning tree to automatically identify the number of the reconstructed targets without prior information and human intervention. A serial of numerical simulation results demonstrates that SC-FMT and OSC can resolve multiple targets robustly and automatically, which also shows the potential of the proposed postprocessing algorithms in FMT reconstruction.
Collapse
|
29
|
Liu T, Rong J, Gao P, Zhang W, Liu W, Zhang Y, Lu H. Cone-beam x-ray luminescence computed tomography based on x-ray absorption dosage. JOURNAL OF BIOMEDICAL OPTICS 2018; 23:1-11. [PMID: 29473348 DOI: 10.1117/1.jbo.23.2.026006] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2017] [Accepted: 01/22/2018] [Indexed: 06/08/2023]
Abstract
With the advances of x-ray excitable nanophosphors, x-ray luminescence computed tomography (XLCT) has become a promising hybrid imaging modality. In particular, a cone-beam XLCT (CB-XLCT) system has demonstrated its potential in in vivo imaging with the advantage of fast imaging speed over other XLCT systems. Currently, the imaging models of most XLCT systems assume that nanophosphors emit light based on the intensity distribution of x-ray within the object, not completely reflecting the nature of the x-ray excitation process. To improve the imaging quality of CB-XLCT, an imaging model that adopts an excitation model of nanophosphors based on x-ray absorption dosage is proposed in this study. To solve the ill-posed inverse problem, a reconstruction algorithm that combines the adaptive Tikhonov regularization method with the imaging model is implemented for CB-XLCT reconstruction. Numerical simulations and phantom experiments indicate that compared with the traditional forward model based on x-ray intensity, the proposed dose-based model could improve the image quality of CB-XLCT significantly in terms of target shape, localization accuracy, and image contrast. In addition, the proposed model behaves better in distinguishing closer targets, demonstrating its advantage in improving spatial resolution.
Collapse
Affiliation(s)
- Tianshuai Liu
- Fourth Military Medical University, Department of Biomedical Engineering, Xi'an, Shaanxi, China
| | - Junyan Rong
- Fourth Military Medical University, Department of Biomedical Engineering, Xi'an, Shaanxi, China
| | - Peng Gao
- Fourth Military Medical University, Department of Biomedical Engineering, Xi'an, Shaanxi, China
| | - Wenli Zhang
- Fourth Military Medical University, Department of Biomedical Engineering, Xi'an, Shaanxi, China
| | - Wenlei Liu
- Fourth Military Medical University, Department of Biomedical Engineering, Xi'an, Shaanxi, China
| | - Yuanke Zhang
- Fourth Military Medical University, Department of Biomedical Engineering, Xi'an, Shaanxi, China
| | - Hongbing Lu
- Fourth Military Medical University, Department of Biomedical Engineering, Xi'an, Shaanxi, China
| |
Collapse
|
30
|
Gao Y, Wang K, Jiang S, Liu Y, Ai T, Tian J. Bioluminescence Tomography Based on Gaussian Weighted Laplace Prior Regularization for In Vivo Morphological Imaging of Glioma. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:2343-2354. [PMID: 28796614 DOI: 10.1109/tmi.2017.2737661] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
Bioluminescence tomography (BLT) is a powerful non-invasive molecular imaging tool for in vivo studies of glioma in mice. However, because of the light scattering and resulted ill-posed problems, it is challenging to develop a sufficient reconstruction method, which can accurately locate the tumor and define the tumor morphology in three-dimension. In this paper, we proposed a novel Gaussian weighted Laplace prior (GWLP) regularization method. It considered the variance of the bioluminescence energy between any two voxels inside an organ had a non-linear inverse relationship with their Gaussian distance to solve the over-smoothed tumor morphology in BLT reconstruction. We compared the GWLP with conventional Tikhonov and Laplace regularization methods through various numerical simulations and in vivo orthotopic glioma mouse model experiments. The in vivo magnetic resonance imaging and ex vivo green fluorescent protein images and hematoxylin-eosin stained images of whole head cryoslicing specimens were utilized as gold standards. The results demonstrated that GWLP achieved the highest accuracy in tumor localization and tumor morphology preservation. To the best of our knowledge, this is the first study that achieved such accurate BLT morphological reconstruction of orthotopic glioma without using any segmented tumor structure from any other structural imaging modalities as the prior for reconstruction guidance. This enabled BLT more suitable and practical for in vivo imaging of orthotopic glioma mouse models.
Collapse
|
31
|
Baikejiang R, Zhao Y, Fite BZ, Ferrara KW, Li C. Anatomical image-guided fluorescence molecular tomography reconstruction using kernel method. JOURNAL OF BIOMEDICAL OPTICS 2017; 22:55001. [PMID: 28464120 PMCID: PMC5629124 DOI: 10.1117/1.jbo.22.5.055001] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2017] [Accepted: 04/10/2017] [Indexed: 05/20/2023]
Abstract
Fluorescence molecular tomography (FMT) is an important in vivo imaging modality to visualize physiological and pathological processes in small animals. However, FMT reconstruction is ill-posed and ill-conditioned due to strong optical scattering in deep tissues, which results in poor spatial resolution. It is well known that FMT image quality can be improved substantially by applying the structural guidance in the FMT reconstruction. An approach to introducing anatomical information into the FMT reconstruction is presented using the kernel method. In contrast to conventional methods that incorporate anatomical information with a Laplacian-type regularization matrix, the proposed method introduces the anatomical guidance into the projection model of FMT. The primary advantage of the proposed method is that it does not require segmentation of targets in the anatomical images. Numerical simulations and phantom experiments have been performed to demonstrate the proposed approach’s feasibility. Numerical simulation results indicate that the proposed kernel method can separate two FMT targets with an edge-to-edge distance of 1 mm and is robust to false-positive guidance and inhomogeneity in the anatomical image. For the phantom experiments with two FMT targets, the kernel method has reconstructed both targets successfully, which further validates the proposed kernel method.
Collapse
Affiliation(s)
- Reheman Baikejiang
- University of California, Merced, School of Engineering, Merced, California, United States
| | - Yue Zhao
- University of California, Merced, School of Engineering, Merced, California, United States
| | - Brett Z. Fite
- University of California, Davis, Department of Biomedical Engineering, Davis, California, United States
| | - Katherine W. Ferrara
- University of California, Davis, Department of Biomedical Engineering, Davis, California, United States
| | - Changqing Li
- University of California, Merced, School of Engineering, Merced, California, United States
- Address all correspondence to: Changqing Li, E-mail:
| |
Collapse
|
32
|
An Y, Liu J, Zhang G, Jiang S, Ye J, Chi C, Tian J. Compactly Supported Radial Basis Function-Based Meshless Method for Photon Propagation Model of Fluorescence Molecular Tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:366-373. [PMID: 27552744 DOI: 10.1109/tmi.2016.2601311] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Fluorescence Molecular Tomography (FMT) is a powerful imaging modality for the research of cancer diagnosis, disease treatment and drug discovery. Via three-dimensional (3-D) imaging reconstruction, it can quantitatively and noninvasively obtain the distribution of fluorescent probes in biological tissues. Currently, photon propagation of FMT is conventionally described by the Finite Element Method (FEM), and it can obtain acceptable image quality. However, there are still some inherent inadequacies in FEM, such as time consuming, discretization error and inflexibility in mesh generation, which partly limit its imaging accuracy. To further improve the solving accuracy of photon propagation model (PPM), we propose a novel compactly supported radial basis functions (CSRBFs)-based meshless method (MM) to implement the PPM of FMT. We introduced a series of independent nodes and continuous CSRBFs to interpolate the PPM, which can avoid complicated mesh generation. To analyze the performance of the proposed MM, we carried out numerical heterogeneous mouse simulation to validate the simulated surface fluorescent measurement. Then we performed an in vivo experiment to observe the tomographic reconstruction. The experimental results confirmed that our proposed MM could obtain more similar surface fluorescence measurement with the golden standard (Monte-Carlo method), and more accurate reconstruction result was achieved via MM in in vivo application.
Collapse
|
33
|
Zhang G, Liu F, Liu J, Luo J, Xie Y, Bai J, Xing L. Cone Beam X-ray Luminescence Computed Tomography Based on Bayesian Method. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:225-235. [PMID: 27576245 PMCID: PMC5391999 DOI: 10.1109/tmi.2016.2603843] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
X-ray luminescence computed tomography (XLCT), which aims to achieve molecular and functional imaging by X-rays, has recently been proposed as a new imaging modality. Combining the principles of X-ray excitation of luminescence-based probes and optical signal detection, XLCT naturally fuses functional and anatomical images and provides complementary information for a wide range of applications in biomedical research. In order to improve the data acquisition efficiency of previously developed narrow-beam XLCT, a cone beam XLCT (CB-XLCT) mode is adopted here to take advantage of the useful geometric features of cone beam excitation. Practically, a major hurdle in using cone beam X-ray for XLCT is that the inverse problem here is seriously ill-conditioned, hindering us to achieve good image quality. In this paper, we propose a novel Bayesian method to tackle the bottleneck in CB-XLCT reconstruction. The method utilizes a local regularization strategy based on Gaussian Markov random field to mitigate the ill-conditioness of CB-XLCT. An alternating optimization scheme is then used to automatically calculate all the unknown hyperparameters while an iterative coordinate descent algorithm is adopted to reconstruct the image with a voxel-based closed-form solution. Results of numerical simulations and mouse experiments show that the self-adaptive Bayesian method significantly improves the CB-XLCT image quality as compared with conventional methods.
Collapse
|
34
|
Jiang S, Liu J, An Y, Zhang G, Ye J, Mao Y, He K, Chi C, Tian J. Novel l 2,1-norm optimization method for fluorescence molecular tomography reconstruction. BIOMEDICAL OPTICS EXPRESS 2016; 7:2342-59. [PMID: 27375949 PMCID: PMC4918587 DOI: 10.1364/boe.7.002342] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2016] [Revised: 05/09/2016] [Accepted: 05/12/2016] [Indexed: 05/23/2023]
Abstract
Fluorescence molecular tomography (FMT) is a promising tomographic method in preclinical research, which enables noninvasive real-time three-dimensional (3-D) visualization for in vivo studies. The ill-posedness of the FMT reconstruction problem is one of the many challenges in the studies of FMT. In this paper, we propose a l 2,1-norm optimization method using a priori information, mainly the structured sparsity of the fluorescent regions for FMT reconstruction. Compared to standard sparsity methods, the structured sparsity methods are often superior in reconstruction accuracy since the structured sparsity utilizes correlations or structures of the reconstructed image. To solve the problem effectively, the Nesterov's method was used to accelerate the computation. To evaluate the performance of the proposed l 2,1-norm method, numerical phantom experiments and in vivo mouse experiments are conducted. The results show that the proposed method not only achieves accurate and desirable fluorescent source reconstruction, but also demonstrates enhanced robustness to noise.
Collapse
Affiliation(s)
- Shixin Jiang
- Department of Biomedical Engineering, School of Computer and Information Technology, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China
| | - Jie Liu
- Department of Biomedical Engineering, School of Computer and Information Technology, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China
| | - Yu An
- Department of Biomedical Engineering, School of Computer and Information Technology, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China
| | - Guanglei Zhang
- Department of Biomedical Engineering, School of Computer and Information Technology, Beijing Jiaotong University, No. 3 Shangyuancun, Haidian District, Beijing 100044, China
| | - Jinzuo Ye
- Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing 100190, China
| | - Yamin Mao
- Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing 100190, China
| | - Kunshan He
- Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing 100190, China
| | - Chongwei Chi
- Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing 100190, China
- Beijing Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing 100190, China
| | - Jie Tian
- Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, Institute of Automation, Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing 100190, China
- Beijing Key Laboratory of Molecular Imaging, Institute of Automation, Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Haidian District, Beijing 100190, China
| |
Collapse
|
35
|
He X, Dong F, Yu J, Guo H, Hou Y. Reconstruction algorithm for fluorescence molecular tomography using sorted L-one penalized estimation. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2015; 32:1928-1935. [PMID: 26560906 DOI: 10.1364/josaa.32.001928] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Fluorescence molecular tomography (FMT) has been a promising imaging tool that provides convenience for accurate localization and quantitative analysis of the fluorescent probe. In this study, we present a reconstruction method combining sorted L-one penalized estimation with an iterative-shrinking permissible region strategy to reconstruct fluorescence targets. Both numerical simulation experiments on a three-dimensional digital mouse model and physical experiments on a cubic phantom were carried out to validate the accuracy, effectiveness, and robustness of the proposed method. The results indicate that the proposed method can produce better location and satisfactory fluorescent yield with computational efficiency, which makes it a practical and promising reconstruction method for FMT.
Collapse
|
36
|
An Y, Liu J, Zhang G, Ye J, Mao Y, Jiang S, Shang W, Du Y, Chi C, Tian J. Meshless reconstruction method for fluorescence molecular tomography based on compactly supported radial basis function. JOURNAL OF BIOMEDICAL OPTICS 2015; 20:105003. [PMID: 26451513 DOI: 10.1117/1.jbo.20.10.105003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/02/2015] [Accepted: 09/15/2015] [Indexed: 05/05/2023]
Abstract
Fluorescence molecular tomography (FMT) is a promising tool in the study of cancer, drug discovery, and disease diagnosis, enabling noninvasive and quantitative imaging of the biodistribution of fluorophores in deep tissues via image reconstruction techniques. Conventional reconstruction methods based on the finite-element method (FEM) have achieved acceptable stability and efficiency. However, some inherent shortcomings in FEM meshes, such as time consumption in mesh generation and a large discretization error, limit further biomedical application. In this paper, we propose a meshless method for reconstruction of FMT (MM-FMT) using compactly supported radial basis functions (CSRBFs). With CSRBFs, the image domain can be accurately expressed by continuous CSRBFs, avoiding the discretization error to a certain degree. After direct collocation with CSRBFs, the conventional optimization techniques, including Tikhonov, L1-norm iteration shrinkage (L1-IS), and sparsity adaptive matching pursuit, were adopted to solve the meshless reconstruction. To evaluate the performance of the proposed MM-FMT, we performed numerical heterogeneous mouse experiments and in vivo bead-implanted mouse experiments. The results suggest that the proposed MM-FMT method can reduce the position error of the reconstruction result to smaller than 0.4 mm for the double-source case, which is a significant improvement for FMT.
Collapse
Affiliation(s)
- Yu An
- Beijing Jiaotong University, School of Computer and Information, Department of Biomedical Engineering, No. 3 Shangyuancun Road, Beijing 100044, ChinabChinese Academy of Sciences, Institute of Automation, Key Laboratory of Molecular Imaging of Chinese Acad
| | - Jie Liu
- Beijing Jiaotong University, School of Computer and Information, Department of Biomedical Engineering, No. 3 Shangyuancun Road, Beijing 100044, China
| | - Guanglei Zhang
- Beijing Jiaotong University, School of Computer and Information, Department of Biomedical Engineering, No. 3 Shangyuancun Road, Beijing 100044, China
| | - Jinzuo Ye
- Chinese Academy of Sciences, Institute of Automation, Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Beijing, China
| | - Yamin Mao
- Chinese Academy of Sciences, Institute of Automation, Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Beijing, China
| | - Shixin Jiang
- Beijing Jiaotong University, School of Computer and Information, Department of Biomedical Engineering, No. 3 Shangyuancun Road, Beijing 100044, China
| | - Wenting Shang
- Chinese Academy of Sciences, Institute of Automation, Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Beijing, China
| | - Yang Du
- Chinese Academy of Sciences, Institute of Automation, Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Beijing, China
| | - Chongwei Chi
- Chinese Academy of Sciences, Institute of Automation, Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Beijing, China
| | - Jie Tian
- Chinese Academy of Sciences, Institute of Automation, Key Laboratory of Molecular Imaging of Chinese Academy of Sciences, No. 95 Zhongguancun East Road, Beijing, ChinacChinese Academy of Sciences, Institute of Automation, Beijing Key Laboratory of Molecul
| |
Collapse
|
37
|
Reconstruction Method for Optical Tomography Based on the Linearized Bregman Iteration with Sparse Regularization. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2015; 2015:304191. [PMID: 26421055 PMCID: PMC4570181 DOI: 10.1155/2015/304191] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2015] [Revised: 07/28/2015] [Accepted: 08/06/2015] [Indexed: 12/21/2022]
Abstract
Optical molecular imaging is a promising technique and has been widely used in physiology, and pathology at cellular and molecular levels, which includes different modalities such as bioluminescence tomography, fluorescence molecular tomography and Cerenkov luminescence tomography. The inverse problem is ill-posed for the above modalities, which cause a nonunique solution. In this paper, we propose an effective reconstruction method based on the linearized Bregman iterative algorithm with sparse regularization (LBSR) for reconstruction. Considering the sparsity characteristics of the reconstructed sources, the sparsity can be regarded as a kind of a priori information and sparse regularization is incorporated, which can accurately locate the position of the source. The linearized Bregman iteration method is exploited to minimize the sparse regularization problem so as to further achieve fast and accurate reconstruction results. Experimental results in a numerical simulation and in vivo mouse demonstrate the effectiveness and potential of the proposed method.
Collapse
|