1
|
Zhu J, Zhang X, Su T, Cui H, Tan Y, Huang H, Guo J, Zheng H, Liang D, Wu G, Ge Y. MMD-Net: Image domain multi-material decomposition network for dual-energy CT imaging. Med Phys 2025; 52:771-786. [PMID: 39556663 DOI: 10.1002/mp.17500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 09/20/2024] [Accepted: 10/15/2024] [Indexed: 11/20/2024] Open
Abstract
BACKGROUND Multi-material decomposition is an interesting topic in dual-energy CT (DECT) imaging; however, the accuracy and performance may be limited using the conventional algorithms. PURPOSE In this work, a novel multi-material decomposition network (MMD-Net) is proposed to improve the multi-material decomposition performance of DECT imaging. METHODS To achieve dual-energy multi-material decomposition, a deep neural network, named as MMD-Net, is proposed in this work. In MMD-Net, two specific convolutional neural network modules, Net-I and Net-II, are developed. Specifically, Net-I is used to distinguish the material triangles, while Net-II predicts the effective attenuation coefficients corresponding to the vertices of the material triangles. Subsequently, the material-specific density maps are calculated analytically through matrix inversion. The new method is validated using in-house benchtop DECT imaging experiments with a solution phantom and a pig leg specimen, as well as commercial medical DECT imaging experiments with a human patient. The decomposition accuracy, edge spreading function, and noise power spectrum are quantitatively evaluated. RESULTS Compared to the conventional multiple material decomposition (MMD) algorithm, the proposed MMD-Net method is more effective at suppressing image noise. Additionally, MMD-Net outperforms the iterative MMD approach in maintaining decomposition accuracy, image sharpness, and high-frequency content. Consequently, MMD-Net is capable of generating high-quality material decomposition images. CONCLUSION A high performance multi-material decomposition network is developed for dual-energy CT imaging.
Collapse
Affiliation(s)
- Jiongtao Zhu
- Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen, China
| | - Xin Zhang
- Research Center for Advanced Detection Materials and Medical Imaging Devices, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | - Ting Su
- Research Center for Advanced Detection Materials and Medical Imaging Devices, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | - Han Cui
- Research Center for Advanced Detection Materials and Medical Imaging Devices, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | - Yuhang Tan
- Research Center for Advanced Detection Materials and Medical Imaging Devices, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | - Hao Huang
- Department of Radiology, Shenzhen University General Hospital, Shenzhen, Guangdong, China
| | - Jinchuan Guo
- Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen, China
| | - Hairong Zheng
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
- Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | - Dong Liang
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
- Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, Guangdong, China
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| | - Guangyao Wu
- Department of Radiology, Shenzhen University General Hospital, Shenzhen, Guangdong, China
| | - Yongshuai Ge
- Research Center for Advanced Detection Materials and Medical Imaging Devices, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
- Paul C Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong, China
- Key Laboratory of Biomedical Imaging Science and System, Chinese Academy of Sciences, Shenzhen, Guangdong, China
| |
Collapse
|
2
|
Xu D, Lyu Q, Ruan D, Sheng K. A Two-Step Framework for Multi-Material Decomposition of Dual Energy Computed Tomography from Projection Domain. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-7. [PMID: 40039390 DOI: 10.1109/embc53108.2024.10782757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
BACKGROUND AND PURPOSE Dual-energy computed tomography (DECT) utilizes separate X-ray energy spectra to improve multi-material decomposition (MMD) for various diagnostic applications. However accurate decomposing more than two types of material remains challenging using conventional methods. Deep learning (DL) methods have shown promise to improve the MMD performance, but typical approaches of conducing DL-MMD in the image domain fail to fully utilize projection information or are under computationally inefficient iterative setup. In this work, we present a clinical-applicable MMD (> 2) framework - rFast-MMDNet, operating with raw projection data in non-recursive setup, for breast tissue differentiation. METHODS rFast-MMDNet is a two-stage algorithm, including stage-one SinoNet to perform dual energy projection decomposition on tissue sinograms and stage-two FBP-DenoiseNet to perform domain adaptation and image post-processing. rFast-MMDNet was tested on a 2022 DL-Spectral-Challenge dataset, which includes 1000 pairs of training, 10 pairs of validation, and 100 pairs of testing images simulating dual energy fast kVp-switching fan beam CT projections of breast phantoms. MMD for breast fibroglandular, adipose tissues and calcification was performed. The two stages of rFast-MMDNet were evaluated separately and then compared with four noniterative reference methods including a direct inversion method (AA-MMD), an image domain DL method (ID-UNet), AA-MMD/ID-UNet + DenoiseNet and a sinogram domain DL method (Triple-CBCT). RESULTS Our results show that models trained from information stored in DE transmission domain can yield high-fidelity decomposition with averaged RMSE, MAE, negative PSNR, and SSIM of 0.004 ± 0, 0.001 ± 0, -45.027 ± 0.542, and 0.002±0 benchmarking to the ground truth, respectively. The inference time of rFast-MMDNet is < +1s. All DL methods generally led to more accurate MMD than AA-MMD. rFast-MMDNet outperformed Triple-CBCT, but both are superior to the image-domain based methods. CONCLUSIONS A fast, robust, intuitive, and interpretable work-flow is presented to facilitate an efficient and precise MMD with input from projection domain.
Collapse
|
3
|
Chang HY, Liu CK, Huang HM. Material decomposition using dual-energy CT with unsupervised learning. Phys Eng Sci Med 2023; 46:1607-1617. [PMID: 37695508 DOI: 10.1007/s13246-023-01323-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 08/24/2023] [Indexed: 09/12/2023]
Abstract
Material decomposition (MD) is an application of dual-energy computed tomography (DECT) that decomposes DECT images into specific material images. However, the direct inversion method used in MD often amplifies noise in the decomposed material images, resulting in lower image quality. To address this issue, we propose an image-domain MD method based on the concept of deep image prior (DIP). DIP is an unsupervised learning method that can perform different tasks without using a large training dataset with known targets (i.e., basis material images). We retrospectively recruited patients who underwent non-contrast brain DECT scans and investigated the feasibility of using the proposed DIP-based method to decompose DECT images into two (i.e., bone and soft tissue) and three (i.e., bone, soft tissue, and fat) basis materials. We evaluated the decomposed material images in terms of signal-to-noise ratio (SNR) and modulation transfer function (MTF). The proposed DIP-based method showed greater improvement in SNR in the decomposed soft-tissue images compared to the direct inversion method and the iterative method. Moreover, the proposed method produced similar MTF curves in both two- and three-material decompositions. Additionally, the proposed DIP-based method demonstrated better separation ability than the other two studied methods in the case of three-material decomposition. Our results suggest that the proposed DIP-based method is capable of unsupervisedly generating high-quality basis material images from DECT images.
Collapse
Affiliation(s)
- Hui-Yu Chang
- Institute of Medical Device and Imaging, College of Medicine, National Taiwan University, No.1, Sec. 1, Jen Ai Rd., Zhongzheng Dist., Taipei City, 100, Taiwan
| | - Chi-Kuang Liu
- Department of Medical Imaging, Changhua Christian Hospital, 135 Nanxiao St., Changhua City, 500, Taiwan
| | - Hsuan-Ming Huang
- Institute of Medical Device and Imaging, College of Medicine, National Taiwan University, No.1, Sec. 1, Jen Ai Rd., Zhongzheng Dist., Taipei City, 100, Taiwan.
| |
Collapse
|
4
|
Frank CH, Ramesh P, Lyu Q, Ruan D, Park SJ, Chang AJ, Venkat PS, Kishan AU, Sheng K. Analytical HDR prostate brachytherapy planning with automatic catheter and isotope selection. Med Phys 2023; 50:6525-6534. [PMID: 37650773 PMCID: PMC10635680 DOI: 10.1002/mp.16677] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 06/27/2023] [Accepted: 07/30/2023] [Indexed: 09/01/2023] Open
Abstract
BACKGROUND High dose rate (HDR) brachytherapy is commonly used to treat prostate cancer. Existing HDR planning systems solve the dwell time problem for predetermined catheters and a single energy source. PURPOSE Additional degrees of freedom can be obtained by relaxing the catheters' pre-designation and introducing more source types, and may have a dosimetric benefit, particularly in improving conformality to spare the urethra. This study presents a novel analytical approach to solving the corresponding HDR planning problem. METHODS The catheter and dual-energy source selection problem was formulated as a constrained optimization problem with a non-convex group sparsity regularization. The optimization problem was solved using the fast-iterative shrinkage-thresholding algorithm (FISTA). Two isotopes were considered. The dose rates for the HDR 4140 Ytterbium (Yb-169) source and the Elekta Iridium (Ir-192) HDR Flexisource were modeled according to the TG-43U1 formalism and benchmarked accordingly. Twenty-two retrospective HDR prostate brachytherapy patients treated with Ir-192 were considered. An Ir-192 only (IRO), Yb-169 only (YBO), and dual-source (DS) plan with optimized catheter location was created for each patient with N catheters, where N is the number of catheters used in the clinically delivered plans. The DS plans jointly optimized Yb-169 and Ir-192 dwell times. All plans and the clinical plans were normalized to deliver a 15 Gy prescription (Rx) dose to 95% of the clinical treatment volume (CTV) and evaluated for the CTV D90%, V150%, and V200%, urethra D0.1cc and D1cc, bladder V75%, and rectum V75%. Dose-volume histograms (DVHs) were generated for each structure. RESULTS The DS plans ubiquitously selected Ir-192 as the only treatment source. IRO outperformed YBO in organ at risk (OARs) OAR sparing, reducing the urethra D0.1cc and D1cc by 0.98% (p = 2.22 ∗ 10 - 9 $p\ = \ 2.22*{10^{ - 9}}$ ) and 1.09% (p = 1.22 ∗ 10 - 10 $p\ = \ 1.22*{10^{ - 10}}$ ) of the Rx dose, respectively, and reducing the bladder and rectum V75% by 0.09 (p = 0.0023 $p\ = \ 0.0023$ ) and 0.13 cubic centimeters (cc) (p = 0.033 $p\ = \ 0.033$ ), respectively. The YBO plans delivered a more homogenous dose to the CTV, with a smaller V150% and V200% by 3.20 (p = 4.67 ∗ 10 - 10 $p\ = \ 4.67*{10^{ - 10}}$ ) and 1.91 cc (p = 5.79 ∗ 10 - 10 $p\ = \ 5.79*{10^{ - 10}}$ ), respectively, and a lower CTV D90% by 0.49% (p = 0.0056 $p\ = \ 0.0056$ ) of the prescription dose. The IRO plans reduce the urethral D1cc by 2.82% (p = 1.38 ∗ 10 - 4 $p\ = \ 1.38*{10^{ - 4}}$ ) of the Rx dose compared to the clinical plans, at the cost of increased bladder and rectal V75% by 0.57 (p = 0.0022 $p\ = \ 0.0022$ ) and 0.21 cc (p = 0.019 $p\ = \ 0.019$ ), respectively, and increased CTV V150% by a mean of 1.46 cc (p = 0.010 $p\ = \ 0.010$ ) and CTV D90% by an average of 1.40% of the Rx dose (p = 8.80 ∗ 10 - 8 $p\ = \ 8.80*{10^{ - 8}}$ ). While these differences are statistically significant, the clinical differences between the plans are minimal. CONCLUSIONS The proposed analytical HDR planning algorithm integrates catheter and isotope selection with dwell time optimization for varying clinical goals, including urethra sparing. The planning method can guide HDR implants and identify promising isotopes for specific HDR clinical goals, such as target conformality or OAR sparing.
Collapse
Affiliation(s)
- Catherine Holly Frank
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
| | - Pavitra Ramesh
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
| | - Qihui Lyu
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
| | - Dan Ruan
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
| | - Sang-June Park
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
| | - Albert J. Chang
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
| | - Puja S. Venkat
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
| | - Amar U. Kishan
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
| | - Ke Sheng
- Department of Radiation Oncology, University of California Los Angeles, Los Angeles, CA 90095
- Department of Radiation Oncology, University of California San Francisco, San Francisco, CA 94115
| |
Collapse
|
5
|
Zimmerman J, Thor D, Poludniowski G. Stopping-power ratio estimation for proton radiotherapy using dual-energy computed tomography and prior-image constrained denoising. Med Phys 2023; 50:1481-1495. [PMID: 36322128 DOI: 10.1002/mp.16063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Revised: 09/12/2022] [Accepted: 09/26/2022] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND Dual-energy computed tomography (DECT) is a promising technique for estimating stopping-power ratio (SPR) for proton therapy planning. It is known, however, that deriving electron density (ED) and effective atomic number (EAN) from DECT data can cause noise amplification in the resulting SPR images. This can negate the benefits of DECT. PURPOSE This work introduces a new algorithm for estimating SPR from DECT with noise suppression, using a pair of CT scans with spectral separation. The method is demonstrated using phantom measurements. MATERIALS AND METHODS An iterative algorithm is presented, reconstructing ED and EAN with noise suppression, based on Prior Image Constrained Denoising (PIC-D). The algorithm is tested using a Siemens Definition AS+ CT scanner (Siemens Healthcare, Forchheim, Germany). Three phantoms are investigated: a calibration phantom (CIRS 062M), a QA phantom (CATPHAN 700), and an anthropomorphic head phantom (CIRS 731-HN). A task-transfer function (TTF) and the noise power spectrum are derived from SPR images of the QA phantom for the evaluation of image quality. Comparisons of accuracy and noise for ED, EAN, and SPR are made for various versions of the algorithm in comparison to a solution based on Siemens syngo.via Rho/Z software and the current clinical standard of a single-energy CT stoichiometric calibration. A gamma analysis is also applied to the SPR images of the head phantom and water-equivalent distance (WED) is evaluated in a treatment planning system for a proton treatment field. RESULTS The algorithm is effective at suppressing noise in both ED and EAN and hence also SPR. The noise is tunable to a level equivalent to or lower than that of the syngo.via Rho/Z software. The spatial resolution (10% and 50% frequencies in the TTF) does not degrade even for the highest noise suppression investigated, although the average spatial frequency of noise does decrease. The PIC-D algorithm showed better accuracy than syngo.via Rho/Z for low density materials. In the calibration phantom, it was superior even when excluding lung substitutes, with root-mean-square deviations for ED and EAN less than 0.3% and 2%, respectively, compared to 0.5% and 3%. In the head phantom, however, the SPR accuracy of the PIC-D algorithm was comparable (excluding sinus tissue) to that derived from syngo.via Rho/Z: less than 1% error for soft tissue, brain, and trabecular bone substitutes and 5-7% for cortical bone, with the larger error for the latter likely related to the phantom geometry. Gamma evaluation showed that PIC-D can suppress noise in a patient-like geometry without introducing substantial errors in SPR. The absolute pass rates were almost identical for PIC-D and syngo.via Rho/Z. In the WED evaluations no general differences were shown. CONCLUSIONS The PIC-D DECT algorithm provides scanner-specific calibration and tunable noise suppression. It is vendor agnostic and applicable to any pair of CT scans with spectral separation. Improved accuracy to current methods was not clearly demonstrated for the complex geometry of a head phantom, but the suppression of noise without spatial resolution degradation and the possibility of incorporating constraints on image properties, suggests the usefulness of the approach.
Collapse
Affiliation(s)
- Jens Zimmerman
- Department of Medical Radiation Physics and Nuclear Medicine, Karolinska University Hospital, Stockholm, Sweden
- Department of Oncology-Pathology, Karolinska Institutet, Stockholm, Sweden
| | - Daniel Thor
- Department of Medical Radiation Physics and Nuclear Medicine, Karolinska University Hospital, Stockholm, Sweden
- Department of Oncology-Pathology, Karolinska Institutet, Stockholm, Sweden
| | - Gavin Poludniowski
- Department of Medical Radiation Physics and Nuclear Medicine, Karolinska University Hospital, Stockholm, Sweden
- Department of Clinical Science, Intervention and Technology, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
6
|
Zhou H, Cao M, Min Y, Yoon S, Kishan A, Ruan D. Ensemble learning and tensor regularization for cone-beam computed tomography-based pelvic organ segmentation. Med Phys 2022; 49:1660-1672. [PMID: 35061244 DOI: 10.1002/mp.15475] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 12/31/2021] [Accepted: 01/07/2022] [Indexed: 11/10/2022] Open
Abstract
PURPOSE Cone-beam computed tomography (CBCT) is a widely accessible low-dose imaging approach compatible with on-table patient anatomy observation for radiotherapy. However, its use in comprehensive anatomy monitoring is hindered by low contrast and low signal-to-noise ratio and a large presence of artifacts, resulting in difficulty in identifying organ and structure boundaries either manually or automatically. In this study, we propose and develop an ensemble deep-learning model to segment post-prostatectomy organs automatically. METHODS We utilize the ensemble logic in various modules during the segmentation process to alleviate the impact of low image quality of CBCT. Specifically, (1) semantic attention was obtained from an ensemble 2.5D You-only-look-once detector to consistently define regions of interest, (2) multiple view-specific two-stream 2.5D segmentation networks were developed, using auxiliary high-quality CT data to aid CBCT segmentation, and (3) a novel tensor-regularized ensemble scheme was proposed to aggregate the estimates from multiple views and regularize the spatial integrity of the final segmentation. RESULTS A cross validation study achieved Dice similarity coefficient and mean surface distance of 0.779 ± 0.069 and 2.895 ± 1.496 mm for the rectum, and 0.915 ± 0.055 and 1.675 ± 1.311 mm for the bladder. CONCLUSIONS The proposed ensemble scheme manages to enhance the geometric integrity and robustness of the contours derived from CBCT with light network components. The tensor regularization approach generates organ results conforming to anatomy and physiology, without compromising typical quantitative performance in DSC and MSD, to support further clinical interpretation and decision making. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Hanyue Zhou
- Department of Bioengineering, University of California, Los Angeles, Los Angeles, CA, 90095, USA
| | - Minsong Cao
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, CA, 90095, USA
| | - Yugang Min
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, CA, 90095, USA
| | - Stephanie Yoon
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, CA, 90095, USA
| | - Amar Kishan
- Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, CA, 90095, USA
| | - Dan Ruan
- Department of Bioengineering, University of California, Los Angeles, Los Angeles, CA, 90095, USA.,Department of Radiation Oncology, University of California, Los Angeles, Los Angeles, CA, 90095, USA
| |
Collapse
|