1
|
Li S, Zhang M, Xue M, Zhu Q. Difference imaging from single measurements in diffuse optical tomography: a deep learning approach. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:JBO-220081GRR. [PMID: 36008881 PMCID: PMC9403167 DOI: 10.1117/1.jbo.27.8.086003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/16/2022] [Accepted: 08/03/2022] [Indexed: 06/15/2023]
Abstract
SIGNIFICANCE "Difference imaging," which reconstructs target optical properties using measurements with and without target information, is often used in diffuse optical tomography (DOT) in vivo imaging. However, taking additional reference measurements is time consuming, and mismatches between the target medium and the reference medium can cause inaccurate reconstruction. AIM We aim to streamline the data acquisition and mitigate the mismatch problems in DOT difference imaging using a deep learning-based approach to generate data from target measurements only. APPROACH We train an artificial neural network to output data for difference imaging from target measurements only. The model is trained and validated on simulation data and tested with simulations, phantom experiments, and clinical data from 56 patients with breast lesions. RESULTS The proposed method has comparable performance to the traditional approach using measurements without mismatch between the target side and the reference side, and it outperforms the traditional approach using measurements when there is a mismatch. It also improves the target-to-artifact ratio and lesion localization in patient data. CONCLUSIONS The proposed method can simplify the data acquisition procedure, mitigate mismatch problems, and improve reconstructed image quality in DOT difference imaging.
Collapse
Affiliation(s)
- Shuying Li
- Washington University in St. Louis, Optical and Ultrasound Imaging Lab, Department of Biomedical Engineering, St. Louis, Missouri, United States
| | - Menghao Zhang
- Washington University in St. Louis, Optical and Ultrasound Imaging Lab, Department of Electrical and Systems Engineering, St. Louis, Missouri, United States
| | - Minghao Xue
- Washington University in St. Louis, Optical and Ultrasound Imaging Lab, Department of Biomedical Engineering, St. Louis, Missouri, United States
| | - Quing Zhu
- Washington University in St. Louis, Optical and Ultrasound Imaging Lab, Department of Biomedical Engineering, St. Louis, Missouri, United States
- Washington University School of Medicine, Department of Radiology, St. Louis, Missouri, United States
| |
Collapse
|
2
|
Prospects of Structural Similarity Index for Medical Image Analysis. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12083754] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
An image quality matrix provides a significant principle for objectively observing an image based on an alteration between the original and distorted images. During the past two decades, a novel universal image quality assessment has been developed with the ability of adaptation with human visual perception for measuring the difference of a degraded image from the reference image, namely a structural similarity index. Structural similarity has since been widely used in various sectors, including medical image evaluation. Although numerous studies have reported the use of structural similarity as an evaluation strategy for computer-based medical images, reviews on the prospects of using structural similarity for medical imaging applications have been rare. This paper presents previous studies implementing structural similarity in analyzing medical images from various imaging modalities. In addition, this review describes structural similarity from the perspective of a family’s historical background, as well as progress made from the original to the recent structural similarity, and its strengths and drawbacks. Additionally, potential research directions in applying such similarities related to medical image analyses are described. This review will be beneficial in guiding researchers toward the discovery of potential medical image examination methods that can be improved through structural similarity index.
Collapse
|
3
|
Wang X, Hu R, Wang Y, Yan Q, Wang Y, Kang F, Zhu S. A Data Self-Calibration Method Based on High-Density Parallel Plate Diffuse Optical Tomography for Breast Cancer Imaging. Front Oncol 2021; 11:786289. [PMID: 34993144 PMCID: PMC8724432 DOI: 10.3389/fonc.2021.786289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 12/03/2021] [Indexed: 11/13/2022] Open
Abstract
When performing the diffuse optical tomography (DOT) of the breast, the mismatch between the forward model and the experimental conditions will significantly hinder the reconstruction accuracy. Therefore, the reference measurement is commonly used to calibrate the measured data before the reconstruction. However, it is complicated to customize corresponding reference phantoms based on the breast shape and background optical parameters of different subjects in clinical trials. Furthermore, although high-density (HD) DOT configuration has been proven to improve imaging quality, a large number of source-detector (SD) pairs also increase the difficulty of multi-channel correction. To enhance the applicability of the breast DOT, a data self-calibration method based on an HD parallel-plate DOT system is proposed in this paper to replace the conventional relative measurement on a reference phantom. The reference predicted data can be constructed directly from the measurement data with the support of the HD-DOT system, which has nearly a hundred sets of measurements at each SD distance. The proposed scheme has been validated by Monte Carlo (MC) simulation, breast-size phantom experiments, and clinical trials, exhibiting the feasibility in ensuring the quality of the DOT reconstruction while effectively reducing the complexity associated with relative measurements on reference phantoms.
Collapse
Affiliation(s)
- Xin Wang
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
| | - Rui Hu
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
| | - Yirong Wang
- Department of Nuclear Medicine, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Qiang Yan
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
| | - Yihan Wang
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
- *Correspondence: Yihan Wang, ; Shouping Zhu,
| | - Fei Kang
- Department of Nuclear Medicine, Xijing Hospital, Fourth Military Medical University, Xi’an, China
| | - Shouping Zhu
- School of Life Science and Technology, Xidian University, Xi’an, China
- Engineering Research Center of Molecular and Neuro Imaging of Ministry of Education, Xi’an, China
- *Correspondence: Yihan Wang, ; Shouping Zhu,
| |
Collapse
|
4
|
Mudeng V, Kim M, Choe SW. Objective Numerical Evaluation of Diffuse, Optically Reconstructed Images Using Structural Similarity Index. BIOSENSORS 2021; 11:504. [PMID: 34940261 PMCID: PMC8699273 DOI: 10.3390/bios11120504] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Revised: 12/06/2021] [Accepted: 12/06/2021] [Indexed: 05/13/2023]
Abstract
Diffuse optical tomography is emerging as a non-invasive optical modality used to evaluate tissue information by obtaining the optical properties' distribution. Two procedures are performed to produce reconstructed absorption and reduced scattering images, which provide structural information that can be used to locate inclusions within tissues with the assistance of a known light intensity around the boundary. These methods are referred to as a forward problem and an inverse solution. Once the reconstructed image is obtained, a subjective measurement is used as the conventional way to assess the image. Hence, in this study, we developed an algorithm designed to numerically assess reconstructed images to identify inclusions using the structural similarity (SSIM) index. We compared four SSIM algorithms with 168 simulated reconstructed images involving the same inclusion position with different contrast ratios and inclusion sizes. A multiscale, improved SSIM containing a sharpness parameter (MS-ISSIM-S) was proposed to represent the potential evaluation compared with the human visible perception. The results indicated that the proposed MS-ISSIM-S is suitable for human visual perception by demonstrating a reduction of similarity score related to various contrasts with a similar size of inclusion; thus, this metric is promising for the objective numerical assessment of diffuse, optically reconstructed images.
Collapse
Affiliation(s)
- Vicky Mudeng
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39253, Korea;
- Department of Electrical Engineering, Institut Teknologi Kalimantan, Balikpapan 76127, Indonesia
| | - Minseok Kim
- Department of Mechanical System Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea
- Department of Aeronautics, Mechanical and Electronic Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Korea
| | - Se-woon Choe
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39253, Korea;
- Department of IT Convergence Engineering, Kumoh National Institute of Technology, Gumi 39253, Korea
| |
Collapse
|
5
|
Li S, Zhang M, Zhu Q. Ultrasound segmentation-guided edge artifact reduction in diffuse optical tomography using connected component analysis. BIOMEDICAL OPTICS EXPRESS 2021; 12:5320-5336. [PMID: 34513259 PMCID: PMC8407838 DOI: 10.1364/boe.428107] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Revised: 07/09/2021] [Accepted: 07/12/2021] [Indexed: 05/02/2023]
Abstract
Ultrasound (US)-guided diffuse optical tomography (DOT) has demonstrated potential value for breast cancer diagnosis and treatment response assessment. However, in clinical use, the chest wall, poor probe-tissue contact, and tissue heterogeneity can all cause image artifacts. These image artifacts, appearing commonly as hot spots in the non-lesion regions (edge artifacts), can decrease the reconstruction accuracy and cause misinterpretation of lesion images. Here we introduce an iterative, connected component analysis-based image artifact reduction algorithm. A convolutional neural network (CNN) is used to segment co-registered US images to extract the lesion location and size to guide the artifact reduction. We demonstrate its performance using Monte Carlo simulations on VICTRE digital breast phantoms and breast patient images. In simulated tissue mismatch models, this algorithm successfully reduces edge artifacts without significantly changing the reconstructed target absorption coefficients. With clinical data it improves the optical contrast between malignant and benign groups, from 1.55 without artifact reduction to 1.91 with artifact reduction. The proposed algorithm has a broad range of applications in other modality-guided DOT imaging.
Collapse
Affiliation(s)
- Shuying Li
- Department of Biomedical Engineering, Washington University in St. Louis, 1 Brookings Dr, St. Louis 63130, USA
| | - Menghao Zhang
- Department of Electrical & Systems Engineering, Washington University in St. Louis, 1 Brookings Dr, St. Louis 63130, USA
| | - Quing Zhu
- Department of Biomedical Engineering, Washington University in St. Louis, 1 Brookings Dr, St. Louis 63130, USA
- Department of Radiology, Washington University School of Medicine, 660 S Euclid Ave, St. Louis 63110, USA
| |
Collapse
|
6
|
Li S, Huang K, Zhang M, Uddin KMS, Zhu Q. Effect and correction of optode coupling errors in breast imaging using diffuse optical tomography. BIOMEDICAL OPTICS EXPRESS 2021; 12:689-704. [PMID: 33680536 PMCID: PMC7901340 DOI: 10.1364/boe.411595] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 11/27/2020] [Accepted: 12/08/2020] [Indexed: 05/18/2023]
Abstract
In diffuse optical tomography (DOT) and spectroscopy (DOS) using handheld probes, tissue curvature can cause bad fiber-to-tissue contact. Understanding and minimizing image artifacts caused by these coupling errors would significantly improve DOT and DOS image quality. In this work, we utilized Monte Carlo simulations and experiments with gelatin-Intralipid phantoms to systematically study the influence of source or detector (optode) coupling errors. Optode coupling errors can increase the amplitude and decrease the phase of the measured diffuse reflectance, creating artifacts in the reconstructed absorption maps, such as hot spots on the edges. We propose an outlier removal algorithm that can correct these image artifacts, and we demonstrate its performance using simulations, phantom experiments, and breast patient data acquired with bad probe contact due to a dense or small breast. Further, we designed and implemented a new resistance-type thin-film force sensor array that provides real-time optode coupling feedback and guides the outlier removal to minimize optode coupling errors. Our approaches and study results have significant implications for reducing image artifacts arising from handheld probes, which are commonly used with mobile and wearable DOT and DOS devices.
Collapse
Affiliation(s)
- Shuying Li
- Department of Biomedical Engineering,
Washington University in St. Louis, 1 Brookings Dr, St. Louis 63130,
USA
| | - Kexin Huang
- Department of Biomedical Engineering,
Washington University in St. Louis, 1 Brookings Dr, St. Louis 63130,
USA
| | - Menghao Zhang
- Department of Electrical and Systems
Engineering, Washington University in St. Louis, 1 Brookings Dr, St.
Louis 63130, USA
| | - K. M. Shihab Uddin
- Department of Biomedical Engineering,
Washington University in St. Louis, 1 Brookings Dr, St. Louis 63130,
USA
| | - Quing Zhu
- Department of Biomedical Engineering,
Washington University in St. Louis, 1 Brookings Dr, St. Louis 63130,
USA
- Department of Radiology, Washington
University School of Medicine, 660 S Euclid Ave, St. Louis 63110,
USA
| |
Collapse
|
7
|
Jiang J, Costanzo Mata AD, Lindner S, Zhang C, Charbon E, Wolf M, Kalyanov A. Image reconstruction for novel time domain near infrared optical tomography: towards clinical applications. BIOMEDICAL OPTICS EXPRESS 2020; 11:4723-4734. [PMID: 32923074 PMCID: PMC7449738 DOI: 10.1364/boe.398885] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2020] [Revised: 07/17/2020] [Accepted: 07/17/2020] [Indexed: 05/04/2023]
Abstract
Near infrared optical tomography (NIROT) is an emerging modality that enables imaging the oxygenation of tissue, which is a biomarker of tremendous clinical relevance. Measuring in reflectance is usually required when NIROT is applied in clinical scenarios. Single photon avalanche diode (SPAD) array technology provides a compact solution for time domain (TD) NIROT to gain huge temporal and spatial information. This makes it possible to image complex structures in tissue. The main aim of this paper is to validate the wavelength normalization method for our new TD NIROT experimentally by exposing it to a particularly difficult challenge: the recovery of two inclusions at different depths. The proposed reconstruction algorithm aims to tackle systematic errors and other artifacts with known wavelength-dependent relation. We validated the device and reconstruction method experimentally on a silicone phantom with two inclusions: one at depth of 10 mm and the other at 15 mm. Despite this tough challenge for reflectance NIROT, the system was able to localize both inclusions accurately.
Collapse
Affiliation(s)
- Jingjing Jiang
- Biomedical Optics Research Laboratory, Dept. of Neonatology, University Hospital Zurich and University of Zurich, Switzerland
| | - Aldo Di Costanzo Mata
- Biomedical Optics Research Laboratory, Dept. of Neonatology, University Hospital Zurich and University of Zurich, Switzerland
| | - Scott Lindner
- Biomedical Optics Research Laboratory, Dept. of Neonatology, University Hospital Zurich and University of Zurich, Switzerland
- Advanced Quantum Architecture Laboratory, EPFL, 2002 Neuchâtel, Switzerland
| | - Chao Zhang
- Advanced Quantum Architecture Laboratory, EPFL, 2002 Neuchâtel, Switzerland
| | - Edoardo Charbon
- Advanced Quantum Architecture Laboratory, EPFL, 2002 Neuchâtel, Switzerland
| | - Martin Wolf
- Biomedical Optics Research Laboratory, Dept. of Neonatology, University Hospital Zurich and University of Zurich, Switzerland
| | - Alexander Kalyanov
- Biomedical Optics Research Laboratory, Dept. of Neonatology, University Hospital Zurich and University of Zurich, Switzerland
| |
Collapse
|
8
|
Uddin KMS, Zhang M, Anastasio M, Zhu Q. Optimal breast cancer diagnostic strategy using combined ultrasound and diffuse optical tomography. BIOMEDICAL OPTICS EXPRESS 2020; 11:2722-2737. [PMID: 32499955 PMCID: PMC7249842 DOI: 10.1364/boe.389275] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2020] [Revised: 03/19/2020] [Accepted: 03/31/2020] [Indexed: 05/02/2023]
Abstract
Ultrasound (US)-guided near-infrared diffuse optical tomography (DOT) has demonstrated great potential as an adjunct breast cancer diagnosis tool to US imaging alone, especially in reducing unnecessary benign biopsies. However, DOT data processing and image reconstruction speeds remain slow compared to the real-time speed of US. Real-time or near real-time diagnosis with DOT is an important step toward the clinical translation of US-guided DOT. Here, to address this important need, we present a two-stage diagnostic strategy that is both computationally efficient and accurate. In the first stage, benign lesions are identified in near real-time by use of a random forest classifier acting on the DOT measurements and the radiologists' US diagnostic scores. Any lesions that cannot be reliably classified by the random forest classifier will be passed on to the second stage which begins with image reconstruction. Functional information from the reconstructed hemoglobin concentrations is employed by a Support Vector Machine (SVM) classifier for diagnosis at the end of the second stage. This two-step classification approach which combines both perturbation data and functional features, results in improved classification, as denoted by the receiver operating characteristic (ROC) curve. Using this two-step approach, the area under the ROC curve (AUC) is 0.937 ± 0.009, with a sensitivity of 91.4% and specificity of 85.7%. In comparison, using functional features and US score yields an AUC of 0.892 ± 0.027, with a sensitivity of 90.2% and specificity of 74.5%. Most notably, the specificity is increased by more than 10% due to the implementation of the random forest classifier.
Collapse
Affiliation(s)
- K. M. Shihab Uddin
- Biomedical Engineering Department, Washington University in St. Louis, 1 Brooking Dr, St. Louis, MO 63130, USA
| | - Menghao Zhang
- Electrical and System Engineering Department, Washington University in St. Louis, 1 Brooking Dr, St. Louis, MO 63130, USA
| | - Mark Anastasio
- Biomedical Engineering Department, Washington University in St. Louis, 1 Brooking Dr, St. Louis, MO 63130, USA
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1406 W Green St, Urbana, IL 61801, USA
| | - Quing Zhu
- Biomedical Engineering Department, Washington University in St. Louis, 1 Brooking Dr, St. Louis, MO 63130, USA
| |
Collapse
|