1
|
Cheng S, Chang S, Li Y, Novoseltseva A, Lin S, Wu Y, Zhu J, McKee AC, Rosene DL, Wang H, Bigio IJ, Boas DA, Tian L. Enhanced multiscale human brain imaging by semi-supervised digital staining and serial sectioning optical coherence tomography. LIGHT, SCIENCE & APPLICATIONS 2025; 14:57. [PMID: 39833166 PMCID: PMC11746934 DOI: 10.1038/s41377-024-01658-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Revised: 09/29/2024] [Accepted: 10/11/2024] [Indexed: 01/22/2025]
Abstract
A major challenge in neuroscience is visualizing the structure of the human brain at different scales. Traditional histology reveals micro- and meso-scale brain features but suffers from staining variability, tissue damage, and distortion, which impedes accurate 3D reconstructions. The emerging label-free serial sectioning optical coherence tomography (S-OCT) technique offers uniform 3D imaging capability across samples but has poor histological interpretability despite its sensitivity to cortical features. Here, we present a novel 3D imaging framework that combines S-OCT with a deep-learning digital staining (DS) model. This enhanced imaging modality integrates high-throughput 3D imaging, low sample variability and high interpretability, making it suitable for 3D histology studies. We develop a novel semi-supervised learning technique to facilitate DS model training on weakly paired images for translating S-OCT to Gallyas silver staining. We demonstrate DS on various human cerebral cortex samples, achieving consistent staining quality and enhancing contrast across cortical layer boundaries. Additionally, we show that DS preserves geometry in 3D on cubic-centimeter tissue blocks, allowing for visualization of meso-scale vessel networks in the white matter. We believe that our technique has the potential for high-throughput, multiscale imaging of brain tissues and may facilitate studies of brain structures.
Collapse
Affiliation(s)
- Shiyi Cheng
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
| | - Shuaibin Chang
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
| | - Yunzhe Li
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA, 94720, USA
| | - Anna Novoseltseva
- Department of Biomedical Engineering, Boston University, Boston, MA, 02215, USA
| | - Sunni Lin
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, Boston, MA, 02215, USA
| | - Yicun Wu
- Department of Computer Science, Boston University, Boston, MA, 02215, USA
| | - Jiahui Zhu
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
| | - Ann C McKee
- Boston University Alzheimer's Disease Research Center and CTE Center, Boston University School of Medicine, Boston, MA, 02118, USA
- Department of Neurology, Boston University School of Medicine, Boston, MA, 02118, USA
- VA Boston Healthcare System, U.S. Department of Veteran Affairs, Boston, MA, 02130, USA
- Department of Pathology and Laboratory Medicine, Boston University School of Medicine, Boston, MA, 02118, USA
| | - Douglas L Rosene
- Department of Anatomy & Neurobiology, Boston University School of Medicine, Boston, MA, USA
| | - Hui Wang
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, 02129, USA
| | - Irving J Bigio
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, Boston, MA, 02215, USA
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA
| | - David A Boas
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, Boston, MA, 02215, USA
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA
| | - Lei Tian
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA.
- Department of Biomedical Engineering, Boston University, Boston, MA, 02215, USA.
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA.
| |
Collapse
|
2
|
Li S, Higashita R, Fu H, Yang B, Liu J. Score Prior Guided Iterative Solver for Speckles Removal in Optical Coherent Tomography Images. IEEE J Biomed Health Inform 2025; 29:248-258. [PMID: 39437277 DOI: 10.1109/jbhi.2024.3480928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2024]
Abstract
Optical coherence tomography (OCT) is a widely used non-invasive imaging modality for ophthalmic diagnosis. However, the inherent speckle noise becomes the leading cause of OCT image quality, and efficient speckle removal algorithms can improve image readability and benefit automated clinical analysis. As an ill-posed inverse problem, it is of utmost importance for speckle removal to learn suitable priors. In this work, we develop a score prior guided iterative solver (SPIS) with logarithmic space to remove speckles in OCT images. Specifically, we model the posterior distribution of raw OCT images as a data consistency term and transform the speckle removal from a nonlinear into a linear inverse problem in the logarithmic domain. Subsequently, the learned prior distribution through the score function from the diffusion model is utilized as a constraint for the data consistency term into the linear inverse optimization, resulting in an iterative speckle removal procedure that alternates between the score prior predictor and the subsequent non-expansive data consistency corrector. Experimental results on the private and public OCT datasets demonstrate that the proposed SPIS has an excellent performance in speckle removal and out-of-distribution (OOD) generalization. Further downstream automatic analysis on the OCT images verifies that the proposed SPIS can benefit clinical applications.
Collapse
|
3
|
Chintada BR, Ruiz-Lopera S, Restrepo R, Bouma BE, Villiger M, Uribe-Patarroyo N. Probabilistic volumetric speckle suppression in OCT using deep learning. BIOMEDICAL OPTICS EXPRESS 2024; 15:4453-4469. [PMID: 39346991 PMCID: PMC11427188 DOI: 10.1364/boe.523716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Revised: 06/17/2024] [Accepted: 06/18/2024] [Indexed: 10/01/2024]
Abstract
We present a deep learning framework for volumetric speckle reduction in optical coherence tomography (OCT) based on a conditional generative adversarial network (cGAN) that leverages the volumetric nature of OCT data. In order to utilize the volumetric nature of OCT data, our network takes partial OCT volumes as input, resulting in artifact-free despeckled volumes that exhibit excellent speckle reduction and resolution preservation in all three dimensions. Furthermore, we address the ongoing challenge of generating ground truth data for supervised speckle suppression deep learning frameworks by using volumetric non-local means despeckling-TNode- to generate training data. We show that, while TNode processing is computationally demanding, it serves as a convenient, accessible gold-standard source for training data; our cGAN replicates efficient suppression of speckle while preserving tissue structures with dimensions approaching the system resolution of non-local means despeckling while being two orders of magnitude faster than TNode. We demonstrate fast, effective, and high-quality despeckling of the proposed network in different tissue types that are not part of the training. This was achieved with training data composed of just three OCT volumes and demonstrated in three different OCT systems. The open-source nature of our work facilitates re-training and deployment in any OCT system with an all-software implementation, working around the challenge of generating high-quality, speckle-free training data.
Collapse
Affiliation(s)
- Bhaskara Rao Chintada
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| | - Sebastián Ruiz-Lopera
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02142, USA
| | - René Restrepo
- Applied Optics Group, Universidad EAFIT, Carrera 49 # 7 Sur-50, Medellín, Colombia
| | - Brett E. Bouma
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
- Institute of Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA 02142, USA
| | - Martin Villiger
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| | - Néstor Uribe-Patarroyo
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| |
Collapse
|
4
|
Daneshmand PG, Rabbani H. Tensor Ring Decomposition Guided Dictionary Learning for OCT Image Denoising. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2547-2562. [PMID: 38393847 DOI: 10.1109/tmi.2024.3369176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/25/2024]
Abstract
Optical coherence tomography (OCT) is a non-invasive and effective tool for the imaging of retinal tissue. However, the heavy speckle noise, resulting from multiple scattering of the light waves, obscures important morphological structures and impairs the clinical diagnosis of ocular diseases. In this paper, we propose a novel and powerful model known as tensor ring decomposition-guided dictionary learning (TRGDL) for OCT image denoising, which can simultaneously utilize two useful complementary priors, i.e., three-dimensional low-rank and sparsity priors, under a unified framework. Specifically, to effectively use the strong correlation between nearby OCT frames, we construct the OCT group tensors by extracting cubic patches from OCT images and clustering similar patches. Then, since each created OCT group tensor has a low-rank structure, to exploit spatial, non-local, and its temporal correlations in a balanced way, we enforce the TR decomposition model on each OCT group tensor. Next, to use the beneficial three-dimensional inter-group sparsity, we learn shared dictionaries in both spatial and temporal dimensions from all of the stacked OCT group tensors. Furthermore, we develop an effective algorithm to solve the resulting optimization problem by using two efficient optimization approaches, including proximal alternating minimization and the alternative direction method of multipliers. Finally, extensive experiments on OCT datasets from various imaging devices are conducted to prove the generality and usefulness of the proposed TRGDL model. Experimental simulation results show that the suggested TRGDL model outperforms state-of-the-art approaches for OCT image denoising both qualitatively and quantitatively.
Collapse
|
5
|
Cheng S, Chang S, Li Y, Novoseltseva A, Lin S, Wu Y, Zhu J, McKee AC, Rosene DL, Wang H, Bigio IJ, Boas DA, Tian L. Enhanced Multiscale Human Brain Imaging by Semi-supervised Digital Staining and Serial Sectioning Optical Coherence Tomography. RESEARCH SQUARE 2024:rs.3.rs-4014687. [PMID: 38562721 PMCID: PMC10984089 DOI: 10.21203/rs.3.rs-4014687/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
A major challenge in neuroscience is to visualize the structure of the human brain at different scales. Traditional histology reveals micro- and meso-scale brain features, but suffers from staining variability, tissue damage and distortion that impedes accurate 3D reconstructions. Here, we present a new 3D imaging framework that combines serial sectioning optical coherence tomography (S-OCT) with a deep-learning digital staining (DS) model. We develop a novel semi-supervised learning technique to facilitate DS model training on weakly paired images. The DS model performs translation from S-OCT to Gallyas silver staining. We demonstrate DS on various human cerebral cortex samples with consistent staining quality. Additionally, we show that DS enhances contrast across cortical layer boundaries. Furthermore, we showcase geometry-preserving 3D DS on cubic-centimeter tissue blocks and visualization of meso-scale vessel networks in the white matter. We believe that our technique offers the potential for high-throughput, multiscale imaging of brain tissues and may facilitate studies of brain structures.
Collapse
Affiliation(s)
- Shiyi Cheng
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
| | - Shuaibin Chang
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
| | - Yunzhe Li
- Department of Electrical Engineering and Computer Sciences, University of California, Cory Hall, Berkeley, California, 94720, USA
| | - Anna Novoseltseva
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
| | - Sunni Lin
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
| | - Yicun Wu
- Department of Computer Science, Boston University, 665 Commonwealth Ave, Boston, MA, 02215, USA
| | - Jiahui Zhu
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
| | - Ann C. McKee
- Boston University Alzheimer’s Disease Research Center and CTE Center, Boston University, Chobanian and Avedisian School of Medicine, Boston, MA, 02118, USA
- Department of Neurology, Boston University, Chobanian and Avedisian School of Medicine, Boston, MA, 02118, USA
- VA Boston Healthcare System, U.S. Department of Veteran Affairs, Jamaica Plain, MA, 02130, USA
- Department of Psychiatry and Ophthalmology, Boston University School of Medicine, Boston, MA, 02118, USA
- Department of Pathology and Laboratory Medicine, Boston University School of Medicine, Boston, MA, 02118, USA
| | - Douglas L. Rosene
- Department of Anatomy & Neurobiology, Boston University Chobanian & Avedisian School of Medicine, Boston, Massachusetts, USA
| | - Hui Wang
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital/Harvard Medical School, Charlestown, MA, 02129, USA
| | - Irving J. Bigio
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA
| | - David A. Boas
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA
| | - Lei Tian
- Department of Electrical and Computer Engineering, Boston University, 8 St Mary’s St, Boston, MA, 02215, USA
- Department of Biomedical Engineering, Boston University, 44 Cummington Mall, Boston MA, 02215, USA
- Neurophotonics Center, Boston University, Boston, MA, 02215, USA
| |
Collapse
|
6
|
CHINTADA BHASKARARAO, RUIZ-LOPERA SEBASTIÁN, RESTREPO RENÉ, BOUMA BRETTE, VILLIGER MARTIN, URIBE-PATARROYO NÉSTOR. Probabilistic volumetric speckle suppression in OCT using deep learning. ARXIV 2023:arXiv:2312.04460v1. [PMID: 38106457 PMCID: PMC10723542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
We present a deep learning framework for volumetric speckle reduction in optical coherence tomography (OCT) based on a conditional generative adversarial network (cGAN) that leverages the volumetric nature of OCT data. In order to utilize the volumetric nature of OCT data, our network takes partial OCT volumes as input, resulting in artifact-free despeckled volumes that exhibit excellent speckle reduction and resolution preservation in all three dimensions. Furthermore, we address the ongoing challenge of generating ground truth data for supervised speckle suppression deep learning frameworks by using volumetric non-local means despeckling-TNode to generate training data. We show that, while TNode processing is computationally demanding, it serves as a convenient, accessible gold-standard source for training data; our cGAN replicates efficient suppression of speckle while preserving tissue structures with dimensions approaching the system resolution of non-local means despeckling while being two orders of magnitude faster than TNode. We demonstrate fast, effective, and high-quality despeckling of the proposed network in different tissue types acquired with three different OCT systems compared to existing deep learning methods. The open-source nature of our work facilitates re-training and deployment in any OCT system with an all-software implementation, working around the challenge of generating high-quality, speckle-free training data.
Collapse
Affiliation(s)
- BHASKARA RAO CHINTADA
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| | - SEBASTIÁN RUIZ-LOPERA
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02142, USA
| | - RENÉ RESTREPO
- Applied Optics Group, Universidad EAFIT, Carrera 49 # 7 Sur-50, Medellín, Colombia
| | - BRETT E. BOUMA
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
- Institute of Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, MA 02142, USA
| | - MARTIN VILLIGER
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| | - NÉSTOR URIBE-PATARROYO
- Wellman Center for Photomedicine, Massachusetts General Hospital, Boston, MA 02114, USA
- Harvard Medical School, Boston, MA 02115, USA
| |
Collapse
|