Harnessing non-destructive 3D pathology

Analysis of 3D pathology samples using weakly supervised AI

Human tissue, which is inherently three-dimensional (3D), is traditionally examined through standard-of-care histopathology as limited two-dimensional (2D) cross-sections that can insufficiently represent the tissue due to sampling bias. To holistically characterize histomorphology, 3D imaging modalities have been developed, but clinical translation is hampered by complex manual evaluation and lack of computational platforms to distill clinical insights from large, high-resolution datasets. We present TriPath, a deep-learning platform for processing tissue volumes and efficiently predicting clinical outcomes based on 3D morphological features. Recurrence risk-stratification models were trained on prostate cancer specimens imaged with open-top light-sheet microscopy or microcomputed tomography. By comprehensively capturing 3D morphologies, 3D volume-based prognostication achieves superior performance to traditional 2D slice-based approaches, including clinical/histopathological baselines from six certified genitourinary pathologists. Incorporating greater tissue volume improves prognostic performance and mitigates risk prediction variability from sampling bias, further emphasizing the value of capturing larger extents of heterogeneous morphology.

Increased Multiplexity in Optical Tissue Clearing-Based Three-Dimensional Immunofluorescence Microscopy of the Tumor Microenvironment by Light-Emitting Diode Photobleaching

Optical tissue clearing and three-dimensional (3D) immunofluorescence (IF) microscopy is transforming imaging of the complex tumor microenvironment (TME). However, current 3D IF microscopy has restricted multiplexity; only 3 or 4 cellular and noncellular TME components can be localized in cleared tumor tissue. Here we report a light-emitting diode (LED) photobleaching method and its application for 3D multiplexed optical mapping of the TME. We built a high-power LED light irradiation device and temperature-controlled chamber for completely bleaching fluorescent signals throughout optically cleared tumor tissues without compromise of tissue and protein antigen integrity. With newly developed tissue mounting and selected region-tracking methods, we established a cyclic workflow involving IF staining, tissue clearing, 3D confocal microscopy, and LED photobleaching. By registering microscope channel images generated through 3 work cycles, we produced 8-plex image data from individual 400 μm-thick tumor macrosections that visualize various vascular, immune, and cancer cells in the same TME at tissue-wide and cellular levels in 3D. Our method was also validated for quantitative 3D spatial analysis of cellular remodeling in the TME after immunotherapy. These results demonstrate that our LED photobleaching system and its workflow offer a novel approach to increase the multiplexing power of 3D IF microscopy for studying tumor heterogeneity and response to therapy.

The 3D Revolution in Cancer Discovery

SUMMARY

The transition from 2D to 3D spatial profiling marks a revolutionary era in cancer research, offering unprecedented potential to enhance cancer diagnosis and treatment. This commentary outlines the experimental and computational advancements and challenges in 3D spatial molecular profiling, underscoring the innovation needed in imaging tools, software, artificial intelligence, and machine learning to overcome implementation hurdles and harness the full potential of 3D analysis in the field.

An end-to-end workflow for nondestructive 3D pathology

Recent advances in 3D pathology offer the ability to image orders of magnitude more tissue than conventional pathology methods while also providing a volumetric context that is not achievable with 2D tissue sections, and all without requiring destructive tissue sectioning. Generating high-quality 3D pathology datasets on a consistent basis, however, is not trivial and requires careful attention to a series of details during tissue preparation, imaging and initial data processing, as well as iterative optimization of the entire process. Here, we provide an end-to-end procedure covering all aspects of a 3D pathology workflow (using light-sheet microscopy as an illustrative imaging platform) with sufficient detail to perform well-controlled preclinical and clinical studies. Although 3D pathology is compatible with diverse staining protocols and computationally generated color palettes for visual analysis, this protocol focuses on the use of a fluorescent analog of hematoxylin and eosin, which remains the most common stain used for gold-standard pathological reports. We present our guidelines for a broad range of end users (e.g., biologists, clinical researchers and engineers) in a simple format. The end-to-end workflow requires 3-6 d to complete, bearing in mind that data analysis may take longer.

Current Landscape of Advanced Imaging Tools for Pathology Diagnostics

Histopathology relies on century-old workflows of formalin fixation, paraffin embedding, sectioning, and staining tissue specimens on glass slides. Despite being robust, this conventional process is slow, labor-intensive, and limited to providing two-dimensional views. Emerging technologies promise to enhance and accelerate histopathology. Slide-free microscopy allows rapid imaging of fresh, unsectioned specimens, overcoming slide preparation delays. Methods such as fluorescence confocal microscopy, multiphoton microscopy, along with more recent innovations including microscopy with UV surface excitation and fluorescence-imitating brightfield imaging can generate images resembling conventional histology directly from the surface of tissue specimens. Slide-free microscopy enable applications such as rapid intraoperative margin assessment and, with appropriate technology, three-dimensional histopathology. Multiomics profiling techniques, including imaging mass spectrometry and Raman spectroscopy, provide highly multiplexed molecular maps of tissues, although clinical translation remains challenging. Artificial intelligence is aiding the adoption of new imaging modalities via virtual staining, which converts methods such as slide-free microscopy into synthetic brightfield-like or even molecularly informed images. Although not yet commonplace, these emerging technologies collectively demonstrate the potential to modernize histopathology. Artificial intelligence-assisted workflows will ease the transition to new imaging modalities. With further validation, these advances may transform the century-old conventional histopathology pipeline to better serve 21st-century medicine. This review provides an overview of these enabling technology platforms and discusses their potential impact.

Blueprints from plane to space: outlook of next-generation three-dimensional histopathology

Here, we summarize the literature relevant to recent advances in three-dimensional (3D) histopathology in relation to clinical oncology, highlighting serial sectioning, tissue clearing, light-sheet microscopy, and digital image analysis with artificial intelligence. We look forward to a future where 3D histopathology expands our understanding of human pathophysiology and improves patient care through cross-disciplinary collaboration and innovation.

Open-top Bessel beam two-photon light sheet microscopy for three-dimensional pathology

Nondestructive pathology based on three-dimensional (3D) optical microscopy holds promise as a complement to traditional destructive hematoxylin and eosin (H&E) stained slide-based pathology by providing cellular information in high throughput manner. However, conventional techniques provided superficial information only due to shallow imaging depths. Herein, we developed open-top two-photon light sheet microscopy (OT-TP-LSM) for intraoperative 3D pathology. An extended depth of field two-photon excitation light sheet was generated by scanning a nondiffractive Bessel beam, and selective planar imaging was conducted with cameras at 400 frames/s max during the lateral translation of tissue specimens. Intrinsic second harmonic generation was collected for additional extracellular matrix (ECM) visualization. OT-TP-LSM was tested in various human cancer specimens including skin, pancreas, and prostate. High imaging depths were achieved owing to long excitation wavelengths and long wavelength fluorophores. 3D visualization of both cells and ECM enhanced the ability of cancer detection. Furthermore, an unsupervised deep learning network was employed for the style transfer of OT-TP-LSM images to virtual H&E images. The virtual H&E images exhibited comparable histological characteristics to real ones. OT-TP-LSM may have the potential for histopathological examination in surgical and biopsy applications by rapidly providing 3D information.

Direct three-dimensional segmentation of prostate glands with nnU-Net

Significance

In recent years, we and others have developed non-destructive methods to obtain three-dimensional (3D) pathology datasets of clinical biopsies and surgical specimens. For prostate cancer risk stratification (prognostication), standard-of-care Gleason grading is based on examining the morphology of prostate glands in thin 2D sections. This motivates us to perform 3D segmentation of prostate glands in our 3D pathology datasets for the purposes of computational analysis of 3D glandular features that could offer improved prognostic performance.

Aim

To facilitate prostate cancer risk assessment, we developed a computationally efficient and accurate deep learning model for 3D gland segmentation based on open-top light-sheet microscopy datasets of human prostate biopsies stained with a fluorescent analog of hematoxylin and eosin (H&E).

Approach

For 3D gland segmentation based on our H&E-analog 3D pathology datasets, we previously developed a hybrid deep learning and computer vision-based pipeline, called image translation-assisted segmentation in 3D (ITAS3D), which required a complex two-stage procedure and tedious manual optimization of parameters. To simplify this procedure, we use the 3D gland-segmentation masks previously generated by ITAS3D as training datasets for a direct end-to-end deep learning-based segmentation model, nnU-Net. The inputs to this model are 3D pathology datasets of prostate biopsies rapidly stained with an inexpensive fluorescent analog of H&E and the outputs are 3D semantic segmentation masks of the gland epithelium, gland lumen, and surrounding stromal compartments within the tissue.

Results

nnU-Net demonstrates remarkable accuracy in 3D gland segmentations even with limited training data. Moreover, compared with the previous ITAS3D pipeline, nnU-Net operation is simpler and faster, and it can maintain good accuracy even with lower-resolution inputs.

Conclusions

Our trained DL-based 3D segmentation model will facilitate future studies to demonstrate the value of computational 3D pathology for guiding critical treatment decisions for patients with prostate cancer.

A novel micro-CT analysis for evaluating the regenerative potential of bone augmentation xenografts in rabbit calvarias

Guided Bone Regeneration is a common procedure, yet, as new grafting materials are being introduced into the market, a reliable evaluation method is required. Critical size defect in animal models provides an accurate simulation, followed by histological sections to evaluate the new bone formation. However, histology is destructive, two-dimensional and technique-sensitive. In this study we developed a novel volumetric Micro-CT analysis to quantify new bone formation characteristics. Eight adult female New Zealand white rabbits were subjected to calvarial critical-size defects. Four 8 mm in diameter circular defects were preformed in each animal, to allow random allocation of four treatment modalities. All calvarias were scanned using Micro-CT. Each defect was segmented into four equal parts: pristine bone, outer, middle, and inner. Amira software (v. 6.3, www.fei.com ) was used to calculate the new bone volume in each region and compare it to that of the pristine bone. All grafting materials demonstrated that new bone formation decreased as it moved inward. Only the inner region differed across grafting materials (p = 0.001). The new Micro-CT analysis allowed us to divide each defect into 3D regions providing better understanding of the bone formation process. Amongst the various advantages of the Micro-CT, it enables us to quantify the graft materials and the newly formed bone independently, and to describe the defect morphology in 3D (bi- vs. uni-cortical defects). Providing an insight into the inner region of the defect can better predict the regenerative potential of the bone augmentation graft material. Therefore, the suggested Micro-CT analysis is beneficial for further developing of clinical approaches.

Artificial Intelligence and Pathomics: Prostate Cancer

Artificial intelligence (AI) has the potential to transform pathologic diagnosis and cancer patient management as a predictive and prognostic biomarker. AI-based systems can be used to examine digitally scanned histopathology slides and differentiate benign from malignant cells and low from high grade. Deep learning models can analyze patient data from individual or multimodal combinations and identify patterns to be used to predict the response to different therapeutic options, the risk of recurrence or progression, and the prognosis of the newly diagnosed patient. AI-based models will improve treatment planning for patients with prostate cancer and improve the efficiency and cost-effectiveness of the pathology laboratory.

A novel computer-assisted tool for 3D imaging of programmed death-ligand 1 expression in immunofluorescence-stained and optically cleared breast cancer specimens

BACKGROUND

Programmed death-1 (PD-1) and programmed death-ligand 1 (PD-L1) are the two most common immune checkpoints targeted in triple-negative breast cancer (BC). Refining patient selection for immunotherapy is non-trivial and finding an appropriate digital pathology framework for spatial analysis of theranostic biomarkers for PD-1/PD-L1 inhibitors remains an unmet clinical need.

METHODS

We describe a novel computer-assisted tool for three-dimensional (3D) imaging of PD-L1 expression in immunofluorescence-stained and optically cleared BC specimens (n = 20). The proposed 3D framework appeared to be feasible and showed a high overall agreement with traditional, clinical-grade two-dimensional (2D) staining techniques. Additionally, the results obtained for automated immune cell detection and analysis of PD-L1 expression were satisfactory.

RESULTS

The spatial distribution of PD-L1 expression was heterogeneous across various BC tissue layers in the 3D space. Notably, there were six cases (30%) wherein PD-L1 expression levels along different layers crossed the 1% threshold for admitting patients to PD-1/PD-L1 inhibitors. The average PD-L1 expression in 3D space was different from that of traditional immunohistochemistry (IHC) in eight cases (40%). Pending further standardization and optimization, we expect that our technology will become a valuable addition for assessing PD-L1 expression in patients with BC.

CONCLUSION

Via a single round of immunofluorescence imaging, our approach may provide a considerable improvement in patient stratification for cancer immunotherapy as compared with standard techniques.

Engineering the future of 3D pathology

In recent years, technological advances in tissue preparation, high-throughput volumetric microscopy, and computational infrastructure have enabled rapid developments in nondestructive 3D pathology, in which high-resolution histologic datasets are obtained from thick tissue specimens, such as whole biopsies, without the need for physical sectioning onto glass slides. While 3D pathology generates massive datasets that are attractive for automated computational analysis, there is also a desire to use 3D pathology to improve the visual assessment of tissue histology. In this perspective, we discuss and provide examples of potential advantages of 3D pathology for the visual assessment of clinical specimens and the challenges of dealing with large 3D datasets (of individual or multiple specimens) that pathologists have not been trained to interpret. We discuss the need for artificial intelligence triaging algorithms and explainable analysis methods to assist pathologists or other domain experts in the interpretation of these novel, often complex, large datasets.

Beyond 2D: A scalable and highly sensitive method for a comprehensive 3D analysis of kidney biopsy tissue

The spatial organization of various cell populations is critical for the major physiological and pathological processes in the kidneys. Most evaluation of these processes typically comes from a conventional 2D tissue cross-section, visualizing a limited amount of cell organization. Therefore, the 2D analysis of kidney biopsy introduces selection bias. The 2D analysis potentially omits key pathological findings outside a 1- to 10-μm thin-sectioned area and lacks information on tissue organization, especially in a particular irregular structure such as crescentic glomeruli. In this study, we introduce an easy-to-use and scalable method for obtaining high-quality images of molecules of interest in a large tissue volume, enabling a comprehensive evaluation of the 3D organization and cellular composition of kidney tissue, especially the glomerular structure. We show that CUBIC and ScaleS clearing protocols could allow a 3D analysis of the kidney tissues in human and animal models of kidney disease. We also demonstrate that the paraffin-embedded human biopsy specimens previously examined via 2D evaluation could be applicable to 3D analysis, showing a potential utilization of this method in kidney biopsy tissue collected in the past. In summary, the 3D analysis of kidney biopsy provides a more comprehensive analysis and a minimized selection bias than 2D tissue analysis. Additionally, this method enables a quantitative evaluation of particular kidney structures and their surrounding tissues, with the potential utilization from basic science investigation to applied diagnostics in nephrology.

Increased multiplexity in optical tissue clearing-based 3D immunofluorescence microscopy of the tumor microenvironment by LED photobleaching

Optical tissue clearing and three-dimensional (3D) immunofluorescence (IF) microscopy have been transforming imaging of the complex tumor microenvironment (TME). However, current 3D IF microscopy has restricted multiplexity; only three or four cellular and non-cellular TME components can be localized in a cleared tumor tissue. Here we report a LED photobleaching method and its application for 3D multiplexed optical mapping of the TME. We built a high-power LED light irradiation device and temperature-controlled chamber for completely bleaching fluorescent signals throughout optically cleared tumor tissues without compromise of tissue and protein antigen integrity. With newly developed tissue mounting and selected region-tracking methods, we established a cyclic workflow involving IF staining, tissue clearing, 3D confocal microscopy, and LED photobleaching. By registering microscope channel images generated through three work cycles, we produced 8-plex image data from individual 400 μm-thick tumor macrosections that visualize various vascular, immune, and cancer cells in the same TME at tissue-wide and cellular levels in 3D. Our method was also validated for quantitative 3D spatial analysis of cellular remodeling in the TME after immunotherapy. These results demonstrate that our LED photobleaching system and its workflow offer a novel approach to increase the multiplexing power of 3D IF microscopy for studying tumor heterogeneity and response to therapy.

Visual Assessment of 2-Dimensional Levels Within 3-Dimensional Pathology Data Sets of Prostate Needle Biopsies Reveals Substantial Spatial Heterogeneity

Prostate cancer prognostication largely relies on visual assessment of a few thinly sectioned biopsy specimens under a microscope to assign a Gleason grade group (GG). Unfortunately, the assigned GG is not always associated with a patient's outcome in part because of the limited sampling of spatially heterogeneous tumors achieved by 2-dimensional histopathology. In this study, open-top light-sheet microscopy was used to obtain 3-dimensional pathology data sets that were assessed by 4 human readers. Intrabiopsy variability was assessed by asking readers to perform Gleason grading of 5 different levels per biopsy for a total of 20 core needle biopsies (ie, 100 total images). Intrabiopsy variability (Cohen κ) was calculated as the worst pairwise agreement in GG between individual levels within each biopsy and found to be 0.34, 0.34, 0.38, and 0.43 for the 4 pathologists. These preliminary results reveal that even within a 1-mm-diameter needle core, GG based on 2-dimensional images can vary dramatically depending on the location within a biopsy being analyzed. We believe that morphologic assessment of whole biopsies in 3 dimension has the potential to enable more reliable and consistent tumor grading.

Three-dimensional multifocal scanning microscopy for super-resolution cell and tissue imaging

Recent advancements in image-scanning microscopy have significantly enriched super-resolution biological research, providing deeper insights into cellular structures and processes. However, current image-scanning techniques often require complex instrumentation and alignment, constraining their broader applicability in cell biological discovery and convenient, cost-effective integration into commonly used frameworks like epi-fluorescence microscopes. Here, we introduce three-dimensional multifocal scanning microscopy (3D-MSM) for super-resolution imaging of cells and tissue with substantially reduced instrumental complexity. This method harnesses the inherent 3D movement of specimens to achieve stationary, multi-focal excitation and super-resolution microscopy through a standard epi-fluorescence platform. We validated the system using a range of phantom, single-cell, and tissue specimens. The combined strengths of structured illumination, confocal detection, and epi-fluorescence setup result in two-fold resolution improvement in all three dimensions, effective optical sectioning, scalable volume acquisition, and compatibility with general imaging and sample protocols. We anticipate that 3D-MSM will pave a promising path for future super-resolution investigations in cell and tissue biology.

3D multiplexed tissue imaging reconstruction and optimized region of interest (ROI) selection through deep learning model of channels embedding

Introduction: Tissue-based sampling and diagnosis are defined as the extraction of information from certain limited spaces and its diagnostic significance of a certain object. Pathologists deal with issues related to tumor heterogeneity since analyzing a single sample does not necessarily capture a representative depiction of cancer, and a tissue biopsy usually only presents a small fraction of the tumor. Many multiplex tissue imaging platforms (MTIs) make the assumption that tissue microarrays (TMAs) containing small core samples of 2-dimensional (2D) tissue sections are a good approximation of bulk tumors although tumors are not 2D. However, emerging whole slide imaging (WSI) or 3D tumor atlases that use MTIs like cyclic immunofluorescence (CyCIF) strongly challenge this assumption. In spite of the additional insight gathered by measuring the tumor microenvironment in WSI or 3D, it can be prohibitively expensive and time-consuming to process tens or hundreds of tissue sections with CyCIF. Even when resources are not limited, the criteria for region of interest (ROI) selection in tissues for downstream analysis remain largely qualitative and subjective as stratified sampling requires the knowledge of objects and evaluates their features. Despite the fact TMAs fail to adequately approximate whole tissue features, a theoretical subsampling of tissue exists that can best represent the tumor in the whole slide image. Methods: To address these challenges, we propose deep learning approaches to learn multi-modal image translation tasks from two aspects: 1) generative modeling approach to reconstruct 3D CyCIF representation and 2) co-embedding CyCIF image and Hematoxylin and Eosin (H&E) section to learn multi-modal mappings by a cross-domain translation for minimum representative ROI selection. Results and discussion: We demonstrate that generative modeling enables a 3D virtual CyCIF reconstruction of a colorectal cancer specimen given a small subset of the imaging data at training time. By co-embedding histology and MTI features, we propose a simple convex optimization for objective ROI selection. We demonstrate the potential application of ROI selection and the efficiency of its performance with respect to cellular heterogeneity.

Harnessing the power of optical microscopy for visualization and analysis of histopathological images

Histopathology is the foundation and gold standard for identifying diseases, and precise quantification of histopathological images can provide the pathologist with objective clues to make a more convincing diagnosis. Optical microscopy (OM), an important branch of optical imaging technology that provides high-resolution images of tissue cytology and structural morphology, has been used in the diagnosis of histopathology and evolved into a new disciplinary direction of optical microscopic histopathology (OMH). There are a number of ex-vivo studies providing applicability of different OMH approaches, and a transfer of these techniques toward in vivo diagnosis is currently in progress. Furthermore, combined with advanced artificial intelligence algorithms, OMH allows for improved diagnostic reliability and convenience due to the complementarity of retrieval information. In this review, we cover recent advances in OMH, including the exploration of new techniques in OMH as well as their applications, and look ahead to new challenges in OMH. These typical application examples well demonstrate the application potential and clinical value of OMH techniques in histopathological diagnosis.

Nondestructive 3D Pathology Image Atlas of Barrett Esophagus With Open-Top Light-Sheet Microscopy

CONTEXT.—

Anatomic pathologists render diagnosis on tissue samples sectioned onto glass slides and viewed under a bright-field microscope. This approach is destructive to the sample, which can limit its use for ancillary assays that can inform patient management. Furthermore, the subjective interpretation of a relatively small number of 2D tissue sections per sample contributes to low interobserver agreement among pathologists for the assessment (diagnosis and grading) of various lesions.

OBJECTIVE.—

To evaluate 3D pathology data sets of thick formalin-fixed Barrett esophagus specimens imaged nondestructively with open-top light-sheet (OTLS) microscopy.

DESIGN.—

Formalin-fixed, paraffin-embedded Barrett esophagus samples (N = 15) were deparaffinized, stained with a fluorescent analog of hematoxylin-eosin, optically cleared, and imaged nondestructively with OTLS microscopy. The OTLS microscopy images were subsequently compared with archived hematoxylin-eosin histology sections from each sample.

RESULTS.—

Barrett esophagus samples, both small endoscopic forceps biopsies and endoscopic mucosal resections, exhibited similar resolvable structures between OTLS microscopy and conventional light microscopy with up to a ×20 objective (×200 overall magnification). The 3D histologic images generated by OTLS microscopy can enable improved discrimination of cribriform and well-formed gland morphologies. In addition, a much larger amount of tissue is visualized with OTLS microscopy, which enables improved assessment of clinical specimens exhibiting high spatial heterogeneity.

CONCLUSIONS.—

In esophageal specimens, OTLS microscopy can generate images comparable in quality to conventional light microscopy, with the advantages of providing 3D information for enhanced evaluation of glandular morphologies and enabling much more of the tissue specimen to be visualized nondestructively.

Accelerating Cancer Histopathology Workflows with Chemical Imaging and Machine Learning

Histopathology has remained a cornerstone for biomedical tissue assessment for over a century, with a resource-intensive workflow involving biopsy or excision, gross examination, sampling, tissue processing to snap frozen or formalin-fixed paraffin-embedded blocks, sectioning, staining, optical imaging, and microscopic assessment. Emerging chemical imaging approaches, including stimulated Raman scattering (SRS) microscopy, can directly measure inherent molecular composition in tissue (thereby dispensing with the need for tissue processing, sectioning, and using dyes) and can use artificial intelligence (AI) algorithms to provide high-quality images. Here we show the integration of SRS microscopy in a pathology workflow to rapidly record chemical information from minimally processed fresh-frozen prostate tissue. Instead of using thin sections, we record data from intact thick tissues and use optical sectioning to generate images from multiple planes. We use a deep learning–based processing pipeline to generate virtual hematoxylin and eosin images. Next, we extend the computational method to generate archival-quality images in minutes, which are equivalent to those obtained from hours/days-long formalin-fixed, paraffin-embedded processing. We assessed the quality of images from the perspective of enabling pathologists to make decisions, demonstrating that the virtual stained image quality was diagnostically useful and the interpathologist agreement on prostate cancer grade was not impacted. Finally, because this method does not wash away lipids and small molecules, we assessed the utility of lipid chemical composition in determining grade. Together, the combination of chemical imaging and AI provides novel capabilities for rapid assessments in pathology by reducing the complexity and burden of current workflows.

SIGNIFICANCE

Archival-quality (formalin-fixed paraffin-embedded), thin-section diagnostic images are obtained from thick-cut, fresh-frozen prostate tissues without dyes or stains to expedite cancer histopathology by combining SRS microscopy and machine learning.

AutoFibroNet: A deep learning and multi-photon microscopy-derived automated network for liver fibrosis quantification in MAFLD

BACKGROUND

Liver fibrosis is the strongest histological risk factor for liver-related complications and mortality in metabolic dysfunction-associated fatty liver disease (MAFLD). Second harmonic generation/two-photon excitation fluorescence (SHG/TPEF) is a powerful tool for label-free two-dimensional and three-dimensional tissue visualisation that shows promise in liver fibrosis assessment.

AIM

To investigate combining multi-photon microscopy (MPM) and deep learning techniques to develop and validate a new automated quantitative histological classification tool, named AutoFibroNet (Automated Liver Fibrosis Grading Network), for accurately staging liver fibrosis in MAFLD.

METHODS

AutoFibroNet was developed in a training cohort that consisted of 203 Chinese adults with biopsy-confirmed MAFLD. Three deep learning models (VGG16, ResNet34, and MobileNet V3) were used to train pre-processed images and test data sets. Multi-layer perceptrons were used to fuse data (deep learning features, clinical features, and manual features) to build a joint model. This model was then validated in two further independent cohorts.

RESULTS

AutoFibroNet showed good discrimination in the training set. For F0, F1, F2 and F3-4 fibrosis stages, the area under the receiver operating characteristic curves (AUROC) of AutoFibroNet were 1.00, 0.99, 0.98 and 0.98. The AUROCs of F0, F1, F2 and F3-4 fibrosis stages for AutoFibroNet in the two validation cohorts were 0.99, 0.83, 0.80 and 0.90 and 1.00, 0.83, 0.80 and 0.94, respectively, showing a good discriminatory ability in different cohorts.

CONCLUSION

AutoFibroNet is an automated quantitative tool that accurately identifies histological stages of liver fibrosis in Chinese individuals with MAFLD.

An end-to-end workflow for non-destructive 3D pathology

Recent advances in 3D pathology offer the ability to image orders-of-magnitude more tissue than conventional pathology while providing a volumetric context that is lacking with 2D tissue sections, all without requiring destructive tissue sectioning. Generating high-quality 3D pathology datasets on a consistent basis is non-trivial, requiring careful attention to many details regarding tissue preparation, imaging, and data/image processing in an iterative process. Here we provide an end-to-end protocol covering all aspects of a 3D pathology workflow (using light-sheet microscopy as an illustrative imaging platform) with sufficient detail to perform well-controlled preclinical and clinical studies. While 3D pathology is compatible with diverse staining protocols and computationally generated color palettes for visual analysis, this protocol will focus on a fluorescent analog of hematoxylin and eosin (H&E), which remains the most common stain for gold-standard diagnostic determinations. We present our guidelines for a broad range of end-users (e.g., biologists, clinical researchers, and engineers) in a simple tutorial format.

Nondestructive 3D pathology with analysis of nuclear features for prostate cancer risk assessment

Prostate cancer treatment decisions rely heavily on subjective visual interpretation [assigning Gleason patterns or International Society of Urological Pathology (ISUP) grade groups] of limited numbers of two-dimensional (2D) histology sections. Under this paradigm, interobserver variance is high, with ISUP grades not correlating well with outcome for individual patients, and this contributes to the over- and undertreatment of patients. Recent studies have demonstrated improved prognostication of prostate cancer outcomes based on computational analyses of glands and nuclei within 2D whole slide images. Our group has also shown that the computational analysis of three-dimensional (3D) glandular features, extracted from 3D pathology datasets of whole intact biopsies, can allow for improved recurrence prediction compared to corresponding 2D features. Here we seek to expand on these prior studies by exploring the prognostic value of 3D shape-based nuclear features in prostate cancer (e.g. nuclear size, sphericity). 3D pathology datasets were generated using open-top light-sheet (OTLS) microscopy of 102 cancer-containing biopsies extracted ex vivo from the prostatectomy specimens of 46 patients. A deep learning-based workflow was developed for 3D nuclear segmentation within the glandular epithelium versus stromal regions of the biopsies. 3D shape-based nuclear features were extracted, and a nested cross-validation scheme was used to train a supervised machine classifier based on 5-year biochemical recurrence (BCR) outcomes. Nuclear features of the glandular epithelium were found to be more prognostic than stromal cell nuclear features (area under the ROC curve [AUC] = 0.72 versus 0.63). 3D shape-based nuclear features of the glandular epithelium were also more strongly associated with the risk of BCR than analogous 2D features (AUC = 0.72 versus 0.62). The results of this preliminary investigation suggest that 3D shape-based nuclear features are associated with prostate cancer aggressiveness and could be of value for the development of decision-support tools. © 2023 The Pathological Society of Great Britain and Ireland.

Weakly Supervised AI for Efficient Analysis of 3D Pathology Samples

Human tissue consists of complex structures that display a diversity of morphologies, forming a tissue microenvironment that is, by nature, three-dimensional (3D). However, the current standard-of-care involves slicing 3D tissue specimens into two-dimensional (2D) sections and selecting a few for microscopic evaluation1,2, with concomitant risks of sampling bias and misdiagnosis3-6. To this end, there have been intense efforts to capture 3D tissue morphology and transition to 3D pathology, with the development of multiple high-resolution 3D imaging modalities7-18. However, these tools have had little translation to clinical practice as manual evaluation of such large data by pathologists is impractical and there is a lack of computational platforms that can efficiently process the 3D images and provide patient-level clinical insights. Here we present Modality-Agnostic Multiple instance learning for volumetric Block Analysis (MAMBA), a deep-learning-based platform for processing 3D tissue images from diverse imaging modalities and predicting patient outcomes. Archived prostate cancer specimens were imaged with open-top light-sheet microscopy12-14 or microcomputed tomography15,16 and the resulting 3D datasets were used to train risk-stratification networks based on 5-year biochemical recurrence outcomes via MAMBA. With the 3D block-based approach, MAMBA achieves an area under the receiver operating characteristic curve (AUC) of 0.86 and 0.74, superior to 2D traditional single-slice-based prognostication (AUC of 0.79 and 0.57), suggesting superior prognostication with 3D morphological features. Further analyses reveal that the incorporation of greater tissue volume improves prognostic performance and mitigates risk prediction variability from sampling bias, suggesting that there is value in capturing larger extents of spatially heterogeneous 3D morphology. With the rapid growth and adoption of 3D spatial biology and pathology techniques by researchers and clinicians, MAMBA provides a general and efficient framework for 3D weakly supervised learning for clinical decision support and can help to reveal novel 3D morphological biomarkers for prognosis and therapeutic response.

Comprehensive Surface Histology of Fresh Resection Margins With Rapid Open-Top Light-Sheet (OTLS) Microscopy

OBJECTIVE

For tumor resections, margin status typically correlates with patient survival but positive margin rates are generally high (up to 45% for head and neck cancer). Frozen section analysis (FSA) is often used to intraoperatively assess the margins of excised tissue, but suffers from severe under-sampling of the actual margin surface, inferior image quality, slow turnaround, and tissue destructiveness.

METHODS

Here, we have developed an imaging workflow to generate en face histologic images of freshly excised surgical margin surfaces based on open-top light-sheet (OTLS) microscopy. Key innovations include (1) the ability to generate false-colored H&E-mimicking images of tissue surfaces stained for < 1 min with a single fluorophore, (2) rapid OTLS surface imaging at a rate of 15 min/cm2 followed by real-time post-processing of datasets within RAM at a rate of 5 min/cm2, and (3) rapid digital surface extraction to account for topological irregularities at the tissue surface.

RESULTS

In addition to the performance metrics listed above, we show that the image quality generated by our rapid surface-histology method approaches that of gold-standard archival histology.

CONCLUSION

OTLS microscopy has the feasibility to provide intraoperative guidance of surgical oncology procedures.

SIGNIFICANCE

The reported methods can potentially improve tumor-resection procedures, thereby improving patient outcomes and quality of life.

Digital Histopathology by Infrared Spectroscopic Imaging

Infrared (IR) spectroscopic imaging records spatially resolved molecular vibrational spectra, enabling a comprehensive measurement of the chemical makeup and heterogeneity of biological tissues. Combining this novel contrast mechanism in microscopy with the use of artificial intelligence can transform the practice of histopathology, which currently relies largely on human examination of morphologic patterns within stained tissue. First, this review summarizes IR imaging instrumentation especially suited to histopathology, analyses of its performance, and major trends. Second, an overview of data processing methods and application of machine learning is given, with an emphasis on the emerging use of deep learning. Third, a discussion on workflows in pathology is provided, with four categories proposed based on the complexity of methods and the analytical performance needed. Last, a set of guidelines, termed experimental and analytical specifications for spectroscopic imaging in histopathology, are proposed to help standardize the diversity of approaches in this emerging area.

Nondestructive 3D Pathology with Light-Sheet Fluorescence Microscopy for Translational Research and Clinical Assays

In recent years, there has been a revived appreciation for the importance of spatial context and morphological phenotypes for both understanding disease progression and guiding treatment decisions. Compared with conventional 2D histopathology, which is the current gold standard of medical diagnostics, nondestructive 3D pathology offers researchers and clinicians the ability to visualize orders of magnitude more tissue within their natural volumetric context. This has been enabled by rapid advances in tissue-preparation methods, high-throughput 3D microscopy instrumentation, and computational tools for processing these massive feature-rich data sets. Here, we provide a brief overview of many of these technical advances along with remaining challenges to be overcome. We also speculate on the future of 3D pathology as applied in translational investigations, preclinical drug development, and clinical decision-support assays.

Digital labeling for 3D histology: segmenting blood vessels without a vascular contrast agent using deep learning

Recent advances in optical tissue clearing and three-dimensional (3D) fluorescence microscopy have enabled high resolution in situ imaging of intact tissues. Using simply prepared samples, we demonstrate here "digital labeling," a method to segment blood vessels in 3D volumes solely based on the autofluorescence signal and a nuclei stain (DAPI). We trained a deep-learning neural network based on the U-net architecture using a regression loss instead of a commonly used segmentation loss to achieve better detection of small vessels. We achieved high vessel detection accuracy and obtained accurate vascular morphometrics such as vessel length density and orientation. In the future, such digital labeling approach could easily be transferred to other biological structures.

A living biobank of patient-derived ductal carcinoma in situ mouse-intraductal xenografts identifies risk factors for invasive progression

Ductal carcinoma in situ (DCIS) is a non-obligate precursor of invasive breast cancer (IBC). Due to a lack of biomarkers able to distinguish high- from low-risk cases, DCIS is treated similar to early IBC even though the minority of untreated cases eventually become invasive. Here, we characterized 115 patient-derived mouse-intraductal (MIND) DCIS models reflecting the full spectrum of DCIS observed in patients. Utilizing the possibility to follow the natural progression of DCIS combined with omics and imaging data, we reveal multiple prognostic factors for high-risk DCIS including high grade, HER2 amplification, expansive 3D growth, and high burden of copy number aberrations. In addition, sequential transplantation of xenografts showed minimal phenotypic and genotypic changes over time, indicating that invasive behavior is an intrinsic phenotype of DCIS and supporting a multiclonal evolution model. Moreover, this study provides a collection of 19 distributable DCIS-MIND models spanning all molecular subtypes.

Value of Artificial Intelligence in Evaluating Lymph Node Metastases

One of the most relevant prognostic factors in cancer staging is the presence of lymph node (LN) metastasis. Evaluating lymph nodes for the presence of metastatic cancerous cells can be a lengthy, monotonous, and error-prone process. Owing to digital pathology, artificial intelligence (AI) applied to whole slide images (WSIs) of lymph nodes can be exploited for the automatic detection of metastatic tissue. The aim of this study was to review the literature regarding the implementation of AI as a tool for the detection of metastases in LNs in WSIs. A systematic literature search was conducted in PubMed and Embase databases. Studies involving the application of AI techniques to automatically analyze LN status were included. Of 4584 retrieved articles, 23 were included. Relevant articles were labeled into three categories based upon the accuracy of AI in evaluating LNs. Published data overall indicate that the application of AI in detecting LN metastases is promising and can be proficiently employed in daily pathology practice.

A Guide to Perform 3D Histology of Biological Tissues with Fluorescence Microscopy

The analysis of histological alterations in all types of tissue is of primary importance in pathology for highly accurate and robust diagnosis. Recent advances in tissue clearing and fluorescence microscopy made the study of the anatomy of biological tissue possible in three dimensions. The combination of these techniques with classical hematoxylin and eosin (H&E) staining has led to the birth of three-dimensional (3D) histology. Here, we present an overview of the state-of-the-art methods, highlighting the optimal combinations of different clearing methods and advanced fluorescence microscopy techniques for the investigation of all types of biological tissues. We employed fluorescence nuclear and eosin Y staining that enabled us to obtain hematoxylin and eosin pseudo-coloring comparable with the gold standard H&E analysis. The computational reconstructions obtained with 3D optical imaging can be analyzed by a pathologist without any specific training in volumetric microscopy, paving the way for new biomedical applications in clinical pathology.

High-resolution confocal and light-sheet imaging of collagen 3D network architecture in very large samples

Although notoriously difficult, imaging collagen network architecture, a key element affecting tissue mechanical properties, is of paramount importance in developmental and cancer biology. Here, we introduce a simple and robust method of whole-mount collagen staining with the 'Fast Green' dye that provides unmatched visualization of collagen 3D network architecture, via confocal or light-sheet microscopy, compatible with solvent-based tissue clearing and immunostaining.

Multiscale Label-Free Imaging of Fibrillar Collagen in the Tumor Microenvironment

With recent advances in cancer therapeutics, there is a great need for improved imaging methods for characterizing cancer onset and progression in a quantitative and actionable way. Collagen, the most abundant extracellular matrix protein in the tumor microenvironment (and the body in general), plays a multifaceted role, both hindering and promoting cancer invasion and progression. Collagen deposition can defend the tumor with immunosuppressive effects, while aligned collagen fiber structures can enable tumor cell migration, aiding invasion and metastasis. Given the complex role of collagen fiber organization and topology, imaging has been a tool of choice to characterize these changes on multiple spatial scales, from the organ and tumor scale to cellular and subcellular level. Macroscale density already aids in the detection and diagnosis of solid cancers, but progress is being made to integrate finer microscale features into the process. Here we review imaging modalities ranging from optical methods of second harmonic generation (SHG), polarized light microscopy (PLM), and optical coherence tomography (OCT) to the medical imaging approaches of ultrasound and magnetic resonance imaging (MRI). These methods have enabled scientists and clinicians to better understand the impact collagen structure has on the tumor environment, at both the bulk scale (density) and microscale (fibrillar structure) levels. We focus on imaging methods with the potential to both examine the collagen structure in as natural a state as possible and still be clinically amenable, with an emphasis on label-free strategies, exploiting intrinsic optical properties of collagen fibers.

Space in cancer biology: its role and implications

Tumor cells present complex behaviors in their interactions with other cells. This intricate behavior is driving the need to develop new tools to understand these ecosystems. The surge of spatial technologies allows evaluation of the complexity of relationships between cells present in a tumor, giving insights about tumor heterogeneity and the tumor microenvironment while providing clinically relevant metrics for tumor classification. In this review, we describe key results obtained using spatial techniques, present recent advances in methods to uncover spatially relevant biological significance, and summarize their main characteristics. We expect spatial technologies to significantly broaden our understanding of tumor biology and to generate clinically relevant tools that will ultimately impact personalized medicine.

Three-dimensional imaging and analysis of pathological tissue samples with de novo generation of citrate-based fluorophores

Two-dimensional (2D) histopathology based on the observation of thin tissue slides is the current paradigm in diagnosis and prognosis. However, labeling strategies in conventional histopathology are limited in compatibility with 3D imaging combined with tissue clearing techniques. Here, we present a rapid and efficient volumetric imaging technique of pathological tissues called 3D tissue imaging through de novo formation of fluorophores, or 3DNFC, which is the integration of citrate-based fluorogenic reaction DNFC and tissue clearing techniques. 3DNFC markedly increases the fluorescence intensity of tissues by generating fluorophores on nonfluorescent amino-terminal cysteine and visualizes the 3D structure of the tissues to provide their anatomical morphology and volumetric information. Furthermore, the application of 3DNFC to pathological tissue achieves the 3D reconstruction for the unbiased analysis of diverse features of the disorders in their natural context. We suggest that 3DNFC is a promising volumetric imaging method for the prognosis and diagnosis of pathological tissues.

Artificial Intelligence for Clinical Diagnosis and Treatment of Prostate Cancer

As medical science and technology progress towards the era of "big data", a multi-dimensional dataset pertaining to medical diagnosis and treatment is becoming accessible for mathematical modelling. However, these datasets are frequently inconsistent, noisy, and often characterized by a significant degree of redundancy. Thus, extensive data processing is widely advised to clean the dataset before feeding it into the mathematical model. In this context, Artificial intelligence (AI) techniques, including machine learning (ML) and deep learning (DL) algorithms based on artificial neural networks (ANNs) and their types, are being used to produce a precise and cross-sectional illustration of clinical data. For prostate cancer patients, datasets derived from the prostate-specific antigen (PSA), MRI-guided biopsies, genetic biomarkers, and the Gleason grading are primarily used for diagnosis, risk stratification, and patient monitoring. However, recording diagnoses and further stratifying risks based on such diagnostic data frequently involves much subjectivity. Thus, implementing an AI algorithm on a PC's diagnostic data can reduce the subjectivity of the process and assist in decision making. In addition, AI is used to cut down the processing time and help with early detection, which provides a superior outcome in critical cases of prostate cancer. Furthermore, this also facilitates offering the service at a lower cost by reducing the amount of human labor. Herein, the prime objective of this review is to provide a deep analysis encompassing the existing AI algorithms that are being deployed in the field of prostate cancer (PC) for diagnosis and treatment. Based on the available literature, AI-powered technology has the potential for extensive growth and penetration in PC diagnosis and treatment to ease and expedite the existing medical process.

CODA: quantitative 3D reconstruction of large tissues at cellular resolution

A central challenge in biology is obtaining high-content, high-resolution information while analyzing tissue samples at volumes relevant to disease progression. We address this here with CODA, a method to reconstruct exceptionally large (up to multicentimeter cubed) tissues at subcellular resolution using serially sectioned hematoxylin and eosin-stained tissue sections. Here we demonstrate CODA's ability to reconstruct three-dimensional (3D) distinct microanatomical structures in pancreas, skin, lung and liver tissues. CODA allows creation of readily quantifiable tissue volumes amenable to biological research. As a testbed, we assess the microanatomy of the human pancreas during tumorigenesis within the branching pancreatic ductal system, labeling ten distinct structures to examine heterogeneity and structural transformation during neoplastic progression. We show that pancreatic precancerous lesions develop into distinct 3D morphological phenotypes and that pancreatic cancer tends to spread far from the bulk tumor along collagen fibers that are highly aligned to the 3D curves of ductal, lobular, vascular and neural structures. Thus, CODA establishes a means to transform broadly the structural study of human diseases through exploration of exhaustively labeled 3D microarchitecture.

Cloud-enabled Biodepot workflow builder integrates image processing using Fiji with reproducible data analysis using Jupyter notebooks

Modern biomedical image analyses workflows contain multiple computational processing tasks giving rise to problems in reproducibility. In addition, image datasets can span both spatial and temporal dimensions, with additional channels for fluorescence and other data, resulting in datasets that are too large to be processed locally on a laptop. For omics analyses, software containers have been shown to enhance reproducibility, facilitate installation and provide access to scalable computational resources on the cloud. However, most image analyses contain steps that are graphical and interactive, features that are not supported by most omics execution engines. We present the containerized and cloud-enabled Biodepot-workflow-builder platform that supports graphics from software containers and has been extended for image analyses. We demonstrate the potential of our modular approach with multi-step workflows that incorporate the popular and open-source Fiji suite for image processing. One of our examples integrates fully interactive ImageJ macros with Jupyter notebooks. Our second example illustrates how the complicated cloud setup of an computationally intensive process such as stitching 3D digital pathology datasets using BigStitcher can be automated and simplified. In both examples, users can leverage a form-based graphical interface to execute multi-step workflows with a single click, using the provided sample data and preset input parameters. Alternatively, users can interactively modify the image processing steps in the workflow, apply the workflows to their own data, change the input parameters and macros. By providing interactive graphics support to software containers, our modular platform supports reproducible image analysis workflows, simplified access to cloud resources for analysis of large datasets, and integration across different applications such as Jupyter.

Ultrafast 3D histological imaging based on a minutes-time scale tissue clearing and multidirectional selective plane illumination microscopy

Conventional histopathological examinations are time-consuming and labor-intensive, and are insufficient to depict 3D pathological features intuitively. Here we report an ultrafast 3D histological imaging scheme based on optimized selective plane illumination microscopy (mSPIM), a minutes-time scale clearing method (FOCM), and a deep learning-based image enhancement algorithm (SRACNet) to realize histological preparation and imaging of clinical tissues. Our scheme enables 1-minute clearing and fast imaging (up to 900 mm²/min) of 200 µm-thick mouse kidney slices at micron-level resolution. With hematoxylin and eosin analog, we demonstrated the detailed 3D morphological connections between glomeruli and the surrounding tubules, which is difficult to identify in conventional 2D histology. Further, by the preliminary verification on human kidney tissues, this study will provide new, to the best of our knowledge, feasible histological solutions and inspirations in future 3D digital pathology.

A Novel Three-Dimensional Imaging System Based on Polysaccharide Staining for Accurate Histopathological Diagnosis of Inflammatory Bowel Diseases

BACKGROUND & AIMS

Tissue-clearing and three-dimensional (3D) imaging techniques aid clinical histopathological evaluation; however, further methodological developments are required before use in clinical practice.

METHODS

We sought to develop a novel fluorescence staining method based on the classical periodic acid-Schiff stain. We further attempted to develop a 3D imaging system based on this staining method and evaluated whether the system can be used for quantitative 3D pathological evaluation and deep learning-based automatic diagnosis of inflammatory bowel diseases.

RESULTS

We successfully developed a novel periodic acid-FAM hydrazide (PAFhy) staining method for 3D imaging when combined with a tissue-clearing technique (PAFhy-3D). This strategy enabled clear and detailed imaging of the 3D architectures of crypts in human colorectal mucosa. PAFhy-3D imaging also revealed abnormal architectural changes in crypts in ulcerative colitis tissues and identified the distributions of neutrophils in cryptitis and crypt abscesses. PAFhy-3D revealed novel pathological findings including spiral staircase-like crypts specific to inflammatory bowel diseases. Quantitative analysis of crypts based on 3D morphologic changes enabled differential diagnosis of ulcerative colitis, Crohn's disease, and non-inflammatory bowel disease; such discrimination could not be achieved by pathologists. Furthermore, a deep learning-based system using PAFhy-3D images was used to distinguish these diseases The accuracies were excellent (macro-average area under the curve = 0.94; F1 scores = 0.875 for ulcerative colitis, 0.717 for Crohn's disease, and 0.819 for non-inflammatory bowel disease).

CONCLUSIONS

PAFhy staining and PAFhy-3D imaging are promising approaches for next-generation experimental and clinical histopathology.

The state of the art for artificial intelligence in lung digital pathology

Lung diseases carry a significant burden of morbidity and mortality worldwide. The advent of digital pathology (DP) and an increase in computational power have led to the development of artificial intelligence (AI)-based tools that can assist pathologists and pulmonologists in improving clinical workflow and patient management. While previous works have explored the advances in computational approaches for breast, prostate, and head and neck cancers, there has been a growing interest in applying these technologies to lung diseases as well. The application of AI tools on radiology images for better characterization of indeterminate lung nodules, fibrotic lung disease, and lung cancer risk stratification has been well documented. In this article, we discuss methodologies used to build AI tools in lung DP, describing the various hand-crafted and deep learning-based unsupervised feature approaches. Next, we review AI tools across a wide spectrum of lung diseases including cancer, tuberculosis, idiopathic pulmonary fibrosis, and COVID-19. We discuss the utility of novel imaging biomarkers for different types of clinical problems including quantification of biomarkers like PD-L1, lung disease diagnosis, risk stratification, and prediction of response to treatments such as immune checkpoint inhibitors. We also look briefly at some emerging applications of AI tools in lung DP such as multimodal data analysis, 3D pathology, and transplant rejection. Lastly, we discuss the future of DP-based AI tools, describing the challenges with regulatory approval, developing reimbursement models, planning clinical deployment, and addressing AI biases. © 2022 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

New Efforts in Biomedical Imaging

Since the invention of the X-ray in 1895, biomedical imaging has come a long way and the pace of advances in the field are only accelerating. Research groups are progressing on many fronts through improvements to existing technologies and the development of novel imaging devices and algorithms that not only deliver better pictures, but also more-and more useful-information from the image data.

A multiscale X-ray phase-contrast tomography dataset of a whole human left lung

Technological advancements in X-ray imaging using bright and coherent synchrotron sources now allows the decoupling of sample size and resolution while maintaining high sensitivity to the microstructures of soft, partially dehydrated tissues. The continuous developments in multiscale X-ray imaging resulted in hierarchical phase-contrast tomography, a comprehensive approach to address the challenge of organ-scale (up to tens of centimeters) soft tissue imaging with resolution and sensitivity down to the cellular level. Using this technique, we imaged ex vivo an entire human left lung at an isotropic voxel size of 25.08 μm along with local zooms down to 6.05-6.5 μm and 2.45-2.5 μm in voxel size. The high tissue contrast offered by the fourth-generation synchrotron source at the European Synchrotron Radiation Facility reveals the complex multiscale anatomical constitution of the human lung from the macroscopic (centimeter) down to the microscopic (micrometer) scale. The dataset provides comprehensive organ-scale 3D information of the secondary pulmonary lobules and delineates the microstructure of lung nodules with unprecedented detail.

3D Visualization of Human Blood Vascular Networks Using Single-Domain Antibodies Directed against Endothelial Cell-Selective Adhesion Molecule (ESAM)

High-quality three-dimensional (3D) microscopy allows detailed, unrestricted and non-destructive imaging of entire volumetric tissue specimens and can therefore increase the diagnostic accuracy of histopathological tissue analysis. However, commonly used IgG antibodies are oftentimes not applicable to 3D imaging, due to their relatively large size and consequently inadequate tissue penetration and penetration speed. The lack of suitable reagents for 3D histopathology can be overcome by an emerging class of single-domain antibodies, referred to as nanobodies (Nbs), which can facilitate rapid and superior 2D and 3D histological stainings. Here, we report the generation and experimental validation of Nbs directed against the human endothelial cell-selective adhesion molecule (hESAM), which enables spatial visualization of blood vascular networks in whole-mount 3D imaging. After analysis of Nb binding properties and quality, selected Nb clones were validated in 2D and 3D imaging approaches, demonstrating comparable staining qualities to commercially available hESAM antibodies in 2D, as well as rapid and complete staining of entire specimens in 3D. We propose that the presented hESAM-Nbs can serve as novel blood vessel markers in academic research and can potentially improve 3D histopathological diagnostics of entire human tissue specimens, leading to improved treatment and superior patient outcomes.

In vivo microscopy as an adjunctive tool to guide detection, diagnosis, and treatment

SIGNIFICANCE

There have been numerous academic and commercial efforts to develop high-resolution in vivo microscopes for a variety of clinical use cases, including early disease detection and surgical guidance. While many high-profile studies, commercialized products, and publications have resulted from these efforts, mainstream clinical adoption has been relatively slow other than for a few clinical applications (e.g., dermatology).

AIM

Here, our goals are threefold: (1) to introduce and motivate the need for in vivo microscopy (IVM) as an adjunctive tool for clinical detection, diagnosis, and treatment, (2) to discuss the key translational challenges facing the field, and (3) to propose best practices and recommendations to facilitate clinical adoption.

APPROACH

We will provide concrete examples from various clinical domains, such as dermatology, oral/gastrointestinal oncology, and neurosurgery, to reinforce our observations and recommendations.

RESULTS

While the incremental improvement and optimization of IVM technologies should and will continue to occur, future translational efforts would benefit from the following: (1) integrating clinical and industry partners upfront to define and maintain a compelling value proposition, (2) identifying multimodal/multiscale imaging workflows, which are necessary for success in most clinical scenarios, and (3) developing effective artificial intelligence tools for clinical decision support, tempered by a realization that complete adoption of such tools will be slow.

CONCLUSIONS

The convergence of imaging modalities, academic-industry-clinician partnerships, and new computational capabilities has the potential to catalyze rapid progress and adoption of IVM in the next few decades.

Fluorescent labeling of abundant reactive entities (FLARE) for cleared-tissue and super-resolution microscopy

Fluorescence microscopy is a vital tool in biomedical research but faces considerable challenges in achieving uniform or bright labeling. For instance, fluorescent proteins are limited to model organisms, and antibody conjugates can be inconsistent and difficult to use with thick specimens. To partly address these challenges, we developed a labeling protocol that can rapidly visualize many well-contrasted key features and landmarks on biological specimens in both thin and thick tissues or cultured cells. This approach uses established reactive fluorophores to label a variety of biological specimens for cleared-tissue microscopy or expansion super-resolution microscopy and is termed FLARE (fluorescent labeling of abundant reactive entities). These fluorophores target chemical groups and reveal their distribution on the specimens; amine-reactive fluorophores such as hydroxysuccinimidyl esters target accessible amines on proteins, while hydrazide fluorophores target oxidized carbohydrates. The resulting stains provide signals analogous to traditional general histology stains such as H&E or periodic acid-Schiff but use fluorescent probes that are compatible with volumetric imaging. In general, the stains for FLARE are performed in the order of carbohydrates, amine and DNA, and the incubation time for the stains varies from 1 h to 1 d depending on the combination of stains and the type and thickness of the biological specimens. FLARE is powerful, robust and easy to implement in laboratories that already routinely do fluorescence microscopy.

Assessment of photoacoustic tomography contrast for breast tissue imaging using 3D correlative virtual histology

Current breast tumor margin detection methods are destructive, time-consuming, and result in significant reoperative rates. Dual-modality photoacoustic tomography (PAT) and ultrasound has the potential to enhance breast margin characterization by providing clinically relevant compositional information with high sensitivity and tissue penetration. However, quantitative methods that rigorously compare volumetric PAT and ultrasound images with gold-standard histology are lacking, thus limiting clinical validation and translation. Here, we present a quantitative multimodality workflow that uses inverted Selective Plane Illumination Microscopy (iSPIM) to facilitate image co-registration between volumetric PAT-ultrasound datasets with histology in human invasive ductal carcinoma breast tissue samples. Our ultrasound-PAT system consisted of a tunable Nd:YAG laser coupled with a 40 MHz central frequency ultrasound transducer. A linear stepper motor was used to acquire volumetric PAT and ultrasound breast biopsy datasets using 1100 nm light to identify hemoglobin-rich regions and 1210 nm light to identify lipid-rich regions. Our iSPIM system used 488 nm and 647 nm laser excitation combined with Eosin and DRAQ5, a cell-permeant nucleic acid binding dye, to produce high-resolution volumetric datasets comparable to histology. Image thresholding was applied to PAT and iSPIM images to extract, quantify, and topologically visualize breast biopsy lipid, stroma, hemoglobin, and nuclei distribution. Our lipid-weighted PAT and iSPIM images suggest that low lipid regions strongly correlate with malignant breast tissue. Hemoglobin-weighted PAT images, however, correlated poorly with cancerous regions determined by histology and interpreted by a board-certified pathologist. Nuclei-weighted iSPIM images revealed similar cellular content in cancerous and non-cancerous tissues, suggesting malignant cell migration from the breast ducts to the surrounding tissues. We demonstrate the utility of our nondestructive, volumetric, region-based quantitative method for comprehensive validation of 3D tomographic imaging methods suitable for bedside tumor margin detection.

Slide Over: Advances in Slide-Free Optical Microscopy as Drivers of Diagnostic Pathology

Conventional analysis using clinical histopathology is based on bright-field microscopy of thinly sliced tissue specimens. Although bright-field microscopy is a simple and robust method of examining microscope slides, the preparation of the slides needed is a lengthy and labor-intensive process. Slide-free histopathology, however, uses direct imaging of intact, minimally processed tissue samples using advanced optical-imaging systems, bypassing the extended workflow now required for the preparation of tissue sections. This article explains the technical basis of slide-free microscopy, reviews common slide-free optical microscopy techniques, and discusses the opportunities and challenges involved in clinical implementation.