Multimodal optical imaging with multiphoton microscopy and optical coherence tomography

Wide field block face imaging using deep ultraviolet induced autofluorescence of the human brain

BACKGROUND

Imaging large volume human brains at cellular resolution involve histological methods that cause structural changes. A reference point prior to sectioning is needed to quantify these changes and is achieved by serial block face imaging (BFI) methods that have been applied to small volume tissue (∼1 cm3).

NEW METHOD

We have developed a BFI uniquely designed for large volume tissues (∼1300 cm3) with a very large field of view (20 × 20 cm) at a resolution of 70 µm/pixel under deep ultraviolet (UV-C) illumination which highlights key features.

RESULTS

The UV-C imaging ensures high contrast imaging of the brain tissue and highlights salient features of the brain. The system is designed to provide uniform and stable illumination across the entire surface area of the tissue and to work at low temperatures, which are required during cryosectioning. Most importantly, it has been designed to maintain its optical focus over the large depth of tissue and over long periods of time, without readjustments. The BFI was installed within a cryomacrotome, and was used to image a large cryoblock of an adult human cerebellum and brainstem (∼6 cm depth resulting in 2995 serial images) with precise optical focus and no loss during continuous serial acquisition.

COMPARISON WITH EXISTING METHOD(S)

The deep UV-C induced BFI highlights several large fibre tracts within the brain including the cerebellar peduncles, and the corticospinal tract providing important advantage over white light BFI.

CONCLUSIONS

The 3D reconstructed serial BFI images can assist in the registration and alignment of the microscopic high-resolution histological tissue sections.

Label-free photothermal optical coherence microscopy to locate desired regions of interest in multiphoton imaging of volumetric specimens

Biochip-based research is currently evolving into a three-dimensional and large-scale basis similar to the in vivo microenvironment. For the long-term live and high-resolution imaging in these specimens, nonlinear microscopy capable of label-free and multiscale imaging is becoming increasingly important. Combination with non-destructive contrast imaging will be useful for effectively locating regions of interest (ROI) in large specimens and consequently minimizing photodamage. In this study, a label-free photothermal optical coherence microscopy (OCM) serves as a new approach to locate the desired ROI within biological samples which are under investigation by multiphoton microscopy (MPM). The weak photothermal perturbation in sample by the MPM laser with reduced power was detected at the endogenous photothermal particles within the ROI using the highly sensitive phase-differentiated photothermal (PD-PT) OCM. By monitoring the temporal change of the photothermal response signal of the PD-PT OCM, the hotspot generated within the sample focused by the MPM laser was located on the ROI. Combined with automated sample movement in the x-y axis, the focal plane of MPM could be effectively navigated to the desired portion of a volumetric sample for high-resolution targeted MPM imaging. We demonstrated the feasibility of the proposed method in second harmonic generation microscopy using two phantom samples and a biological sample, a fixed insect on microscope slide, with dimensions of 4 mm wide, 4 mm long, and 1 mm thick.

Imaging approaches for monitoring three-dimensional cell and tissue culture systems

The past decade has seen an increasing demand for more complex, reproducible and physiologically relevant tissue cultures that can mimic the structural and biological features of living tissues. Monitoring the viability, development and responses of such tissues in real-time are challenging due to the complexities of cell culture physical characteristics and the environments in which these cultures need to be maintained in. Significant developments in optics, such as optical manipulation, improved detection and data analysis, have made optical imaging a preferred choice for many three-dimensional (3D) cell culture monitoring applications. The aim of this review is to discuss the challenges associated with imaging and monitoring 3D tissues and cell culture, and highlight topical label-free imaging tools that enable bioengineers and biophysicists to non-invasively characterise engineered living tissues.

In vivo microscopy as an adjunctive tool to guide detection, diagnosis, and treatment

SIGNIFICANCE

There have been numerous academic and commercial efforts to develop high-resolution in vivo microscopes for a variety of clinical use cases, including early disease detection and surgical guidance. While many high-profile studies, commercialized products, and publications have resulted from these efforts, mainstream clinical adoption has been relatively slow other than for a few clinical applications (e.g., dermatology).

AIM

Here, our goals are threefold: (1) to introduce and motivate the need for in vivo microscopy (IVM) as an adjunctive tool for clinical detection, diagnosis, and treatment, (2) to discuss the key translational challenges facing the field, and (3) to propose best practices and recommendations to facilitate clinical adoption.

APPROACH

We will provide concrete examples from various clinical domains, such as dermatology, oral/gastrointestinal oncology, and neurosurgery, to reinforce our observations and recommendations.

RESULTS

While the incremental improvement and optimization of IVM technologies should and will continue to occur, future translational efforts would benefit from the following: (1) integrating clinical and industry partners upfront to define and maintain a compelling value proposition, (2) identifying multimodal/multiscale imaging workflows, which are necessary for success in most clinical scenarios, and (3) developing effective artificial intelligence tools for clinical decision support, tempered by a realization that complete adoption of such tools will be slow.

CONCLUSIONS

The convergence of imaging modalities, academic-industry-clinician partnerships, and new computational capabilities has the potential to catalyze rapid progress and adoption of IVM in the next few decades.

Oblique scanning laser microscopy for simultaneously volumetric structural and molecular imaging using only one raster scan

Multi-modal three dimensional (3D) optical imaging combining both structural sensitivity and molecular specificity is highly desirable in biomedical research. In this paper, we present a method termed oblique scanning laser microscopy (OSLM) to combine optical coherence tomography (OCT), for simultaneously volumetric structural and molecular imaging with cellular resolution in all three dimensions. Conventional 3D laser scanning fluorescence microscopy requires repeated optical sectioning to create z-stacks in depth. Here, the use of an obliquely scanning laser eliminates the z-stacking process, then allows highly efficient 3D OCT and fluorescence imaging by using only one raster scan. The current setup provides ~3.6 × 4.2 × 6.5 μm resolution in fluorescence imaging, ~7 × 7 × 3.5 μm in OCT in three dimensions, and the current speed of imaging is up to 100 frames per second (fps) over a volume about 0.8 × 1 × 0.5 mm³. We demonstrate several mechanisms for molecular imaging, including intrinsically expressed GFP fluorescence, autofluorescence from Flavin proteins, and exogenous antibody-conjugated dyes. We also demonstrate potential applications in imaging human intestinal organoids (HIOs), colon mucosa, and retina.

Usefulness of Intravital Multiphoton Microscopy in Visualizing Study of Mouse Cochlea and Volume Changes in the Scala Media

Conventional microscopy has limitations in viewing the cochlear microstructures due to three-dimensional spiral structure and the overlying bone. But these issues can be overcome by imaging the cochlea in vitro with intravital multiphoton microscopy (MPM). By using near-infrared lasers for multiphoton excitation, intravital MPM can detect endogenous fluorescence and second harmonic generation of tissues. In this study, we used intravital MPM to visualize various cochlear microstructures without any staining and non-invasively analyze the volume changes of the scala media (SM) without removing the overlying cochlear bone. The intravital MPM images revealed various tissue types, ranging from thin membranes to dense bone, as well as the spiral ganglion beneath the cochlear bone. The two-dimensional, cross-sectional, and serial z-stack intravital MPM images also revealed the spatial dilation of the SM in the temporal bone of pendrin-deficient mice. These findings suggest that intravital MPM might serve as a new method for obtaining microanatomical information regarding the cochlea, similar to standard histopathological analyses in the animal study for the cochlea. Given the capability of intravital MPM for detecting an increase in the volume of the SM in pendrin-deficient mice, it might be a promising new tool for assessing the pathophysiology of hearing loss in the future.

Visualizing liver anatomy, physiology and pharmacology using multiphoton microscopy

Multiphoton microscopy (MPM) has become increasingly popular and widely used in both basic and clinical liver studies over the past few years. This technology provides insights into deep live tissues with less photobleaching and phototoxicity, which helps us to better understand the cellular morphology, microenvironment, immune responses and spatiotemporal dynamics of drugs and therapeutic cells in the healthy and diseased liver. This review summarizes the principles, opportunities, applications and limitations of MPM in hepatology. A key emphasis is on the use of fluorescence lifetime imaging (FLIM) to add additional quantification and specificity to the detection of endogenous fluorescent species in the liver as well as exogenous molecules and nanoparticles that are applied to the liver in vivo. We anticipate that in the near future MPM-FLIM will advance our understanding of the cellular and molecular mechanisms of liver diseases, and will be evaluated from bench to bedside, leading to real-time histology of human liver diseases.

Multimodal optical coherence tomography and fluorescence lifetime imaging with interleaved excitation sources for simultaneous endogenous and exogenous fluorescence

Multimodal imaging probes a variety of tissue properties in a single image acquisition by merging complimentary imaging technologies. Exploiting synergies amongst the data, algorithms can be developed that lead to better tissue characterization than could be accomplished by the constituent imaging modalities taken alone. The combination of optical coherence tomography (OCT) with fluorescence lifetime imaging microscopy (FLIM) provides access to detailed tissue morphology and local biochemistry. The optical system described here merges 1310 nm swept-source OCT with time-domain FLIM having excitation at 355 and 532 nm. The pulses from 355 and 532 nm lasers have been interleaved to enable simultaneous acquisition of endogenous and exogenous fluorescence signals, respectively. The multimodal imaging system was validated using tissue phantoms. Nonspecific tagging with Alexa Flour 532 in a Watanbe rabbit aorta and active tagging of the LOX-1 receptor in human coronary artery, demonstrate the capacity of the system for simultaneous acquisition of OCT, endogenous FLIM, and exogenous FLIM in tissues.

Time-serial Assessment of Drug Combination Interventions in a Mouse Model of Colorectal Carcinogenesis Using Optical Coherence Tomography

Optical coherence tomography (OCT) is a high-resolution, nondestructive imaging modality that enables time-serial assessment of adenoma development in the mouse model of colorectal cancer. In this study, OCT was utilized to evaluate the effectiveness of interventions with the experimental antitumor agent α-difluoromethylornithine (DFMO) and a nonsteroidal anti-inflammatory drug sulindac during early [chemoprevention (CP)] and late stages [chemotherapy (CT)] of colon tumorigenesis. Biological endpoints for drug interventions included OCT-generated tumor number and tumor burden. Immunochistochemistry was used to evaluate biochemical endpoints [Ki-67, cleaved caspase-3, cyclooxygenase (COX)-2, β-catenin]. K-Ras codon 12 mutations were studied with polymerase chain reaction-based technique. We demonstrated that OCT imaging significantly correlated with histological analysis of both tumor number and tumor burden for all experimental groups (P < 0.0001), but allows more accurate and full characterization of tumor number and burden growth rate because of its time-serial, nondestructive nature. DFMO alone or in combination with sulindac suppressed both the tumor number and tumor burden growth rate in the CP setting because of DFMO-mediated decrease in cell proliferation (Ki-67, P < 0.001) and K-RAS mutations frequency (P = 0.04). In the CT setting, sulindac alone and DFMO/sulindac combination were effective in reducing tumor number, but not tumor burden growth rate. A decrease in COX-2 staining in DFMO/sulindac CT groups (COX-2, P < 0.01) confirmed the treatment effect. Use of nondestructive OCT enabled repeated, quantitative evaluation of tumor number and burden, allowing changes in these parameters to be measured during CP and as a result of CT. In conclusion, OCT is a robust minimally invasive method for monitoring colorectal cancer disease and effectiveness of therapies in mouse models.

Texture analysis and classification in coherent anti-Stokes Raman scattering (CARS) microscopy images for automated detection of skin cancer

Coherent anti-Stokes Raman scattering (CARS) microscopy is a powerful tool for fast label-free tissue imaging, which is promising for early medical diagnostics. To facilitate the diagnostic process, automatic image analysis algorithms, which are capable of extracting relevant features from the image content, are needed. In this contribution we perform an automated classification of healthy and tumor areas in CARS images of basal cell carcinoma (BCC) skin samples. The classification is based on extraction of texture features from image regions and subsequent classification of these regions into healthy and cancerous with a perceptron algorithm. The developed approach is capable of an accurate classification of texture types with high sensitivity and specificity, which is an important step towards an automated tumor detection procedure.

Advances and challenges in label-free nonlinear optical imaging using two-photon excitation fluorescence and second harmonic generation for cancer research

Nonlinear optical imaging (NLOI) has emerged to be a promising tool for bio-medical imaging in recent times. Among the various applications of NLOI, its utility is the most significant in the field of pre-clinical and clinical cancer research. This review begins by briefly covering the core principles involved in NLOI, such as two-photon excitation fluorescence (TPEF) and second harmonic generation (SHG). Subsequently, there is a short description on the various cellular components that contribute to endogenous optical fluorescence. Later on the review deals with its main theme--the challenges faced during label-free NLO imaging in translational cancer research. While this review addresses the accomplishment of various label-free NLOI based studies in cancer diagnostics, it also touches upon the limitations of the mentioned studies. In addition, areas in cancer research that need to be further investigated by label-free NLOI are discussed in a latter segment. The review eventually concludes on the note that label-free NLOI has and will continue to contribute richly in translational cancer research, to eventually provide a very reliable, yet minimally invasive cancer diagnostic tool for the patient.

Noise characterization of broadband fiber Cherenkov radiation as a visible-wavelength source for optical coherence tomography and two-photon fluorescence microscopy

Optical sources in the visible region immediately adjacent to the near-infrared biological optical window are preferred in imaging techniques such as spectroscopic optical coherence tomography of endogenous absorptive molecules and two-photon fluorescence microscopy of intrinsic fluorophores. However, existing sources based on fiber supercontinuum generation are known to have high relative intensity noise and low spectral coherence, which may degrade imaging performance. Here we compare the optical noise and pulse compressibility of three high-power fiber Cherenkov radiation sources developed recently, and evaluate their potential to replace the existing supercontinuum sources in these imaging techniques.

Accumulating advantages, reducing limitations: multimodal nonlinear imaging in biomedical sciences - the synergy of multiple contrast mechanisms

Multimodal nonlinear microscopy has matured during the past decades to one of the key imaging modalities in life science and biomedicine due to its unique capabilities of label-free visualization of tissue structure and chemical composition, high depth penetration, intrinsic 3D sectioning, diffraction limited resolution and low phototoxicity. This review briefly summarizes first recent advances in the field regarding the methodology, e.g., contrast mechanisms and signal characteristics used for contrast generation as well as novel image processing approaches. The second part deals with technologic developments emphasizing improvements in penetration depth, imaging speed, spatial resolution and nonlinear labeling strategies. The third part focuses on recent applications in life science fundamental research and biomedical diagnostics as well as future clinical applications.

Detection and Discrimination of Non-Melanoma Skin Cancer by Multimodal Imaging

Non-melanoma skin cancer (NMSC) belongs to the most frequent human neoplasms. Its exposed location facilitates a fast ambulant treatment. However, in the clinical practice far more lesions are removed than necessary, due to the lack of an efficient pre-operational examination procedure: Standard imaging methods often do not provide a sufficient spatial resolution. The demand for an efficient in vivo imaging technique might be met in the near future by non-linear microscopy. As a first step towards this goal, the appearance of NMSC in various microspectroscopic modalities has to be defined and approaches have to be derived to distinguish healthy skin from NMSC using non-linear optical microscopy. Therefore, in this contribution the appearance of ex vivo NMSC in a combination of coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG) and two photon excited fluorescence (TPEF) imaging—referred as multimodal imaging—is described. Analogous to H&E staining, an overview of the distinct appearances and features of basal cell and squamous cell carcinoma in the complementary modalities is derived, and is expected to boost in vivo studies of this promising technological approach.

Techniques for assessing 3-D cell-matrix mechanical interactions in vitro and in vivo

Cellular interactions with extracellular matrices (ECM) through the application of mechanical forces mediate numerous biological processes including developmental morphogenesis, wound healing and cancer metastasis. They also play a key role in the cellular repopulation and/or remodeling of engineered tissues and organs. While 2-D studies can provide important insights into many aspects of cellular mechanobiology, cells reside within 3-D ECMs in vivo, and matrix structure and dimensionality have been shown to impact cell morphology, protein organization and mechanical behavior. Global measurements of cell-induced compaction of 3-D collagen matrices can provide important insights into the regulation of overall cell contractility by various cytokines and signaling pathways. However, to understand how the mechanics of cell spreading, migration, contraction and matrix remodeling are regulated at the molecular level, these processes must also be studied in individual cells. Here we review the evolution and application of techniques for imaging and assessing local cell-matrix mechanical interactions in 3-D culture models, tissue explants and living animals.

Automated seeding-based nuclei segmentation in nonlinear optical microscopy

Nonlinear optical (NLO) microscopy based, e.g., on coherent anti-Stokes Raman scattering (CARS) or two-photon-excited fluorescence (TPEF) is a fast label-free imaging technique, with a great potential for biomedical applications. However, NLO microscopy as a diagnostic tool is still in its infancy; there is a lack of robust and durable nuclei segmentation methods capable of accurate image processing in cases of variable image contrast, nuclear density, and type of investigated tissue. Nonetheless, such algorithms specifically adapted to NLO microscopy present one prerequisite for the technology to be routinely used, e.g., in pathology or intraoperatively for surgical guidance. In this paper, we compare the applicability of different seeding and boundary detection methods to NLO microscopic images in order to develop an optimal seeding-based approach capable of accurate segmentation of both TPEF and CARS images. Among different methods, the Laplacian of Gaussian filter showed the best accuracy for the seeding of the image, while a modified seeded watershed segmentation was the most accurate in the task of boundary detection. The resulting combination of these methods followed by the verification of the detected nuclei performs high average sensitivity and specificity when applied to various types of NLO microscopy images.

Three-dimensional multiphoton/optical coherence tomography for diagnostic applications in dermatology

A preliminary clinical trial using state-of-the-art multiphoton tomography (MPT) and optical coherence tomography (OCT) for three-dimensional (3D) multimodal in vivo imaging of normal skin, nevi, scars and pathologic skin lesions has been conducted. MPT enabled visualization of sub-cellular details with axial and transverse resolutions of <2 μm and <0.5 μm, respectively, from a volume of 0.35 × 0.35 × 0.2 mm(3) at a frame rate of 0.14 Hz (512 × 512 pixels). State-of-the-art OCT, operating at a center wavelength of 1300 nm, was capable of acquiring 3D images depicting the layered architecture of skin with axial and transverse resolutions ~8 μm and ~20 μm, respectively, from a volume of 7 × 3.5 × 1.5 mm(3) at a frame rate of 46 Hz (1024 × 1024 pixels). This study demonstrates the clinical diagnostic potential of MPT/OCT for pre-screening relatively large areas of skin using 3D OCT to identify suspicious regions at microscopic level and subsequently using high resolution MPT to obtain zoomed in, sub-cellular level information of the respective regions.

Tri-modal microscopy with multiphoton and optical coherence microscopy/tomography for multi-scale and multi-contrast imaging

Multi-scale multimodal microscopy is a very useful technique by providing multiple imaging contrasts with adjustable field of views and spatial resolutions. Here, we present a tri-modal microscope combining multiphoton microscopy (MPM), optical coherence microscopy (OCM) and optical coherence tomography (OCT) for subsurface visualization of biological tissues. The advantages of the tri-modal system are demonstrated on various biological samples. It enables the visualization of multiple intrinsic contrasts including scattering, two-photon excitation fluorescence (TPEF), and second harmonic generation (SHG). It also enables a rapid scanning over a large tissue area and a high resolution zoom-in for cellular-level structures on regions of interest. The tri-modal microscope can be important for label-free imaging to obtain a sufficient set of parameters for reliable sample analysis.