Third harmonic generation imaging for fast, label-free pathology of human brain tumors

Uniaxial mechanical stretch properties correlated with three-dimensional microstructure of human dermal skin

The intact and healthy skin forms a barrier to the outside world and protects the body from mechanical impact. The skin is a complex structure with unique mechano-elastic properties. To better direct the design of biomimetic materials and induce skin regeneration in wounds with optimal outcome, more insight is required in how the mechano-elastic properties emerge from the skin's main constituents, collagen and elastin fibers. Here, we employed two-photon excited autofluorescence and second harmonic generation microscopy to characterize collagen and elastin fibers in 3D in 24 human dermis skin samples. Through uniaxial stretching experiments, we derive uni-directional mechanical properties from resultant stress-strain curves, including the initial Young's modulus, elastic Young's modulus, maximal stress, and maximal and mid-strain values. The stress-strain curves show a large variation, with an average Young's modules in the toe and linear regions of 0.1 MPa and 21 MPa. We performed a comprehensive analysis of the correlation between the key mechanical properties with age and with microstructural parameters, e.g., fiber density, thickness, and orientation. Age was found to correlate negatively with Young's modulus and collagen density. Moreover, real-time monitoring during uniaxial stretching allowed us to observe changes in collagen and elastin alignment. Elastin fibers aligned significantly in both the heel and linear regions, and the collagen bundles engaged and oriented mainly in the linear region. This research advances our understanding of skin biomechanics and yields input for future first principles full modeling of skin tissue.

Diving head-first into brain intravital microscopy

Tissue microenvironments during physiology and pathology are highly complex, meaning dynamic cellular activities and their interactions cannot be accurately modelled ex vivo or in vitro. In particular, tissue-specific resident cells which may function and behave differently after isolation and the heterogenous vascular beds in various organs highlight the importance of observing such processes in real-time in vivo. This challenge gave rise to intravital microscopy (IVM), which was discovered over two centuries ago. From the very early techniques of low-optical resolution brightfield microscopy, limited to transparent tissues, IVM techniques have significantly evolved in recent years. Combined with improved animal surgical preparations, modern IVM technologies have achieved significantly higher speed of image acquisition and enhanced image resolution which allow for the visualisation of biological activities within a wider variety of tissue beds. These advancements have dramatically expanded our understanding in cell migration and function, especially in organs which are not easily accessible, such as the brain. In this review, we will discuss the application of rodent IVM in neurobiology in health and disease. In particular, we will outline the capability and limitations of emerging technologies, including photoacoustic, two- and three-photon imaging for brain IVM. In addition, we will discuss the use of these technologies in the context of neuroinflammation.

Current Landscape of Advanced Imaging Tools for Pathology Diagnostics

Histopathology relies on century-old workflows of formalin fixation, paraffin embedding, sectioning, and staining tissue specimens on glass slides. Despite being robust, this conventional process is slow, labor-intensive, and limited to providing two-dimensional views. Emerging technologies promise to enhance and accelerate histopathology. Slide-free microscopy allows rapid imaging of fresh, unsectioned specimens, overcoming slide preparation delays. Methods such as fluorescence confocal microscopy, multiphoton microscopy, along with more recent innovations including microscopy with UV surface excitation and fluorescence-imitating brightfield imaging can generate images resembling conventional histology directly from the surface of tissue specimens. Slide-free microscopy enable applications such as rapid intraoperative margin assessment and, with appropriate technology, three-dimensional histopathology. Multiomics profiling techniques, including imaging mass spectrometry and Raman spectroscopy, provide highly multiplexed molecular maps of tissues, although clinical translation remains challenging. Artificial intelligence is aiding the adoption of new imaging modalities via virtual staining, which converts methods such as slide-free microscopy into synthetic brightfield-like or even molecularly informed images. Although not yet commonplace, these emerging technologies collectively demonstrate the potential to modernize histopathology. Artificial intelligence-assisted workflows will ease the transition to new imaging modalities. With further validation, these advances may transform the century-old conventional histopathology pipeline to better serve 21st-century medicine. This review provides an overview of these enabling technology platforms and discusses their potential impact.

Vibrational spectroscopy and multiphoton microscopy for label-free visualization of nervous system degeneration and regeneration

Neurological disorders, including spinal cord injury, peripheral nerve injury, traumatic brain injury, and neurodegenerative diseases, pose significant challenges in terms of diagnosis, treatment, and understanding the underlying pathophysiological processes. Label-free multiphoton microscopy techniques, such as coherent Raman scattering, two-photon excited autofluorescence, and second and third harmonic generation microscopy, have emerged as powerful tools for visualizing nervous tissue with high resolution and without the need for exogenous labels. Coherent Raman scattering processes as well as third harmonic generation enable label-free visualization of myelin sheaths, while their combination with two-photon excited autofluorescence and second harmonic generation allows for a more comprehensive tissue visualization. They have shown promise in assessing the efficacy of therapeutic interventions and may have future applications in clinical diagnostics. In addition to multiphoton microscopy, vibrational spectroscopy methods such as infrared and Raman spectroscopy offer insights into the molecular signatures of injured nervous tissues and hold potential as diagnostic markers. This review summarizes the application of these label-free optical techniques in preclinical models and illustrates their potential in the diagnosis and treatment of neurological disorders with a special focus on injury, degeneration, and regeneration. Furthermore, it addresses current advancements and challenges for bridging the gap between research findings and their practical applications in a clinical setting.

SLAM medical imaging enabled by pre-chirp and gain jointly managed Yb-fiber laser

We demonstrate a pre-chirp and gain jointly managed Yb-fiber laser that drives simultaneous label-free autofluorescence-multiharmonic (SLAM) medical imaging. We show that a gain managed Yb-fiber amplifier produces high-quality compressed pulses when the seeding pulses exhibit proper negative pre-chirp. The resulting laser source can generate 43-MHz, 34-fs pulses centered at 1110 nm with more than 90-nJ energy. We apply this ultrafast source to SLAM imaging of cellular and extracellular components in various human tissues of intestinal adenocarcinoma, lung adenocarcinoma, and liver.

Compact portable higher harmonic generation microscopy for the real time assessment of unprocessed thyroid tissue

During thyroid surgery fast and reliable intra-operative pathological feedback has the potential to avoid a two-stage procedure and significantly reduce health care costs in patients undergoing a diagnostic hemithyroidectomy (HT). We explored higher harmonic generation (HHG) microscopy, which combines second harmonic generation (SHG), third harmonic generation (THG), and multiphoton excited autofluorescence (MPEF) for this purpose. With a compact, portable HHG microscope, images of freshly excised healthy tissue, benign nodules (follicular adenoma) and malignant tissue (papillary carcinoma, follicular carcinoma and spindle cell carcinoma) were recorded. The images were generated on unprocessed tissue within minutes and show relevant morphological thyroid structures in good accordance with the histology images. The thyroid follicle architecture, cells, cell nuclei (THG), collagen organization (SHG) and the distribution of thyroglobulin and/or thyroid hormones T3 or T4 (MPEF) could be visualized. We conclude that SHG/THG/MPEF imaging is a promising tool for clinical intraoperative assessment of thyroid tissue.

Single source CARS-based multimodal microscopy system for biological tissue imaging [Invited]

A coherent anti-Stokes Raman scattering (CARS)-based multimodality microscopy system was developed using a single Ti:sapphire femtosecond laser source for biological imaging. It provides three complementary and co-registered imaging modalities: CARS, MPM (multiphoton microscopy), and RCM (reflectance confocal microscopy). The imaging speed is about 1 frame-per-second (fps) with a digital resolution of 1024 × 1024 pixels. This microscopy system can provide clear 2-dimensional and 3-dimensional images of ex-vivo biological tissue samples. Its spectral selection initiates vibrational excitation in lipid cells (approximately 2850 cm-1) using two filters on the pump and Stokes beam paths. The excitation can be tuned over a wide spectral range with adjustable spectral filters. The imaging capability of this CARS-based multimodal microscopy system was demonstrated using porcine fat, murine skin, and murine liver tissue samples.

Advances in Intraoperative Glioma Tissue Sampling and Infiltration Assessment

Gliomas are infiltrative brain tumors that often involve functional tissue. While maximal safe resection is critical for maximizing survival, this is challenged by the difficult intraoperative discrimination between tumor-infiltrated and normal structures. Surgical expertise is essential for identifying safe margins, and while the intraoperative pathological review of frozen tissue is possible, this is a time-consuming task. Advances in intraoperative stimulation mapping have aided surgeons in identifying functional structures and, as such, has become the gold standard for this purpose. However, intraoperative margin assessment lacks a similar consensus. Nonetheless, recent advances in intraoperative imaging techniques and tissue examination methods have demonstrated promise for the accurate and efficient assessment of tumor infiltration and margin delineation within the operating room, respectively. In this review, we describe these innovative technologies that neurosurgeons should be aware of.

In vivo label-free optical signatures of chemotherapy response in human pancreatic ductal adenocarcinoma patient-derived xenografts

Pancreatic cancer is a devastating disease often detected at later stages, necessitating swift and effective chemotherapy treatment. However, chemoresistance is common and its mechanisms are poorly understood. Here, label-free multi-modal nonlinear optical microscopy was applied to study microstructural and functional features of pancreatic tumors in vivo to monitor inter- and intra-tumor heterogeneity and treatment response. Patient-derived xenografts with human pancreatic ductal adenocarcinoma were implanted into mice and characterized over five weeks of intraperitoneal chemotherapy (FIRINOX or Gem/NabP) with known responsiveness/resistance. Resistant and responsive tumors exhibited a similar initial metabolic response, but by week 5 the resistant tumor deviated significantly from the responsive tumor, indicating that a representative response may take up to five weeks to appear. This biphasic metabolic response in a chemoresistant tumor reveals the possibility of intra-tumor spatiotemporal heterogeneity of drug responsiveness. These results, though limited by small sample size, suggest the possibility for further work characterizing chemoresistance mechanisms using nonlinear optical microscopy.

Effect of tissue fixation on the optical properties of structural components assessed by non-linear microscopy imaging

Fixation methods such as formalin are commonly used for the preservation of tissue with the aim of keeping their structure as close as possible to the native condition. However, fixatives chemically interact with tissue molecules, such as collagen in the extracellular matrix (ECM) or myosin, and may thus modify their structure. Taking advantage of the second- and third-harmonic generation (SHG and THG) emission capabilities of such components, we used nonlinear two-photon microscopy (NL2PM) to evaluate the effect that preservation methods, such as chemical fixatives, have on the nonlinear capabilities of protein components within mouse tissues. Our results show that depending on the preservation technique used, the nonlinear capabilities of collagen, lipid droplets and myosin microarchitecture are strongly affected. Parameters of collagen fibers, such as density and branch points, especially in collagen-sparse regions, e.g., in kidneys, were found to be altered upon formalin fixation. Moreover, cryo-freezing drastically reduced SHG signals from myosin. Our findings provide valuable information to select the best tissue fixation method for visualization and quantification of structural proteins, such as collagen and myosin by advanced NL2PM imaging techniques. This may advance the interpretation of the role these proteins play in disease.

Rapid digital pathology of H&E-stained fresh human brain specimens as an alternative to frozen biopsy

BACKGROUND

Hematoxylin and Eosin (H&E)-based frozen section (FS) pathology is presently the global standard for intraoperative tumor assessment (ITA). Preparation of frozen section is labor intensive, which might consume up-to 30 minutes, and is susceptible to freezing artifacts. An FS-alternative technique is thus necessary, which is sectioning-free, artifact-free, fast, accurate, and reliably deployable without machine learning and/or additional interpretation training.

METHODS

We develop a training-free true-H&E Rapid Fresh digital-Pathology (the-RFP) technique which is 4 times faster than the conventional preparation of frozen sections. The-RFP is assisted by a mesoscale Nonlinear Optical Gigascope (mNLOG) platform with a streamlined rapid artifact-compensated 2D large-field mosaic-stitching (rac2D-LMS) approach. A sub-6-minute True-H&E Rapid whole-mount-Soft-Tissue Staining (the-RSTS) protocol is introduced for soft/frangible fresh brain specimens. The mNLOG platform utilizes third harmonic generation (THG) and two-photon excitation fluorescence (TPEF) signals from H and E dyes, respectively, to yield the-RFP images.

RESULTS

We demonstrate the-RFP technique on fresh excised human brain specimens. The-RFP enables optically-sectioned high-resolution 2D scanning and digital display of a 1 cm² area in <120 seconds with 3.6 Gigapixels at a sustained effective throughput of >700 M bits/sec, with zero post-acquisition data/image processing. Training-free blind tests considering 50 normal and tumor-specific brain specimens obtained from 8 participants reveal 100% match to the respective formalin-fixed paraffin-embedded (FFPE)-biopsy outcomes.

CONCLUSIONS

We provide a digital ITA solution: the-RFP, which is potentially a fast and reliable alternative to FS-pathology. With H&E-compatibility, the-RFP eliminates color- and morphology-specific additional interpretation training for a pathologist, and the-RFP-assessed specimen can reliably undergo FFPE-biopsy confirmation.

Third harmonic imaging contrast from tubular structures in the presence of index discontinuity

Accurate interpretation of third harmonic generation (THG) microscopy images in terms of sample optical properties and microstructure is generally hampered by the presence of excitation field distortions resulting from sample heterogeneity. Numerical methods that account for these artifacts need to be established. In this work, we experimentally and numerically analyze the THG contrast obtained from stretched hollow glass pipettes embedded in different liquids. We also characterize the nonlinear optical properties of 2,2[Formula: see text]-thiodiethanol (TDE), a water-soluble index-matching medium. We find that index discontinuity not only changes the level and modulation amplitude of polarization-resolved THG signals, but can even change the polarization direction producing maximum THG near interfaces. We then show that a finite-difference time-domain (FDTD) modeling strategy can accurately account for contrast observed in optically heterogeneous samples, whereas reference Fourier-based numerical approaches are accurate only in the absence of index mismatch. This work opens perspectives for interpreting THG microscopy images of tubular objects and other geometries.

Fast intraoperative histology-based diagnosis of gliomas with third harmonic generation microscopy and deep learning

Management of gliomas requires an invasive treatment strategy, including extensive surgical resection. The objective of the neurosurgeon is to maximize tumor removal while preserving healthy brain tissue. However, the lack of a clear tumor boundary hampers the neurosurgeon's ability to accurately detect and resect infiltrating tumor tissue. Nonlinear multiphoton microscopy, in particular higher harmonic generation, enables label-free imaging of excised brain tissue, revealing histological hallmarks within seconds. Here, we demonstrate a real-time deep learning-based pipeline for automated glioma image analysis, matching video-rate image acquisition. We used a custom noise detection scheme, and a fully-convolutional classification network, to achieve on average 79% binary accuracy, 0.77 AUC and 0.83 mean average precision compared to the consensus of three pathologists, on a preliminary dataset. We conclude that the combination of real-time imaging and image analysis shows great potential for intraoperative assessment of brain tissue during tumor surgery.

Label-free highly multimodal nonlinear endoscope

We demonstrate a 2 mm diameter highly multimodal nonlinear micro-endoscope allowing label-free imaging of biological tissues. The endoscope performs multiphoton fluorescence (3-photon, 2-photon), harmonic generation (second-SHG and third-THG) and coherent anti-Stokes Raman scattering (CARS) imaging over a field of view of 200 µm. The micro-endoscope is based on a double-clad antiresonant hollow core fiber featuring a high transmission window (850 nm to 1800 nm) that is functionalized with a short piece of graded-index (GRIN) fiber. When combined with a GRIN micro-objective, the micro-endoscope achieves a 1.1 µm point spread function (PSF). We demonstrate 3-photon, 2-photon, THG, SHG, and CARS high resolution images of unlabelled biological tissues.

Dual-wavelength multimodal multiphoton microscope with SMA-based depth scanning

We report on a multimodal multiphoton microscopy (MPM) system with depth scanning. The multimodal capability is realized by an Er-doped femtosecond fiber laser with dual output wavelengths of 1580 nm and 790 nm that are responsible for three-photon and two-photon excitation, respectively. A shape-memory-alloy (SMA) actuated miniaturized objective enables the depth scanning capability. Image stacks combined with two-photon excitation fluorescence (TPEF), second harmonic generation (SHG), and third harmonic generation (THG) signals have been acquired from animal, fungus, and plant tissue samples with a maximum depth range over 200 µm.

Intraoperative imaging in pathology-assisted surgery

The pathological assessment of surgical specimens during surgery can reduce the incidence of positive resection margins, which otherwise can result in additional surgeries or aggressive therapeutic regimens. To improve patient outcomes, intraoperative spectroscopic, fluorescence-based, structural, optoacoustic and radiological imaging techniques are being tested on freshly excised tissue. The specific clinical setting and tumour type largely determine whether endogenous or exogenous contrast is to be detected and whether the tumour specificity of the detected biomarker, image resolution, image-acquisition times or penetration depth are to be prioritized. In this Perspective, we describe current clinical standards for intraoperative tissue analysis and discuss how intraoperative imaging is being implemented. We also discuss potential implementations of intraoperative pathology-assisted surgery for clinical decision-making.

Commercially derived versatile optical architecture for two-photon STED, wavelength mixing and label-free microscopy

Multimodal microscopy combines multiple non-linear techniques that take advantage of different optical processes to generate contrast and increase the amount of information that can be obtained from biological samples. However, the most advanced optical architectures are typically custom-made and often require on-site adjustment of optical components performed by trained personnel for optimal performance. Here, we describe a hybrid system we built based on a commercial upright microscope. We show that our multimodal imaging platform can be used to seamlessly perform two-photon STED, wavelength mixing and label-free microscopy in both ex vivo and in vivo turbid samples. The system is stable and endowed with remote alignment hardware that ensures long-term operability also for non-expert users, using the alignment protocol described in this article and in the related material. This optical architecture is an important step forward towards a wider practical applicability of non-linear optics to bioimaging.

Optical biopsy of laryngeal lesions using femtosecond multiphoton microscopy

Laryngeal squamous cell carcinoma (LSCC) is one of the most prevalent malignancy of the upper aerodigestive tract. Detection of early lesions in vivo could improve the survival rate significantly. In this study, we demonstrated that femtosecond multiphoton microscopy (MPM) is an effective tool to visualize the microscopic features within fixed laryngeal tissues, without sectioning, staining, or labeling. Accurate detection of lesions and determination of the tumor grading can be achieved, with excellent consistency with conventional histological examination. These results suggest that MPM may represent a powerful tool for in-vivo or fast ex-vivo diagnosis of laryngeal lesions at the point of care.

Application of P(VDF-TrFE) Glass Coating for Robust Harmonic Nanoparticles Characterization

Polyvinylidene fluoride and its copolymers are a well-known family of low-cost ferroelectric materials widely used for the fabrication of devices for a wide range of applications. A biocompatibility, high optical quality, chemical and mechanical durability of poly(vinylidene fluoride–trifluoroethylene), (P(VDF–TrFE)), makes it particularly attractive for designing of effective coating layers for different diagnostic techniques. In the present work, the nonlinear optical characterization of P(VDF-TrFE)-coating films deposited onto a glass substrate was done. Advantages of the coating application for cells/substrates in the field of multiphoton imaging the efficiency of such coating layer for long-duration characterization of so-called harmonic nanoparticles (HNPs) were shown. The influence of glass surface protection by P(VDF-TrFE) film from an effect of HNPs sticking to the walls of the flow-cell was analyzed for effective studying of the optical harmonics generation efficiency of HNPs making the analysis more robust.

Compact portable multiphoton microscopy reveals histopathological hallmarks of unprocessed lung tumor tissue in real time

During lung cancer operations a rapid and reliable assessment of tumor tissue can reduce operation time and potentially improve patient outcomes. We show that third harmonic generation (THG), second harmonic generation (SHG) and two-photon excited autofluorescence (2PEF) microscopy reveals relevant, histopathological information within seconds in fresh unprocessed human lung samples. We used a compact, portable microscope and recorded images within 1 to 3 seconds using a power of 5 mW. The generated THG/SHG/2PEF images of tumorous and nontumorous tissues are compared with the corresponding standard histology images, to identify alveolar structures and histopathological hallmarks. Cellular structures (tumor cells, macrophages and lymphocytes) (THG), collagen (SHG) and elastin (2PEF) are differentiated and allowed for rapid identification of carcinoid with solid growth pattern, minimally enlarged monomorphic cell nuclei with salt-and-pepper chromatin pattern, and adenocarcinoma with lipidic and micropapillary growth patterns. THG/SHG/2PEF imaging is thus a promising tool for clinical intraoperative assessment of lung tumor tissue.

Third Harmonic Generation microscopy distinguishes malignant cell grade in human breast tissue biopsies

The ability to distinguish and grade malignant cells during surgical procedures in a fast, non-invasive and staining-free manner is of high importance in tumor management. To this extend, Third Harmonic Generation (THG), Second Harmonic Generation (SHG) and Fourier-Transform Infrared (FTIR) spectroscopy were applied to discriminate malignant from healthy cells in human breast tissue biopsies. Indeed, integration of non-linear processes into a single, unified microscopy platform offered complementary structural information within individual cells at the submicron level. Using a single laser beam, label-free THG imaging techniques provided important morphological information as to the mean nuclear and cytoplasmic area, cell volume and tissue intensity, which upon quantification could not only distinguish cancerous from benign breast tissues but also define disease severity. Simultaneously, collagen fibers that could be detected by SHG imaging showed a well structured continuity in benign tumor tissues, which were gradually disoriented along with disease severity. Combination of THG imaging with FTIR spectroscopy could provide a clearer distinction among the different grades of breast cancer, since FTIR analysis showed increased lipid concentrations in malignant tissues. Thus, the use of non-linear optical microscopy can be considered as powerful and harmless tool for tumor cell diagnostics even during real time surgery procedures.

Label-free multiphoton imaging allows brain tumor recognition based on texture analysis-a study of 382 tumor patients

Background

Label-free multiphoton microscopy has been suggested for intraoperative recognition and delineation of brain tumors. For any future clinical application, appropriate approaches for image acquisition and analysis have to be developed. Moreover, an evaluation of the reliability of the approach, taking into account inter- and intrapatient variability, is needed.

Methods

Coherent anti-Stokes Raman scattering (CARS), two-photon excited fluorescence (TPEF), and second-harmonic generation were acquired on cryosections of brain tumors of 382 patients and 28 human nontumor brain samples. Texture parameters of those images were calculated and used as input for linear discriminant analysis.

Results

The combined analysis of texture parameters of the CARS and TPEF signal proved to be most suited for the discrimination of nontumor brain versus brain tumors (low- and high-grade astrocytoma, oligodendroglioma, glioblastoma, recurrent glioblastoma, brain metastases of lung, colon, renal, and breast cancer and of malignant melanoma) leading to a correct rate of 96% (sensitivity: 96%, specificity: 100%). To approximate the clinical setting, the results were validated on 42 fresh, unfixed tumor biopsies. 82% of the tumors and, most important, all of the nontumor samples were correctly recognized. An image resolution of 1 µm was sufficient to distinguish brain tumors and nontumor brain. Moreover, the vast majority of single fields of view of each patient’s sample were correctly classified with high probabilities, which is important for clinical translation.

Conclusion

Label-free multiphoton imaging might allow fast and accurate intraoperative delineation of primary and secondary brain tumors in combination with endoscopic systems.

Additive-color multi-harmonic generation microscopy for simultaneous label-free differentiation of plaques, tangles, and neuronal axons

Multicolor fluorescence imaging has been widely used by neuroscientists to simultaneously observe different neuropathological features of the brain. However, these optical modalities rely on exogenous labeling. Here, we demonstrate, for the first time, a label-free additive-color multi-harmonic generation microscopy to elucidate, concurrently with different hues, Alzheimer's disease (AD) neuropathological hallmarks: amyloid β (Aβ) plaques and neurofibrillary tangles (NFT). By treating third harmonic generation (THG) and second harmonic generation (SHG) as two primary colors, our study can simultaneously label-free differentiate AD hallmarks by providing different additive colors between Aβ plaques, NFT, and neuronal axons, with weaker THG presentation from NFT in most places of the brain. Interestingly our pixel-based quantification and Pearson's correlation results further corroborated these findings. Our proposed label-free technique fulfills the unmet challenge in the clinical histopathology for stain-free slide-free differential visualization of neurodegenerative disease pathologies, with a sub-femtoliter resolution in a single image field-of-view.

Dynamically manipulating third-harmonic generation of phase change material with gap-plasmon resonators

Here we theoretically demonstrate a dynamic third-harmonic generation (THG) device by incorporating chalcogenide phase change material (Ge₂Sb₂Te₅) into ultra-small cavities of gap-plasmon resonators. Through coupling to plasmonic resonances, the THG efficiency of Ge₂Sb₂Te₅ is increased up to five orders of magnitude due to the greatly enhanced electromagnetic fields within the ultra-small cavities. More interestingly, the THG signals of the proposed device can be dynamically switched on and off by tuning the phase states of Ge₂Sb₂Te₅ between amorphous and crystalline. Our proposed dynamic THG nanostructures are beneficial to developing dynamic nonlinear nanophotonic devices.

Quantitative Histopathology of Stained Tissues using Color Spatial Light Interference Microscopy (cSLIM)

Tissue biopsy evaluation in the clinic is in need of quantitative disease markers for diagnosis and, most importantly, prognosis. Among the new technologies, quantitative phase imaging (QPI) has demonstrated promise for histopathology because it reveals intrinsic tissue nanoarchitecture through the refractive index. However, a vast majority of past QPI investigations have relied on imaging unstained tissues, which disrupts the established specimen processing. Here we present color spatial light interference microscopy (cSLIM) as a new whole-slide imaging modality that performs interferometric imaging on stained tissue, with a color detector array. As a result, cSLIM yields in a single scan both the intrinsic tissue phase map and the standard color bright-field image, familiar to the pathologist. Our results on 196 breast cancer patients indicate that cSLIM can provide stain-independent prognostic information from the alignment of collagen fibers in the tumor microenvironment. The effects of staining on the tissue phase maps were corrected by a mathematical normalization. These characteristics are likely to reduce barriers to clinical translation for the new cSLIM technology.

Speckle modulation enables high-resolution wide-field human brain tumor margin detection and in vivo murine neuroimaging

Current in vivo neuroimaging techniques provide limited field of view or spatial resolution and often require exogenous contrast. These limitations prohibit detailed structural imaging across wide fields of view and hinder intraoperative tumor margin detection. Here we present a novel neuroimaging technique, speckle-modulating optical coherence tomography (SM-OCT), which allows us to image the brains of live mice and ex vivo human samples with unprecedented resolution and wide field of view using only endogenous contrast. The increased visibility provided by speckle elimination reveals white matter fascicles and cortical layer architecture in brains of live mice. To our knowledge, the data reported herein represents the highest resolution imaging of murine white matter structure achieved in vivo across a wide field of view of several millimeters. When applied to an orthotopic murine glioblastoma xenograft model, SM-OCT readily identifies brain tumor margins with resolution of approximately 10 μm. SM-OCT of ex vivo human temporal lobe tissue reveals fine structures including cortical layers and myelinated axons. Finally, when applied to an ex vivo sample of a low-grade glioma resection margin, SM-OCT is able to resolve the brain tumor margin. Based on these findings, SM-OCT represents a novel approach for intraoperative tumor margin detection and in vivo neuroimaging.

Quantitative Third Harmonic Generation Microscopy for Assessment of Glioma in Human Brain Tissue

Distinguishing tumors from normal brain cells is important but challenging in glioma surgery due to the lack of clear interfaces between the two. The ability of label-free third harmonic generation (THG) microscopy in combination with automated image analysis to quantitatively detect glioma infiltration in fresh, unprocessed tissue in real time is assessed. The THG images reveal increased cellularity in grades II-IV glioma samples from 23 patients, as confirmed by subsequent hematoxylin and eosin histology. An automated image quantification workflow is presented for quantitative assessment of the imaged cellularity as a reflection of the degree of glioma invasion. The cellularity is validated in three ways: 1) Quantitative comparison of THG imaging with fluorescence microscopy of nucleus-stained samples demonstrates that THG reflects the true tissue cellularity. 2) Thresholding of THG cellularity differentiates normal brain from glioma infiltration, with 96.6% sensitivity and 95.5% specificity, in nearly perfect (93%) agreement with pathologists. 3) In one patient, a good correlation between THG cellularity and preoperative magnetic resonance and positron emission tomography imaging is demonstrated. In conclusion, quantitative real-time THG microscopy accurately assesses glioma infiltration in ex vivo human brain samples, and therefore holds strong potential for improving the accuracy of surgical resection.

Second and third harmonic generation microscopy visualizes key structural components in fresh unprocessed healthy human breast tissue

Real-time assessment of excised tissue may help to improve surgical results in breast tumor surgeries. Here, as a step towards this purpose, the potential of second and third harmonic generation (SHG, THG) microscopy is explored. SHG and THG are nonlinear optical microscopic techniques that do not require labeling of tissue to generate 3D images with intrinsic depth-sectioning at sub-cellular resolution. Until now, this technique had been applied on fixated breast tissue or to visualize the stroma only, whereas most tumors start in the lobules and ducts. Here, SHG/THG images of freshly excised unprocessed healthy human tissue are shown to reveal key breast components-lobules, ducts, fat tissue, connective tissue and blood vessels, in good agreement with hematoxylin and eosin histology. DNA staining of fresh unprocessed mouse breast tissue was performed to aid in the identification of cell nuclei in label-free THG images. Furthermore, 2- and 3-photon excited auto-fluorescence images of mouse and human tissue are collected for comparison. The SHG/THG imaging modalities generate high quality images of freshly excised tissue in less than a minute with an information content comparable to that of the gold standard, histopathology. Therefore, SHG/THG microscopy is a promising tool for real-time assessment of excised tissue during surgery.

Detection of the T cell activation state using nonlinear optical microscopy

The ability to monitor the activation state of T-cells during immunotherapy is of great importance. Although specific activation markers do exist, their abundance and complicated regulation cannot definitely define the activation state of the cells. Previous studies have shown that Third Harmonic Generation (THG) imaging could distinguish between activated versus resting microglia and healthy versus cancerous cells, mainly based on their lipid-body profiles. In the present study, mitogen or antigen-stimulated T-cells were subjected to THG imaging microscopy. Qualitative and quantitative analysis showed statistically significant increase of THG mean area and intensity in activated versus resting T-cells. The connection of THG imaging to chemical information was achieved using Raman spectroscopy, which showed significant differences between the activation processes and controls, correlating of THG signal area with cholesterol and lipid compounds, but not with triglycerides. The obtained results suggested a potential employment of nonlinear microscopy in evaluating of T-cell activation, which is expected to be largely appreciated in the clinical practice.

Multimodal imaging platform for optical virtual skin biopsy enabled by a fiber-based two-color ultrafast laser source

We demonstrate multimodal label-free nonlinear optical microscopy in human skin enabled by a fiber-based two-color ultrafast source. Energetic femtosecond pulses at 775 nm and 1250 nm are simultaneously generated by an Er-fiber laser source employing frequency doubling and self-phase modulation enabled spectral selection. The integrated nonlinear optical microscope driven by such a two-color femtosecond source enables the excitation of endogenous two-photon excitation fluorescence, second-harmonic generation, and third-harmonic generation in human skin. Such a 3-channel imaging platform constitutes a powerful tool for clinical application and optical virtual skin biopsy.

Tensor regularized total variation for denoising of third harmonic generation images of brain tumors

Third harmonic generation (THG) microscopy shows great potential for instant pathology of brain tissue during surgery. However, the rich morphologies contained and the noise associated makes image restoration, necessary for quantification of the THG images, challenging. Anisotropic diffusion filtering (ADF) has been recently applied to restore THG images of normal brain, but ADF is hard-to-code, time-consuming and only reconstructs salient edges. This work overcomes these drawbacks by expressing ADF as a tensor regularized total variation model, which uses the Huber penalty and the L1 norm for tensor regularization and fidelity measurement, respectively. The diffusion tensor is constructed from the structure tensor of ADF yet the tensor decomposition is performed only in the non-flat areas. The resulting model is solved by an efficient and easy-to-code primal-dual algorithm. Tests on THG brain tumor images show that the proposed model has comparable denoising performance as ADF while it much better restores weak edges and it is up to 60% more time efficient.

Optical force-induced nonlinearity and self-guiding of light in human red blood cell suspensions

Osmotic conditions play an important role in the cell properties of human red blood cells (RBCs), which are crucial for the pathological analysis of some blood diseases such as malaria. Over the past decades, numerous efforts have mainly focused on the study of the RBC biomechanical properties that arise from the unique deformability of erythrocytes. Here, we demonstrate nonlinear optical effects from human RBCs suspended in different osmotic solutions. Specifically, we observe self-trapping and scattering-resistant nonlinear propagation of a laser beam through RBC suspensions under all three osmotic conditions, where the strength of the optical nonlinearity increases with osmotic pressure on the cells. This tunable nonlinearity is attributed to optical forces, particularly the forward-scattering and gradient forces. Interestingly, in aged blood samples (with lysed cells), a notably different nonlinear behavior is observed due to the presence of free hemoglobin. We use a theoretical model with an optical force-mediated nonlocal nonlinearity to explain the experimental observations. Our work on light self-guiding through scattering bio-soft-matter may introduce new photonic tools for noninvasive biomedical imaging and medical diagnosis.

Compact fiber-based multi-photon endoscope working at 1700 nm

We present the design, implementation and performance analysis of a compact multi-photon endoscope based on a piezo electric scanning tube. A miniature objective lens with a long working distance and a high numerical aperture (≈ 0.5) is designed to provide a diffraction limited spot size. Furthermore, a 1700 nm wavelength femtosecond fiber laser is used as an excitation source to overcome the scattering of biological tissues and reduce water absorption. Therefore, the novel optical system along with the unique wavelength allows us to increase the imaging depth. We demonstrate that the endoscope is capable of performing third and second harmonic generation (THG/SHG) and three-photon excitation fluorescence (3PEF) imaging over a large field of view (> 400 μm) with high lateral resolution (2.2 μm). The compact and lightweight probe design makes it suitable for minimally-invasive in-vivo imaging as a potential alternative to surgical biopsies.

Molecular mobility and activity in an intravital imaging setting - implications for cancer progression and targeting

Molecular mobility, localisation and spatiotemporal activity are at the core of cell biological processes and deregulation of these dynamic events can underpin disease development and progression. Recent advances in intravital imaging techniques in mice are providing new avenues to study real-time molecular behaviour in intact tissues within a live organism and to gain exciting insights into the intricate regulation of live cell biology at the microscale level. The monitoring of fluorescently labelled proteins and agents can be combined with autofluorescent properties of the microenvironment to provide a comprehensive snapshot of in vivo cell biology. In this Review, we summarise recent intravital microscopy approaches in mice, in processes ranging from normal development and homeostasis to disease progression and treatment in cancer, where we emphasise the utility of intravital imaging to observe dynamic and transient events in vivo We also highlight the recent integration of advanced subcellular imaging techniques into the intravital imaging pipeline, which can provide in-depth biological information beyond the single-cell level. We conclude with an outlook of ongoing developments in intravital microscopy towards imaging in humans, as well as provide an overview of the challenges the intravital imaging community currently faces and outline potential ways for overcoming these hurdles.

High-throughput ultraviolet photoacoustic microscopy with multifocal excitation

Ultraviolet photoacoustic microscopy (UV-PAM) is a promising intraoperative tool for surgical margin assessment (SMA), one that can provide label-free histology-like images with high resolution. In this study, using a microlens array and a one-dimensional (1-D) array ultrasonic transducer, we developed a high-throughput multifocal UV-PAM (MF-UV-PAM). Our new system achieved a 1.6  ±  0.2  μm lateral resolution and produced images 40 times faster than the previously developed point-by-point scanning UV-PAM. MF-UV-PAM provided a readily comprehensible photoacoustic image of a mouse brain slice with specific absorption contrast in ∼16  min, highlighting cell nuclei. Individual cell nuclei could be clearly resolved, showing its practical potential for intraoperative SMA.

Quantitative comparison of 3D third harmonic generation and fluorescence microscopy images

Third harmonic generation (THG) microscopy is a label-free imaging technique that shows great potential for rapid pathology of brain tissue during brain tumor surgery. However, the interpretation of THG brain images should be quantitatively linked to images of more standard imaging techniques, which so far has been done qualitatively only. We establish here such a quantitative link between THG images of mouse brain tissue and all-nuclei-highlighted fluorescence images, acquired simultaneously from the same tissue area. For quantitative comparison of a substantial pair of images, we present here a segmentation workflow that is applicable for both THG and fluorescence images, with a precision of 91.3 % and 95.8 % achieved respectively. We find that the correspondence between the main features of the two imaging modalities amounts to 88.9 %, providing quantitative evidence of the interpretation of dark holes as brain cells. Moreover, 80 % bright objects in THG images overlap with nuclei highlighted in the fluorescence images, and they are 2 times smaller than the dark holes, showing that cells of different morphologies can be recognized in THG images. We expect that the described quantitative comparison is applicable to other types of brain tissue and with more specific staining experiments for cell type identification.

Understanding the neurovascular unit at multiple scales: Advantages and limitations of multi-photon and functional ultrasound imaging

Developing efficient brain imaging technologies by combining a high spatiotemporal resolution and a large penetration depth is a key step for better understanding the neurovascular interface that emerges as a main pathway to neurodegeneration in many pathologies such as dementia. This review focuses on the advances in two complementary techniques: multi-photon laser scanning microscopy (MPLSM) and functional ultrasound imaging (fUSi). MPLSM has become the gold standard for in vivo imaging of cellular dynamics and morphology, together with cerebral blood flow. fUSi is an innovative imaging modality based on Doppler ultrasound, capable of recording vascular brain activity over large scales (i.e., tens of cubic millimeters) at unprecedented spatial and temporal resolution for such volumes (up to 10μm pixel size at 10kHz). By merging these two technologies, researchers may have access to a more detailed view of the various processes taking place at the neurovascular interface. MPLSM and fUSi are also good candidates for addressing the major challenge of real-time delivery, monitoring, and in vivo evaluation of drugs in neuronal tissue.

Distinction between breast cancer cell subtypes using third harmonic generation microscopy

Third Harmonic Generation (THG) microscopy as a non-invasive, label free imaging methodology, allows linkage of lipid profiles with various breast cancer cells. The collected THG signal arise mostly from the lipid droplets and the membrane lipid bilayer. Quantification of THG signal can accurately distinguish HER2-positive cells. Further analysis using Fourier transform infrared (FTIR) spectra reveals cancer-specific profiles, correlating lipid raft-corresponding spectra to THG signal, associating thus THG to chemical information. THG imaging of a cancer cell.

Context-dependent intravital imaging of therapeutic response using intramolecular FRET biosensors

Intravital microscopy represents a more physiologically relevant method for assessing therapeutic response. However, the movement into an in vivo setting brings with it several additional considerations, the primary being the context in which drug activity is assessed. Microenvironmental factors, such as hypoxia, pH, fibrosis, immune infiltration and stromal interactions have all been shown to have pronounced effects on drug activity in a more complex setting, which is often lost in simpler two- or three-dimensional assays. Here we present a practical guide for the application of intravital microscopy, looking at the available fluorescent reporters and their respective expression systems and analysis considerations. Moving in vivo, we also discuss the microscopy set up and methods available for overlaying microenvironmental context to the experimental readouts. This enables a smooth transition into applying higher fidelity intravital imaging to improve the drug discovery process.