Multifocal multiphoton microscopy based on multianode photomultiplier tubes

Multiline orthogonal scanning temporal focusing (mosTF) microscopy for scattering reduction in in vivo brain imaging

Temporal focusing two-photon microscopy has been utilized for high-resolution imaging of neuronal and synaptic structures across volumes spanning hundreds of microns in vivo. However, a limitation of temporal focusing is the rapid degradation of the signal-to-background ratio and resolution with increasing imaging depth. This degradation is due to scattered emission photons being widely distributed, resulting in a strong background. To overcome this challenge, we have developed multiline orthogonal scanning temporal focusing (mosTF) microscopy. mosTF captures a sequence of images at each scan location of the excitation line. A reconstruction algorithm then reassigns scattered photons back to their correct scan positions. We demonstrate the effectiveness of mosTF by acquiring neuronal images of mice in vivo. Our results show remarkable improvements in in vivo brain imaging with mosTF, while maintaining its speed advantage.

Multiline Orthogonal Scanning Temporal Focusing (mosTF) Microscopy for Scattering Reduction in High-speed in vivo Brain Imaging

Temporal focusing two-photon microscopy enables high resolution imaging of fine structures in vivo over a large volume. A limitation of temporal focusing is that signal-to-background ratio and resolution degrade rapidly with increasing imaging depth. This degradation originates from the scattered emission photons are widely distributed resulting in a strong background. We have developed Multiline Orthogonal Scanning Temporal Focusing (mosTF) microscopy that overcomes this problem. mosTF captures a sequence of images at each scan location of the excitation line, followed by a reconstruction algorithm reassigns scattered photons back to the correct scan position. We demonstrate mosTF by acquiring mice neuronal images in vivo. Our results show remarkably improvements with mosTF for in vivo brain imaging while maintaining its speed advantage.

High-speed low-light in vivo two-photon voltage imaging of large neuronal populations

Monitoring spiking activity across large neuronal populations at behaviorally relevant timescales is critical for understanding neural circuit function. Unlike calcium imaging, voltage imaging requires kilohertz sampling rates that reduce fluorescence detection to near shot-noise levels. High-photon flux excitation can overcome photon-limited shot noise, but photobleaching and photodamage restrict the number and duration of simultaneously imaged neurons. We investigated an alternative approach aimed at low two-photon flux, which is voltage imaging below the shot-noise limit. This framework involved developing positive-going voltage indicators with improved spike detection (SpikeyGi and SpikeyGi2); a two-photon microscope ('SMURF') for kilohertz frame rate imaging across a 0.4 mm × 0.4 mm field of view; and a self-supervised denoising algorithm (DeepVID) for inferring fluorescence from shot-noise-limited signals. Through these combined advances, we achieved simultaneous high-speed deep-tissue imaging of more than 100 densely labeled neurons over 1 hour in awake behaving mice. This demonstrates a scalable approach for voltage imaging across increasing neuronal populations.

Tutorial: multiphoton microscopy to advance neuroscience research

Multiphoton microscopy (MPM) employs ultrafast infrared lasers for high-resolution deep three-dimensional imaging of live biological samples. The goal of this tutorial is to provide a practical guide to MPM imaging for novice microscopy developers and life-science users. Principles of MPM, microscope setup, and labeling strategies are discussed. Use of MPM to achieve unprecedented imaging depth of whole mounted explants and intravital imaging via implantable glass windows of the mammalian nervous system is demonstrated.

High-contrast visualization of human skin cancers with combined reflectance confocal and moxifloxacin-based two-photon microscopy: An ex vivo study

BACKGROUND AND OBJECTIVES

Precise determination of cancer margin during skin cancer surgery is crucial for complete resection and further clinical prognosis. Although reflection confocal microscopy (RCM) has been used for perioperative guiding, its reflection contrast has limitations in detecting cancer cells in the dermis. We previously developed combined reflection confocal (RC) and moxifloxacin-based two-photon (MB-TP) microscopy for sensitive cancer detection by using multiple contrast mechanisms. In this study, the performance of combined microscopy was characterized in various skin cancer specimens and compared with standard methods.

MATERIALS AND METHODS

Seven human skin specimens in total including two normal ones, three basal cell carcinomas (BCCs), and two squamous cell carcinomas (SCCs) were collected and imaged in fresh condition. Moxifloxacin ophthalmic solution was topically instilled for cell labeling for 3-5 minutes, then mosaic imaging with the combined microscopy was conducted. The imaged specimens were imaged again after exogenous nuclear labeling for comparison and then processed for standard hematoxylin and eosin histology.

RESULTS

Combined RC and MB-TP microscopy visualized both cell and extracellular matrix structures of the skin specimens with multiple contrasts of reflection, moxifloxacin fluorescence, autofluorescence, and second harmonic generation. It distinguished normal cell structures in the skin dermis such as hair follicles, sebaceous and eccrine glands from BCC nests, and SCCs based on cell organization. Normal cell structures had organized cell arrangements for their functions, while cancer cell structures had dense and disorganized cell arrangements. Cellular features found by combined microscopy images were confirmed by both TP microscopy with nuclear labeling and histological examination.

CONCLUSIONS

The imaging results showed the potential of combined microscopy for sensitive cancer detection and in vivo guiding of skin cancer surgery.

Fluorescence imaging of large-scale neural ensemble dynamics

Recent progress in fluorescence imaging allows neuroscientists to observe the dynamics of thousands of individual neurons, identified genetically or by their connectivity, across multiple brain areas and for extended durations in awake behaving mammals. We discuss advances in fluorescent indicators of neural activity, viral and genetic methods to express these indicators, chronic animal preparations for long-term imaging studies, and microscopes to monitor and manipulate the activity of large neural ensembles. Ca²⁺ imaging studies of neural activity can track brain area interactions and distributed information processing at cellular resolution. Across smaller spatial scales, high-speed voltage imaging reveals the distinctive spiking patterns and coding properties of targeted neuron types. Collectively, these innovations will propel studies of brain function and dovetail with ongoing neuroscience initiatives to identify new neuron types and develop widely applicable, non-human primate models. The optical toolkit's growing sophistication also suggests that "brain observatory" facilities would be useful open resources for future brain-imaging studies.

Neurophotonic tools for microscopic measurements and manipulation: status report

Neurophotonics was launched in 2014 coinciding with the launch of the BRAIN Initiative focused on development of technologies for advancement of neuroscience. For the last seven years, Neurophotonics' agenda has been well aligned with this focus on neurotechnologies featuring new optical methods and tools applicable to brain studies. While the BRAIN Initiative 2.0 is pivoting towards applications of these novel tools in the quest to understand the brain, this status report reviews an extensive and diverse toolkit of novel methods to explore brain function that have emerged from the BRAIN Initiative and related large-scale efforts for measurement and manipulation of brain structure and function. Here, we focus on neurophotonic tools mostly applicable to animal studies. A companion report, scheduled to appear later this year, will cover diffuse optical imaging methods applicable to noninvasive human studies. For each domain, we outline the current state-of-the-art of the respective technologies, identify the areas where innovation is needed, and provide an outlook for the future directions.

De-scattering with Excitation Patterning enables rapid wide-field imaging through scattering media

Nonlinear optical microscopy has enabled in vivo deep tissue imaging on the millimeter scale. A key unmet challenge is its limited throughput especially compared to rapid wide-field modalities that are used ubiquitously in thin specimens. Wide-field imaging methods in tissue specimens have found successes in optically cleared tissues and at shallower depths, but the scattering of emission photons in thick turbid samples severely degrades image quality at the camera. To address this challenge, we introduce a novel technique called De-scattering with Excitation Patterning or "DEEP," which uses patterned nonlinear excitation followed by computational imaging-assisted wide-field detection. Multiphoton temporal focusing allows high-resolution excitation patterns to be projected deep inside specimen at multiple scattering lengths due to the use of long wavelength light. Computational reconstruction allows high-resolution structural features to be reconstructed from tens to hundreds of DEEP images instead of millions of point-scanning measurements.

High-NA two-photon single cell imaging with remote focusing using a diffractive tunable lens

Fast, volumetric structural and functional imaging of cellular and sub-cellular dynamics inside the living brain is one of the most desired capabilities in the neurosciences, but still faces serious challenges. Specifically, while few solutions for rapid 3D scanning exist, it is generally much easier to facilitate fast in-plane scanning than it is to scan axially at high speeds. Remote focusing in which the imaging plane is shifted along the optical axis by a tunable lens while maintaining the position of the sample and objective is a promising approach to increase the axial scan speed, but existing techniques often introduce severe optical aberrations in high-NA imaging systems, eliminating the possibility of diffraction-limited single-cell imaging. Here, we demonstrate near diffraction-limited, volumetric two-photon fluorescence microscopy in which we resolve the deep sub-micron structures of single microglia cells with axial scanning performed using a novel high-NA remote focusing method. Image contrast is maintained to within 7% compared to mechanical sample stepping and the focal volume remains nearly diffraction-limited over an axial range greater than 86 µm.

Three-Dimensional Two-Color Dual-Particle Tracking Microscope for Monitoring DNA Conformational Changes and Nanoparticle Landings on Live Cells

Here, we present a three-dimensional two-color dual-particle tracking (3D-2C-DPT) technique that can simultaneously localize two spectrally distinct targets in three dimensions with a time resolution down to 5 ms. The dual-targets can be tracked with separation distances from 33 to 250 nm with tracking precisions of ∼15 nm (for static targets) and ∼35 nm (for freely diffusing targets). Since each target is individually localized, a wealth of data can be extracted, such as the relative 3D position, the 2D rotation, and the separation distance between the two targets. Using this technique, we turn a double-stranded DNA (dsDNA)-linked dumbbell-like dimer into a nanoscopic optical ruler to quantify the bending dynamics of nicked or gapped dsDNA molecules in free solution by manipulating the design of dsDNA linkers (1-nick, 3-nt, 6-nt, or 9-nt single-strand gap), and the results show the increase of kon (linear to bent) from 3.2 to 10.7 s-1. The 3D-2C-DPT is then applied to observe translational and rotational motions of the landing of an antibody-conjugated nanoparticle on the plasma membrane of living cells, revealing the reduction of rotations possibly due to interactions with membrane receptors. This study demonstrates that this 3D-2C-DPT technique is a new tool to shed light on the conformational changes of biomolecules and the intermolecular interactions on plasma membrane.

Subcellular resolution three-dimensional light-field imaging with genetically encoded voltage indicators

Significance: Light-field microscopy (LFM) enables high signal-to-noise ratio (SNR) and light efficient volume imaging at fast frame rates. Voltage imaging with genetically encoded voltage indicators (GEVIs) stands to particularly benefit from LFM's volumetric imaging capability due to high required sampling rates and limited probe brightness and functional sensitivity. Aim: We demonstrate subcellular resolution GEVI light-field imaging in acute mouse brain slices resolving dendritic voltage signals in three spatial dimensions. Approach: We imaged action potential-induced fluorescence transients in mouse brain slices sparsely expressing the GEVI VSFP-Butterfly 1.2 in wide-field microscopy (WFM) and LFM modes. We compared functional signal SNR and localization between different LFM reconstruction approaches and between LFM and WFM. Results: LFM enabled three-dimensional (3-D) localization of action potential-induced fluorescence transients in neuronal somata and dendrites. Nonregularized deconvolution decreased SNR with increased iteration number compared to synthetic refocusing but increased axial and lateral signal localization. SNR was unaffected for LFM compared to WFM. Conclusions: LFM enables 3-D localization of fluorescence transients, therefore eliminating the need for structures to lie in a single focal plane. These results demonstrate LFM's potential for studying dendritic integration and action potential propagation in three spatial dimensions.

Spectro-temporal encoded multiphoton microscopy and fluorescence lifetime imaging at kilohertz frame-rates

Two-Photon Microscopy has become an invaluable tool for biological and medical research, providing high sensitivity, molecular specificity, inherent three-dimensional sub-cellular resolution and deep tissue penetration. In terms of imaging speeds, however, mechanical scanners still limit the acquisition rates to typically 10-100 frames per second. Here we present a high-speed non-linear microscope achieving kilohertz frame rates by employing pulse-modulated, rapidly wavelength-swept lasers and inertia-free beam steering through angular dispersion. In combination with a high bandwidth, single-photon sensitive detector, this enables recording of fluorescent lifetimes at speeds of 88 million pixels per second. We show high resolution, multi-modal - two-photon fluorescence and fluorescence lifetime (FLIM) - microscopy and imaging flow cytometry with a digitally reconfigurable laser, imaging system and data acquisition system. These high speeds should enable high-speed and high-throughput image-assisted cell sorting.

Fundamental bounds on the fidelity of sensory cortical coding

How the brain processes information accurately despite stochastic neural activity is a longstanding question¹. For instance, perception is fundamentally limited by the information that the brain can extract from the noisy dynamics of sensory neurons. Seminal experiments^2,3 suggest that correlated noise in sensory cortical neural ensembles is what limits their coding accuracy^4-6, although how correlated noise affects neural codes remains debated^7-11. Recent theoretical work proposes that how a neural ensemble's sensory tuning properties relate statistically to its correlated noise patterns is a greater determinant of coding accuracy than is absolute noise strength^12-14. However, without simultaneous recordings from thousands of cortical neurons with shared sensory inputs, it is unknown whether correlated noise limits coding fidelity. Here we present a 16-beam, two-photon microscope to monitor activity across the mouse primary visual cortex, along with analyses to quantify the information conveyed by large neural ensembles. We found that, in the visual cortex, correlated noise constrained signalling for ensembles with 800-1,300 neurons. Several noise components of the ensemble dynamics grew proportionally to the ensemble size and the encoded visual signals, revealing the predicted information-limiting correlations^12-14. Notably, visual signals were perpendicular to the largest noise mode, which therefore did not limit coding fidelity. The information-limiting noise modes were approximately ten times smaller and concordant with mouse visual acuity¹⁵. Therefore, cortical design principles appear to enhance coding accuracy by restricting around 90% of noise fluctuations to modes that do not limit signalling fidelity, whereas much weaker correlated noise modes inherently bound sensory discrimination.

High spatiotemporal resolution and low photo-toxicity fluorescence imaging in live cells and in vivo

Taking advantage of high contrast and molecular specificity, fluorescence microscopy has played a critical role in the visualization of subcellular structures and function, enabling unprecedented exploration from cell biology to neuroscience in living animals. To record and quantitatively analyse complex and dynamic biological processes in real time, fluorescence microscopes must be capable of rapid, targeted access deep within samples at high spatial resolutions, using techniques including super-resolution fluorescence microscopy, light sheet fluorescence microscopy, and multiple photon microscopy. In recent years, tremendous breakthroughs have improved the performance of these fluorescence microscopies in spatial resolution, imaging speed, and penetration. Here, we will review recent advancements of these microscopies in terms of the trade-off among spatial resolution, sampling speed and penetration depth and provide a view of their possible applications.

Optical Imaging in Brainsmatics

When neuroscience’s focus moves from molecular and cellular level to systems level, information technology mixes in and cultivates a new branch neuroinformatics. Especially under the investments of brain initiatives all around the world, brain atlases and connectomics are identified as the substructure to understand the brain. We think it is time to call for a potential interdisciplinary subject, brainsmatics, referring to brain-wide spatial informatics science and emphasizing on precise positioning information affiliated to brain-wide connectome, genome, proteome, transcriptome, metabolome, etc. Brainsmatics methodology includes tracing, surveying, visualizing, and analyzing brain-wide spatial information. Among all imaging techniques, optical imaging is the most appropriate solution to achieve whole-brain connectome in consistent single-neuron resolution. This review aims to introduce contributions of optical imaging to brainsmatics studies, especially the major strategies applied in tracing and surveying processes. After discussions on the state-of-the-art technology, the development objectives of optical imaging in brainsmatics field are suggested. We call for a global contribution to the brainsmatics field from all related communities such as neuroscientists, biologists, engineers, programmers, chemists, mathematicians, physicists, clinicians, pharmacists, etc. As the leading approach, optical imaging will, in turn, benefit from the prosperous development of brainsmatics.

Compressive sensing for fast 3-D and random-access two-photon microscopy

3-D two-photon excitation (TPE) microscopy has been a critical tool for biological study since its introduction. Yet, the speed is largely limited by its point detector, e.g., photomultiplier tube (PMT), which requires a point-scanning imaging sequence. In this Letter, we present a multi-focus compressive sensing (CS) method for 3-D and random-access TPE microscopy based on a digital micromirror device (DMD). This new platform combines CS with a unique holography-based DMD random-access scanner to enhance the imaging speed by three to five times for imaging arbitrarily selected regions in 3-D specimens without sacrificing the resolution. In the experiments, 1-20 randomly selected foci are generated by modulating the wavefront of a femtosecond laser via binary holography, where the combined intensity is recorded by a PMT. By exploiting CS algorithms, 3-D images at arbitrarily selected sites can be reconstructed. Simulations and imaging experiments on different samples have been performed to verify the principle and identify the optimal processing parameters, including the number of laser foci and sampling ratios. The results show that high-resolution images can be obtained by using a 25% sampling ratio and five foci. The new CS-based TPE imaging method may find important applications in biological studies, e.g., neuronal imaging and optogenetics.

Scattering reduction by structured light illumination in line-scanning temporal focusing microscopy

Line-scanning temporal focusing microscopy (LineTFM) is capable of imaging biological samples more than 10 times faster than two-photon laser point-scanning microscopy (TPLSM), while achieving nearly the same lateral and axial spatial resolution. However, the image contrast taken by LineTFM is lower than that by TPLSM because LineTFM is severely influenced by biological tissue scattering. To reject the scattered photons, we implemented LineTFM using both structured illumination and uniform illumination combined with the HiLo post-processing algorithm, called HiLL microscopy (HiLo-Line-scanning temporal focusing microscopy). HiLL microscopy significantly reduces tissue scattering and improves image contrast. We demonstrate HiLL microscopy with in vivo brain imaging. This approach could potentially find applications in monitoring fast dynamic events and in mapping high resolution structures over a large volume.

Line excitation array detection fluorescence microscopy at 0.8 million frames per second

Three-dimensional, fluorescence imaging methods with ~1 MHz frame rates are needed for high-speed, blur-free flow cytometry and capturing volumetric neuronal activity. The frame rates of current imaging methods are limited to kHz by the photon budget, slow camera readout, and/or slow laser beam scanners. Here, we present line excitation array detection (LEAD) fluorescence microscopy, a high-speed imaging method capable of providing 0.8 million frames per second. The method performs 0.8 MHz line-scanning of an excitation laser beam using a chirped signal-driven longitudinal acousto-optic deflector to create a virtual light-sheet, and images the field-of-view with a linear photomultiplier tube array to generate a 66 × 14 pixel frame each scan cycle. We implement LEAD microscopy as a blur-free flow cytometer for Caenorhabditis elegans moving at 1 m s-1 with 3.5-µm resolution and signal-to-background ratios >200. Signal-to-noise measurements indicate future LEAD fluorescence microscopes can reach higher resolutions and pixels per frame without compromising frame rates.

Fiber-bundle illumination: realizing high-degree time-multiplexed multifocal multiphoton microscopy with simplicity

High-degree time-multiplexed multifocal multiphoton microscopy was expected to provide a facile path to scanningless optical-sectioning and the fast imaging of dynamic three-dimensional biological systems. However, physical constraints on typical time multiplexing devices, arising from diffraction in the free-space propagation of light waves, lead to significant manufacturing difficulties and have prevented the experimental realization of high-degree time multiplexing. To resolve this issue, we have developed a novel method using optical fiber bundles of various lengths to confine the diffraction of propagating light waves and to create a time multiplexing effect. Through this method, we experimentally demonstrate the highest degree of time multiplexing ever achieved in multifocal multiphoton microscopy (~50 times larger than conventional approaches), and hence the potential of using simply-manufactured devices for scanningless optical sectioning of biological systems.

Automated fluorescence intensity and gradient analysis enables detection of rare fluorescent mutant cells deep within the tissue of RaDR mice

Homologous recombination (HR) events are key drivers of cancer-promoting mutations, and the ability to visualize these events in situ provides important information regarding mutant cell type, location, and clonal expansion. We have previously created the Rosa26 Direct Repeat (RaDR) mouse model wherein HR at an integrated substrate gives rise to a fluorescent cell. To fully leverage this in situ approach, we need better ways to quantify rare fluorescent cells deep within tissues. Here, we present a robust, automated event quantification algorithm that uses image intensity and gradient features to detect fluorescent cells in deep tissue specimens. To analyze the performance of our algorithm, we simulate fluorescence behavior in tissue using Monte Carlo methods. Importantly, this approach reduces the potential for bias in manual counting and enables quantification of samples with highly dense HR events. Using this approach, we measured the relative frequency of HR within a chromosome and between chromosomes and found that HR within a chromosome is more frequent, which is consistent with the close proximity of sister chromatids. Our approach is both objective and highly rapid, providing a powerful tool, not only to researchers interested in HR, but also to many other researchers who are similarly using fluorescence as a marker for understanding mammalian biology in tissues.

High speed functional imaging with source localized multifocal two-photon microscopy

Multifocal two-photon microscopy (MTPM) increases imaging speed over single-focus scanning by parallelizing fluorescence excitation. The imaged fluorescence's susceptibility to crosstalk, however, severely degrades contrast in scattering tissue. Here we present a source-localized MTPM scheme optimized for high speed functional fluorescence imaging in scattering mammalian brain tissue. A rastered line array of beamlets excites fluorescence imaged with a complementary metal-oxide-semiconductor (CMOS) camera. We mitigate scattering-induced crosstalk by temporally oversampling the rastered image, generating grouped images with structured illumination, and applying Richardson-Lucy deconvolution to reassign scattered photons. Single images are then retrieved with a maximum intensity projection through the deconvolved image groups. This method increased image contrast at depths up to 112 μm in scattering brain tissue and reduced functional crosstalk between pixels during neuronal calcium imaging. Source-localization did not affect signal-to-noise ratio (SNR) in densely labeled tissue under our experimental conditions. SNR decreased at low frame rates in sparsely labeled tissue, with no effect at frame rates above 50 Hz. Our non-descanned source-localized MTPM system enables high SNR, 100 Hz capture of fluorescence transients in scattering brain, increasing the scope of MTPM to faster and smaller functional signals.

Fast two-snapshot structured illumination for temporal focusing microscopy with enhanced axial resolution

We present a new two-snapshot structured light illumination (SLI) reconstruction algorithm for fast image acquisition. The new algorithm, which only requires two mutually π phase-shifted raw structured images, is implemented on a custom-built temporal focusing fluorescence microscope (TFFM) to enhance its axial resolution via a digital micromirror device (DMD). First, the orientation of the modulated sinusoidal fringe patterns is automatically identified via spatial frequency vector detection. Subsequently, the modulated in-focal-plane images are obtained via rotation and subtraction. Lastly, a parallel amplitude demodulation method, derived based on Hilbert transform, is applied to complete the decoding processes. To demonstrate the new SLI algorithm, a TFFM is custom-constructed, where a DMD replaces the generic blazed grating in the system and simultaneously functions as a diffraction grating and a programmable binary mask, generating arbitrary fringe patterns. The experimental results show promising depth-discrimination capability with an axial resolution enhancement factor of 1.25, which matches well with the theoretical estimation, i.e, 1.27. Imaging experiments on pollen grain and mouse kidney samples have been performed. The results indicate that the two-snapshot algorithm presents comparable contrast reconstruction and optical cross-sectioning capability than those adopting the conventional root-mean-square (RMS) reconstruction method. The two-snapshot method can be readily applied to any sinusoidally modulated illumination systems to realize high-speed 3D imaging as less frames are required for each in-focal-plane image restoration, i.e., the image acquisition speed is improved by 2.5 times for any two-photon systems.

Technologies for imaging neural activity in large volumes

Neural circuitry has evolved to form distributed networks that act dynamically across large volumes. Conventional microscopy collects data from individual planes and cannot sample circuitry across large volumes at the temporal resolution relevant to neural circuit function and behaviors. Here we review emerging technologies for rapid volume imaging of neural circuitry. We focus on two critical challenges: the inertia of optical systems, which limits image speed, and aberrations, which restrict the image volume. Optical sampling time must be long enough to ensure high-fidelity measurements, but optimized sampling strategies and point-spread function engineering can facilitate rapid volume imaging of neural activity within this constraint. We also discuss new computational strategies for processing and analyzing volume imaging data of increasing size and complexity. Together, optical and computational advances are providing a broader view of neural circuit dynamics and helping elucidate how brain regions work in concert to support behavior.

In vivo imaging of neural activity

Since the introduction of calcium imaging to monitor neuronal activity with single-cell resolution, optical imaging methods have revolutionized neuroscience by enabling systematic recordings of neuronal circuits in living animals. The plethora of methods for functional neural imaging can be daunting to the nonexpert to navigate. Here we review advanced microscopy techniques for in vivo functional imaging and offer guidelines for which technologies are best suited for particular applications.

Correction of spherical aberration in multi-focal multiphoton microscopy with spatial light modulator

We demonstrate that high-quality images of the deep regions of a thick sample can be obtained from its surface by multi-focal multiphoton microscopy (MMM). The MMM system incorporates a spatial light modulator to separate the excitation beam into a multi-focal excitation beam and modulate the pre-distortion wavefront to correct spherical aberration (SA) caused by a refractive index mismatch between the immersion medium and the biological sample. When fluorescent beads in transparent epoxy resin were observed using four SA-corrected focal beams, the fluorescence signal of the obtained images was ~52 times higher than that obtained without SA correction until a depth of ~1100 μm, similar to the result for single-focal multiphoton microscopy (SMM). The MMM scanning time was four times less than that for SMM, and MMM showed an improved fluorescence intensity and depth resolution for an image of blood vessels in the brain of a mouse stained with a fluorescent dye.

Imaging and Optically Manipulating Neuronal Ensembles

The neural code that relates the firing of neurons to the generation of behavior and mental states must be implemented by spatiotemporal patterns of activity across neuronal populations. These patterns engage selective groups of neurons, called neuronal ensembles, which are emergent building blocks of neural circuits. We review optical and computational methods, based on two-photon calcium imaging and two-photon optogenetics, to detect, characterize, and manipulate neuronal ensembles in three dimensions. We review data using these methods in the mammalian cortex that demonstrate the existence of neuronal ensembles in the spontaneous and evoked cortical activity in vitro and in vivo. Moreover, two-photon optogenetics enable the possibility of artificially imprinting neuronal ensembles into awake, behaving animals and of later recalling those ensembles selectively by stimulating individual cells. These methods could enable deciphering the neural code and also be used to understand the pathophysiology of and design novel therapies for neurological and mental diseases.

Advances in two photon scanning and scanless microscopy technologies for functional neural circuit imaging

Recent years have seen substantial developments in technology for imaging neural circuits, raising the prospect of large scale imaging studies of neural populations involved in information processing, with the potential to lead to step changes in our understanding of brain function and dysfunction. In this article we will review some key recent advances: improved fluorophores for single cell resolution functional neuroimaging using a two photon microscope; improved approaches to the problem of scanning active circuits; and the prospect of scanless microscopes which overcome some of the bandwidth limitations of current imaging techniques. These advances in technology for experimental neuroscience have in themselves led to technical challenges, such as the need for the development of novel signal processing and data analysis tools in order to make the most of the new experimental tools. We review recent work in some active topics, such as region of interest segmentation algorithms capable of demixing overlapping signals, and new highly accurate algorithms for calcium transient detection. These advances motivate the development of new data analysis tools capable of dealing with spatial or spatiotemporal patterns of neural activity, that scale well with pattern size.

Fast volumetric calcium imaging across multiple cortical layers using sculpted light

Although whole-organism calcium imaging in small and semi-transparent animals has been demonstrated, capturing the functional dynamics of large-scale neuronal circuits in awake behaving mammals at high speed and resolution has remained one of the main frontiers in systems neuroscience. Here we present a method based on light sculpting that enables unbiased single- and dual-plane high-speed (up to 160 Hz) calcium imaging as well as in vivo volumetric calcium imaging of a mouse cortical column (0.5 mm × 0.5 mm × 0.5 mm) at single-cell resolution and fast volume rates (3-6 Hz). We achieved this by tailoring the point-spread function of our microscope to the structures of interest while maximizing the signal-to-noise ratio using a home-built fiber laser amplifier with pulses that are synchronized to the imaging voxel speed. This enabled in vivo recording of calcium dynamics of several thousand neurons across cortical layers and in the hippocampus of awake behaving mice.

Super-sensitivity multiphoton frequency-domain fluorescence lifetime imaging microscopy

We present a series of experiments that demonstrate a super-sensitive chemical imaging technique based on multiphoton frequency-domain fluorescence lifetime imaging microscopy (MPM-FD-FLIM) that shows a 2× improvement in imaging speed compared to the theoretical limit of conventional MPM-FD-FLIM. Additionally, this technique produces unprecedented sensitivity over a large range of fluorescence lifetimes. These results are achieved through simple modifications to data analysis in a conventional MPM-FD-FLIM microscope and are based on an analytical model describing the signal-to-noise ratio (SNR) of a MPM-FD-FLIM system [J. Opt. Soc. Am. A33, B1 (2016)]. Here we experimentally validate this model.

In vivo 3D measurement of moxifloxacin and gatifloxacin distributions in the mouse cornea using multiphoton microscopy

Moxifloxacin and gatifloxacin are fourth-generation fluoroquinolone antibiotics used in the clinic to prevent or treat ocular infections. Their pharmacokinetics in the cornea is usually measured from extracted ocular fluids or tissues, and in vivo direct measurement is difficult. In this study multiphoton microscopy (MPM), which is a 3D optical microscopic technique based on multiphoton fluorescence, was applied to the measurement of moxifloxacin and gatifloxacin distribution in the cornea. Intrinsic multiphoton fluorescence properties of moxifloxacin and gatifloxacin were characterized, and their distributions in mouse cornea in vivo were measured by 3D MPM imaging. Both moxifloxacin and gatifloxacin had similar multiphoton spectra, while moxifloxacin had stronger fluorescence than gatifloxacin. MPM imaging of mouse cornea in vivo showed (1) moxifloxacin had good penetration through the superficial corneal epithelium, while gatifloxacin had relatively poor penetration, (2) both ophthalmic solutions had high intracellular distribution. In vivo MPM results were consistent with previous studies. This study demonstrates the feasibility of MPM as a method for in vivo direct measurement of moxifloxacin and gatifloxacin in the cornea.

Whole Brain Imaging with Serial Two-Photon Tomography

Imaging entire mouse brains at submicron resolution has historically been a challenging undertaking and largely confined to the province of dedicated atlasing initiatives. This has limited systematic investigations into important areas of neuroscience, such as neural circuits, brain mapping and neurodegeneration. In this article, we describe in detail Serial Two-Photon (STP) tomography, a robust, reliable method for imaging entire brains with histological detail. We provide examples of how the basic methodology can be extended to other imaging modalities, such as Optical Coherence Tomography (OCT), in order to provide unique contrast mechanisms. Furthermore, we provide a survey of the research that STP tomography has enabled in the field of neuroscience, provide examples of how this technology enables quantitative whole brain studies, and discuss the current limitations of STP tomography-based approaches.

Simultaneous Multi-plane Imaging of Neural Circuits

Recording the activity of large populations of neurons is an important step toward understanding the emergent function of neural circuits. Here we present a simple holographic method to simultaneously perform two-photon calcium imaging of neuronal populations across multiple areas and layers of mouse cortex in vivo. We use prior knowledge of neuronal locations, activity sparsity, and a constrained nonnegative matrix factorization algorithm to extract signals from neurons imaged simultaneously and located in different focal planes or fields of view. Our laser multiplexing approach is simple and fast, and could be used as a general method to image the activity of neural circuits in three dimensions across multiple areas in the brain.

High-speed multifocal array scanning using refractive window tilting

Confocal microscopy has several advantages over wide-field microscopy, such as out-of-focus light suppression, 3D sectioning, and compatibility with specialized detectors. While wide-field microscopy is a faster approach, multiplexed confocal schemes can be used to make confocal microscopy more suitable for high-throughput applications, such as high-content screening (HCS) commonly used in drug discovery. An increasingly powerful modality in HCS is fluorescence lifetime imaging microscopy (FLIM), which can be used to measure protein-protein interactions through Förster resonant energy transfer (FRET). FLIM-FRET for HCS combines the requirements of high throughput, high resolution and specialized time-resolving detectors, making it difficult to implement using wide-field and spinning disk confocal approaches. We developed a novel foci array scan method that can achieve uniform multiplex confocal acquisition using stationary lenslet arrays for high resolution and high throughput FLIM. Unlike traditional mirror galvanometers, which work in Fourier space between scan lenses, this scan method uses optical flats to steer a 2-dimension foci array through refraction. After integrating this scanning scheme in a multiplexing confocal FLIM system, we demonstrate it offers clear benefits over traditional mirror galvanometer scanners in scan linearity, uniformity, cost and complexity.

Non-descanned multifocal multiphoton microscopy with a multianode photomultiplier tube

Multifocal multiphoton microscopy (MMM) improves imaging speed over a point scanning approach by parallelizing the excitation process. Early versions of MMM relied on imaging detectors to record emission signals from multiple foci simultaneously. For many turbid biological specimens, the scattering of emission photons results in blurred images and degrades the signal-to-noise ratio (SNR). We have recently demonstrated that a multianode photomultiplier tube (MAPMT) placed in a descanned configuration can effectively collect scattered emission photons from each focus into their corresponding anodes significantly improving image SNR for highly scattering specimens. Unfortunately, a descanned MMM has a longer detection path resulting in substantial emission photon loss. Optical design constraints in a descanned geometry further results in significant optical aberrations especially for large field-of-view (FOV), high NA objectives. Here, we introduce a non-descanned MMM based on MAPMT that substantially overcomes most of these drawbacks. We show that we improve signal efficiency up to fourfold with limited image SNR degradation due to scattered emission photons. The excitation foci can also be spaced wider to cover the full FOV of the objective with minimal aberrations. The performance of this system is demonstrated by imaging interneuron morphological structures deep in the brains of living mice.

Two-dimensional spatiotemporal focusing of femtosecond pulses and its applications in microscopy

We demonstrate and theoretically analyze the two-dimensional spatiotemporal focusing of femtosecond pulses by utilizing a two-dimensional spectral disperser. Compared with spatiotemporal focusing with a diffraction grating, it can achieve widefield illumination with better sectioning ability for a multiphoton excitation process. By utilizing paraxial approximation, our analytical method improves the axial confinement ability and identifies that the free spectra range (FSR) of the two-dimensional spectral disperser affects the out-of-focus multiphoton excitation intensity due to the temporal self-imaging effect. Based on our numerical simulation, a FSR of 50 GHz is necessary to reduce the out-of-focus two-photon excitation by 2 orders of magnitude compared with that in a grating-based spatiotemporal focusing scheme for a 90-fs excitation laser pulse. We build a two-dimensional spatiotemporal focusing microscope using a virtually imaged phased array and achieve an axial resolution of 1.3 μm, which outperforms the resolution of conventional spatiotemporal focusing using a grating by a factor of 1.7, and demonstrate better image contrast inside a tissue-like phantom.

Deep and high-resolution three-dimensional tracking of single particles using nonlinear and multiplexed illumination

Molecular trafficking within cells, tissues and engineered three-dimensional multicellular models is critical to the understanding of the development and treatment of various diseases including cancer. However, current tracking methods are either confined to two dimensions or limited to an interrogation depth of ∼15 μm. Here we present a three-dimensional tracking method capable of quantifying rapid molecular transport dynamics in highly scattering environments at depths up to 200 μm. The system has a response time of 1 ms with a temporal resolution down to 50 μs in high signal-to-noise conditions, and a spatial localization precision as good as 35 nm. Built on spatiotemporally multiplexed two-photon excitation, this approach requires only one detector for three-dimensional particle tracking and allows for two-photon, multicolour imaging. Here we demonstrate three-dimensional tracking of epidermal growth factor receptor complexes at a depth of ∼100 μm in tumour spheroids.

Existing single-particle tracking techniques are limited in terms of penetration depth, tracking range or temporal resolution. Here, Perillo et al. demonstrate three-dimensional particle tracking up to 200-μm depth, with 35-nm spatial localization and 50-μs resolution using multiplexed two-photon excitation.

A pragmatic guide to multiphoton microscope design

Multiphoton microscopy has emerged as a ubiquitous tool for studying microscopic structure and function across a broad range of disciplines. As such, the intent of this paper is to present a comprehensive resource for the construction and performance evaluation of a multiphoton microscope that will be understandable to the broad range of scientific fields that presently exploit, or wish to begin exploiting, this powerful technology. With this in mind, we have developed a guide to aid in the design of a multiphoton microscope. We discuss source selection, optical management of dispersion, image-relay systems with scan optics, objective-lens selection, single-element light-collection theory, photon-counting detection, image rendering, and finally, an illustrated guide for building an example microscope.

Multispot multiphoton Ca²⁺ imaging in acute myocardial slices

Multiphoton microscopy has become essential for dynamic imaging in thick living tissues. High-rate, full-field image acquisition in multiphoton microscopy is achievable by parallelization of the excitation and detection pathways. We developed our approach via a diffractive optical element which splits a pulsed laser into 16 beamlets and exploits a descanned detection system consisting of an array of beamlet-associated photomultiplier tubes. The optical performance of the multiphoton multispot system (MCube) has been characterized in cardiac tissue sections and subsequently used for the first time for fluorescence imaging of cardiomyocyte Ca²⁺ dynamics in viable acute cardiac slices. Multispot multiphoton microscopy (MMM) has never been used before to monitor Ca²⁺ dynamics in thick, viable tissue samples. Acute heart slices are a powerful close-to-in vivo model of Ca²⁺ imaging allowing the simultaneous observation of several cells in their own tissue environment, exploiting the multiphoton excitation ability to penetrate scattering tissues. Moreover, we show that the concurrent high spatial and temporal resolutions afforded by the parallel scanning in MMM can be exploited to simultaneously assess subcellular Ca²⁺ dynamics in different cells in the tissue. We recorded local Ca²⁺ release events including macrosparks, travelling waves, and rotors.

Nonlinear optical microscopy for immunoimaging: a custom optimized system of high-speed, large-area, multicolor imaging

BACKGROUND

The nonlinear optical microscopy has become the current state-of-the-art for intravital imaging. Due to its advantages of high resolution, superior tissue penetration, lower photodamage and photobleaching, as well as intrinsic z-sectioning ability, this technology has been widely applied in immunoimaging for a decade. However, in terms of monitoring immune events in native physiological environment, the conventional nonlinear optical microscope system has to be optimized for live animal imaging. Generally speaking, three crucial capabilities are desired, including high-speed, large-area and multicolor imaging. Among numerous high-speed scanning mechanisms used in nonlinear optical imaging, polygon scanning is not only linearly but also dispersion-freely with high stability and tunable rotation speed, which can overcome disadvantages of multifocal scanning, resonant scanner and acousto-optical deflector (AOD). However, low frame rate, lacking large-area or multicolor imaging ability make current polygonbased nonlinear optical microscopes unable to meet the requirements of immune event monitoring.

METHODS

We built up a polygon-based nonlinear optical microscope system which was custom optimized for immunoimaging with high-speed, large-are and multicolor imaging abilities.

RESULTS

Firstly, we validated the imaging performance of the system by standard methods. Then, to demonstrate the ability to monitor immune events, migration of immunocytes observed by the system based on typical immunological models such as lymph node, footpad and dorsal skinfold chamber are shown. Finally, we take an outlook for the possible advance of related technologies such as sample stabilization and optical clearing for more stable and deeper intravital immunoimaging.

CONCLUSIONS

This study will be helpful for optimizing nonlinear optical microscope to obtain more comprehensive and accurate information of immune events.

Spectral-resolved multifocal multiphoton microscopy with multianode photomultiplier tubes

Multiphoton excitation fluorescence microscopy is the preferred method for in vivo deep tissue imaging. Many biological applications demand both high imaging speed and the ability to resolve multiple fluorophores. One of the successful methods to improve imaging speed in a highly turbid specimen is multifocal multiphoton microscopy (MMM) based on use of multi-anode photomultiplier tubes (MAPMT). This approach improves imaging speed by using multiple foci for parallelized excitation without sacrificing signal to noise ratio (SNR) due to the scattering of emission photons. In this work, we demonstrate that the MAPMT based MMM can be extended with spectral resolved imaging capability. Instead of generating multiple excitation foci in a 2D grid pattern, a linear array of foci is generated. This leaves one axis of the 2D MAPMT available for spectral dispersion and detection. The spectral-resolved MMM can detect several emission signals simultaneously with high imaging speed optimized for high-throughput, high-contents applications. The new procedure is illustrated using imaging data from the kidney, peripheral nerve regeneration and dendritic morphological data from the brain.

High-throughput nonlinear optical microscopy

High-resolution microscopy methods based on different nonlinear optical (NLO) contrast mechanisms are finding numerous applications in biology and medicine. While the basic implementations of these microscopy methods are relatively mature, an important direction of continuing technological innovation lies in improving the throughput of these systems. Throughput improvement is expected to be important for studying fast kinetic processes, for enabling clinical diagnosis and treatment, and for extending the field of image informatics. This review will provide an overview of the fundamental limitations on NLO microscopy throughput. We will further cover several important classes of high-throughput NLO microscope designs with discussions on their strengths and weaknesses and their key biomedical applications. Finally, this review will close with a perspective of potential future technological improvements in this field.

Reassignment of scattered emission photons in multifocal multiphoton microscopy

Multifocal multiphoton microscopy (MMM) achieves fast imaging by simultaneously scanning multiple foci across different regions of specimen. The use of imaging detectors in MMM, such as CCD or CMOS, results in degradation of image signal-to-noise-ratio (SNR) due to the scattering of emitted photons. SNR can be partly recovered using multianode photomultiplier tubes (MAPMT). In this design, however, emission photons scattered to neighbor anodes are encoded by the foci scan location resulting in ghost images. The crosstalk between different anodes is currently measured a priori, which is cumbersome as it depends specimen properties. Here, we present the photon reassignment method for MMM, established based on the maximum likelihood (ML) estimation, for quantification of crosstalk between the anodes of MAPMT without a priori measurement. The method provides the reassignment of the photons generated by the ghost images to the original spatial location thus increases the SNR of the final reconstructed image.

An adaptive approach for uniform scanning in multifocal multiphoton microscopy with a spatial light modulator

We propose high-quality generation of uniform multiple fluorescence spots (MFS) with a spatial light modulator (SLM) and demonstrate uniform laser scanning in multifocal multiphoton microscopy (MMM). The MFS excitation method iteratively updates a computer-generated hologram (CGH) using correction coefficients to improve the fluorescence intensity distribution in a dye solution whose consistency is uniform. This simple correction method can be applied for calibration of the MMM before observation of living tissue. We experimentally demonstrate an improvement of the uniformity of a 10 × 10 grid of MFS by using a dye solution. After the calibration, we performed laser scanning with two-photon excitation to observe fluorescent polystyrene beads, as well as the gastric gland of a guinea pig specimen.

Improvement of axial resolution and contrast in temporally focused widefield two-photon microscopy with structured light illumination

Although temporally focused wide-field two-photon microscopy (TFM) can perform depth resolved wide field imaging, it cannot avoid the image degradation due to scattering of excitation and emission photons when imaging in a turbid medium. Further, its axial resolution is inferior to standard point-scanning two-photon microscopy. We implemented a structured light illumination for TFM and have shown that it can effectively reject the out-of-focus scattered emission photons improving image contrast. Further, the depth resolution of the improved system is dictated by the spatial frequency of the structure light with the potential of attaining depth resolution better than point-scanning two-photon microscopy.

Encoded multisite two-photon microscopy

The advent of scanning two-photon microscopy (2PM) has created a fertile new avenue for noninvasive investigation of brain activity in depth. One principal weakness of this method, however, lies with the limit of scanning speed, which makes optical interrogation of action potential-like activity in a neuronal network problematic. Encoded multisite two-photon microscopy (eMS2PM), a scanless method that allows simultaneous imaging of multiple targets in depth with high temporal resolution, addresses this drawback. eMS2PM uses a liquid crystal spatial light modulator to split a high-power femto-laser beam into multiple subbeams. To distinguish them, a digital micromirror device encodes each subbeam with a specific binary amplitude modulation sequence. Fluorescence signals from all independently targeted sites are then collected simultaneously onto a single photodetector and site-specifically decoded. We demonstrate that eMS2PM can be used to image spike-like voltage transients in cultured cells and fluorescence transients (calcium signals in neurons and red blood cells in capillaries from the cortex) in depth in vivo. These results establish eMS2PM as a unique method for simultaneous acquisition of neuronal network activity.

Advances in multiphoton microscopy technology

Multiphoton microscopy has enabled unprecedented dynamic exploration in living organisms. A significant challenge in biological research is the dynamic imaging of features deep within living organisms, which permits the real-time analysis of cellular structure and function. To make progress in our understanding of biological machinery, optical microscopes must be capable of rapid, targeted access deep within samples at high resolution. In this Review, we discuss the basic architecture of a multiphoton microscope capable of such analysis and summarize the state-of-the-art technologies for the quantitative imaging of biological phenomena.

Enhancement of lateral resolution and optical sectioning capability of two-photon fluorescence microscopy by combining temporal-focusing with structured illumination

We demonstrate super-resolution imaging with background fluorescence rejection by interferometric temporal focusing microscopy, in which temporal focusing is combined with structured illumination. The lateral resolution and the optical sectioning capability are simultaneously improved by factors of 1.6 and 1.4, respectively, compared to conventional temporal focusing microscopy. Fluorescent beads (200 nm diameter) that are difficult to distinguish from the background fluorescence in conventional temporal focusing microscopy, are clearly visualized by interferometric temporal focusing microscopy.

Review of advanced imaging techniques

Pathology informatics encompasses digital imaging and related applications. Several specialized microscopy techniques have emerged which permit the acquisition of digital images (“optical biopsies”) at high resolution. Coupled with fiber-optic and micro-optic components, some of these imaging techniques (e.g., optical coherence tomography) are now integrated with a wide range of imaging devices such as endoscopes, laparoscopes, catheters, and needles that enable imaging inside the body. These advanced imaging modalities have exciting diagnostic potential and introduce new opportunities in pathology. Therefore, it is important that pathology informaticists understand these advanced imaging techniques and the impact they have on pathology. This paper reviews several recently developed microscopic techniques, including diffraction-limited methods (e.g., confocal microscopy, 2-photon microscopy, 4Pi microscopy, and spatially modulated illumination microscopy) and subdiffraction techniques (e.g., photoactivated localization microscopy, stochastic optical reconstruction microscopy, and stimulated emission depletion microscopy). This article serves as a primer for pathology informaticists, highlighting the fundamentals and applications of advanced optical imaging techniques.