Converting lateral scanning into axial focusing to speed up three-dimensional microscopy

Intraoperative Fast Adaptive Focus Tracking Robotic OCT Enables Real-Time Tumor Grading and Large-Area Microvascular Imaging in Human Spinal Cord Surgery

Current surgical procedures for spinal cord tumors lack in vivo high-resolution multifunctional imaging systems, hindering precise tumor resection. This study introduces the fast adaptive focus tracking robotic optical coherence tomography (FACT-ROCT) system, which provides real-time, artifact-free imaging during surgery, addressing motion artifacts and resolution degradation. Imaging occurs in 22 patients, including 13 with gliomas (WHO grade I-IV). This represents the first in situ OCT imaging of human spinal cord tumors, enabling the differentiation of tumor types in real-time. The standard deviation of the attenuation coefficient serves as a physical marker, achieving 90.2%  ±  2.7% accuracy in distinguishing high- from low-grade gliomas intraoperatively at a threshold of 0.75  ±  0.01 mm-1. FACT-ROCT also enables microvascular imaging, covering areas of 70 mm × 13 mm × 10 mm within 2 min and revealing greater vascular tortuosity in higher-grade tumors. This extensive imaging capability provides critical information that guides surgical strategies, enhancing surgical outcomes. Overall, FACT-ROCT represents a significant advancement in intraoperative imaging, offering high-resolution, high-speed, and comprehensive insights into spinal cord tumor structure and vasculature.

High-speed two-photon microscopy with adaptive line-excitation

We present a two-photon fluorescence microscope designed for high-speed imaging of neural activity at cellular resolution. Our microscope uses an adaptive sampling scheme with line illumination. Instead of building images pixel by pixel via scanning a diffraction-limited spot across the sample, our scheme only illuminates the regions of interest (i.e., neuronal cell bodies) and samples a large area of them in a single measurement. Such a scheme significantly increases the imaging speed and reduces the overall laser power on the brain tissue. Using this approach, we performed high-speed imaging of the neuronal activity in mouse cortex in vivo. Our method provides a sampling strategy in laser-scanning two-photon microscopy and will be powerful for high-throughput imaging of neural activity.

Remote refocusing for multi-scale imaging

Significance

The technique of remote focusing (RF) has attracted considerable attention among microscopists due to its ability to quickly adjust focus across different planes, thus facilitating quicker volumetric imaging. However, the difficulty in changing objectives to align with a matching objective in a remote setting while upholding key requirements remains a challenge.

Aim

We aim to propose a customized yet straightforward technique to align multiple objectives with a remote objective, employing an identical set of optical elements to ensure meeting the criteria of remote focusing.

Approach

We propose a simple optical approach for aligning multiple objectives with a singular remote objective to achieve a perfect imaging system. This method utilizes readily accessible, commercial optical components to meet the fundamental requirements of remote focusing.

Results

Our experimental observations indicate that the proposed RF technique offers at least comparable, if not superior, performance over a significant axial depth compared with the conventional RF technique based on commercial lenses while offering the flexibility to switch the objective for multi-scale imaging.

Conclusions

The proposed technique addresses various microscopy challenges, particularly in the realm of multi-resolution imaging. We have experimentally demonstrated the efficacy of this technique by capturing images of focal volumes generated by two distinct objectives in a water medium.

Highly sensitive volumetric single-molecule imaging

Volumetric subcellular imaging has long been essential for studying structures and dynamics in cells and tissues. However, due to limited imaging speed and depth of field, it has been challenging to perform live-cell imaging and single-particle tracking. Here we report a 2.5D fluorescence microscopy combined with highly inclined illumination beams, which significantly reduce not only the image acquisition time but also the out-of-focus background by ∼2-fold compared to epi-illumination. Instead of sequential z-scanning, our method projects a certain depth of volumetric information onto a 2D plane in a single shot using multi-layered glass for incoherent wavefront splitting, enabling high photon detection efficiency. We apply our method to multi-color immunofluorescence imaging and volumetric super-resolution imaging, covering ∼3-4 µm thickness of samples without z-scanning. Additionally, we demonstrate that our approach can substantially extend the observation time of single-particle tracking in living cells.

Axial de-scanning using remote focusing in the detection arm of light-sheet microscopy

Rapid, high-resolution volumetric imaging without moving heavy objectives or disturbing delicate samples remains challenging. Pupil-matched remote focusing offers a promising solution for high NA systems, but the fluorescence signal's incoherent and unpolarized nature complicates its application. Thus, remote focusing is mainly used in the illumination arm with polarized laser light to improve optical coupling. Here, we introduce a novel optical design that can de-scan the axial focus movement in the detection arm of a microscope. Our method splits the fluorescence signal into S and P-polarized light, lets them pass through the remote focusing module separately, and combines them with the camera. This allows us to use only one focusing element to perform aberration-free, multi-color, volumetric imaging without (a) compromising the fluorescent signal and (b) needing to perform sample/detection-objective translation. We demonstrate the capabilities of this scheme by acquiring fast dual-color 4D (3D space + time) image stacks with an axial range of 70 μm and camera-limited acquisition speed. Owing to its general nature, we believe this technique will find its application in many other microscopy techniques that currently use an adjustable Z-stage to carry out volumetric imaging, such as confocal, 2-photon, and light sheet variants.

Axial de-scanning using remote focusing in the detection arm of light-sheet microscopy

The ability to image at high speeds is necessary for biological imaging to capture fast-moving or transient events or to efficiently image large samples. However, due to the lack of rigidity of biological specimens, carrying out fast, high-resolution volumetric imaging without moving and agitating the sample has been a challenging problem. Pupil-matched remote focusing has been promising for high NA imaging systems with their low aberrations and wavelength independence, making it suitable for multicolor imaging. However, owing to the incoherent and unpolarized nature of the fluorescence signal, manipulating this emission light through remote focusing is challenging. Therefore, remote focusing has been primarily limited to the illumination arm, using polarized laser light to facilitate coupling in and out of the remote focusing optics. Here, we introduce a novel optical design that can de-scan the axial focus movement in the detection arm of a microscope. Our method splits the fluorescence signal into S and P-polarized light, lets them pass through the remote focusing module separately, and combines them with the camera. This allows us to use only one focusing element to perform aberration-free, multi-color, volumetric imaging without (a) compromising the fluorescent signal and (b) needing to perform sample/detection-objective translation. We demonstrate the capabilities of this scheme by acquiring fast dual-color 4D (3D space + time) image stacks with an axial range of 70 μm and camera-limited acquisition speed. Owing to its general nature, we believe this technique will find its application in many other microscopy techniques that currently use an adjustable Z-stage to carry out volumetric imaging, such as confocal, 2-photon, and light sheet variants.

Varifocal MEMS mirrors for high-speed axial focus scanning: a review

Recent advances brought the performance of MEMS-based varifocal mirrors to levels comparable to conventional ultra-high-speed focusing devices. Varifocal mirrors are becoming capable of high axial resolution exceeding 300 resolvable planes, can achieve microsecond response times, continuous operation above several hundred kHz, and can be designed to combine focusing with lateral steering in a single-chip device. This survey summarizes the past 50 years of scientific progress in varifocal MEMS mirrors, providing the most comprehensive study in this field to date. We introduce a novel figure of merit for varifocal mirrors on the basis of which we evaluate and compare nearly all reported devices from the literature. At the forefront of this review is the analysis of the advantages and shortcomings of various actuation technologies, as well as a systematic study of methods reported to enhance the focusing performance in terms of speed, resolution, and shape fidelity. We believe this analysis will fuel the future technological development of next-generation varifocal mirrors reaching the axial resolution of 1000 resolvable planes.

Axial de-scanning using remote focusing in the detection arm of light-sheet microscopy

The ability to image at high speeds is necessary in biological imaging to capture fast-moving or transient events or to efficiently image large samples. However, due to the lack of rigidity of biological specimens, carrying out fast, high-resolution volumetric imaging without moving and agitating the sample has been a challenging problem. Pupil-matched remote focusing has been promising for high NA imaging systems with their low aberrations and wavelength independence, making it suitable for multicolor imaging. However, owing to the incoherent and unpolarized nature of the fluorescence signal, manipulating this emission light through remote focusing is challenging. Therefore, remote focusing has been primarily limited to the illumination arm, using polarized laser light for facilitating coupling in and out of the remote focusing optics. Here we introduce a novel optical design that can de-scan the axial focus movement in the detection arm of a microscope. Our method splits the fluorescence signal into S and P-polarized light and lets them pass through the remote focusing module separately and combines them with the camera. This allows us to use only one focusing element to perform aberration-free, multi-color, volumetric imaging without (a) compromising the fluorescent signal and (b) needing to perform sample/detection-objective translation. We demonstrate the capabilities of this scheme by acquiring fast dual-color 4D (3D space + time) image stacks, with an axial range of 70 μm and camera limited acquisition speed. Owing to its general nature, we believe this technique will find its application to many other microscopy techniques that currently use an adjustable Z-stage to carry out volumetric imaging such as confocal, 2-photon, and light sheet variants.

Recent advances in oblique plane microscopy

Oblique plane microscopy (OPM) directly captures object information in a plane tilted from the focal plane of the objective lens without the need for slow z-stack acquisition. This unconventional widefield imaging approach is made possible by using a remote focusing principle that eliminates optical aberrations for object points beyond the focal plane. Together with oblique lightsheet illumination, OPM can make conventional lightsheet imaging fully compatible with standard biological specimens prepared on microscope slides. OPM is not only an excellent high-speed volumetric imaging platform by sweeping oblique lightsheet illumination without mechanically moving either the sample or objective lens in sample space, but also provides a solution for direct oblique plane imaging along any orientation of interest on the sample in a single shot. Since its first demonstration in 2008, OPM has continued to evolve into an advanced microscope platform for biological, medical, and materials science applications. In recent years, many technological advances have been made in OPM with the goal of super-resolution, fast volumetric imaging, and a large imaging field of view, etc. This review gives an overview of OPM's working principle and imaging performance and introduces recent technical developments in OPM methods and applications. OPM has strong potential in a variety of research fields, including cellular and developmental biology, clinical diagnostics in histology and ophthalmology, flow cytometry, microfluidic devices, and soft materials.

A Compact Two-Dimensional Varifocal Scanning Imaging Device Actuated by Artificial Muscle Material

This paper presents a compact two-dimensional varifocal-scanning imaging device, with the capability of continuously variable focal length and a large scanning range, actuated by artificial muscle material. The varifocal function is realized by the principle of laterally shifting cubic phase masks and the scanning function is achieved by the principle of the decentered lens. One remarkable feature of these two principles is that both are based on the lateral displacements perpendicular to the optical axis. Artificial muscle material is emerging as a good choice of soft actuators capable of high strain, high efficiency, fast response speed, and light weight. Inspired by the artificial muscle, the dielectric elastomer is used as an actuator and produces the lateral displacements of the Alvarez lenses and the decentered lenses. A two-dimensional varifocal scanning imaging device prototype was established and validated through experiments to verify the feasibility of the proposed varifocal-scanning device. The results showed that the focal length variation of the proposed varifocal scanning device is up to 4.65 times higher (31.6 mm/6.8 mm), and the maximum scanning angle was 26.4°. The rise and fall times were 110 ms and 185 ms, respectively. Such a varifocal scanning device studied here has the potential to be used in consumer electronics, endoscopy, and microscopy in the future.

Efficient 3D light-sheet imaging of very large-scale optically cleared human brain and prostate tissue samples

The ability to image human tissue samples in 3D, with both cellular resolution and a large field of view (FOV), can improve fundamental and clinical investigations. Here, we demonstrate the feasibility of light-sheet imaging of ~5 cm³ sized formalin fixed human brain and up to ~7 cm³ sized formalin fixed paraffin embedded (FFPE) prostate cancer samples, processed with the FFPE-MASH protocol. We present a light-sheet microscopy prototype, the cleared-tissue dual view Selective Plane Illumination Microscope (ct-dSPIM), capable of fast 3D high-resolution acquisitions of cm³ scale cleared tissue. We used mosaic scans for fast 3D overviews of entire tissue samples or higher resolution overviews of large ROIs with various speeds: (a) Mosaic 16 (16.4 µm isotropic resolution, ~1.7 h/cm³), (b) Mosaic 4 (4.1 µm isotropic resolution, ~ 5 h/cm³) and (c) Mosaic 0.5 (0.5 µm near isotropic resolution, ~15.8 h/cm³). We could visualise cortical layers and neurons around the border of human brain areas V1&V2, and could demonstrate suitable imaging quality for Gleason score grading in thick prostate cancer samples. We show that ct-dSPIM imaging is an excellent technique to quantitatively assess entire MASH prepared large-scale human tissue samples in 3D, with considerable future clinical potential.

Adaptive optics in single objective inclined light sheet microscopy enables three-dimensional localization microscopy in adult Drosophila brains

Single-molecule localization microscopy (SMLM) enables the high-resolution visualization of organelle structures and the precise localization of individual proteins. However, the expected resolution is not achieved in tissue as the imaging conditions deteriorate. Sample-induced aberrations distort the point spread function (PSF), and high background fluorescence decreases the localization precision. Here, we synergistically combine sensorless adaptive optics (AO), in-situ 3D-PSF calibration, and a single-objective lens inclined light sheet microscope (SOLEIL), termed (AO-SOLEIL), to mitigate deep tissue-induced deteriorations. We apply AO-SOLEIL on several dSTORM samples including brains of adult Drosophila. We observed a 2x improvement in the estimated axial localization precision with respect to widefield without aberration correction while we used synergistic solution. AO-SOLEIL enhances the overall imaging resolution and further facilitates the visualization of sub-cellular structures in tissue.

Isotropic imaging across spatial scales with axially swept light-sheet microscopy

Light-sheet fluorescence microscopy is a rapidly growing technique that has gained tremendous popularity in the life sciences owing to its high-spatiotemporal resolution and gentle, non-phototoxic illumination. In this protocol, we provide detailed directions for the assembly and operation of a versatile light-sheet fluorescence microscopy variant, referred to as axially swept light-sheet microscopy (ASLM), that delivers an unparalleled combination of field of view, optical resolution and optical sectioning. To democratize ASLM, we provide an overview of its working principle and applications to biological imaging, as well as pragmatic tips for the assembly, alignment and control of its optical systems. Furthermore, we provide detailed part lists and schematics for several variants of ASLM that together can resolve molecular detail in chemically expanded samples, subcellular organization in living cells or the anatomical composition of chemically cleared intact organisms. We also provide software for instrument control and discuss how users can tune imaging parameters to accommodate diverse sample types. Thus, this protocol will serve not only as a guide for both introductory and advanced users adopting ASLM, but as a useful resource for any individual interested in deploying custom imaging technology. We expect that building an ASLM will take ~1-2 months, depending on the experience of the instrument builder and the version of the instrument.

Axial scanning of dual focus to improve light sheet microscopy

Axially swept light sheet microscopy (ASLM) is an emerging technique that enables isotropic, subcellular resolution imaging with high optical sectioning capability over a large field-of-view (FOV). Due to its versatility across a broad range of immersion media, it has been utilized to image specimens that may range from live cells to intact chemically cleared organs. However, because of its design, the performance of ASLM-based microscopes is impeded by a low detection signal and the maximum achievable frame-rate for full FOV imaging. Here we present a new optical concept that pushes the limits of ASLM further by scanning two staggered light sheets and simultaneously synchronizing the rolling shutter of a scientific camera. For a particular peak-illumination-intensity, this idea can make ASLMs image twice as fast without compromising the detection signal. Alternately, for a particular frame rate our method doubles the detection signal without requiring to double the peak-illumination-power, thereby offering a gentler illumination scheme compared to tradition single-focus ASLM. We demonstrate the performance of our instrument by imaging fluorescent beads and a PEGASOS cleared-tissue mouse brain.

Fast volumetric imaging with line-scan confocal microscopy by electrically tunable lens at resonant frequency

In microscopic imaging of biological tissues, particularly real-time visualization of neuronal activities, rapid acquisition of volumetric images poses a prominent challenge. Typically, two-dimensional (2D) microscopy can be devised into an imaging system with 3D capability using any varifocal lens. Despite the conceptual simplicity, such an upgrade yet requires additional, complicated device components and usually suffers from a reduced acquisition rate, which is critical to properly document rapid neurophysiological dynamics. In this study, we implemented an electrically tunable lens (ETL) in the line-scan confocal microscopy (LSCM), enabling the volumetric acquisition at the rate of 20 frames per second with a maximum volume of interest of 315 × 315 × 80 µm³. The axial extent of point-spread-function (PSF) was 17.6 ± 1.6 µm and 90.4 ± 2.1 µm with the ETL operating in either stationary or resonant mode, respectively, revealing significant depth axial penetration by the resonant mode ETL microscopy. We further demonstrated the utilities of the ETL system by volume imaging of both cleared mouse brain ex vivo samples and in vivo brains. The current study showed a successful application of resonant ETL for constructing a high-performance 3D axially scanning LSCM (asLSCM) system. Such advances in rapid volumetric imaging would significantly enhance our understanding of various dynamic biological processes.

Advanced high resolution three-dimensional imaging to visualize the cerebral neurovascular network in stroke

As an important method to accurately and timely diagnose stroke and study physiological characteristics and pathological mechanism in it, imaging technology has gone through more than a century of iteration. The interaction of cells densely packed in the brain is three-dimensional (3D), but the flat images brought by traditional visualization methods show only a few cells and ignore connections outside the slices. The increased resolution allows for a more microscopic and underlying view. Today's intuitive 3D imagings of micron or even nanometer scale are showing its essentiality in stroke. In recent years, 3D imaging technology has gained rapid development. With the overhaul of imaging mediums and the innovation of imaging mode, the resolution has been significantly improved, endowing researchers with the capability of holistic observation of a large volume, real-time monitoring of tiny voxels, and quantitative measurement of spatial parameters. In this review, we will summarize the current methods of high-resolution 3D imaging applied in stroke.

Neurophotonic tools for microscopic measurements and manipulation: status report

Neurophotonics was launched in 2014 coinciding with the launch of the BRAIN Initiative focused on development of technologies for advancement of neuroscience. For the last seven years, Neurophotonics' agenda has been well aligned with this focus on neurotechnologies featuring new optical methods and tools applicable to brain studies. While the BRAIN Initiative 2.0 is pivoting towards applications of these novel tools in the quest to understand the brain, this status report reviews an extensive and diverse toolkit of novel methods to explore brain function that have emerged from the BRAIN Initiative and related large-scale efforts for measurement and manipulation of brain structure and function. Here, we focus on neurophotonic tools mostly applicable to animal studies. A companion report, scheduled to appear later this year, will cover diffuse optical imaging methods applicable to noninvasive human studies. For each domain, we outline the current state-of-the-art of the respective technologies, identify the areas where innovation is needed, and provide an outlook for the future directions.

Electro-responsive actuators based on graphene

Electro-responsive actuators (ERAs) hold great promise for cutting-edge applications in e-skins, soft robots, unmanned flight, and in vivo surgery devices due to the advantages of fast response, precise control, programmable deformation, and the ease of integration with control circuits. Recently, considering the excellent physical/chemical/mechanical properties (e.g., high carrier mobility, strong mechanical strength, outstanding thermal conductivity, high specific surface area, flexibility, and transparency), graphene and its derivatives have emerged as an appealing material in developing ERAs. In this review, we have summarized the recent advances in graphene-based ERAs. Typical the working mechanisms of graphene ERAs have been introduced. Design principles and working performance of three typical types of graphene ERAs (e.g., electrostatic actuators, electrothermal actuators, and ionic actuators) have been comprehensively summarized. Besides, emerging applications of graphene ERAs, including artificial muscles, bionic robots, human-soft actuators interaction, and other smart devices, have been reviewed. At last, the current challenges and future perspectives of graphene ERAs are discussed.

Fast 3D imaging of giant unilamellar vesicles using reflected light-sheet microscopy with single molecule sensitivity

Observation of highly dynamic processes inside living cells at the single molecule level is key for a better understanding of biological systems. However, imaging of single molecules in living cells is usually limited by the spatial and temporal resolution, photobleaching and the signal-to-background ratio. To overcome these limitations, light-sheet microscopes with thin selective plane illumination, for example, in a reflected geometry with a high numerical aperture imaging objective, have been developed. Here, we developed a reflected light-sheet microscope with active optics for fast, high contrast, two-colour acquisition of z -stacks. We demonstrate fast volume scanning by imaging a two-colour giant unilamellar vesicle (GUV) hemisphere. In addition, the high contrast enabled the imaging and tracking of single lipids in the GUV cap. The enhanced reflected scanning light-sheet microscope enables fast 3D scanning of artificial membrane systems and potentially live cells with single-molecule sensitivity and thereby could provide quantitative and molecular insight into the operation of cells.

CompassLSM: axially swept light-sheet microscopy made simple

Axially swept light-sheet microscopy (ASLM) is an effective method of generating a uniform light sheet across a large field of view (FOV). However, current ASLM designs are more complicated than conventional light-sheet systems, limiting their adaptation in less experienced labs. By eliminating difficult-to-align components and reducing the total number of components, we show that high-performance ASLM can be accomplished much simpler than existing designs, requiring less expertise and effort to construct, align, and operate. Despite the high simplicity, our design achieved 3.5-µm uniform optical sectioning across a >6-mm FOV, surpassing existing light-sheet designs with similar optical sectioning. With well-corrected chromatic aberration, multi-channel fluorescence imaging can be performed without realignment. This manuscript provides a comprehensive tutorial on building the system and demonstrates the imaging performance with optically cleared whole-mount tissue samples.

Video-rate remote refocusing through continuous oscillation of a membrane deformable mirror

This paper presents the use of a deformable mirror (DM) configured to rapidly refocus a microscope employing a high numerical aperture (NA) objective lens. An Alpao DM97-15 membrane DM was used to refocus a 40×/0.80 NA water-immersion objective through a defocus range of -50-50 μm at 26.3 sweeps s-1. We achieved imaging with a mean Strehl metric of >0.6 over a field of view in the sample of 200 × 200 μm2 over a defocus range of 77 μm. We describe an optimisation procedure where the mirror is swept continuously in order to avoid known problems of hysteresis associated with the membrane DM employed. This work demonstrates that a DM-based refocusing system could in the future be used in light-sheet fluorescence microscopes to achieve video-rate volumetric imaging.

Accelerated electrowetting-based tunable fluidic lenses

One of the limitations in the application of electrowetting-based tunable fluidic lenses is their slow response time. We consider here two approaches for enhancing the response speed of tunable fluidic lenses: optimization of the properties of the fluids employed and modification of the time-dependent actuation voltages. Using a tubular optofluidic configuration, it is shown through simulations how one may take advantage of the interplay between liquid viscosities and surface tension to reduce the actuation time. In addition, by careful designing the actuation pulses, the response speed of both overdamped and underdamped systems may be increased by over an order of magnitude, leading to response times of several ten milliseconds. These performance improvements may significantly enhance the applicability of tunable optofluidic-based components and systems.

New solution for fast axial scanning in fluorescence microscopy

A novel technique based on the remote-focusing concept, using a galvanometer scanner combined with a self-fabricated "step mirror" or "tilted mirror" to transform fast lateral scanning into axial scanning, was reported as a new solution for fast, subcellular, 3D fluorescence imaging.

A micromirror array with annular partitioning for high-speed random-access axial focusing

Dynamic axial focusing functionality has recently experienced widespread incorporation in microscopy, augmented/virtual reality (AR/VR), adaptive optics and material processing. However, the limitations of existing varifocal tools continue to beset the performance capabilities and operating overhead of the optical systems that mobilize such functionality. The varifocal tools that are the least burdensome to operate (e.g. liquid crystal, elastomeric or optofluidic lenses) suffer from low (≈100 Hz) refresh rates. Conversely, the fastest devices sacrifice either critical capabilities such as their dwelling capacity (e.g. acoustic gradient lenses or monolithic micromechanical mirrors) or low operating overhead (e.g. deformable mirrors). Here, we present a general-purpose random-access axial focusing device that bridges these previously conflicting features of high speed, dwelling capacity and lightweight drive by employing low-rigidity micromirrors that exploit the robustness of defocusing phase profiles. Geometrically, the device consists of an 8.2 mm diameter array of piston-motion and 48-μm-pitch micromirror pixels that provide 2π phase shifting for wavelengths shorter than 1100 nm with 10-90% settling in 64.8 μs (i.e., 15.44 kHz refresh rate). The pixels are electrically partitioned into 32 rings for a driving scheme that enables phase-wrapped operation with circular symmetry and requires <30 V per channel. Optical experiments demonstrated the array's wide focusing range with a measured ability to target 29 distinct resolvable depth planes. Overall, the features of the proposed array offer the potential for compact, straightforward methods of tackling bottlenecked applications, including high-throughput single-cell targeting in neurobiology and the delivery of dense 3D visual information in AR/VR.