Computational conjugate adaptive optics microscopy for longitudinal through-skull imaging of cortical myelin

Long-term tracking of neural and oligodendroglial development in large-scale human cerebral organoids by noninvasive volumetric imaging

Human cerebral organoids serve as a quintessential model for deciphering the complexities of brain development in a three-dimensional milieu. However, imaging these organoids, particularly when they exceed several millimeters in size, has been curtailed by the technical impediments such as phototoxicity, slow imaging speeds, and inadequate resolution and imaging depth. Addressing these pivotal challenges, our study has pioneered a high-speed scanning microscope, synergistically coupled with advanced computational image processing. This ensemble has empowered us to monitor the intricate dynamics of neuron and oligodendrocyte development within cerebral organoids across a trajectory of approximately two months. Line-shaped illumination mitigates photodamage and, alongside refined spatial gating, maximizes signal collection through integrating with computational processing. The integration of deconvolution and compressive sensing has improved image contrast by 6-fold, elucidating fine features of the neurites. Thus, noninvasive imaging enabled us to perform long-term tracking of neural and oligodendroglial development in the large-scale human cerebral organoid. Furthermore, our sophisticated volumetric segmentation algorithm has yielded a robust four-dimensional quantitative analysis, encapsulating both neuronal and oligodendroglial maturation. Collectively, these advances mark a significant advancement in the field of neurodevelopment, providing a powerful tool for in-depth study of complex brain organoid systems.

Noninvasive megapixel fluorescence microscopy through scattering layers by a virtual incoherent reflection matrix

Optical-resolution fluorescence imaging through and within complex samples presents a major challenge due to random light scattering, with substantial implications across multiple fields. While considerable advancements in coherent imaging through severe multiple scattering have been recently introduced by reflection matrix processing, approaches that tackle scattering in incoherent fluorescence imaging have been limited to sparse targets, require high-resolution control of the illumination or detection wavefronts, or require a very large number of measurements. Here, we present an approach that allows the adaptation of well-established reflection matrix techniques to scattering compensation in incoherent fluorescence imaging. We experimentally demonstrate that a small number of conventional wide-field fluorescence microscope images acquired under unknown random illuminations can effectively be used to construct a virtual fluorescence-based reflection matrix. Processing this matrix by an adapted matrix-based scattering compensation algorithm allows reconstructing megapixel-scale images from <150 acquired frames, without any spatial light modulators or computationally intensive processing.

Bidirectional in-silico clearing approach for deep refractive-index tomography using a sparsely sampled transmission matrix

Optical diffraction tomography (ODT) enables the label-free volumetric imaging of biological specimens by mapping their three-dimensional refractive index (RI) distribution. However, the depth of imaging achievable is restricted due to spatially inhomogeneous RI distributions that induce multiple scattering. In this study, we introduce a novel ODT technique named bidirectional in-silico clearing RI tomography. This method incorporates both forward and reversed in-silico clearing. For the reversed in-silico clearing, we have integrated an ODT reconstruction framework with a transmission matrix approach, which enables RI reconstruction and wave backpropagation from the illumination side without necessitating modifications to the conventional ODT setup. Furthermore, the framework employs a sparsely sampled transmission matrix, significantly reducing the requisite number of measurements and computational expenses. Employing this proposed technique, we successfully imaged a spheroid with a thickness of 263 µm, corresponding to 11.4 scattering mean free paths. This method was successfully applied to various biological specimens, including liver and colon spheroids, demonstrating consistent imaging performance across samples with varied morphologies.

Neurophotonics beyond the surface: unmasking the brain's complexity exploiting optical scattering

The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.

Harnessing forward multiple scattering for optical imaging deep inside an opaque medium

As light travels through a disordered medium such as biological tissues, it undergoes multiple scattering events. This phenomenon is detrimental to in-depth optical microscopy, as it causes a drastic degradation of contrast, resolution and brightness of the resulting image beyond a few scattering mean free paths. However, the information about the inner reflectivity of the sample is not lost; only scrambled. To recover this information, a matrix approach of optical imaging can be fruitful. Here, we report on a de-scanned measurement of a high-dimension reflection matrix R via low coherence interferometry. Then, we show how a set of independent focusing laws can be extracted for each medium voxel through an iterative multi-scale analysis of wave distortions contained in R. It enables an optimal and local compensation of forward multiple scattering paths and provides a three-dimensional confocal image of the sample as the latter one had become digitally transparent. The proof-of-concept experiment is performed on a human opaque cornea and an extension of the penetration depth by a factor five is demonstrated compared to the state-of-the-art.

Memory-less scattering imaging with ultrafast convolutional optical neural networks

The optical memory effect in complex scattering media including turbid tissue and speckle layers has been a critical foundation for macroscopic and microscopic imaging methods. However, image reconstruction from strong scattering media without the optical memory effect has not been achieved. Here, we demonstrate image reconstruction through scattering layers where no optical memory effect exists, by developing a multistage convolutional optical neural network (ONN) integrated with multiple parallel kernels operating at the speed of light. Training this Fourier optics-based, parallel, one-step convolutional ONN with the strong scattering process for direct feature extraction, we achieve memory-less image reconstruction with a field of view enlarged by a factor up to 271. This device is dynamically reconfigurable for ultrafast multitask image reconstruction with a computational power of 1.57 peta-operations per second (POPS). Our achievement establishes an ultrafast and high energy-efficient optical machine learning platform for graphic processing.

Neurophotonics beyond the Surface: Unmasking the Brain's Complexity Exploiting Optical Scattering

The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.

Tandem aberration correction optics (TACO) in wide-field structured illumination microscopy

Structured illumination microscopy (SIM) is a powerful super-resolution imaging technique that uses patterned illumination to down-modulate high spatial-frequency information of samples. However, the presence of spatially-dependent aberrations can severely disrupt the illumination pattern, limiting the quality of SIM imaging. Conventional adaptive optics (AO) techniques that employ wavefront correctors at the pupil plane are not capable of effectively correcting these spatially-dependent aberrations. We introduce the Tandem Aberration Correction Optics (TACO) approach that combines both pupil AO and conjugate AO for aberration correction in SIM. TACO incorporates a deformable mirror (DM) for pupil AO in the detection path to correct for global aberrations, while a spatial light modulator (SLM) is placed at the plane conjugate to the aberration source near the sample plane, termed conjugate AO, to compensate spatially-varying aberrations in the illumination path. Our numerical simulations and experimental results show that the TACO approach can recover the illumination pattern close to an ideal condition, even when severely misshaped by aberrations, resulting in high-quality super-resolution SIM reconstruction. The TACO approach resolves a critical traditional shortcoming of aberration correction for structured illumination. This advance significantly expands the application of SIM imaging in the study of complex, particularly biological, samples and should be effective in other wide-field microscopies.

Three-dimensional ultrasound matrix imaging

Matrix imaging paves the way towards a next revolution in wave physics. Based on the response matrix recorded between a set of sensors, it enables an optimized compensation of aberration phenomena and multiple scattering events that usually drastically hinder the focusing process in heterogeneous media. Although it gave rise to spectacular results in optical microscopy or seismic imaging, the success of matrix imaging has been so far relatively limited with ultrasonic waves because wave control is generally only performed with a linear array of transducers. In this paper, we extend ultrasound matrix imaging to a 3D geometry. Switching from a 1D to a 2D probe enables a much sharper estimation of the transmission matrix that links each transducer and each medium voxel. Here, we first present an experimental proof of concept on a tissue-mimicking phantom through ex-vivo tissues and then, show the potential of 3D matrix imaging for transcranial applications.

Label-free adaptive optics single-molecule localization microscopy for whole zebrafish

Specimen-induced aberration has been a major factor limiting the imaging depth of single-molecule localization microscopy (SMLM). Here, we report the application of label-free wavefront sensing adaptive optics to SMLM for deep-tissue super-resolution imaging. The proposed system measures complex tissue aberrations from intrinsic reflectance rather than fluorescence emission and physically corrects the wavefront distortion more than three-fold stronger than the previous limit. This enables us to resolve sub-diffraction morphologies of cilia and oligodendrocytes in whole zebrafish as well as dendritic spines in thick mouse brain tissues at the depth of up to 102 μm with localization number enhancement by up to 37 times and localization precision comparable to aberration-free samples. The proposed approach can expand the application range of SMLM to whole zebrafish that cause the loss of localization number owing to severe tissue aberrations.

Single-shot decoherence polarization gated imaging through turbid media

We propose a method for imaging through a turbid medium by using a single-shot decoherence polarization gate (DPG). The DPG is made up of a polarizer, an analyzer, and a weakly scattering medium. Contrary to intuition, we discover that the preferential utilization of sparsely scattered photons by introducing weakly scattering mediums can lead to better image quality. The experimental results show that the visibilities of the images acquired from the DPG imaging method are obviously improved. The contrast of the bar can be increased by 50% by the DPG imaging technique. Furthermore, we study the effect of the volume concentration of the weakly scattering medium on the speckle suppression and the enhancement of the visibilities of the images. The variances of the contrasts of the image show that there exists an optimum optical depth (∼0.8) of the weakly scattering medium for DPG imaging through a specific turbid medium.