Structured illumination microscopy with interleaved reconstruction (SIMILR)

Fast volumetric multifocus structured illumination microscopy of subcellular dynamics in living cells

Studying the nanoscale dynamics of subcellular structures is possible with 2D structured illumination microscopy (SIM). The method allows for acquisition with improved resolution over typical widefield. For 3D samples, the acquisition speed is inherently limited by the need to acquire sequential two-dimensional planes to create a volume. Here, we present a development of multifocus SIM designed to provide high volumetric frame rate by using fast synchronized electro-optical components. We demonstrate the high volumetric imaging capacity of the microscope by recording the dynamics of microtubule and endoplasmatic reticulum in living cells at up to 2.3 super resolution volumes per second for a total volume of 30 × 30 × 1.8 µm3.

High-fidelity 3D live-cell nanoscopy through data-driven enhanced super-resolution radial fluctuation

Live-cell super-resolution microscopy enables the imaging of biological structure dynamics below the diffraction limit. Here we present enhanced super-resolution radial fluctuations (eSRRF), substantially improving image fidelity and resolution compared to the original SRRF method. eSRRF incorporates automated parameter optimization based on the data itself, giving insight into the trade-off between resolution and fidelity. We demonstrate eSRRF across a range of imaging modalities and biological systems. Notably, we extend eSRRF to three dimensions by combining it with multifocus microscopy. This realizes live-cell volumetric super-resolution imaging with an acquisition speed of ~1 volume per second. eSRRF provides an accessible super-resolution approach, maximizing information extraction across varied experimental conditions while minimizing artifacts. Its optimal parameter prediction strategy is generalizable, moving toward unbiased and optimized analyses in super-resolution microscopy.

Rationalized deep learning super-resolution microscopy for sustained live imaging of rapid subcellular processes

The goal when imaging bioprocesses with optical microscopy is to acquire the most spatiotemporal information with the least invasiveness. Deep neural networks have substantially improved optical microscopy, including image super-resolution and restoration, but still have substantial potential for artifacts. In this study, we developed rationalized deep learning (rDL) for structured illumination microscopy and lattice light sheet microscopy (LLSM) by incorporating prior knowledge of illumination patterns and, thereby, rationally guiding the network to denoise raw images. Here we demonstrate that rDL structured illumination microscopy eliminates spectral bias-induced resolution degradation and reduces model uncertainty by five-fold, improving the super-resolution information by more than ten-fold over other computational approaches. Moreover, rDL applied to LLSM enables self-supervised training by using the spatial or temporal continuity of noisy data itself, yielding results similar to those of supervised methods. We demonstrate the utility of rDL by imaging the rapid kinetics of motile cilia, nucleolar protein condensation during light-sensitive mitosis and long-term interactions between membranous and membrane-less organelles.

Nanoscale architecture and coordination of actin cores within the sealing zone of human osteoclasts

Osteoclasts are unique in their capacity to degrade bone tissue. To achieve this process, osteoclasts form a specific structure called the sealing zone, which creates a close contact with bone and confines the release of protons and hydrolases for bone degradation. The sealing zone is composed of actin structures called podosomes nested in a dense actin network. The organization of these actin structures inside the sealing zone at the nano scale is still unknown. Here, we combine cutting-edge microscopy methods to reveal the nanoscale architecture and dynamics of the sealing zone formed by human osteoclasts on bone surface. Random illumination microscopy allowed the identification and live imaging of densely packed actin cores within the sealing zone. A cross-correlation analysis of the fluctuations of actin content at these cores indicates that they are locally synchronized. Further examination shows that the sealing zone is composed of groups of synchronized cores linked by a-actinin1 positive filaments, and encircled by adhesion complexes. Thus, we propose that the confinement of bone degradation mediators is achieved through the coordination of islets of actin cores and not by the global coordination of all podosomal subunits forming the sealing zone.

Reflectional quantitative phase-contrast microscopy (RQPCM) with annular epi-illumination

Quantitative phase microscopy (QPM) is a label-free microscopic technique that exploits the phase of a wave passing through a sample; hence, it has been applied to many fields, including biomedical research and industrial inspection. However, the high spatiotemporal resolution imaging of reflective samples still challenges conventional transmission QPM. In this paper, we propose reflectional quantitative phase-contrast microscopy based on annular epi-illumination of light-emitting diodes. The unscattered wave from the sample is successively phase-retarded by 0, π/2, π, and 3π/2 through a spatial light modulator, and high-resolution phase-contrast images are obtained, revealing the finer structure or three-dimensional tomography of reflective samples. With this system, we have quantitatively obtained the contour of tissue slices and silicon semiconductor wafers. We believe that the proposed system will be very helpful for the high-resolution imaging of industrial devices and biomedical dynamics.

Real-time reconstruction using electro-optics modulator-based structured illumination microscopy

Structured illumination microscopy (SIM), a super-resolution technology, has a wide range of applications in life sciences. In this study, we present an electro-optic high-speed phase-shift super-resolution microscopy imaging system including 2D SIM, total internal reflection fluorescence-SIM, and 3D SIM modes. This system uses galvanometers and an electro-optic modulator to flexibly and quickly control the phase and direction of structured illumination patterns. Moreover, its design consists of precise timing for improved acquisition speed and software architecture for real-time reconstruction. The highest acquisition rate achieved was 151 frames/s, while the highest real-time super-resolution reconstruction frame rate achieved was over 25 frames/s.

Answering some questions about structured illumination microscopy

Structured illumination microscopy (SIM) provides images of fluorescent objects at an enhanced resolution greater than that of conventional epifluorescence wide-field microscopy. Initially demonstrated in 1999 to enhance the lateral resolution twofold, it has since been extended to enhance axial resolution twofold (2008), applied to live-cell imaging (2009) and combined with myriad other techniques, including interferometric detection (2008), confocal microscopy (2010) and light sheet illumination (2012). Despite these impressive developments, SIM remains, perhaps, the most poorly understood 'super-resolution' method. In this article, we provide answers to the 13 questions regarding SIM proposed by Prakash et al. along with answers to a further three questions. After providing a general overview of the technique and its developments, we explain why SIM as normally used is still diffraction-limited. We then highlight the necessity for a non-polynomial, and not just nonlinear, response to the illuminating light in order to make SIM a true, diffraction-unlimited, super-resolution technique. In addition, we present a derivation of a real-space SIM reconstruction approach that can be used to process conventional SIM and image scanning microscopy (ISM) data and extended to process data with quasi-arbitrary illumination patterns. Finally, we provide a simple bibliometric analysis of SIM development over the past two decades and provide a short outlook on potential future work. This article is part of the Theo Murphy meeting issue 'Super-resolution structured illumination microscopy (part 2)'.

SIM reconstruction framework for high-speed multi-dimensional super-resolution imaging

Structured illumination microscopy (SIM) holds great promise for live cell imaging applications due to its potential to obtain multidimensional information such as intensity, spectrum and polarization (I, λ , p) at high spatial-temporal resolution, enabling the observation of more complex dynamic interactions between subcellular structures. However, the reconstruction results of polarized samples are prone to artifacts because all current SIM reconstruction frameworks use incomplete imaging models which neglect polarization modulation. Such polarization-related artifacts are especially prevalent for SIM reconstruction using a reduced number of raw images (RSIM) and severely undermine the ability of SIM to capture multi-dimensional information. Here, we report a new SIM reconstruction framework (PRSIM) that can recover multi-dimensional information (I, λ, p) using a reduced number of raw images. PRSIM adopts a complete imaging model that is versatile for normal and polarized samples and uses a frequency-domain iterative reconstruction algorithm for artifact-free super-resolution (SR) reconstruction. It can simultaneously obtain the SR spatial structure and polarization orientation of polarized samples using 6 raw SIM images and can perform SR reconstruction using 4 SIM images for normal samples. In addition, PRSIM has less spatial computational complexity and achieves reconstruction speeds tens of times higher than that of the state-of-the-art non-iterative RSIM, making it more suitable for large field-of-view imaging. Thus, PRSIM is expected to facilitate the development of SIM into an ultra-high-speed and multi-dimensional SR imaging tool.

Label-free imaging of intracellular organelle dynamics using flat-fielding quantitative phase contrast microscopy (FF-QPCM)

Panoramic and long-term observation of nanosized organelle dynamics and interactions with high spatiotemporal resolution still hold great challenge for current imaging platforms. In this study, we propose a live-organelle imaging platform, where a flat-fielding quantitative phase contrast microscope (FF-QPCM) visualizes all the membrane-bound subcellular organelles, and an intermittent fluorescence channel assists in specific organelle identification. FF-QPCM features a high spatiotemporal resolution of 245 nm and 250 Hz and strong immunity against external disturbance. Thus, we could investigate several important dynamic processes of intracellular organelles from direct perspectives, including chromosome duplication in mitosis, mitochondrial fusion and fission, filaments, and vesicles' morphologies in apoptosis. Of note, we have captured, for the first time, a new type of mitochondrial fission (entitled mitochondrial disintegration), the generation and fusion process of vesicle-like organelles, as well as the mitochondrial vacuolization during necrosis. All these results bring us new insights into spatiotemporal dynamics and interactions among organelles, and hence aid us in understanding the real behaviors and functional implications of the organelles in cellular activities.

Iterative tomography with digital adaptive optics permits hour-long intravital observation of 3D subcellular dynamics at millisecond scale

Long-term subcellular intravital imaging in mammals is vital to study diverse intercellular behaviors and organelle functions during native physiological processes. However, optical heterogeneity, tissue opacity, and phototoxicity pose great challenges. Here, we propose a computational imaging framework, termed digital adaptive optics scanning light-field mutual iterative tomography (DAOSLIMIT), featuring high-speed, high-resolution 3D imaging, tiled wavefront correction, and low phototoxicity with a compact system. By tomographic imaging of the entire volume simultaneously, we obtained volumetric imaging across 225 × 225 × 16 μm3, with a resolution of up to 220 nm laterally and 400 nm axially, at the millisecond scale, over hundreds of thousands of time points. To establish the capabilities, we investigated large-scale cell migration and neural activities in different species and observed various subcellular dynamics in mammals during neutrophil migration and tumor cell circulation.

High-speed volumetric imaging in vivo based on structured illumination microscopy with interleaved reconstruction

Wide-field fluorescence microscopy (WFFM) is widely adopted in biomedical studies, due to its high imaging speed over large field-of-views. However, WFFM is susceptible to out-of-focus background. To overcome this problem, structured illumination microscopy (SIM) was proposed as a wide-field, optical-sectioning technique, which needs multiple raw images for image reconstruction and thus has a lower imaging speed. Here we propose SIM with interleaved reconstruction, to make SIM of lossless speed. We apply this method in volumetric imaging of neural network dynamics in brains of zebrafish larva in vivo.

Dynamical spectroscopy and microscopy of proteins in cells

With a strong understanding of how proteins fold in hand, it is now possible to ask how in-cell environments modulate their folding, binding and function. Studies accessing fast (ns to s) in-cell dynamics have accelerated over the past few years through a combination of in-cell NMR spectroscopy and time-resolved fluorescence microscopies. Here, we discuss this recent work and the emerging picture of protein surfaces as not just hydrophilic coats interfacing the solvent to the protein's core and functional regions, but as critical components in cells controlling protein mobility, function and communication with post-translational modifications.

Method for assessing the spatiotemporal resolution of structured illumination microscopy (SIM)

A method is proposed for assessing the temporal resolution of structured illumination microscopy (SIM), by tracking the amplitude of different spatial frequency components over time, and comparing them to a temporally-oscillating ground-truth. This method is used to gain insight into the performance limits of SIM, along with alternative reconstruction techniques (termed 'rolling SIM') that claim to improve temporal resolution. Results show that the temporal resolution of SIM varies considerably between low and high spatial frequencies, and that, despite being used in several high profile papers and commercial microscope software, rolling SIM provides no increase in temporal resolution over conventional SIM.

Fast widefield imaging of neuronal structure and function with optical sectioning in vivo

Optical microscopy, owing to its noninvasiveness and subcellular resolution, enables in vivo visualization of neuronal structure and function in the physiological context. Optical-sectioning structured illumination microscopy (OS-SIM) is a widefield fluorescence imaging technique that uses structured illumination patterns to encode in-focus structures and optically sections 3D samples. However, its application to in vivo imaging has been limited. In this study, we optimized OS-SIM for in vivo neural imaging. We modified OS-SIM reconstruction algorithms to improve signal-to-noise ratio and correct motion-induced artifacts in live samples. Incorporating an adaptive optics (AO) module to OS-SIM, we found that correcting sample-induced optical aberrations was essential for achieving accurate structural and functional characterizations in vivo. With AO OS-SIM, we demonstrated fast, high-resolution in vivo imaging with optical sectioning for structural imaging of mouse cortical neurons and zebrafish larval motor neurons, and functional imaging of quantal synaptic transmission at Drosophila larval neuromuscular junctions.

Quantitative phase microscopy with enhanced contrast and improved resolution through ultra-oblique illumination (UO-QPM)

Recent developments in phase contrast microscopy have enabled the label-free visualization of certain organelles due to their distinct morphological features, making this method an attractive alternative in the study of cellular dynamics. However tubular structures such as endoplasmic reticulum (ER) networks and complex dynamics such as the fusion and fission of mitochondria, due to their low phase contrast, still need fluorescent labeling to be adequately imaged. In this article, we report a quantitative phase microscope with ultra-oblique illumination that enables us to see those structures and their dynamics with high contrast for the first time without labeling. The imaging capability was validated through comparison to the fluorescence images with the same field-of-view. The high image resolution (~270 nm) was validated using both beads and cellular structures. Furthermore, we were able to record the vibration of ER networks at a frame rate of 250 Hz. We additionally show complex cellular processes such as remodeling of the mitochondria networks through fusion and fission and vesicle transportation along the ER without labels. Our high spatial and temporal resolution allowed us to observe mitochondria "spinning", which has not been reported before, further demonstrating the advantages of the proposed method.