Localizing and tracking single nanoscale emitters in three dimensions with high spatiotemporal resolution using a double-helix point spread function

Dimerization of iLID optogenetic proteins observed using 3D single-molecule tracking in live E. coli

3D single-molecule tracking microscopy has enabled measurements of protein diffusion in living cells, offering information about protein dynamics and cellular environments. For example, different diffusive states can be resolved and assigned to protein complexes of different size and composition. However, substantial statistical power and biological validation, often through genetic deletion of binding partners, are required to support diffusive state assignments. When investigating cellular processes, real-time perturbations to protein spatial distributions is preferable to permanent genetic deletion of an essential protein. For example, optogenetic dimerization systems can be used to manipulate protein spatial distributions that could offer a means to deplete specific diffusive states observed in single-molecule tracking experiments. Here, we evaluate the performance of the iLID optogenetic system in living E. coli cells using diffraction-limited microscopy and 3D single-molecule tracking. We observed a robust optogenetic response in protein spatial distributions after 488 nm laser activation. Surprisingly, 3D single-molecule tracking results indicate activation of the optogenetic response when illuminating with high-intensity light with wavelengths at which there is minimal photon absorbance by the LOV2 domain. The preactivation can be minimized through the use of iLID system mutants, and titration of protein expression levels.

Recent Advances in Single-Molecule Tracking and Imaging Techniques

Since the early 1990s, single-molecule detection in solution at room temperature has enabled direct observation of single biomolecules at work in real time and under physiological conditions, providing insights into complex biological systems that the traditional ensemble methods cannot offer. In particular, recent advances in single-molecule tracking techniques allow researchers to follow individual biomolecules in their native environments for a timescale of seconds to minutes, revealing not only the distinct pathways these biomolecules take for downstream signaling but also their roles in supporting life. In this review, we discuss various single-molecule tracking and imaging techniques developed to date, with an emphasis on advanced three-dimensional (3D) tracking systems that not only achieve ultrahigh spatiotemporal resolution but also provide sufficient working depths suitable for tracking single molecules in 3D tissue models. We then summarize the observables that can be extracted from the trajectory data. Methods to perform single-molecule clustering analysis and future directions are also discussed.

Single-molecule localization microscopy goes quantitative

In the last few years, single-molecule localization (SMLM) techniques have been used to address biological questions in different research fields. More recently, super-resolution has also been proposed as a quantitative tool for quantifying protein copy numbers at the nanoscale level. In this scenario, quantitative approaches, mainly based on stepwise photobleaching and quantitative SMLM assisted by calibration standards, offer an exquisite tool for investigating protein complexes. This primer focuses on the basic concepts behind quantitative super-resolution microscopy, also providing strategies to overcome the technical hurdles that could limit their application.

Double helix point spread function with variable spacing for precise 3D particle localization

To extend the axial depth of nanoscale 3D-localization microscopy, we propose here a splicing-type vortex singularities (SVS) phase mask, which has been meticulously optimized with a Fresnel approximation imaging inverse operation. The optimized SVS DH-PSF has proven to have high transfer function efficiency with adjustable performance in its axial range. The axial position of the particle was computed by using both the main lobes' spacing and the rotation angle, an improvement of the localization precision of the particle. Concretely, the proposed optimized SVS DH-PSF, with a smaller spatial extent, can effectively reduce the overlap of nanoparticle images and realize the 3D localization of multiple nanoparticles with small spacing, with respect to PSFs for large axial 3D localization. Finally, we successfully conducted extensive experiments on 3D localization for tracking dense nanoparticles at 8µm depth with a numerical aperture of 1.4, demonstrating its great potential.

Distinct Cytosolic Complexes Containing the Type III Secretion System ATPase Resolved by Three-Dimensional Single-Molecule Tracking in Live Yersinia enterocolitica

The membrane-embedded injectisome, the structural component of the virulence-associated type III secretion system (T3SS), is used by Gram-negative bacterial pathogens to inject species-specific effector proteins into eukaryotic host cells. The cytosolic injectisome proteins are required for export of effectors and display both stationary, injectisome-bound populations and freely diffusing cytosolic populations. How the cytosolic injectisome proteins interact with each other in the cytosol and associate with membrane-embedded injectisomes remains unclear. Here, we utilized three-dimensional (3D) single-molecule tracking to resolve distinct cytosolic complexes of injectisome proteins in living Yersinia enterocolitica cells. Tracking of the enhanced yellow fluorescent protein (eYFP)-labeled ATPase YeSctN and its regulator, YeSctL, revealed that these proteins form a cytosolic complex with each other and then further with YeSctQ. YeSctNL and YeSctNLQ complexes can be observed both in wild-type cells and in ΔsctD mutants, which cannot assemble injectisomes. In ΔsctQ mutants, the relative abundance of the YeSctNL complex is considerably increased. These data indicate that distinct cytosolic complexes of injectisome proteins can form prior to injectisome binding, which has important implications for how injectisomes are functionally regulated. IMPORTANCE Injectisomes are membrane-embedded, multiprotein assemblies used by bacterial pathogens to inject virulent effector proteins into eukaryotic host cells. Protein secretion is regulated by cytosolic proteins that dynamically bind and unbind at injectisomes. However, how these regulatory proteins interact with each other remains unknown. By measuring the diffusion rates of single molecules in living cells, we show that cytosolic injectisome proteins form distinct oligomeric complexes with each other prior to binding to injectisomes. We additionally identify the molecular compositions of these complexes and quantify their relative abundances. Quantifying to what extent cytosolic proteins exist as part of larger complexes in living cells has important implications for deciphering the complexity of biomolecular mechanisms. The results and methods reported here are thus relevant for advancing our understanding of how injectisomes and related multiprotein assemblies, such as bacterial flagellar motors, are functionally regulated.

Particle Localization Using Local Gradients and Its Application to Nanometer Stabilization of a Microscope

Particle localization plays a fundamental role in advanced biological techniques such as single-molecule tracking, superresolution microscopy, and manipulation by optical and magnetic tweezers. Such techniques require fast and accurate particle localization algorithms as well as nanometer-scale stability of the microscope. Here, we present a universal method for three-dimensional localization of single labeled and unlabeled particles based on local gradient calculation of particle images. The method outperforms state-of-the-art localization techniques in high-noise conditions, and it is capable of 3D nanometer accuracy localization of nano- and microparticles with sub-millisecond calculation time. By localizing a fixed particle as fiducial mark and running a feedback loop, we demonstrate its applicability for active drift correction in sensitive nanomechanical measurements such as optical trapping and superresolution imaging. A multiplatform open software package comprising a set of tools for local gradient calculation in brightfield, darkfield, and fluorescence microscopy is shared for ready use by the scientific community.

Axial accuracy in localization microscopy with 3D point spread function engineering

Single-molecule localization microscopy has developed into a widely used technique to overcome the diffraction limit and enables 3D localization of single-emitters with nanometer precision. A widely used method to enable 3D encoding is to use a cylindrical lens or a phase mask to engineer the point spread function (PSF). The performance of these PSFs is often assessed by comparing the precision they achieve, ignoring accuracy. Nonetheless, accurate localization is required in many applications, such as multi-plane imaging, measuring and modelling of physical processes based on volumetric data, and 3D particle averaging. However, there are PSF model mismatches in the localization schemes due to how reference PSFs are obtained, look-up-tables are created, or spots are fitted. Currently there is little insight in how these model mismatches give rise to systematic axial localization errors, how large these errors are, and how to mitigate them. In this theoretical and simulation work we use a vector PSF model, which incorporates super-critical angle fluorescence (SAF) and the appropriate aplanatic correction factor, to analyze the errors in z-localization. We introduce theory for defining the focal plane in SAF conditions and analyze the predicted axial errors for an astigmatic PSF, double-helix PSF, and saddle-point PSF. These simulations indicate that the absolute axial biases can be as large as 140 nm, 250 nm, and 120 nm for the astigmatic, saddle-point, and double-helix PSF respectively, with relative errors of more than 50%. Finally, we discuss potential experimental methods to verify these findings and propose a workflow to mitigate these effects.

Quantized spiral-phase-modulation based deep learning for real-time defocusing distance prediction

Whole slide imaging (WSI) has become an essential tool in pathological diagnosis, owing to its convenience on remote and collaborative review. However, how to bring the sample at the optimal position in the axial direction and image without defocusing artefacts is still a challenge, as traditional methods are either not universal or time-consuming. Until recently, deep learning has been shown to be effective in the autofocusing task in predicting defocusing distance. Here, we apply quantized spiral phase modulation on the Fourier domain of the captured images before feeding them into a light-weight neural network. It can significantly reduce the average predicting error to be lower than any previous work on an open dataset. Also, the high predicting speed strongly supports it can be applied on an edge device for real-time tasks with limited computational source and memory footprint.

Real-Time Feedback-Driven Single-Particle Tracking: A Survey and Perspective

Real-time feedback-driven single-particle tracking (RT-FD-SPT) is a class of techniques in the field of single-particle tracking that uses feedback control to keep a particle of interest in a detection volume. These methods provide high spatiotemporal resolution on particle dynamics and allow for concurrent spectroscopic measurements. This review article begins with a survey of existing techniques and of applications where RT-FD-SPT has played an important role. Each of the core components of RT-FD-SPT are systematically discussed in order to develop an understanding of the trade-offs that must be made in algorithm design and to create a clear picture of the important differences, advantages, and drawbacks of existing approaches. These components are feedback tracking and control, ranging from simple proportional-integral-derivative control to advanced nonlinear techniques, estimation to determine particle location from the measured data, including both online and offline algorithms, and techniques for calibrating and characterizing different RT-FD-SPT methods. Then a collection of metrics for RT-FD-SPT is introduced to help guide experimentalists in selecting a method for their particular application and to help reveal where there are gaps in the techniques that represent opportunities for further development. Finally, this review is concluded with a discussion on future perspectives in the field.

Reconfigurable Metalens with Phase-Change Switching between Beam Acceleration and Rotation for 3D Depth Imaging

Depth imaging is very important for many emerging technologies, such as artificial intelligence, driverless vehicles and facial recognition. However, all these applications demand compact and low-power systems that are beyond the capabilities of most state-of-art depth cameras. Recently, metasurface-based depth imaging that exploits point spread function (PSF) engineering has been demonstrated to be miniaturized and single shot without requiring active illumination or multiple viewpoint exposures. A pair of spatially adjacent metalenses with an extended depth-of-field (EDOF) PSF and a depth-sensitive double-helix PSF (DH-PSF) were used, using the former metalens to reconstruct clear images of each depth and the latter to accurately estimate depth. However, due to these two metalenses being non-coaxial, parallax in capturing scenes is inevitable, which would limit the depth precision and field of view. In this work, a bifunctional reconfigurable metalens for 3D depth imaging was proposed by dynamically switching between EDOF-PSF and DH-PSF. Specifically, a polarization-independent metalens working at 1550 nm with a compact 1 mm2 aperture was realized, which can generate a focused accelerating beam and a focused rotating beam at the phase transition of crystalline and amorphous Ge2Sb2Te5 (GST), respectively. Combined with the deconvolution algorithm, we demonstrated the good capabilities of scene reconstruction and depth imaging using a theoretical simulation and achieved a depth measurement error of only 3.42%.

Imaging Dynamic Processes in Multiple Dimensions and Length Scales

Optical microscopy has become an invaluable tool for investigating complex samples. Over the years, many advances to optical microscopes have been made that have allowed us to uncover new insights into the samples studied. Dynamic changes in biological and chemical systems are of utmost importance to study. To probe these samples, multidimensional approaches have been developed to acquire a fuller understanding of the system of interest. These dimensions include the spatial information, such as the three-dimensional coordinates and orientation of the optical probes, and additional chemical and physical properties through combining microscopy with various spectroscopic techniques. In this review, we survey the field of multidimensional microscopy and provide an outlook on the field and challenges that may arise. Expected final online publication date for the Annual Review of Physical Chemistry, Volume 73 is April 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

A guide for single-particle chromatin tracking in live cell nuclei

The emergence of labeling strategies and live cell imaging methods enables the imaging of chromatin in living cells at single digit nanometer resolution as well as milliseconds temporal resolution. These technical breakthroughs revolutionize our understanding of chromatin structure, dynamics and functions. Single molecule tracking algorithms are usually preferred to quantify the movement of these intranucleus elements to interpret the spatiotemporal evolution of the chromatin. In this review, we will first summarize the fluorescent labeling strategy of chromatin in live cells which will be followed by a sys-tematic comparison of live cell imaging instrumentation. With the proper microscope, we will discuss the image analysis pipelines to extract the biophysical properties of the chromatin. Finally, we expect to give practical suggestions to broad biologists on how to select methods and link to the model properly according to different investigation pur-poses. This article is protected by copyright. All rights reserved.

High-axial-resolution single-molecule localization under dense excitation with a multi-channel deep U-Net

Single-molecule localization microscopy (SMLM) can bypass the diffraction limit of optical microscopes and greatly improve the resolution in fluorescence microscopy. By introducing the point spread function (PSF) engineering technique, we can customize depth varying PSF to achieve higher axial resolution. However, most existing 3D single-molecule localization algorithms require excited fluorescent molecules to be sparse and captured at high signal-to-noise ratios, which results in a long acquisition time and precludes SMLM's further applications in many potential fields. To address this problem, we propose a novel 3D single-molecular localization method based on a multi-channel neural network based on U-Net. By leveraging the deep network's great advantages in feature extraction, the proposed network can reliably discriminate dense fluorescent molecules with overlapped PSFs and corrupted by sensor noise. Both simulated and real experiments demonstrate its superior performance in PSF engineered microscopes with short exposure and dense excitations, which holds great potential in fast 3D super-resolution microscopy.

Targeted Nanoscale 3D Thermal Imaging of Tumor Cell Surface with Functionalized Quantum Dots

Measuring the changes in tumor cell surface temperature can provide insights into cellular metabolism and pathological features, which is significant for targeted chemotherapy and hyperthermic therapy. However, conventional micro-nano scale methods are invasive and can only measure the temperature of cells across a single plane, which excludes specific organelles. In this study, fluorescence quantum dots (QDs) are functionalized with the membrane transport protein transferrin (Tf) as a thermo-sensor specific for tumor cell membrane. The covalent conjugation is optimized to maintain the relative fluorescence intensity of the Tf-QDs to >90%. In addition, the Tf-QDs undergo changes in the fluorescence spectra as a function of temperature, underscoring its thermo-sensor function. Double helix point spread function imaging optical path is designed to locate the probe at nanoscale, and 3D thermal imaging technology is proposed to measure the local temperature distribution and direction of heat flux on the tumor cell surface. This novel targeted nanoscale 3D thermometry method can be a highly promising tool for measuring the local and global temperature distribution across intracellular organelles.

Computationally-efficient spatiotemporal correlation analysis super-resolves anomalous diffusion

Anomalous diffusion dynamics in confined nanoenvironments govern the macroscale properties and interactions of many biophysical and material systems. Currently, it is difficult to quantitatively link the nanoscale structure of porous media to anomalous diffusion within them. Fluorescence correlation spectroscopy super-resolution optical fluctuation imaging (fcsSOFI) has been shown to extract nanoscale structure and Brownian diffusion dynamics within gels, liquid crystals, and polymers, but has limitations which hinder its wider application to more diverse, biophysically-relevant datasets. Here, we parallelize the least-squares curve fitting step on a GPU improving computation times by up to a factor of 40, implement anomalous diffusion and two-component Brownian diffusion models, and make fcsSOFI more accessible by packaging it in a user-friendly GUI. We apply fcsSOFI to simulations of the protein fibrinogen diffusing in polyacrylamide of varying matrix densities and super-resolve locations where slower, anomalous diffusion occurs within smaller, confined pores. The improvements to fcsSOFI in speed, scope, and usability will allow for the wider adoption of super-resolution correlation analysis to diverse research topics.

Fundamental precision bounds for three-dimensional optical localization microscopy using self-interference digital holography

Localization based microscopy using self-interference digital holography (SIDH) provides three-dimensional (3D) positional information about point sources with nanometer scale precision. To understand the performance limits of SIDH, here we calculate the theoretical limit to localization precision for SIDH when designed with two different configurations. One configuration creates the hologram using a plane wave and a spherical wave while the second configuration creates the hologram using two spherical waves. We further compare the calculated precision bounds to the 3D single molecule localization precision from different Point Spread Functions. SIDH results in almost constant localization precision in all three dimensions for a 20 µm thick depth of field. For high signal-to-background ratio (SBR), SIDH on average achieves better localization precision. For lower SBR values, the large size of the hologram on the detector becomes a problem, and PSF models perform better.

Controlling microgel deformation via deposition method and surface functionalization of solid supports

Soft matter at solid-liquid interfaces plays an important role in multiple scientific disciplines as well as in various technological fields. For microgels, representing highly interesting soft matter systems, we demonstrate that the preparation method, i.e. the way how the microgel is applied to the specific surface, plays a key role. Focusing on the three most common sample preparation methods (spin-coating, drop-casting and adsorption from solution), we performed a comparative study of the deformation behavior of microgels at the solid-liquid interface on three different surfaces with varying hydrophilicities. For in situ visualization of the deformation of pNIPMAM microgels, we conducted highly sensitive 3D super resolution fluorescence microscopy methods. We furthermore performed complementary molecular dynamics simulations to determine the driving force responsible for the deformation depending on the surface and the deposition method. The combination of experiments and simulations revealed that the simulated equilibrium structure obtained after simulation of the completely dry microgel after deposition is retained after rehydration and subsequent fluorescent imaging.

Effect of Pixelation on the Parameter Estimation of Single Molecule Trajectories

The advent of single molecule microscopy has revolutionized biological investigations by providing a powerful tool for the study of intercellular and intracellular trafficking processes of protein molecules which was not available before through conventional microscopy. In practice, pixelated detectors are used to acquire the images of fluorescently labeled objects moving in cellular environments. Then, the acquired fluorescence microscopy images contain the numbers of the photons detected in each pixel, during an exposure time interval. Moreover, instead of having the exact locations of detection of the photons, we only know the pixel areas in which the photons impact the detector. These challenges make the analysis of single molecule trajectories, from pixelated images, a complex problem. Here, we investigate the effect of pixelation on the parameter estimation of single molecule trajectories. In particular, we develop a stochastic framework to calculate the maximum likelihood estimates of the parameters of a stochastic differential equation that describes the motion of the molecule in living cells. We also calculate the Fisher information matrix for this parameter estimation problem. The analytical results are complicated through the fact that the observation process in a microscope prohibits the use of standard Kalman filter type approaches. The analytical framework presented here is illustrated with examples of low photon count scenarios for which we rely on Monte Carlo methods to compute the associated probability distributions.

Transforming Separation Science with Single-Molecule Methods

Empirical optimization of the multiscale parameters underlying chromatographic and membrane separations leads to enormous resource waste and production costs. A bottom-up approach to understand the physical phenomena underlying challenges in separations is possible with single-molecule observations of solute-stationary phase interactions. We outline single-molecule fluorescence techniques that can identify key interactions under ambient conditions. Next, we describe how studying increasingly complex samples heightens the relevance of single-molecule results to industrial applications. Finally, we illustrate how separation methods that have not been studied at the single-molecule scale can be advanced, using chiral chromatography as an example case. We hope new research directions based on a molecular approach to separations will emerge based on the ideas, technologies, and open scientific questions presented in this Perspective.

Fast-tracking of single emitters in large volumes with nanometer precision

Multifocal plane microscopy allows for capturing images at different focal planes simultaneously. Using a proprietary prism which splits the emitted light into paths of different lengths, images at 8 different focal depths were obtained, covering a volume of 50x50x4 µm³. The position of single emitters was retrieved using a phasor-based approach across the different imaging planes, with better than 10 nm precision in the axial direction. We validated the accuracy of this approach by tracking fluorescent beads in 3D to calculate water viscosity. The fast acquisition rate (>100 fps) also enabled us to follow the capturing of 0.2 µm fluorescent beads into an optical trap.

Three-Dimensional Single Particle Tracking and Its Applications in Confined Environments

Single particle tracking (SPT) has proven to be a powerful technique in studying molecular dynamics in complicated systems. We review its recent development, including three-dimensional (3D) SPT and its applications in probing nanostructures and molecule-surface interactions that are important to analytical chemical processes. Several frequently used 3D SPT techniques are introduced. Especially of interest are those based on point spread function engineering, which are simple in instrumentation and can be easily adapted and used in analytical labs. Corresponding data analysis methods are briefly discussed. We present several important case studies, with a focus on probing mass transport and molecule-surface interactions in confined environments. The presented studies demonstrate the great potential of 3D SPT for understanding fundamental phenomena in confined space, which will enable us to predict basic principles involved in chemical recognition, separation, and analysis, and to optimize mass transport and responses by structural design and optimization.

Hybrid multifocal structured illumination microscopy with enhanced lateral resolution and axial localization capability

Super-resolution (SR) fluorescence microscopy that breaks through the diffraction barrier has drawn great interest in biomedical research. However, obtaining a high precision three-dimensional distribution of the specimen in a short time still remains a challenging task for existing techniques. In this paper, we propose a super-resolution fluorescence microscopy with axial localization capability by combining multifocal structured illumination microscopy with a hybrid detection PSF composed of a Gaussian PSF and a double-helix PSF. A modified reconstruction scheme is presented to accommodate the new hybrid PSF. This method can not only recover the lateral super-resolution image of the specimen but also retain the specimen's depth map within a range of 600 nm with an axial localization precision of 20.8 nm. The performance of this approach is verified by testing fluorescent beads and tubulin in 293-cells. The developed microscope is well suited for observing the precise 3D distribution of thin specimens.

Three dimensional spatiotemporal nano-scale position retrieval of the confined diffusion of nano-objects inside optofluidic microstructured fibers

Understanding the dynamics of single nano-scale species at high spatiotemporal resolution is of utmost importance within fields such as bioanalytics or microrheology. Here we introduce the concept of axial position retrieval via scattered light at evanescent fields inside a corralled geometry using optofluidic microstructured optical fibers allowing to unlock information about diffusing nano-scale objects in all three spatial dimensions at kHz acquisition rate for several seconds. Our method yields the lateral positions by localizing the particle in a wide-field microscopy image. In addition, the axial position is retrieved via the scattered light intensity of the particle, as a result of the homogenized evanescent fields inside a microchannel running parallel to an optical core. This method yields spatial localization accuracies <3 nm along the transverse and <21 nm along the retrieved directions. Due to its unique properties such as three dimensional tracking, straightforward operation, mechanical flexibility, strong confinement, fast and efficient data recording, long observation times, low background scattering, and compatibility with microscopy and fiber circuitry, our concept represents a new paradigm in light-based nanoscale detection techniques, extending the capabilities of the field of nanoparticle tracking analysis and potentially allowing for the observation of so far inaccessible processes at the nanoscale level.

Single-Virus Tracking: From Imaging Methodologies to Virological Applications

Uncovering the mechanisms of virus infection and assembly is crucial for preventing the spread of viruses and treating viral disease. The technique of single-virus tracking (SVT), also known as single-virus tracing, allows one to follow individual viruses at different parts of their life cycle and thereby provides dynamic insights into fundamental processes of viruses occurring in live cells. SVT is typically based on fluorescence imaging and reveals insights into previously unreported infection mechanisms. In this review article, we provide the readers a broad overview of the SVT technique. We first summarize recent advances in SVT, from the choice of fluorescent labels and labeling strategies to imaging implementation and analytical methodologies. We then describe representative applications in detail to elucidate how SVT serves as a valuable tool in virological research. Finally, we present our perspectives regarding the future possibilities and challenges of SVT.

Deformation of Microgels at Solid-Liquid Interfaces Visualized in Three-Dimension

Solid-liquid interfaces play an important role for functional devices. Hence, a detailed understanding of the interaction of soft matter objects with solid supports and of the often concomitant structural deformations is of great importance. We address this topic in a combined experimental and simulation approach. We investigated thermoresponsive poly(N-isopropylmethacrylamide) microgels (μGs) at different surfaces in an aqueous environment. As super-resolution fluorescence imaging method, three-dimensional direct stochastical optical reconstruction microscopy (dSTORM) allowed for visualizing μGs in their three-dimensional (3D) shape, for example, in a "fried-egg" conformation depending on the hydrophilicity of the surface (strength of adsorption). The 3D shape, as defined by point clouds obtained from single-molecule localizations, was analyzed. A new fitting algorithm yielded an isosurface of constant density which defines the deformation of μGs at the different surfaces. The presented methodology quantifies deformation of objects with fuzzy surfaces and allows for comparison of their structures, whereby it is completely independent from the data acquisition method. Finally, the experimental data are complemented with mesoscopic computer simulations in order to (i) rationalize the experimental results and (ii) to track the evolution of the shape with changing surface hydrophilicity; a good correlation of the shapes obtained experimentally and with computer simulations was found.

Computational correction of spatially variant optical aberrations in 3D single-molecule localization microscopy

3D single-molecule localization microscopy relies on fitting the shape of point-spread-functions (PSFs) recorded on a wide-field detector. However, optical aberrations distort those shapes, which compromises the accuracy and precision of single-molecule localization microscopy. Here, we employ a computational phase retrieval based on a vectorial PSF model to quantify the spatial variance of optical aberrations in a two-channel ultrawide-field single-molecule localization microscope. The use of a spatially variant PSF model enables accurate and precise emitter localization in x-, y- and z-directions throughout the entire field of view.

Resolving Cytosolic Diffusive States in Bacteria by Single-Molecule Tracking

The trajectory of a single protein in the cytosol of a living cell contains information about its molecular interactions in its native environment. However, it has remained challenging to accurately resolve and characterize the diffusive states that can manifest in the cytosol using analytical approaches based on simplifying assumptions. Here, we show that multiple intracellular diffusive states can be successfully resolved if sufficient single-molecule trajectory information is available to generate well-sampled distributions of experimental measurements and if experimental biases are taken into account during data analysis. To address the inherent experimental biases in camera-based and MINFLUX-based single-molecule tracking, we use an empirical data analysis framework based on Monte Carlo simulations of confined Brownian motion. This framework is general and adaptable to arbitrary cell geometries and data acquisition parameters employed in two-dimensional or three-dimensional single-molecule tracking. We show that, in addition to determining the diffusion coefficients and populations of prevalent diffusive states, the timescales of diffusive state switching can be determined by stepwise increasing the time window of averaging over subsequent single-molecule displacements. Time-averaged diffusion analysis of single-molecule tracking data may thus provide quantitative insights into binding and unbinding reactions among rapidly diffusing molecules that are integral for cellular functions.

Revealing Nanoscale Morphology of the Primary Cilium Using Super-Resolution Fluorescence Microscopy

Super-resolution (SR) microscopy has been used to observe structural details beyond the diffraction limit of ∼250 nm in a variety of biological and materials systems. By combining this imaging technique with both computer-vision algorithms and topological methods, we reveal and quantify the nanoscale morphology of the primary cilium, a tiny tubular cellular structure (∼2-6 μm long and 200-300 nm in diameter). The cilium in mammalian cells protrudes out of the plasma membrane and is important in many signaling processes related to cellular differentiation and disease. After tagging individual ciliary transmembrane proteins, specifically Smoothened, with single fluorescent labels in fixed cells, we use three-dimensional (3D) single-molecule SR microscopy to determine their positions with a precision of 10-25 nm. We gain a dense, pointillistic reconstruction of the surfaces of many cilia, revealing large heterogeneity in membrane shape. A Poisson surface reconstruction algorithm generates a fine surface mesh, allowing us to characterize the presence of deformations by quantifying the surface curvature. Upon impairment of intracellular cargo transport machinery by genetic knockout or small-molecule treatment of cells, our quantitative curvature analysis shows significant morphological differences not visible by conventional fluorescence microscopy techniques. Furthermore, using a complementary SR technique, two-color, two-dimensional stimulated emission depletion microscopy, we find that the cytoskeleton in the cilium, the axoneme, also exhibits abnormal morphology in the mutant cells, similar to our 3D results on the Smoothened-measured ciliary surface. Our work combines 3D SR microscopy and computational tools to quantitatively characterize morphological changes of the primary cilium under different treatments and uses stimulated emission depletion to discover correlated changes in the underlying structure. This approach can be useful for studying other biological or nanoscale structures of interest.

Single Quantum Dot Tracking Illuminates Neuroscience at the Nanoscale

The use of nanometer-sized semiconductor crystals, known as quantum dots, allows us to directly observe individual biomolecular transactions through a fluorescence microscope. Here, we review the evolution of single quantum dot tracking over the past two decades, highlight key biophysical discoveries facilitated by quantum dots, briefly discuss biochemical and optical implementation strategies for a single quantum dot tracking experiment, and report recent accomplishments of our group at the interface of molecular neuroscience and nanoscience.

Light sheet approaches for improved precision in 3D localization-based super-resolution imaging in mammalian cells [Invited]

The development of imaging techniques beyond the diffraction limit has paved the way for detailed studies of nanostructures and molecular mechanisms in biological systems. Imaging thicker samples, such as mammalian cells and tissue, in all three dimensions, is challenging due to increased background and volumes to image. Light sheet illumination is a method that allows for selective irradiation of the image plane, and its inherent optical sectioning capability allows for imaging of biological samples with reduced background, photobleaching, and photodamage. In this review, we discuss the advantage of combining single-molecule imaging with light sheet illumination. We begin by describing the principles of single-molecule localization microscopy and of light sheet illumination. Finally, we present examples of designs that successfully have married single-molecule super-resolution imaging with light sheet illumination for improved precision in mammalian cells.

Tilted Light Sheet Microscopy with 3D Point Spread Functions for Single-Molecule Super-Resolution Imaging in Mammalian Cells

To obtain a complete picture of subcellular nanostructures, cells must be imaged with high resolution in all three dimensions (3D). Here, we present tilted light sheet microscopy with 3D point spread functions (TILT3D), an imaging platform that combines a novel, tilted light sheet illumination strategy with engineered long axial range point spread functions (PSFs) for low-background, 3D super localization of single molecules as well as 3D super-resolution imaging in thick cells. TILT3D is built upon a standard inverted microscope and has minimal custom parts. The axial positions of the single molecules are encoded in the shape of the PSF rather than in the position or thickness of the light sheet, and the light sheet can therefore be formed using simple optics. The result is flexible and user-friendly 3D super-resolution imaging with tens of nm localization precision throughout thick mammalian cells. We validated TILT3D for 3D super-resolution imaging in mammalian cells by imaging mitochondria and the full nuclear lamina using the double-helix PSF for single-molecule detection and the recently developed Tetrapod PSF for fiducial bead tracking and live axial drift correction. We envision TILT3D to become an important tool not only for 3D super-resolution imaging, but also for live whole-cell single-particle and single-molecule tracking.

3D single-molecule super-resolution microscopy with a tilted light sheet

Tilted light sheet microscopy with 3D point spread functions (TILT3D) combines a novel, tilted light sheet illumination strategy with long axial range point spread functions (PSFs) for low-background, 3D super-localization of single molecules as well as 3D super-resolution imaging in thick cells. Because the axial positions of the single emitters are encoded in the shape of each single-molecule image rather than in the position or thickness of the light sheet, the light sheet need not be extremely thin. TILT3D is built upon a standard inverted microscope and has minimal custom parts. The result is simple and flexible 3D super-resolution imaging with tens of nm localization precision throughout thick mammalian cells. We validate TILT3D for 3D super-resolution imaging in mammalian cells by imaging mitochondria and the full nuclear lamina using the double-helix PSF for single-molecule detection and the recently developed tetrapod PSFs for fiducial bead tracking and live axial drift correction.

Single-molecule tracking in liveYersinia enterocoliticareveals distinct cytosolic complexes of injectisome subunits

Single-molecule tracking of bound (blue trajectories) and diffusive (red trajectories) injectisome subunits reveals the formation of distinct cytosolic complexes.

Three-Dimensional Tracking of Quantum Dot-Conjugated Molecules in Living Cells

Here, we describe protocols for three-dimensional tracking of single quantum dot-conjugated molecules with nanometer accuracy in living cells using conventional fluorescence microscopy. The technique exploits out-of-focus images of single emitters combined with an automated pattern-recognition open-source software that fits the images with proper model functions to extract the emitter coordinates. We describe protocols for targeting quantum dots to both membrane components and cytosolic proteins.

Mapping the Functional Tortuosity and Spatiotemporal Heterogeneity of Porous Polymer Membranes with Super-Resolution Nanoparticle Tracking

As particles flow through porous media, they follow complex pathways and experience heterogeneous environments that are challenging to characterize. Tortuosity is often used as a parameter to characterize the complexity of pathways in porous materials and is useful in understanding hindered mass transport in industrial filtration and mass separation processes. However, conventional calculations of tortuosity provide only average values under static conditions; they are insensitive to the intrinsic heterogeneity of porous media and do not account for potential effects of operating conditions. Here, we employ a high-throughput nanoparticle tracking method which enables the observation of actual particle trajectories in polymer membranes under relevant operating conditions. Our results indicate that tortuosity is not simply a structural material property but is instead a functional property that depends on flow rate and particle size. We also resolved the spatiotemporal heterogeneity of flowing particles in these porous media. The distributions of tortuosity and of local residence/retention times were surprisingly broad, exhibiting heavy tails representing a population of highly tortuous trajectories and local regions with anomalously long residence times. Interestingly, local tortuosity and residence times were directly correlated, suggesting the presence of highly confining regions that cause more meandering trajectories and longer retention times. The comprehensive information about tortuosity and spatiotemporal heterogeneity provided by these methods will advance the understanding of complex mass transport and assist rational design and synthesis of porous materials.

Three-Dimensional Super-resolution Imaging of Single Nanoparticles Delivered by Pipettes

Controlled three-dimensional positioning of nanoparticles is achieved by delivering single fluorescent nanoparticles from a nanopipette and capturing them at well-defined regions of an electrified substrate. To control the position of single nanoparticles, the force of the pressure-driven flow from the pipette is balanced by the attractive electrostatic force at the substrate, providing a strategy by which nanoparticle trajectories can be manipulated in real time. To visualize nanoparticle motion, a resistive-pulse electrochemical setup is coupled with an optical microscope, and nanoparticle trajectories are tracked in three dimensions using super-resolution fluorescence imaging to obtain positional information with precision in the tens of nanometers. As the particles approach the substrate, the diffusion kinetics are analyzed and reveal either subdiffusive (hindered) or superdiffusive (directed) motion depending on the electric field at the substrate and the pressure-driven flow from the pipette. By balancing the effects of the forces exerted on the particle by the pressure and electric fields, controlled, real-time manipulation of single nanoparticle trajectories is achieved. The developed approach has implications for a variety of applications such as surface patterning and drug delivery using colloidal nanoparticles.

Single Particle Tracking: From Theory to Biophysical Applications

After three decades of developments, single particle tracking (SPT) has become a powerful tool to interrogate dynamics in a range of materials including live cells and novel catalytic supports because of its ability to reveal dynamics in the structure-function relationships underlying the heterogeneous nature of such systems. In this review, we summarize the algorithms behind, and practical applications of, SPT. We first cover the theoretical background including particle identification, localization, and trajectory reconstruction. General instrumentation and recent developments to achieve two- and three-dimensional subdiffraction localization and SPT are discussed. We then highlight some applications of SPT to study various biological and synthetic materials systems. Finally, we provide our perspective regarding several directions for future advancements in the theory and application of SPT.

Three-Dimensional Super-Resolution in Eukaryotic Cells Using the Double-Helix Point Spread Function

Single-molecule localization microscopy, typically based on total internal reflection illumination, has taken our understanding of protein organization and dynamics in cells beyond the diffraction limit. However, biological systems exist in a complicated three-dimensional environment, which has required the development of new techniques, including the double-helix point spread function (DHPSF), to accurately visualize biological processes. The application of the DHPSF approach has so far been limited to the study of relatively small prokaryotic cells. By matching the refractive index of the objective lens immersion liquid to that of the sample media, we demonstrate DHPSF imaging of up to 15-μm-thick whole eukaryotic cell volumes in three to five imaging planes. We illustrate the capabilities of the DHPSF by exploring large-scale membrane reorganization in human T cells after receptor triggering, and by using single-particle tracking to image several mammalian proteins, including membrane, cytoplasmic, and nuclear proteins in T cells and embryonic stem cells.

Cytoplasmic RNA-Protein Particles Exhibit Non-Gaussian Subdiffusive Behavior

The cellular cytoplasm is a complex, heterogeneous environment (both spatially and temporally) that exhibits viscoelastic behavior. To further develop our quantitative insight into cellular transport, we analyze data sets of mRNA molecules fluorescently labeled with MS2-GFP tracked in real time in live Escherichia coli and Saccharomyces cerevisiae cells. As shown previously, these RNA-protein particles exhibit subdiffusive behavior that is viscoelastic in its origin. Examining the ensemble of particle displacements reveals a Laplace distribution at all observed timescales rather than the Gaussian distribution predicted by the central limit theorem. This ensemble non-Gaussian behavior is caused by a combination of an exponential distribution in the time-averaged diffusivities and non-Gaussian behavior of individual trajectories. We show that the non-Gaussian behavior is a consequence of significant heterogeneity between trajectories and dynamic heterogeneity along single trajectories. Informed by theory and simulation, our work provides an in-depth analysis of the complex diffusive behavior of RNA-protein particles in live cells.

Spiral phase mask shadow-imaging for 3D-measurement of flow fields

Particle tracking velocimetry (PTV) is a valuable tool for microfluidic analysis. Especially mixing processes and the environmental interaction of fluids on a microscopic scale are of particular importance for pharmaceutical and biomedical applications. However, currently applied techniques suffer from the lag of instantaneous depth information. Here we present a scan-free, shadow-imaging PTV-technique for 3D trajectory and velocity measurement of flow fields in micro-channels with 2 µm spatial resolution. By using an incoherent light source, one camera and a spatial light modulator (LCoS-SLM) that generates double-images of the seeding particle shadows, it is a simply applicable and highly scalable technique.

Super Temporal-Resolved Microscopy (STReM)

Super-resolution microscopy typically achieves high spatial resolution, but the temporal resolution remains low. We report super temporal-resolved microscopy (STReM) to improve the temporal resolution of 2D super-resolution microscopy by a factor of 20 compared to that of the traditional camera-limited frame rate. This is achieved by rotating a phase mask in the Fourier plane during data acquisition and then recovering the temporal information by fitting the point spread function (PSF) orientations. The feasibility of this technique is verified with both simulated and experimental 2D adsorption/desorption and 2D emitter transport. When STReM is applied to measure protein adsorption at a glass surface, previously unseen dynamics are revealed.

Live-cell single-molecule labeling and analysis of myosin motors with quantum dots

Quantum dots (QDs) are a powerful tool for quantitative biology, but two challenges are associated with using them to track intracellular molecules in live cells. A simple and convenient method is presented for labeling intracellular molecules by using HaloTag technology and electroporation and is used to successfully track myosins within live cells.

Quantum dots (QDs) are a powerful tool for quantitatively analyzing dynamic cellular processes by single-particle tracking. However, tracking of intracellular molecules with QDs is limited by their inability to penetrate the plasma membrane and bind to specific molecules of interest. Although several techniques for overcoming these problems have been proposed, they are either complicated or inconvenient. To address this issue, in this study, we developed a simple, convenient, and nontoxic method for labeling intracellular molecules in cells using HaloTag technology and electroporation. We labeled intracellular myosin motors with this approach and tracked their movement within cells. By simultaneously imaging myosin movement and F-actin architecture, we observed that F-actin serves not only as a rail but also as a barrier for myosin movement. We analyzed the effect of insulin on the movement of several myosin motors, which have been suggested to regulate intracellular trafficking of the insulin-responsive glucose transporter GLUT4, but found no significant enhancement in myosin motor motility as a result of insulin treatment. Our approach expands the repertoire of proteins for which intracellular dynamics can be analyzed at the single-molecule level.

Fast Three-Dimensional Single-Particle Tracking in Natural Brain Tissue

Observation of molecular dynamics is often biased by the optical very heterogeneous environment of cells and complex tissue. Here, we have designed an algorithm that facilitates molecular dynamic analyses within brain slices. We adjust fast astigmatism-based three-dimensional single-particle tracking techniques to depth-dependent optical aberrations induced by the refractive index mismatch so that they are applicable to complex samples. In contrast to existing techniques, our online calibration method determines the aberration directly from the acquired two-dimensional image stream by exploiting the inherent particle movement and the redundancy introduced by the astigmatism. The method improves the positioning by reducing the systematic errors introduced by the aberrations, and allows correct derivation of the cellular morphology and molecular diffusion parameters in three dimensions independently of the imaging depth. No additional experimental effort for the user is required. Our method will be useful for many imaging configurations, which allow imaging in deep cellular structures.

Fisher information theory for parameter estimation in single molecule microscopy: tutorial

Estimation of a parameter of interest from image data represents a task that is commonly carried out in single molecule microscopy data analysis. The determination of the positional coordinates of a molecule from its image, for example, forms the basis of standard applications such as single molecule tracking and localization-based super-resolution image reconstruction. Assuming that the estimator used recovers, on average, the true value of the parameter, its accuracy, or standard deviation, is then at best equal to the square root of the Cramér-Rao lower bound. The Cramér-Rao lower bound can therefore be used as a benchmark in the evaluation of the accuracy of an estimator. Additionally, as its value can be computed and assessed for different experimental settings, it is useful as an experimental design tool. This tutorial demonstrates a mathematical framework that has been specifically developed to calculate the Cramér-Rao lower bound for estimation problems in single molecule microscopy and, more broadly, fluorescence microscopy. The material includes a presentation of the photon detection process that underlies all image data, various image data models that describe images acquired with different detector types, and Fisher information expressions that are necessary for the calculation of the lower bound. Throughout the tutorial, examples involving concrete estimation problems are used to illustrate the effects of various factors on the accuracy of parameter estimation and, more generally, to demonstrate the flexibility of the mathematical framework.

Single-Molecule Tracking and Its Application in Biomolecular Binding Detection

In the past two decades significant advances have been made in single-molecule detection, which enables the direct observation of single biomolecules at work in real time and under physiological conditions. In particular, the development of single-molecule tracking (SMT) microscopy allows us to monitor the motion paths of individual biomolecules in living systems, unveiling the localization dynamics and transport modalities of the biomolecules that support the development of life. Beyond the capabilities of traditional camera-based tracking techniques, state-of-the-art SMT microscopies developed in recent years can record fluorescence lifetime while tracking a single molecule in the 3D space. This multiparameter detection capability can open the door to a wide range of investigations at the cellular or tissue level, including identification of molecular interaction hotspots and characterization of association/dissociation kinetics between molecules. In this review, we discuss various SMT techniques developed to date, with an emphasis on our recent development of the next generation 3D tracking system that not only achieves ultrahigh spatiotemporal resolution but also provides sufficient working depth suitable for live animal imaging. We also discuss the challenges that current SMT techniques are facing and the potential strategies to tackle those challenges.

Three-dimensional particle tracking via tunable color-encoded multiplexing

We present a novel 3D tracking approach capable of locating single particles with nanometric precision over wide axial ranges. Our method uses a fast acousto-optic liquid lens implemented in a bright field microscope to multiplex light based on color into different and selectable focal planes. By separating the red, green, and blue channels from an image captured with a color camera, information from up to three focal planes can be retrieved. Multiplane information from the particle diffraction rings enables precisely locating and tracking individual objects up to an axial range about 5 times larger than conventional single-plane approaches. We apply our method to the 3D visualization of the well-known coffee-stain phenomenon in evaporating water droplets.

Nanoscale three-dimensional single particle tracking by light-sheet-based double-helix point spread function microscopy

The double-helix point spread function (DH-PSF) microscopy has become an essential tool for nanoscale three-dimensional (3D) localization and tracking of single molecules in living cells. However, its localization precision is limited by fluorescent contrast in thick samples because the signal-to-noise ratio of the system is low due to the inherent low transfer function efficiency and background fluorescence. Here we combine DH-PSF microscopy with light-sheet illumination to eliminate out-of-focus background fluorescence for high-precision 3D single particle tracking. To demonstrate the capability of the method, we obtain the single fluorescent bead image with light-sheet illumination, with three-dimensional localization accuracy better than that of epi-illumination. We also show that the single fluorescent beads in agarose solution can be tracked, which demonstrates the possibility of our method for the study of dynamic processes in complex biological specimens.

Note: Time-gated 3D single quantum dot tracking with simultaneous spinning disk imaging

We describe recent upgrades to a 3D tracking microscope to include simultaneous Nipkow spinning disk imaging and time-gated single-particle tracking (SPT). Simultaneous 3D molecular tracking and spinning disk imaging enable the visualization of cellular structures and proteins around a given fluorescently labeled target molecule. The addition of photon time-gating to the SPT hardware improves signal to noise by discriminating against Raman scattering and short-lived fluorescence. In contrast to camera-based SPT, single-photon arrival times are recorded, enabling time-resolved spectroscopy (e.g., measurement of fluorescence lifetimes and photon correlations) to be performed during single molecule/particle tracking experiments.