Effects of fixed pattern noise on single molecule localization microscopy

Quality assessment in light microscopy for routine use through simple tools and robust metrics

Although there is a need to demonstrate reproducibility in light microscopy acquisitions, the lack of standardized guidelines monitoring microscope health status over time has so far impaired the widespread use of quality control (QC) measurements. As scientists from 10 imaging core facilities who encounter various types of projects, we provide affordable hardware and open source software tools, rigorous protocols, and define reference values to assess QC metrics for the most common fluorescence light microscopy modalities. Seven protocols specify metrics on the microscope resolution, field illumination flatness, chromatic aberrations, illumination power stability, stage drift, positioning repeatability, and spatial-temporal noise of camera sensors. We designed the MetroloJ_QC ImageJ/Fiji Java plugin to incorporate the metrics and automate analysis. Measurements allow us to propose an extensive characterization of the QC procedures that can be used by any seasoned microscope user, from research biologists with a specialized interest in fluorescence light microscopy through to core facility staff, to ensure reproducible and quantifiable microscopy results.

A gain series method for accurate EMCCD calibration

Calibration of the gain and digital conversion factor of an EMCCD is necessary for accurate photon counting. We present a new method to quickly calibrate multiple gain settings of an EMCCD camera. Acquiring gain-series calibration data and analyzing the resulting images with the EMCCD noise model more accurately estimates the gain response of the camera. Furthermore, we develop a method to compare the results from different calibration approaches. Gain-series calibration outperforms all other methods in this self-consistency test.

Improving spatial precision and field-of-view in wavelength-tagged single-particle tracking using spectroscopic single-molecule localization microscopy

Spectroscopic single-molecule localization microscopy (sSMLM) generates super-resolution images of single molecules while simultaneously capturing the spectra of their fluorescence emissions. However, sSMLM splits photons from single-molecule emissions into a spatial channel and a spectral channel, reducing both channels' precisions. It is also challenging in transmission grating-based sSMLM to achieve a large field-of-view (FOV) and avoid overlap between the spatial and spectral channels. The challenge in FOV has further significance in single-molecule tracking applications. In this work, we analyzed the correlation between the spatial and spectral channels in sSMLM to improve its spatial precision, and we developed a split-mirror assembly to enlarge its FOV. We demonstrate the benefits of these improvements by tracking quantum dots. We also show that we can reduce particle-identification ambiguity by tagging each particle with its unique spectral characteristics.

Characterizing and correcting camera noise in back-illuminated sCMOS cameras

With promising properties of fast imaging speed, large field-of-view, relative low cost and many others, back-illuminated sCMOS cameras have been receiving intensive attention for low light level imaging in the past several years. However, due to the pixel-to-pixel difference of camera noise (called noise non-uniformity) in sCMOS cameras, researchers may hesitate to use them in some application fields, and sometimes wonder whether they should optimize the noise non-uniformity of their sCMOS cameras before using them in a specific application scenario. In this paper, we systematically characterize the impact of different types of sCMOS noise on image quality and perform corrections to these types of sCMOS noise using three representative algorithms (PURE, NCS and MLE_sCMOS). We verify that it is possible to use appropriate correction methods to push the non-uniformity of major types of camera noise, including readout noise, offset, and photon response, to a satisfactory level for conventional microscopy and single molecule localization microscopy. We further find out that, after these corrections, global read noise becomes a major concern that limits the imaging performance of back-illuminated sCMOS cameras. We believe this study provides new insights into the understanding of camera noise in back-illuminated sCMOS cameras, and also provides useful information for future development of this promising camera technology.

Rethinking resolution estimation in fluorescence microscopy: from theoretical resolution criteria to super-resolution microscopy

Resolution is undoubtedly the most important parameter in optical microscopy by providing an estimation on the maximum resolving power of a certain optical microscope. For centuries, the resolution of an optical microscope is generally considered to be limited only by the numerical aperture of the optical system and the wavelength of light. However, since the invention and popularity of various advanced fluorescence microscopy techniques, especially super-resolution fluorescence microscopy, many new methods have been proposed for estimating the resolution, leading to confusions for researchers who need to quantify the resolution of their fluorescence microscopes. In this paper, we firstly summarize the early concepts and criteria for predicting the resolution limit of an ideal optical system. Then, we discuss some important influence factors that deteriorate the resolution of a certain fluorescence microscope. Finally, we provide methods and examples on how to measure the resolution of a fluorescence microscope from captured fluorescence images. This paper aims to answer as best as possible the theoretical and practical issues regarding the resolution estimation in fluorescence microscopy.

Symmetrically dispersed spectroscopic single-molecule localization microscopy

Spectroscopic single-molecule localization microscopy (sSMLM) was used to achieve simultaneous imaging and spectral analysis of single molecules for the first time. Current sSMLM fundamentally suffers from a reduced photon budget because the photons from individual stochastic emissions are divided into spatial and spectral channels. Therefore, both spatial localization and spectral analysis only use a portion of the total photons, leading to reduced precisions in both channels. To improve the spatial and spectral precisions, we present symmetrically dispersed sSMLM, or SDsSMLM, to fully utilize all photons from individual stochastic emissions in both spatial and spectral channels. SDsSMLM achieved 10-nm spatial and 0.8-nm spectral precisions at a total photon budget of 1000. Compared with the existing sSMLM using a 1:3 splitting ratio between spatial and spectral channels, SDsSMLM improved the spatial and spectral precisions by 42% and 10%, respectively, under the same photon budget. We also demonstrated multicolour imaging of fixed cells and three-dimensional single-particle tracking using SDsSMLM. SDsSMLM enables more precise spectroscopic single-molecule analysis in broader cell biology and material science applications.

Theoretical analysis of spectral precision in spectroscopic single-molecule localization microscopy

Spectroscopic single-molecule localization microscopy (sSMLM) is a novel super-resolution imaging technology, which simultaneously records the nanoscopic location and the corresponding full emission spectrum of every stochastic single-molecule emission event. This spectroscopic imaging capability of sSMLM necessitates the establishment of a theoretical foundation of the newly introduced spectral precision and to guide the system design and optimization. Based on numerical simulation and analytical solution, we introduced such a theoretical model to analyze spectral precision by considering the main system parameters, including signal and background shot noises, readout noise, and the spectral calibration procedure. Using this model, we demonstrated the delicate balance among these parameters in achieving the optimal spectral precision and discovered that the best spectral precision can only be achieved at a particular system spectral dispersion. For example, with a given signal of 3000 photons and a readout noise of 2 e-, a system spectral dispersion of 1.6 nm/pixel is required for sSMLM to achieve the highest spectral precision of 1.31 nm.

Subnanometer localization accuracy in widefield optical microscopy

The common assumption that precision is the limit of accuracy in localization microscopy and the typical absence of comprehensive calibration of optical microscopes lead to a widespread issue-overconfidence in measurement results with nanoscale statistical uncertainties that can be invalid due to microscale systematic errors. In this article, we report a comprehensive solution to this underappreciated problem. We develop arrays of subresolution apertures into the first reference materials that enable localization errors approaching the atomic scale across a submillimeter field. We present novel methods for calibrating our microscope system using aperture arrays and develop aberration corrections that reach the precision limit of our reference materials. We correct and register localization data from multiple colors and test different sources of light emission with equal accuracy, indicating the general applicability of our reference materials and calibration methods. In a first application of our new measurement capability, we introduce the concept of critical-dimension localization microscopy, facilitating tests of nanofabrication processes and quality control of aperture arrays. In a second application, we apply these stable reference materials to answer open questions about the apparent instability of fluorescent nanoparticles that commonly serve as fiducial markers. Our study establishes a foundation for subnanometer localization accuracy in widefield optical microscopy.

Quantitative performance evaluation of a back-illuminated sCMOS camera with 95% QE for super-resolution localization microscopy

Scientific Complementary Metal Oxide Semiconductor (sCMOS) cameras were introduced into the market in 2009 and are now becoming a major type of commercial cameras for low-light imaging. sCMOS cameras provide simultaneously low read noise, high readout speed, and large pixel array; however, the relatively low quantum efficiency (QE) of sCMOS cameras has been a major limitation for its application in single molecule imaging, especially super-resolution localization microscopy which requires high detection sensitivity. Here we report the imaging performance of a newly released back-illuminated sCMOS camera (called Dhyana 95 from Tucsen) which is claimed to be the world's first 95% QE sCMOS camera. The imaging performance evaluation is based on a new methodology which is designed to provide paired images from two tested cameras under almost identical experimental conditions. We verified that this new 95% QE sCMOS camera is able to provide superior imaging performance over a representative front-illuminated sCMOS camera (Hamamatsu Flash 4.0 V2) and a popular back-illuminated EMCCD camera (Andor iXon 897 Ultra) in a wide signal range. We hope this study will inspire more studies on using sCMOS cameras in super-resolution localization microscopy, or even single molecule imaging. © 2017 International Society for Advancement of Cytometry.

A Simple Marker-Assisted 3D Nanometer Drift Correction Method for Superresolution Microscopy

High-precision fluorescence microscopy such as superresolution imaging or single-particle tracking often requires an online drift correction method to maintain the stability of the three-dimensional (3D) position of the sample at a nanometer precision throughout the entire data acquisition process. Current online drift correction methods require modification of the existing two-dimensional (2D) fluorescence microscope with additional optics and detectors, which can be cumbersome and limit its use in many biological laboratories. Here we report a simple marker-assisted online drift correction method in which all 3D positions can be derived from fiducial markers on the coverslip of the sample on a standard 2D fluorescence microscope without additional optical components. We validate this method by tracking the long-term 3D stability of single-molecule localization microscopy at a precision of <2 and 5 nm in the lateral and axial dimension, respectively. We then provide three examples to evaluate the performance of the marker-assisted drift correction method. Finally, we give an example of a biological application of superresolution imaging of spatiotemporal alteration for a DNA replication structure with both low-abundance newly synthesized DNAs at the early onset of DNA synthesis and gradually condensed DNA structures during DNA replication. Using an isogenic breast cancer progression cell line model that recapitulates normal-like, precancerous, and tumorigenic stages, we characterize a distinction in the DNA replication process in normal, precancerous, and tumorigenic cells.

Centroid precision and orientation precision of planar localization microscopy

The concept of localization precision, which is essential to localization microscopy, is formally extended from optical point sources to microscopic rigid bodies. Measurement functions are presented to calculate the planar pose and motion of microscopic rigid bodies from localization microscopy data. Physical lower bounds on the associated uncertainties - termed centroid precision and orientation precision - are derived analytically in terms of the characteristics of the optical measurement system and validated numerically by Monte Carlo simulations. The practical utility of these expressions is demonstrated experimentally by an analysis of the motion of a microelectromechanical goniometer indicated by a sparse constellation of fluorescent nanoparticles. Centroid precision and orientation precision, as developed here, are useful concepts due to the generality of the expressions and the widespread interest in localization microscopy for super-resolution imaging and particle tracking.

Superior performance with sCMOS over EMCCD in super-resolution optical fluctuation imaging

Super-resolution optical fluctuation imaging (SOFI) is a fast and low-cost live-cell optical nanoscopy for extracting subdiffraction information from the statistics of fluorescence intensity fluctuation. As SOFI is based on the fluctuation statistics, rather than the detection of single molecules, it poses unique requirements for imaging detectors, which still lack a systematic evaluation. Here, we analyze the influences of pixel sizes, frame rates, noise levels, and different gains in SOFI with simulations and experimental tests. Our analysis shows that the smaller pixel size and faster readout speed of scientific-grade complementary metal oxide semiconductor (sCMOS) enables SOFI to achieve high spatiotemporal resolution with a large field-of-view, which is especially beneficial for live-cell super-resolution imaging. Overall, as the performance of SOFI is relatively insensitive to the signal-to-noise ratio (SNR), the gain in pixel size and readout speed exceeds the loss in SNR, indicating sCMOS is superior to electron multiplying charge coupled device in context to SOFI in many cases. Super-resolution imaging of cellular microtubule structures with high-order SOFI is experimentally demonstrated at large field-of-view, taking advantage of the large pixel number and fast frame rate of sCMOS cameras.

Single-molecule localization software applied to photon counting imaging

Centroiding in photon counting imaging has traditionally been accomplished by a single-step, noniterative algorithm, often implemented in hardware. Single-molecule localization techniques in superresolution fluorescence microscopy are conceptually similar, but use more sophisticated iterative software-based fitting algorithms to localize the fluorophore. Here, we discuss common features and differences between single-molecule localization and photon counting imaging and investigate the suitability of single-molecule localization software for photon event localization. We find that single-molecule localization software packages designed for superresolution microscopy-QuickPALM, rapidSTORM, and ThunderSTORM-can work well when applied to photon counting imaging with a microchannel-plate-based intensified camera system: photon event recognition can be excellent, fixed pattern noise can be low, and the microchannel plate pores can easily be resolved.