Real-time electron clustering in an event-driven hybrid pixel detector

Event-driven hybrid pixel detectors with nanosecond time resolution have opened up novel pathways in modern ultrafast electron microscopy, for example in hyperspectral electron-energy loss spectroscopy or free-electron quantum optics. However, the impinging electrons typically excite more than one pixel of the device, and an efficient algorithm is therefore needed to convert the measured pixel hits to real single-electron events. Here we present a robust clustering algorithm that is fast enough to find clusters in a continuous stream of raw data in real time. Each tuple of position and arrival time from the detector is continuously compared to a buffer of previous hits until the probability of a merger with an old event becomes irrelevant. In this way, the computation time becomes independent of the density of electron arrival and the algorithm does not break the operation chain. We showcase the performance of the algorithm with a 'timepix' camera in two regimes of electron microscopy, in continuous beam emission and laser-triggered femtosecond mode.

Multi-scale time-resolved electron diffraction: A case study in moiré materials

Ultrafast-optical-pump - structural-probe measurements, including ultrafast electron and x-ray scattering, provide direct experimental access to the fundamental timescales of atomic motion, and are thus foundational techniques for studying matter out of equilibrium. High-performance detectors are needed in scattering experiments to obtain maximum scientific value from every probe particle. We deploy a hybrid pixel array direct electron detector to perform ultrafast electron diffraction experiments on a WSe2/MoSe2 2D heterobilayer, resolving the weak features of diffuse scattering and moiré superlattice structure without saturating the zero order peak. Enabled by the detector's high frame rate, we show that a chopping technique provides diffraction difference images with signal-to-noise at the shot noise limit. Finally, we demonstrate that a fast detector frame rate coupled with a high repetition rate probe can provide continuous time resolution from femtoseconds to seconds, enabling us to perform a scanning ultrafast electron diffraction experiment that maps thermal transport in WSe2/MoSe2 and resolves distinct diffusion mechanisms in space and time.

Effect of self and extrinsic encapsulation on electron resilience of porous 2D polymer nanosheets

Despite the exceptional resolution in aberration-corrected high-resolution transmission electron microscope (AC-HRTEM) images of inorganic two-dimensional (2D) materials, achieving high-resolution imaging of organic 2D materials remains a daunting challenge due to their low electron resilience. Optimizing the critical dose (the electron exposure, the material can accept before it is noticeably damaged) is vital to mitigate this challenge. An understanding of electron resilience in porous crystalline 2D polymers including the effect of sample thickness has not been derived thus far. It is assumed, that additional layers of the sample form a cage around inner layers, which are preventing fragments from escaping into the vacuum and enabling recombination. In the literature this so called caging effect has been reported for perylene and pythalocyanine. In this work we determine the critical dose of a porous, triazine-based 2D polymer as function of the sample thickness. The results show that the caging effect should not be generalized to more sophisticated polymer systems. We argue that pore channels in the framework structure serve as escape routes for free fragments preventing the caging effect and thus showing surprisingly a thickness-independent critical dose. Moreover, we demonstrate that graphene encapsulation prevents fragment escape and results in an increase in the critical electron dose and unit-cell image resolution.

Characterization of a Timepix detector for use in SEM acceleration voltage range

Hybrid pixel direct electron detectors are gaining popularity in electron microscopy due to their excellent properties. Some commercial cameras based on this technology are relatively affordable which makes them attractive tools for experimentation especially in combination with an SEM setup. To support this, a detector characterization (Modulation Transfer Function, Detective Quantum Efficiency) of an Advacam Minipix and Advacam Advapix detector in the 15-30 keV range was made. In the current work we present images of Point Spread Function, plots of MTF/DQE curves and values of DQE(0) for these detectors. At low beam currents, the silicon detector layer behaviour should be dominant, which could make these findings transferable to any other available detector based on either Medipix2, Timepix or Timepix3 provided the same detector layer is used.

Evaluating direct detection detectors for short-range order characterization of amorphous materials by electron scattering

The introduction of direct electron detectors (DEDs) to transmission electron microscopy has set off the 'resolution revolution', especially for cryoTEM low-dose imaging of soft matter. In comparison to traditional indirect electron detectors such as Charged-Coupled Devices (CCD), DEDs show an improved modulation transfer function (MTF) and detective quantum efficiency (DQE) across all spatial frequencies, as well as faster frame rates which enable single electron counting. The benefits of such characteristics for imaging, spectroscopy and electron holography have been demonstrated previously. However, studies are lacking on the application of DEDs for localized characterization of short- to medium- range-order (SRO, MRO) in amorphous materials using electron scattering. Therefore, we evaluate the performance of a Monolithic Active Pixel Sensor DED for the characterization of SRO and MRO in nanoscale volumes of amorphous materials, using SiO₂ and Ta₂O₅ thin films as test cases. The performance of the detector is compared systematically to electron scattering measurements recorded on an indirect detector (CCD) using 200 keV electrons and electron doses starting at approximately 500e^-Ų . In addition, the effects of sample cooling and energy-filtering on the measured SRO of the oxides were investigated. We demonstrate that the performance of the DED resulted in improved SRO characterization in comparison to that obtained from the CCD measurements. The DED enabled to achieve a larger measured maximal scattering vector, ∼16.51Å compared to ∼151Å, for the CCD. Furthermore, an improved signal-to-noise ratio of approximately two-fold was observed across all spatial frequencies for both 200 keV and 80 keV electrons. These improvements are shown to result from the superior DQE of the DED. Consequently, the DED measurements enabled to determine the coordination numbers of atomic bonds more accurately. We expect that further benefits of the DED for S/MRO characterization will be highlighted for ultra- sensitive materials that cannot withstand electron doses above several e^-Ų .

Characterizing the resolution and throughput of the Apollo direct electron detector

Advances in electron detection have been essential to the success of high-resolution cryo-EM structure determination. A new generation of direct electron detector called the Apollo, has been developed by Direct Electron. The Apollo uses a novel event-based MAPS detector custom designed for ultra-fast electron counting. We have evaluated this new camera, finding that it delivers high detective quantum efficiency (DQE) and low coincidence loss, enabling high-quality electron counting data acquisition at up to nearly 80 input electrons per pixel per second. We further characterized the performance of Apollo for single particle cryo-EM on real biological samples. Using mouse apoferritin, Apollo yielded better than 1.9 Å resolution reconstructions at all three tested dose rates from a half-day data collection session each. With longer collection time and improved specimen preparation, mouse apoferritin was reconstructed to 1.66 Å resolution. Applied to a more challenging small protein aldolase, we obtained a 2.24 Å resolution reconstruction. The high quality of the map indicates that the Apollo has sufficiently high DQE to reconstruct smaller proteins and complexes with high-fidelity. Our results demonstrate that the Apollo camera performs well across a broad range of dose rates and is capable of capturing high quality data that produce high-resolution reconstructions for large and small single particle samples.

Electron-counting MicroED data with the K2 and K3 direct electron detectors

Microcrystal electron diffraction (MicroED) uses electron cryo-microscopy (cryo-EM) to collect diffraction data from small crystals during continuous rotation of the sample. As a result of advances in hardware as well as methods development, the data quality has continuously improved over the past decade, to the point where even macromolecular structures can be determined ab initio. Detectors suitable for electron diffraction should ideally have fast readout to record data in movie mode, and high sensitivity at low exposure rates to accurately report the intensities. Direct electron detectors are commonly used in cryo-EM imaging for their sensitivity and speed, but despite their availability are generally not used in diffraction. Primary concerns with diffraction experiments are the dynamic range and coincidence loss, which will corrupt the measurement if the flux exceeds the count rate of the detector. Here, we describe instrument setup and low-exposure MicroED data collection in electron-counting mode using K2 and K3 direct electron detectors and show that the integrated intensities can be effectively used to solve structures of two macromolecules between 1.2 Å and 2.8 Å resolution. Even though a beam stop was not used with the K3 studies we did not observe damage to the camera. As these cameras are already available in many cryo-EM facilities, this provides opportunities for users who do not have access to dedicated facilities for MicroED.

The progressive spectral signal-to-noise ratio of cryo-electron micrograph movies as a tool to assess quality and radiation damage

BACKGROUND AND OBJECTIVE

The quality of a cryoEM reconstruction is fundamentally a function of the signal-to-noise ratio (SNR) of the original micrographs. The SNR embodies multiple aspects of image formation, including microscope details and alignment, specimen composition and thickness, how it is recorded, and how the specimen degrades during imaging. With the advent of direct electron detectors and the recording of a series of images for each micrograph (a movie), we have an opportunity to count every electron and derive fully quantitative results. After alignment of the movie frames of a micrograph, we can calculate the SNR, or its spatial frequency equivalent, the spectral SNR (SSNR). This SSNR reflects residual movement between frames and the progressive effect of radiation damage. The goal is to develop a quantitative analysis of the SSNR and radiation damage to assess and improve the quality of micrographs.

METHODS

Several test cases were selected from the EMPIAR database and ten micrograph movies downloaded for each case. The movie frames were aligned as rigid bodies to compensate for stage and support movement. The SSNR for subsets of frames was then calculated to assess the effect of residual movement. The progressive SSNR (PSSNR) was subsequently calculated to determine the decrease in signal accumulation as a result of radiation damage.

RESULTS

In all cases the alignment of the movie frames compensated for global movement to the extent that the effect on the SSNR is negligible. The subset SSNR can be used as a tool to further confirm the extent of residual movement. The progressive SSNR indicates an increase in value up to an asymptote, consistent with the theory for radiation damage. Fitting these curves gives the inherent SNR before exposure, and the critical dose, which decreases with spatial frequency with an exponential parameter roughly between one and two.

CONCLUSIONS

The implementation of the PSSNR for movie frames provides a tool for assessing micrograph quality and progression of radiation damage. The estimation of the critical dose further quantifies radiation damage and may shed some light on the mechanisms of damage. These are likely both a function of the specimen composition and the imaging parameters used.

Quantifying the performance of a hybrid pixel detector with GaAs:Cr sensor for transmission electron microscopy

Hybrid pixel detectors (HPDs) have been shown to be highly effective for diffraction-based and time-resolved studies in transmission electron microscopy, but their performance is limited by the fact that high-energy electrons scatter over long distances in their thick Si sensors. An advantage of HPDs compared to monolithic active pixel sensors is that their sensors do not need to be fabricated from Si. We have compared the performance of the Medipix3 HPD with a Si sensor and a GaAs:Cr sensor using primary electrons in the energy range of 60-300 keV. We describe the measurement and calculation of the detectors' modulation transfer function (MTF) and detective quantum efficiency (DQE), which show that the performance of the GaAs:Cr device is markedly superior to that of the Si device for high-energy electrons.

Sub-100 nanosecond temporally resolved imaging with the Medipix3 direct electron detector

Detector developments are currently enabling new capabilities in the field of transmission electron microscopy (TEM). We have investigated the limits of a hybrid pixel detector, Medipix3, to record dynamic, time varying, electron signals. Operating with an energy of 60 keV, we have utilised electrostatic deflection to oscillate electron beam position on the detector. Adopting a pump-probe imaging strategy, we have demonstrated that temporal resolutions three orders of magnitude smaller than are available for typically used TEM imaging detectors are possible. Our experiments have shown that energy deposition of the primary electrons in the hybrid pixel detector limits the overall temporal resolution. Through adjustment of user specifiable thresholds or the use of charge summing mode, we have obtained images composed from summing 10,000s frames containing single electron events to achieve temporal resolution less than 100 ns. We propose that this capability can be directly applied to studying repeatable material dynamic processes but also to implement low-dose imaging schemes in scanning transmission electron microscopy.

Low-dose (S)TEM elemental analysis of water and oxygen uptake in beam sensitive materials

The performance stability of organic photovoltaics (OPVs) is largely determined by their nanoscale morphology and composition and is highly dependent on the interaction with oxygen and water from air. Low-dose cryo-(S)TEM techniques, in combination with OPV donor-acceptor model systems, can be used to assess oxygen- and water-uptake in the donor, acceptor and their interface. By determining a materials dependent critical electron dose from the decay of the oxygen K-edge intensity in Electron Energy Loss Spectra, we reliably measured oxygen- and water-uptake minimizing and correcting electron beam effects. With measurements below the dose limit the capability of STEM-EDX, EFTEM and STEM-EELS techniques are compared to qualitatively and quantitatively measure oxygen and water uptake in these OPV model systems. Here we demonstrate that oxygen and water is mainly taken up in acceptor-rich regions, and that specific oxygen uptake at the donor-acceptor interphase does not occur. STEM-EELS is shown to be the best suitable technique, enabling quantification of the local oxygen concentration in OPV model systems.

Image processing techniques for high-resolution structure determination from badly ordered 2D crystals

2D electron crystallography can be used to study small membrane proteins in their native environment. Obtaining highly ordered 2D crystals is difficult and time-consuming. However, 2D crystals diffracting to only 10-12 Å can be prepared relatively conveniently in most cases. We have developed image-processing algorithms allowing to generate a high resolution 3D structure from cryo-electron crystallography images of badly ordered crystals. These include movie-mode unbending, refinement over sub-tiles of the images in order to locally refine the sample tilt geometry, implementation of different CTF correction schemes, and an iterative method to apply known constraints in the real and reciprocal space to approximate amplitudes and phases in the so-called missing cone regions. These algorithms applied to a dataset of the potassium channel MloK1 show significant resolution improvements to better than 5 Å.

The influence of frame alignment with dose compensation on the quality of single particle reconstructions

As direct electron detection devices in cryo-electron microscopy become ubiquitous, the field is now ripe for new developments in image analysis techniques that take advantage of their increased SNR coupled with their high-throughput frame collection abilities. In approaching atomic resolution of native-like biomolecules, the accurate extraction of structural locations and orientations of side-chains from frames depends not only on the electron dose that a sample receives but also on the ability to accurately estimate the CTF. Here we use a new 2.8Å resolution structure of a recombinant gene therapy virus, AAV-DJ with Arixtra, imaged on an FEI Titan Krios with a DE-20 direct electron detector to probe new metrics including relative side-chain density and ResLog analysis for optimizing the compensation of electron beam damage and to characterize the factors that are limiting the resolution of the reconstruction. The influence of dose compensation on the accuracy of CTF estimation and particle classifiability are also presented. We show that rigorous dose compensation allows for better particle classifiability and greater recovery of structural information from negatively charged, electron-sensitive side-chains, resulting in a more accurate macromolecular model.

Alignment of cryo-EM movies of individual particles by optimization of image translations

Direct detector device (DDD) cameras have revolutionized single particle electron cryomicroscopy (cryo-EM). In addition to an improved camera detective quantum efficiency, acquisition of DDD movies allows for correction of movement of the specimen, due to both instabilities in the microscope specimen stage and electron beam-induced movement. Unlike specimen stage drift, beam-induced movement is not always homogeneous within an image. Local correlation in the trajectories of nearby particles suggests that beam-induced motion is due to deformation of the ice layer. Algorithms have already been described that can correct movement for large regions of frames and for >1 MDa protein particles. Another algorithm allows individual <1 MDa protein particle trajectories to be estimated, but requires rolling averages to be calculated from frames and fits linear trajectories for particles. Here we describe an algorithm that allows for individual <1 MDa particle images to be aligned without frame averaging or linear trajectories. The algorithm maximizes the overall correlation of the shifted frames with the sum of the shifted frames. The optimum in this single objective function is found efficiently by making use of analytically calculated derivatives of the function. To smooth estimates of particle trajectories, rapid changes in particle positions between frames are penalized in the objective function and weighted averaging of nearby trajectories ensures local correlation in trajectories. This individual particle motion correction, in combination with weighting of Fourier components to account for increasing radiation damage in later frames, can be used to improve 3-D maps from single particle cryo-EM.

Description and comparison of algorithms for correcting anisotropic magnification in cryo-EM images

Single particle electron cryomicroscopy (cryo-EM) allows for structures of proteins and protein complexes to be determined from images of non-crystalline specimens. Cryo-EM data analysis requires electron microscope images of randomly oriented ice-embedded protein particles to be rotated and translated to allow for coherent averaging when calculating three-dimensional (3D) structures. Rotation of 2D images is usually done with the assumption that the magnification of the electron microscope is the same in all directions. However, due to electron optical aberrations, this condition is not met with some electron microscopes when used with the settings necessary for cryo-EM with a direct detector device (DDD) camera. Correction of images by linear interpolation in real space has allowed high-resolution structures to be calculated from cryo-EM images for symmetric particles. Here we describe and compare a simple real space method, a simple Fourier space method, and a somewhat more sophisticated Fourier space method to correct images for a measured anisotropy in magnification. Further, anisotropic magnification causes contrast transfer function (CTF) parameters estimated from image power spectra to have an apparent systematic astigmatism. To address this problem we develop an approach to adjust CTF parameters measured from distorted images so that they can be used with corrected images. The effect of anisotropic magnification on CTF parameters provides a simple way of detecting magnification anisotropy in cryo-EM datasets.

Quantitative characterization of electron detectors for transmission electron microscopy

A new generation of direct electron detectors for transmission electron microscopy (TEM) promises significant improvement over previous detectors in terms of their modulation transfer function (MTF) and detective quantum efficiency (DQE). However, the performance of these new detectors needs to be carefully monitored in order to optimize imaging conditions and check for degradation over time. We have developed an easy-to-use software tool, FindDQE, to measure MTF and DQE of electron detectors using images of a microscope's built-in beam stop. Using this software, we have determined the DQE curves of four direct electron detectors currently available: the Gatan K2 Summit, the FEI Falcon I and II, and the Direct Electron DE-12, under a variety of total dose and dose rate conditions. We have additionally measured the curves for the Gatan US4000 and TVIPS TemCam-F416 scintillator-based cameras. We compare the results from our new method with published curves.