Avoiding the pitfalls of single particle cryo-electron microscopy: Einstein from noise

CryoPROS: Correcting misalignment caused by preferred orientation using AI-generated auxiliary particles

The preferred orientation phenomenon is a common issue in cryo-EM, posing a persistent challenge to conventional reconstruction methods. In this study, we introduce cryoPROS, a computational framework designed to correct misalignment caused by preferred orientation through co-refining the raw and auxiliary particles. These auxiliary particles, generated using a self-supervised deep generative model, enhance the alignment accuracy of particles in datasets affected by preferred orientation. CryoPROS achieved near-atomic resolution with the untilted HA-trimer dataset and successfully resolved high-resolution structures from three experimental datasets, including P001-Y, NaX, and hormone-sensitive lipase dimer, all affected by preferred orientation issues. Extensive experiments validate the robustness of cryoPROS and its minimal risk of introducing model bias. These findings suggest that in many cases thought to suffer from preferred orientation, addressing misalignment issues can lead to significant improvements in the density map.

A non-parametric approach to particle picking in all frames

Single-particle cryo-electron microscopy (cryo-EM) has significantly advanced macromolecular structure reconstruction. However, a key limitation is the conventional reliance on micrographs obtained by motion correction and averaging, which inherently loses the richness of information contained within each frame of the original movie. The future of cryo-EM reconstruction ideally involves harnessing the raw signal from every frame to unlock potentially higher quality structures. In this paper, we present a first essential step toward this paradigm shift, that is, a novel, non-parametric method for detecting tomographic projections across all movie frames, using temporal consistency. Our method is inspired by Structure-from-Motion (SfM), and independent of motion correction, CTF estimation, and initial reconstruction. Our experimental results demonstrate reduced outlier rate and accurate particle localization comparable to existing approaches throughout the entire movie sequence.

Outlier removal in cryo-EM via radial profiles

The process of particle picking, a crucial step in cryo-electron microscopy (cryo-EM) image analysis, often encounters challenges due to outliers, leading to inaccuracies in downstream processing. In response to this challenge, this research introduces an additional automated step to reduce the number of outliers identified by the particle picker. The proposed method enhances both the accuracy and efficiency of particle picking, thereby reducing the overall running time and the necessity for expert intervention in the process. Experimental results demonstrate the effectiveness of the proposed approach in mitigating outlier inclusion and its potential to enhance cryo-EM data analysis pipelines significantly. This work contributes to the ongoing advancement of automated cryo-EM image processing methods, offering novel insights and solutions to challenges in structural biology research.

DNA Nanotags for Multiplexed Single-Particle Electron Microscopy and In Situ Electron Cryotomography

DNA nanostructures present new opportunities as Nanotags for electron microscopy (EM) imaging, leveraging their high programmability, unique shapes, biomolecule conjugation capability, and stability compatible with standard cryogenic sample preparation protocols. This perspective highlights the potential of DNA Nanotags to enable high-throughput multiplexed EM analysis and facilitate in situ particle identification for cryogenic electron tomography (cryo-ET). Meanwhile, applying Nanotags in live-cell environments requires the efficient cellular uptake of intact structures and successful cytosolic migration. Promising strategies such as employing direct cytosolic delivery platforms and expressing RNA-based Nanotags in situ are discussed, while more systematic studies are needed to fully understand the intracellular trafficking and achieve precise localization of DNA Nanotags.

Structural dynamics of human ribosomes in situ reconstructed by exhaustive high-resolution template matching

Protein synthesis is central to life and requires the ribosome, which catalyzes the stepwise addition of amino acids to a polypeptide chain by undergoing a sequence of structural transformations. Here, we employed high-resolution template matching (HRTM) on cryoelectron microscopy (cryo-EM) images of directly cryofixed living cells to obtain a set of ribosomal configurations covering the entire elongation cycle, with each configuration occurring at its native abundance. HRTM's position and orientation precision and ability to detect small targets (∼300 kDa) made it possible to order these configurations along the reaction coordinate and to reconstruct molecular features of any configuration along the elongation cycle. Visualizing the cycle's structural dynamics by combining a sequence of >40 reconstructions into a 3D movie readily revealed component and ligand movements, some of them surprising, such as spring-like intramolecular motion, providing clues about the molecular mechanisms involved in some still mysterious steps during chain elongation.

One-step nanoscale expansion microscopy reveals individual protein shapes

The attainable resolution of fluorescence microscopy has reached the subnanometer range, but this technique still fails to image the morphology of single proteins or small molecular complexes. Here, we expand the specimens at least tenfold, label them with conventional fluorophores and image them with conventional light microscopes, acquiring videos in which we analyze fluorescence fluctuations. One-step nanoscale expansion (ONE) microscopy enables the visualization of the shapes of individual membrane and soluble proteins, achieving around 1-nm resolution. We show that conformational changes are readily observable, such as those undergone by the ~17-kDa protein calmodulin upon Ca2+ binding. ONE is also applied to clinical samples, analyzing the morphology of protein aggregates in cerebrospinal fluid from persons with Parkinson disease, potentially aiding disease diagnosis. This technology bridges the gap between high-resolution structural biology techniques and light microscopy, providing new avenues for discoveries in biology and medicine.

DynaMight: estimating molecular motions with improved reconstruction from cryo-EM images

How to deal with continuously flexing molecules is one of the biggest outstanding challenges in single-particle analysis of proteins from cryogenic-electron microscopy (cryo-EM) images. Here, we present DynaMight, a software tool that estimates a continuous space of conformations in a cryo-EM dataset by learning three-dimensional deformations of a Gaussian pseudo-atomic model of a consensus structure for every particle image. Inversion of the learned deformations is then used to obtain an improved reconstruction of the consensus structure. We illustrate the performance of DynaMight for several experimental cryo-EM datasets. We also show how error estimates on the deformations may be obtained by independently training two variational autoencoders on half sets of the cryo-EM data, and how regularization of the three-dimensional deformations through the use of atomic models may lead to important artifacts due to model bias. DynaMight is distributed as free, open-source software, as part of RELION-5.

Four Parallel Pathways in T4 Ligase-Catalyzed Repair of Nicked DNA with Diverse Bending Angles

The structural diversity of biological macromolecules in different environments contributes complexity to enzymological processes vital for cellular functions. Fluorescence resonance energy transfer and electron microscopy are used to investigate the enzymatic reaction of T4 DNA ligase catalyzing the ligation of nicked DNA. The data show that both the ligase-AMP complex and the ligase-AMP-DNA complex can have four conformations. This finding suggests the parallel occurrence of four ligation reaction pathways, each characterized by specific conformations of the ligase-AMP complex that persist in the ligase-AMP-DNA complex. Notably, these complexes have DNA bending angles of ≈0°, 20°, 60°, or 100°. The mechanism of parallel reactions challenges the conventional notion of simple sequential reaction steps occurring among multiple conformations. The results provide insights into the dynamic conformational changes and the versatile attributes of T4 DNA ligase and suggest that the parallel multiple reaction pathways may correspond to diverse T4 DNA ligase functions. This mechanism may potentially have evolved as an adaptive strategy across evolutionary history to navigate complex environments.

Use of phase plate cryo-EM reveals conformation diversity of therapeutic IgG with 50 kDa Fab fragment resolved below 6 Å

While cryogenic electron microscopy (cryo-EM) is fruitfully used for harvesting high-resolution structures of sizable macromolecules, its application to small or flexible proteins composed of small domains like immunoglobulin (IgG) remain challenging. Here, we applied single particle cryo-EM to Rituximab, a therapeutic IgG mediating anti-tumor toxicity, to explore its solution conformations. We found Rituximab molecules exhibited aggregates in cryo-EM specimens contrary to its solution behavior, and utilized a non-ionic detergent to successfully disperse them as isolated particles amenable to single particle analysis. As the detergent adversely reduced the protein-to-solvent contrast, we employed phase plate contrast to mitigate the impaired protein visibility. Assisted by phase plate imaging, we obtained a canonical three-arm IgG structure with other structures displaying variable arm densities co-existing in solution, affirming high flexibility of arm-connecting linkers. Furthermore, we showed phase plate imaging enables reliable structure determination of Fab to sub-nanometer resolution from ab initio, yielding a characteristic two-lobe structure that could be unambiguously docked with crystal structure. Our findings revealed conformation diversity of IgG and demonstrated phase plate was viable for cryo-EM analysis of small proteins without symmetry. This work helps extend cryo-EM boundaries, providing a valuable imaging and structural analysis framework for macromolecules with similar challenging features.

Single image Fourier ring correlation

We address resolution assessment for (light super-resolution) microscopy imaging. In modalities where imaging is not diffraction limited, correlation between two noise independent images is the standard way to infer the resolution. Here we take away the need for two noise independent images by computationally splitting one image acquisition into two noise independent realizations. This procedure generates two Poisson noise distributed images if the input is Poissonian distributed. As most modern cameras are shot-noise limited this procedure is directly applicable. However, also in the presence of readout noise we can compute the resolution faithfully via a correction factor. We evaluate our method on simulations and experimental data of widefield microscopy, STED microscopy, rescan confocal microscopy, image scanning microscopy, conventional confocal microscopy, and transmission electron microscopy. In all situations we find that using one image instead of two results in the same computed image resolution.

Community recommendations on cryoEM data archiving and validation

In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for the deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 47 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discussed, and the resulting consensus recommendations. Some challenges for future methods-development efforts in this area are also highlighted, as is the implementation to date of some of the recommendations.

Community recommendations on cryoEM data archiving and validation: Outcomes of a wwPDB/EMDB workshop on cryoEM data management, deposition and validation

In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 47 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discussed, and consensus recommendations resulting from the workshop. Some challenges for future methods-development efforts in this area are also highlighted, as is the implementation to date of some of the recommendations.

A kinetic model for solving a combination optimization problem in ab-initio Cryo-EM 3D reconstruction

Cryo-Electron Microscopy (cryo-EM) is a widely used and effective method for determining the three-dimensional (3D) structure of biological molecules. For ab-initio Cryo-EM 3D reconstruction using single particle analysis (SPA), estimating the projection direction of the projection image is a crucial step. However, the existing SPA methods based on common lines are sensitive to noise. The error in common line detection will lead to a poor estimation of the projection directions and thus may greatly affect the final reconstruction results. To improve the reconstruction results, multiple candidate common lines are estimated for each pair of projection images. The key problem then becomes a combination optimization problem of selecting consistent common lines from multiple candidates. To solve the problem efficiently, a physics-inspired method based on a kinetic model is proposed in this work. More specifically, hypothetical attractive forces between each pair of candidate common lines are used to calculate a hypothetical torque exerted on each projection image in the 3D reconstruction space, and the rotation under the hypothetical torque is used to optimize the projection direction estimation of the projection image. This way, the consistent common lines along with the projection directions can be found directly without enumeration of all the combinations of the multiple candidate common lines. Compared with the traditional methods, the proposed method is shown to be able to produce more accurate 3D reconstruction results from high noise projection images. Besides the practical value, the proposed method also serves as a good reference for solving similar combinatorial optimization problems.

Baited reconstruction with 2D template matching for high-resolution structure determination in vitro and in vivo without template bias

Previously we showed that 2D template matching (2DTM) can be used to localize macromolecular complexes in images recorded by cryogenic electron microscopy (cryo-EM) with high precision, even in the presence of noise and cellular background (Lucas et al., 2021; Lucas et al., 2022). Here, we show that once localized, these particles may be averaged together to generate high-resolution 3D reconstructions. However, regions included in the template may suffer from template bias, leading to inflated resolution estimates and making the interpretation of high-resolution features unreliable. We evaluate conditions that minimize template bias while retaining the benefits of high-precision localization, and we show that molecular features not present in the template can be reconstructed at high resolution from targets found by 2DTM, extending prior work at low-resolution. Moreover, we present a quantitative metric for template bias to aid the interpretation of 3D reconstructions calculated with particles localized using high-resolution templates and fine angular sampling.

Detecting continuous structural heterogeneity in single-molecule localization microscopy data

Fusion of multiple chemically identical complexes, so-called particles, in localization microscopy, can improve the signal-to-noise ratio and overcome under-labeling. To this end, structural homogeneity of the data must be assumed. Biological heterogeneity, however, could be present in the data originating from distinct conformational variations or (continuous) variations in particle shapes. We present a prior-knowledge-free method for detecting continuous structural variations with localization microscopy. Detecting this heterogeneity leads to more faithful fusions and reconstructions of the localization microscopy data as their heterogeneity is taken into account. In experimental datasets, we show the continuous variation of the height of DNA origami tetrahedrons imaged with 3D PAINT and of the radius of Nuclear Pore Complexes imaged in 2D with STORM. In simulation, we study the impact on the heterogeneity detection pipeline of Degree Of Labeling and of structural variations in the form of two independent modes.

Computational methods for in situ structural studies with cryogenic electron tomography

Cryo-electron tomography (cryo-ET) plays a critical role in imaging microorganisms in situ in terms of further analyzing the working mechanisms of viruses and drug exploitation, among others. A data processing workflow for cryo-ET has been developed to reconstruct three-dimensional density maps and further build atomic models from a tilt series of two-dimensional projections. Low signal-to-noise ratio (SNR) and missing wedge are two major factors that make the reconstruction procedure challenging. Because only few near-atomic resolution structures have been reconstructed in cryo-ET, there is still much room to design new approaches to improve universal reconstruction resolutions. This review summarizes classical mathematical models and deep learning methods among general reconstruction steps. Moreover, we also discuss current limitations and prospects. This review can provide software and methods for each step of the entire procedure from tilt series by cryo-ET to 3D atomic structures. In addition, it can also help more experts in various fields comprehend a recent research trend in cryo-ET. Furthermore, we hope that more researchers can collaborate in developing computational methods and mathematical models for high-resolution three-dimensional structures from cryo-ET datasets.

A robust normalized local filter to estimate compositional heterogeneity directly from cryo-EM maps

Cryo electron microscopy (cryo-EM) is used by biological research to visualize biomolecular complexes in 3D, but the heterogeneity of cryo-EM reconstructions is not easily estimated. Current processing paradigms nevertheless exert great effort to reduce flexibility and heterogeneity to improve the quality of the reconstruction. Clustering algorithms are typically employed to identify populations of data with reduced variability, but lack assessment of remaining heterogeneity. Here we develope a fast and simple algorithm based on spatial filtering to estimate the heterogeneity of a reconstruction. In the absence of flexibility, this estimate approximates macromolecular component occupancy. We show that our implementation can derive reasonable input parameters, that composition heterogeneity can be estimated based on contrast loss, and that the reconstruction can be modified accordingly to emulate altered constituent occupancy. This stands to benefit conventionally employed maximum-likelihood classification methods, whereas we here limit considerations to cryo-EM map interpretation, quantification, and particle-image signal subtraction.

`Cryo-EM': electron cryomicroscopy, cryo electron microscopy or something else?

Structural biology continues to benefit from an expanding toolkit, which is helping to gain unprecedented insight into the assembly and organization of multi-protein machineries, enzyme mechanisms and ligand/inhibitor binding. During the last ten years, cryoEM has become widely available and has provided a major boost to structure determination of membrane proteins and large multi-protein complexes. Many of the structures have now been made available at resolutions around 2 Å, where fundamental questions regarding enzyme mechanisms can be addressed. Over the years, the abbreviation cryoEM has been understood to stand for different things. We wish the wider community to engage and clarify the definition of cryoEM so that the expanding literature involving cryoEM is unified.

Improvement of cryo-EM maps by simultaneous local and non-local deep learning

Cryo-EM has emerged as the most important technique for structure determination of macromolecular complexes. However, raw cryo-EM maps often exhibit loss of contrast at high resolution and heterogeneity over the entire map. As such, various post-processing methods have been proposed to improve cryo-EM maps. Nevertheless, it is still challenging to improve both the quality and interpretability of EM maps. Addressing the challenge, we present a three-dimensional Swin-Conv-UNet-based deep learning framework to improve cryo-EM maps, named EMReady, by not only implementing both local and non-local modeling modules in a multiscale UNet architecture but also simultaneously minimizing the local smooth L1 distance and maximizing the non-local structural similarity between processed experimental and simulated target maps in the loss function. EMReady was extensively evaluated on diverse test sets of 110 primary cryo-EM maps and 25 pairs of half-maps at 3.0-6.0 Å resolutions, and compared with five state-of-the-art map post-processing methods. It is shown that EMReady can not only robustly enhance the quality of cryo-EM maps in terms of map-model correlations, but also improve the interpretability of the maps in automatic de novo model building.

Computational Methods Toward Unbiased Pattern Mining and Structure Determination in Cryo-Electron Tomography Data

Cryo-electron tomography can uniquely probe the native cellular environment for macromolecular structures. Tomograms feature complex data with densities of diverse, densely crowded macromolecular complexes, low signal-to-noise, and artifacts such as the missing wedge effect. Post-processing of this data generally involves isolating regions or particles of interest from tomograms, organizing them into related groups, and rendering final structures through subtomogram averaging. Template-matching and reference-based structure determination are popular analysis methods but are vulnerable to biases and can often require significant user input. Most importantly, these approaches cannot identify novel complexes that reside within the imaged cellular environment. To reliably extract and resolve structures of interest, efficient and unbiased approaches are therefore of great value. This review highlights notable computational software and discusses how they contribute to making automated structural pattern discovery a possibility. Perspectives emphasizing the importance of features for user-friendliness and accessibility are also presented.

High-throughput cryo-ET structural pattern mining by unsupervised deep iterative subtomogram clustering

Cryoelectron tomography directly visualizes heterogeneous macromolecular structures in their native and complex cellular environments. However, existing computer-assisted structure sorting approaches are low throughput or inherently limited due to their dependency on available templates and manual labels. Here, we introduce a high-throughput template-and-label-free deep learning approach, Deep Iterative Subtomogram Clustering Approach (DISCA), that automatically detects subsets of homogeneous structures by learning and modeling 3D structural features and their distributions. Evaluation on five experimental cryo-ET datasets shows that an unsupervised deep learning based method can detect diverse structures with a wide range of molecular sizes. This unsupervised detection paves the way for systematic unbiased recognition of macromolecular complexes in situ.

Signal enhancement for two-dimensional cryo-EM data processing

Different tasks in the computational pipeline of single-particle cryo-electron microscopy (cryo-EM) require enhancing the quality of the highly noisy raw images. To this end, we develop an efficient algorithm for signal enhancement of cryo-EM images. The enhanced images can be used for a variety of downstream tasks, such as two-dimensional classification, removing uninformative images, constructing ab initio models, generating templates for particle picking, providing a quick assessment of the data set, dimensionality reduction, and symmetry detection. The algorithm includes built-in quality measures to assess its performance and alleviate the risk of model bias. We demonstrate the effectiveness of the proposed algorithm on several experimental data sets. In particular, we show that the quality of the resulting images is high enough to produce ab initio models of Å resolution. The algorithm is accompanied by a publicly available, documented, and easy-to-use code.

EMPIAR: the Electron Microscopy Public Image Archive

Public archiving in structural biology is well established with the Protein Data Bank (PDB; wwPDB.org) catering for atomic models and the Electron Microscopy Data Bank (EMDB; emdb-empiar.org) for 3D reconstructions from cryo-EM experiments. Even before the recent rapid growth in cryo-EM, there was an expressed community need for a public archive of image data from cryo-EM experiments for validation, software development, testing and training. Concomitantly, the proliferation of 3D imaging techniques for cells, tissues and organisms using volume EM (vEM) and X-ray tomography (XT) led to calls from these communities to publicly archive such data as well. EMPIAR (empiar.org) was developed as a public archive for raw cryo-EM image data and for 3D reconstructions from vEM and XT experiments and now comprises over a thousand entries totalling over 2 petabytes of data. EMPIAR resources include a deposition system, entry pages, facilities to search, visualize and download datasets, and a REST API for programmatic access to entry metadata. The success of EMPIAR also poses significant challenges for the future in dealing with the very fast growth in the volume of data and in enhancing its reusability.

Cryo-electron Microscopy of Protein Cages

Protein cages are one of the most widely studied objects in the field of cryogenic electron microscopy-encompassing natural and synthetic constructs, from enzymes assisting protein folding such as chaperonin to virus capsids. Tremendous diversity of morphology and function is demonstrated by the structure and role of proteins, some of which are nearly ubiquitous, while others are present in few organisms. Protein cages are often highly symmetrical, which helps improve the resolution obtained by cryo-electron microscopy (cryo-EM). Cryo-EM is the study of vitrified samples using an electron probe to image the subject. A sample is rapidly frozen in a thin layer on a porous grid, attempting to keep the sample as close to a native state as possible. This grid is kept at cryogenic temperatures throughout imaging in an electron microscope. Once image acquisition is complete, a variety of software packages may be employed to carry out analysis and reconstruction of three-dimensional structures from the two-dimensional micrograph images. Cryo-EM can be used on samples that are too large or too heterogeneous to be amenable to other structural biology techniques like NMR or X-ray crystallography. In recent years, advances in both hardware and software have provided significant improvements to the results obtained using cryo-EM, recently demonstrating true atomic resolution from vitrified aqueous samples. Here, we review these advances in cryo-EM, especially in that of protein cages, and introduce several tips for situations we have experienced.

Near-Atomic Resolution Cryo-EM Image Reconstruction of RNA

The rapid development of cryogenic electron microscopy (cryo-EM) enables the structure determination of macromolecules without the need for crystallization. Protein, protein-lipid, and protein-nucleic acid complexes can now be routinely resolved by cryo-EM single-particle analysis (SPA) to near-atomic or atomic resolution. Here we describe the structure determination of pure RNAs by SPA, from cryo-specimen preparation to data collection and 3D reconstruction. This protocol is useful to yield many cryo-EM structures of RNA, here exemplified by the Tetrahymena L-21 ScaI ribozyme at 3.1-Å resolution.

Toward Single Particle Reconstruction without Particle Picking: Breaking the Detection Limit

Single-particle cryo-electron microscopy (cryo-EM) has recently joined X-ray crystallography and NMR spectroscopy as a high-resolution structural method to resolve biological macromolecules. In a cryo-EM experiment, the microscope produces images called micrographs. Projections of the molecule of interest are embedded in the micrographs at unknown locations, and under unknown viewing directions. Standard imaging techniques first locate these projections (detection) and then reconstruct the 3-D structure from them. Unfortunately, high noise levels hinder detection. When reliable detection is rendered impossible, the standard techniques fail. This is a problem, especially for small molecules. In this paper, we pursue a radically different approach: we contend that the structure could, in principle, be reconstructed directly from the micrographs, without intermediate detection. The aim is to bring small molecules within reach for cryo-EM. To this end, we design an autocorrelation analysis technique that allows one to go directly from the micrographs to the sought structures. This involves only one pass over the micrographs, allowing online, streaming processing for large experiments. We show numerical results and discuss challenges that lay ahead to turn this proof-of-concept into a complementary approach to state-of-the-art algorithms.

Maximum-likelihood model fitting for quantitative analysis of SMLM data

Quantitative data analysis is important for any single-molecule localization microscopy (SMLM) workflow to extract biological insights from the coordinates of the single fluorophores. However, current approaches are restricted to simple geometries or require identical structures. Here, we present LocMoFit (Localization Model Fit), an open-source framework to fit an arbitrary model to localization coordinates. It extracts meaningful parameters from individual structures and can select the most suitable model. In addition to analyzing complex, heterogeneous and dynamic structures for in situ structural biology, we demonstrate how LocMoFit can assemble multi-protein distribution maps of six nuclear pore components, calculate single-particle averages without any assumption about geometry or symmetry, and perform a time-resolved reconstruction of the highly dynamic endocytic process from static snapshots. We provide extensive simulation and visualization routines to validate the robustness of LocMoFit and tutorials to enable any user to increase the information content they can extract from their SMLM data.

Exploring the Structural Variability of Dynamic Biological Complexes by Single-Particle Cryo-Electron Microscopy

Biological macromolecules and assemblies precisely rearrange their atomic 3D structures to execute cellular functions. Understanding the mechanisms by which these molecular machines operate requires insight into the ensemble of structural states they occupy during the functional cycle. Single-particle cryo-electron microscopy (cryo-EM) has become the preferred method to provide near-atomic resolution, structural information about dynamic biological macromolecules elusive to other structure determination methods. Recent advances in cryo-EM methodology have allowed structural biologists not only to probe the structural intermediates of biochemical reactions, but also to resolve different compositional and conformational states present within the same dataset. This article reviews newly developed sample preparation and single-particle analysis (SPA) techniques for high-resolution structure determination of intrinsically dynamic and heterogeneous samples, shedding light upon the intricate mechanisms employed by molecular machines and helping to guide drug discovery efforts.

Neutralizing monoclonal antibodies elicited by mosaic RBD nanoparticles bind conserved sarbecovirus epitopes

Increased immune evasion by SARS-CoV-2 variants of concern highlights the need for new therapeutic neutralizing antibodies. Immunization with nanoparticles co-displaying spike receptor-binding domains (RBDs) from eight sarbecoviruses (mosaic-8 RBD-nanoparticles) efficiently elicits cross-reactive polyclonal antibodies against conserved sarbecovirus RBD epitopes. Here, we identified monoclonal antibodies (mAbs) capable of cross-reactive binding and neutralization of animal sarbecoviruses and SARS-CoV-2 variants by screening single mouse B cells secreting IgGs that bind two or more sarbecovirus RBDs. Single-particle cryo-EM structures of antibody-spike complexes, including a Fab-Omicron complex, mapped neutralizing mAbs to conserved class 1/4 RBD epitopes. Structural analyses revealed neutralization mechanisms, potentials for intra-spike trimer cross-linking by IgGs, and induced changes in trimer upon Fab binding. In addition, we identified a mAb-resembling Bebtelovimab, an EUA-approved human class 3 anti-RBD mAb. These results support using mosaic RBD-nanoparticle vaccination to generate and identify therapeutic pan-sarbecovirus and pan-variant mAbs.

Deep generative modeling for volume reconstruction in cryo-electron microscopy

Advances in cryo-electron microscopy (cryo-EM) for high-resolution imaging of biomolecules in solution have provided new challenges and opportunities for algorithm development for 3D reconstruction. Next-generation volume reconstruction algorithms that combine generative modelling with end-to-end unsupervised deep learning techniques have shown promise, but many technical and theoretical hurdles remain, especially when applied to experimental cryo-EM images. In light of the proliferation of such methods, we propose here a critical review of recent advances in the field of deep generative modelling for cryo-EM reconstruction. The present review aims to (i) provide a unified statistical framework using terminology familiar to machine learning researchers with no specific background in cryo-EM, (ii) review the current methods in this framework, and (iii) outline outstanding bottlenecks and avenues for improvements in the field.

Cryomicroscopy in situ: what is the smallest molecule that can be directly identified without labels in a cell?

Electron cryomicroscopy (cryoEM) has made great strides in the last decade, such that the atomic structure of most biological macromolecules can, at least in principle, be determined. Major technological advances - in electron imaging hardware, data analysis software, and cryogenic specimen preparation technology - continue at pace and contribute to the exponential growth in the number of atomic structures determined by cryoEM. It is now conceivable that within the next decade we will have structures for hundreds of thousands of unique protein and nucleic acid molecular complexes. But the answers to many important questions in biology would become obvious if we could identify these structures precisely inside cells with quantifiable error. In the context of an abundance of known structures, it is appropriate to consider the current state of electron cryomicroscopy for frozen specimens prepared directly from cells, and try to answer to the question of the title, both now and in the foreseeable future.

Emerging Themes in CryoEM─Single Particle Analysis Image Processing

Cryo-electron microscopy (CryoEM) has become a vital technique in structural biology. It is an interdisciplinary field that takes advantage of advances in biochemistry, physics, and image processing, among other disciplines. Innovations in these three basic pillars have contributed to the boosting of CryoEM in the past decade. This work reviews the main contributions in image processing to the current reconstruction workflow of single particle analysis (SPA) by CryoEM. Our review emphasizes the time evolution of the algorithms across the different steps of the workflow differentiating between two groups of approaches: analytical methods and deep learning algorithms. We present an analysis of the current state of the art. Finally, we discuss the emerging problems and challenges still to be addressed in the evolution of CryoEM image processing methods in SPA.

Membranes under the Magnetic Lens: A Dive into the Diverse World of Membrane Protein Structures Using Cryo-EM

Membrane proteins are highly diverse in both structure and function and can, therefore, present different challenges for structure determination. They are biologically important for cells and organisms as gatekeepers for information and molecule transfer across membranes, but each class of membrane proteins can present unique obstacles to structure determination. Historically, many membrane protein structures have been investigated using highly engineered constructs or using larger fusion proteins to improve solubility and/or increase particle size. Other strategies included the deconstruction of the full-length protein to target smaller soluble domains. These manipulations were often required for crystal formation to support X-ray crystallography or to circumvent lower resolution due to high noise and dynamic motions of protein subdomains. However, recent revolutions in membrane protein biochemistry and cryo-electron microscopy now provide an opportunity to solve high resolution structures of both large, >1 megadalton (MDa), and small, <100 kDa (kDa), drug targets in near-native conditions, routinely reaching resolutions around or below 3 Å. This review provides insights into how the recent advances in membrane biology and biochemistry, as well as technical advances in cryo-electron microscopy, help us to solve structures of a large variety of membrane protein groups, from small receptors to large transporters and more complex machineries.

Cryo-EM of Helical Polymers

While the application of cryogenic electron microscopy (cryo-EM) to helical polymers in biology has a long history, due to the huge number of helical macromolecular assemblies in viruses, bacteria, archaea, and eukaryotes, the use of cryo-EM to study synthetic soft matter noncovalent polymers has been much more limited. This has mainly been due to the lack of familiarity with cryo-EM in the materials science and chemistry communities, in contrast to the fact that cryo-EM was developed as a biological technique. Nevertheless, the relatively few structures of self-assembled peptide nanotubes and ribbons solved at near-atomic resolution by cryo-EM have demonstrated that cryo-EM should be the method of choice for a structural analysis of synthetic helical filaments. In addition, cryo-EM has also demonstrated that the self-assembly of soft matter polymers has enormous potential for polymorphism, something that may be obscured by techniques such as scattering and spectroscopy. These cryo-EM structures have revealed how far we currently are from being able to predict the structure of these polymers due to their chaotic self-assembly behavior.

Computational methods for ultrastructural analysis of synaptic complexes

Electron microscopy (EM) provided fundamental insights about the ultrastructure of neuronal synapses. The large amount of information present in the contemporary EM datasets precludes a thorough assessment by visual inspection alone, thus requiring computational methods for the analysis of the data. Here, I review image processing software methods ranging from membrane tracing in large volume datasets to high resolution structures of synaptic complexes. Particular attention is payed to molecular level analysis provided by recent cryo-electron microscopy and tomography methods.

Quantitative Cryo-Electron Tomography

The three-dimensional organization of biomolecules important for the functioning of all living systems can be determined by cryo-electron tomography imaging under native biological contexts. Cryo-electron tomography is continually expanding and evolving, and the development of new methods that use the latest technology for sample thinning is enabling the visualization of ever larger and more complex biological systems, allowing imaging across scales. Quantitative cryo-electron tomography possesses the capability of visualizing the impact of molecular and environmental perturbations in subcellular structure and function to understand fundamental biological processes. This review provides an overview of current hardware and software developments that allow quantitative cryo-electron tomography studies and their limitations and how overcoming them may allow us to unleash the full power of cryo-electron tomography.

Probing Structural Perturbation of Biomolecules by Extracting Cryo-EM Data Heterogeneity

Single-particle cryogenic electron microscopy (cryo-EM) has become an indispensable tool to probe high-resolution structural detail of biomolecules. It enables direct visualization of the biomolecules and opens a possibility for averaging molecular images to reconstruct a three-dimensional Coulomb potential density map. Newly developed algorithms for data analysis allow for the extraction of structural heterogeneity from a massive and low signal-to-noise-ratio (SNR) cryo-EM dataset, expanding our understanding of multiple conformational states, or further implications in dynamics, of the target biomolecule. This review provides an overview that briefly describes the workflow of single-particle cryo-EM, including imaging and data processing, and new methods developed for analyzing the data heterogeneity to understand the structural variability of biomolecules.

3D reconstruction from cryo-EM projection images using two spherical embeddings

Single-particle analysis (SPA) in cryo-electron microscopy has become a powerful tool for determining and studying the macromolecular structure at an atomic level. However, since the SPA problem is a non-convex optimization problem with enormous search space and there is high level of noise in the input images, the existing methods may produce biased or even wrong final models. In this work, to deal with the problem, consistent constraints from the input data are explored in an embedding space, a 3D spherical surface. More specifically, the orientation of a projection image is represented by two intersection points of the normal vector and the local X-axis vector of the projection image on the unit spherical surface. To determine the orientations of the projection images, the global consistency constraints of the relative orientations of all the projection images are satisfied by two spherical embeddings which estimate the normal vectors and the local X-axis vectors of the projection images respectively. Compared to the traditional methods, the proposed method is shown to be able to rectify the initial computation errors and produce a more accurate estimation of the projection angles, which results in a better final model reconstruction from the noisy image data.

A 3D reconstruction method using two spherical embeddings to resolve projection angles of the cryo-EM images is shown to improve the initial model reconstruction for single-particle analysis.

On bias, variance, overfitting, gold standard and consensus in single-particle analysis by cryo-electron microscopy

Cryo-electron microscopy (cryoEM) has become a well established technique to elucidate the 3D structures of biological macromolecules. Projection images from thousands of macromolecules that are assumed to be structurally identical are combined into a single 3D map representing the Coulomb potential of the macromolecule under study. This article discusses possible caveats along the image-processing path and how to avoid them to obtain a reliable 3D structure. Some of these problems are very well known in the community. These may be referred to as sample-related (such as specimen denaturation at interfaces or non-uniform projection geometry leading to underrepresented projection directions). The rest are related to the algorithms used. While some have been discussed in depth in the literature, such as the use of an incorrect initial volume, others have received much less attention. However, they are fundamental in any data-analysis approach. Chiefly among them, instabilities in estimating many of the key parameters that are required for a correct 3D reconstruction that occur all along the processing workflow are referred to, which may significantly affect the reliability of the whole process. In the field, the term overfitting has been coined to refer to some particular kinds of artifacts. It is argued that overfitting is a statistical bias in key parameter-estimation steps in the 3D reconstruction process, including intrinsic algorithmic bias. It is also shown that common tools (Fourier shell correlation) and strategies (gold standard) that are normally used to detect or prevent overfitting do not fully protect against it. Alternatively, it is proposed that detecting the bias that leads to overfitting is much easier when addressed at the level of parameter estimation, rather than detecting it once the particle images have been combined into a 3D map. Comparing the results from multiple algorithms (or at least, independent executions of the same algorithm) can detect parameter bias. These multiple executions could then be averaged to give a lower variance estimate of the underlying parameters.

Raw Data to Results: A Hands-On Introduction and Overview of Computational Analysis for Single-Molecule Localization Microscopy

Single-molecule localization microscopy (SMLM) is an advanced microscopy method that uses the blinking of fluorescent molecules to determine the position of these molecules with a resolution below the diffraction limit (∼5-40 nm). While SMLM imaging itself is becoming more popular, the computational analysis surrounding the technique is still a specialized area and often remains a "black box" for experimental researchers. Here, we provide an introduction to the required computational analysis of SMLM imaging, post-processing and typical data analysis. Importantly, user-friendly, ready-to-use and well-documented code in Python and MATLAB with exemplary data is provided as an interactive experience for the reader, as well as a starting point for further analysis. Our code is supplemented by descriptions of the computational problems and their implementation. We discuss the state of the art in computational methods and software suites used in SMLM imaging and data analysis. Finally, we give an outlook into further computational challenges in the field.

Machine Learning for Structure Determination in Single-Particle Cryo-Electron Microscopy: A Systematic Review

Recently, single-particle cryo-electron microscopy (cryo-EM) has become an indispensable method for determining macromolecular structures at high resolution to deeply explore the relevant molecular mechanism. Its recent breakthrough is mainly because of the rapid advances in hardware and image processing algorithms, especially machine learning. As an essential support of single-particle cryo-EM, machine learning has powered many aspects of structure determination and greatly promoted its development. In this article, we provide a systematic review of the applications of machine learning in this field. Our review begins with a brief introduction of single-particle cryo-EM, followed by the specific tasks and challenges of its image processing. Then, focusing on the workflow of structure determination, we describe relevant machine learning algorithms and applications at different steps, including particle picking, 2-D clustering, 3-D reconstruction, and other steps. As different tasks exhibit distinct characteristics, we introduce the evaluation metrics for each task and summarize their dynamics of technology development. Finally, we discuss the open issues and potential trends in this promising field.

Architecture and assembly mechanism of native glycine receptors

Glycine receptors (GlyRs) are pentameric, 'Cys-loop' receptors that form chloride-permeable channels and mediate fast inhibitory signalling throughout the central nervous system1,2. In the spinal cord and brainstem, GlyRs regulate locomotion and cause movement disorders when mutated2,3. However, the stoichiometry of native GlyRs and the mechanism by which they are assembled remain unclear, despite extensive investigation4-8. Here we report cryo-electron microscopy structures of native GlyRs from pig spinal cord and brainstem, revealing structural insights into heteromeric receptors and their predominant subunit stoichiometry of 4α:1β. Within the heteromeric pentamer, the β(+)-α(-) interface adopts a structure that is distinct from the α(+)-α(-) and α(+)-β(-) interfaces. Furthermore, the β-subunit contains a unique phenylalanine residue that resides within the pore and disrupts the canonical picrotoxin site. These results explain why inclusion of the β-subunit breaks receptor symmetry and alters ion channel pharmacology. We also find incomplete receptor complexes and, by elucidating their structures, reveal the architectures of partially assembled α-trimers and α-tetramers.

Deep learning improves macromolecule identification in 3D cellular cryo-electron tomograms

Cryogenic electron tomography (cryo-ET) visualizes the 3D spatial distribution of macromolecules at nanometer resolution inside native cells. However, automated identification of macromolecules inside cellular tomograms is challenged by noise and reconstruction artifacts, as well as the presence of many molecular species in the crowded volumes. Here, we present DeepFinder, a computational procedure that uses artificial neural networks to simultaneously localize multiple classes of macromolecules. Once trained, the inference stage of DeepFinder is faster than template matching and performs better than other competitive deep learning methods at identifying macromolecules of various sizes in both synthetic and experimental datasets. On cellular cryo-ET data, DeepFinder localized membrane-bound and cytosolic ribosomes (roughly 3.2 MDa), ribulose 1,5-bisphosphate carboxylase-oxygenase (roughly 560 kDa soluble complex) and photosystem II (roughly 550 kDa membrane complex) with an accuracy comparable to expert-supervised ground truth annotations. DeepFinder is therefore a promising algorithm for the semiautomated analysis of a wide range of molecular targets in cellular tomograms.

Validation, analysis and annotation of cryo-EM structures

The process of turning 2D micrographs into 3D atomic models of the imaged macromolecules has been under rapid development and scrutiny in the field of cryo-EM. Here, some important methods for validation at several stages in this process are described. Firstly, how Fourier shell correlation of two independent maps and phase randomization beyond a certain frequency address the assessment of map resolution is reviewed. Techniques for local resolution estimation and map sharpening are also touched upon. The topic of validating models which are either built de novo or based on a known atomic structure fitted into a cryo-EM map is then approached. Map-model comparison using Q-scores and Fourier shell correlation plots is used to assure the agreement of the model with the observed map density. The importance of annotating the model with B factors to account for the resolvability of individual atoms in the map is illustrated. Finally, the timely topic of detecting and validating water molecules and metal ions in maps that have surpassed ∼2 Å resolution is described.

Locating macromolecular assemblies in cells by 2D template matching with cisTEM

For a more complete understanding of molecular mechanisms, it is important to study macromolecules and their assemblies in the broader context of the cell. This context can be visualized at nanometer resolution in three dimensions (3D) using electron cryo-tomography, which requires tilt series to be recorded and computationally aligned, currently limiting throughput. Additionally, the high-resolution signal preserved in the raw tomograms is currently limited by a number of technical difficulties, leading to an increased false-positive detection rate when using 3D template matching to find molecular complexes in tomograms. We have recently described a 2D template matching approach that addresses these issues by including high-resolution signal preserved in single-tilt images. A current limitation of this approach is the high computational cost that limits throughput. We describe here a GPU-accelerated implementation of 2D template matching in the image processing software cisTEM that allows for easy scaling and improves the accessibility of this approach. We apply 2D template matching to identify ribosomes in images of frozen-hydrated Mycoplasma pneumoniae cells with high precision and sensitivity, demonstrating that this is a versatile tool for in situ visual proteomics and in situ structure determination. We benchmark the results with 3D template matching of tomograms acquired on identical sample locations and identify strengths and weaknesses of both techniques, which offer complementary information about target localization and identity.

Current data processing strategies for cryo-electron tomography and subtomogram averaging

Cryo-electron tomography (cryo-ET) can be used to reconstruct three-dimensional (3D) volumes, or tomograms, from a series of tilted two-dimensional images of biological objects in their near-native states in situ or in vitro. 3D subvolumes, or subtomograms, containing particles of interest can be extracted from tomograms, aligned, and averaged in a process called subtomogram averaging (STA). STA overcomes the low signal to noise ratio within the individual subtomograms to generate structures of the particle(s) of interest. In recent years, cryo-ET with STA has increasingly been capable of reaching subnanometer resolution due to improvements in microscope hardware and data processing strategies. There has also been an increase in the number and quality of software packages available to process cryo-ET data with STA. In this review, we describe and assess the data processing strategies available for cryo-ET data and highlight the recent software developments which have enabled the extraction of high-resolution information from cryo-ET datasets.

Experimental Demonstration of an Electrostatic Orbital Angular Momentum Sorter for Electron Beams

The component of orbital angular momentum (OAM) in the propagation direction is one of the fundamental quantities of an electron wave function that describes its rotational symmetry and spatial chirality. Here, we demonstrate experimentally an electrostatic sorter that can be used to analyze the OAM states of electron beams in a transmission electron microscope. The device achieves postselection or sorting of OAM states after electron-material interactions, thereby allowing the study of new material properties such as the magnetic states of atoms. The required electron-optical configuration is achieved by using microelectromechanical systems technology and focused ion beam milling to control the electron phase electrostatically with a lateral resolution of 50 nm. An OAM resolution of 1.5ℏ is realized in tests on controlled electron vortex beams, with the perspective of reaching an optimal OAM resolution of 1ℏ in the near future.

[Progress in filters for denoising cryo-electron microscopy images]

Cryo-electron microscopy (cryo-EM) imaging has the unique potential to bridge the gap between cellular and molecular biology. Therefore, cryo-EM three-dimensional (3D) reconstruction has been rapidly developed in recent several years and applied widely in life science research to reveal the structures of large macromolecular assemblies and cellular complexes, which is critical to understanding their functions at all scales. Although the technical breakthrough in recent years, for example, the introduction of the direct detection device (DDD) camera and the development of cryo-EM software tools, made the three cryo-EM pioneers share the 2017 Nobel Prize, several bottleneck problems still exist that hamper the further increase of the resolution of single-particle reconstruction and hold back the application of in situ subnanometer structure determination by cryo-tomography. Radiation damage is still the key limiting factor in cryo-EM. In order to minimize the radiation damage and preserve as much resolution as possible, the imaging conditions of a low dose and weak contrast make cryo-EM images extremely noisy with very low signal-to-noise ratios (SNR), generally about 0.1. The high noise will obscure the fine details in cryo-EM images or reconstructed maps. Thus, a method to reduce the level of noise and improve the resolution has become an important issue. In this paper, we systematically reviewed and compared some robust filters in the cryo-EM field of two aspects, single-particle analysis (SPA) and cryo-electron tomography (cryo-ET), and especially studied their applications, such as, 3D reconstruction, visualization, structural analysis, and interpretation. Conventional approaches to noise reduction in cryo-EM imaging include the use of Gaussian, median, and bilateral filters, among other means. A Gaussian filter selects an appropriate filter kernel to conduct spatial convolution with a noisy image. Although noise with larger standard deviations in cryo-EM images can be suppressed and satisfactory performance is achieved in certain cases, this filter also blurs the images and over-smooths small-scale image features. This is especially detrimental when precise quantitative information needs to be extracted. Unlike a Gaussian filter, a median filter is based on the order statistics of the image and selects the median intensity in a window of the adjacent pixels to denoise the image. Although this filter is robust to outliers, it suffers from aliasing problems that possibly result in incorrect information for cryo-EM structure interpretation. A bilateral filter is a nonlinear filter that performs spatial weighted averaging and is more selective in the pixels allowing to contribute to the weighted sum, excluding the high frequency noise from the smoothing process. Thus, this filter can be used to smooth out noise while maintaining the edge details, which is similar to an anisotropic diffusion filter, and distinct from a Gaussian filter but its utility will be limited when the SNR of a cryo-EM image is very low. Generally, spatial filtering methods have the disadvantage of losing image resolution when reducing noise. A wavelet transform can exploit the wavelet's natural ability to separate a signal from noise at multiple image scales to allow for joint resolution in both the spatial and frequency domains, and thus has the potential to outperform existing methods. The modified wavelet shrinkage filter we developed can offer a remarkable improvement in image quality with a good compromise between detail preservation and noise smoothing. We expect that our review study on different filters can provide benefits to cryo-EM applications and the interpretation of biological structures.

Electron microscopy as a critical tool in the determination of pore forming mechanisms in proteins

Electron microscopy has consistently played an important role in the description of pore-forming protein systems. The discovery of pore-forming proteins has depended on visualization of the structural pores formed by their oligomeric protein complexes, and as electron microscopy has advanced technologically so has the degree of insight it has been able to give. This review considers a large number of published studies of pore-forming complexes in prepore and pore states determined using single-particle cryo-electron microscopy. Sample isolation and preparation, imaging and image analysis, structure determination and optimization of results are all discussed alongside challenges which pore-forming proteins particularly present. The review also considers the use made of cryo-electron tomography to study pores within their membrane environment and which will prove an increasingly important approach for the future.

In situ Electron Microscopy of Complex Biological and Nanoscale Systems: Challenges and Opportunities

In situ imaging for direct visualization is important for physical and biological sciences. Research endeavors into elucidating dynamic biological and nanoscale phenomena frequently necessitate in situ and time-resolved imaging. In situ liquid cell electron microscopy (LC-EM) can overcome certain limitations of conventional electron microscopies and offer great promise. This review aims to examine the status-quo and practical challenges of in situ LC-EM and its applications, and to offer insights into a novel correlative technique termed microfluidic liquid cell electron microscopy. We conclude by suggesting a few research ideas adopting microfluidic LC-EM for in situ imaging of biological and nanoscale systems.