Machine Learning for Structure Determination in Single-Particle Cryo-Electron Microscopy: A Systematic Review

PlaneSeg: Building a Plug-In for Boosting Planar Region Segmentation

Existing methods in planar region segmentation suffer the problems of vague boundaries and failure to detect small-sized regions. To address these, this study presents an end-to-end framework, named PlaneSeg, which can be easily integrated into various plane segmentation models. Specifically, PlaneSeg contains three modules, namely, the edge feature extraction module, the multiscale module, and the resolution-adaptation module. First, the edge feature extraction module produces edge-aware feature maps for finer segmentation boundaries. The learned edge information acts as a constraint to mitigate inaccurate boundaries. Second, the multiscale module combines feature maps of different layers to harvest spatial and semantic information from planar objects. The multiformity of object information can help recognize small-sized objects to produce more accurate segmentation results. Third, the resolution-adaptation module fuses the feature maps produced by the two aforementioned modules. For this module, a pairwise feature fusion is adopted to resample the dropped pixels and extract more detailed features. Extensive experiments demonstrate that PlaneSeg outperforms other state-of-the-art approaches on three downstream tasks, including plane segmentation, 3-D plane reconstruction, and depth prediction. Code is available at https://github.com/nku-zhichengzhang/PlaneSeg.

The dynamic duo: cryo-EM teams up with machine learning to visualize biomolecules in motion

Cryo-EM has been a key technique in our understanding of biomolecular structures. Now, machine learning techniques are being used to put these structures in motion, revealing dynamic interactions and processes happening on a molecular and cellular level.[Formula: see text].

Cryo-electron microscopy-based drug design

Structure-based drug design (SBDD) has gained popularity owing to its ability to develop more potent drugs compared to conventional drug-discovery methods. The success of SBDD relies heavily on obtaining the three-dimensional structures of drug targets. X-ray crystallography is the primary method used for solving structures and aiding the SBDD workflow; however, it is not suitable for all targets. With the resolution revolution, enabling routine high-resolution reconstruction of structures, cryogenic electron microscopy (cryo-EM) has emerged as a promising alternative and has attracted increasing attention in SBDD. Cryo-EM offers various advantages over X-ray crystallography and can potentially replace X-ray crystallography in SBDD. To fully utilize cryo-EM in drug discovery, understanding the strengths and weaknesses of this technique and noting the key advancements in the field are crucial. This review provides an overview of the general workflow of cryo-EM in SBDD and highlights technical innovations that enable its application in drug design. Furthermore, the most recent achievements in the cryo-EM methodology for drug discovery are discussed, demonstrating the potential of this technique for advancing drug development. By understanding the capabilities and advancements of cryo-EM, researchers can leverage the benefits of designing more effective drugs. This review concludes with a discussion of the future perspectives of cryo-EM-based SBDD, emphasizing the role of this technique in driving innovations in drug discovery and development. The integration of cryo-EM into the drug design process holds great promise for accelerating the discovery of new and improved therapeutic agents to combat various diseases.

An Unsupervised Classification Algorithm for Heterogeneous Cryo-EM Projection Images Based on Autoencoders

Heterogeneous three-dimensional (3D) reconstruction in single-particle cryo-electron microscopy (cryo-EM) is an important but very challenging technique for recovering the conformational heterogeneity of flexible biological macromolecules such as proteins in different functional states. Heterogeneous projection image classification is a feasible solution to solve the structural heterogeneity problem in single-particle cryo-EM. The majority of heterogeneous projection image classification methods are developed using supervised learning technology or require a large amount of a priori knowledge, such as the orientations or common lines of the projection images, which leads to certain limitations in their practical applications. In this paper, an unsupervised heterogeneous cryo-EM projection image classification algorithm based on autoencoders is proposed, which only needs to know the number of heterogeneous 3D structures in the dataset and does not require any labeling information of the projection images or other a priori knowledge. A simple autoencoder with multi-layer perceptrons trained in iterative mode and a complex autoencoder with residual networks trained in one-pass learning mode are implemented to convert heterogeneous projection images into latent variables. The extracted high-dimensional features are reduced to two dimensions using the uniform manifold approximation and projection dimensionality reduction algorithm, and then clustered using the spectral clustering algorithm. The proposed algorithm is applied to two heterogeneous cryo-EM datasets for heterogeneous 3D reconstruction. Experimental results show that the proposed algorithm can effectively extract category features of heterogeneous projection images and achieve high classification and reconstruction accuracy, indicating that the proposed algorithm is effective for heterogeneous 3D reconstruction in single-particle cryo-EM.

Machine learning in electron microscopy for advanced nanocharacterization: current developments, available tools and future outlook

In the last few years, electron microscopy has experienced a new methodological paradigm aimed to fix the bottlenecks and overcome the challenges of its analytical workflow. Machine learning and artificial intelligence are answering this call providing powerful resources towards automation, exploration, and development. In this review, we evaluate the state-of-the-art of machine learning applied to electron microscopy (and obliquely, to materials and nano-sciences). We start from the traditional imaging techniques to reach the newest higher-dimensionality ones, also covering the recent advances in spectroscopy and tomography. Additionally, the present review provides a practical guide for microscopists, and in general for material scientists, but not necessarily advanced machine learning practitioners, to straightforwardly apply the offered set of tools to their own research. To conclude, we explore the state-of-the-art of other disciplines with a broader experience in applying artificial intelligence methods to their research (e.g., high-energy physics, astronomy, Earth sciences, and even robotics, videogames, or marketing and finances), in order to narrow down the incoming future of electron microscopy, its challenges and outlook.