Automatic virus particle selection--the entropy approach

VISN: virus instance segmentation network for TEM images using deep attention transformer

The identification of viruses from negative staining transmission electron microscopy (TEM) images has mainly depended on experienced experts. Recent advances in artificial intelligence have enabled virus recognition using deep learning techniques. However, most of the existing methods only perform virus classification or semantic segmentation, and few studies have addressed the challenge of virus instance segmentation in TEM images. In this paper, we focus on the instance segmentation of severe acute respiratory syndrome coronavirus type 2 (SARS-CoV-2) and other respiratory viruses and provide experts with more effective information about viruses. We propose an effective virus instance segmentation network based on the You Only Look At CoefficienTs backbone, which integrates the Swin Transformer, dense connections and the coordinate-spatial attention mechanism, to identify SARS-CoV-2, H1N1 influenza virus, respiratory syncytial virus, Herpes simplex virus-1, Human adenovirus type 5 and Vaccinia virus. We also provide a public TEM virus dataset and conduct extensive comparative experiments. Our method achieves a mean average precision score of 83.8 and F1 score of 0.920, outperforming other state-of-the-art instance segmentation algorithms. The proposed automated method provides virologists with an effective approach for recognizing and identifying SARS-CoV-2 and assisting in the diagnosis of viruses. Our dataset and code are accessible at https://github.com/xiaochiHNU/Virus-Instance-Segmentation-Transformer-Network.

Virus Particle Detection by Convolutional Neural Network in Transmission Electron Microscopy Images

A new computational method for the detection of virus particles in transmission electron microscopy (TEM) images is presented. Our approach is to use a convolutional neural network that transforms a TEM image to a probabilistic map that indicates where virus particles exist in the image. Our proposed approach automatically and simultaneously learns both discriminative features and classifier for virus particle detection by machine learning, in contrast to existing methods that are based on handcrafted features that yield many false positives and require several postprocessing steps. The detection performance of the proposed method was assessed against a dataset of TEM images containing feline calicivirus particles and compared with several existing detection methods, and the state-of-the-art performance of the developed method for detecting virus was demonstrated. Since our method is based on supervised learning that requires both the input images and their corresponding annotations, it is basically used for detection of already-known viruses. However, the method is highly flexible, and the convolutional networks can adapt themselves to any virus particles by learning automatically from an annotated dataset.

Automatic detection and morphological delineation of bacteriophages in electron microscopy images

Automatic detection, recognition and geometric characterization of bacteriophages in electron microscopy images was the main objective of this work. A novel technique, combining phase congruency-based image enhancement, Hough transform-, Radon transform- and open active contours with free boundary conditions-based object detection was developed to detect and recognize the bacteriophages associated with infection and lysis of cyanobacteria Aphanizomenon flos-aquae. A random forest classifier designed to recognize phage capsids provided higher than 99% accuracy, while measurable phage tails were detected and associated with a correct capsid with 81.35% accuracy. Automatically derived morphometric measurements of phage capsids and tails exhibited lower variability than the ones obtained manually. The technique allows performing precise and accurate quantitative (e.g. abundance estimation) and qualitative (e.g. diversity and capsid size) measurements for studying the interactions between host population and different phages that infect the same host.