Application of machine learning based genome sequence analysis in pathogen identification

Infectious diseases caused by pathogenic microorganisms pose a serious threat to human health. Despite advances in molecular biology, genetics, computation, and medicinal chemistry, infectious diseases remain a significant public health concern. Addressing the challenges posed by pathogen outbreaks, pandemics, and antimicrobial resistance requires concerted interdisciplinary efforts. With the development of computer technology and the continuous exploration of artificial intelligence(AI)applications in the biomedical field, the automatic morphological recognition and image processing of microbial images under microscopes have advanced rapidly. The research team of Institute of Microbiology, Chinese Academy of Sciences has developed a single cell microbial identification technology combining Raman spectroscopy and artificial intelligence. Through laser Raman acquisition system and convolutional neural network analysis, the average accuracy rate of 95.64% has been achieved, and the identification can be completed in only 5 min. These technologies have shown substantial advantages in the visible morphological detection of pathogenic microorganisms, expanding anti-infective drug discovery, enhancing our understanding of infection biology, and accelerating the development of diagnostics. In this review, we discuss the application of AI-based machine learning in image analysis, genome sequencing data analysis, and natural language processing (NLP) for pathogen identification, highlighting the significant role of artificial intelligence in pathogen diagnosis. AI can improve the accuracy and efficiency of diagnosis, promote early detection and personalized treatment, and enhance public health safety.

AFM-YOLOv8s: An Accurate, Fast, and Highly Robust Model for Detection of Sporangia of Plasmopara viticola with Various Morphological Variants

Monitoring spores is crucial for predicting and preventing fungal- or oomycete-induced diseases like grapevine downy mildew. However, manual spore or sporangium detection using microscopes is time-consuming and labor-intensive, often resulting in low accuracy and slow processing speed. Emerging deep learning models like YOLOv8 aim to rapidly detect objects accurately but struggle with efficiency and accuracy when identifying various sporangia formations amidst complex backgrounds. To address these challenges, we developed an enhanced YOLOv8s, namely, AFM-YOLOv8s, by introducing an Adaptive Cross Fusion module, a lightweight feature extraction module FasterCSP (Faster Cross-Stage Partial Module), and a novel loss function MPDIoU (Minimum Point Distance Intersection over Union). AFM-YOLOv8s replaces the C2f module with FasterCSP, a more efficient feature extraction module, to reduce model parameter size and overall depth. In addition, we developed and integrated an Adaptive Cross Fusion Feature Pyramid Network to enhance the fusion of multiscale features within the YOLOv8 architecture. Last, we utilized the MPDIoU loss function to improve AFM-YOLOv8s' ability to locate bounding boxes and learn object spatial localization. Experimental results demonstrated AFM-YOLOv8s' effectiveness, achieving 91.3% accuracy (mean average precision at 50% IoU) on our custom grapevine downy mildew sporangium dataset-a notable improvement of 2.7% over the original YOLOv8 algorithm. FasterCSP reduced model complexity and size, enhanced deployment versatility, and improved real-time detection, chosen over C2f for easier integration despite minor accuracy trade-off. Currently, the AFM-YOLOv8s model is running as a backend algorithm in an open web application, providing valuable technical support for downy mildew prevention and control efforts and fungicide resistance studies.

A decision support system for the detection of cutaneous fungal infections using artificial intelligence

Cutaneous fungal infections are one of the most common skin conditions, hence, the burden of determining fungal elements upon microscopic examination with periodic acid-Schiff (PAS) and Gomori methenamine silver (GMS) stains, is very time consuming. Despite some morphological variability posing challenges to training artificial intelligence (AI)-based solutions, these structures are favored potential targets, enabling the recruitment of promising AI-based technologies. Herein, we present a novel AI solution for identifying skin fungal infections, potentially providing a decision support system for pathologists. Skin biopsies of patients diagnosed with a cutaneous fungal infection at the Sheba Medical Center, Israel between 2014 and 2023, were used. Samples were stained with PAS and GMS and digitized by the Philips IntelliSite scanner. DeePathology® STUDIO fungal elements were annotated and deemed as ground truth data after an overall revision by two specialist pathologists. Subsequently, they were used to create an AI-based solution, which has been further validated in other regions of interests. The study participants were divided into two cohorts. In the first cohort, the overall sensitivity of the algorithm was 0.8, specificity 0.97, F1 score 0.78; in the second, the overall sensitivity of the algorithm was 0.93, specificity 0.99, F1 score 0.95. The results obtained are encouraging as proof of concept for an AI-based fungi detection algorithm. DeePathology® STUDIO can be employed as a decision support system for pathologists when diagnosing a cutaneous fungal infection using PAS and GMS stains, thereby, saving time and money.

Innovative infrastructure to access Brazilian fungal diversity using deep learning

In the present investigation, we employ a novel and meticulously structured database assembled by experts, encompassing macrofungi field-collected in Brazil, featuring upwards of 13,894 photographs representing 505 distinct species. The purpose of utilizing this database is twofold: firstly, to furnish training and validation for convolutional neural networks (CNNs) with the capacity for autonomous identification of macrofungal species; secondly, to develop a sophisticated mobile application replete with an advanced user interface. This interface is specifically crafted to acquire images, and, utilizing the image recognition capabilities afforded by the trained CNN, proffer potential identifications for the macrofungal species depicted therein. Such technological advancements democratize access to the Brazilian Funga, thereby enhancing public engagement and knowledge dissemination, and also facilitating contributions from the populace to the expanding body of knowledge concerning the conservation of macrofungal species of Brazil.

Multidimensional discriminant analysis of species, strains and culture age of closely related entomopathogenic fungi using reflectance spectroscopy

The diversity of fungal strains is influenced by genetic and environmental factors, growth conditions and mycelium age, and the spectral features of fungal mycelia are associated with their biochemical, physiological, and structural traits. This study investigates whether intraspecific differences can be detected in two closely related entomopathogenic species, namely Cordyceps farinosa and Cordyceps fumosorosea, using ultraviolet A to shortwave infrared (UVA-SWIR) reflectance spectra. Phylogenetic analysis of all strains revealed a high degree of uniformity among the populations of both species. The characteristics resulting from variation in the species, as well as those resulting from the age of the cultures were determined. We cultured fungi on PDA medium and measured the reflectance of mycelia in the 350-2500 nm range after 10 and 17 days. We subjected the measurements to quadratic discriminant analysis (QDA) to identify the minimum number of bands containing meaningful information. We found that when the age of the fungal culture was known, species represented by a group of different strains could be distinguished with no more than 3-4 wavelengths, compared to 7-8 wavelengths when the age of the culture was unknown. At least 6-8 bands were required to distinguish cultures of a known species among different age groups. Distinguishing all strains within a species was more demanding: at least 10 bands were required for C. fumosorosea and 21 bands for C. farinosa. In conclusion, fungal differentiation using point reflectance spectroscopy gives reliable results when intraspecific and age variations are taken into account.

Fungal Skin Disease Classification Using the Convolutional Neural Network

Skin is the outer cover of our body, which protects vital organs from harm. This important body part is often affected by a series of infections caused by fungus, bacteria, viruses, allergies, and dust. Millions of people suffer from skin diseases. It is one of the common causes of infection in sub-Saharan Africa. Skin disease can also be the cause of stigma and discrimination. Early and accurate diagnosis of skin disease can be vital for effective treatment. Laser and photonics-based technologies are used for the diagnosis of skin disease. These technologies are expensive and not affordable, especially for resource-limited countries like Ethiopia. Hence, image-based methods can be effective in reducing cost and time. There are previous studies on image-based diagnosis for skin disease. However, there are few scientific studies on tinea pedis and tinea corporis. In this study, the convolution neural network (CNN) has been used to classify fungal skin disease. The classification was carried out on the four most common fungal skin diseases: tinea pedis, tinea capitis, tinea corporis, and tinea unguium. The dataset consisted of a total of 407 fungal skin lesions collected from Dr. Gerbi Medium Clinic, Jimma, Ethiopia. Normalization of image size, conversion of RGB to grayscale, and balancing the intensity of the image have been carried out. Images were normalized to three sizes: 120 × 120, 150 × 150, and 224 × 224. Then, augmentation was applied. The developed model classified the four common fungal skin diseases with 93.3% accuracy. Comparisons were made with similar CNN architectures: MobileNetV2 and ResNet 50, and the proposed model was superior to both. This study may be an important addition to the very limited work on the detection of fungal skin disease. It can be used to build an automated image-based screening system for dermatology at an initial stage.

Trends in forensic microbiology: From classical methods to deep learning

Forensic microbiology has been widely used in the diagnosis of causes and manner of death, identification of individuals, detection of crime locations, and estimation of postmortem interval. However, the traditional method, microbial culture, has low efficiency, high consumption, and a low degree of quantitative analysis. With the development of high-throughput sequencing technology, advanced bioinformatics, and fast-evolving artificial intelligence, numerous machine learning models, such as RF, SVM, ANN, DNN, regression, PLS, ANOSIM, and ANOVA, have been established with the advancement of the microbiome and metagenomic studies. Recently, deep learning models, including the convolutional neural network (CNN) model and CNN-derived models, improve the accuracy of forensic prognosis using object detection techniques in microorganism image analysis. This review summarizes the application and development of forensic microbiology, as well as the research progress of machine learning (ML) and deep learning (DL) based on microbial genome sequencing and microbial images, and provided a future outlook on forensic microbiology.

Advances Towards Automatic Detection and Classification of Parasites Microscopic Images Using Deep Convolutional Neural Network: Methods, Models and Research Directions

In the developing world, parasites are responsible for causing several serious health problems, with relatively high infections in human beings. The traditional manual light microscopy process of parasite recognition remains the golden standard approach for the diagnosis of parasitic species, but this approach is time-consuming, highly tedious, and also difficult to maintain consistency but essential in parasitological classification for carrying out several experimental observations. Therefore, it is meaningful to apply deep learning to address these challenges. Convolution Neural Network and digital slide scanning show promising results that can revolutionize the clinical parasitology laboratory by automating the process of classification and detection of parasites. Image analysis using deep learning methods have the potential to achieve high efficiency and accuracy. For this review, we have conducted a thorough investigation in the field of image detection and classification of various parasites based on deep learning. Online databases and digital libraries such as ACM, IEEE, ScienceDirect, Springer, and Wiley Online Library were searched to identify sufficient related paper collections. After screening of 200 research papers, 70 of them met our filtering criteria, which became a part of this study. This paper presents a comprehensive review of existing parasite classification and detection methods and models in chronological order, from traditional machine learning based techniques to deep learning based techniques. In this review, we also demonstrate the summary of machine learning and deep learning methods along with dataset details, evaluation metrics, methods limitations, and future scope over the one decade. The majority of the technical publications from 2012 to the present have been examined and summarized. In addition, we have discussed the future directions and challenges of parasites classification and detection to help researchers in understanding the existing research gaps. Further, this review provides support to researchers who require an effective and comprehensive understanding of deep learning development techniques, research, and future trends in the field of parasites detection and classification.

Technique Evolutions for Microorganism Detection in Complex Samples: A Review

Rapid detection of microorganisms is a major challenge in the medical and industrial sectors. In a pharmaceutical laboratory, contamination of medical products may lead to severe health risks for patients, such as sepsis. In the specific case of advanced therapy medicinal products, contamination must be detected as early as possible to avoid late production stop and unnecessary costs. Unfortunately, the conventional methods used to detect microorganisms are based on time-consuming and labor-intensive approaches. Therefore, it is important to find new tools to detect microorganisms in a shorter time frame. This review sums up the current methods and represents the evolution in techniques for microorganism detection. First, there is a focus on promising ligands, such as aptamers and antimicrobial peptides, cheaper to produce and with a broader spectrum of detection. Then, we describe methods achieving low limits of detection, thanks to Raman spectroscopy or precise handling of samples through microfluids devices. The last part is dedicated to techniques in real-time, such as surface plasmon resonance, preventing the risk of contamination. Detection of pathogens in complex biological fluids remains a scientific challenge, and this review points toward important areas for future research.

A state-of-the-art survey of object detection techniques in microorganism image analysis: from classical methods to deep learning approaches

Microorganisms play a vital role in human life. Therefore, microorganism detection is of great significance to human beings. However, the traditional manual microscopic detection methods have the disadvantages of long detection cycle, low detection accuracy in large orders, and great difficulty in detecting uncommon microorganisms. Therefore, it is meaningful to apply computer image analysis technology to the field of microorganism detection. Computer image analysis can realize high-precision and high-efficiency detection of microorganisms. In this review, first,we analyse the existing microorganism detection methods in chronological order, from traditional image processing and traditional machine learning to deep learning methods. Then, we analyze and summarize these existing methods and introduce some potential methods, including visual transformers. In the end, the future development direction and challenges of microorganism detection are discussed. In general, we have summarized 142 related technical papers from 1985 to the present. This review will help researchers have a more comprehensive understanding of the development process, research status, and future trends in the field of microorganism detection and provide a reference for researchers in other fields.

Applications of artificial neural networks in microorganism image analysis: a comprehensive review from conventional multilayer perceptron to popular convolutional neural network and potential visual transformer

Microorganisms are widely distributed in the human daily living environment. They play an essential role in environmental pollution control, disease prevention and treatment, and food and drug production. The analysis of microorganisms is essential for making full use of different microorganisms. The conventional analysis methods are laborious and time-consuming. Therefore, the automatic image analysis based on artificial neural networks is introduced to optimize it. However, the automatic microorganism image analysis faces many challenges, such as the requirement of a robust algorithm caused by various application occasions, insignificant features and easy under-segmentation caused by the image characteristic, and various analysis tasks. Therefore, we conduct this review to comprehensively discuss the characteristics of microorganism image analysis based on artificial neural networks. In this review, the background and motivation are introduced first. Then, the development of artificial neural networks and representative networks are presented. After that, the papers related to microorganism image analysis based on classical and deep neural networks are reviewed from the perspectives of different tasks. In the end, the methodology analysis and potential direction are discussed.

Microscopic Imaging and Labeling Dataset for the Detection of Pneumocystis jirovecii Using Methenamine Silver Staining Method

Pneumocystis jirovecii pneumonia is one of the diseases that most affects immunocompromised patients today, and under certain circumstances, it can be fatal. On the other hand, more and more automatic tools based on artificial intelligence are required every day to help diagnose diseases and thus optimize the resources of the healthcare system. It is therefore important to develop techniques and mechanisms that enable early diagnosis. One of the most widely used techniques in diagnostic laboratories for the detection of its etiological agent, Pneumocystis jirovecii, is optical microscopy. Therefore, an image dataset of 29 different patients is presented in this work, which can be used to detect whether a patient is positive or negative for this fungi. These images were taken in at least four random positions on the specimen holder. The dataset consists of a total of 137 RGB images. Likewise, it contains realistic, annotated, and high-quality microscope images. In addition, we provide image segmentation and labeling that can also be used in numerous studies based on artificial intelligence implementation. The labeling was also validated by an expert, allowing it to be used as a reference in the training of automatic algorithms with supervised learning methods and thus to develop diagnostic assistance systems. Therefore, the dataset will open new opportunities for researchers working in image segmentation, detection, and classification problems related to Pneumocystis jirovecii pneumonia diagnosis.

Automatic Fungi Recognition: Deep Learning Meets Mycology

The article presents an AI-based fungi species recognition system for a citizen-science community. The system's real-time identification too - FungiVision - with a mobile application front-end, led to increased public interest in fungi, quadrupling the number of citizens collecting data. FungiVision, deployed with a human-in-the-loop, reaches nearly 93% accuracy. Using the collected data, we developed a novel fine-grained classification dataset - Danish Fungi 2020 (DF20) - with several unique characteristics: species-level labels, a small number of errors, and rich observation metadata. The dataset enables the testing of the ability to improve classification using metadata, e.g., time, location, habitat and substrate, facilitates classifier calibration testing and finally allows the study of the impact of the device settings on the classification performance. The continual flow of labelled data supports improvements of the online recognition system. Finally, we present a novel method for the fungi recognition service, based on a Vision Transformer architecture. Trained on DF20 and exploiting available metadata, it achieves a recognition error that is 46.75% lower than the current system. By providing a stream of labeled data in one direction, and an accuracy increase in the other, the collaboration creates a virtuous cycle helping both communities.

Machine Learning and Deep Learning Based Computational Approaches in Automatic Microorganisms Image Recognition: Methodologies, Challenges, and Developments

Microorganisms or microbes comprise majority of the diversity on earth and are extremely important to human life. They are also integral to processes in the ecosystem. The process of their recognition is highly tedious, but very much essential in microbiology to carry out different experimentation. To overcome certain challenges, machine learning techniques assist microbiologists in automating the entire process. This paper presents a systematic review of research done using machine learning (ML) and deep leaning techniques in image recognition of different microorganisms. This review investigates certain research questions to analyze the studies concerning image pre-processing, feature extraction, classification techniques, evaluation measures, methodological limitations and technical development over a period of time. In addition to this, this paper also addresses the certain challenges faced by researchers in this field. Total of 100 research publications in the chronological order of their appearance have been considered for the time period 1995-2021. This review will be extremely beneficial to the researchers due to the detailed analysis of different methodologies and comprehensive overview of effectiveness of different ML techniques being applied in microorganism image recognition field.

Deep convolutional neural network: a novel approach for the detection of Aspergillus fungi via stereomicroscopy

Fungi of the genus Aspergillus are ubiquitously distributed in nature, and some cause invasive aspergillosis (IA) infections in immunosuppressed individuals and contamination in agricultural products. Because microscopic observation and molecular detection of Aspergillus species represent the most operator-dependent and time-intensive activities, automated and cost-effective approaches are needed. To address this challenge, a deep convolutional neural network (CNN) was used to investigate the ability to classify various Aspergillus species. Using a dissecting microscopy (DM)/stereomicroscopy platform, colonies on plates were scanned with a 35× objective, generating images of sufficient resolution for classification. A total of 8,995 original colony images from seven Aspergillus species cultured in enrichment medium were gathered and autocut to generate 17,142 image crops as training and test datasets containing the typical representative morphology of conidiophores or colonies of each strain. Encouragingly, the Xception model exhibited a classification accuracy of 99.8% on the training image set. After training, our CNN model achieved a classification accuracy of 99.7% on the test image set. Based on the Xception performance during training and testing, this classification algorithm was further applied to recognize and validate a new set of raw images of these strains, showing a detection accuracy of 98.2%. Thus, our study demonstrated a novel concept for an artificial-intelligence-based and cost-effective detection methodology for Aspergillus organisms, which also has the potential to improve the public's understanding of the fungal kingdom.

Deep Learning for Imaging and Detection of Microorganisms

Despite tremendous recent interest, the application of deep learning in microbiology has still not reached its full potential. To tackle the challenges faced by human-operated microscopy, deep-learning-based methods have been proposed for microscopic image analysis of a wide range of microorganisms, including viruses, bacteria, fungi, and parasites. We believe that deep-learning technology-based systems will be on the front line of monitoring and investigation of microorganisms.