Ureidoglycolate hydrolase, amidohydrolase, lyase: how errors in biological databases are incorporated in scientific papers and vice versa

Biological databases in the age of generative artificial intelligence

Summary

Modern biological research critically depends on public databases. The introduction and propagation of errors within and across databases can lead to wasted resources as scientists are led astray by bad data or have to conduct expensive validation experiments. The emergence of generative artificial intelligence systems threatens to compound this problem owing to the ease with which massive volumes of synthetic data can be generated. We provide an overview of several key issues that occur within the biological data ecosystem and make several recommendations aimed at reducing data errors and their propagation. We specifically highlight the critical importance of improved educational programs aimed at biologists and life scientists that emphasize best practices in data engineering. We also argue for increased theoretical and empirical research on data provenance, error propagation, and on understanding the impact of errors on analytic pipelines. Furthermore, we recommend enhanced funding for the stewardship and maintenance of public biological databases.

Availability and implementation

Not applicable.

Limitations of Current Machine-Learning Models in Predicting Enzymatic Functions for Uncharacterized Proteins

Thirty to seventy percent of proteins in any given genome have no assigned function and have been labeled as the protein "unknome". This large knowledge gap prevents the biological community from fully leveraging the plethora of genomic data that is now available. Machine-learning approaches are showing some promise in propagating functional knowledge from experimentally characterized proteins to the correct set of isofunctional orthologs. However, they largely fail to predict enzymatic functions unseen in the training set, as shown by dissecting the predictions made for over 450 enzymes of unknown function from the model bacteria Escherichia coli uxgsing the DeepECTransformer platform. Lessons from these failures can help the community develop machine-learning methods that assist domain experts in making testable functional predictions for more members of the uncharacterized proteome.

Article Summary

Many proteins in any genome, ranging from 30 to 70%, lack an assigned function. This knowledge gap limits the full use of the vast available genomic data. Machine learning has shown promise in transferring functional knowledge from proteins of known functions to similar ones, but largely fails to predict novel functions not seen in its training data. Understanding these failures can guide the development of better machine-learning methods to help experts make accurate functional predictions for uncharacterized proteins.

The HABD: Home of All Biological Databases Empowering Biological Research With Cutting-Edge Database Systems

The emergence of computer technologies and computing power has led to the development of several database systems that provide standardized access to vast quantities of data, making it possible to collect, search, index, evaluate, and extract useful knowledge across various fields. The Home of All Biological Databases (HABD) has been established as a continually expanding platform that aims to store, organize, and distribute biological data in a searchable manner, removing all dead and non-accessible data. The platform meticulously categorizes data into various categories, such as COVID-19 Pandemic Database (CO-19PDB), Database relevant to Human Research (DBHR), Cancer Research Database (CRDB), Latest Database of Protein Research (LDBPR), Fungi Databases Collection (FDBC), and many other databases that are categorized based on biological phenomena. It currently provides a total of 22 databases, including 6 published, 5 submitted, and the remaining in various stages of development. These databases encompass a range of areas, including phytochemical-specific and plastic biodegradation databases. HABD is equipped with search engine optimization (SEO) analyzer and Neil Patel tools, which ensure excellent SEO and high-speed value. With timely updates, HABD aims to facilitate the processing and visualization of data for scientists, providing a one-stop-shop for all biological databases. Computer platforms, such as PhP, html, CSS, Java script and Biopython, are used to build all the databases. © 2024 Wiley Periodicals LLC.

Identification of hidden associations among eukaryotic genes through statistical analysis of coevolutionary transitions

Coevolution at the gene level, as reflected by correlated events of gene loss or gain, can be revealed by phylogenetic profile analysis. The optimal method and metric for comparing phylogenetic profiles, especially in eukaryotic genomes, are not yet established. Here, we describe a procedure suitable for large-scale analysis, which can reveal coevolution based on the assessment of the statistical significance of correlated presence/absence transitions between gene pairs. This metric can identify coevolution in profiles with low overall similarities and is not affected by similarities lacking coevolutionary information. We applied the procedure to a large collection of 60,912 orthologous gene groups (orthogroups) in 1,264 eukaryotic genomes extracted from OrthoDB. We found significant cotransition scores for 7,825 orthogroups associated in 2,401 coevolving modules linking known and unknown genes in protein complexes and biological pathways. To demonstrate the ability of the method to predict hidden gene associations, we validated through experiments the involvement of vertebrate malate synthase-like genes in the conversion of (S)-ureidoglycolate into glyoxylate and urea, the last step of purine catabolism. This identification explains the presence of glyoxylate cycle genes in metazoa and suggests an anaplerotic role of purine degradation in early eukaryotes.

Purine catabolism by enterobacteria

Purines are abundant among organic nitrogen sources and have high nitrogen content. Accordingly, microorganisms have evolved different pathways to catabolize purines and their metabolic products such as allantoin. Enterobacteria from the genera Escherichia, Klebsiella and Salmonella have three such pathways. First, the HPX pathway, found in the genus Klebsiella and very close relatives, catabolizes purines during aerobic growth, extracting all four nitrogen atoms in the process. This pathway includes several known or predicted enzymes not previously observed in other purine catabolic pathways. Second, the ALL pathway, found in strains from all three species, catabolizes allantoin during anaerobic growth in a branched pathway that also includes glyoxylate assimilation. This allantoin fermentation pathway originally was characterized in a gram-positive bacterium, and therefore is widespread. Third, the XDH pathway, found in strains from Escherichia and Klebsiella spp., at present is ill-defined but likely includes enzymes to catabolize purines during anaerobic growth. Critically, this pathway may include an enzyme system for anaerobic urate catabolism, a phenomenon not previously described. Documenting such a pathway would overturn the long-held assumption that urate catabolism requires oxygen. Overall, this broad capability for purine catabolism during either aerobic or anaerobic growth suggests that purines and their metabolites contribute to enterobacterial fitness in a variety of environments.

A roadmap for the functional annotation of protein families: a community perspective

Over the last 25 years, biology has entered the genomic era and is becoming a science of 'big data'. Most interpretations of genomic analyses rely on accurate functional annotations of the proteins encoded by more than 500 000 genomes sequenced to date. By different estimates, only half the predicted sequenced proteins carry an accurate functional annotation, and this percentage varies drastically between different organismal lineages. Such a large gap in knowledge hampers all aspects of biological enterprise and, thereby, is standing in the way of genomic biology reaching its full potential. A brainstorming meeting to address this issue funded by the National Science Foundation was held during 3-4 February 2022. Bringing together data scientists, biocurators, computational biologists and experimentalists within the same venue allowed for a comprehensive assessment of the current state of functional annotations of protein families. Further, major issues that were obstructing the field were identified and discussed, which ultimately allowed for the proposal of solutions on how to move forward.

Turtle ants harbor metabolically versatile microbiomes with conserved functions across development and phylogeny

Gut bacterial symbionts can support animal nutrition by facilitating digestion and providing valuable metabolites. However, changes in symbiotic roles between immature and adult stages are not well documented, especially in ants. Here, we explored the metabolic capabilities of microbiomes sampled from herbivorous turtle ant (Cephalotes sp.) larvae and adult workers through (meta)genomic screening and in vitro metabolic assays. We reveal that larval guts harbor bacterial symbionts with impressive metabolic capabilities, including catabolism of plant and fungal recalcitrant dietary fibers and energy-generating fermentation. Additionally, several members of the specialized adult gut microbiome, sampled downstream of an anatomical barrier that dams large food particles, show a conserved potential to depolymerize many dietary fibers. Symbionts from both life stages have the genomic capacity to recycle nitrogen and synthesize amino acids and B-vitamins. With help of their gut symbionts, including several bacteria likely acquired from the environment, turtle ant larvae may aid colony digestion and contribute to colony-wide nitrogen, B-vitamin and energy budgets. In addition, the conserved nature of the digestive capacities among adult-associated symbionts suggests that nutritional ecology of turtle ant colonies has long been shaped by specialized, behaviorally-transferred gut bacteria with over 45 million years of residency.

ARGDIT: a validation and integration toolkit for Antimicrobial Resistance Gene Databases

MOTIVATION

Antimicrobial resistance is currently one of the main challenges in public health due to the excessive use of antimicrobials in medical treatments and agriculture. The advancements in high-throughput next-generation sequencing and development of bioinformatics tools allow simultaneous detection and identification of antimicrobial resistance genes (ARGs) from clinical, food and environment samples, to monitor the prevalence and track the dissemination of these ARGs. Such analyses are however reliant on a comprehensive database of ARGs with accurate sequence content and annotation. Most of the current ARG databases are therefore manually curated, but this is a time-consuming process and the resulting curation errors could be hard to detect. Several secondary ARG databases consolidate contents from different source ARG databases, and hence modifications in the primary databases might not be propagated and updated promptly in the secondary ARG databases.

RESULTS

To address these problems, a validation and integration toolkit called ARGDIT was developed to validate ARG database fidelity, and merge multiple primary ARG databases into a single consolidated secondary ARG database with optional automated sequence re-annotation. Experimental results demonstrated the effectiveness of this toolkit in identifying errors such as sequence annotation typos in current ARG databases and generating an integrated non-redundant ARG database with structured annotation. A toolkit-oriented workflow is also proposed to minimize the efforts in validating, curating and merging multiple ARG protein or coding sequence databases. Database developers therefore benefit from faster update cycles and lower costs for database maintenance, while ARG pipeline users can easily evaluate the reference ARG database quality.

AVAILABILITY AND IMPLEMENTATION

ARGDIT is available at https://github.com/phglab/ARGDIT.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Nephromyces Encodes a Urate Metabolism Pathway and Predicted Peroxisomes, Demonstrating That These Are Not Ancient Losses of Apicomplexans

The phylum Apicomplexa is a quintessentially parasitic lineage, whose members infect a broad range of animals. One exception to this may be the apicomplexan genus Nephromyces, which has been described as having a mutualistic relationship with its host. Here we analyze transcriptome data from Nephromyces and its parasitic sister taxon, Cardiosporidium, revealing an ancestral purine degradation pathway thought to have been lost early in apicomplexan evolution. The predicted localization of many of the purine degradation enzymes to peroxisomes, and the in silico identification of a full set of peroxisome proteins, indicates that loss of both features in other apicomplexans occurred multiple times. The degradation of purines is thought to play a key role in the unusual relationship between Nephromyces and its host. Transcriptome data confirm previous biochemical results of a functional pathway for the utilization of uric acid as a primary nitrogen source for this unusual apicomplexan.

Automated detection of records in biological sequence databases that are inconsistent with the literature

We investigate and analyse the data quality of nucleotide sequence databases with the objective of automatic detection of data anomalies and suspicious records. Specifically, we demonstrate that the published literature associated with each data record can be used to automatically evaluate its quality, by cross-checking the consistency of the key content of the database record with the referenced publications. Focusing on GenBank, we describe a set of quality indicators based on the relevance paradigm of information retrieval (IR). Then, we use these quality indicators to train an anomaly detection algorithm to classify records as "confident" or "suspicious". Our experiments on the PubMed Central collection show assessing the coherence between the literature and database records, through our algorithms, is an effective mechanism for assisting curators to perform data cleansing. Although fewer than 0.25% of the records in our data set are known to be faulty, we would expect that there are many more in GenBank that have not yet been identified. By automated comparison with literature they can be identified with a precision of up to 10% and a recall of up to 30%, while strongly outperforming several baselines. While these results leave substantial room for improvement, they reflect both the very imbalanced nature of the data, and the limited explicitly labelled data that is available. Overall, the obtained results show promise for the development of a new kind of approach to detecting low-quality and suspicious sequence records based on literature analysis and consistency. From a practical point of view, this will greatly help curators in identifying inconsistent records in large-scale sequence databases by highlighting records that are likely to be inconsistent with the literature.

Coping with inevitable accidents in metabolism

Genomic studies focus on key metabolites and pathways that, despite their obvious anthropocentric design, keep being 'predicted', while this is only finding again what is already known. As increasingly more genomes are sequenced, this lightpost effect may account at least in part for our failure to understand the function of a continuously growing number of genes. Core metabolism often goes astray, accidentally producing a variety of unexpected compounds. Catabolism of these forgotten metabolites makes an essential part of the functions coded in metagenomes. Here, I explore the fate of a limited number of those: compounds resulting from radical reactions and molecules derived from some reactive intermediates produced during normal metabolism. I try both to update investigators with the most recent literature and to uncover old articles that may open up new research avenues in the genome exploration of metabolism. This should allow us to foresee further developments in experimental genomics and genome annotation.

Functional Annotations of Paralogs: A Blessing and a Curse

Gene duplication followed by mutation is a classic mechanism of neofunctionalization, producing gene families with functional diversity. In some cases, a single point mutation is sufficient to change the substrate specificity and/or the chemistry performed by an enzyme, making it difficult to accurately separate enzymes with identical functions from homologs with different functions. Because sequence similarity is often used as a basis for assigning functional annotations to genes, non-isofunctional gene families pose a great challenge for genome annotation pipelines. Here we describe how integrating evolutionary and functional information such as genome context, phylogeny, metabolic reconstruction and signature motifs may be required to correctly annotate multifunctional families. These integrative analyses can also lead to the discovery of novel gene functions, as hints from specific subgroups can guide the functional characterization of other members of the family. We demonstrate how careful manual curation processes using comparative genomics can disambiguate subgroups within large multifunctional families and discover their functions. We present the COG0720 protein family as a case study. We also discuss strategies to automate this process to improve the accuracy of genome functional annotation pipelines.

Supervised Learning for Detection of Duplicates in Genomic Sequence Databases

MOTIVATION

First identified as an issue in 1996, duplication in biological databases introduces redundancy and even leads to inconsistency when contradictory information appears. The amount of data makes purely manual de-duplication impractical, and existing automatic systems cannot detect duplicates as precisely as can experts. Supervised learning has the potential to address such problems by building automatic systems that learn from expert curation to detect duplicates precisely and efficiently. While machine learning is a mature approach in other duplicate detection contexts, it has seen only preliminary application in genomic sequence databases.

RESULTS

We developed and evaluated a supervised duplicate detection method based on an expert curated dataset of duplicates, containing over one million pairs across five organisms derived from genomic sequence databases. We selected 22 features to represent distinct attributes of the database records, and developed a binary model and a multi-class model. Both models achieve promising performance; under cross-validation, the binary model had over 90% accuracy in each of the five organisms, while the multi-class model maintains high accuracy and is more robust in generalisation. We performed an ablation study to quantify the impact of different sequence record features, finding that features derived from meta-data, sequence identity, and alignment quality impact performance most strongly. The study demonstrates machine learning can be an effective additional tool for de-duplication of genomic sequence databases. All Data are available as described in the supplementary material.

Annotation inconsistencies beyond sequence similarity-based function prediction - phylogeny and genome structure

The function annotation process in computational biology has increasingly shifted from the traditional characterization of individual biochemical roles of protein molecules to the system-wide detection of entire metabolic pathways and genomic structures. The so-called genome-aware methods broaden misannotation inconsistencies in genome sequences beyond protein function assignments, encompassing phylogenetic anomalies and artifactual genomic regions. We outline three categories of error propagation in databases by providing striking examples – at various levels of appreciation by the community from traditional to emerging, thus raising awareness for future solutions.

Curation accuracy of model organism databases

Manual extraction of information from the biomedical literature-or biocuration-is the central methodology used to construct many biological databases. For example, the UniProt protein database, the EcoCyc Escherichia coli database and the Candida Genome Database (CGD) are all based on biocuration. Biological databases are used extensively by life science researchers, as online encyclopedias, as aids in the interpretation of new experimental data and as golden standards for the development of new bioinformatics algorithms. Although manual curation has been assumed to be highly accurate, we are aware of only one previous study of biocuration accuracy. We assessed the accuracy of EcoCyc and CGD by manually selecting curated assertions within randomly chosen EcoCyc and CGD gene pages and by then validating that the data found in the referenced publications supported those assertions. A database assertion is considered to be in error if that assertion could not be found in the publication cited for that assertion. We identified 10 errors in the 633 facts that we validated across the two databases, for an overall error rate of 1.58%, and individual error rates of 1.82% for CGD and 1.40% for EcoCyc. These data suggest that manual curation of the experimental literature by Ph.D-level scientists is highly accurate. Database URL: http://ecocyc.org/, http://www.candidagenome.org//

Expert curation in UniProtKB: a case study on dealing with conflicting and erroneous data

UniProtKB/Swiss-Prot provides expert curation with information extracted from literature and curator-evaluated computational analysis. As knowledgebases continue to play an increasingly important role in scientific research, a number of studies have evaluated their accuracy and revealed various errors. While some are curation errors, others are the result of incorrect information published in the scientific literature. By taking the example of sirtuin-5, a complex annotation case, we will describe the curation procedure of UniProtKB/Swiss-Prot and detail how we report conflicting information in the database. We will demonstrate the importance of collaboration between resources to ensure curation consistency and the value of contributions from the user community in helping maintain error-free resources.

Database URL:www.uniprot.org