ErrorTracer: an algorithm for identifying the origins of inconsistencies in genome-scale metabolic models

MACAW: a method for semi-automatic detection of errors in genome-scale metabolic models

Genome-scale metabolic models (GSMMs) are used to predict metabolic fluxes, with applications ranging from identifying novel drug targets to engineering microbial metabolism. Erroneous or missing reactions, scattered throughout densely interconnected networks, are a limiting factor in these applications. We present Metabolic Accuracy Check and Analysis Workflow (MACAW), a suite of algorithms that helps to identify and visualize errors at the level of connected pathways, rather than individual reactions. We show how MACAW highlights inaccuracies of varying severity in manually curated and automatically generated GSMMs for humans, yeast, and bacteria and helps to identify systematic issues to be addressed in future model construction efforts.

Semi-Automatic Detection of Errors in Genome-Scale Metabolic Models

Background

Genome-Scale Metabolic Models (GSMMs) are used for numerous tasks requiring computational estimates of metabolic fluxes, from predicting novel drug targets to engineering microbes to produce valuable compounds. A key limiting step in most applications of GSMMs is ensuring their representation of the target organism's metabolism is complete and accurate. Identifying and visualizing errors in GSMMs is complicated by the fact that they contain thousands of densely interconnected reactions. Furthermore, many errors in GSMMs only become apparent when considering pathways of connected reactions collectively, as opposed to examining reactions individually.

Results

We present Metabolic Accuracy Check and Analysis Workflow (MACAW), a collection of algorithms for detecting errors in GSMMs. The relative frequencies of errors we detect in manually curated GSMMs appear to reflect the different approaches used to curate them. Changing the method used to automatically create a GSMM from a particular organism's genome can have a larger impact on the kinds of errors in the resulting GSMM than using the same method with a different organism's genome. Our algorithms are particularly capable of identifying errors that are only apparent at the pathway level, including loops, and nontrivial cases of dead ends.

Conclusions

MACAW is capable of identifying inaccuracies of varying severity in a wide range of GSMMs. Correcting these errors can measurably improve the predictive capacity of a GSMM. The relative prevalence of each type of error we identify in a large collection of GSMMs could help shape future efforts for further automation of error correction and GSMM creation.

Addressing uncertainty in genome-scale metabolic model reconstruction and analysis

The reconstruction and analysis of genome-scale metabolic models constitutes a powerful systems biology approach, with applications ranging from basic understanding of genotype-phenotype mapping to solving biomedical and environmental problems. However, the biological insight obtained from these models is limited by multiple heterogeneous sources of uncertainty, which are often difficult to quantify. Here we review the major sources of uncertainty and survey existing approaches developed for representing and addressing them. A unified formal characterization of these uncertainties through probabilistic approaches and ensemble modeling will facilitate convergence towards consistent reconstruction pipelines, improved data integration algorithms, and more accurate assessment of predictive capacity.