The principles of whole-cell modeling

Towards multimodal foundation models in molecular cell biology

The rapid advent of high-throughput omics technologies has created an exponential growth in biological data, often outpacing our ability to derive molecular insights. Large-language models have shown a way out of this data deluge in natural language processing by integrating massive datasets into a joint model with manifold downstream use cases. Here we envision developing multimodal foundation models, pretrained on diverse omics datasets, including genomics, transcriptomics, epigenomics, proteomics, metabolomics and spatial profiling. These models are expected to exhibit unprecedented potential for characterizing the molecular states of cells across a broad continuum, thereby facilitating the creation of holistic maps of cells, genes and tissues. Context-specific transfer learning of the foundation models can empower diverse applications from novel cell-type recognition, biomarker discovery and gene regulation inference, to in silico perturbations. This new paradigm could launch an era of artificial intelligence-empowered analyses, one that promises to unravel the intricate complexities of molecular cell biology, to support experimental design and, more broadly, to profoundly extend our understanding of life sciences.

LM-Merger: A workflow for merging logical models with an application to gene regulation

Motivation

Gene regulatory network (GRN) models provide mechanistic understanding of genetic interactions that regulate gene expression and, consequently, influence cellular behavior. Dysregulated gene expression plays a critical role in disease progression and treatment response, making GRN models a promising tool for precision medicine. While researchers have built many models to describe specific subsets of gene interactions, more comprehensive models that cover a broader range of genes are challenging to build. This necessitates the development of automated approaches for merging existing models.

Results

We present LM-Merger, a workflow for semi-automatically merging logical GRN models. The workflow consists of five main steps: (a) model identification, (b) model standardization and annotation, (c) model verification, (d) model merging, and (d) model evaluation. We demonstrate the feasibility and benefit of this workflow with two pairs of published models pertaining to acute myeloid leukemia (AML). The integrated models were able to retain the predictive accuracy of the original models, while expanding coverage of the biological system. Notably, when applied to a new dataset, the integrated models outperformed the individual models in predicting patient response. This study highlights the potential of logical model merging to advance systems biology research and our understanding of complex diseases.

Availability and implementation

The workflow and accompanying tools, including modules for model standardization, automated logical model merging, and evaluation, are available at https://github.com/IlyaLab/LogicModelMerger/.

Enzyme kinetics simulation at the scale of individual particles

Enzyme-catalyzed reactions involve two distinct timescales: a short timescale on which enzymes bind to substrate molecules to produce bound complexes and a comparatively long timescale on which the molecules of the complex are transformed into products. The uptake of the substrate in these reactions is the rate at which the product is made on the long timescale. Models often only consider the uptake to reduce the number of chemical species that need to be modeled and to avoid explicitly treating multiple timescales. Typically, the uptake rates cannot be described by mass action kinetics and are traditionally derived by applying singular perturbation theory to the system's governing differential equations. This analysis ignores short timescales by assuming that a pseudo-equilibrium between the enzyme and the enzyme-bound complex is maintained at all times. This assumption cannot be incorporated into current particle-based simulations of reaction-diffusion systems because they utilize proximity-based conditions to govern the instances of reactions that cannot maintain this pseudo-equilibrium for infinitely fast reactions. Instead, these methods must directly simulate the dynamics on the short timescale to accurately model the system. Due to the disparate timescales, such simulations require excessive amounts of computational time before the behavior on the long timescale can be observed. To resolve this problem, we use singular perturbation theory to develop a proximity-based reaction condition that enables us to ignore all fast reactions and directly reproduce non-mass action kinetics at long timescales. To demonstrate our approach, we implement simulations of a specific third order reaction with kinetics reminiscent of the prototypical Michaelis-Menten system.

Development of specialized devices for microbial experimental evolution

Experimental evolution of microbial cells provides valuable information on evolutionary dynamics, such as mutations that contribute to fitness gain under given selection pressures. Although experimental evolution is a promising tool in evolutionary biology and bioengineering, long-term culture experiments under multiple environmental conditions often impose an excessive workload on researchers. Therefore, the development of automated systems significantly contributes to the advancement of experimental evolutionary research. This review presents several specialized devices designed for experimental evolution studies, such as an automated system for high-throughput culture experiments, a culture device that generate a temperature gradient, and an automated ultraviolet (UV) irradiation culture device. The ongoing development of such specialized devices is poised to continually expand new frontiers in experimental evolution research.

Technologies for whole-cell modeling: Genome-wide reconstruction of a cell in silico

With advances in high-throughput, large-scale in vivo measurement and genome modification techniques at the single-nucleotide level, there is an increasing demand for the development of new technologies for the flexible design and control of cellular systems. Computer-aided design is a powerful tool to design new cells. Whole-cell modeling aims to integrate various cellular subsystems, determine their interactions and cooperative mechanisms, and predict comprehensive cellular behaviors by computational simulations on a genome-wide scale. It has been applied to prokaryotes, yeasts, and higher eukaryotic cells, and utilized in a wide range of applications, including production of valuable substances, drug discovery, and controlled differentiation. Whole-cell modeling, consisting of several thousand elements with diverse scales and properties, requires innovative model construction, simulation, and analysis techniques. Furthermore, whole-cell modeling has been extended to multiple scales, including high-resolution modeling at the single-nucleotide and single-amino acid levels and multicellular modeling of tissues and organs. This review presents an overview of the current state of whole-cell modeling, discusses the novel computational and experimental technologies driving it, and introduces further developments toward multihierarchical modeling on a whole-genome scale.

Multi-scale models of whole cells: progress and challenges

Whole-cell modeling is "the ultimate goal" of computational systems biology and "a grand challenge for 21st century" (Tomita, Trends in Biotechnology, 2001, 19(6), 205-10). These complex, highly detailed models account for the activity of every molecule in a cell and serve as comprehensive knowledgebases for the modeled system. Their scope and utility far surpass those of other systems models. In fact, whole-cell models (WCMs) are an amalgam of several types of "system" models. The models are simulated using a hybrid modeling method where the appropriate mathematical methods for each biological process are used to simulate their behavior. Given the complexity of the models, the process of developing and curating these models is labor-intensive and to date only a handful of these models have been developed. While whole-cell models provide valuable and novel biological insights, and to date have identified some novel biological phenomena, their most important contribution has been to highlight the discrepancy between available data and observations that are used for the parametrization and validation of complex biological models. Another realization has been that current whole-cell modeling simulators are slow and to run models that mimic more complex (e.g., multi-cellular) biosystems, those need to be executed in an accelerated fashion on high-performance computing platforms. In this manuscript, we review the progress of whole-cell modeling to date and discuss some of the ways that they can be improved.

PhysiBoSS 2.0: a sustainable integration of stochastic Boolean and agent-based modelling frameworks

In systems biology, mathematical models and simulations play a crucial role in understanding complex biological systems. Different modelling frameworks are employed depending on the nature and scales of the system under study. For instance, signalling and regulatory networks can be simulated using Boolean modelling, whereas multicellular systems can be studied using agent-based modelling. Herein, we present PhysiBoSS 2.0, a hybrid agent-based modelling framework that allows simulating signalling and regulatory networks within individual cell agents. PhysiBoSS 2.0 is a redesign and reimplementation of PhysiBoSS 1.0 and was conceived as an add-on that expands the PhysiCell functionalities by enabling the simulation of intracellular cell signalling using MaBoSS while keeping a decoupled, maintainable and model-agnostic design. PhysiBoSS 2.0 also expands the set of functionalities offered to the users, including custom models and cell specifications, mechanistic submodels of substrate internalisation and detailed control over simulation parameters. Together with PhysiBoSS 2.0, we introduce PCTK, a Python package developed for handling and processing simulation outputs, and generating summary plots and 3D renders. PhysiBoSS 2.0 allows studying the interplay between the microenvironment, the signalling pathways that control cellular processes and population dynamics, suitable for modelling cancer. We show different approaches for integrating Boolean networks into multi-scale simulations using strategies to study the drug effects and synergies in models of cancer cell lines and validate them using experimental data. PhysiBoSS 2.0 is open-source and publicly available on GitHub with several repositories of accompanying interoperable tools.

Uses of Multi-Objective Flux Analysis for Optimization of Microbial Production of Secondary Metabolites

Secondary metabolites are not essential for the growth of microorganisms, but they play a critical role in how microbes interact with their surroundings. In addition to this important ecological role, secondary metabolites also have a variety of agricultural, medicinal, and industrial uses, and thus the examination of secondary metabolism of plants and microbes is a growing scientific field. While the chemical production of certain secondary metabolites is possible, industrial-scale microbial production is a green and economically attractive alternative. This is even more true, given the advances in bioengineering that allow us to alter the workings of microbes in order to increase their production of compounds of interest. This type of engineering requires detailed knowledge of the "chassis" organism's metabolism. Since the resources and the catalytic capacity of enzymes in microbes is finite, it is important to examine the tradeoffs between various bioprocesses in an engineered system and alter its working in a manner that minimally perturbs the robustness of the system while allowing for the maximum production of a product of interest. The in silico multi-objective analysis of metabolism using genome-scale models is an ideal method for such examinations.

scAEGAN: Unification of single-cell genomics data by adversarial learning of latent space correspondences

Recent progress in Single-Cell Genomics has produced different library protocols and techniques for molecular profiling. We formulate a unifying, data-driven, integrative, and predictive methodology for different libraries, samples, and paired-unpaired data modalities. Our design of scAEGAN includes an autoencoder (AE) network integrated with adversarial learning by a cycleGAN (cGAN) network. The AE learns a low-dimensional embedding of each condition, whereas the cGAN learns a non-linear mapping between the AE representations. We evaluate scAEGAN using simulated data and real scRNA-seq datasets, different library preparations (Fluidigm C1, CelSeq, CelSeq2, SmartSeq), and several data modalities as paired scRNA-seq and scATAC-seq. The scAEGAN outperforms Seurat3 in library integration, is more robust against data sparsity, and beats Seurat 4 in integrating paired data from the same cell. Furthermore, in predicting one data modality from another, scAEGAN outperforms Babel. We conclude that scAEGAN surpasses current state-of-the-art methods and unifies integration and prediction challenges.

Molecular dynamics simulation of an entire cell

The ultimate microscope, directed at a cell, would reveal the dynamics of all the cell's components with atomic resolution. In contrast to their real-world counterparts, computational microscopes are currently on the brink of meeting this challenge. In this perspective, we show how an integrative approach can be employed to model an entire cell, the minimal cell, JCVI-syn3A, at full complexity. This step opens the way to interrogate the cell's spatio-temporal evolution with molecular dynamics simulations, an approach that can be extended to other cell types in the near future.

Modeling signaling pathways in biology with MaBoSS: From one single cell to a dynamic population of heterogeneous interacting cells

As a result of the development of experimental technologies and the accumulation of data, biological and molecular processes can be described as complex networks of signaling pathways. These networks are often directed and signed, where nodes represent entities (genes/proteins) and arrows interactions. They are translated into mathematical models by adding a dynamic layer onto them. Such mathematical models help to understand and interpret non-intuitive experimental observations and to anticipate the response to external interventions such as drug effects on phenotypes. Several frameworks for modeling signaling pathways exist. The choice of the appropriate framework is often driven by the experimental context. In this review, we present MaBoSS, a tool based on Boolean modeling using a continuous time approach, which predicts time-dependent probabilities of entities in different biological contexts. MaBoSS was initially built to model the intracellular signaling in non-interacting homogeneous cell populations. MaBoSS was then adapted to model heterogeneous cell populations (EnsembleMaBoSS) by considering families of models rather than a unique model. To account for more complex questions, MaBoSS was extended to simulate dynamical interacting populations (UPMaBoSS), with a precise spatial distribution (PhysiBoSS). To illustrate all these levels of description, we show how each of these tools can be used with a running example of a simple model of cell fate decisions. Finally, we present practical applications to cancer biology and studies of the immune response.

Genome-scale metabolic network models: from first-generation to next-generation

Over the last two decades, thousands of genome-scale metabolic network models (GSMMs) have been constructed. These GSMMs have been widely applied in various fields, ranging from network interaction analysis, to cell phenotype prediction. However, due to the lack of constraints, the prediction accuracy of first-generation GSMMs was limited. To overcome these limitations, the next-generation GSMMs were developed by integrating omics data, adding constrain condition, integrating different biological models, and constructing whole-cell models. Here, we review recent advances of GSMMs from the first generation to the next generation. Then, we discuss the major application of GSMMs in industrial biotechnology, such as predicting phenotypes and guiding metabolic engineering. In addition, human health applications, including understanding biological mechanisms, discovering biomarkers and drug targets, are also summarized. Finally, we address the challenges and propose new trend of GSMMs. KEY POINTS: •This mini-review updates the literature on almost all published GSMMs since 1999. •Detailed insights into the development of the first- and next-generation GSMMs. •The application of GSMMs is summarized, and the prospects of integrating machine learning are emphasized.

Construction of Multiscale Genome-Scale Metabolic Models: Frameworks and Challenges

Genome-scale metabolic models (GEMs) are effective tools for metabolic engineering and have been widely used to guide cell metabolic regulation. However, the single gene–protein-reaction data type in GEMs limits the understanding of biological complexity. As a result, multiscale models that add constraints or integrate omics data based on GEMs have been developed to more accurately predict phenotype from genotype. This review summarized the recent advances in the development of multiscale GEMs, including multiconstraint, multiomic, and whole-cell models, and outlined machine learning applications in GEM construction. This review focused on the frameworks, toolkits, and algorithms for constructing multiscale GEMs. The challenges and perspectives of multiscale GEM development are also discussed.

A multiscale model of the regulation of aquaporin 2 recycling

The response of cells to their environment is driven by a variety of proteins and messenger molecules. In eukaryotes, their distribution and location in the cell are regulated by the vesicular transport system. The transport of aquaporin 2 between membrane and storage region is a crucial part of the water reabsorption in renal principal cells, and its malfunction can lead to Diabetes insipidus. To understand the regulation of this system, we aggregated pathways and mechanisms from literature and derived three models in a hypothesis-driven approach. Furthermore, we combined the models to a single system to gain insight into key regulatory mechanisms of Aquaporin 2 recycling. To achieve this, we developed a multiscale computational framework for the modeling and simulation of cellular systems. The analysis of the system rationalizes that the compartmentalization of cAMP in renal principal cells is a result of the protein kinase A signalosome and can only occur if specific cellular components are observed in conjunction. Endocytotic and exocytotic processes are inherently connected and can be regulated by the same protein kinase A signal.

Accelerating Whole-Cell Simulations of mRNA Translation Using a Dedicated Hardware

In recent years, intracellular biophysical simulations have been used with increasing frequency not only for answering basic scientific questions but also in the field of synthetic biology. However, since these models include networks of interaction between millions of components, they are extremely time-consuming and cannot run easily on parallel computers. In this study, we demonstrate for the first time a novel approach addressing this challenge by using a dedicated hardware designed specifically to simulate such processes. As a proof of concept, we specifically focus on mRNA translation, which is the process consuming most of the energy in the cell. We design a hardware that simulates translation in Escherichia coli and Saccharomyces cerevisiae for thousands of mRNAs and ribosomes, which is in orders of magnitude faster than a similar software solution. With the sharp increase in the amount of genomic data available today and the complexity of the corresponding models inferred from them, we believe that the strategy suggested here will become common and can be used among others for simulating entire cells with all gene expression steps.

Simulating single-cell metabolism using a stochastic flux-balance analysis algorithm

Stochasticity from gene expression in single cells is known to drive metabolic heterogeneity at the level of cellular populations, which is understood to have important consequences for issues such as microbial drug tolerance and treatment of human diseases like cancer. Despite considerable advancements in profiling the genomes, transcriptomes, and proteomes of single cells, it remains difficult to experimentally characterize their metabolism at the genome scale. Computational methods could bridge this gap toward a systems understanding of single-cell biology. To address this challenge, we developed stochastic simulation algorithm with flux-balance analysis embedded (SSA-FBA), a computational framework for simulating the stochastic dynamics of the metabolism of individual cells using genome-scale metabolic models with experimental estimates of gene expression and enzymatic reaction rate parameters. SSA-FBA extends the constraint-based modeling formalism of metabolic network modeling to the single-cell regime, enabling simulation when experimentation is intractable. We also developed an efficient implementation of SSA-FBA that leverages the topology of embedded flux-balance analysis models to significantly reduce the computational cost of simulation. As a preliminary case study, we built a reduced single-cell model of Mycoplasma pneumoniae and used SSA-FBA to illustrate the role of stochasticity on the dynamics of metabolism at the single-cell level.

Genome-Scale Reconstruction of Microbial Dynamic Phenotype: Successes and Challenges

This review is a part of the SI 'Genome-Scale Modeling of Microorganisms in the Real World'. The goal of GEM is the accurate prediction of the phenotype from its respective genotype under specified environmental conditions. This review focuses on the dynamic phenotype; prediction of the real-life behaviors of microorganisms, such as cell proliferation, dormancy, and mortality; balanced and unbalanced growth; steady-state and transient processes; primary and secondary metabolism; stress responses; etc. Constraint-based metabolic reconstructions were successfully started two decades ago as FBA, followed by more advanced models, but this review starts from the earlier nongenomic predecessors to show that some GEMs inherited the outdated biokinetic frameworks compromising their performances. The most essential deficiencies are: (i) an inadequate account of environmental conditions, such as various degrees of nutrients limitation and other factors shaping phenotypes; (ii) a failure to simulate the adaptive changes of MMCC (MacroMolecular Cell Composition) in response to the fluctuating environment; (iii) the misinterpretation of the SGR (Specific Growth Rate) as either a fixed constant parameter of the model or independent factor affecting the conditional expression of macromolecules; (iv) neglecting stress resistance as an important objective function; and (v) inefficient experimental verification of GEM against simple growth (constant MMCC and SGR) data. Finally, we propose several ways to improve GEMs, such as replacing the outdated Monod equation with the SCM (Synthetic Chemostat Model) that establishes the quantitative relationships between primary and secondary metabolism, growth rate and stress resistance, process kinetics, and cell composition.

Relating simulation studies by provenance-Developing a family of Wnt signaling models

For many biological systems, a variety of simulation models exist. A new simulation model is rarely developed from scratch, but rather revises and extends an existing one. A key challenge, however, is to decide which model might be an appropriate starting point for a particular problem and why. To answer this question, we need to identify entities and activities that contributed to the development of a simulation model. Therefore, we exploit the provenance data model, PROV-DM, of the World Wide Web Consortium and, building on previous work, continue developing a PROV ontology for simulation studies. Based on a case study of 19 Wnt/β-catenin signaling models, we identify crucial entities and activities as well as useful metadata to both capture the provenance information from individual simulation studies and relate these forming a family of models. The approach is implemented in WebProv, a web application for inserting and querying provenance information. Our specialization of PROV-DM contains the entities Research Question, Assumption, Requirement, Qualitative Model, Simulation Model, Simulation Experiment, Simulation Data, and Wet-lab Data as well as activities referring to building, calibrating, validating, and analyzing a simulation model. We show that most Wnt simulation models are connected to other Wnt models by using (parts of) these models. However, the overlap, especially regarding the Wet-lab Data used for calibration or validation of the models is small. Making these aspects of developing a model explicit and queryable is an important step for assessing and reusing simulation models more effectively. Exposing this information helps to integrate a new simulation model within a family of existing ones and may lead to the development of more robust and valid simulation models. We hope that our approach becomes part of a standardization effort and that modelers adopt the benefits of provenance when considering or creating simulation models.

We revise a provenance ontology for simulation studies of cellular biochemical models. Provenance information is useful for understanding the creation of a simulation model because it not only contains information about the entities and activities that have led to a simulation model but also their relations, all of which can be visualized. It provides additional structure by explicitly recording research questions, assumptions, and requirements and relating them along with data, qualitative models, simulation models, and simulation experiments through a small set of predefined but extensible activities.

We have applied our concept to a family of 19 Wnt signaling models and implemented a web-based tool (WebProv) to store the provenance information from these studies. The resulting provenance graph visualizes the story line of simulation studies and demonstrates the creation and calibration of simulation models, the successive attempts of validation and extension, and shows, beyond an individual simulation study, how the Wnt models are related. Thereby, the steps and sources that contributed to a simulation model are made explicit.

Our approach complements other approaches aimed at facilitating the reuse and assessment of simulation products in systems biology such as model repositories as well as annotation and documentation guidelines.

Multiscale plant modeling: from genome to phenome and beyond

Plants are complex organisms that adapt to changes in their environment using an array of regulatory mechanisms that span across multiple levels of biological organization. Due to this complexity, it is difficult to predict emergent properties using conventional approaches that focus on single levels of biology such as the genome, transcriptome, or metabolome. Mathematical models of biological systems have emerged as useful tools for exploring pathways and identifying gaps in our current knowledge of biological processes. Identification of emergent properties, however, requires their vertical integration across biological scales through multiscale modeling. Multiscale models that capture and predict these emergent properties will allow us to predict how plants will respond to a changing climate and explore strategies for plant engineering. In this review, we (1) summarize the recent developments in plant multiscale modeling; (2) examine multiscale models of microbial systems that offer insight to potential future directions for the modeling of plant systems; (3) discuss computational tools and resources for developing multiscale models; and (4) examine future directions of the field.

Atlas: automatic modeling of regulation of bacterial gene expression and metabolism using rule-based languages

MOTIVATION

Cells are complex systems composed of hundreds of genes whose products interact to produce elaborated behaviors. To control such behaviors, cells rely on transcription factors to regulate gene expression, and gene regulatory networks (GRNs) are employed to describe and understand such behavior. However, GRNs are static models, and dynamic models are difficult to obtain due to their size, complexity, stochastic dynamics and interactions with other cell processes.

RESULTS

We developed Atlas, a Python software that converts genome graphs and gene regulatory, interaction and metabolic networks into dynamic models. The software employs these biological networks to write rule-based models for the PySB framework. The underlying method is a divide-and-conquer strategy to obtain sub-models and combine them later into an ensemble model. To exemplify the utility of Atlas, we used networks of varying size and complexity of Escherichia coli and evaluated in silico modifications, such as gene knockouts and the insertion of promoters and terminators. Moreover, the methodology could be applied to the dynamic modeling of natural and synthetic networks of any bacteria.

AVAILABILITY AND IMPLEMENTATION

Code, models and tutorials are available online (https://github.com/networkbiolab/atlas).

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

The roles of code in biology

The way in which computer code is perceived and used in biological research has been a source of some controversy and confusion, and has resulted in sub-optimal outcomes related to reproducibility, scalability and productivity. We suggest that the confusion is due in part to a misunderstanding of the function of code when applied to the life sciences. Code has many roles, and in this paper we present a three-dimensional taxonomy to classify those roles and map them specifically to the life sciences. We identify a "sweet spot" in the taxonomy-a convergence where bioinformaticians should concentrate their efforts in order to derive the most value from the time they spend using code. We suggest the use of the "inverse Conway maneuver" to shape a research team so as to allow dedicated software engineers to interface with researchers working in this "sweet spot." We conclude that in order to address current issues in the use of software in life science research such as reproducibility and scalability, the field must reevaluate its relationship with software engineering, and adapt its research structures to overcome current issues in bioinformatics such as reproducibility, scalability and productivity.

Datanator: an integrated database of molecular data for quantitatively modeling cellular behavior

Integrative research about multiple biochemical subsystems has significant potential to help advance biology, bioengineering and medicine. However, it is difficult to obtain the diverse data needed for integrative research. To facilitate biochemical research, we developed Datanator (https://datanator.info), an integrated database and set of tools for finding clouds of multiple types of molecular data about specific molecules and reactions in specific organisms and environments, as well as data about chemically-similar molecules and reactions in phylogenetically-similar organisms in similar environments. Currently, Datanator includes metabolite concentrations, RNA modifications and half-lives, protein abundances and modifications, and reaction rate constants about a broad range of organisms. Going forward, we aim to launch a community initiative to curate additional data. Datanator also provides tools for filtering, visualizing and exporting these data clouds. We believe that Datanator can facilitate a wide range of research from integrative mechanistic models, such as whole-cell models, to comparative data-driven analyses of multiple organisms.

Prediction of Cellular Burden with Host-Circuit Models

Heterologous gene expression draws resources from host cells. These resources include vital components to sustain growth and replication, and the resulting cellular burden is a widely recognized bottleneck in the design of robust circuits. In this tutorial we discuss the use of computational models that integrate gene circuits and the physiology of host cells. Through various use cases, we illustrate the power of host-circuit models to predict the impact of design parameters on both burden and circuit functionality. Our approach relies on a new generation of computational models for microbial growth that can flexibly accommodate resource bottlenecks encountered in gene circuit design. Adoption of this modeling paradigm can facilitate fast and robust design cycles in synthetic biology.

History and Evolution of Modeling in Biotechnology: Modeling & Simulation, Application and Hardware Performance

Biological systems are typically composed of highly interconnected subunits and possess an inherent complexity that make monitoring, control and optimization of a bioprocess a challenging task. Today a toolset of modeling techniques can provide guidance in understanding complexity and in meeting those challenges. Over the last four decades, computational performance increased exponentially. This increase in hardware capacity allowed ever more detailed and computationally intensive models approaching a "one-to-one" representation of the biological reality. Fueled by governmental guidelines like the PAT initiative of the FDA, novel soft sensors and techniques were developed in the past to ensure product quality and provide data in real time. The estimation of current process state and prediction of future process course eventually enabled dynamic process control. In this review, past, present and envisioned future of models in biotechnology are compared and discussed with regard to application in process monitoring, control and optimization. In addition, hardware requirements and availability to fit the needs of increasingly more complex models are summarized. The major techniques and diverse approaches of modeling in industrial biotechnology are compared, and current as well as future trends and perspectives are outlined.

Computer-Aided Whole-Cell Design: Taking a Holistic Approach by Integrating Synthetic With Systems Biology

Computer-aided design (CAD) for synthetic biology promises to accelerate the rational and robust engineering of biological systems. It requires both detailed and quantitative mathematical and experimental models of the processes to (re)design biology, and software and tools for genetic engineering and DNA assembly. Ultimately, the increased precision in the design phase will have a dramatic impact on the production of designer cells and organisms with bespoke functions and increased modularity. CAD strategies require quantitative models of cells that can capture multiscale processes and link genotypes to phenotypes. Here, we present a perspective on how whole-cell, multiscale models could transform design-build-test-learn cycles in synthetic biology. We show how these models could significantly aid in the design and learn phases while reducing experimental testing by presenting case studies spanning from genome minimization to cell-free systems. We also discuss several challenges for the realization of our vision. The possibility to describe and build whole-cells in silico offers an opportunity to develop increasingly automatized, precise and accessible CAD tools and strategies.

SBML Level 3: an extensible format for the exchange and reuse of biological models

Systems biology has experienced dramatic growth in the number, size, and complexity of computational models. To reproduce simulation results and reuse models, researchers must exchange unambiguous model descriptions. We review the latest edition of the Systems Biology Markup Language (SBML), a format designed for this purpose. A community of modelers and software authors developed SBML Level 3 over the past decade. Its modular form consists of a core suited to representing reaction-based models and packages that extend the core with features suited to other model types including constraint-based models, reaction-diffusion models, logical network models, and rule-based models. The format leverages two decades of SBML and a rich software ecosystem that transformed how systems biologists build and interact with models. More recently, the rise of multiscale models of whole cells and organs, and new data sources such as single-cell measurements and live imaging, has precipitated new ways of integrating data with models. We provide our perspectives on the challenges presented by these developments and how SBML Level 3 provides the foundation needed to support this evolution.

Comprehensive understanding of Saccharomyces cerevisiae phenotypes with whole-cell model WM_S288C

Biological network construction for Saccharomyces cerevisiae is a widely used approach for simulating phenotypes and designing cell factories. However, due to a complicated regulatory mechanism governing the translation of genotype to phenotype, precise prediction of phenotypes remains challenging. Here, we present WM_S288C, a computational whole-cell model that includes 15 cellular states and 26 cellular processes and which enables integrated analyses of physiological functions of Saccharomyces cerevisiae. Using WM_S288C to predict phenotypes of S. cerevisiae, the functions of 1140 essential genes were characterized and linked to phenotypes at five levels. During the cell cycle, the dynamic allocation of intracellular molecules could be tracked in real-time to simulate cell activities. Additionally, one-third of non-essential genes were identified to affect cell growth via regulating nucleotide concentrations. These results demonstrated the value of WM_S288C as a tool for understanding and investigating the phenotypes of S. cerevisiae.

Whole-Cell Models and Simulations in Molecular Detail

Comprehensive data about the composition and structure of cellular components have enabled the construction of quantitative whole-cell models. While kinetic network-type models have been established, it is also becoming possible to build physical, molecular-level models of cellular environments. This review outlines challenges in constructing and simulating such models and discusses near- and long-term opportunities for developing physical whole-cell models that can connect molecular structure with biological function.

Coloured Petri nets for multilevel, multiscale and multidimensional modelling of biological systems

Owing to the availability of data of one biological phenomenon at different levels/scales, modelling of biological systems is moving from single level/scale to multiple levels/scales, which introduces a number of challenges. Coloured Petri nets (ColPNs) have been successfully applied to multilevel, multiscale and multidimensional modelling of some biological systems, addressing many of these challenges. In this article, we first review the basics of ColPNs and some popular extensions, and then their applications for multilevel, multiscale and multidimensional modelling of biological systems. This understanding of how to use ColPNs for modelling biological systems will assist readers in selecting appropriate ColPN classes for specific modelling circumstances.

Fuzzy Petri nets for modelling of uncertain biological systems

The modelling of biological systems is accompanied with epistemic uncertainties that range from structural uncertainty to parametric uncertainty due to such limitations as insufficient understanding of the underlying mechanism and incomplete measurement data of a system. Fuzzy logic approaches such as fuzzy Petri nets (FPNs) are effective in addressing these issues. In this paper, we review FPNs that have been used for modelling uncertain biological systems, which we classify in three categories: basic fuzzy Petri nets, fuzzy quantitative Petri nets and Petri nets with fuzzy kinetic parameters. For each category of these FPNs, we summarize its modelling capabilities and current applications, discuss its merits and drawbacks and give suggestions for further research. This understanding on how to use FPNs for modelling uncertain biological systems will assist readers in selecting appropriate FPN classes for specific modelling circumstances. This review may also promote the extensive research and application of FPNs in the systems biology area.

Complexity-aware simple modeling

Mathematical models continue to be essential for deepening our understanding of biology. On one extreme, simple or small-scale models help delineate general biological principles. However, the parsimony of detail in these models as well as their assumption of modularity and insulation make them inaccurate for describing quantitative features. On the other extreme, large-scale and detailed models can quantitatively recapitulate a phenotype of interest, but have to rely on many unknown parameters, making them often difficult to parse mechanistically and to use for extracting general principles. We discuss some examples of a new approach-complexity-aware simple modeling-that can bridge the gap between the small-scale and large-scale approaches.

Multi-Algorithm Particle Simulations with Spatiocyte

As quantitative biologists get more measurements of spatially regulated systems such as cell division and polarization, simulation of reaction and diffusion of proteins using the data is becoming increasingly relevant to uncover the mechanisms underlying the systems. Spatiocyte is a lattice-based stochastic particle simulator for biochemical reaction and diffusion processes. Simulations can be performed at single molecule and compartment spatial scales simultaneously. Molecules can diffuse and react in 1D (filament), 2D (membrane), and 3D (cytosol) compartments. The implications of crowded regions in the cell can be investigated because each diffusing molecule has spatial dimensions. Spatiocyte adopts multi-algorithm and multi-timescale frameworks to simulate models that simultaneously employ deterministic, stochastic, and particle reaction-diffusion algorithms. Comparison of light microscopy images to simulation snapshots is supported by Spatiocyte microscopy visualization and molecule tagging features. Spatiocyte is open-source software and is freely available at http://spatiocyte.org .

Emerging whole-cell modeling principles and methods

Whole-cell computational models aim to predict cellular phenotypes from genotype by representing the entire genome, the structure and concentration of each molecular species, each molecular interaction, and the extracellular environment. Whole-cell models have great potential to transform bioscience, bioengineering, and medicine. However, numerous challenges remain to achieve whole-cell models. Nevertheless, researchers are beginning to leverage recent progress in measurement technology, bioinformatics, data sharing, rule-based modeling, and multi-algorithmic simulation to build the first whole-cell models. We anticipate that ongoing efforts to develop scalable whole-cell modeling tools will enable dramatically more comprehensive and more accurate models, including models of human cells.

Integrative biological simulation praxis: Considerations from physics, philosophy, and data/model curation practices

Integrative biological simulations have a varied and controversial history in the biological sciences. From computational models of organelles, cells, and simple organisms, to physiological models of tissues, organ systems, and ecosystems, a diverse array of biological systems have been the target of large-scale computational modeling efforts. Nonetheless, these research agendas have yet to prove decisively their value among the broader community of theoretical and experimental biologists. In this commentary, we examine a range of philosophical and practical issues relevant to understanding the potential of integrative simulations. We discuss the role of theory and modeling in different areas of physics and suggest that certain sub-disciplines of physics provide useful cultural analogies for imagining the future role of simulations in biological research. We examine philosophical issues related to modeling which consistently arise in discussions about integrative simulations and suggest a pragmatic viewpoint that balances a belief in philosophy with the recognition of the relative infancy of our state of philosophical understanding. Finally, we discuss community workflow and publication practices to allow research to be readily discoverable and amenable to incorporation into simulations. We argue that there are aligned incentives in widespread adoption of practices which will both advance the needs of integrative simulation efforts as well as other contemporary trends in the biological sciences, ranging from open science and data sharing to improving reproducibility.

A blueprint for human whole-cell modeling

Whole-cell dynamical models of human cells are a central goal of systems biology. Such models could help researchers understand cell biology and help physicians treat disease. Despite significant challenges, we believe that human whole-cell models are rapidly becoming feasible. To develop a plan for achieving human whole-cell models, we analyzed the existing models of individual cellular pathways, surveyed the biomodeling community, and reflected on our experience developing whole-cell models of bacteria. Based on these analyses, we propose a plan for a project, termed the Human Whole-Cell Modeling Project, to achieve human whole-cell models. The foundations of the plan include technology development, standards development, and interdisciplinary collaboration.

How to deal with parameters for whole-cell modelling

Dynamical systems describing whole cells are on the verge of becoming a reality. But as models of reality, they are only useful if we have realistic parameters for the molecular reaction rates and cell physiological processes. There is currently no suitable framework to reliably estimate hundreds, let alone thousands, of reaction rate parameters. Here, we map out the relative weaknesses and promises of different approaches aimed at redressing this issue. While suitable procedures for estimation or inference of the whole (vast) set of parameters will, in all likelihood, remain elusive, some hope can be drawn from the fact that much of the cellular behaviour may be explained in terms of smaller sets of parameters. Identifying such parameter sets and assessing their behaviour is now becoming possible even for very large systems of equations, and we expect such methods to become central tools in the development and analysis of whole-cell models.

Computational modelling of genome-scale metabolic networks and its application to CHO cell cultures

Genome-scale metabolic models (GEMs) have become increasingly important in recent years. Currently, GEMs are the most accurate in silico representation of the genotype-phenotype link. They allow us to study complex networks from the systems perspective. Their application may drastically reduce the amount of experimental and clinical work, improve diagnostic tools and increase our understanding of complex biological phenomena. GEMs have also demonstrated high potential for the optimisation of bio-based production of recombinant proteins. Herein, we review the basic concepts, methods, resources and software tools used for the reconstruction and application of GEMs. We overview the evolution of the modelling efforts devoted to the metabolism of Chinese Hamster Ovary (CHO) cells. We present a case study on CHO cell metabolism under different amino acid depletions. This leads us to the identification of the most influential as well as essential amino acids in selected CHO cell lines.

Parameter identifiability analysis and visualization in large-scale kinetic models of biosystems

Background

Kinetic models of biochemical systems usually consist of ordinary differential equations that have many unknown parameters. Some of these parameters are often practically unidentifiable, that is, their values cannot be uniquely determined from the available data. Possible causes are lack of influence on the measured outputs, interdependence among parameters, and poor data quality. Uncorrelated parameters can be seen as the key tuning knobs of a predictive model. Therefore, before attempting to perform parameter estimation (model calibration) it is important to characterize the subset(s) of identifiable parameters and their interplay. Once this is achieved, it is still necessary to perform parameter estimation, which poses additional challenges.

Methods

We present a methodology that (i) detects high-order relationships among parameters, and (ii) visualizes the results to facilitate further analysis. We use a collinearity index to quantify the correlation between parameters in a group in a computationally efficient way. Then we apply integer optimization to find the largest groups of uncorrelated parameters. We also use the collinearity index to identify small groups of highly correlated parameters. The results files can be visualized using Cytoscape, showing the identifiable and non-identifiable groups of parameters together with the model structure in the same graph.

Results

Our contributions alleviate the difficulties that appear at different stages of the identifiability analysis and parameter estimation process. We show how to combine global optimization and regularization techniques for calibrating medium and large scale biological models with moderate computation times. Then we evaluate the practical identifiability of the estimated parameters using the proposed methodology. The identifiability analysis techniques are implemented as a MATLAB toolbox called VisId, which is freely available as open source from GitHub (https://github.com/gabora/visid).

Conclusions

Our approach is geared towards scalability. It enables the practical identifiability analysis of dynamic models of large size, and accelerates their calibration. The visualization tool allows modellers to detect parts that are problematic and need refinement or reformulation, and provides experimentalists with information that can be helpful in the design of new experiments.

Electronic supplementary material

The online version of this article (doi:10.1186/s12918-017-0428-y) contains supplementary material, which is available to authorized users.

Evolvix BEST Names for semantic reproducibility across code2brain interfaces

Names in programming are vital for understanding the meaning of code and big data. We define code2brain (C2B) interfaces as maps in compilers and brains between meaning and naming syntax, which help to understand executable code. While working toward an Evolvix syntax for general‐purpose programming that makes accurate modeling easy for biologists, we observed how names affect C2B quality. To protect learning and coding investments, C2B interfaces require long‐term backward compatibility and semantic reproducibility (accurate reproduction of computational meaning from coder‐brains to reader‐brains by code alone). Semantic reproducibility is often assumed until confusing synonyms degrade modeling in biology to deciphering exercises. We highlight empirical naming priorities from diverse individuals and roles of names in different modes of computing to show how naming easily becomes impossibly difficult. We present the Evolvix BEST (Brief, Explicit, Summarizing, Technical) Names concept for reducing naming priority conflicts, test it on a real challenge by naming subfolders for the Project Organization Stabilizing Tool system, and provide naming questionnaires designed to facilitate C2B debugging by improving names used as keywords in a stabilizing programming language. Our experiences inspired us to develop Evolvix using a flipped programming language design approach with some unexpected features and BEST Names at its core.

Toward Community Standards and Software for Whole-Cell Modeling

OBJECTIVE

Whole-cell (WC) modeling is a promising tool for biological research, bioengineering, and medicine. However, substantial work remains to create accurate comprehensive models of complex cells.

METHODS

We organized the 2015 Whole-Cell Modeling Summer School to teach WC modeling and evaluate the need for new WC modeling standards and software by recoding a recently published WC model in the Systems Biology Markup Language.

RESULTS

Our analysis revealed several challenges to representing WC models using the current standards.

CONCLUSION

We, therefore, propose several new WC modeling standards, software, and databases.

SIGNIFICANCE

We anticipate that these new standards and software will enable more comprehensive models.

Metabolic flux analyses of Pseudomonas aeruginosa cystic fibrosis isolates

Pseudomonas aeruginosa is a metabolically versatile wide-ranging opportunistic pathogen. In humans P. aeruginosa causes infections of the skin, urinary tract, blood, and the lungs of Cystic Fibrosis patients. In addition, P. aeruginosa's broad environmental distribution, relatedness to biotechnologically useful species, and ability to form biofilms have made it the focus of considerable interest. We used ¹³C metabolic flux analysis (MFA) and flux balance analysis to understand energy and redox production and consumption and to explore the metabolic phenotypes of one reference strain and five strains isolated from the lungs of cystic fibrosis patients. Our results highlight the importance of the oxidative pentose phosphate and Entner-Doudoroff pathways in P. aeruginosa growth. Among clinical strains we report two divergent metabolic strategies and identify changes between genetically related strains that have emerged during a chronic infection of the same patient. MFA revealed that the magnitude of fluxes through the glyoxylate cycle correlates with growth rates.

Current state and challenges for dynamic metabolic modeling

While the stoichiometry of metabolism is probably the best studied cellular level, the dynamics in metabolism can still not be well described, predicted and, thus, engineered. Unknowns in the metabolic flux behavior arise from kinetic interactions, especially allosteric control mechanisms. While the stoichiometry of enzymes is preserved in vitro, their activity and kinetic behavior differs from the in vivo situation. Next to this challenge, it is infeasible to test the interaction of each enzyme with each intracellular metabolite in vitro exhaustively. As a consequence, the whole interacting metabolome has to be studied in vivo to identify the relevant enzymes properties. In this review we discuss current approaches for in vivo perturbation experiments, that is, stimulus response experiments using different setups and quantitative analytical approaches, including dynamic carbon tracing. Next to reliable and informative data, advanced modeling approaches and computational tools are required to identify kinetic mechanisms and their parameters.

Guidelines for Reproducibly Building and Simulating Systems Biology Models

OBJECTIVE

Reproducibility is the cornerstone of the scientific method. However, currently, many systems biology models cannot easily be reproduced. This paper presents methods that address this problem.

METHODS

We analyzed the recent Mycoplasma genitalium whole-cell (WC) model to determine the requirements for reproducible modeling.

RESULTS

We determined that reproducible modeling requires both repeatable model building and repeatable simulation.

CONCLUSION

New standards and simulation software tools are needed to enhance and verify the reproducibility of modeling. New standards are needed to explicitly document every data source and assumption, and new deterministic parallel simulation tools are needed to quickly simulate large, complex models.

SIGNIFICANCE

We anticipate that these new standards and software will enable researchers to reproducibly build and simulate more complex models, including WC models.

Big Data in Plant Science: Resources and Data Mining Tools for Plant Genomics and Proteomics

In modern plant biology, progress is increasingly defined by the scientists' ability to gather and analyze data sets of high volume and complexity, otherwise known as "big data". Arguably, the largest increase in the volume of plant data sets over the last decade is a consequence of the application of the next-generation sequencing and mass-spectrometry technologies to the study of experimental model and crop plants. The increase in quantity and complexity of biological data brings challenges, mostly associated with data acquisition, processing, and sharing within the scientific community. Nonetheless, big data in plant science create unique opportunities in advancing our understanding of complex biological processes at a level of accuracy without precedence, and establish a base for the plant systems biology. In this chapter, we summarize the major drivers of big data in plant science and big data initiatives in life sciences with a focus on the scope and impact of iPlant, a representative cyberinfrastructure platform for plant science.

Long-Range Control of V(D)J Recombination & Allelic Exclusion: Modeling Views

Allelic exclusion of immunoglobulin (Ig) and T-cell receptor (TCR) genes ensures the development of B and T lymphocytes operating under the mode of clonal selection. This phenomenon associates asynchronous V(D)J recombination events at Ig or TCR alleles and inhibitory feedback control. Despite years of intense research, however, the mechanisms that sustain asymmetric choice in random Ig/TCR dual allele usage and the production of Ig/TCR monoallelic expressing B and T lymphocytes remain unclear and open for debate. In this chapter, we first recapitulate the biological evidence that almost from the start appeared to link V(D)J recombination and allelic exclusion. We review the theoretical models previously proposed to explain this connection. Finally, we introduce our own mathematical modeling views based on how the developmental dynamics of individual lymphoid cells combine to sustain allelic exclusion.