A Monte Carlo/response surface strategy for sensitivity analysis: application to a dynamic model of vegetative plant growth

Quantifying uncertainty in partially specified biological models: how can optimal control theory help us?

Mathematical models in biology are highly simplified representations of a complex underlying reality and there is always a high degree of uncertainty with regards to model function specification. This uncertainty becomes critical for models in which the use of different functions fitting the same dataset can yield substantially different predictions-a property known as structural sensitivity. Thus, even if the model is purely deterministic, then the uncertainty in the model functions carries through into uncertainty in model predictions, and new frameworks are required to tackle this fundamental problem. Here, we consider a framework that uses partially specified models in which some functions are not represented by a specific form. The main idea is to project infinite dimensional function space into a low-dimensional space taking into account biological constraints. The key question of how to carry out this projection has so far remained a serious mathematical challenge and hindered the use of partially specified models. Here, we propose and demonstrate a potentially powerful technique to perform such a projection by using optimal control theory to construct functions with the specified global properties. This approach opens up the prospect of a flexible and easy to use method to fulfil uncertainty analysis of biological models.

Sensitivity Analysis of an ENteric Immunity SImulator (ENISI)-Based Model of Immune Responses to Helicobacter pylori Infection

Agent-based models (ABM) are widely used to study immune systems, providing a procedural and interactive view of the underlying system. The interaction of components and the behavior of individual objects is described procedurally as a function of the internal states and the local interactions, which are often stochastic in nature. Such models typically have complex structures and consist of a large number of modeling parameters. Determining the key modeling parameters which govern the outcomes of the system is very challenging. Sensitivity analysis plays a vital role in quantifying the impact of modeling parameters in massively interacting systems, including large complex ABM. The high computational cost of executing simulations impedes running experiments with exhaustive parameter settings. Existing techniques of analyzing such a complex system typically focus on local sensitivity analysis, i.e. one parameter at a time, or a close “neighborhood” of particular parameter settings. However, such methods are not adequate to measure the uncertainty and sensitivity of parameters accurately because they overlook the global impacts of parameters on the system. In this article, we develop novel experimental design and analysis techniques to perform both global and local sensitivity analysis of large-scale ABMs. The proposed method can efficiently identify the most significant parameters and quantify their contributions to outcomes of the system. We demonstrate the proposed methodology for ENteric Immune SImulator (ENISI), a large-scale ABM environment, using a computational model of immune responses to Helicobacter pylori colonization of the gastric mucosa.

When can we trust our model predictions? Unearthing structural sensitivity in biological systems

It is well recognized that models in the life sciences can be sensitive to small variations in their model functions, a phenomenon known as ‘structural sensitivity’. Conventionally, modellers test for sensitivity by varying parameters for a specific formulation of the model functions, but models can show structural sensitivity to the choice of functional representations used: a particularly concerning problem when system processes are too complex, or insufficiently understood, to theoretically justify specific parameterizations. Here we propose a rigorous test for the detection of structural sensitivity in a system with respect to the local stability of equilibria, the main idea being to project infinite dimensional function space onto a finite dimensional space by considering the local properties of the model functions. As an illustrative example, we use our test to demonstrate structural sensitivity in the seminal Rosenzweig–MacArthur predator–prey model, and show that the conventional parameter-based approach can fail to do so. We also consider some implications that structural sensitivity has for ecological modelling: we argue that when the model exhibits structural sensitivity but experimental results remain consistent it may indicate that there is a problem with the model construction, and that in some cases trying to find an ‘optimal’ parameterization of a model function may simply be impossible when the model exhibits structural sensitivity. Finally, we suggest that the phenomenon of structural sensitivity in biological models may help explain the irregular oscillations often observed in real ecosystems.