Mean-field descriptions of collective migration with strong adhesion

Lattice-based stochastic models motivate non-linear diffusion descriptions of memory-based dispersal

The role of memory and cognition in the movement of individuals (e.g. animals) within a population, is thought to play an important role in population dispersal. In response, there has been increasing interest in incorporating spatial memory effects into classical partial differential equation (PDE) models of animal dispersal. However, the specific detail of the transport terms, such as diffusion and advection terms, that ought to be incorporated into PDE models to accurately reflect the memory effect remains unclear. To bridge this gap, we propose a straightforward lattice-based model where the movement of individuals depends on both crowding effects and the historic distribution within the simulation. The advantage of working with the individual-based model is that it is straightforward to propose and implement memory effects within the simulation in a way that is more biologically intuitive than simply proposing heuristic extensions of classical PDE models. Through deriving the continuum limit description of our stochastic model, we obtain a novel nonlinear diffusion equation which encompasses memory-based diffusion terms. For the first time we reveal the relationship between memory-based diffusion and the individual-based movement mechanisms that depend upon memory effects. Through repeated stochastic simulation and numerical explorations of the mean-field PDE model, we show that the new PDE model accurately describes the expected behaviour of the stochastic model, and we also explore how memory effects impact population dispersal.

Random walk models in the life sciences: including births, deaths and local interactions

Random walks and related spatial stochastic models have been used in a range of application areas, including animal and plant ecology, infectious disease epidemiology, developmental biology, wound healing and oncology. Classical random walk models assume that all individuals in a population behave independently, ignoring local physical and biological interactions. This assumption simplifies the mathematical description of the population considerably, enabling continuum-limit descriptions to be derived and used in model analysis and fitting. However, interactions between individuals can have a crucial impact on population-level behaviour. In recent decades, research has increasingly been directed towards models that include interactions, including physical crowding effects and local biological processes such as adhesion, competition, dispersal, predation and adaptive directional bias. In this article, we review the progress that has been made with models of interacting individuals. We aim to provide an overview that is accessible to researchers in application areas, as well as to specialist modellers. We focus particularly on derivation of asymptotically exact or approximate continuum-limit descriptions and simplified deterministic models of mean-field behaviour and resulting spatial patterns. We provide worked examples and illustrative results of selected models. We conclude with a discussion of current areas of focus and future challenges.

Forecasting and Predicting Stochastic Agent-Based Model Data with Biologically-Informed Neural Networks

Collective migration is an important component of many biological processes, including wound healing, tumorigenesis, and embryo development. Spatial agent-based models (ABMs) are often used to model collective migration, but it is challenging to thoroughly predict these models' behavior throughout parameter space due to their random and computationally intensive nature. Modelers often coarse-grain ABM rules into mean-field differential equation (DE) models. While these DE models are fast to simulate, they suffer from poor (or even ill-posed) ABM predictions in some regions of parameter space. In this work, we describe how biologically-informed neural networks (BINNs) can be trained to learn interpretable BINN-guided DE models capable of accurately predicting ABM behavior. In particular, we show that BINN-guided partial DE (PDE) simulations can (1) forecast future spatial ABM data not seen during model training, and (2) predict ABM data at previously-unexplored parameter values. This latter task is achieved by combining BINN-guided PDE simulations with multivariate interpolation. We demonstrate our approach using three case study ABMs of collective migration that imitate cell biology experiments and find that BINN-guided PDEs accurately forecast and predict ABM data with a one-compartment PDE when the mean-field PDE is ill-posed or requires two compartments. This work suggests that BINN-guided PDEs allow modelers to efficiently explore parameter space, which may enable data-driven tasks for ABMs, such as estimating parameters from experimental data. All code and data from our study is available at https://github.com/johnnardini/Forecasting_predicting_ABMs .

Interpreting how nonlinear diffusion affects the fate of bistable populations using a discrete modelling framework

Understanding whether a population will survive or become extinct is a central question in population biology. One way of exploring this question is to study population dynamics using reaction-diffusion equations, where migration is usually represented as a linear diffusion term, and birth-death is represented with a nonlinear source term. While linear diffusion is most commonly employed to study migration, there are several limitations of this approach, such as the inability of linear diffusion-based models to predict a well-defined population front. One way to overcome this is to generalize the constant diffusivity, D , to a nonlinear diffusivity function D ( C ) , where C > 0 is the population density. While the choice of D ( C ) affects long-term survival or extinction of a bistable population, working solely in a continuum framework makes it difficult to understand how the choice of D ( C ) affects survival or extinction. We address this question by working with a discrete simulation model that is easy to interpret. This approach provides clear insight into how the choice of D ( C ) either encourages or suppresses population extinction relative to the classical linear diffusion model.

Seven challenges in the multiscale modeling of multicellular tissues

The growth and dynamics of multicellular tissues involve tightly regulated and coordinated morphogenetic cell behaviors, such as shape changes, movement, and division, which are governed by subcellular machinery and involve coupling through short- and long-range signals. A key challenge in the fields of developmental biology, tissue engineering and regenerative medicine is to understand how relationships between scales produce emergent tissue-scale behaviors. Recent advances in molecular biology, live-imaging and ex vivo techniques have revolutionized our ability to study these processes experimentally. To fully leverage these techniques and obtain a more comprehensive understanding of the causal relationships underlying tissue dynamics, computational modeling approaches are increasingly spanning multiple spatial and temporal scales, and are coupling cell shape, growth, mechanics, and signaling. Yet such models remain challenging: modeling at each scale requires different areas of technical skills, while integration across scales necessitates the solution to novel mathematical and computational problems. This review aims to summarize recent progress in multiscale modeling of multicellular tissues and to highlight ongoing challenges associated with the construction, implementation, interrogation, and validation of such models. This article is categorized under: Reproductive System Diseases > Computational Models Metabolic Diseases > Computational Models Cancer > Computational Models.

Learning differential equation models from stochastic agent-based model simulations

Agent-based models provide a flexible framework that is frequently used for modelling many biological systems, including cell migration, molecular dynamics, ecology and epidemiology. Analysis of the model dynamics can be challenging due to their inherent stochasticity and heavy computational requirements. Common approaches to the analysis of agent-based models include extensive Monte Carlo simulation of the model or the derivation of coarse-grained differential equation models to predict the expected or averaged output from the agent-based model. Both of these approaches have limitations, however, as extensive computation of complex agent-based models may be infeasible, and coarse-grained differential equation models can fail to accurately describe model dynamics in certain parameter regimes. We propose that methods from the equation learning field provide a promising, novel and unifying approach for agent-based model analysis. Equation learning is a recent field of research from data science that aims to infer differential equation models directly from data. We use this tutorial to review how methods from equation learning can be used to learn differential equation models from agent-based model simulations. We demonstrate that this framework is easy to use, requires few model simulations, and accurately predicts model dynamics in parameter regions where coarse-grained differential equation models fail to do so. We highlight these advantages through several case studies involving two agent-based models that are broadly applicable to biological phenomena: a birth-death-migration model commonly used to explore cell biology experiments and a susceptible-infected-recovered model of infectious disease spread.

Biologically-informed neural networks guide mechanistic modeling from sparse experimental data

Biologically-informed neural networks (BINNs), an extension of physics-informed neural networks [1], are introduced and used to discover the underlying dynamics of biological systems from sparse experimental data. In the present work, BINNs are trained in a supervised learning framework to approximate in vitro cell biology assay experiments while respecting a generalized form of the governing reaction-diffusion partial differential equation (PDE). By allowing the diffusion and reaction terms to be multilayer perceptrons (MLPs), the nonlinear forms of these terms can be learned while simultaneously converging to the solution of the governing PDE. Further, the trained MLPs are used to guide the selection of biologically interpretable mechanistic forms of the PDE terms which provides new insights into the biological and physical mechanisms that govern the dynamics of the observed system. The method is evaluated on sparse real-world data from wound healing assays with varying initial cell densities [2].

In this work we extend equation learning methods to be feasible for biological applications with nonlinear dynamics and where data are often sparse and noisy. Physics-informed neural networks have recently been shown to approximate solutions of PDEs from simulated noisy data while simultaneously optimizing the PDE parameters. However, the success of this method requires the correct specification of the governing PDE, which may not be known in practice. Here, we present an extension of the algorithm that allows neural networks to learn the nonlinear terms of the governing system without the need to specify the mechanistic form of the PDE. Our method is demonstrated on real-world biological data from scratch assay experiments and used to discover a previously unconsidered biological mechanism that describes delayed population response to the scratch.

Travelling wave solutions in a negative nonlinear diffusion-reaction model

We use a geometric approach to prove the existence of smooth travelling wave solutions of a nonlinear diffusion–reaction equation with logistic kinetics and a convex nonlinear diffusivity function which changes sign twice in our domain of interest. We determine the minimum wave speed, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$c^*$$\end{document}c∗, and investigate its relation to the spectral stability of a desingularised linear operator associated with the travelling wave solutions.

Mathematical models for cell migration: a non-local perspective

We provide a review of recent advancements in non-local continuous models for migration, mainly from the perspective of its involvement in embryonal development and cancer invasion. Particular emphasis is placed on spatial non-locality occurring in advection terms, used to characterize a cell's motility bias according to its interactions with other cellular and acellular components in its vicinity (e.g. cell-cell and cell-tissue adhesions, non-local chemotaxis), but we also briefly address spatially non-local source terms. Following a short introduction and description of applications, we give a systematic classification of available PDE models with respect to the type of featured non-localities and review some of the mathematical challenges arising from such models, with a focus on analytical aspects. This article is part of the theme issue 'Multi-scale analysis and modelling of collective migration in biological systems'.

From a discrete model of chemotaxis with volume-filling to a generalized Patlak-Keller-Segel model

We present a discrete model of chemotaxis whereby cells responding to a chemoattractant are seen as individual agents whose movement is described through a set of rules that result in a biased random walk. In order to take into account possible alterations in cellular motility observed at high cell densities (i.e. volume-filling), we let the probabilities of cell movement be modulated by a decaying function of the cell density. We formally show that a general form of the celebrated Patlak-Keller-Segel (PKS) model of chemotaxis can be formally derived as the appropriate continuum limit of this discrete model. The family of steady-state solutions of such a generalized PKS model are characterized and the conditions for the emergence of spatial patterns are studied via linear stability analysis. Moreover, we carry out a systematic quantitative comparison between numerical simulations of the discrete model and numerical solutions of the corresponding PKS model, both in one and in two spatial dimensions. The results obtained indicate that there is excellent quantitative agreement between the spatial patterns produced by the two models. Finally, we numerically show that the outcomes of the two models faithfully replicate those of the classical PKS model in a suitable asymptotic regime.

A space-jump derivation for non-local models of cell-cell adhesion and non-local chemotaxis

Cellular adhesion provides one of the fundamental forms of biological interaction between cells and their surroundings, yet the continuum modelling of cellular adhesion has remained mathematically challenging. In 2006, Armstrong et al. proposed a mathematical model in the form of an integro-partial differential equation. Although successful in applications, a derivation from an underlying stochastic random walk has remained elusive. In this work we develop a framework by which non-local models can be derived from a space-jump process. We show how the notions of motility and a cell polarization vector can be naturally included. With this derivation we are able to include microscopic biological properties into the model. We show that particular choices yield the original Armstrong model, while others lead to more general models, including a doubly non-local adhesion model and non-local chemotaxis models. Finally, we use random walk simulations to confirm that the corresponding continuum model represents the mean field behaviour of the stochastic random walk.

Variable species densities are induced by volume exclusion interactions upon domain growth

In this work we study the effect of domain growth on spatial correlations in agent populations containing multiple species. This is important as heterogenous cell populations are ubiquitous during the embryonic development of many species. We have previously shown that the long-term behavior of an agent population depends on the way in which domain growth is implemented. We extend this work to show that, depending on the way in which domain growth is implemented, different species dominate in multispecies simulations. Continuum approximations of the lattice-based model that ignore spatial correlations cannot capture this behavior, while those that explicitly account for spatial correlations can. The results presented here show that the precise mechanism of domain growth can determine the long-term behavior of multispecies populations and, in certain circumstances, establish spatially varying species densities.

Co-operation, Competition and Crowding: A Discrete Framework Linking Allee Kinetics, Nonlinear Diffusion, Shocks and Sharp-Fronted Travelling Waves

Invasion processes are ubiquitous throughout cell biology and ecology. During invasion, individuals can become isolated from the bulk population and behave differently. We present a discrete, exclusion-based description of the birth, death and movement of individuals. The model distinguishes between individuals that are part of, or are isolated from, the bulk population by imposing different rates of birth, death and movement. This enables the simulation of various co-operative or competitive mechanisms, where there is either a positive or negative benefit associated with being part of the bulk population, respectively. The mean-field approximation of the discrete process gives rise to 22 different classes of partial differential equation, which can include Allee kinetics and nonlinear diffusion. Here we examine the ability of each class of partial differential equation to support travelling wave solutions and interpret the long time behaviour in terms of the individual-level parameters. For the first time we show that the strong Allee effect and nonlinear diffusion can result in shock-fronted travelling waves. We also demonstrate how differences in group and individual motility rates can influence the persistence of a population and provide conditions for the successful invasion of a population.

How domain growth is implemented determines the long-term behavior of a cell population through its effect on spatial correlations

Domain growth plays an important role in many biological systems, and so the inclusion of domain growth in models of these biological systems is important to understanding how these systems function. In this work we present methods to include the effects of domain growth on the evolution of spatial correlations in a continuum approximation of a lattice-based model of cell motility and proliferation. We show that, depending on the way in which domain growth is implemented, different steady-state densities are predicted for an agent population. Furthermore, we demonstrate that the way in which domain growth is implemented can result in the evolution of the agent density depending on the size of the domain. Continuum approximations that ignore spatial correlations cannot capture these behaviors, while those that account for spatial correlations do. These results will be of interest to researchers in developmental biology, as they suggest that the nature of domain growth can determine the characteristics of cell populations.

Filling the gaps: A robust description of adhesive birth-death-movement processes

Existing continuum descriptions of discrete adhesive birth-death-movement processes provide accurate predictions of the average discrete behavior for limited parameter regimes. Here we present an alternative continuum description in terms of the dynamics of groups of contiguous occupied and vacant lattice sites. Our method provides more accurate predictions, is valid in parameter regimes that could not be described by previous continuum descriptions, and provides information about the spatial clustering of occupied sites. Furthermore, we present a simple analytic approximation of the spatial clustering of occupied sites at late time, when the system reaches its steady-state configuration.

Modeling keratinocyte wound healing dynamics: Cell-cell adhesion promotes sustained collective migration

The in vitro migration of keratinocyte cell sheets displays behavioral and biochemical similarities to the in vivo wound healing response of keratinocytes in animal model systems. In both cases, ligand-dependent Epidermal Growth Factor Receptor (EGFR) activation is sufficient to elicit collective cell migration into the wound. Previous mathematical modeling studies of in vitro wound healing assays assume that physical connections between cells have a hindering effect on cell migration, but biological literature suggests a more complicated story. By combining mathematical modeling and experimental observations of collectively migrating sheets of keratinocytes, we investigate the role of cell-cell adhesion during in vitro keratinocyte wound healing assays. We develop and compare two nonlinear diffusion models of the wound healing process in which cell-cell adhesion either hinders or promotes migration. Both models can accurately fit the leading edge propagation of cell sheets during wound healing when using a time-dependent rate of cell-cell adhesion strength. The model that assumes a positive role of cell-cell adhesion on migration, however, is robust to changes in the leading edge definition and yields a qualitatively accurate density profile. Using RNAi for the critical adherens junction protein, α-catenin, we demonstrate that cell sheets with wild type cell-cell adhesion expression maintain migration into the wound longer than cell sheets with decreased cell-cell adhesion expression, which fails to exhibit collective migration. Our modeling and experimental data thus suggest that cell-cell adhesion promotes sustained migration as cells pull neighboring cells into the wound during wound healing.

Spatial point processes and moment dynamics in the life sciences: a parsimonious derivation and some extensions

Mathematical models of dynamical systems in the life sciences typically assume that biological systems are spatially well mixed (the mean-field assumption). Even spatially explicit differential equation models typically make a local mean-field assumption. In effect, the assumption is that diffusive movement is strong enough to destroy spatial structure or that interactions between individuals are sufficiently long-range that the effects of spatial structure are weak. However, many important biophysical processes, such as chemical reactions of biomolecules within cells, disease transmission among humans, and dispersal of plants, have characteristic spatial scales that can generate strong spatial structure at the scale of individuals, with important effects on the behaviour of biological systems. This calls for mathematical methods that incorporate spatial structure. Here, we focus on one method, spatial-moment dynamics, which is based on the idea that important information about a spatial point process is held in its low-order spatial moments. The method goes beyond the dynamics of the first moment, i.e. the mean density or concentration of agents in space, in which no information about spatial structure is retained. By including the dynamics of at least the second moment, the method retains some information about spatial structure. Whereas mean-field models effectively use a closure assumption for the second moment, spatial-moment models use a closure assumption for the third (or a higher-order) moment. The aim of the paper was to provide a parsimonious and intuitive derivation of spatial-moment dynamic equations that is accessible to non-specialists. The derivation builds naturally from the first moment to the second, and we show how it can be extended to higher-order moments. Rather than tying the model to a specific biological example, we formulate a general model of movement, birth, and death of multiple types of interacting agents. This model can be applied to problems from a range of disciplines, some of which we discuss. The derivation is performed in a spatially non-homogeneous setting, to facilitate future investigations of biological scenarios, such as invasions, in which the spatial patterns are non-stationary over space.

Assessing the role of spatial correlations during collective cell spreading

Spreading cell fronts are essential features of development, repair and disease processes. Many mathematical models used to describe the motion of cell fronts, such as Fisher's equation, invoke a mean-field assumption which implies that there is no spatial structure, such as cell clustering, present. Here, we examine the presence of spatial structure using a combination of in vitro circular barrier assays, discrete random walk simulations and pair correlation functions. In particular, we analyse discrete simulation data using pair correlation functions to show that spatial structure can form in a spreading population of cells either through sufficiently strong cell-to-cell adhesion or sufficiently rapid cell proliferation. We analyse images from a circular barrier assay describing the spreading of a population of MM127 melanoma cells using the same pair correlation functions. Our results indicate that the spreading melanoma cell populations remain very close to spatially uniform, suggesting that the strength of cell-to-cell adhesion and the rate of cell proliferation are both sufficiently small so as not to induce any spatial patterning in the spreading populations.

A continuum approximation to an off-lattice individual-cell based model of cell migration and adhesion

Cell-cell adhesion plays a key role in the collective migration of cells and in determining correlations in the relative cell positions and velocities. Recently, it was demonstrated that off-lattice individual cell based models (IBMs) can accurately capture the correlations observed experimentally in a migrating cell population. However, IBMs are often computationally expensive and difficult to analyse mathematically. Traditional continuum-based models, in contrast, are amenable to mathematical analysis and are computationally less demanding, but typically correspond to a mean-field approximation of cell migration and so ignore cell-cell correlations. In this work, we address this problem by using an off-lattice IBM to derive a continuum approximation which does take into account correlations. We furthermore show that a mean-field approximation of the off-lattice IBM leads to a single partial integro-differential equation of the same form as proposed by Sherratt and co-workers to model cell adhesion. The latter is found to be only effective at approximating the ensemble averaged cell number density when mechanical interactions between cells are weak. In contrast, the predictions of our novel continuum model for the time-evolution of the ensemble cell number density distribution and of the density-density correlation function are in close agreement with those obtained from the IBM for a wide range of mechanical interaction strengths. In particular, we observe 'front-like' propagation of cells in simulations using both our IBM and our continuum model, but not in the continuum model simulations obtained using the mean-field approximation.

Do pioneer cells exist?

Most mathematical models of collective cell spreading make the standard assumption that the cell diffusivity and cell proliferation rate are constants that do not vary across the cell population. Here we present a combined experimental and mathematical modeling study which aims to investigate how differences in the cell diffusivity and cell proliferation rate amongst a population of cells can impact the collective behavior of the population. We present data from a three-dimensional transwell migration assay that suggests that the cell diffusivity of some groups of cells within the population can be as much as three times higher than the cell diffusivity of other groups of cells within the population. Using this information, we explore the consequences of explicitly representing this variability in a mathematical model of a scratch assay where we treat the total population of cells as two, possibly distinct, subpopulations. Our results show that when we make the standard assumption that all cells within the population behave identically we observe the formation of moving fronts of cells where both subpopulations are well-mixed and indistinguishable. In contrast, when we consider the same system where the two subpopulations are distinct, we observe a very different outcome where the spreading population becomes spatially organized with the more motile subpopulation dominating at the leading edge while the less motile subpopulation is practically absent from the leading edge. These modeling predictions are consistent with previous experimental observations and suggest that standard mathematical approaches, where we treat the cell diffusivity and cell proliferation rate as constants, might not be appropriate.

Lattice-free descriptions of collective motion with crowding and adhesion

Cell-to-cell adhesion is an important aspect of malignant spreading that is often observed in images from the experimental cell biology literature. Since cell-to-cell adhesion plays an important role in controlling the movement of individual malignant cells, it is likely that cell-to-cell adhesion also influences the spatial spreading of populations of such cells. Therefore, it is important for us to develop biologically realistic simulation tools that can mimic the key features of such collective spreading processes to improve our understanding of how cell-to-cell adhesion influences the spreading of cell populations. Previous models of collective cell spreading with adhesion have used lattice-based random walk frameworks which may lead to unrealistic results, since the agents in the random walk simulations always move across an artificial underlying lattice structure. This is particularly problematic in high-density regions where it is clear that agents in the random walk align along the underlying lattice, whereas no such regular alignment is ever observed experimentally. To address these limitations, we present a lattice-free model of collective cell migration that explicitly incorporates crowding and adhesion. We derive a partial differential equation description of the discrete process and show that averaged simulation results compare very well with numerical solutions of the partial differential equation.

Nonlinear subdiffusive fractional equations and the aggregation phenomenon

In this article we address the problem of the nonlinear interaction of subdiffusive particles. We introduce the random walk model in which statistical characteristics of a random walker such as escape rate and jump distribution depend on the mean density of particles. We derive a set of nonlinear subdiffusive fractional master equations and consider their diffusion approximations. We show that these equations describe the transition from an intermediate subdiffusive regime to asymptotically normal advection-diffusion transport regime. This transition is governed by nonlinear tempering parameter that generalizes the standard linear tempering. We illustrate the general results through the use of the examples from cell and population biology. We find that a nonuniform anomalous exponent has a strong influence on the aggregation phenomenon.

Exclusion processes: short-range correlations induced by adhesion and contact interactions

We analyze the out-of-equilibrium behavior of exclusion processes where agents interact with their nearest neighbors, and we study the short-range correlations which develop because of the exclusion and other contact interactions. The form of interactions we focus on, including adhesion and contact-preserving interactions, is especially relevant for migration processes of living cells. We show the local agent density and nearest-neighbor two-point correlations resulting from simulations on two-dimensional lattices in the transient regime where agents invade an initially empty space from a source and in the stationary regime between a source and a sink. We compare the results of simulations with the corresponding quantities derived from the master equation of the exclusion processes, and in both cases, we show that, during the invasion of space by agents, a wave of correlations travels with velocity v(t)~t(-1/2). The relative placement of this wave to the agent density front and the time dependence of its height may be used to discriminate between different forms of contact interactions or to quantitatively estimate the intensity of interactions. We discuss, in the stationary density profile between a full and an empty reservoir of agents, the presence of a discontinuity close to the empty reservoir. Then we develop a method for deriving approximate hydrodynamic limits of the processes. From the resulting systems of partial differential equations, we recover the self-similar behavior of the agent density and correlations during space invasion.