Intrinsic noise in systems with switching environments

Optimisation of gene expression noise for cellular persistence against lethal events

Bacterial cell persistence, crucial for survival under adverse conditions like antibiotic exposure, is intrinsically linked to stochastic fluctuations in gene expression. Certain genes, while inhibiting growth under normal circumstances, confer tolerance to antibiotics at elevated expression levels. The occurrence of antibiotic events lead to instantaneous cellular responses with varied survival probabilities correlated with gene expression levels. Notably, cells with lower protein concentrations face higher mortality rates. This study aims to elucidate an optimal strategy for protein expression conducive to cellular survival. Through comprehensive mathematical analysis, we determine the optimal burst size and frequency that maximise cell proliferation. Furthermore, we explore how the optimal expression distribution changes as the cost of protein expression to growth escalates. Our model reveals a hysteresis phenomenon, characterised by discontinuous transitions between deterministic and stochastic optima. Intriguingly, stochastic optima possess a noise floor, representing the minimal level of fluctuations essential for optimal cellular resilience.

Navigating uncertainty: Risk-averse versus risk-prone strategies in populations facing demographic and environmental stochasticity

Strategies aimed at reducing the negative effects of long-term uncertainty and risk are common in biology, game theory, and finance, even if they entail a cost in terms of mean benefit. Here, we focus on the single mutant's invasion of a finite resident population subject to fluctuating environmental conditions. Thus, the game-theoretical model we analyze integrates environmental and demographic randomness, i.e., the two leading sources of stochasticity and uncertainty. We use simulations and mathematical analysis to study if and when strategies that either increase or reduce payoff variance across environmental states can enhance the mutant fixation probability. Variance aversion implies that the mutant pays insurance in terms of mean payoff to avoid worst-case scenarios. Variance-prone or gambling strategies, on the other hand, entail specialization, allowing the mutant to capitalize on transient favorable conditions, leading to a series of "boom-and-bust" cycles. Our analyses elucidate how the rate of change of environmental conditions and the shape of the probability distribution of possible states affect the possible most convenient strategies. We discuss how our results relate to the bet-hedging theory, which aims to reduce fitness variance rather than payoff variance. We also describe the analogies and differences between these similar yet distinct approaches.

Competition of two time scales determines the performance of a voltage-gated potassium channel

The dynamics of a voltage-gated potassium channel in real environments represents a crucial bridge between its molecular structure and functions. However, it is still missing due to the mathematical difficulty that arises from the high dimensionality and nonlinear interregulation. Here we present a method for solving the stationary distribution of a hybrid process that contains two negatively interregulating kinetics: channel gating and voltage decay. The results can be summarized as follows: first, the voltage distribution is determined by the competition of their time scales; second, the fluctuation structures in parameter space illustrate that, to perform the voltage-controlling task, the channel gating is elastic while the membrane produces the stabilizing function; third, the power dissipated by the capacitive currents and the internal battery current are calculated and explained. Based on these findings, we examine the manner in which macroscopic functions of potassium channels are manifested. Our methodology provides an accurate characterization of hybrid processes that are pervasive in the life sciences.

Mutant fate in spatially structured populations on graphs: Connecting models to experiments

In nature, most microbial populations have complex spatial structures that can affect their evolution. Evolutionary graph theory predicts that some spatial structures modelled by placing individuals on the nodes of a graph affect the probability that a mutant will fix. Evolution experiments are beginning to explicitly address the impact of graph structures on mutant fixation. However, the assumptions of evolutionary graph theory differ from the conditions of modern evolution experiments, making the comparison between theory and experiment challenging. Here, we aim to bridge this gap by using our new model of spatially structured populations. This model considers connected subpopulations that lie on the nodes of a graph, and allows asymmetric migrations. It can handle large populations, and explicitly models serial passage events with migrations, thus closely mimicking experimental conditions. We analyze recent experiments in light of this model. We suggest useful parameter regimes for future experiments, and we make quantitative predictions for these experiments. In particular, we propose experiments to directly test our recent prediction that the star graph with asymmetric migrations suppresses natural selection and can accelerate mutant fixation or extinction, compared to a well-mixed population.

Solving stochastic gene-expression models using queueing theory: A tutorial review

Stochastic models of gene expression are typically formulated using the chemical master equation, which can be solved exactly or approximately using a repertoire of analytical methods. Here, we provide a tutorial review of an alternative approach based on queueing theory that has rarely been used in the literature of gene expression. We discuss the interpretation of six types of infinite-server queues from the angle of stochastic single-cell biology and provide analytical expressions for the stationary and nonstationary distributions and/or moments of mRNA/protein numbers and bounds on the Fano factor. This approach may enable the solution of complex models that have hitherto evaded analytical solution.

Truncated stochastically switching processes

There are a large variety of hybrid stochastic systems that couple a continuous process with some form of stochastic switching mechanism. In many cases the system switches between different discrete internal states according to a finite-state Markov chain, and the continuous dynamics depends on the current internal state. The resulting hybrid stochastic differential equation (hSDE) could describe the evolution of a neuron's membrane potential, the concentration of proteins synthesized by a gene network, or the position of an active particle. Another major class of switching system is a search process with stochastic resetting, where the position of a diffusing or active particle is reset to a fixed position at a random sequence of times. In this case the system switches between a search phase and a reset phase, where the latter may be instantaneous. In this paper, we investigate how the behavior of a stochastically switching system is modified when the maximum number of switching (or reset) events in a given time interval is fixed. This is motivated by the idea that each time the system switches there is an additive energy cost. We first show that in the case of an hSDE, restricting the number of switching events is equivalent to truncating a Volterra series expansion of the particle propagator. Such a truncation significantly modifies the moments of the resulting renormalized propagator. We then investigate how restricting the number of reset events affects the diffusive search for an absorbing target. In particular, truncating a Volterra series expansion of the survival probability, we calculate the splitting probabilities and conditional MFPTs for the particle to be absorbed by the target or exceed a given number of resets, respectively.

Frequent asymmetric migrations suppress natural selection in spatially structured populations

Natural microbial populations often have complex spatial structures. This can impact their evolution, in particular the ability of mutants to take over. While mutant fixation probabilities are known to be unaffected by sufficiently symmetric structures, evolutionary graph theory has shown that some graphs can amplify or suppress natural selection, in a way that depends on microscopic update rules. We propose a model of spatially structured populations on graphs directly inspired by batch culture experiments, alternating within-deme growth on nodes and migration-dilution steps, and yielding successive bottlenecks. This setting bridges models from evolutionary graph theory with Wright-Fisher models. Using a branching process approach, we show that spatial structure with frequent migrations can only yield suppression of natural selection. More precisely, in this regime, circulation graphs, where the total incoming migration flow equals the total outgoing one in each deme, do not impact fixation probability, while all other graphs strictly suppress selection. Suppression becomes stronger as the asymmetry between incoming and outgoing migrations grows. Amplification of natural selection can nevertheless exist in a restricted regime of rare migrations and very small fitness advantages, where we recover the predictions of evolutionary graph theory for the star graph.

Coupled environmental and demographic fluctuations shape the evolution of cooperative antimicrobial resistance

There is a pressing need to better understand how microbial populations respond to antimicrobial drugs, and to find mechanisms to possibly eradicate antimicrobial-resistant cells. The inactivation of antimicrobials by resistant microbes can often be viewed as a cooperative behaviour leading to the coexistence of resistant and sensitive cells in large populations and static environments. This picture is, however, greatly altered by the fluctuations arising in volatile environments, in which microbial communities commonly evolve. Here, we study the eco-evolutionary dynamics of a population consisting of an antimicrobial-resistant strain and microbes sensitive to antimicrobial drugs in a time-fluctuating environment, modelled by a carrying capacity randomly switching between states of abundance and scarcity. We assume that antimicrobial resistance (AMR) is a shared public good when the number of resistant cells exceeds a certain threshold. Eco-evolutionary dynamics is thus characterised by demographic noise (birth and death events) coupled to environmental fluctuations which can cause population bottlenecks. By combining analytical and computational means, we determine the environmental conditions for the long-lived coexistence and fixation of both strains, and characterise a fluctuation-driven AMR eradication mechanism, where resistant microbes experience bottlenecks leading to extinction. We also discuss the possible applications of our findings to laboratory-controlled experiments.

Noisy voter models in switching environments

We study the stationary states of variants of the noisy voter model, subject to fluctuating parameters or external environments. Specifically, we consider scenarios in which the herding-to-noise ratio switches randomly and on different timescales between two values. We show that this can lead to a phase in which polarized and heterogeneous states exist. Second, we analyze a population of noisy voters subject to groups of external influencers, and show how multipeak stationary distributions emerge. Our work is based on a combination of individual-based simulations, analytical approximations in terms of a piecewise-deterministic Markov processes (PDMP), and on corrections to this process capturing intrinsic stochasticity in the linear-noise approximation. We also propose a numerical scheme to obtain the stationary distribution of PDMPs with three environmental states and linear velocity fields.

Lotka-Volterra predator-prey model with periodically varying carrying capacity

We study the stochastic spatial Lotka-Volterra model for predator-prey interaction subject to a periodically varying carrying capacity. The Lotka-Volterra model with on-site lattice occupation restrictions (i.e., finite local carrying capacity) that represent finite food resources for the prey population exhibits a continuous active-to-absorbing phase transition. The active phase is sustained by the existence of spatiotemporal patterns in the form of pursuit and evasion waves. Monte Carlo simulations on a two-dimensional lattice are utilized to investigate the effect of seasonal variations of the environment on species coexistence. The results of our simulations are also compared to a mean-field analysis in order to specifically delineate the impact of stochastic fluctuations and spatial correlations. We find that the parameter region of predator and prey coexistence is enlarged relative to the stationary situation when the carrying capacity varies periodically. The (quasi-)stationary regime of our periodically varying Lotka-Volterra predator-prey system shows qualitative agreement between the stochastic model and the mean-field approximation. However, under periodic carrying capacity-switching environments, the mean-field rate equations predict period-doubling scenarios that are washed out by internal reaction noise in the stochastic lattice model. Utilizing visual representations of the lattice simulations and dynamical correlation functions, we study how the pursuit and evasion waves are affected by ensuing resonance effects. Correlation function measurements indicate a time delay in the response of the system to sudden changes in the environment. Resonance features are observed in our simulations that cause prolonged persistent spatial correlations. Different effective static environments are explored in the extreme limits of fast and slow periodic switching. The analysis of the mean-field equations in the fast-switching regime enables a semiquantitative description of the (quasi-)stationary state.

Stochastic switching of delayed feedback suppresses oscillations in genetic regulatory systems

Delays and stochasticity have both served as crucially valuable ingredients in mathematical descriptions of control, physical and biological systems. In this work, we investigate how explicitly dynamical stochasticity in delays modulates the effect of delayed feedback. To do so, we consider a hybrid model where stochastic delays evolve by a continuous-time Markov chain, and between switching events, the system of interest evolves via a deterministic delay equation. Our main contribution is the calculation of an effective delay equation in the fast switching limit. This effective equation maintains the influence of all subsystem delays and cannot be replaced with a single effective delay. To illustrate the relevance of this calculation, we investigate a simple model of stochastically switching delayed feedback motivated by gene regulation. We show that sufficiently fast switching between two oscillatory subsystems can yield stable dynamics.

A solution of the Crow-Kimura evolution model on fluctuating fitness landscape

The article discusses the Crow-Kimura model in the context of random transitions between different fitness landscapes. The duration of epochs, during which the fitness landscape is constant over time, is modeled by an exponential distribution. To obtain an exact solution, a system of functional equations is required. However, to approximate the model, we consider the cases of slow or fast transitions and calculate the first-order corrections using either the transition rate or its inverse. Specifically, we focus on the case of slow transitions and find that the average fitness is equal to the average fitness for evolution on static fitness landscapes, but with the addition of a load term. We also investigate the model for a small number of genes and identify the exact transition points to the transient phase.

Controlling the Mean Time to Extinction in Populations of Bacteria

Populations of ecological systems generally have demographic fluctuations due to birth and death processes. At the same time, they are exposed to changing environments. We studied populations composed of two phenotypes of bacteria and analyzed the impact that both types of fluctuations have on the mean time to extinction of the entire population if extinction is the final fate. Our results are based on Gillespie simulations and on the WKB approach applied to classical stochastic systems, here in certain limiting cases. As a function of the frequency of environmental changes, we observe a non-monotonic dependence of the mean time to extinction. Its dependencies on other system parameters are also explored. This allows the control of the mean time to extinction to be as large or as small as possible, depending on whether extinction should be avoided or is desired from the perspective of bacteria or the perspective of hosts to which the bacteria are deleterious.

Mutual Information Disentangles Interactions from Changing Environments

Real-world systems are characterized by complex interactions of their internal degrees of freedom, while living in ever-changing environments whose net effect is to act as additional couplings. Here, we introduce a paradigmatic interacting model in a switching, but unobserved, environment. We show that the limiting properties of the mutual information of the system allow for a disentangling of these two sources of couplings. Further, our approach might stand as a general method to discriminate complex internal interactions from equally complex changing environments.

Stochastic resonance of abundance fluctuations and mean time to extinction in an ecological community

Periodic environmental changes are commonly observed in nature from the amount of daylight to seasonal temperature. These changes usually affect individuals' death or birth rates, dragging the system from its previous stable states. When the fluctuation of abundance is amplified due to such changes, extinction of species may be accelerated. To see this effect, we examine how the abundance and the mean time to extinction respond to the periodic environmental changes. We consider a population wherein two species coexist together implemented by three rules-birth, spontaneous death, and death from competitions. As the interspecific interaction strength is varied, we observe the resonance behavior in both fluctuations of abundances and the mean time to extinction. Our result suggests that neither too high nor too low competition rates make the system more susceptible to environmental changes.

Beyond the adiabatic limit in systems with fast environments: A τ-leaping algorithm

We propose a τ-leaping simulation algorithm for stochastic systems subject to fast environmental changes. Similar to conventional τ-leaping the algorithm proceeds in discrete time steps, but as a principal addition it captures environmental noise beyond the adiabatic limit. The key idea is to treat the input rates for the τ-leaping as (clipped) Gaussian random variables with first and second moments constructed from the environmental process. In this way, each step of the algorithm retains environmental stochasticity to subleading order in the timescale separation between system and environment. We test the algorithm on several toy examples with discrete and continuous environmental states and find good performance in the regime of fast environmental dynamics. At the same time, the algorithm requires significantly less computing time than full simulations of the combined system and environment. In this context we also discuss several methods for the simulation of stochastic population dynamics in time-varying environments with continuous states.

Analytic solutions for stochastic hybrid models of gene regulatory networks

Discrete-state stochastic models are a popular approach to describe the inherent stochasticity of gene expression in single cells. The analysis of such models is hindered by the fact that the underlying discrete state space is extremely large. Therefore hybrid models, in which protein counts are replaced by average protein concentrations, have become a popular alternative. The evolution of the corresponding probability density functions is given by a coupled system of hyperbolic PDEs. This system has Markovian nature but its hyperbolic structure makes it difficult to apply standard functional analytical methods. We are able to prove convergence towards the stationary solution and determine such equilibrium explicitly by combining abstract methods from the theory of positive operators and elementary ideas from potential analysis.

Liquid-liquid phase separation driven compartmentalization of reactive nucleoplasm

The nucleus of eukaryotic cells harbors active and out of equilibrium environments conducive to diverse gene regulatory processes. On a molecular scale, gene regulatory processes take place within hierarchically compartmentalized sub-nuclear bodies. While the impact of nuclear structure on gene regulation is widely appreciated, it has remained much less clear whether and how gene regulation is impacting nuclear order itself. Recently, the liquid-liquid phase separation emerged as a fundamental mechanism driving the formation of biomolecular condensates, including membrane-less organelles, chromatin territories, and transcriptional domains. The transience and environmental sensitivity of biomolecular condensation are strongly suggestive of kinetic gene-regulatory control of phase separation. To better understand kinetic aspects controlling biomolecular phase-separation, we have constructed a minimalist model of the reactive nucleoplasm. The model is based on the Cahn-Hilliard formulation of ternary protein-RNA-nucleoplasm components coupled to non-equilibrium and spatially dependent gene expression. We find a broad range of kinetic regimes through an extensive set of simulations where the interplay of phase separation and reactive timescales can generate heterogeneous multi-modal gene expression patterns. Furthermore, the significance of this finding is that heterogeneity of gene expression is linked directly with the heterogeneity of length-scales in phase-separated condensates.

Cyclic epidemics and extreme outbreaks induced by hydro-climatic variability and memory

A minimalist model of ecohydrologic dynamics is coupled to the well-known susceptible-infected-recovered epidemiological model to explore hydro-climatic controls on infection dynamics and extreme outbreaks. The resulting HYSIR model reveals the existence of a noise-induced bifurcation producing oscillations in infection dynamics. Linearization of the governing equations allows for an analytic expression for the periodicity of infections in terms of both epidemiological (e.g. transmission and recovery rate) and hydrologic (i.e. soil moisture decay rate or memory) parameters. Numerical simulations of the full stochastic, nonlinear system show extreme outbreaks in response to particular combinations of hydro-climatic conditions, neither of which is extreme per se, rather than a single major climatic event. These combinations depend on the assumed functional relationship between the hydrologic variables and the transmission rate. Our results emphasize the importance of hydro-climatic history and system memory in evaluating the risk of severe outbreaks.

Adapt or Perish: Evolutionary Rescue in a Gradually Deteriorating Environment

We investigate the evolutionary rescue of a microbial population in a gradually deteriorating environment, through a combination of analytical calculations and stochastic simulations. We consider a population destined for extinction in the absence of mutants, which can survive only if mutants sufficiently adapted to the new environment arise and fix. We show that mutants that appear later during the environment deterioration have a higher probability to fix. The rescue probability of the population increases with a sigmoidal shape when the product of the carrying capacity and of the mutation probability increases. Furthermore, we find that rescue becomes more likely for smaller population sizes and/or mutation probabilities if the environment degradation is slower, which illustrates the key impact of the rapidity of environment degradation on the fate of a population. We also show that our main conclusions are robust across various types of adaptive mutants, including specialist and generalist ones, as well as mutants modeling antimicrobial resistance evolution. We further express the average time of appearance of the mutants that do rescue the population and the average extinction time of those that do not. Our methods can be applied to other situations with continuously variable fitnesses and population sizes, and our analytical predictions are valid in the weak-to-moderate mutation regime.

Population Dynamics in a Changing Environment: Random versus Periodic Switching

Environmental changes greatly influence the evolution of populations. Here, we study the dynamics of a population of two strains, one growing slightly faster than the other, competing for resources in a time-varying binary environment modeled by a carrying capacity switching either randomly or periodically between states of abundance and scarcity. The population dynamics is characterized by demographic noise (birth and death events) coupled to a varying environment. We elucidate the similarities and differences of the evolution subject to a stochastically and periodically varying environment. Importantly, the population size distribution is generally found to be broader under intermediate and fast random switching than under periodic variations, which results in markedly different asymptotic behaviors between the fixation probability of random and periodic switching. We also determine the detailed conditions under which the fixation probability of the slow strain is maximal.

Emergence of stationary multimodality under two-timescaled dichotomic noise

We study a linear Langevin dynamics driven by an additive non-Markovian symmetrical dichotomic noise. It is shown that when the statistics of the time intervals between noise transitions is characterized by two well differentiated timescales, the stationary distribution may develop multimodality (bi- and trimodality). The underlying effects that lead to a probability concentration in different points include intermittence and also a dynamical locking of realizations. Our results are supported by numerical simulations as well as by an exact treatment obtained from a Markovian embedding of the full dynamics, which leads to a third-order differential equation for the stationary distribution.

Resist or perish: Fate of a microbial population subjected to a periodic presence of antimicrobial

The evolution of antimicrobial resistance can be strongly affected by variations of antimicrobial concentration. Here, we study the impact of periodic alternations of absence and presence of antimicrobial on resistance evolution in a microbial population, using a stochastic model that includes variations of both population composition and size, and fully incorporates stochastic population extinctions. We show that fast alternations of presence and absence of antimicrobial are inefficient to eradicate the microbial population and strongly favor the establishment of resistance, unless the antimicrobial increases enough the death rate. We further demonstrate that if the period of alternations is longer than a threshold value, the microbial population goes extinct upon the first addition of antimicrobial, if it is not rescued by resistance. We express the probability that the population is eradicated upon the first addition of antimicrobial, assuming rare mutations. Rescue by resistance can happen either if resistant mutants preexist, or if they appear after antimicrobial is added to the environment. Importantly, the latter case is fully prevented by perfect biostatic antimicrobials that completely stop division of sensitive microorganisms. By contrast, we show that the parameter regime where treatment is efficient is larger for biocidal drugs than for biostatic drugs. This sheds light on the respective merits of different antimicrobial modes of action.

Stochastic dynamics in a time-delayed model for autoimmunity

In this paper we study interactions between stochasticity and time delays in the dynamics of immune response to viral infections, with particular interest in the onset and development of autoimmune response. Starting with a deterministic time-delayed model of immune response to infection, which includes cytokines and T cells with different activation thresholds, we derive an exact delayed chemical master equation for the probability density. We use system size expansion and linear noise approximation to explore how variance and coherence of stochastic oscillations depend on parameters, and to show that stochastic oscillations become more regular when regulatory T cells become more effective at clearing autoreactive T cells. Reformulating the model as an Itô stochastic delay differential equation, we perform numerical simulations to illustrate the dynamics of the model and associated probability distributions in different parameter regimes. The results suggest that even in cases where the deterministic model has stable steady states, in individual stochastic realisations, the model can exhibit sustained stochastic oscillations, whose variance increases as one gets closer to the deterministic stability boundary. Furthermore, in the regime of bi-stability, whereas deterministically the system would approach one of the steady states (or periodic solutions) depending on the initial conditions, due to the presence of stochasticity, it is now possible for the system to reach both of those dynamical states with certain probability. Biological significance of this result lies in highlighting the fact that since normally in a laboratory or clinical setting one would observe a single individual realisation of the course of the disease, even for all parameters characterising the immune system and the strength of infection being the same, there is a proportion of cases where a spontaneous recovery can be observed, and similarly, where a disease can develop in a situation that otherwise would result in a normal disease clearance.

Invasion and Extinction Dynamics of Mating Types Under Facultative Sexual Reproduction

In sexually reproducing isogamous species, syngamy between gametes is generally not indiscriminate, but rather restricted to occurring between complementary self-incompatible mating types. A longstanding question regards the evolutionary pressures that control the number of mating types observed in natural populations, which ranges from two to many thousands. Here, we describe a population genetic null model of this reproductive system, and derive expressions for the stationary probability distribution of the number of mating types, the establishment probability of a newly arising mating type, and the mean time to extinction of a resident type. Our results yield that the average rate of sexual reproduction in a population correlates positively with the expected number of mating types observed. We further show that the low number of mating types predicted in the rare-sex regime is primarily driven by low invasion probabilities of new mating type alleles, with established resident alleles being very stable over long evolutionary periods. Moreover, our model naturally exhibits varying selection strength dependent on the number of resident mating types. This results in higher extinction and lower invasion rates for an increasing number of residents.

Exact and efficient hybrid Monte Carlo algorithm for accelerated Bayesian inference of gene expression models from snapshots of single-cell transcripts

Single cells exhibit a significant amount of variability in transcript levels, which arises from slow, stochastic transitions between gene expression states. Elucidating the nature of these states and understanding how transition rates are affected by different regulatory mechanisms require state-of-the-art methods to infer underlying models of gene expression from single cell data. A Bayesian approach to statistical inference is the most suitable method for model selection and uncertainty quantification of kinetic parameters using small data sets. However, this approach is impractical because current algorithms are too slow to handle typical models of gene expression. To solve this problem, we first show that time-dependent mRNA distributions of discrete-state models of gene expression are dynamic Poisson mixtures, whose mixing kernels are characterized by a piecewise deterministic Markov process. We combined this analytical result with a kinetic Monte Carlo algorithm to create a hybrid numerical method that accelerates the calculation of time-dependent mRNA distributions by 1000-fold compared to current methods. We then integrated the hybrid algorithm into an existing Monte Carlo sampler to estimate the Bayesian posterior distribution of many different, competing models in a reasonable amount of time. We demonstrate that kinetic parameters can be reasonably constrained for modestly sampled data sets if the model is known a priori. If there are many competing models, Bayesian evidence can rigorously quantify the likelihood of a model relative to other models from the data. We demonstrate that Bayesian evidence selects the true model and outperforms approximate metrics typically used for model selection.

Efficient analysis of stochastic gene dynamics in the non-adiabatic regime using piecewise deterministic Markov processes

Single-cell experiments show that gene expression is stochastic and bursty, a feature that can emerge from slow switching between promoter states with different activities. In addition to slow chromatin and/or DNA looping dynamics, one source of long-lived promoter states is the slow binding and unbinding kinetics of transcription factors to promoters, i.e. the non-adiabatic binding regime. Here, we introduce a simple analytical framework, known as a piecewise deterministic Markov process (PDMP), that accurately describes the stochastic dynamics of gene expression in the non-adiabatic regime. We illustrate the utility of the PDMP on a non-trivial dynamical system by analysing the properties of a titration-based oscillator in the non-adiabatic limit. We first show how to transform the underlying chemical master equation into a PDMP where the slow transitions between promoter states are stochastic, but whose rates depend upon the faster deterministic dynamics of the transcription factors regulated by these promoters. We show that the PDMP accurately describes the observed periods of stochastic cycles in activator and repressor-based titration oscillators. We then generalize our PDMP analysis to more complicated versions of titration-based oscillators to explain how multiple binding sites lengthen the period and improve coherence. Last, we show how noise-induced oscillation previously observed in a titration-based oscillator arises from non-adiabatic and discrete binding events at the promoter site.

Model reduction methods for population dynamics with fast-switching environments: Reduced master equations, stochastic differential equations, and applications

We study stochastic population dynamics coupled to fast external environments and combine expansions in the inverse switching rate of the environment and a Kramers-Moyal expansion in the inverse size of the population. This leads to a series of approximation schemes, capturing both intrinsic and environmental noise. These methods provide a means of efficient simulation and we show how they can be used to obtain analytical results for the fluctuations of population dynamics in switching environments. We place the approximations in relation to existing work on piecewise-deterministic and piecewise-diffusive Markov processes. Finally, we demonstrate the accuracy and efficiency of these model-reduction methods in different research fields, including systems in biology and a model of crack propagation.

Bet-hedging strategies in expanding populations

In ecology, species can mitigate their extinction risks in uncertain environments by diversifying individual phenotypes. This observation is quantified by the theory of bet-hedging, which provides a reason for the degree of phenotypic diversity observed even in clonal populations. Bet-hedging in well-mixed populations is rather well understood. However, many species underwent range expansions during their evolutionary history, and the importance of phenotypic diversity in such scenarios still needs to be understood. In this paper, we develop a theory of bet-hedging for populations colonizing new, unknown environments that fluctuate either in space or time. In this case, we find that bet-hedging is a more favorable strategy than in well-mixed populations. For slow rates of variation, temporal and spatial fluctuations lead to different outcomes. In spatially fluctuating environments, bet-hedging is favored compared to temporally fluctuating environments. In the limit of frequent environmental variation, no opportunity for bet-hedging exists, regardless of the nature of the environmental fluctuations. For the same model, bet-hedging is never an advantageous strategy in the well-mixed case, supporting the view that range expansions strongly promote diversification. These conclusions are robust against stochasticity induced by finite population sizes. Our findings shed light on the importance of phenotypic heterogeneity in range expansions, paving the way to novel approaches to understand how biodiversity emerges and is maintained.

Ecological populations are often exposed to unpredictable and variable environmental conditions. A number of strategies have evolved to cope with such uncertainty. One of them is stochastic phenotypic switching, by which some individuals in the community are enabled to tackle adverse conditions, even at the price of reducing overall growth in the short term. In this paper, we study the effectiveness of these “bet-hedging” strategies for a population in the process of colonizing new territory. We show that bet-hedging is more advantageous when the environment varies spatially rather than temporally, and infrequently rather than frequently.

Synchronization of stochastic hybrid oscillators driven by a common switching environment

Many systems in biology, physics, and chemistry can be modeled through ordinary differential equations (ODEs), which are piecewise smooth, but switch between different states according to a Markov jump process. In the fast switching limit, the dynamics converges to a deterministic ODE. In this paper, we suppose that this limit ODE supports a stable limit cycle. We demonstrate that a set of such oscillators can synchronize when they are uncoupled, but they share the same switching Markov jump process. The latter is taken to represent the effect of a common randomly switching environment. We determine the leading order of the Lyapunov coefficient governing the rate of decay of the phase difference in the fast switching limit. The analysis bears some similarities to the classical analysis of synchronization of stochastic oscillators subject to common white noise. However, the discrete nature of the Markov jump process raises some difficulties: in fact, we find that the Lyapunov coefficient from the quasi-steady-state approximation differs from the Lyapunov coefficient one obtains from a second order perturbation expansion in the waiting time between jumps. Finally, we demonstrate synchronization numerically in the radial isochron clock model and show that the latter Lyapunov exponent is more accurate.

Eco-evolutionary dynamics of a population with randomly switching carrying capacity

Environmental variability greatly influences the eco-evolutionary dynamics of a population, i.e. it affects how its size and composition evolve. Here, we study a well-mixed population of finite and fluctuating size whose growth is limited by a randomly switching carrying capacity. This models the environmental fluctuations between states of resources abundance and scarcity. The population consists of two strains, one growing slightly faster than the other, competing under two scenarios: one in which competition is solely for resources, and one in which the slow (cooperating) strain produces a public good (PG) that benefits also the fast (free-riding) strain. We investigate how the coupling of demographic and environmental (external) noise affects the population's eco-evolutionary dynamics. By analytical and computational means, we study the correlations between the population size and its composition, and discuss the social-dilemma-like 'eco-evolutionary game' characterizing the PG production. We determine in what conditions it is best to produce a PG; when cooperating is beneficial but outcompeted by free riding, and when the PG production is detrimental for cooperators. Within a linear noise approximation to populations of varying size, we also accurately analyse the coupled effects of demographic and environmental noise on the size distribution.

A variational method for analyzing limit cycle oscillations in stochastic hybrid systems

Many systems in biology can be modeled through ordinary differential equations, which are piece-wise continuous, and switch between different states according to a Markov jump process known as a stochastic hybrid system or piecewise deterministic Markov process (PDMP). In the fast switching limit, the dynamics converges to a deterministic ODE. In this paper, we develop a phase reduction method for stochastic hybrid systems that support a stable limit cycle in the deterministic limit. A classic example is the Morris-Lecar model of a neuron, where the switching Markov process is the number of open ion channels and the continuous process is the membrane voltage. We outline a variational principle for the phase reduction, yielding an exact analytic expression for the resulting phase dynamics. We demonstrate that this decomposition is accurate over timescales that are exponential in the switching rate ϵ^-1. That is, we show that for a constant C, the probability that the expected time to leave an O(a) neighborhood of the limit cycle is less than T scales as T exp (-Ca/ϵ).

Generalizing Gillespie's Direct Method to Enable Network-Free Simulations

Gillespie's direct method for stochastic simulation of chemical kinetics is a staple of computational systems biology research. However, the algorithm requires explicit enumeration of all reactions and all chemical species that may arise in the system. In many cases, this is not feasible due to the combinatorial explosion of reactions and species in biological networks. Rule-based modeling frameworks provide a way to exactly represent networks containing such combinatorial complexity, and generalizations of Gillespie's direct method have been developed as simulation engines for rule-based modeling languages. Here, we provide both a high-level description of the algorithms underlying the simulation engines, termed network-free simulation algorithms, and how they have been applied in systems biology research. We also define a generic rule-based modeling framework and describe a number of technical details required for adapting Gillespie's direct method for network-free simulation. Finally, we briefly discuss potential avenues for advancing network-free simulation and the role they continue to play in modeling dynamical systems in biology.

Survival behavior in the cyclic Lotka-Volterra model with a randomly switching reaction rate

We study the influence of a randomly switching reproduction-predation rate on the survival behavior of the nonspatial cyclic Lotka-Volterra model, also known as the zero-sum rock-paper-scissors game, used to metaphorically describe the cyclic competition between three species. In large and finite populations, demographic fluctuations (internal noise) drive two species to extinction in a finite time, while the species with the smallest reproduction-predation rate is the most likely to be the surviving one (law of the weakest). Here we model environmental (external) noise by assuming that the reproduction-predation rate of the strongest species (the fastest to reproduce and predate) in a given static environment randomly switches between two values corresponding to more and less favorable external conditions. We study the joint effect of environmental and demographic noise on the species survival probabilities and on the mean extinction time. In particular, we investigate whether the survival probabilities follow the law of the weakest and analyze their dependence on the external noise intensity and switching rate. Remarkably, when, on average, there is a finite number of switches prior to extinction, the survival probability of the predator of the species whose reaction rate switches typically varies nonmonotonically with the external noise intensity (with optimal survival about a critical noise strength). We also outline the relationship with the case where all reaction rates switch on markedly different time scales.

Stochastic Effects in Autoimmune Dynamics

Among various possible causes of autoimmune disease, an important role is played by infections that can result in a breakdown of immune tolerance, primarily through the mechanism of “molecular mimicry”. In this paper we propose and analyse a stochastic model of immune response to a viral infection and subsequent autoimmunity, with account for the populations of T cells with different activation thresholds, regulatory T cells, and cytokines. We show analytically and numerically how stochasticity can result in sustained oscillations around deterministically stable steady states, and we also investigate stochastic dynamics in the regime of bi-stability. These results provide a possible explanation for experimentally observed variations in the progression of autoimmune disease. Computations of the variance of stochastic fluctuations provide practically important insights into how the size of these fluctuations depends on various biological parameters, and this also gives a headway for comparison with experimental data on variation in the observed numbers of T cells and organ cells affected by infection.

A stochastic and dynamical view of pluripotency in mouse embryonic stem cells

Pluripotent embryonic stem cells are of paramount importance for biomedical sciences because of their innate ability for self-renewal and differentiation into all major cell lines. The fateful decision to exit or remain in the pluripotent state is regulated by complex genetic regulatory networks. The rapid growth of single-cell sequencing data has greatly stimulated applications of statistical and machine learning methods for inferring topologies of pluripotency regulating genetic networks. The inferred network topologies, however, often only encode Boolean information while remaining silent about the roles of dynamics and molecular stochasticity inherent in gene expression. Herein we develop a framework for systematically extending Boolean-level network topologies into higher resolution models of networks which explicitly account for the promoter architectures and gene state switching dynamics. We show the framework to be useful for disentangling the various contributions that gene switching, external signaling, and network topology make to the global heterogeneity and dynamics of transcription factor populations. We find the pluripotent state of the network to be a steady state which is robust to global variations of gene switching rates which we argue are a good proxy for epigenetic states of individual promoters. The temporal dynamics of exiting the pluripotent state, on the other hand, is significantly influenced by the rates of genetic switching which makes cells more responsive to changes in extracellular signals.

Inferring gene regulatory networks from single-cell data: a mechanistic approach

Background

The recent development of single-cell transcriptomics has enabled gene expression to be measured in individual cells instead of being population-averaged. Despite this considerable precision improvement, inferring regulatory networks remains challenging because stochasticity now proves to play a fundamental role in gene expression. In particular, mRNA synthesis is now acknowledged to occur in a highly bursty manner.

Results

We propose to view the inference problem as a fitting procedure for a mechanistic gene network model that is inherently stochastic and takes not only protein, but also mRNA levels into account. We first explain how to build and simulate this network model based upon the coupling of genes that are described as piecewise-deterministic Markov processes. Our model is modular and can be used to implement various biochemical hypotheses including causal interactions between genes. However, a naive fitting procedure would be intractable. By performing a relevant approximation of the stationary distribution, we derive a tractable procedure that corresponds to a statistical hidden Markov model with interpretable parameters. This approximation turns out to be extremely close to the theoretical distribution in the case of a simple toggle-switch, and we show that it can indeed fit real single-cell data. As a first step toward inference, our approach was applied to a number of simple two-gene networks simulated in silico from the mechanistic model and satisfactorily recovered the original networks.

Conclusions

Our results demonstrate that functional interactions between genes can be inferred from the distribution of a mechanistic, dynamical stochastic model that is able to describe gene expression in individual cells. This approach seems promising in relation to the current explosion of single-cell expression data.

Electronic supplementary material

The online version of this article (doi:10.1186/s12918-017-0487-0) contains supplementary material, which is available to authorized users.

Resonant activation of population extinctions

Understanding the mechanisms governing population extinctions is of key importance to many problems in ecology and evolution. Stochastic factors are known to play a central role in extinction, but the interactions between a population's demographic stochasticity and environmental noise remain poorly understood. Here we model environmental forcing as a stochastic fluctuation between two states, one with a higher death rate than the other. We find that, in general, there exists a rate of fluctuations that minimizes the mean time to extinction, a phenomenon previously dubbed "resonant activation." We develop a heuristic description of the phenomenon, together with a criterion for the existence of resonant activation. Specifically, the minimum extinction time arises as a result of the system approaching a scenario wherein the severity of rare events is balanced by the time interval between them. We discuss our findings within the context of more general forms of environmental noise and suggest potential applications to evolutionary models.

Evolution of a Fluctuating Population in a Randomly Switching Environment

Environment plays a fundamental role in the competition for resources, and hence in the evolution of populations. Here, we study a well-mixed, finite population consisting of two strains competing for the limited resources provided by an environment that randomly switches between states of abundance and scarcity. Assuming that one strain grows slightly faster than the other, we consider two scenarios-one of pure resource competition, and one in which one strain provides a public good-and investigate how environmental randomness (external noise) coupled to demographic (internal) noise determines the population's fixation properties and size distribution. By analytical means and simulations, we show that these coupled sources of noise can significantly enhance the fixation probability of the slower-growing species. We also show that the population size distribution can be unimodal, bimodal, or multimodal and undergoes noise-induced transitions between these regimes when the rate of switching matches the population's growth rate.

Impact of environmental colored noise in single-species population dynamics

Variability on external conditions has important consequences for the dynamics and the organization of biological systems. In many cases, the characteristic timescale of environmental changes as well as their correlations play a fundamental role in the way living systems adapt and respond to it. A proper mathematical approach to understand population dynamics, thus, requires approaches more refined than, e.g., simple white-noise approximations. To shed further light onto this problem, in this paper we propose a unifying framework based on different analytical and numerical tools available to deal with “colored” environmental noise. In particular, we employ a “unified colored noise approximation” to map the original problem into an effective one with white noise, and then we apply a standard path integral approach to gain analytical understanding. For the sake of specificity, we present our approach using as a guideline a variation of the contact process—which can also be seen as a birth-death process of the Malthus-Verhulst class—where the propagation or birth rate varies stochastically in time. Our approach allows us to tackle in a systematic manner some of the relevant questions concerning population dynamics under environmental variability, such as determining the stationary population density, establishing the conditions under which a population may become extinct, and estimating extinction times. We focus on the emerging phase diagram and its possible phase transitions, underlying how these are affected by the presence of environmental noise time-correlations.

Transitions in optimal adaptive strategies for populations in fluctuating environments

Biological populations are subject to fluctuating environmental conditions. Different adaptive strategies can allow them to cope with these fluctuations: specialization to one particular environmental condition, adoption of a generalist phenotype that compromises between conditions, or population-wise diversification (bet hedging). Which strategy provides the largest selective advantage in the long run depends on the range of accessible phenotypes and the statistics of the environmental fluctuations. Here, we analyze this problem in a simple mathematical model of population growth. First, we review and extend a graphical method to identify the nature of the optimal strategy when the environmental fluctuations are uncorrelated. Temporal correlations in environmental fluctuations open up new strategies that rely on memory but are mathematically challenging to study: We present analytical results to address this challenge. We illustrate our general approach by analyzing optimal adaptive strategies in the presence of trade-offs that constrain the range of accessible phenotypes. Our results extend several previous studies and have applications to a variety of biological phenomena, from antibiotic resistance in bacteria to immune responses in vertebrates.

Stochastic Liouville equation for particles driven by dichotomous environmental noise

We analyze the stochastic dynamics of a large population of noninteracting particles driven by a global environmental input in the form of a dichotomous Markov noise process (DMNP). The population density of particle states evolves according to a stochastic Liouville equation with respect to different realizations of the DMNP. We then exploit the connection with previous work on diffusion in randomly switching environments, in order to derive moment equations for the distribution of solutions to the stochastic Liouville equation. We illustrate the theory by considering two simple examples of dichotomous flows, a velocity jump process and a two-state gene regulatory network. In both cases we show how the global environmental input induces statistical correlations between different realizations of the population density.

Gene expression noise is affected differentially by feedback in burst frequency and burst size

Inside individual cells, expression of genes is stochastic across organisms ranging from bacterial to human cells. A ubiquitous feature of stochastic expression is burst-like synthesis of gene products, which drives considerable intercellular variability in protein levels across an isogenic cell population. One common mechanism by which cells control such stochasticity is negative feedback regulation, where a protein inhibits its own synthesis. For a single gene that is expressed in bursts, negative feedback can affect the burst frequency or the burst size. In order to compare these feedback types, we study a piecewise deterministic model for gene expression of a self-regulating gene. Mathematically tractable steady-state protein distributions are derived and used to compare the noise suppression abilities of the two feedbacks. Results show that in the low noise regime, both feedbacks are similar in term of their noise buffering abilities. Intriguingly, feedback in burst size outperforms the feedback in burst frequency in the high noise regime. Finally, we discuss various regulatory strategies by which cells implement feedback to control burst sizes of expressed proteins at the level of single cells.