Mesoscopic kinetic basis of macroscopic chemical thermodynamics: A mathematical theory

Nonequilibrium properties of autocatalytic networks

Autocatalysis, the ability of a chemical system to make more of itself, is a crucial feature in metabolism and is speculated to have played a decisive role in the origin of life. Nevertheless, how autocatalytic systems behave far from equilibrium remains unexplored. In this work, we elaborate on recent advances regarding the stoichiometric characterization of autocatalytic networks, particularly their absence of mass-like conservation laws, to study how this topological feature influences their nonequilibrium behavior. Building upon the peculiar topology of autocatalytic networks, we derive a decomposition of the chemical fluxes, which highlights the existence of productive modes in their dynamics. These modes produce the autocatalysts in net excess and require the presence of external fuel/waste species to operate. Relying solely on topology, the flux decomposition holds under broad conditions and, in particular, does not require steady state or elementary reactions. Additionally, we show that once externally controlled, the nonconservative forces brought by the external species do not act on these productive modes. This must be considered when one is interested in the thermodynamics of open autocatalytic networks. Specifically, we show that an additional term must be added to the semigrand free energy. Finally, from the thermodynamic potential, we derive the thermodynamic cost associated with the production of autocatalysts.

Energy Landscape Reveals the Underlying Mechanism of Cancer-Adipose Conversion in Gene Network Models

Cancer is a systemic heterogeneous disease involving complex molecular networks. Tumor formation involves an epithelial-mesenchymal transition (EMT), which promotes both metastasis and plasticity of cancer cells. Recent experiments have proposed that cancer cells can be transformed into adipocytes via a combination of drugs. However, the underlying mechanisms for how these drugs work, from a molecular network perspective, remain elusive. To reveal the mechanism of cancer-adipose conversion (CAC), this study adopts a systems biology approach by combing mathematical modeling and molecular experiments, based on underlying molecular regulatory networks. Four types of attractors are identified, corresponding to epithelial (E), mesenchymal (M), adipose (A) and partial/intermediate EMT (P) cell states on the CAC landscape. Landscape and transition path results illustrate that intermediate states play critical roles in the cancer to adipose transition. Through a landscape control approach, two new therapeutic strategies for drug combinations are identified, that promote CAC. These predictions are verified by molecular experiments in different cell lines. The combined computational and experimental approach provides a powerful tool to explore molecular mechanisms for cell fate transitions in cancer networks. The results reveal underlying mechanisms of intermediate cell states that govern the CAC, and identified new potential drug combinations to induce cancer adipogenesis.

Coupled chemical reactions: Effects of electric field, diffusion, and boundary control

Chemical reactions involve the movement of charges, and this paper presents a mathematical model for describing chemical reactions in electrolytes. The model is developed using an energy variational method that aligns with classical thermodynamics principles. It encompasses both electrostatics and chemical reactions within consistently defined energetic and dissipative functionals. Furthermore, the energy variation method is extended to account for open systems that involve the input and output of charge and mass. Such open systems have the capability to convert one form of input energy into another form of output energy. In particular, a two-domain model is developed to study a reaction system with self-regulation and internal switching, which plays a vital role in the electron transport chain of mitochondria responsible for ATP generation-a crucial process for sustaining life. Simulations are conducted to explore the influence of electric potential on reaction rates and switching dynamics within the two-domain system. It shows that the electric potential inhibits the oxidation reaction while accelerating the reduction reaction.

Trade-offs between number fluctuations and response in nonequilibrium chemical reaction networks

We study the response of chemical reaction networks driven far from equilibrium to logarithmic perturbations of reaction rates. The response of the mean number of a chemical species is observed to be quantitively limited by number fluctuations and the maximum thermodynamic driving force. We prove these trade-offs for linear chemical reaction networks and a class of nonlinear chemical reaction networks with a single chemical species. Numerical results for several model systems support the conclusion that these trade-offs continue to hold for a broad class of chemical reaction networks, though their precise form appears to sensitively depend on the deficiency of the network.

Structure and function in artificial, zebrafish and human neural networks

Network science provides a set of tools for the characterization of the structure and functional behavior of complex systems. Yet a major problem is to quantify how the structural domain is related to the dynamical one. In other words, how the diversity of dynamical states of a system can be predicted from the static network structure? Or the reverse problem: starting from a set of signals derived from experimental recordings, how can one discover the network connections or the causal relations behind the observed dynamics? Despite the advances achieved over the last two decades, many challenges remain concerning the study of the structure-dynamics interplay of complex systems. In neuroscience, progress is typically constrained by the low spatio-temporal resolution of experiments and by the lack of a universal inferring framework for empirical systems. To address these issues, applications of network science and artificial intelligence to neural data have been rapidly growing. In this article, we review important recent applications of methods from those fields to the study of the interplay between structure and functional dynamics of human and zebrafish brain. We cover the selection of topological features for the characterization of brain networks, inference of functional connections, dynamical modeling, and close with applications to both the human and zebrafish brain. This review is intended to neuroscientists who want to become acquainted with techniques from network science, as well as to researchers from the latter field who are interested in exploring novel application scenarios in neuroscience.

An improved approach for calculating energy landscape of gene networks from moment equations

The energy landscape theory has widely been applied to study the stochastic dynamics of biological systems. Different methods have been developed to quantify the energy landscape for gene networks, e.g., using Gaussian approximation (GA) approach to calculate the landscape by solving the diffusion equation approximately from the first two moments. However, how high-order moments influence the landscape construction remains to be elucidated. Also, multistability exists extensively in biological networks. So, how to quantify the landscape for a multistable dynamical system accurately, is a paramount problem. In this work, we prove that the weighted summation from GA (WSGA), provides an effective way to calculate the landscape for multistable systems and limit cycle systems. Meanwhile, we proposed an extended Gaussian approximation (EGA) approach by considering the effects of the third moments, which provides a more accurate way to obtain probability distribution and corresponding landscape. By applying our generalized EGA approach to two specific biological systems: multistable genetic circuit and synthetic oscillatory network, we compared EGA with WSGA by calculating the KL divergence of the probability distribution between these two approaches and simulations, which demonstrated that the EGA provides a more accurate approach to calculate the energy landscape.

Information-geometric structure for chemical thermodynamics: An explicit construction of dual affine coordinates

We construct an information-geometric structure for chemical thermodynamics, applicable to a wide range of chemical reaction systems including nonideal and open systems. For this purpose, we explicitly construct dual affine coordinate systems, which completely designate an information-geometric structure, using the extent of reactions and the affinities of reactions as coordinates on a linearly constrained space of amounts of substances. The resulting structure induces a metric and a divergence (a function of two distributions of amounts), both expressed with chemical potentials. These quantities have been partially known for ideal-dilute solutions, but their extensions for nonideal solutions and the complete underlying structure are novel. The constructed geometry is a generalization of dual affine coordinates for stochastic thermodynamics. For example, the metric and the divergence are generalizations of the Fisher information and the Kullback-Leibler divergence. As an application, we identify the chemical-thermodynamic analog of the Hatano-Sasa excess entropy production using our divergence.

Inferring structural and dynamical properties of gene networks from data with deep learning

The reconstruction of gene regulatory networks (GRNs) from data is vital in systems biology. Although different approaches have been proposed to infer causality from data, some challenges remain, such as how to accurately infer the direction and type of interactions, how to deal with complex network involving multiple feedbacks, as well as how to infer causality between variables from real-world data, especially single cell data. Here, we tackle these problems by deep neural networks (DNNs). The underlying regulatory network for different systems (gene regulations, ecology, diseases, development) can be successfully reconstructed from trained DNN models. We show that DNN is superior to existing approaches including Boolean network, Random Forest and partial cross mapping for network inference. Further, by interrogating the ensemble DNN model trained from single cell data from dynamical system perspective, we are able to unravel complex cell fate dynamics during preimplantation development. We also propose a data-driven approach to quantify the energy landscape for gene regulatory systems, by combining DNN with the partial self-consistent mean field approximation (PSCA) approach. We anticipate the proposed method can be applied to other fields to decipher the underlying dynamical mechanisms of systems from data.

Emergent second law for non-equilibrium steady states

The Gibbs distribution universally characterizes states of thermal equilibrium. In order to extend the Gibbs distribution to non-equilibrium steady states, one must relate the self-information \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{{{{{{\mathcal{I}}}}}}}}(x)=-\!\log ({P}_{{{{{{{{\rm{ss}}}}}}}}}(x))$$\end{document}I(x)=−log(Pss(x)) of microstate x to measurable physical quantities. This is a central problem in non-equilibrium statistical physics. By considering open systems described by stochastic dynamics which become deterministic in the macroscopic limit, we show that changes \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\Delta }}{{{{{{{\mathcal{I}}}}}}}}={{{{{{{\mathcal{I}}}}}}}}({x}_{t})-{{{{{{{\mathcal{I}}}}}}}}({x}_{0})$$\end{document}ΔI=I(xt)−I(x0) in steady state self-information along deterministic trajectories can be bounded by the macroscopic entropy production Σ. This bound takes the form of an emergent second law \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$${{\Sigma }}+{k}_{b}{{\Delta }}{{{{{{{\mathcal{I}}}}}}}}\,\ge \,0$$\end{document}Σ+kbΔI≥0, which contains the usual second law Σ ≥ 0 as a corollary, and is saturated in the linear regime close to equilibrium. We thus obtain a tighter version of the second law of thermodynamics that provides a link between the deterministic relaxation of a system and the non-equilibrium fluctuations at steady state. In addition to its fundamental value, our result leads to novel methods for computing non-equilibrium distributions, providing a deterministic alternative to Gillespie simulations or spectral methods.

Contrary to states of thermal equilibrium, there is no universal characterization of non-equilibrium steady states displaying constant flows of energy and/or matter. Here, the authors make progress in this direction by deriving an emergent and stricter version of the second law of thermodynamics.

Thermodynamics of concentration vs flux control in chemical reaction networks

We investigate the thermodynamic implications of two control mechanisms of open chemical reaction networks. The first controls the concentrations of the species that are exchanged with the surroundings, while the other controls the exchange fluxes. We show that the two mechanisms can be mapped one into the other and that the thermodynamic theories usually developed in the framework of concentration control can be applied to flux control as well. This implies that the thermodynamic potential and the fundamental forces driving chemical reaction networks out of equilibrium can be identified in the same way for both mechanisms. By analyzing the dynamics and thermodynamics of a simple enzymatic model, we also show that while the two mechanisms are equivalent at steady state, the flux control may lead to fundamentally different regimes where systems achieve stationary growth.

Unraveling the stochastic transition mechanism between oscillation states by landscape and minimum action path theory

Cell fate transitions have been studied from various perspectives, such as the transition between stable states, or the transition between stable states and oscillation states. However, there is a lack...

Small-sample limit of the Bennett acceptance ratio method and the variationally derived intermediates

Free energy calculations based on atomistic Hamiltonians provide microscopic insight into the thermodynamic driving forces of biophysical or condensed matter systems. Many approaches use intermediate Hamiltonians interpolating between the two states for which the free energy difference is calculated. The Bennett acceptance ratio (BAR) and variationally derived intermediates (VI) methods are optimal estimator and intermediate states in that the mean-squared error of free energy calculations based on independent sampling is minimized. However, BAR and VI have been derived based on several approximations that do not hold for very few sample points. Analyzing one-dimensional test systems, we show that in such cases BAR and VI are suboptimal and that established uncertainty estimates are inaccurate. Whereas for VI to become optimal, less than seven samples per state suffice in all cases; for BAR the required number increases unboundedly with decreasing configuration space densities overlap of the end states. We show that for BAR, the required number of samples is related to the overlap through an inverse power law. Because this relation seems to hold universally and almost independent of other system properties, these findings can guide the proper choice of estimators for free energy calculations.

Stochastic dynamics, large deviation principle, and nonequilibrium thermodynamics

By examining the deterministic limit of a general ε-dependent generator for Markovian dynamics, which includes the continuous Fokker-Planck equations and discrete chemical master equations as two special cases, the intrinsic connections among mesoscopic stochastic dynamics, deterministic ordinary differential equations or partial differential equations, large deviation rate functions, and macroscopic thermodynamic potentials are established. Our result not only solves the long-lasting question of the origin of the entropy function in classical irreversible thermodynamics, but also reveals an emergent feature that arises automatically during the deterministic limit, through its large deviation rate function, with both time-reversible dynamics equipped with a Hamiltonian function and time-irreversible dynamics equipped with an entropy function.

Recent Advances in Conservation-Dissipation Formalism for Irreversible Processes

The main purpose of this review is to summarize the recent advances of the Conservation–Dissipation Formalism (CDF), a new way for constructing both thermodynamically compatible and mathematically stable and well-posed models for irreversible processes. The contents include but are not restricted to the CDF’s physical motivations, mathematical foundations, formulations of several classical models in mathematical physics from master equations and Fokker–Planck equations to Boltzmann equations and quasi-linear Maxwell equations, as well as novel applications in the fields of non-Fourier heat conduction, non-Newtonian viscoelastic fluids, wave propagation/transportation in geophysics and neural science, soft matter physics, etc. Connections with other popular theories in the field of non-equilibrium thermodynamics are examined too.

Quantifying the Landscape of Decision Making From Spiking Neural Networks

The decision making function is governed by the complex coupled neural circuit in the brain. The underlying energy landscape provides a global picture for the dynamics of the neural decision making system and has been described extensively in the literature, but often as illustrations. In this work, we explicitly quantified the landscape for perceptual decision making based on biophysically-realistic cortical network with spiking neurons to mimic a two-alternative visual motion discrimination task. Under certain parameter regions, the underlying landscape displays bistable or tristable attractor states, which quantify the transition dynamics between different decision states. We identified two intermediate states: the spontaneous state which increases the plasticity and robustness of changes of minds and the "double-up" state which facilitates the state transitions. The irreversibility of the bistable and tristable switches due to the probabilistic curl flux demonstrates the inherent non-equilibrium characteristics of the neural decision system. The results of global stability of decision-making quantified by barrier height inferred from landscape topography and mean first passage time are in line with experimental observations. These results advance our understanding of the stochastic and dynamical transition mechanism of decision-making function, and the landscape and kinetic path approach can be applied to other cognitive function related problems (such as working memory) in brain networks.

Landscape and kinetic path quantify critical transitions in epithelial-mesenchymal transition

Epithelial-mesenchymal transition (EMT), a basic developmental process that might promote cancer metastasis, has been studied from various perspectives. Recently, the early warning theory has been used to anticipate critical transitions in EMT from mathematical modeling. However, the underlying mechanisms of EMT involving complex molecular networks remain to be clarified. Especially, how to quantify the global stability and stochastic transition dynamics of EMT and what the underlying mechanism for early warning theory in EMT is remain to be fully clarified. To address these issues, we constructed a comprehensive gene regulatory network model for EMT and quantified the corresponding potential landscape. The landscape for EMT displays multiple stable attractors, which correspond to E, M, and some other intermediate states. Based on the path-integral approach, we identified the most probable transition paths of EMT, which are supported by experimental data. Correspondingly, the results of transition actions demonstrated that intermediate states can accelerate EMT, consistent with recent studies. By integrating the landscape and path with early warning concept, we identified the potential barrier height from the landscape as a global and more accurate measure for early warning signals to predict critical transitions in EMT. The landscape results also provide an intuitive and quantitative explanation for the early warning theory. Overall, the landscape and path results advance our mechanistic understanding of dynamical transitions and roles of intermediate states in EMT, and the potential barrier height provides a new, to our knowledge, measure for critical transitions and quantitative explanations for the early warning theory.

Thermodynamic Uncertainty Relation and Thermodynamic Speed Limit in Deterministic Chemical Reaction Networks

We generalize the thermodynamic uncertainty relation (TUR) and thermodynamic speed limit (TSL) for deterministic chemical reaction networks (CRNs). The scaled diffusion coefficient derived by considering the connection between macro- and mesoscopic CRNs plays an essential role in our results. The TUR shows that the product of the entropy production rate and the ratio of the scaled diffusion coefficient to the square of the rate of concentration change is bounded below by two. The TSL states a trade-off relation between speed and thermodynamic quantities, the entropy production, and the time-averaged scaled diffusion coefficient. The results are proved under the general setting of open and nonideal CRNs.

Landscape and flux quantify the stochastic transition dynamics for p53 cell fate decision

The p53 transcription factor is a key mediator in cellular responses to various stress signals including DNA repair, cell cycle arrest, and apoptosis. In this work, we employ landscape and flux theory to investigate underlying mechanisms of p53-regulated cell fate decisions. Based on a p53 regulatory network, we quantified the potential landscape and probabilistic flux for the p53 system. The landscape topography unifies and quantifies three cell fate states, including the limit cycle oscillations (representing cell cycle arrest), high p53 state (characterizing apoptosis), and low p53 state (characterizing the normal proliferative state). Landscape and flux results provide a quantitative explanation for the biphasic dynamics of the p53 system. In the oscillatory phase (first phase), the landscape attracts the system into the ring valley and flux drives the system cyclically moving, leading to cell cycle arrest. In the fate decision-making phase (second phase), the ring valley shape of the landscape provides an efficient way for cells to return to the normal proliferative state once DNA damage is repaired. If the damage is unrepairable with larger flux, the system may cross the barrier between two states and switch to the apoptotic state with a high p53 level. By landscape-flux decomposition, we revealed a trade-off between stability (guaranteed by landscape) and function (driven by flux) in cellular systems. Cells need to keep a balance between appropriate speed to repair DNA damage and appropriate stability to survive. This is further supported by flux landscape analysis showing that flux may provide the dynamical origin of phase transition in a non-equilibrium system by changing landscape topography.

A Dimension Reduction Approach for Energy Landscape: Identifying Intermediate States in Metabolism-EMT Network

Dimension reduction is a challenging problem in complex dynamical systems. Here, a dimension reduction approach of landscape (DRL) for complex dynamical systems is proposed, by mapping a high-dimensional system on a low-dimensional energy landscape. The DRL approach is applied to three biological networks, which validates that new reduced dimensions preserve the major information of stability and transition of original high-dimensional systems. The consistency of barrier heights calculated from the low-dimensional landscape and transition actions calculated from the high-dimensional system further shows that the landscape after dimension reduction can quantify the global stability of the system. The epithelial-mesenchymal transition (EMT) and abnormal metabolism are two hallmarks of cancer. With the DRL approach, a quadrastable landscape for metabolism-EMT network is identified, including epithelial (E), abnormal metabolic (A), hybrid E/M (H), and mesenchymal (M) cell states. The quantified energy landscape and kinetic transition paths suggest that for the EMT process, the cells at E state need to first change their metabolism, then enter the M state. The work proposes a general framework for the dimension reduction of a stochastic dynamical system, and advances the mechanistic understanding of the underlying relationship between EMT and cellular metabolism.

Field theory of reaction-diffusion: Law of mass action with an energetic variational approach

We extend the energetic variational approach so it can be applied to a chemical reaction system with general mass action kinetics. Our approach starts with an energy-dissipation law. We show that the chemical equilibrium is determined by the choice of the free energy and the dynamics of the chemical reaction is determined by the choice of the dissipation. This approach enables us to couple chemical reactions with other effects, such as diffusion and drift in an electric field. As an illustration, we apply our approach to a nonequilibrium reaction-diffusion system in a specific but canonical setup. We show by numerical simulations that the input-output relation of such a system depends on the choice of the dissipation.

Variationally derived intermediates for correlated free-energy estimates between intermediate states

Free-energy difference calculations based on atomistic simulations generally improve in accuracy when sampling from a sequence of intermediate equilibrium thermodynamic states that bridge the configuration space between two states of interest. For reasons of efficiency, usually the same samples are used to calculate the stepwise difference of such an intermediate to both adjacent intermediates. However, this procedure violates the assumption of uncorrelated estimates that is necessary to derive both the optimal sequence of intermediate states and the widely used Bennett acceptance ratio estimator. In this work, via a variational approach, we derive the sequence of intermediate states and the corresponding estimator with minimal mean-squared error that account for these correlations and assess its accuracy.

Stochastic approach to entropy production in chemical chaos

Methods are presented to evaluate the entropy production rate in stochastic reactive systems. These methods are shown to be consistent with known results from nonequilibrium chemical thermodynamics. Moreover, it is proved that the time average of the entropy production rate can be decomposed into the contributions of the cycles obtained from the stoichiometric matrix in both stochastic processes and deterministic systems. These methods are applied to a complex reaction network constructed on the basis of Rössler's reinjection principle and featuring chemical chaos.

Intrinsic and Extrinsic Thermodynamics for Stochastic Population Processes with Multi-Level Large-Deviation Structure

A set of core features is set forth as the essence of a thermodynamic description, which derive from large-deviation properties in systems with hierarchies of timescales, but which are not dependent upon conservation laws or microscopic reversibility in the substrate hosting the process. The most fundamental elements are the concept of a macrostate in relation to the large-deviation entropy, and the decomposition of contributions to irreversibility among interacting subsystems, which is the origin of the dependence on a concept of heat in both classical and stochastic thermodynamics. A natural decomposition that is known to exist, into a relative entropy and a housekeeping entropy rate, is taken here to define respectively the intensive thermodynamics of a system and an extensive thermodynamic vector embedding the system in its context. Both intensive and extensive components are functions of Hartley information of the momentary system stationary state, which is information about the joint effect of system processes on its contribution to irreversibility. Results are derived for stochastic chemical reaction networks, including a Legendre duality for the housekeeping entropy rate to thermodynamically characterize fully-irreversible processes on an equal footing with those at the opposite limit of detailed-balance. The work is meant to encourage development of inherent thermodynamic descriptions for rule-based systems and the living state, which are not conceived as reductive explanations to heat flows.

Quantifying the Landscape and Transition Paths for Proliferation-Quiescence Fate Decisions

The cell cycle, essential for biological functions, experiences delicate spatiotemporal regulation. The transition between G1 and S phase, which is called the proliferation–quiescence decision, is critical to the cell cycle. However, the stability and underlying stochastic dynamical mechanisms of the proliferation–quiescence decision have not been fully understood. To quantify the process of the proliferation–quiescence decision, we constructed its underlying landscape based on the relevant gene regulatory network. We identified three attractors on the landscape corresponding to the G0, G1, and S phases, individually, which are supported by single-cell data. By calculating the transition path, which quantifies the potential barrier, we built expression profiles in temporal order for key regulators in different transitions. We propose that the two saddle points on the landscape characterize restriction point (RP) and G1/S checkpoint, respectively, which provides quantitative and physical explanations for the mechanisms of Rb governing the RP while p21 controlling the G1/S checkpoint. We found that Emi1 inhibits the transition from G0 to G1, while Emi1 in a suitable range facilitates the transition from G1 to S. These results are partially consistent with previous studies, which also suggested new roles of Emi1 in the cell cycle. By global sensitivity analysis, we identified some critical regulatory factors influencing the proliferation–quiescence decision. Our work provides a global view of the stochasticity and dynamics in the proliferation–quiescence decision of the cell cycle.

Counting single cells and computing their heterogeneity: from phenotypic frequencies to mean value of a quantitative biomarker

This tutorial presents a mathematical theory that relates the probability of sample frequencies, of M phenotypes in an isogenic population of N cells, to the probability distribution of the sample mean of a quantitative biomarker, when the N is very large. An analogue to the statistical mechanics of canonical ensemble is discussed.

Landscape inferred from gene expression data governs pluripotency in embryonic stem cells

Embryonic stem cells (ESCs) can differentiate into diverse cell types and have the ability of self-renewal. Therefore, the study of cell fate decisions on embryonic stem cells has far-reaching significance for regenerative medicine and other biomedical fields. Mathematical models have been used to study emryonic stem cell differentiation. However, the underlying mechanisms of cell differentiation and lineage reprogramming remain to be elucidated. Especially, how to integrate the computational models with quantitative experimental data is still challenging. In this work, we developed a data-constrained modelling approach, and established a model of mouse embryonic stem cells. We used the truncated moment equations (TME) method to quantify the potential landscape of the ESC network. We identified two attractors on the landscape, which represent the embryonic stem cell (ESC) state and differentiated cell (DC) state, respectively, and quantified high dimensional biological paths for differentiation and reprogramming process. Through identifying the optimal combinations of gene targets based on a landscape control strategy, we offered some predictions about the key regulatory factors that govern the differentiation and reprogramming in ESCs.

Thermodynamics of Markov processes with nonextensive entropy and free energy

Statistical thermodynamics of small systems shows dramatic differences from normal systems. Parallel to the recently presented steady-state thermodynamic formalism for master equation and Fokker-Planck equation, we show that a "thermodynamic" theory can also be developed based on Tsallis' generalized entropy S^{(q)}=∑_{i=1}^{N}(p_{i}-p_{i}^{q})/[q(q-1)] and Shiino's generalized free energy F^{(q)}=[∑_{i=1}^{N}p_{i}(p_{i}/π_{i})^{q-1}-1]/[q(q-1)], where π_{i} is the stationary distribution. dF^{(q)}/dt=-f_{d}^{(q)}≤0 and it is zero if and only if the system is in its stationary state. dS^{(q)}/dt-Q_{ex}^{(q)}=f_{d}^{(q)}, where Q_{ex}^{(q)} characterizes the heat exchange. For systems approaching equilibrium with detailed balance, f_{d}^{(q)} is the product of Onsager's thermodynamic flux and force. However, it is discovered that the Onsager's force is nonlocal. This is a consequence of the particular transformation invariance for zero energy of Tsallis' statistics.

Landscape and flux govern cellular mode-hopping between oscillations

Recently, a "mode-hopping" phenomenon has been observed in a NF-κB gene regulatory network with oscillatory tumor necrosis factor (TNF) inputs. It was suggested that noise facilitates the switch between different oscillation modes. However, the underlying mechanism of this noise-induced "cellular mode-hopping" behavior remains elusive. We employed a landscape and flux approach to study the stochastic dynamics and global stability of the NF-κB regulatory system. We used a truncated moment equation approach to calculate the probability distribution and potential landscape for gene regulatory systems. The potential landscape of the NF-κB system exhibits a "double ring valley" shape. Barrier heights from landscape topography provide quantitative measures of the global stability and transition feasibility of the double oscillation system. We found that the landscape and flux jointly govern the dynamical "mode-hopping" behavior of the NF-κB regulatory system. The landscape attracts the system into a "double ring valley," and the flux drives the system to move cyclically. As the external noise increases, relevant barrier heights decrease, and the flux increases. As the amplitude of the TNF input increases, the flux contribution, from the total driving force, increases and the system behavior changes from one to two cycles and ultimately to chaotic dynamics. Therefore, the probabilistic flux may provide an origin of chaotic behavior. We found that the height of the peak of the power spectrum of autocorrelation functions and phase coherence is correlated with barrier heights of the landscape and provides quantitative measures of global stability of the system under intrinsic fluctuations.

Exposing the Underlying Relationship of Cancer Metastasis to Metabolism and Epithelial-Mesenchymal Transitions

Cancer is a disease governed by the underlying gene regulatory networks. The hallmarks of cancer have been proposed to characterize the cancerization, e.g., abnormal metabolism, epithelial to mesenchymal transition (EMT), and cancer metastasis. We constructed a metabolism-EMT-metastasis regulatory network and quantified its underlying landscape. We identified four attractors, characterizing epithelial, abnormal metabolic, mesenchymal, and metastatic cell states, respectively. Importantly, we identified an abnormal metabolic state. Based on the transition path theory, we quantified the kinetic transition paths among these different cell states. Our results for landscape and paths indicate that metastasis is a sequential process: cells tend to first change their metabolism, then activate the EMT and eventually reach the metastatic state. This demonstrates the importance of the temporal order for different gene circuits switching on or off during metastatic progression of cancer cells and underlines the cascading regulation of metastasis through an abnormal metabolic intermediate state.

A landscape view on the interplay between EMT and cancer metastasis

The epithelial-mesenchymal transition (EMT) is a basic developmental process that converts epithelial cells to mesenchymal cells. Although EMT might promote cancer metastasis, the molecular mechanisms for it remain to be fully clarified. To address this issue, we constructed an EMT-metastasis gene regulatory network model and quantified the potential landscape of cancer metastasis-promoting system computationally. We identified four steady-state attractors on the landscape, which separately characterize anti-metastatic (A), metastatic (M), and two other intermediate (I1 and I2) cell states. The tetrastable landscape and the existence of intermediate states are consistent with recent single-cell measurements. We identified one of the two intermediate states I1 as the EMT state. From a MAP approach, we found that for metastatic progression cells need to first undergo EMT (enter the I1 state), and then become metastatic (switch from the I1 state to the M state). Specifically, for metastatic progression, EMT genes (such as ZEB) should be activated before metastasis genes (such as BACH1). This suggests that temporal order is important for the activation of cellular programs in biological systems, and provides a possible mechanism of EMT-promoting cancer metastasis. To identify possible therapeutic targets from this landscape view, we performed sensitivity analysis for individual molecular factors, and identified optimal interventions for landscape control. We found that minimizing transition actions more effectively identifies optimal combinations of targets that induce transitions between attractors than single-factor sensitivity analysis. Overall, the landscape view not only suggests that intermediate states increase plasticity during cell fate decisions, providing a possible source for tumor heterogeneity that is critically important in metastatic progress, but also provides a way to identify therapeutic targets for preventing cancer progression.

Grand canonical diffusion-influenced reactions: A stochastic theory with applications to multiscale reaction-diffusion simulations

Smoluchowski-type models for diffusion-influenced reactions (A + B → C) can be formulated within two frameworks: the probabilistic-based approach for a pair A, B of reacting particles and the concentration-based approach for systems in contact with a bath that generates a concentration gradient of B particles that interact with A. Although these two approaches are mathematically similar, it is not straightforward to establish a precise mathematical relationship between them. Determining this relationship is essential to derive particle-based numerical methods that are quantitatively consistent with bulk concentration dynamics. In this work, we determine the relationship between the two approaches by introducing the grand canonical Smoluchowski master equation (GC-SME), which consists of a continuous-time Markov chain that models an arbitrary number of B particles, each one of them following Smoluchowski's probabilistic dynamics. We show that the GC-SME recovers the concentration-based approach by taking either the hydrodynamic or the large copy number limit. In addition, we show that the GC-SME provides a clear statistical mechanical interpretation of the concentration-based approach and yields an emergent chemical potential for nonequilibrium spatially inhomogeneous reaction processes. We further exploit the GC-SME robust framework to accurately derive multiscale/hybrid numerical methods that couple particle-based reaction-diffusion simulations with bulk concentration descriptions, as described in detail through two computational implementations.

Processes on the emergent landscapes of biochemical reaction networks and heterogeneous cell population dynamics: differentiation in living matters

The notion of an attractor has been widely employed in thinking about the nonlinear dynamics of organisms and biological phenomena as systems and as processes. The notion of a landscape with valleys and mountains encoding multiple attractors, however, has a rigorous foundation only for closed, thermodynamically non-driven, chemical systems, such as a protein. Recent advances in the theory of nonlinear stochastic dynamical systems and its applications to mesoscopic reaction networks, one reaction at a time, have provided a new basis for a landscape of open, driven biochemical reaction systems under sustained chemostat. The theory is equally applicable not only to intracellular dynamics of biochemical regulatory networks within an individual cell but also to tissue dynamics of heterogeneous interacting cell populations. The landscape for an individual cell, applicable to a population of isogenic non-interacting cells under the same environmental conditions, is defined on the counting space of intracellular chemical compositions x = (x₁,x₂, … ,x_N ) in a cell, where x_ℓ is the concentration of the ℓth biochemical species. Equivalently, for heterogeneous cell population dynamics x_ℓ is the number density of cells of the ℓth cell type. One of the insights derived from the landscape perspective is that the life history of an individual organism, which occurs on the hillsides of a landscape, is nearly deterministic and 'programmed', while population-wise an asynchronous non-equilibrium steady state resides mostly in the lowlands of the landscape. We argue that a dynamic 'blue-sky' bifurcation, as a representation of Waddington's landscape, is a more robust mechanism for a cell fate decision and subsequent differentiation than the widely pictured pitch-fork bifurcation. We revisit, in terms of the chemostatic driving forces upon active, living matter, the notions of near-equilibrium thermodynamic branches versus far-from-equilibrium states. The emergent landscape perspective permits a quantitative discussion of a wide range of biological phenomena as nonlinear, stochastic dynamics.