Nonequilibrium steady state of a stochastic system driven by a nonlinear drift force

Nested Selves: Self-Organization and Shared Markov Blankets in Prenatal Development in Humans

The immune system is a central component of organismic function in humans. This paper addresses self-organization of biological systems in relation to-and nested within-other biological systems in pregnancy. Pregnancy constitutes a fundamental state for human embodiment and a key step in the evolution and conservation of our species. While not all humans can be pregnant, our initial state of emerging and growing within another person's body is universal. Hence, the pregnant state does not concern some individuals but all individuals. Indeed, the hierarchical relationship in pregnancy reflects an even earlier autopoietic process in the embryo by which the number of individuals in a single blastoderm is dynamically determined by cell- interactions. The relationship and the interactions between the two self-organizing systems during pregnancy may play a pivotal role in understanding the nature of biological self-organization per se in humans. Specifically, we consider the role of the immune system in biological self-organization in addition to neural/brain systems that furnish us with a sense of self. We examine the complex case of pregnancy, whereby two immune systems need to negotiate the exchange of resources and information in order to maintain viable self-regulation of nested systems. We conclude with a proposal for the mechanisms-that scaffold the complex relationship between two self-organising systems in pregnancy-through the lens of the Active Inference, with a focus on shared Markov blankets.

A Variational Synthesis of Evolutionary and Developmental Dynamics

This paper introduces a variational formulation of natural selection, paying special attention to the nature of 'things' and the way that different 'kinds' of 'things' are individuated from-and influence-each other. We use the Bayesian mechanics of particular partitions to understand how slow phylogenetic processes constrain-and are constrained by-fast, phenotypic processes. The main result is a formulation of adaptive fitness as a path integral of phenotypic fitness. Paths of least action, at the phenotypic and phylogenetic scales, can then be read as inference and learning processes, respectively. In this view, a phenotype actively infers the state of its econiche under a generative model, whose parameters are learned via natural (Bayesian model) selection. The ensuing variational synthesis features some unexpected aspects. Perhaps the most notable is that it is not possible to describe or model a population of conspecifics per se. Rather, it is necessary to consider populations of distinct natural kinds that influence each other. This paper is limited to a description of the mathematical apparatus and accompanying ideas. Subsequent work will use these methods for simulations and numerical analyses-and identify points of contact with related mathematical formulations of evolution.

Fracton Hydrodynamics without Time-Reversal Symmetry

We present an effective field theory for the nonlinear fluctuating hydrodynamics of a single conserved charge with or without time-reversal symmetry, based on the Martin-Siggia-Rose formalism. Applying this formalism to fluids with only charge and multipole conservation, and with broken time-reversal symmetry, we predict infinitely many new dynamical universality classes, including some with arbitrarily large upper critical dimensions. Using large scale simulations of classical Markov chains, we find numerical evidence for a breakdown of hydrodynamics in quadrupole-conserving models with broken time-reversal symmetry in one spatial dimension. Our framework can be applied to the hydrodynamics around stationary states of open systems, broadening the applicability of previously developed ideas and methods to a wide range of systems in driven and active matter.

How particular is the physics of the free energy principle?

The free energy principle (FEP) states that any dynamical system can be interpreted as performing Bayesian inference upon its surrounding environment. Although, in theory, the FEP applies to a wide variety of systems, there has been almost no direct exploration or demonstration of the principle in concrete systems. In this work, we examine in depth the assumptions required to derive the FEP in the simplest possible set of systems - weakly-coupled non-equilibrium linear stochastic systems. Specifically, we explore (i) how general the requirements imposed on the statistical structure of a system are and (ii) how informative the FEP is about the behaviour of such systems. We discover that two requirements of the FEP - the Markov blanket condition (i.e. a statistical boundary precluding direct coupling between internal and external states) and stringent restrictions on its solenoidal flows (i.e. tendencies driving a system out of equilibrium) - are only valid for a very narrow space of parameters. Suitable systems require an absence of perception-action asymmetries that is highly unusual for living systems interacting with an environment. More importantly, we observe that a mathematically central step in the argument, connecting the behaviour of a system to variational inference, relies on an implicit equivalence between the dynamics of the average states of a system with the average of the dynamics of those states. This equivalence does not hold in general even for linear stochastic systems, since it requires an effective decoupling from the system's history of interactions. These observations are critical for evaluating the generality and applicability of the FEP and indicate the existence of significant problems of the theory in its current form. These issues make the FEP, as it stands, not straightforwardly applicable to the simple linear systems studied here and suggest that more development is needed before the theory could be applied to the kind of complex systems that describe living and cognitive processes.

Seascape origin of Richards growth

First proposed as an empirical rule over half a century ago, the Richards growth equation has been frequently invoked in population modeling and pandemic forecasting. Central to this model is the advent of a fractional exponent γ, typically fitted to the data. While various motivations for this nonanalytical form have been proposed, it is still considered foremost an empirical fitting procedure. Here, we find that Richards-like growth laws emerge naturally from generic analytical growth rules in a distributed population, upon inclusion of (i) migration (spatial diffusion) among different locales, and (ii) stochasticity in the growth rate, also known as "seascape noise." The latter leads to a wide (power law) distribution in local population number that, while smoothened through the former, can still result in a fractional growth law for the overall population. This justification of the Richards growth law thus provides a testable connection to the distribution of constituents of the population.

Fluctuation-dissipation-type theorem in stochastic linear learning

The fluctuation-dissipation theorem (FDT) is a simple yet powerful consequence of the first-order differential equation governing the dynamics of systems subject simultaneously to dissipative and stochastic forces. The linear learning dynamics, in which the input vector maps to the output vector by a linear matrix whose elements are the subject of learning, has a stochastic version closely mimicking the Langevin dynamics when a full-batch gradient descent scheme is replaced by that of a stochastic gradient descent. We derive a generalized FDT for the stochastic linear learning dynamics and verify its validity among the well-known machine learning data sets such as MNIST, CIFAR-10, and EMNIST.

Stochastic Chaos and Markov Blankets

In this treatment of random dynamical systems, we consider the existence-and identification-of conditional independencies at nonequilibrium steady-state. These independencies underwrite a particular partition of states, in which internal states are statistically secluded from external states by blanket states. The existence of such partitions has interesting implications for the information geometry of internal states. In brief, this geometry can be read as a physics of sentience, where internal states look as if they are inferring external states. However, the existence of such partitions-and the functional form of the underlying densities-have yet to be established. Here, using the Lorenz system as the basis of stochastic chaos, we leverage the Helmholtz decomposition-and polynomial expansions-to parameterise the steady-state density in terms of surprisal or self-information. We then show how Markov blankets can be identified-using the accompanying Hessian-to characterise the coupling between internal and external states in terms of a generalised synchrony or synchronisation of chaos. We conclude by suggesting that this kind of synchronisation may provide a mathematical basis for an elemental form of (autonomous or active) sentience in biology.

Rendering neuronal state equations compatible with the principle of stationary action

The principle of stationary action is a cornerstone of modern physics, providing a powerful framework for investigating dynamical systems found in classical mechanics through to quantum field theory. However, computational neuroscience, despite its heavy reliance on concepts in physics, is anomalous in this regard as its main equations of motion are not compatible with a Lagrangian formulation and hence with the principle of stationary action. Taking the Dynamic Causal Modelling (DCM) neuronal state equation as an instructive archetype of the first-order linear differential equations commonly found in computational neuroscience, we show that it is possible to make certain modifications to this equation to render it compatible with the principle of stationary action. Specifically, we show that a Lagrangian formulation of the DCM neuronal state equation is facilitated using a complex dependent variable, an oscillatory solution, and a Hermitian intrinsic connectivity matrix. We first demonstrate proof of principle by using Bayesian model inversion to show that both the original and modified models can be correctly identified via in silico data generated directly from their respective equations of motion. We then provide motivation for adopting the modified models in neuroscience by using three different types of publicly available in vivo neuroimaging datasets, together with open source MATLAB code, to show that the modified (oscillatory) model provides a more parsimonious explanation for some of these empirical timeseries. It is our hope that this work will, in combination with existing techniques, allow people to explore the symmetries and associated conservation laws within neural systems - and to exploit the computational expediency facilitated by direct variational techniques.

Autonomous Brownian gyrators: A study on gyrating characteristics

We study the nonequilibrium steady-state (NESS) dynamics of two-dimensional Brownian gyrators under harmonic and nonharmonic potentials via computer simulations and analyses based on the Fokker-Planck equation, while our nonharmonic cases feature a double-well potential and an isotropic quartic potential. In particular, we report two simple methods that can help understand gyrating patterns. For harmonic potentials, we use the Fokker-Planck equation to survey the NESS dynamical characteristics; i.e., the NESS currents gyrate along the equiprobability contours and the stationary point of flow coincides with the potential minimum. As a contrast, the NESS results in our nonharmonic potentials show that these properties are largely absent, as the gyrating patterns are very distinct from those of corresponding probability distributions. Furthermore, we observe a critical case of the double-well potential, where the harmonic contribution to the gyrating pattern becomes absent, and the NESS currents do not circulate about the equiprobability contours near the potential minima even at low temperatures.

A Technical Critique of Some Parts of the Free Energy Principle

We summarize the original formulation of the free energy principle and highlight some technical issues. We discuss how these issues affect related results involving generalised coordinates and, where appropriate, mention consequences for and reveal, up to now unacknowledged, differences from newer formulations of the free energy principle. In particular, we reveal that various definitions of the “Markov blanket” proposed in different works are not equivalent. We show that crucial steps in the free energy argument, which involve rewriting the equations of motion of systems with Markov blankets, are not generally correct without additional (previously unstated) assumptions. We prove by counterexamples that the original free energy lemma, when taken at face value, is wrong. We show further that this free energy lemma, when it does hold, implies the equality of variational density and ergodic conditional density. The interpretation in terms of Bayesian inference hinges on this point, and we hence conclude that it is not sufficiently justified. Additionally, we highlight that the variational densities presented in newer formulations of the free energy principle and lemma are parametrised by different variables than in older works, leading to a substantially different interpretation of the theory. Note that we only highlight some specific problems in the discussed publications. These problems do not rule out conclusively that the general ideas behind the free energy principle are worth pursuing.

Perturbative theory for Brownian vortexes

Brownian vortexes are stochastic machines that use static nonconservative force fields to bias random thermal fluctuations into steadily circulating currents. The archetype for this class of systems is a colloidal sphere in an optical tweezer. Trapped near the focus of a strongly converging beam of light, the particle is displaced by random thermal kicks into the nonconservative part of the optical force field arising from radiation pressure, which then biases its diffusion. Assuming the particle remains localized within the trap, its time-averaged trajectory traces out a toroidal vortex. Unlike trivial Brownian vortexes, such as the biased Brownian pendulum, which circulate preferentially in the direction of the bias, the general Brownian vortex can change direction and even topology in response to temperature changes. Here we introduce a theory based on a perturbative expansion of the Fokker-Planck equation for weak nonconservative driving. The first-order solution takes the form of a modified Boltzmann relation and accounts for the rich phenomenology observed in experiments on micrometer-scale colloidal spheres in optical tweezers.