Exploratory adaptation in large random networks

Darwin's agential materials: evolutionary implications of multiscale competency in developmental biology

A critical aspect of evolution is the layer of developmental physiology that operates between the genotype and the anatomical phenotype. While much work has addressed the evolution of developmental mechanisms and the evolvability of specific genetic architectures with emergent complexity, one aspect has not been sufficiently explored: the implications of morphogenetic problem-solving competencies for the evolutionary process itself. The cells that evolution works with are not passive components: rather, they have numerous capabilities for behavior because they derive from ancestral unicellular organisms with rich repertoires. In multicellular organisms, these capabilities must be tamed, and can be exploited, by the evolutionary process. Specifically, biological structures have a multiscale competency architecture where cells, tissues, and organs exhibit regulative plasticity-the ability to adjust to perturbations such as external injury or internal modifications and still accomplish specific adaptive tasks across metabolic, transcriptional, physiological, and anatomical problem spaces. Here, I review examples illustrating how physiological circuits guiding cellular collective behavior impart computational properties to the agential material that serves as substrate for the evolutionary process. I then explore the ways in which the collective intelligence of cells during morphogenesis affect evolution, providing a new perspective on the evolutionary search process. This key feature of the physiological software of life helps explain the remarkable speed and robustness of biological evolution, and sheds new light on the relationship between genomes and functional anatomical phenotypes.

Mathematical models of learning and what can be learned from them

Learning is a multi-faceted phenomenon of critical importance and hence attracted a great deal of research, both experimental and theoretical. In this review, we will consider some of the paradigmatic examples of learning and discuss the common themes in theoretical learning research, such as levels of modeling and their corresponding relation to experimental observations and mathematical ideas common to different types of learning.

There’s Plenty of Room Right Here: Biological Systems as Evolved, Overloaded, Multi-Scale Machines

The applicability of computational models to the biological world is an active topic of debate. We argue that a useful path forward results from abandoning hard boundaries between categories and adopting an observer-dependent, pragmatic view. Such a view dissolves the contingent dichotomies driven by human cognitive biases (e.g., a tendency to oversimplify) and prior technological limitations in favor of a more continuous view, necessitated by the study of evolution, developmental biology, and intelligent machines. Form and function are tightly entwined in nature, and in some cases, in robotics as well. Thus, efforts to re-shape living systems for biomedical or bioengineering purposes require prediction and control of their function at multiple scales. This is challenging for many reasons, one of which is that living systems perform multiple functions in the same place at the same time. We refer to this as “polycomputing”—the ability of the same substrate to simultaneously compute different things, and make those computational results available to different observers. This ability is an important way in which living things are a kind of computer, but not the familiar, linear, deterministic kind; rather, living things are computers in the broad sense of their computational materials, as reported in the rapidly growing physical computing literature. We argue that an observer-centered framework for the computations performed by evolved and designed systems will improve the understanding of mesoscale events, as it has already done at quantum and relativistic scales. To develop our understanding of how life performs polycomputing, and how it can be convinced to alter one or more of those functions, we can first create technologies that polycompute and learn how to alter their functions. Here, we review examples of biological and technological polycomputing, and develop the idea that the overloading of different functions on the same hardware is an important design principle that helps to understand and build both evolved and designed systems. Learning to hack existing polycomputing substrates, as well as to evolve and design new ones, will have massive impacts on regenerative medicine, robotics, and computer engineering.

Effective bet-hedging through growth rate dependent stability

Microbes in the wild face highly variable and unpredictable environments and are naturally selected for their average growth rate across environments. Apart from using sensory regulatory systems to adapt in a targeted manner to changing environments, microbes employ bet-hedging strategies where cells in an isogenic population switch stochastically between alternative phenotypes. Yet, bet-hedging suffers from a fundamental trade-off: Increasing the phenotype-switching rate increases the rate at which maladapted cells explore alternative phenotypes but also increases the rate at which cells switch out of a well-adapted state. Consequently, it is currently believed that bet-hedging strategies are effective only when the number of possible phenotypes is limited and when environments last for sufficiently many generations. However, recent experimental results show that gene expression noise generally decreases with growth rate, suggesting that phenotype-switching rates may systematically decrease with growth rate. Such growth rate dependent stability (GRDS) causes cells to be more explorative when maladapted and more phenotypically stable when well-adapted, and we show that GRDS can almost completely overcome the trade-off that limits bet-hedging, allowing for effective adaptation even when environments are diverse and change rapidly. We further show that even a small decrease in switching rates of faster-growing phenotypes can substantially increase long-term fitness of bet-hedging strategies. Together, our results suggest that stochastic strategies may play an even bigger role for microbial adaptation than hitherto appreciated.

Endless forms most beautiful 2.0: teleonomy and the bioengineering of chimaeric and synthetic organisms

The rich variety of biological forms and behaviours results from one evolutionary history on Earth, via frozen accidents and selection in specific environments. This ubiquitous baggage in natural, familiar model species obscures the plasticity and swarm intelligence of cellular collectives. Significant gaps exist in our understanding of the origin of anatomical novelty, of the relationship between genome and form, and of strategies for control of large-scale structure and function in regenerative medicine and bioengineering. Analysis of living forms that have never existed before is necessary to reveal deep design principles of life as it can be. We briefly review existing examples of chimaeras, cyborgs, hybrots and other beings along the spectrum containing evolved and designed systems. To drive experimental progress in multicellular synthetic morphology, we propose teleonomic (goal-seeking, problem-solving) behaviour in diverse problem spaces as a powerful invariant across possible beings regardless of composition or origin. Cybernetic perspectives on chimaeric morphogenesis erase artificial distinctions established by past limitations of technology and imagination. We suggest that a multi-scale competency architecture facilitates evolution of robust problem-solving, living machines. Creation and analysis of novel living forms will be an essential testbed for the emerging field of diverse intelligence, with numerous implications across regenerative medicine, robotics and ethics.

Competency in Navigating Arbitrary Spaces as an Invariant for Analyzing Cognition in Diverse Embodiments

One of the most salient features of life is its capacity to handle novelty and namely to thrive and adapt to new circumstances and changes in both the environment and internal components. An understanding of this capacity is central to several fields: the evolution of form and function, the design of effective strategies for biomedicine, and the creation of novel life forms via chimeric and bioengineering technologies. Here, we review instructive examples of living organisms solving diverse problems and propose competent navigation in arbitrary spaces as an invariant for thinking about the scaling of cognition during evolution. We argue that our innate capacity to recognize agency and intelligence in unfamiliar guises lags far behind our ability to detect it in familiar behavioral contexts. The multi-scale competency of life is essential to adaptive function, potentiating evolution and providing strategies for top-down control (not micromanagement) to address complex disease and injury. We propose an observer-focused viewpoint that is agnostic about scale and implementation, illustrating how evolution pivoted similar strategies to explore and exploit metabolic, transcriptional, morphological, and finally 3D motion spaces. By generalizing the concept of behavior, we gain novel perspectives on evolution, strategies for system-level biomedical interventions, and the construction of bioengineered intelligences. This framework is a first step toward relating to intelligence in highly unfamiliar embodiments, which will be essential for progress in artificial intelligence and regenerative medicine and for thriving in a world increasingly populated by synthetic, bio-robotic, and hybrid beings.

Technological Approach to Mind Everywhere: An Experimentally-Grounded Framework for Understanding Diverse Bodies and Minds

Synthetic biology and bioengineering provide the opportunity to create novel embodied cognitive systems (otherwise known as minds) in a very wide variety of chimeric architectures combining evolved and designed material and software. These advances are disrupting familiar concepts in the philosophy of mind, and require new ways of thinking about and comparing truly diverse intelligences, whose composition and origin are not like any of the available natural model species. In this Perspective, I introduce TAME-Technological Approach to Mind Everywhere-a framework for understanding and manipulating cognition in unconventional substrates. TAME formalizes a non-binary (continuous), empirically-based approach to strongly embodied agency. TAME provides a natural way to think about animal sentience as an instance of collective intelligence of cell groups, arising from dynamics that manifest in similar ways in numerous other substrates. When applied to regenerating/developmental systems, TAME suggests a perspective on morphogenesis as an example of basal cognition. The deep symmetry between problem-solving in anatomical, physiological, transcriptional, and 3D (traditional behavioral) spaces drives specific hypotheses by which cognitive capacities can increase during evolution. An important medium exploited by evolution for joining active subunits into greater agents is developmental bioelectricity, implemented by pre-neural use of ion channels and gap junctions to scale up cell-level feedback loops into anatomical homeostasis. This architecture of multi-scale competency of biological systems has important implications for plasticity of bodies and minds, greatly potentiating evolvability. Considering classical and recent data from the perspectives of computational science, evolutionary biology, and basal cognition, reveals a rich research program with many implications for cognitive science, evolutionary biology, regenerative medicine, and artificial intelligence.

Cancer progression as a learning process

Drug resistance and metastasis—the major complications in cancer—both entail adaptation of cancer cells to stress, whether a drug or a lethal new environment. Intriguingly, these adaptive processes share similar features that cannot be explained by a pure Darwinian scheme, including dormancy, increased heterogeneity, and stress-induced plasticity. Here, we propose that learning theory offers a framework to explain these features and may shed light on these two intricate processes. In this framework, learning is performed at the single-cell level, by stress-driven exploratory trial-and-error. Such a process is not contingent on pre-existing pathways but on a random search for a state that diminishes the stress. We review underlying mechanisms that may support this search, and show by using a learning model that such exploratory learning is feasible in a high-dimensional system as the cell. At the population level, we view the tissue as a network of exploring agents that communicate, restraining cancer formation in health. In this view, disease results from the breakdown of homeostasis between cellular exploratory drive and tissue homeostasis.

Gene regulatory networks exhibit several kinds of memory: quantification of memory in biological and random transcriptional networks

Gene regulatory networks (GRNs) process important information in developmental biology and biomedicine. A key knowledge gap concerns how their responses change over time. Hypothesizing long-term changes of dynamics induced by transient prior events, we created a computational framework for defining and identifying diverse types of memory in candidate GRNs. We show that GRNs from a wide range of model systems are predicted to possess several types of memory, including Pavlovian conditioning. Associative memory offers an alternative strategy for the biomedical use of powerful drugs with undesirable side effects, and a novel approach to understanding the variability and time-dependent changes of drug action. We find evidence of natural selection favoring GRN memory. Vertebrate GRNs overall exhibit more memory than invertebrate GRNs, and memory is most prevalent in differentiated metazoan cell networks compared with undifferentiated cells. Timed stimuli are a powerful alternative for biomedical control of complex in vivo dynamics without genomic editing or transgenes.

•

Gene regulatory networks' dynamics are modified by transient stimuli

•

GRNs have several different types of memory, including associative conditioning

•

Evolution favored GRN memory, and differentiated cells have the most memory capacity

•

Training GRNs offers a novel biomedical strategy not dependent on genetic rewiring

Exploring the effect of network topology, mRNA and protein dynamics on gene regulatory network stability

Homeostasis of protein concentrations in cells is crucial for their proper functioning, requiring steady-state concentrations to be stable to fluctuations. Since gene expression is regulated by proteins such as transcription factors (TFs), the full set of proteins within the cell constitutes a large system of interacting components, which can become unstable. We explore factors affecting stability by coupling the dynamics of mRNAs and proteins in a growing cell. We find that mRNA degradation rate does not affect stability, contrary to previous claims. However, global structural features of the network can dramatically enhance stability. Importantly, a network resembling a bipartite graph with a lower fraction of interactions that target TFs has a higher chance of being stable. Scrambling the E. coli transcription network, we find that the biological network is significantly more stable than its randomized counterpart, suggesting that stability constraints may have shaped network structure during the course of evolution.

Scale free topology as an effective feedback system

Biological networks are often heterogeneous in their connectivity pattern, with degree distributions featuring a heavy tail of highly connected hubs. The implications of this heterogeneity on dynamical properties are a topic of much interest. Here we show that interpreting topology as a feedback circuit can provide novel insights on dynamics. Based on the observation that in finite networks a small number of hubs have a disproportionate effect on the entire system, we construct an approximation by lumping these nodes into a single effective hub, which acts as a feedback loop with the rest of the nodes. We use this approximation to study dynamics of networks with scale-free degree distributions, focusing on their probability of convergence to fixed points. We find that the approximation preserves convergence statistics over a wide range of settings. Our mapping provides a parametrization of scale free topology which is predictive at the ensemble level and also retains properties of individual realizations. Specifically, outgoing hubs have an organizing role that can drive the network to convergence, in analogy to suppression of chaos by an external drive. In contrast, incoming hubs have no such property, resulting in a marked difference between the behavior of networks with outgoing vs. incoming scale free degree distribution. Combining feedback analysis with mean field theory predicts a transition between convergent and divergent dynamics which is corroborated by numerical simulations. Furthermore, they highlight the effect of a handful of outlying hubs, rather than of the connectivity distribution law as a whole, on network dynamics.

Nature abounds with complex networks of interacting elements—from the proteins in our cells, through neural networks in our brains, to species interacting in ecosystems. In all of these fields, the relation between network structure and dynamics is an important research question. A recurring feature of natural networks is their heterogeneous structure: individual elements exhibit a huge diversity of connectivity patterns, which complicates the understanding of network dynamics. To address this problem, we devised a simplified approximation for complex structured networks which captures their dynamical properties. Separating out the largest “hubs”—a small number of nodes with disproportionately high connectivity—we represent them by a single node linked to the rest of the network. This enables us to borrow concepts from control theory, where a system’s output is linked back to itself forming a feedback loop. In this analogy, hubs in heterogeneous networks implement a feedback circuit with the rest of the network. The analogy reveals how these hubs can coordinate the network and drive it more easily towards stable states. Our approach enables analyzing dynamical properties of heterogeneous networks, which is difficult to achieve with existing techniques. It is potentially applicable to many fields where heterogeneous networks are important.

Computational modeling demonstrates that glioblastoma cells can survive spatial environmental challenges through exploratory adaptation

Glioblastoma (GBM) is an aggressive type of brain cancer with remarkable cell migration and adaptation capabilities. Exploratory adaptation-utilization of random changes in gene regulation for adaptive benefits-was recently proposed as the process enabling organisms to survive unforeseen conditions. We investigate whether exploratory adaption explains how GBM cells from different anatomic regions of the tumor cope with micro-environmental pressures. We introduce new notions of phenotype and phenotype distance, and determine probable spatial-phenotypic trajectories based on patient data. While some cell phenotypes are inherently plastic, others are intrinsically rigid with respect to phenotypic transitions. We demonstrate that stochastic exploration of the regulatory network structure confers benefits through enhanced adaptive capacity in new environments. Interestingly, even with exploratory capacity, phenotypic paths are constrained to pass through specific, spatial-phenotypic ranges. This work has important implications for understanding how such adaptation contributes to the recurrence dynamics of GBM and other solid tumors.

The Computational Boundary of a "Self": Developmental Bioelectricity Drives Multicellularity and Scale-Free Cognition

All epistemic agents physically consist of parts that must somehow comprise an integrated cognitive self. Biological individuals consist of subunits (organs, cells, and molecular networks) that are themselves complex and competent in their own native contexts. How do coherent biological Individuals result from the activity of smaller sub-agents? To understand the evolution and function of metazoan creatures' bodies and minds, it is essential to conceptually explore the origin of multicellularity and the scaling of the basal cognition of individual cells into a coherent larger organism. In this article, I synthesize ideas in cognitive science, evolutionary biology, and developmental physiology toward a hypothesis about the origin of Individuality: "Scale-Free Cognition." I propose a fundamental definition of an Individual based on the ability to pursue goals at an appropriate level of scale and organization and suggest a formalism for defining and comparing the cognitive capacities of highly diverse types of agents. Any Self is demarcated by a computational surface - the spatio-temporal boundary of events that it can measure, model, and try to affect. This surface sets a functional boundary - a cognitive "light cone" which defines the scale and limits of its cognition. I hypothesize that higher level goal-directed activity and agency, resulting in larger cognitive boundaries, evolve from the primal homeostatic drive of living things to reduce stress - the difference between current conditions and life-optimal conditions. The mechanisms of developmental bioelectricity - the ability of all cells to form electrical networks that process information - suggest a plausible set of gradual evolutionary steps that naturally lead from physiological homeostasis in single cells to memory, prediction, and ultimately complex cognitive agents, via scale-up of the basic drive of infotaxis. Recent data on the molecular mechanisms of pre-neural bioelectricity suggest a model of how increasingly sophisticated cognitive functions emerge smoothly from cell-cell communication used to guide embryogenesis and regeneration. This set of hypotheses provides a novel perspective on numerous phenomena, such as cancer, and makes several unique, testable predictions for interdisciplinary research that have implications not only for evolutionary developmental biology but also for biomedicine and perhaps artificial intelligence and exobiology.

Morphogenesis as Bayesian inference: A variational approach to pattern formation and control in complex biological systems

Recent advances in molecular biology such as gene editing [1], bioelectric recording and manipulation [2] and live cell microscopy using fluorescent reporters [3], [4] - especially with the advent of light-controlled protein activation through optogenetics [5] - have provided the tools to measure and manipulate molecular signaling pathways with unprecedented spatiotemporal precision. This has produced ever increasing detail about the molecular mechanisms underlying development and regeneration in biological organisms. However, an overarching concept - that can predict the emergence of form and the robust maintenance of complex anatomy - is largely missing in the field. Classic (i.e., dynamic systems and analytical mechanics) approaches such as least action principles are difficult to use when characterizing open, far-from equilibrium systems that predominate in Biology. Similar issues arise in neuroscience when trying to understand neuronal dynamics from first principles. In this (neurobiology) setting, a variational free energy principle has emerged based upon a formulation of self-organization in terms of (active) Bayesian inference. The free energy principle has recently been applied to biological self-organization beyond the neurosciences [6], [7]. For biological processes that underwrite development or regeneration, the Bayesian inference framework treats cells as information processing agents, where the driving force behind morphogenesis is the maximization of a cell's model evidence. This is realized by the appropriate expression of receptors and other signals that correspond to the cell's internal (i.e., generative) model of what type of receptors and other signals it should express. The emerging field of the free energy principle in pattern formation provides an essential quantitative formalism for understanding cellular decision-making in the context of embryogenesis, regeneration, and cancer suppression. In this paper, we derive the mathematics behind Bayesian inference - as understood in this framework - and use simulations to show that the formalism can reproduce experimental, top-down manipulations of complex morphogenesis. First, we illustrate this 'first principle' approach to morphogenesis through simulated alterations of anterior-posterior axial polarity (i.e., the induction of two heads or two tails) as in planarian regeneration. Then, we consider aberrant signaling and functional behavior of a single cell within a cellular ensemble - as a first step in carcinogenesis as false 'beliefs' about what a cell should 'sense' and 'do'. We further show that simple modifications of the inference process can cause - and rescue - mis-patterning of developmental and regenerative events without changing the implicit generative model of a cell as specified, for example, by its DNA. This formalism offers a new road map for understanding developmental change in evolution and for designing new interventions in regenerative medicine settings.

Darwinian selection of host and bacteria supports emergence of Lamarckian-like adaptation of the system as a whole

Background

The relatively fast selection of symbiotic bacteria within hosts and the potential transmission of these bacteria across generations of hosts raise the question of whether interactions between host and bacteria support emergent adaptive capabilities beyond those of germ-free hosts.

Results

To investigate possibilities for emergent adaptations that may distinguish composite host-microbiome systems from germ-free hosts, we introduce a population genetics model of a host-microbiome system with vertical transmission of bacteria. The host and its bacteria are jointly exposed to a toxic agent, creating a toxic stress that can be alleviated by selection of resistant individuals and by secretion of a detoxification agent (“detox”). We show that toxic exposure in one generation of hosts leads to selection of resistant bacteria, which in turn, increases the toxic tolerance of the host’s offspring. Prolonged exposure to toxin over many host generations promotes anadditional form of emergent adaptation due to selection of hosts based on detox produced by their bacterial community as a whole (as opposed to properties of individual bacteria).

Conclusions

These findings show that interactions between pure Darwinian selections of host and its bacteria can give rise to emergent adaptive capabilities, including Lamarckian-like adaptation of the host-microbiome system.

Reviewers

This article was reviewed by Eugene Koonin, Yuri Wolf and Philippe Huneman.

Electronic supplementary material

The online version of this article (10.1186/s13062-018-0224-7) contains supplementary material, which is available to authorized users.

Formation of dominant mode by evolution in biological systems

A reduction in high-dimensional phenotypic states to a few degrees of freedom is essential to understand biological systems. Here, we show evolutionary robustness causes such reduction which restricts possible phenotypic changes in response to a variety of environmental conditions. First, global protein expression changes in Escherichia coli after various environmental perturbations were shown to be proportional across components, across different types of environmental conditions. To examine if such dimension reduction is a result of evolution, we analyzed a cell model-with a huge number of components, that reproduces itself via a catalytic reaction network-and confirmed that common proportionality in the concentrations of all components is shaped through evolutionary processes. We found that the changes in concentration across all components in response to environmental and evolutionary changes are constrained to the changes along a one-dimensional major axis, within a huge-dimensional state space. On the basis of these observations, we propose a theory in which such constraints in phenotypic changes are achieved both by evolutionary robustness and plasticity and formulate this proposition in terms of dynamical systems. Accordingly, broad experimental and numerical results on phenotypic changes caused by evolution and adaptation are coherently explained.

Macroscopic Theory for Evolving Biological Systems Akin to Thermodynamics

We present a macroscopic theory to characterize the plasticity, robustness, and evolvability of biological responses and their fluctuations. First, linear approximation in intracellular reaction dynamics is used to demonstrate proportional changes in the expression of all cellular components in response to a given environmental stress, with the proportion coefficient determined by the change in growth rate as a consequence of the steady growth of cells. We further demonstrate that this relationship is supported through adaptation experiments of bacteria, perhaps too well as this proportionality is held even across cultures of different types of conditions. On the basis of simulations of cell models, we further show that this global proportionality is a consequence of evolution in which expression changes in response to environmental or genetic perturbations are constrained along a unique one-dimensional curve, which is a result of evolutionary robustness. It then follows that the expression changes induced by environmental changes are proportionally reduced across different components of a cell by evolution, which is akin to the Le Chatelier thermodynamics principle. Finally, with the aid of a fluctuation-response relationship, this proportionality is shown to hold between fluctuations caused by genetic changes and those caused by noise. Overall, these results and support from the theoretical and experimental literature suggest a formulation of cellular systems akin to thermodynamics, in which a macroscopic potential is given by the growth rate (or fitness) represented as a function of environmental and evolutionary changes.