Realizing 'integral control' in living cells: how to overcome leaky integration due to dilution?

Multi-Layer Autocatalytic Feedback Enables Integral Control Amidst Resource Competition and Across Scales

Integral feedback control strategies have proven effective in regulating protein expression in unpredictable cellular environments. These strategies, grounded in model-based designs and control theory, have advanced synthetic biology applications. Autocatalytic integral feedback controllers, utilizing positive autoregulation for integral action, are one class of simplest architectures to design integrators. This class of controllers offers unique features, such as robustness against dilution effects and cellular growth, as well as the potential for synthetic realizations across different biological scales, owing to their similarity to self-regenerative behaviors widely observed in nature. Despite this, their potential has not yet been fully exploited. One key reason, we discuss, is that their effectiveness is often hindered by resource competition and context-dependent couplings. This study addresses these challenges using a multilayer feedback strategy. Our designs enabled population-level integral feedback and multicellular integrators, where the control function emerges as a property of coordinated interactions distributed across different cell populations coexisting in a multicellular consortium. We provide a generalized mathematical framework for modeling resource competition in complex genetic networks, supporting the design of intracellular control circuits. The use of our proposed multilayer autocatalytic controllers is examined in two typical control tasks that pose significant relevance to synthetic biology applications: concentration regulation and ratiometric control. We define a ratiometric control task and solve it using a variant of our controller. The effectiveness of our controller motifs is demonstrated through a range of application examples, from precise regulation of gene expression and gene ratios in embedded designs to population growth and coculture composition control in multicellular designs within engineered microbial ecosystems. These findings offer a versatile approach to achieving robust adaptation and homeostasis from subcellular to multicellular scales.

Temporal Contrastive Learning through implicit non-equilibrium memory

The backpropagation method has enabled transformative uses of neural networks. Alternatively, for energy-based models, local learning methods involving only nearby neurons offer benefits in terms of decentralized training, and allow for the possibility of learning in computationally-constrained substrates. One class of local learning methods contrasts the desired, clamped behavior with spontaneous, free behavior. However, directly contrasting free and clamped behaviors requires explicit memory. Here, we introduce 'Temporal Contrastive Learning', an approach that uses integral feedback in each learning degree of freedom to provide a simple form of implicit non-equilibrium memory. During training, free and clamped behaviors are shown in a sawtooth-like protocol over time. When combined with integral feedback dynamics, these alternating temporal protocols generate an implicit memory necessary for comparing free and clamped behaviors, broadening the range of physical and biological systems capable of contrastive learning. Finally, we show that non-equilibrium dissipation improves learning quality and determine a Landauer-like energy cost of contrastive learning through physical dynamics.

Multicellular PID control for robust regulation of biological processes

This article presents the first implementation of a proportional-integral-derivative (PID) biomolecular controller within a consortium of different cell populations, aimed at robust regulation of biological processes. By leveraging the modularity and cooperative dynamics of multiple engineered cell populations, we develop a comprehensive in silico analysis of the performance and robustness of P, PD, PI and PID control architectures. Our theoretical findings, validated through in silico experiments using the BSim agent-based simulation platform for bacterial populations, demonstrate the robustness and effectiveness of our multicellular PID control strategy. This innovative approach addresses critical limitations in current control methods, offering significant potential for applications in metabolic engineering, therapeutic contexts and industrial biotechnology. Future work will focus on experimental validation in vivo and further refinement of the control models.

Engineering Sequestration-Based Biomolecular Classifiers with Shared Resources

Constructing molecular classifiers that enable cells to recognize linear and nonlinear input patterns would expand the biocomputational capabilities of engineered cells, thereby unlocking their potential in diagnostics and therapeutic applications. While several biomolecular classifier schemes have been designed, the effects of biological constraints such as resource limitation and competitive binding on the function of those classifiers have been left unexplored. Here, we first demonstrate the design of a sigma factor-based perceptron as a molecular classifier working based on the principles of molecular sequestration between the sigma factor and its antisigma molecule. We then investigate how the output of the biomolecular perceptron, i.e., its response pattern or decision boundary, is affected by the competitive binding of sigma factors to a pool of shared and limited resources of core RNA polymerase. Finally, we reveal the influence of sharing limited resources on multilayer perceptron neural networks and outline design principles that enable the construction of nonlinear classifiers using sigma-based biomolecular neural networks in the presence of competitive resource-sharing effects.

Anti-windup strategies for biomolecular control systems facilitated by model reduction theory for sequestration networks

Robust perfect adaptation, a system property whereby a variable adapts to persistent perturbations at steady state, has been recently realized in living cells using genetic integral controllers. In certain scenarios, such controllers may lead to "integral windup," an adverse condition caused by saturating control elements, which manifests as error accumulation, poor dynamic performance, or instabilities. To mitigate this effect, we here introduce several biomolecular anti-windup topologies and link them to control-theoretic anti-windup strategies. This is achieved using a novel model reduction theory that we develop for reaction networks with fast sequestration reactions. We then show how the anti-windup topologies can be realized as reaction networks and propose intein-based genetic designs for their implementation. We validate our designs through simulations on various biological systems, including models of patients with type I diabetes and advanced biomolecular proportional-integral-derivative (PID) controllers, demonstrating their efficacy in mitigating windup effects and ensuring safety.

Signal integration and integral feedback control with biochemical reaction networks

Biochemical reaction networks perform a variety of signal processing functions, one of which is computing the integrals of signal values. This is often used in integral feedback control, where it enables a system's output to respond to changing inputs, but to then return exactly back to some pre-determined setpoint value afterward. To gain a deeper understanding of how biochemical networks are able to both integrate signals and perform integral feedback control, we investigated these abilities for several simple reaction networks. We found imperfect overlap between these categories, with some networks able to perform both tasks, some able to perform integration but not integral feedback control, and some the other way around. Nevertheless, networks that could either integrate or perform integral feedback control shared key elements. In particular, they included a chemical species that was neutrally stable in the open loop system (no feedback), meaning that this species does not have a unique stable steady-state concentration. Neutral stability could arise from zeroth order decay reactions, binding to a partner that was produced at a constant rate (which occurs in antithetic control), or through a long chain of covalent cycles. Mathematically, it arose from rate equations for the reaction network that were underdetermined when evaluated at steady-state.

A coarse-grained bacterial cell model for resource-aware analysis and design of synthetic gene circuits

Within a cell, synthetic and native genes compete for expression machinery, influencing cellular process dynamics through resource couplings. Models that simplify competitive resource binding kinetics can guide the design of strategies for countering these couplings. However, in bacteria resource availability and cell growth rate are interlinked, which complicates resource-aware biocircuit design. Capturing this interdependence requires coarse-grained bacterial cell models that balance accurate representation of metabolic regulation against simplicity and interpretability. We propose a coarse-grained E. coli cell model that combines the ease of simplified resource coupling analysis with appreciation of bacterial growth regulation mechanisms and the processes relevant for biocircuit design. Reliably capturing known growth phenomena, it provides a unifying explanation to disparate empirical relations between growth and synthetic gene expression. Considering a biomolecular controller that makes cell-wide ribosome availability robust to perturbations, we showcase our model's usefulness in numerically prototyping biocircuits and deriving analytical relations for design guidance.

Design patterns of biological cells

Design patterns are generalized solutions to frequently recurring problems. They were initially developed by architects and computer scientists to create a higher level of abstraction for their designs. Here, we extend these concepts to cell biology to lend a new perspective on the evolved designs of cells' underlying reaction networks. We present a catalog of 21 design patterns divided into three categories: creational patterns describe processes that build the cell, structural patterns describe the layouts of reaction networks, and behavioral patterns describe reaction network function. Applying this pattern language to the E. coli central metabolic reaction network, the yeast pheromone response signaling network, and other examples lends new insights into these systems.

Analysis and design of antithetic proportional-integral-derivative biocontrol-systems with species dilution

The nonlinearity and non-separability of the antithetic PID (aPID) controller have provided greater flexibility in the design of biochemical reaction networks (BCRNs), resulting in significant impacts on biocontrol-systems. Nevertheless, the dilution of control species is disregarded in designs of aPID controllers, which would lead to the failure of inhibition mechanism in the controller and loss of robust perfect adaptation (RPA)-the biological counterpart of robust steady-state tracking. Here, the impact of dilution processes on the structure of aPID is investigated in this study. It is discovered that the proportional and low-pass filters are altered when the dilution processes is present in control species, which increases the coupling between the controller parameters. Moreover, additional integrations for the reference signal and control output generated by control species dilution further leads to the loss of RPA. Subsequently, a novel aPID controller represented by BCRNs, termed quasi-aPID, has been designed to eliminate the detrimental effects of the dilution processes. In an effort to ameliorate the interdependencies among controller parameters, a degradation inhibition mechanism is employed within this controller. Furthermore, this work establishes the limiting relationship between the controller's reaction rates in order to guarantee RPA, while abstaining from the introduction of supplementary species and biochemical reactions. By using the quasi-aPID controller in both the Escherichia coli gene expression model and the whole-body cholesterol metabolism model, its effectiveness is confirmed. Simulation results demonstrate that, the quasi-aPID exhibits a smaller absolute steady-state error in both models and guarantees the RPA property.

Noise properties of adaptation-conferring biochemical control modules

A key goal of synthetic biology is to develop functional biochemical modules with network-independent properties. Antithetic integral feedback (AIF) is a recently developed control module in which two control species perfectly annihilate each other's biological activity. The AIF module confers robust perfect adaptation to the steady-state average level of a controlled intracellular component when subjected to sustained perturbations. Recent work has suggested that such robustness comes at the unavoidable price of increased stochastic fluctuations around average levels. We present theoretical results that support and quantify this trade-off for the commonly analyzed AIF variant in the idealized limit with perfect annihilation. However, we also show that this trade-off is a singular limit of the control module: Even minute deviations from perfect adaptation allow systems to achieve effective noise suppression as long as cells can pay the corresponding energetic cost. We further show that a variant of the AIF control module can achieve significant noise suppression even in the idealized limit with perfect adaptation. This atypical configuration may thus be preferable in synthetic biology applications.

Regulation strategies for two-output biomolecular networks

Feedback control theory facilitates the development of self-regulating systems with desired performance which are predictable and insensitive to disturbances. Feedback regulatory topologies are found in many natural systems and have been of key importance in the design of reliable synthetic bio-devices operating in complex biological environments. Here, we study control schemes for biomolecular processes with two outputs of interest, expanding previously described concepts based on single-output systems. Regulation of such processes may unlock new design possibilities but can be challenging due to coupling interactions; also potential disturbances applied on one of the outputs may affect both. We therefore propose architectures for robustly manipulating the ratio/product and linear combinations of the outputs as well as each of the outputs independently. To demonstrate their characteristics, we apply these architectures to a simple process of two mutually activated biomolecular species. We also highlight the potential for experimental implementation by exploring synthetic realizations both in vivo and in vitro. This work presents an important step forward in building bio-devices capable of sophisticated functions.

Structural identifiability of biomolecular controller motifs with and without flow measurements as model output

Controller motifs are simple biomolecular reaction networks with negative feedback. They can explain how regulatory function is achieved and are often used as building blocks in mathematical models of biological systems. In this paper we perform an extensive investigation into structural identifiability of controller motifs, specifically the so-called basic and antithetic controller motifs. Structural identifiability analysis is a useful tool in the creation and evaluation of mathematical models: it can be used to ensure that model parameters can be determined uniquely and to examine which measurements are necessary for this purpose. This is especially useful for biological models where parameter estimation can be difficult due to limited availability of measureable outputs. Our aim with this work is to investigate how structural identifiability is affected by controller motif complexity and choice of measurements. To increase the number of potential outputs we propose two methods for including flow measurements and show how this affects structural identifiability in combination with, or in the absence of, concentration measurements. In our investigation, we analyze 128 different controller motif structures using a combination of flow and/or concentration measurements, giving a total of 3648 instances. Among all instances, 34% of the measurement combinations provided structural identifiability. Our main findings for the controller motifs include: i) a single measurement is insufficient for structural identifiability, ii) measurements related to different chemical species are necessary for structural identifiability. Applying these findings result in a reduced subset of 1568 instances, where 80% are structurally identifiable, and more complex/interconnected motifs appear easier to structurally identify. The model structures we have investigated are commonly used in models of biological systems, and our results demonstrate how different model structures and measurement combinations affect structural identifiability of controller motifs.

A cybergenetic framework for engineering intein-mediated integral feedback control systems

The ability of biological systems to tightly regulate targeted variables, despite external and internal disturbances, is known as Robust Perfect Adaptation (RPA). Achieved frequently through biomolecular integral feedback controllers at the cellular level, RPA has important implications for biotechnology and its various applications. In this study, we identify inteins as a versatile class of genetic components suitable for implementing these controllers and present a systematic approach for their design. We develop a theoretical foundation for screening intein-based RPA-achieving controllers and a simplified approach for modeling them. We then genetically engineer and test intein-based controllers using commonly used transcription factors in mammalian cells and demonstrate their exceptional adaptation properties over a wide dynamic range. The small size, flexibility, and applicability of inteins across life forms allow us to create a diversity of genetic RPA-achieving integral feedback control systems that can be used in various applications, including metabolic engineering and cell-based therapy.

Biomolecular feedback controllers: from theory to applications

Billions of years of evolution have led to the creation of sophisticated genetic regulatory mechanisms that control various biological processes in a timely and precise fashion, despite their uncertain and noisy environments. Understanding such naturally existing mechanisms and even designing novel ones will have direct implications in various fields such as biotechnology, medicine, and synthetic biology. In particular, many studies have revealed that feedback-based control mechanisms inside the living cells endow the overall system with multiple attractive features, including homeostasis, noise reduction, and high dynamic performance. The remarkable interdisciplinary nature of these studies has brought together disparate disciplines such as systems/synthetic biology and control theory in an effort to design and build more powerful and reliable biomolecular control systems. Here, we review various biomolecular feedback controllers, highlight their characteristics, and point out their promising impact.

Design Principles Underlying Robust Adaptation of Complex Biochemical Networks

Biochemical networks are often characterized by tremendous complexity-both in terms of the sheer number of interacting molecules ("nodes") and in terms of the varied and incompletely understood interactions among these molecules ("interconnections" or "edges"). Strikingly, the vast and intricate networks of interacting proteins that exist within each living cell have the capacity to perform remarkably robustly, and reproducibly, despite significant variations in concentrations of the interacting components from one cell to the next and despite mutability over time of biochemical parameters. Here we consider the ubiquitously observed and fundamentally important signalling response known as robust perfect adaptation (RPA). We have recently shown that all RPA-capable networks, even the most complex ones, must satisfy an extremely rigid set of design principles, and are modular, being decomposable into just two types of network building-blocks-opposer modules and balancer modules. Here we present an overview of the design principles that characterize all RPA-capable network topologies through a detailed examination of a collection of simple examples. We also introduce a diagrammatic method for studying the potential of a network to exhibit RPA, which may be applied without a detailed knowledge of the complex mathematical principles governing RPA.

Synthetic biology by controller design

Natural biological systems display complex regulation and synthetic biomolecular systems have been used to understand their natural counterparts and to parse sophisticated regulations into core design principles. At the same time, the engineering of biomolecular systems has unarguable potential to transform current and to enable new, yet-to-be-imagined, biotechnology applications. In this review, we discuss the progression of control systems design in synthetic biology, from the purpose of understanding the function of naturally occurring regulatory motifs to that of creating genetic circuits whose function is sufficiently robust for biotechnology applications.

Frequency spectra and the color of cellular noise

The invention of the Fourier integral in the 19th century laid the foundation for modern spectral analysis methods. This integral decomposes a temporal signal into its frequency components, providing deep insights into its generating process. While this idea has precipitated several scientific and technological advances, its impact has been fairly limited in cell biology, largely due to the difficulties in connecting the underlying noisy intracellular networks to the frequency content of observed single-cell trajectories. Here we develop a spectral theory and computational methodologies tailored specifically to the computation and analysis of frequency spectra of noisy intracellular networks. Specifically, we develop a method to compute the frequency spectrum for general nonlinear networks, and for linear networks we present a decomposition that expresses the frequency spectrum in terms of its sources. Several examples are presented to illustrate how our results provide frequency-based methods for the design and analysis of noisy intracellular networks.

A genetic mammalian proportional-integral feedback control circuit for robust and precise gene regulation

To survive in the harsh environments they inhabit, cells have evolved sophisticated regulatory mechanisms that can maintain a steady internal milieu or homeostasis. This robustness, however, does not generally translate to engineered genetic circuits, such as the ones studied by synthetic biology. Here, we introduce an implementation of a minimal and universal gene regulatory motif that produces robust perfect adaptation for mammalian cells, and we improve on it by enhancing the precision of its regulation.

The processes that keep a cell alive are constantly challenged by unpredictable changes in its environment. Cells manage to counteract these changes by employing sophisticated regulatory strategies that maintain a steady internal milieu. Recently, the antithetic integral feedback motif has been demonstrated to be a minimal and universal biological regulatory strategy that can guarantee robust perfect adaptation for noisy gene regulatory networks in Escherichia coli. Here, we present a realization of the antithetic integral feedback motif in a synthetic gene circuit in mammalian cells. We show that the motif robustly maintains the expression of a synthetic transcription factor at tunable levels even when it is perturbed by increased degradation or its interaction network structure is perturbed by a negative feedback loop with an RNA-binding protein. We further demonstrate an improved regulatory strategy by augmenting the antithetic integral motif with additional negative feedback to realize antithetic proportional–integral control. We show that this motif produces robust perfect adaptation while also reducing the variance of the regulated synthetic transcription factor. We demonstrate that the integral and proportional–integral feedback motifs can mitigate the impact of gene expression burden, and we computationally explore their use in cell therapy. We believe that the engineering of precise and robust perfect adaptation will enable substantial advances in industrial biotechnology and cell-based therapeutics.

A hierarchy of biomolecular proportional-integral-derivative feedback controllers for robust perfect adaptation and dynamic performance

Proportional-Integral-Derivative (PID) feedback controllers are the most widely used controllers in industry. Recently, the design of molecular PID-controllers has been identified as an important goal for synthetic biology and the field of cybergenetics. In this paper, we consider the realization of PID-controllers via biomolecular reactions. We propose an array of topologies offering a compromise between simplicity and high performance. We first demonstrate that different biomolecular PI-controllers exhibit different performance-enhancing capabilities. Next, we introduce several derivative controllers based on incoherent feedforward loops acting in a feedback configuration. Alternatively, we show that differentiators can be realized by placing molecular integrators in a negative feedback loop, which can be augmented by PI-components to yield PID-controllers. We demonstrate that PID-controllers can enhance stability and dynamic performance, and can also reduce stochastic noise. Finally, we provide an experimental demonstration using a hybrid setup where in silico PID-controllers regulate a genetic circuit in single yeast cells.

Robust and tunable signal processing in mammalian cells via engineered covalent modification cycles

Engineered signaling networks can impart cells with new functionalities useful for directing differentiation and actuating cellular therapies. For such applications, the engineered networks must be tunable, precisely regulate target gene expression, and be robust to perturbations within the complex context of mammalian cells. Here, we use bacterial two-component signaling proteins to develop synthetic phosphoregulation devices that exhibit these properties in mammalian cells. First, we engineer a synthetic covalent modification cycle based on kinase and phosphatase proteins derived from the bifunctional histidine kinase EnvZ, enabling analog tuning of gene expression via its response regulator OmpR. By regulating phosphatase expression with endogenous miRNAs, we demonstrate cell-type specific signaling responses and a new strategy for accurate cell type classification. Finally, we implement a tunable negative feedback controller via a small molecule-stabilized phosphatase, reducing output expression variance and mitigating the context-dependent effects of off-target regulation and resource competition. Our work lays the foundation for establishing tunable, precise, and robust control over cell behavior with synthetic signaling networks.

Stabilization of antithetic control via molecular buffering

A key goal in synthetic biology is the construction of molecular circuits that robustly adapt to perturbations. Although many natural systems display perfect adaptation, whereby stationary molecular concentrations are insensitive to perturbations, its de novo engineering has proven elusive. The discovery of the antithetic control motif was a significant step towards a universal mechanism for engineering perfect adaptation. Antithetic control provides perfect adaptation in a wide range of systems, but it can lead to oscillatory dynamics due to loss of stability; moreover, it can lose perfect adaptation in fast growing cultures. Here, we introduce an extended antithetic control motif that resolves these limitations. We show that molecular buffering, a widely conserved mechanism for homeostatic control in Nature, stabilizes oscillations and allows for near-perfect adaptation during rapid growth. We study multiple buffering topologies and compare their performance in terms of their stability and adaptation properties. We illustrate the benefits of our proposed strategy in exemplar models for biofuel production and growth rate control in bacterial cultures. Our results provide an improved circuit for robust control of biomolecular systems.

Biomolecular mechanisms for signal differentiation

Cells can sense temporal changes of molecular signals, allowing them to predict environmental variations and modulate their behavior. This paper elucidates biomolecular mechanisms of time derivative computation, facilitating the design of reliable synthetic differentiator devices for a variety of applications, ultimately expanding our understanding of cell behavior. In particular, we describe and analyze three alternative biomolecular topologies that are able to work as signal differentiators to input signals around their nominal operation. We propose strategies to preserve their performance even in the presence of high-frequency input signal components which are detrimental to the performance of most differentiators. We find that the core of the proposed topologies appears in natural regulatory networks and we further discuss their biological relevance. The simple structure of our designs makes them promising tools for realizing derivative control action in synthetic biology.

Rapid prototyping and design of cybergenetic single-cell controllers

The design and implementation of synthetic circuits that operate robustly in the cellular context is fundamental for the advancement of synthetic biology. However, their practical implementation presents challenges due to low predictability of synthetic circuit design and time-intensive troubleshooting. Here, we present the Cyberloop, a testing framework to accelerate the design process and implementation of biomolecular controllers. Cellular fluorescence measurements are sent in real-time to a computer simulating candidate stochastic controllers, which in turn compute the control inputs and feed them back to the controlled cells via light stimulation. Applying this framework to yeast cells engineered with optogenetic tools, we examine and characterize different biomolecular controllers, test the impact of non-ideal circuit behaviors such as dilution on their operation, and qualitatively demonstrate improvements in controller function with certain network modifications. From this analysis, we derive conditions for desirable biomolecular controller performance, thereby avoiding pitfalls during its biological implementation.

Control of mammalian cell-based devices with genetic programming

Synthetic biology increasingly enables the construction of sophisticated functions in mammalian cells. A particularly promising frontier combines concepts drawn from industrial process control engineering-which is used to confer and balance properties such as stability and efficiency-with understanding as to how living systems have evolved to perform similar tasks with biological components. In this review, we first survey the state-of-the-art for both technologies and strategies available for genetic programming in mammalian cells. We then discuss recent progress in implementing programming objectives inspired by engineered and natural control mechanisms. Finally, we consider the transformative role of model-guided design in the present and future construction of customized mammalian cell functions for applications in biotechnology, medicine, and fundamental research.

Robust adaptation of PKCζ-IRS1 insulin signaling pathways through integral feedback control

Insulin signaling pathways in muscle tissue play a major role in maintaining glucose homeostasis. Dysregulation in these pathways results in the onset of serious metabolic disorders like type 2 diabetes. Robustness is an essential characteristic of insulin signaling pathways that ensures reliable signal transduction in the presence of perturbations as a result of several feedback mechanisms. Integral control, according to control engineering, provides reliable setpoint tracking and disturbance rejection. The presence of negative feedback and integrating process is crucial for biological processes to achieve integral control. The existence of an integral controller leads to the rejection of perturbations which resulted in the robust regulation of biochemical entities within acceptable levels. In the presentin silicoresearch work, the presence of integral control in the protein kinase Cζ- insulin receptor substrate-1 (PKCζ-IRS1) pathway is identified, verified mathematically and model is simulated in Cell Designer. The data is exported to Minitab software and robustness analysis is carried out statistically using the Mann-Whitney test. The p-value of the results obtained with given parameters perturbed by ±1% is greater than the significance level of 0.05 (0.2132 for 1% error in k7(rate constant of IRS1 phosphorylation), 0.2096 for -1% error in k7, 0.9037 for both ±1% error in insulin and 0.9037 for ±1% error in k1(association rate constant of the first molecule of insulin to bind the insulin receptor), indicated that our hypothesis is proved The results satisfactorily indicate that even when perturbations are present, glucose homeostasis in muscle tissue is robust due to the presence of integral regulation in the PKCζ-IRS1 insulin signaling pathways. In this paper, we have analysed the findings from the framework of robust control theory, which has allowed us to examine that how PKCζ-IRS1 insulin signaling pathways produces desired output in presence of perturbations.

Noise suppression in stochastic genetic circuits using PID controllers

Inside individual cells, protein population counts are subject to molecular noise due to low copy numbers and the inherent probabilistic nature of biochemical processes. We investigate the effectiveness of proportional, integral and derivative (PID) based feedback controllers to suppress protein count fluctuations originating from two noise sources: bursty expression of the protein, and external disturbance in protein synthesis. Designs of biochemical reactions that function as PID controllers are discussed, with particular focus on individual controllers separately, and the corresponding closed-loop system is analyzed for stochastic controller realizations. Our results show that proportional controllers are effective in buffering protein copy number fluctuations from both noise sources, but this noise suppression comes at the cost of reduced static sensitivity of the output to the input signal. In contrast, integral feedback has no effect on the protein noise level from stochastic expression, but significantly minimizes the impact of external disturbances, particularly when the disturbance comes at low frequencies. Counter-intuitively, integral feedback is found to amplify external disturbances at intermediate frequencies. Next, we discuss the design of a coupled feedforward-feedback biochemical circuit that approximately functions as a derivate controller. Analysis using both analytical methods and Monte Carlo simulations reveals that this derivative controller effectively buffers output fluctuations from bursty stochastic expression, while maintaining the static input-output sensitivity of the open-loop system. In summary, this study provides a systematic stochastic analysis of biochemical controllers, and paves the way for their synthetic design and implementation to minimize deleterious fluctuations in gene product levels.

In the noisy cellular environment, biochemical species such as genes, RNAs and proteins that often occur at low molecular counts, are subject to considerable stochastic fluctuations in copy numbers over time. How cellular biochemical processes function reliably in the face of such randomness is an intriguing fundamental problem. Increasing evidence suggests that random fluctuations (noise) in protein copy numbers play important functional roles, such as driving genetically identical cells to different cell fates. Moreover, many disease states have been attributed to elevated noise levels in specific proteins. Here we systematically investigate design of biochemical systems that function as proportional, integral and derivative-based feedback controllers to suppress protein count fluctuations arising from bursty expression of the protein and external disturbance in protein synthesis. Our results show that different controllers are effective in buffering different noise components, and identify ranges of feedback gain for minimizing deleterious fluctuations in protein levels.

Context-aware synthetic biology by controller design: Engineering the mammalian cell

The rise of systems biology has ushered a new paradigm: the view of the cell as a system that processes environmental inputs to drive phenotypic outputs. Synthetic biology provides a complementary approach, allowing us to program cell behavior through the addition of synthetic genetic devices into the cellular processor. These devices, and the complex genetic circuits they compose, are engineered using a design-prototype-test cycle, allowing for predictable device performance to be achieved in a context-dependent manner. Within mammalian cells, context effects impact device performance at multiple scales, including the genetic, cellular, and extracellular levels. In order for synthetic genetic devices to achieve predictable behaviors, approaches to overcome context dependence are necessary. Here, we describe control systems approaches for achieving context-aware devices that are robust to context effects. We then consider cell fate programing as a case study to explore the potential impact of context-aware devices for regenerative medicine applications.

Perfect adaptation in biology

A distinctive feature of many biological systems is their ability to adapt to persistent stimuli or disturbances that would otherwise drive them away from a desirable steady state. The resulting stasis enables organisms to function reliably while being subjected to very different external environments. This perspective concerns a stringent type of biological adaptation, robust perfect adaptation (RPA), that is resilient to certain network and parameter perturbations. As in engineered control systems, RPA requires that the regulating network satisfy certain structural constraints that cannot be avoided. We elucidate these ideas using biological examples from systems and synthetic biology. We then argue that understanding the structural constraints underlying RPA allows us to look past implementation details and offers a compelling means to unravel regulatory biological complexity.

The structure of infinitesimal homeostasis in input-output networks

Homeostasis refers to a phenomenon whereby the output [Formula: see text] of a system is approximately constant on variation of an input [Formula: see text]. Homeostasis occurs frequently in biochemical networks and in other networks of interacting elements where mathematical models are based on differential equations associated to the network. These networks can be abstracted as digraphs [Formula: see text] with a distinguished input node [Formula: see text], a different distinguished output node o, and a number of regulatory nodes [Formula: see text]. In these models the input-output map [Formula: see text] is defined by a stable equilibrium [Formula: see text] at [Formula: see text]. Stability implies that there is a stable equilibrium [Formula: see text] for each [Formula: see text] near [Formula: see text] and infinitesimal homeostasis occurs at [Formula: see text] when [Formula: see text]. We show that there is an [Formula: see text] homeostasis matrix [Formula: see text] for which [Formula: see text] if and only if [Formula: see text]. We note that the entries in H are linearized couplings and [Formula: see text] is a homogeneous polynomial of degree [Formula: see text] in these entries. We use combinatorial matrix theory to factor the polynomial [Formula: see text] and thereby determine a menu of different types of possible homeostasis associated with each digraph [Formula: see text]. Specifically, we prove that each factor corresponds to a subnetwork of [Formula: see text]. The factors divide into two combinatorially defined classes: structural and appendage. Structural factors correspond to feedforward motifs and appendage factors correspond to feedback motifs. Finally, we discover an algorithm for determining the homeostasis subnetwork motif corresponding to each factor of [Formula: see text] without performing numerical simulations on model equations. The algorithm allows us to classify low degree factors of [Formula: see text]. There are two types of degree 1 homeostasis (negative feedback loops and kinetic or Haldane motifs) and there are two types of degree 2 homeostasis (feedforward loops and a degree two appendage motif).

Quasi-robust control of biochemical reaction networks via stochastic morphing

One of the main objectives of synthetic biology is the development of molecular controllers that can manipulate the dynamics of a given biochemical network that is at most partially known. When integrated into smaller compartments, such as living or synthetic cells, controllers have to be calibrated to factor in the intrinsic noise. In this context, biochemical controllers put forward in the literature have focused on manipulating the mean (first moment) and reducing the variance (second moment) of the target molecular species. However, many critical biochemical processes are realized via higher-order moments, particularly the number and configuration of the probability distribution modes (maxima). To bridge the gap, we put forward the stochastic morpher controller that can, under suitable timescale separations, morph the probability distribution of the target molecular species into a predefined form. The morphing can be performed at a lower-resolution, allowing one to achieve desired multi-modality/multi-stability, and at a higher-resolution, allowing one to achieve arbitrary probability distributions. Properties of the controller, such as robustness and convergence, are rigorously established, and demonstrated on various examples. Also proposed is a blueprint for an experimental implementation of stochastic morpher.

Energy-Based Modeling of the Feedback Control of Biomolecular Systems With Cyclic Flow Modulation

Energy-based modelling brings engineering insight to the understanding of biomolecular systems. It is shown how well-established control engineering concepts, such as loop-gain, arise from energy feedback loops and are therefore amenable to control engineering insight. In particular, a novel method is introduced to allow the transfer function based approach of classical linear control to be utilised in the analysis of feedback systems modelled by network thermodynamics and thus amalgamate energy-based modelling with control systems analysis. The approach is illustrated using a class of metabolic cycles with activation and inhibition leading to the concept of Cyclic Flow Modulation.

Ultrasensitive molecular controllers for quasi-integral feedback

Feedback control has enabled the success of automated technologies by mitigating the effects of variability, unknown disturbances, and noise. While it is known that biological feedback loops reduce the impact of noise and help shape kinetic responses, many questions remain about how to design molecular integral controllers. Here, we propose a modular strategy to build molecular quasi-integral feedback controllers, which involves following two design principles. The first principle is to utilize an ultrasensitive response, which determines the gain of the controller and influences the steady-state error. The second is to use a tunable threshold of the ultrasensitive response, which determines the equilibrium point of the system. We describe a reaction network, named brink controller, that satisfies these conditions by combining molecular sequestration and an activation/deactivation cycle. With computational models, we examine potential biological implementations of brink controllers, and we illustrate different example applications.

Guidelines for designing the antithetic feedback motif

Integral feedback control is commonly used in mechanical and electrical systems to achieve zero steady-state error following an external disturbance. Equivalently, in biological systems, a property known as robust perfect adaptation guarantees robustness to environmental perturbations and return to the pre-disturbance state. Previously, Briat et al proposed a biomolecular design for integral feedback control (robust perfect adaptation) called the antithetic feedback motif. The antithetic feedback controller uses the sequestration binding reaction of two biochemical species to record the integral of the error between the current and the desired output of the network it controls. The antithetic feedback motif has been successfully built using synthetic components in vivo in Escherichia coli and Saccharomyces cerevisiae cells. However, these previous synthetic implementations of antithetic feedback have not produced perfect integral feedback control due to the degradation and dilution of the two controller species. Furthermore, previous theoretical results have cautioned that integral control can only be achieved under stability conditions that not all antithetic feedback motifs necessarily fulfill. In this paper, we study how to design antithetic feedback motifs that simultaneously achieve good stability and small steady-state error properties, even as the controller species are degraded and diluted. We provide simple tuning guidelines to achieve flexible and practical synthetic biological implementations of antithetic feedback control. We use several tools and metrics from control theory to design antithetic feedback networks, paving the path for the systematic design of synthetic biological controllers.

Infinitesimal homeostasis in three-node input-output networks

Homeostasis occurs in a system where an output variable is approximately constant on an interval on variation of an input variable [Formula: see text]. Homeostasis plays an important role in the regulation of biological systems, cf.  Ferrell (Cell Syst 2:62-67, 2016), Tang and McMillen (J Theor Biol 408:274-289, 2016), Nijhout et al. (BMC Biol 13:79, 2015), and Nijhout et al. (Wiley Interdiscip Rev Syst Biol Med 11:e1440, 2018). A method for finding homeostasis in mathematical models is given in the control theory literature as points where the derivative of the output variable with respect to [Formula: see text] is identically zero. Such points are called perfect homeostasis or perfect adaptation. Alternatively, Golubitsky and Stewart (J Math Biol 74:387-407, 2017) use an infinitesimal notion of homeostasis (namely, the derivative of the input-output function is zero at an isolated point) to introduce singularity theory into the study of homeostasis. Reed et al. (Bull Math Biol 79(9):1-24, 2017) give two examples of infinitesimal homeostasis in three-node chemical reaction systems: feedforward excitation and substrate inhibition. In this paper we show that there are 13 different three-node networks leading to 78 three-node input-output network configurations, under the assumption that there is one input node, one output node, and they are distinct. The different configurations are based on which node is the input node and which node is the output node. We show nonetheless that there are only three basic mechanisms for three-node input-output networks that lead to infinitesimal homeostasis and we call them structural homeostasis, Haldane homeostasis, and null-degradation homeostasis. Substantial parts of this classification are given in Ma et al. (Cell 138:760-773, 2009) and Ferrell (2016) among others. Our contributions include giving a complete classification using general admissible systems (Golubitsky and Stewart in Bull Am Math Soc 43:305-364, 2006) rather than specific biochemical models, relating the types of infinitesimal homeostasis to the graph theoretic existence of simple paths, and providing the basis to use singularity theory to study higher codimension homeostasis singularities such as the chair singularities introduced in Nijhout and Reed (Integr Comp Biol 54(2):264-275, 2014. https://doi.org/10.1093/icb/icu010) and Nijhout et al. (Math Biosci 257:104-110, 2014). See Golubitsky and Stewart (2017). The first two of these mechanisms are illustrated by feedforward excitation and substrate inhibition. Structural homeostasis occurs only when the network has a feedforward loop as a subnetwork; that is, when there are two distinct simple paths connecting the input node to the output node. Moreover, when the network is just the feedforward loop motif itself, one of the paths must be excitatory and one inhibitory to support infinitesimal homeostasis. Haldane homeostasis occurs when there is a single simple path from the input node to the output node and then only when one of the couplings along this path has strength 0. Null-degradation homeostasis is illustrated by a biochemical example from Ma et al. (2009); this kind of homeostasis can occur only when the degradation constant of the third node is 0. The paper ends with an analysis of Haldane homeostasis infinitesimal chair singularities.

In vitro implementation of robust gene regulation in a synthetic biomolecular integral controller

Feedback mechanisms play a critical role in the maintenance of cell homeostasis in the presence of disturbances and uncertainties. Motivated by the need to tune the dynamics and improve the robustness of gene circuits, biological engineers have proposed various designs that mimic natural molecular feedback control mechanisms. However, practical and predictable implementations have proved challenging because of the complexity of synthesis and analysis of complex biomolecular networks. Here, we analyze and experimentally validate a synthetic biomolecular controller executed in vitro. The controller ensures that gene expression rate tracks an externally imposed reference level, and achieves this goal even in the presence of certain kinds of disturbances. Our design relies upon an analog of the well-known principle of integral feedback in control theory. We implement the controller in an Escherichia coli cell-free transcription-translation system, which allows rapid prototyping and implementation. Modeling and theory guide experimental implementation with well-defined operational predictability.

Low-Burden Biological Feedback Controllers for Near-Perfect Adaptation

The robustness and reliability of synthetic biological systems can be substantially improved by the introduction of feedback control architectures that parallel those employed in traditional engineering disciplines. One common control goal is adaptation (or disturbance rejection), which refers to a system's ability to maintain a constant output despite variation in some of its constituent processes (as frequently occurs in noisy cellular environments) or external perturbations. In this paper, we propose and analyze a control architecture that employs integrase and excisionase proteins to invert regions of DNA and an mRNA-mRNA annihilation reaction. Combined, these components approximate the functionality of a switching controller (as employed in classical control engineering) with three distinct operational modes. We demonstrate that this system is capable of near-perfect adaptation to variation in rates of both transcription and translation and can also operate without excessive consumption of cellular resources. The system's steady-state behavior is analyzed, and limits on its operating range are derived. Deterministic simulations of its dynamics are presented and are then extended to the stochastic case, which treats biochemical reactions as discrete events.

Homeostatic controllers compensating for growth and perturbations

Cells and organisms have developed homeostatic mechanisms which protect them against a changing environment. How growth and homeostasis interact is still not well understood, but of increasing interest to the molecular and synthetic biology community to recognize and design control circuits which can oppose the diluting effects of cell growth. In this paper we describe the performance of selected negative feedback controllers in response to different applied growth laws and time dependent outflow perturbations of a controlled variable. The approach taken here is based on deterministic mass action kinetics assuming that cell content is instantaneously mixed. All controllers behave ideal in the sense that they for step-wise perturbations in volume and a controlled compound A are able to drive A precisely back to the controllers' theoretical set-points. The applied growth kinetics reflect experimentally observed growth laws, which range from surface to volume ratio growth to linear and exponential growth. Our results show that the kinetic implementation of integral control and the structure of the negative feedback loop are two properties which affect controller performance. Best performance is observed for controllers based on derepression kinetics and controllers with an autocatalytic implementation of integral control. Both are able to defend exponential growth and perturbations, although the autocatalytic controller shows an offset from its theoretical set-point. Controllers with activating signaling using zero-order or bimolecular (antithetic) kinetics for integral control behave very similar but less well. Their performance can be improved by implementing negative feedback structures having repression/derepression steps or by increasing controller aggressiveness. Our results provide a guide what type of feedback structures and integral control kinetics are suitable to oppose the dilution effects by different growth laws and time dependent perturbations on a deterministic level.

Synthetic negative feedback circuits using engineered small RNAs

Negative feedback is known to enable biological and man-made systems to perform reliably in the face of uncertainties and disturbances. To date, synthetic biological feedback circuits have primarily relied upon protein-based, transcriptional regulation to control circuit output. Small RNAs (sRNAs) are non-coding RNA molecules that can inhibit translation of target messenger RNAs (mRNAs). In this work, we modelled, built and validated two synthetic negative feedback circuits that use rationally-designed sRNAs for the first time. The first circuit builds upon the well characterised tet-based autorepressor, incorporating an externally-inducible sRNA to tune the effective feedback strength. This allows more precise fine-tuning of the circuit output in contrast to the sigmoidal, steep input–output response of the autorepressor alone. In the second circuit, the output is a transcription factor that induces expression of an sRNA, which inhibits translation of the mRNA encoding the output, creating direct, closed-loop, negative feedback. Analysis of the noise profiles of both circuits showed that the use of sRNAs did not result in large increases in noise. Stochastic and deterministic modelling of both circuits agreed well with experimental data. Finally, simulations using fitted parameters allowed dynamic attributes of each circuit such as response time and disturbance rejection to be investigated.

Hard Limits and Performance Tradeoffs in a Class of Antithetic Integral Feedback Networks

Feedback regulation is pervasive in biology at both the organismal and cellular level. In this article, we explore the properties of a particular biomolecular feedback mechanism called antithetic integral feedback, which can be implemented using the binding of two molecules. Our work develops an analytic framework for understanding the hard limits, performance tradeoffs, and architectural properties of this simple model of biological feedback control. Using tools from control theory, we show that there are simple parametric relationships that determine both the stability and the performance of these systems in terms of speed, robustness, steady-state error, and leakiness. These findings yield a holistic understanding of the behavior of antithetic integral feedback and contribute to a more general theory of biological control systems.

Analysis of primitive genetic interactions for the design of a genetic signal differentiator

We study the dynamic and static input-output behavior of several primitive genetic interactions and their effect on the performance of a genetic signal differentiator. In a simplified design, several requirements for the linearity and time-scales of processes like transcription, translation and competitive promoter binding were introduced. By experimentally probing simple genetic constructs in a cell-free experimental environment and fitting semi-mechanistic models to these data, we show that some of these requirements can be verified, while others are only met with reservations in certain operational regimes. Analyzing the linearized model of the resulting genetic network, we conclude that it approximates a differentiator with relative degree one. Taking also the discovered nonlinearities into account and using a describing function approach, we further determine the particular frequency and amplitude ranges where the genetic differentiator can be expected to behave as such.

Architectural Principles for Characterizing the Performance of Antithetic Integral Feedback Networks

As we begin to design increasingly complex synthetic biomolecular systems, it is essential to develop rational design methodologies that yield predictable circuit performance. Here we apply mathematical tools from the theory of control and dynamical systems to yield practical insights into the architecture and function of a particular class of biological feedback circuit. Specifically, we show that it is possible to analytically characterize both the operating regime and performance tradeoffs of an antithetic integral feedback circuit architecture. Furthermore, we demonstrate how these principles can be applied to inform the design process of a particular synthetic feedback circuit.

A quasi-integral controller for adaptation of genetic modules to variable ribosome demand

The behavior of genetic circuits is often poorly predictable. A gene’s expression level is not only determined by the intended regulators, but also affected by changes in ribosome availability imparted by expression of other genes. Here we design a quasi-integral biomolecular feedback controller that enables the expression level of any gene of interest (GOI) to adapt to changes in available ribosomes. The feedback is implemented through a synthetic small RNA (sRNA) that silences the GOI’s mRNA, and uses orthogonal extracytoplasmic function (ECF) sigma factor to sense the GOI’s translation and to actuate sRNA transcription. Without the controller, the expression level of the GOI is reduced by 50% when a resource competitor is activated. With the controller, by contrast, gene expression level is practically unaffected by the competitor. This feedback controller allows adaptation of genetic modules to variable ribosome demand and thus aids modular construction of complicated circuits.

Competition for shared cellular resources often renders genetic circuits poorly predictable. Here the authors design a biomolecular quasi-integral controller that allows gene expression to adapt to variable demand in translation resources.

Antithetic proportional-integral feedback for reduced variance and improved control performance of stochastic reaction networks

The ability of a cell to regulate and adapt its internal state in response to unpredictable environmental changes is called homeostasis and this ability is crucial for the cell's survival and proper functioning. Understanding how cells can achieve homeostasis, despite the intrinsic noise or randomness in their dynamics, is fundamentally important for both systems and synthetic biology. In this context, a significant development is the proposed antithetic integral feedback (AIF) motif, which is found in natural systems, and is known to ensure robust perfect adaptation for the mean dynamics of a given molecular species involved in a complex stochastic biomolecular reaction network. From the standpoint of applications, one drawback of this motif is that it often leads to an increased cell-to-cell heterogeneity or variance when compared to a constitutive (i.e. open-loop) control strategy. Our goal in this paper is to show that this performance deterioration can be countered by combining the AIF motif and a negative feedback strategy. Using a tailored moment closure method, we derive approximate expressions for the stationary variance for the controlled network that demonstrate that increasing the strength of the negative feedback can indeed decrease the variance, sometimes even below its constitutive level. Numerical results verify the accuracy of these results and we illustrate them by considering three biomolecular networks with two types of negative feedback strategies. Our computational analysis indicates that there is a trade-off between the speed of the settling-time of the mean trajectories and the stationary variance of the controlled species; i.e. smaller variance is associated with larger settling-time.