The Drosophila gap gene network is composed of two parallel toggle switches

Biological computations: Limitations of attractor-based formalisms and the need for transients

Living systems, from single cells to higher vertebrates, receive a continuous stream of non-stationary inputs that they sense, for e.g. via cell surface receptors or sensory organs. By integrating these time-varying, multi-sensory, and often noisy information with memory using complex molecular or neuronal networks, they generate a variety of responses beyond simple stimulus-response association, including avoidance behavior, life-long-learning or social interactions. In a broad sense, these processes can be understood as a type of biological computation. Taking as a basis generic features of biological computations, such as real-time responsiveness or robustness and flexibility of the computation, we highlight the limitations of the current attractor-based framework for understanding computations in biological systems. We argue that frameworks based on transient dynamics away from attractors are better suited for the description of computations performed by neuronal and signaling networks. In particular, we discuss how quasi-stable transient dynamics from ghost states that emerge at criticality have a promising potential for developing an integrated framework of computations, that can help us understand how living system actively process information and learn from their continuously changing environment.

A bistable autoregulatory module in the developing embryo commits cells to binary expression fates

Bistable autoactivation has been proposed as a mechanism for cells to adopt binary fates during embryonic development. However, it is unclear whether the autoactivating modules found within developmental gene regulatory networks are bistable, unless their parameters are quantitatively determined. Here, we combine in vivo live imaging with mathematical modeling to dissect the binary cell fate dynamics of the fruit fly pair-rule gene fushi tarazu (ftz), which is regulated by two known enhancers: the early (non-autoregulating) element and the autoregulatory element. Live imaging of transcription and protein concentration in the blastoderm revealed that binary Ftz fates are achieved as Ftz expression rapidly transitions from being dictated by the early element to the autoregulatory element. Moreover, we discovered that Ftz concentration alone is insufficient to activate the autoregulatory element, and that this element only becomes responsive to Ftz at a prescribed developmental time. Based on these observations, we developed a dynamical systems model and quantitated its kinetic parameters directly from experimental measurements. Our model demonstrated that the ftz autoregulatory module is indeed bistable and that the early element transiently establishes the content of the binary cell fate decision to which the autoregulatory module then commits. Further in silico analysis revealed that the autoregulatory element locks the Ftz fate quickly, within 35 min of exposure to the transient signal of the early element. Overall, our work confirms the widely held hypothesis that autoregulation can establish developmental fates through bistability and, most importantly, provides a framework for the quantitative dissection of cellular decision-making.

Steady-State Operation of a Cell-Free Genetic Band-Detection Circuit

Pattern formation processes play a decisive role during embryogenesis and involve the precise spatial and temporal orchestration of intricate gene regulatory processes. Synthetic gene circuits modeled after their biological counterparts can be used to investigate such processes under well-controlled conditions and may, in the future, be utilized for autonomous position determination in synthetic biological materials. Here, we investigated a three-node feed-forward gene regulatory circuit in vitro that generates three distinct fluorescent outputs in response to varying concentrations of a single externally supplied morphogen. The circuit acts as a band detector for the morphogen concentration and, in a spatial context, could serve as a stripe-forming gene circuit. We simulated the behavior of the genetic circuit in the presence of a morphogen gradient using a system of ordinary differential equations and determined optimal parameters for stripe-pattern formation using an evolutionary algorithm. To analyze the subcircuits of the system, we conducted cell-free characterization experiments and finally tested the whole genetic circuit in nanoliter-scale microfluidic flow reactors that provided a continuous supply of cell extract and metabolites and allowed removal of degradation products. To make use of the widely employed promoters P_LlacO-1 and P_LtetO-1 in our design, we removed LacI from our bacterial cell extract by genome engineering Escherichia coli using a pORTMAGE workflow. Our results show that the band-detector works as designed when operated out of equilibrium within the flow reactors. On the other hand, subcircuits of the system and the whole circuit fail to generate the desired gene expression response when operated in a closed reactor. Our work thus underlines the importance of out-of-equilibrium operation of complex gene circuits, which cannot settle to a steady-state expression pattern within the finite lifetime of a cell-free expression system.

Latent space of a small genetic network: Geometry of dynamics and information

The high-dimensional character of most biological systems presents genuine challenges for modeling and prediction. Here we propose a neural network-based approach for dimensionality reduction and analysis of biological gene expression data, using, as a case study, a well-known genetic network in the early Drosophila embryo, the gap gene patterning system. We build an autoencoder compressing the dynamics of spatial gap gene expression into a two-dimensional (2D) latent map. The resulting 2D dynamics suggests an almost linear model, with a small bare set of essential interactions. Maternally defined spatial modes control gap genes positioning, without the classically assumed intricate set of repressive gap gene interactions. This, surprisingly, predicts minimal changes of neighboring gap domains when knocking out gap genes, consistent with previous observations. Latent space geometries in maternal mutants are also consistent with the existence of such spatial modes. Finally, we show how positional information is well defined and interpretable as a polar angle in latent space. Our work illustrates how optimization of small neural networks on medium-sized biological datasets is sufficiently informative to capture essential underlying mechanisms of network function.

Monostability and bistability of biological switches

Cell-fate transition can be modeled by ordinary differential equations (ODEs) which describe the behavior of several molecules in interaction, and for which each stable equilibrium corresponds to a possible phenotype (or 'biological trait'). In this paper, we focus on simple ODE systems modeling two molecules which each negatively (or positively) regulate the other. It is well-known that such models may lead to monostability or multistability, depending on the selected parameters. However, extensive numerical simulations have led systems biologists to conjecture that in the vast majority of cases, there cannot be more than two stable points. Our main result is a proof of this conjecture. More specifically, we provide a criterion ensuring at most bistability, which is indeed satisfied by most commonly used functions. This includes Hill functions, but also a wide family of convex and sigmoid functions. We also determine which parameters lead to monostability, and which lead to bistability, by developing a more general framework encompassing all our results.

An Esrrb and Nanog Cell Fate Regulatory Module Controlled by Feed Forward Loop Interactions

Cell fate decisions during development are governed by multi-factorial regulatory mechanisms including chromatin remodeling, DNA methylation, binding of transcription factors to specific loci, RNA transcription and protein synthesis. However, the mechanisms by which such regulatory “dimensions” coordinate cell fate decisions are currently poorly understood. Here we quantified the multi-dimensional molecular changes that occur in mouse embryonic stem cells (mESCs) upon depletion of Estrogen related receptor beta (Esrrb), a key pluripotency regulator. Comparative analyses of expression changes subsequent to depletion of Esrrb or Nanog, indicated that a system of interlocked feed-forward loops involving both factors, plays a central part in regulating the timing of mESC fate decisions. Taken together, our meta-analyses support a hierarchical model in which pluripotency is maintained by an Oct4-Sox2 regulatory module, while the timing of differentiation is regulated by a Nanog-Esrrb module.

Lighting up the central dogma for predictive developmental biology

Although the last 30years have witnessed the mapping of the wiring diagrams of the gene regulatory networks that dictate cell fate and animal body plans, specific understanding building on such network diagrams that shows how DNA regulatory regions control gene expression lags far behind. These networks have yet to yield the predictive power necessary to, for example, calculate how the concentration dynamics of input transcription factors and DNA regulatory sequence prescribes output patterns of gene expression that, in turn, determine body plans themselves. Here, we argue that reaching a predictive understanding of developmental decision-making calls for an interplay between theory and experiment aimed at revealing how the regulation of the processes of the central dogma dictate network connections and how network topology guides cells toward their ultimate developmental fate. To make this possible, it is crucial to break free from the snapshot-based understanding of embryonic development facilitated by fixed-tissue approaches and embrace new technologies that capture the dynamics of developmental decision-making at the single cell level, in living embryos.

The engineering principles of combining a transcriptional incoherent feedforward loop with negative feedback

Background

Regulation of gene expression is of paramount importance in all living systems. In the past two decades, it has been discovered that certain motifs, such as the feedforward motif, are overrepresented in gene regulatory circuits. Feedforward loops are also ubiquitous in process control engineering, and are nearly always structured so that one branch has the opposite effect of the other, which is a structure known as an “incoherent” feedforward loop in biology. In engineered systems, feedforward control loops are subject to several engineering constraints, including that (1) they are finely-tuned so that the system returns to the original steady state after a disturbance occurs (perfect adaptation), (2) they are typically only implemented in the combination with negative feedback, and (3) they can greatly improve the stability and dynamical characteristics of the conjoined negative feedback loop. On the other hand, in biology, incoherent feedforward loops can serve many purposes, one of which may be perfect adaptation. It is an open question as to whether those that achieve perfect adaptation are subject to the above engineering principles.

Results

We analyzed an incoherent feedforward gene regulatory motif from the standpoint of the above engineering principles. In particular, we showed that an incoherent feedforward loop Type 1 (I1-FFL), from within a gene regulatory circuit, can be finely-tuned for perfect adaptation after a stimulus, and that the robustness of this behavior is increased by the presence of moderate negative feedback. In addition, we analyzed the advantages of adding a feedforward loop to a system that already operated under negative feedback, and found that the dynamical properties of the combined feedforward/feedback system were superior.

Conclusions

Our analysis shows that many of the engineering principles used in engineering design of feedforward control are also applicable to feedforward loops in biological systems. We speculate that principles found in other domains of engineering may also be applicable to analogous structures in biology.

Electronic supplementary material

The online version of this article (10.1186/s13036-019-0190-3) contains supplementary material, which is available to authorized users.

Bayesian model selection for the Drosophila gap gene network

Background

The gap gene system controls the early cascade of the segmentation pathway in Drosophila melanogaster as well as other insects. Owing to its tractability and key role in embryo patterning, this system has been the focus for both computational modelers and experimentalists. The gap gene expression dynamics can be considered strictly as a one-dimensional process and modeled as a system of reaction-diffusion equations. While substantial progress has been made in modeling this phenomenon, there still remains a deficit of approaches to evaluate competing hypotheses. Most of the model development has happened in isolation and there has been little attempt to compare candidate models.

Results

The Bayesian framework offers a means of doing formal model evaluation. Here, we demonstrate how this framework can be used to compare different models of gene expression. We focus on the Papatsenko-Levine formalism, which exploits a fractional occupancy based approach to incorporate activation of the gap genes by the maternal genes and cross-regulation by the gap genes themselves. The Bayesian approach provides insight about relationship between system parameters. In the regulatory pathway of segmentation, the parameters for number of binding sites and binding affinity have a negative correlation. The model selection analysis supports a stronger binding affinity for Bicoid compared to other regulatory edges, as shown by a larger posterior mean. The procedure doesn’t show support for activation of Kruppel by Bicoid.

Conclusions

We provide an efficient solver for the general representation of the Papatsenko-Levine model. We also demonstrate the utility of Bayes factor for evaluating candidate models for spatial pattering models. In addition, by using the parallel tempering sampler, the convergence of Markov chains can be remarkably improved and robust estimates of Bayes factors obtained.

Electronic supplementary material

The online version of this article (10.1186/s12859-019-2888-0) contains supplementary material, which is available to authorized users.

A Tug-of-War Mechanism for Pattern Formation in a Genetic Network

Synthesizing spatial patterns with genetic networks is an ongoing challenge in synthetic biology. A successful demonstration of pattern formation would imply a better understanding of systems in the natural world and advance applications in synthetic biology. In developmental systems, transient patterning may suffice in order to imprint instructions for long-term development. In this paper we show that transient but persistent patterns can emerge from a realizable synthetic gene network based on a toggle switch. We show that a bistable system incorporating diffusible molecules can generate patterns that resemble Turing patterns but are distinctly different in the underlying mechanism: diffusion of mutually inhibiting molecules creates a prolonged "tug-of-war" between patches of cells at opposing bistable states. The patterns are transient but longer wavelength patterns persist for extended periods of time. Analysis of a representative small scale model implies the eigenvalues of the persistent modes are just above the threshold of stability. The results are verified through simulation of biologically relevant models.

Translating natural genetic variation to gene expression in a computational model of the Drosophila gap gene regulatory network

Annotating the genotype-phenotype relationship, and developing a proper quantitative description of the relationship, requires understanding the impact of natural genomic variation on gene expression. We apply a sequence-level model of gap gene expression in the early development of Drosophila to analyze single nucleotide polymorphisms (SNPs) in a panel of natural sequenced D. melanogaster lines. Using a thermodynamic modeling framework, we provide both analytical and computational descriptions of how single-nucleotide variants affect gene expression. The analysis reveals that the sequence variants increase (decrease) gene expression if located within binding sites of repressors (activators). We show that the sign of SNP influence (activation or repression) may change in time and space and elucidate the origin of this change in specific examples. The thermodynamic modeling approach predicts non-local and non-linear effects arising from SNPs, and combinations of SNPs, in individual fly genotypes. Simulation of individual fly genotypes using our model reveals that this non-linearity reduces to almost additive inputs from multiple SNPs. Further, we see signatures of the action of purifying selection in the gap gene regulatory regions. To infer the specific targets of purifying selection, we analyze the patterns of polymorphism in the data at two phenotypic levels: the strengths of binding and expression. We find that combinations of SNPs show evidence of being under selective pressure, while individual SNPs do not. The model predicts that SNPs appear to accumulate in the genotypes of the natural population in a way biased towards small increases in activating action on the expression pattern. Taken together, these results provide a systems-level view of how genetic variation translates to the level of gene regulatory networks via combinatorial SNP effects.

Predicting Ancestral Segmentation Phenotypes from Drosophila to Anopheles Using In Silico Evolution

Molecular evolution is an established technique for inferring gene homology but regulatory DNA turns over so rapidly that inference of ancestral networks is often impossible. In silico evolution is used to compute the most parsimonious path in regulatory space for anterior-posterior patterning linking two Dipterian species. The expression pattern of gap genes has evolved between Drosophila (fly) and Anopheles (mosquito), yet one of their targets, eve, has remained invariant. Our model predicts that stripe 5 in fly disappears and a new posterior stripe is created in mosquito, thus eve stripe modules 3+7 and 4+6 in fly are homologous to 3+6 and 4+5 in mosquito. We can place Clogmia on this evolutionary pathway and it shares the mosquito homologies. To account for the evolution of the other pair-rule genes in the posterior we have to assume that the ancestral Dipterian utilized a dynamic method to phase those genes in relation to eve.

The last common ancestor of the fruit fly (Drosophila) and mosquito (Anopheles) lived more than 200 Million years ago. Can we use available data on insects alive today to infer what their ancestor looked like? In this manuscript, we focus on early embryonic development, when stripes of genetic expression appear and define the location of insect segments (“segmentation”). We use an evolutionary algorithm to reconstruct and predict dynamics of genes controlling stripes in the last common ancestor of fly and mosquito. We predict a new and different combinatorial logic of stripe formation in mosquito compared to fly, which is fully consistent with development of intermediate species such as moth-fly (Clogmia). Our simulations further suggest that the dynamics of gene expression in this last common ancestor were similar to other insects, such as wasps (Nasonia). Our method illustrates how computational methods inspired by machine learning and non-linear physics can be used to infer gene dynamics in species that disappeared millions of years ago.

Single-Cell Analyses of ESCs Reveal Alternative Pluripotent Cell States and Molecular Mechanisms that Control Self-Renewal

Analyses of gene expression in single mouse embryonic stem cells (mESCs) cultured in serum and LIF revealed the presence of two distinct cell subpopulations with individual gene expression signatures. Comparisons with published data revealed that cells in the first subpopulation are phenotypically similar to cells isolated from the inner cell mass (ICM). In contrast, cells in the second subpopulation appear to be more mature. Pluripotency Gene Regulatory Network (PGRN) reconstruction based on single-cell data and published data suggested antagonistic roles for Oct4 and Nanog in the maintenance of pluripotency states. Integrated analyses of published genomic binding (ChIP) data strongly supported this observation. Certain target genes alternatively regulated by OCT4 and NANOG, such as Sall4 and Zscan10, feed back into the top hierarchical regulator Oct4. Analyses of such incoherent feedforward loops with feedback (iFFL-FB) suggest a dynamic model for the maintenance of mESC pluripotency and self-renewal.

•

Mouse embryonic stem cells grown on serum and LIF contain two subpopulations of cells

•

Oct4 and Nanog alternatively regulate a class of pluripotency genes

•

We demonstrate stabilization of Oct4 concentration and pluripotency via feedback control

•

The “state exchange” model explains self-renewal

Temporal and spatial dynamics of scaling-specific features of a gene regulatory network in Drosophila

A widely appreciated aspect of developmental robustness is pattern formation in proportion to size. But how such scaling features emerge dynamically remains poorly understood. Here we generate a data set of the expression profiles of six gap genes in Drosophila melanogaster embryos that differ significantly in size. Expression patterns exhibit size-dependent dynamics both spatially and temporally. We uncover a dynamic emergence of under-scaling in the posterior, accompanied by reduced expression levels of gap genes near the middle of large embryos. Simulation results show that a size-dependent Bicoid gradient input can lead to reduced Krüppel expression that can have long-range and dynamic effects on gap gene expression in the posterior. Thus, for emergence of scaled patterns, the entire embryo may be viewed as a single unified dynamic system where maternally derived size-dependent information interpreted locally can be propagated in space and time as governed by the dynamics of a gene regulatory network.

How pattern formation is regulated relative to the size of an organism is unclear. Here, Wu et al. take data from gap gene expression in flies of different sizes together with simulations, identifying how scaling emerges dynamically and that local patterning influences global gene regulatory networks.

Mid-embryo patterning and precision in Drosophila segmentation: Krüppel dual regulation of hunchback

In early development, genes are expressed in spatial patterns which later define cellular identities and tissue locations. The mechanisms of such pattern formation have been studied extensively in early Drosophila (fruit fly) embryos. The gap gene hunchback (hb) is one of the earliest genes to be expressed in anterior-posterior (AP) body segmentation. As a transcriptional regulator for a number of downstream genes, the spatial precision of hb expression can have significant effects in the development of the body plan. To investigate the factors contributing to hb precision, we used fine spatial and temporal resolution data to develop a quantitative model for the regulation of hb expression in the mid-embryo. In particular, modelling hb pattern refinement in mid nuclear cleavage cycle 14 (NC14) reveals some of the regulatory contributions of simultaneously-expressed gap genes. Matching the model to recent data from wild-type (WT) embryos and mutants of the gap gene Krüppel (Kr) indicates that a mid-embryo Hb concentration peak important in thoracic development (at parasegment 4, PS4) is regulated in a dual manner by Kr, with low Kr concentration activating hb and high Kr concentration repressing hb. The processes of gene expression (transcription, translation, transport) are intrinsically random. We used stochastic simulations to characterize the noise generated in hb expression. We find that Kr regulation can limit the positional variability of the Hb mid-embryo border. This has been recently corroborated in experimental comparisons of WT and Kr- mutant embryos. Further, Kr regulation can decrease uncertainty in mid-embryo hb expression (i.e. contribute to a smooth Hb boundary) and decrease between-copy transcriptional variability within nuclei. Since many tissue boundaries are first established by interactions between neighbouring gene expression domains, these properties of Hb-Kr dynamics to diminish the effects of intrinsic expression noise may represent a general mechanism contributing to robustness in early development.

A gene expression atlas of a bicoid-depleted Drosophila embryo reveals early canalization of cell fate

In developing embryos, gene regulatory networks drive cells towards discrete terminal fates, a process called canalization. We studied the behavior of the anterior-posterior segmentation network in Drosophila melanogaster embryos by depleting a key maternal input, bicoid (bcd), and measuring gene expression patterns of the network at cellular resolution. This method results in a gene expression atlas containing the levels of mRNA or protein expression of 13 core patterning genes over six time points for every cell of the blastoderm embryo. This is the first cellular resolution dataset of a genetically perturbed Drosophila embryo that captures all cells in 3D. We describe the technical developments required to build this atlas and how the method can be employed and extended by others. We also analyze this novel dataset to characterize the degree and timing of cell fate canalization in the segmentation network. We find that in two layers of this gene regulatory network, following depletion of bcd, individual cells rapidly canalize towards normal cell fates. This result supports the hypothesis that the segmentation network directly canalizes cell fate, rather than an alternative hypothesis whereby cells are initially mis-specified and later eliminated by apoptosis. Our gene expression atlas provides a high resolution picture of a classic perturbation and will enable further computational modeling of canalization and gene regulation in this transcriptional network.

NetExplore: a web server for modeling small network motifs

MOTIVATION

Quantitative and qualitative assessment of biological data often produces small essential recurrent networks, containing 3-5 components called network motifs. In this context, model solutions for small network motifs represent very high interest.

RESULTS

Software package NetExplore has been created in order to generate, classify and analyze solutions for network motifs including up to six network components. NetExplore allows plotting and visualization of the solution's phase spaces and bifurcation diagrams.

AVAILABILITY AND IMPLEMENTATION

The current version of NetExplore has been implemented in Perl-CGI and is accessible at the following locations: http://line.bioinfolab.net/nex/NetExplore.htm and http://nex.autosome.ru/nex/NetExplore.htm.

Multiscale modeling of dorsoventral patterning in Drosophila

The role of mathematical models of signaling networks is showcased by examples from Drosophila development. Three models of consecutive stages in dorsoventral patterning are presented. We begin with a compartmental model of intracellular reactions that generates a gradient of nuclear-localized Dorsal, exhibiting constant shape and dynamic amplitude. A simple thermodynamic model of equilibrium binding explains how a spatially uniform transcription factor, Zelda, can act in combination with a graded factor, Dorsal, to cooperatively regulate gene expression borders. Finally, we formulate a dynamic and stochastic model that predicts spatiotemporal patterns of Sog expression based on known patterns of its transcription factor, Dorsal. The future of coupling multifarious models across multiple temporal and spatial scales is discussed.

In silico evolution of the hunchback gene indicates redundancy in cis-regulatory organization and spatial gene expression

Biological development depends on the coordinated expression of genes in time and space. Developmental genes have extensive cis-regulatory regions which control their expression. These regions are organized in a modular manner, with different modules controlling expression at different times and locations. Both how modularity evolved and what function it serves are open questions. We present a computational model for the cis-regulation of the hunchback (hb) gene in the fruit fly (Drosophila). We simulate evolution (using an evolutionary computation approach from computer science) to find the optimal cis-regulatory arrangements for fitting experimental hb expression patterns. We find that the cis-regulatory region tends to readily evolve modularity. These cis-regulatory modules (CRMs) do not tend to control single spatial domains, but show a multi-CRM/multi-domain correspondence. We find that the CRM-domain correspondence seen in Drosophila evolves with a high probability in our model, supporting the biological relevance of the approach. The partial redundancy resulting from multi-CRM control may confer some biological robustness against corruption of regulatory sequences. The technique developed on hb could readily be applied to other multi-CRM developmental genes.

Cellular resolution models for even skipped regulation in the entire Drosophila embryo

Transcriptional control ensures genes are expressed in the right amounts at the correct times and locations. Understanding quantitatively how regulatory systems convert input signals to appropriate outputs remains a challenge. For the first time, we successfully model even skipped (eve) stripes 2 and 3+7 across the entire fly embryo at cellular resolution. A straightforward statistical relationship explains how transcription factor (TF) concentrations define eve's complex spatial expression, without the need for pairwise interactions or cross-regulatory dynamics. Simulating thousands of TF combinations, we recover known regulators and suggest new candidates. Finally, we accurately predict the intricate effects of perturbations including TF mutations and misexpression. Our approach imposes minimal assumptions about regulatory function; instead we infer underlying mechanisms from models that best fit the data, like the lack of TF-specific thresholds and the positional value of homotypic interactions. Our study provides a general and quantitative method for elucidating the regulation of diverse biological systems. DOI:http://dx.doi.org/10.7554/eLife.00522.001.

Biological signal processing with a genetic toggle switch

Complex gene regulation requires responses that depend not only on the current levels of input signals but also on signals received in the past. In digital electronics, logic circuits with this property are referred to as sequential logic, in contrast to the simpler combinatorial logic without such internal memory. In molecular biology, memory is implemented in various forms such as biochemical modification of proteins or multistable gene circuits, but the design of the regulatory interface, which processes the input signals and the memory content, is often not well understood. Here, we explore design constraints for such regulatory interfaces using coarse-grained nonlinear models and stochastic simulations of detailed biochemical reaction networks. We test different designs for biological analogs of the most versatile memory element in digital electronics, the JK-latch. Our analysis shows that simple protein-protein interactions and protein-DNA binding are sufficient, in principle, to implement genetic circuits with the capabilities of a JK-latch. However, it also exposes fundamental limitations to its reliability, due to the fact that biological signal processing is asynchronous, in contrast to most digital electronics systems that feature a central clock to orchestrate the timing of all operations. We describe a seemingly natural way to improve the reliability by invoking the master-slave concept from digital electronics design. This concept could be useful to interpret the design of natural regulatory circuits, and for the design of synthetic biological systems.

Global parameter estimation for thermodynamic models of transcriptional regulation

Deciphering the mechanisms involved in gene regulation holds the key to understanding the control of central biological processes, including human disease, population variation, and the evolution of morphological innovations. New experimental techniques including whole genome sequencing and transcriptome analysis have enabled comprehensive modeling approaches to study gene regulation. In many cases, it is useful to be able to assign biological significance to the inferred model parameters, but such interpretation should take into account features that affect these parameters, including model construction and sensitivity, the type of fitness calculation, and the effectiveness of parameter estimation. This last point is often neglected, as estimation methods are often selected for historical reasons or for computational ease. Here, we compare the performance of two parameter estimation techniques broadly representative of local and global approaches, namely, a quasi-Newton/Nelder-Mead simplex (QN/NMS) method and a covariance matrix adaptation-evolutionary strategy (CMA-ES) method. The estimation methods were applied to a set of thermodynamic models of gene transcription applied to regulatory elements active in the Drosophila embryo. Measuring overall fit, the global CMA-ES method performed significantly better than the local QN/NMS method on high quality data sets, but this difference was negligible on lower quality data sets with increased noise or on data sets simplified by stringent thresholding. Our results suggest that the choice of parameter estimation technique for evaluation of gene expression models depends both on quality of data, the nature of the models [again, remains to be established] and the aims of the modeling effort.

Post-GWAS: where next? More samples, more SNPs or more biology?

The power of genome-wide association studies (GWAS) rests on several foundations: (i) there is a significant amount of additive genetic variation, (ii) individual causal polymorphisms often have sizable effects and (iii) they segregate at moderate-to-intermediate frequencies, or will be effectively 'tagged' by polymorphisms that do. Each of these assumptions has recently been questioned. (i) Why should genetic variation appear additive given that the underlying molecular networks are highly nonlinear? (ii) A new generation of relatedness-based analyses directs us back to the nearly infinitesimal model for effect sizes that quantitative genetics was long based upon. (iii) Larger effect causal polymorphisms are often low frequency, as selection might lead us to expect. Here, we review these issues and other findings that appear to question many of the foundations of the optimism GWAS prompted. We then present a roadmap emerging as one possible future for quantitative genetics. We argue that in future GWAS should move beyond purely statistical grounds. One promising approach is to build upon the combination of population genetic models and molecular biological knowledge. This combined treatment, however, requires fitting experimental data to models that are very complex, as well as accurate capturing of the uncertainty of resulting inference. This problem can be resolved through Bayesian analysis and tools such as approximate Bayesian computation-a method growing in popularity in population genetic analysis. We show a case example of anterior-posterior segmentation in Drosophila, and argue that similar approaches will be helpful as a GWAS augmentation, in human and agricultural research.

A primer on thermodynamic-based models for deciphering transcriptional regulatory logic

A rigorous analysis of transcriptional regulation at the DNA level is crucial to the understanding of many biological systems. Mathematical modeling has offered researchers a new approach to understanding this central process. In particular, thermodynamic-based modeling represents the most biophysically informed approach aimed at connecting DNA level regulatory sequences to the expression of specific genes. The goal of this review is to give biologists a thorough description of the steps involved in building, analyzing, and implementing a thermodynamic-based model of transcriptional regulation. The data requirements for this modeling approach are described, the derivation for a specific regulatory region is shown, and the challenges and future directions for the quantitative modeling of gene regulation are discussed.

Dynamic interpretation of maternal inputs by the Drosophila segmentation gene network

Patterning of body parts in multicellular organisms relies on the interpretation of transcription factor (TF) concentrations by genetic networks. To determine the extent by which absolute TF concentration dictates gene expression and morphogenesis programs that ultimately lead to patterns in Drosophila embryos, we manipulate maternally supplied patterning determinants and measure readout concentration at the position of various developmental markers. When we increase the overall amount of the maternal TF Bicoid (Bcd) fivefold, Bcd concentrations in cells at positions of the cephalic furrow, an early morphological marker, differ by a factor of 2. This finding apparently contradicts the traditional threshold-dependent readout model, which predicts that the Bcd concentrations at these positions should be identical. In contrast, Bcd concentration at target gene expression boundaries is nearly unchanged early in development but adjusts dynamically toward the same twofold change as development progresses. Thus, the Drosophila segmentation gene network responds faithfully to Bcd concentration during early development, in agreement with the threshold model, but subsequently partially adapts in response to altered Bcd dosage, driving segmentation patterns toward their WT positions. This dynamic response requires other maternal regulators, such as Torso and Nanos, suggesting that integration of maternal input information is not achieved through molecular interactions at the time of readout but through the subsequent collective interplay of the network.

TWO-LAYER MATHEMATICAL MODELING OF GENE EXPRESSION: INCORPORATING DNA-LEVEL INFORMATION AND SYSTEM DYNAMICS

High-throughput genome sequencing and transcriptome analysis have provided researchers with a quantitative basis for detailed modeling of gene expression using a wide variety of mathematical models. Two of the most commonly employed approaches used to model eukaryotic gene regulation are systems of differential equations, which describe time-dependent interactions of gene networks, and thermodynamic equilibrium approaches that can explore DNA-level transcriptional regulation. To combine the strengths of these approaches, we have constructed a new two-layer mathematical model that provides a dynamical description of gene regulatory systems, using detailed DNA-based information, as well as spatial and temporal transcription factor concentration data. We also developed a semi-implicit numerical algorithm for solving the model equations and demonstrate here the efficiency of this algorithm through stability and convergence analyses. To test the model, we used it together with the semi-implicit algorithm to simulate a Drosophila gene regulatory circuit that drives development in the dorsal-ventral axis of the blastoderm-stage embryo, involving three genes. For model validation, we have done both mathematical and statistical comparisons between the experimental data and the model's simulated data. Where protein and cis-regulatory information is available, our two-layer model provides a method for recapitulating and predicting dynamic aspects of eukaryotic transcriptional systems that will greatly improve our understanding of gene regulation at a global level.

Accurate measurements of dynamics and reproducibility in small genetic networks

Quantification of gene expression has become a central tool for understanding genetic networks. In many systems, the only viable way to measure protein levels is by immunofluorescence, which is notorious for its limited accuracy. Using the early Drosophila embryo as an example, we show that careful identification and control of experimental error allows for highly accurate gene expression measurements. We generated antibodies in different host species, allowing for simultaneous staining of four Drosophila gap genes in individual embryos. Careful error analysis of hundreds of expression profiles reveals that less than ∼20% of the observed embryo-to-embryo fluctuations stem from experimental error. These measurements make it possible to extract not only very accurate mean gene expression profiles but also their naturally occurring fluctuations of biological origin and corresponding cross-correlations. We use this analysis to extract gap gene profile dynamics with ∼1 min accuracy. The combination of these new measurements and analysis techniques reveals a twofold increase in profile reproducibility owing to a collective network dynamics that relays positional accuracy from the maternal gradients to the pair-rule genes.

Mutual repression enhances the steepness and precision of gene expression boundaries

Embryonic development is driven by spatial patterns of gene expression that determine the fate of each cell in the embryo. While gene expression is often highly erratic, embryonic development is usually exceedingly precise. In particular, gene expression boundaries are robust not only against intra-embryonic fluctuations such as noise in gene expression and protein diffusion, but also against embryo-to-embryo variations in the morphogen gradients, which provide positional information to the differentiating cells. How development is robust against intra- and inter-embryonic variations is not understood. A common motif in the gene regulation networks that control embryonic development is mutual repression between pairs of genes. To assess the role of mutual repression in the robust formation of gene expression patterns, we have performed large-scale stochastic simulations of a minimal model of two mutually repressing gap genes in Drosophila, hunchback (hb) and knirps (kni). Our model includes not only mutual repression between hb and kni, but also the stochastic and cooperative activation of hb by the anterior morphogen Bicoid (Bcd) and of kni by the posterior morphogen Caudal (Cad), as well as the diffusion of Hb and Kni between neighboring nuclei. Our analysis reveals that mutual repression can markedly increase the steepness and precision of the gap gene expression boundaries. In contrast to other mechanisms such as spatial averaging and cooperative gene activation, mutual repression thus allows for gene-expression boundaries that are both steep and precise. Moreover, mutual repression dramatically enhances their robustness against embryo-to-embryo variations in the morphogen levels. Finally, our simulations reveal that diffusion of the gap proteins plays a critical role not only in reducing the width of the gap gene expression boundaries via the mechanism of spatial averaging, but also in repairing patterning errors that could arise because of the bistability induced by mutual repression.

Modeling of gap gene expression in Drosophila Kruppel mutants

The segmentation gene network in Drosophila embryo solves the fundamental problem of embryonic patterning: how to establish a periodic pattern of gene expression, which determines both the positions and the identities of body segments. The gap gene network constitutes the first zygotic regulatory tier in this process. Here we have applied the systems-level approach to investigate the regulatory effect of gap gene Kruppel (Kr) on segmentation gene expression. We acquired a large dataset on the expression of gap genes in Kr null mutants and demonstrated that the expression levels of these genes are significantly reduced in the second half of cycle 14A. To explain this novel biological result we applied the gene circuit method which extracts regulatory information from spatial gene expression data. Previous attempts to use this formalism to correctly and quantitatively reproduce gap gene expression in mutants for a trunk gap gene failed, therefore here we constructed a revised model and showed that it correctly reproduces the expression patterns of gap genes in Kr null mutants. We found that the remarkable alteration of gap gene expression patterns in Kr mutants can be explained by the dynamic decrease of activating effect of Cad on a target gene and exclusion of Kr gene from the complex network of gap gene interactions, that makes it possible for other interactions, in particular, between hb and gt, to come into effect. The successful modeling of the quantitative aspects of gap gene expression in mutant for the trunk gap gene Kr is a significant achievement of this work. This result also clearly indicates that the oversimplified representation of transcriptional regulation in the previous models is one of the reasons for unsuccessful attempts of mutant simulations.

Systems biology is aimed to develop an understanding of biological function or process as a system of interacting components. Here we apply the systems-level approach to understand how the blueprints for segments in the fruit fly Drosophila embryo arise. We obtain gene expression data and use the gene circuits method which allow us to reconstruct the segment determination process in the computer. To understand the system we need not only to describe it in detail, but also to comprehend what happens when certain stimuli or disruptions occur. Previous attempts to model segmentation gene expression patterns in a mutant for a trunk gap gene were unsuccessful. Here we describe the extension of the model that allows us to solve this problem in the context of Kruppel (Kr) gene. We show that remarkable alteration of gap gene expression patterns in Kr mutants can be explained by dynamic decrease of the activating effect of Cad on a target gene and exclusion of Kr from the complex network of gap gene interactions, that makes it possible for other interactions, in particular between hb and gt, to come into effect.

The role of Bicoid cooperative binding in the patterning of sharp borders in Drosophila melanogaster

In Drosophila embryonic development, the Bicoid (Bcd) protein establishes positional information of downstream developmental genes like hunchback (hb), which has a strong anterior expression and a sharp on-off boundary in the mid-embryo. The role of Bcd cooperative binding in the positioning of the Hb pattern has been previously demonstrated. However, there are discrepancies in the reported results about the role of this mechanism in the sharp Hb border. Here, we determined the Hill coefficient (nH) required for Bcd to generate the sharp border of Hb in wild-type (WT) embryos. We found that an n(H) of approximately 6.3 (s.d. 1.4) and 10.8 (s.d. 4.0) is required to account for Hb sharpness at early and late cycle 14A, respectively. Additional mechanisms are possibly required because the high nH is likely unachievable for Bcd binding to the hb promoter. To test this idea, we determined the nH required to pattern the Hb profile of 15 embryos expressing an hb14F allele that is defective in self-activation and found nH to be 3.0 (s.d. 1.0). This result indicates that in WT embryos, the hb self-activation is important for Hb sharpness. Corroborating our results, we also found a progressive increase in the required value of n(H) spanning from 4.0 to 9.2 by determining this coefficient from averaged profiles of eight temporal classes at cycle 14A (T1 to T8). Our results indicate that there is a transition in the mechanisms responsible for the sharp Hb border during cycle 14A: in early stages of this cycle, Bcd cooperative binding is primarily responsible for Hb sharpness; in late cycle 14A, hb self-activation becomes the dominant mechanism.